Skip to content

Add SYCL logic in whisper #1863

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 22 commits into from
Feb 23, 2024
Merged

Add SYCL logic in whisper #1863

merged 22 commits into from
Feb 23, 2024

Conversation

abhilash1910
Copy link
Contributor

Following abstraction from #2690 Feature: Integrate with unified SYCL backend for Intel GPUs some modifications are made to ensure functionality with SYCL on whisper. The ggml sycl files are already updated and was missing some frontend and CI pipelines.
@airMeng @luoyu-intel @NeoZhangJianyu please review once when available. (Keeping it as draft as examples need to be updated)
(cc @ggerganov )

@abhilash1910 abhilash1910 marked this pull request as draft February 13, 2024 12:14
@abhilash1910 abhilash1910 marked this pull request as ready for review February 22, 2024 10:46
@abhilash1910
Copy link
Contributor Author

@ggerganov the android build https://github.com/ggerganov/whisper.cpp/actions/runs/8001183554/job/21851909961 seems to be failing . Requesting review .

@ggerganov
Copy link
Member

I'm hoping that after the latest changes, the CI will be green and then will review this PR

@ggerganov ggerganov merged commit a0ddd83 into ggml-org:master Feb 23, 2024
jiahansu pushed a commit to WiseSync/whisper.cpp that referenced this pull request Apr 17, 2024
* add changes from llama upstream

* add sycl abstraction

* add sycl build

* update cmake

* add sycl build config

* fix bug

* fix bug

* refactor build

* fix bug

* update build

* call build

* use sycl header

* add examples

* add target

* fix typecast in quant.c

* readd fp16 and readme

* fix quant typecast

* add sample

* add readme

* remove cxx file check
viktor-silakov pushed a commit to viktor-silakov/whisper_node_mic.cpp that referenced this pull request May 11, 2024
* add changes from llama upstream

* add sycl abstraction

* add sycl build

* update cmake

* add sycl build config

* fix bug

* fix bug

* refactor build

* fix bug

* update build

* call build

* use sycl header

* add examples

* add target

* fix typecast in quant.c

* readd fp16 and readme

* fix quant typecast

* add sample

* add readme

* remove cxx file check
iThalay pushed a commit to iThalay/whisper.cpp that referenced this pull request Sep 23, 2024
* add changes from llama upstream

* add sycl abstraction

* add sycl build

* update cmake

* add sycl build config

* fix bug

* fix bug

* refactor build

* fix bug

* update build

* call build

* use sycl header

* add examples

* add target

* fix typecast in quant.c

* readd fp16 and readme

* fix quant typecast

* add sample

* add readme

* remove cxx file check
iThalay pushed a commit to iThalay/whisper.cpp that referenced this pull request Sep 23, 2024
* add changes from llama upstream

* add sycl abstraction

* add sycl build

* update cmake

* add sycl build config

* fix bug

* fix bug

* refactor build

* fix bug

* update build

* call build

* use sycl header

* add examples

* add target

* fix typecast in quant.c

* readd fp16 and readme

* fix quant typecast

* add sample

* add readme

* remove cxx file check
@hlevring
Copy link

@abhilash1910 are you still working on this to support windows?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants