Search results

nix: use optionalAttrs for <code>env</code> mkDerivation attrset argument

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

nixIssues specific to consuming flake.nix, or generally concerned with ❄ Nix-based llama.cpp deploymentIssues specific to consuming flake.nix, or generally concerned with ❄ Nix-based llama.cpp deployment

Status: Open (in progress).

ggml-org/llama.cppnumber 14726

#14726 In ggml-org/llama.cpp;

· amozeo opened on Jul 16, 2025

ci : disable failing vulkan crossbuilds

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

Status: Open (in progress).

ggml-org/llama.cppnumber 14723

#14723 In ggml-org/llama.cpp;

· CISC opened on Jul 16, 2025

HIP: Enable Matrix cores for MMQ Kernels, Enable stream-K for CDNA 3

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 14624

#14624 In ggml-org/llama.cpp;

· deepsek opened on Jul 10, 2025

docker : add cann build pipline

Ascend NPUissues specific to Ascend NPUsissues specific to Ascend NPUs

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Status: Open (in progress).

ggml-org/llama.cppnumber 14591

#14591 In ggml-org/llama.cpp;

· diannaojiang opened on Jul 9, 2025

musa: upgrade musa sdk to 4.2.0

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

documentationImprovements or additions to documentationImprovements or additions to documentation

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Draft (not ready).

ggml-org/llama.cppnumber 14498

#14498 In ggml-org/llama.cpp;

· yeahdongcn opened on Jul 2, 2025

Added CI with RISC-V RVV1.0 Hardware

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

Status: Open (in progress).

ggml-org/llama.cppnumber 14439

#14439 In ggml-org/llama.cpp;

· alitariq4589 opened on Jun 29, 2025

ci: re-enable rocm linux build, reduce the built targets to the ones currently available in rocblas

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

Status: Open (in progress).

ggml-org/llama.cppnumber 14184

#14184 In ggml-org/llama.cpp;

· IMbackK opened on Jun 14, 2025

docker : enable RPC for docker images

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

Status: Draft (not ready).

ggml-org/llama.cppnumber 13474

#13474 In ggml-org/llama.cpp;

· rgerganov opened on May 12, 2025

CUDA: update build CTK version to 12.8

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

Status: Open (in progress).

ggml-org/llama.cppnumber 13360

#13360 In ggml-org/llama.cpp;

· thevishalagarwal opened on May 7, 2025

Nix portability improvements

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

nixIssues specific to consuming flake.nix, or generally concerned with ❄ Nix-based llama.cpp deploymentIssues specific to consuming flake.nix, or generally concerned with ❄ Nix-based llama.cpp deployment

Status: Open (in progress).

ggml-org/llama.cppnumber 13005

#13005 In ggml-org/llama.cpp;

· hacker1024 opened on Apr 18, 2025

<code>tool-call</code>: Phi-4 support

androidIssues specific to AndroidIssues specific to Android

Apple Metalhttps://en.wikipedia.org/wiki/Metal_(API)https://en.wikipedia.org/wiki/Metal_(API)

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

documentationImprovements or additions to documentationImprovements or additions to documentation

examples

ggmlchanges relating to the ggml tensor library for machine learningchanges relating to the ggml tensor library for machine learning

Nvidia GPUIssues specific to Nvidia GPUsIssues specific to Nvidia GPUs

pythonpython script changespython script changes

server

SYCLhttps://en.wikipedia.org/wiki/SYCL - GPU programming languagehttps://en.wikipedia.org/wiki/SYCL - GPU programming language

testingEverything test relatedEverything test related

VulkanIssues specific to the Vulkan backendIssues specific to the Vulkan backend

Status: Open (in progress).

ggml-org/llama.cppnumber 12288

#12288 In ggml-org/llama.cpp;

· jpohhhh opened on Mar 9, 2025

<code>ci</code>: only *write ccache in "push to master" jobs

devopsimprovements to build systems and github actionsimprovements to build systems and github actions

Status: Draft (not ready).

ggml-org/llama.cppnumber 11661

#11661 In ggml-org/llama.cpp;

· ochafik opened on Feb 4, 2025