Skip to content

feat: update llama.cpp to v0.4.0 - #2367

Merged
abetlen merged 1 commit into
mainfrom
feat/update-llama-cpp-v0.4.0
Sep 12, 2026
Merged

abetlen merged 1 commit into
mainfrom
feat/update-llama-cpp-v0.4.0

Conversation

@abetlen

@abetlen abetlen commented Sep 12, 2026

Copy link
Copy Markdown
Owner

Update the vendored llama.cpp to the latest versioned release, v0.4.0 (5266f24da).

  • Synchronize model-loading, quantization, and MTMD ctypes layouts and bind the new MTMD input-parts and placeholder APIs.
  • Pass the new media-helper options in the example server while retaining default options for existing Python helper calls.
  • Inherit upstream MTMD library version variables and update the native state-format constants and changelog.

Previously serialized native context states must be regenerated after this update.

Validation: CPU build, 26 tests, C/ctypes ABI checks, Qwen 0.8B MTMD image smoke test, and Ruff checks passed locally.

@abetlen
abetlen merged commit d736646 into main Sep 12, 2026
15 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant