Read the docs
TI-2024-22699 Aliases CVE-2024-34359GHSA-56xg-wfcc-g829

llama-cpp-python vulnerable to Remote Code Execution by Server-Side Template Injection in Model Metadata

Priority HIGH 76CWE-76Published · Updated

Key facts

Attack vector
Network
Privileges required
None
User interaction
Required
Attack complexity
Low
Impact type
—
Confidentiality · integrity · availability
High · High · High
Fix status
Fixed

Attack profile from CVSS 3.1 · CNA. Fix status from CNA and GitHub.

Summary

llama-cpp-python is the Python bindings for llama.cpp. `llama-cpp-python` depends on class `Llama` in `llama.py` to load `.gguf` llama.cpp or Latency Machine Learning Models. The `__init__` constructor built in the `Llama` takes several parameters to configure the loading and running of the model. Other than `NUMA, LoRa settings`, `loading tokenizers,` and `hardware settings`, `__init__` also loads the `chat template` from targeted `.gguf` 's Metadata and furtherly parses it to `llama_chat_format.Jinja2ChatFormatter.to_chat_handler()` to construct the `self.chat_handler` for this model. Nevertheless, `Jinja2ChatFormatter` parse the `chat template` within the Metadate with sandbox-less `jinja2.Environment`, which is furthermore rendered in `__call__` to construct the `prompt` of interaction. This allows `jinja2` Server Side Template Injection which leads to remote code execution by a carefully constructed payload.

Why it matters now

Exploitation Proof of concept CISA SSVC · not in CISA KEV
EPSS 0.26001 97th percentileScored 2026-11-07
Fix Fixed llama-cpp-python (PyPI): 0.2.72

SSVC decision points

CISA ADP · SSVC 2.0.3

Exploitation
Poc
Automatable
No
Technical impact
Total

The decision (Track, Attend, Act) also depends on your mission and well-being impact; see CISA's SSVC guide.

Affected products

VendorProductAffected versionsFixed inStatusSource
abetlenllama-cpp-python0.2.30 – 0.2.71—No fix listedCNA
—llama-cpp-python (PyPI)0.2.30 to before 0.2.720.2.72Patch availableGHSA-56xg-wfcc-g829
  • llama-cpp-python Vendorabetlen Affected 0.2.30 – 0.2.71 Fixed in — No fix listed CNA
  • llama-cpp-python (PyPI) Vendor— Affected 0.2.30 to before 0.2.72 Fixed in 0.2.72 Patch available GHSA-56xg-wfcc-g829

CPE names CISA-ADP · 1

CPEVersionsRoleVendor
cpe:2.3:a:abetlen:llama-cpp-python:*:*:*:*:*:*:*:*——abetlen
  • cpe:2.3:a:abetlen:llama-cpp-python:*:*:*:*:*:*:*:* Versions — — ·abetlen

Remediation

  • Fix · GHSA-56xg-wfcc-g829 llama-cpp-python (PyPI) Fixed in 0.2.72 Advisory →

Timeline

  1. 2026-10-02 Threatist record created from CVE-2024-34359
  2. 2026-10-03 Alias added: GHSA-56xg-wfcc-g829

References

Sources