INCIDENT MAP

Browse / Unsafe Model Loading and Supply Chain / CVE-2024-2952

LiteLLM has Server-Side Template Injection vulnerability in /completions endpoint

CVE-2024-2952 ยท 2024-04-10 critical

Class
Unsafe Model Loading and Supply Chain (filed by a model that read the advisory)
Technique
Code and command execution
Affected
litellm (PyPI)
CVSS
CVSS:3.0/AV:N/AC:L/PR:N/UI:N/S:U/C:H/I:H/A:H
EPSS
1.3% chance of exploitation in 30 days

How it works, in short

A malicious tokenizer_config.json supplies a chat_template that LiteLLM renders with Jinja unsafely, executing code on the server when the model is used. (Our summary, written by a model. The source text is below.)

Details

BerriAI/litellm is vulnerable to Server-Side Template Injection (SSTI) via the /completions endpoint. The vulnerability arises from the hf_chat_template method processing the chat_template parameter from the tokenizer_config.json file through the Jinja template engine without proper sanitization. Attackers can exploit this by crafting malicious tokenizer_config.json files that execute arbitrary code on the server.

References

Source: GitHub Advisory Database, used under CC BY 4.0.