INCIDENT MAP

Browse / AI Framework and Platform Flaws / CVE-2024-12704

LlamaIndex Improper Handling of Exceptional Conditions vulnerability

CVE-2024-12704 ยท 2025-03-20 high

Class
AI Framework and Platform Flaws (filed by a model that read the advisory)
Technique
Denial of service
Affected
llama-index-core (PyPI)
CVSS
CVSS:3.0/AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H
EPSS
0.8% chance of exploitation in 30 days

How it works, in short

A wrong-typed input makes a worker thread exit early, and the streaming handler then waits forever for a response that never arrives. (Our summary, written by a model. The source text is below.)

Details

A vulnerability in the LangChainLLM class of the run-llama/llama_index repository, version v0.12.5, allows for a Denial of Service (DoS) attack. The stream_complete method executes the llm using a thread and retrieves the result via the get_response_gen method of the StreamingGeneratorCallbackHandler class. If the thread terminates abnormally before the _llm.predict is executed, there is no exception handling for this case, leading to an infinite loop in the get_response_gen function. This can be triggered by providing an input of an incorrect type, causing the thread to terminate and the process to continue running indefinitely.

References

Source: GitHub Advisory Database, used under CC BY 4.0.