Browse / AI Framework and Platform Flaws / CVE-2024-12704
LlamaIndex Improper Handling of Exceptional Conditions vulnerability
- Class
- AI Framework and Platform Flaws (filed by a model that read the advisory)
- Technique
- Denial of service
- Affected
- llama-index-core (PyPI)
- CVSS
- CVSS:3.0/AV:N/AC:L/PR:N/UI:N/S:U/C:N/I:N/A:H
- EPSS
- 0.8% chance of exploitation in 30 days
How it works, in short
A wrong-typed input makes a worker thread exit early, and the streaming handler then waits forever for a response that never arrives. (Our summary, written by a model. The source text is below.)
Details
A vulnerability in the LangChainLLM class of the run-llama/llama_index repository, version v0.12.5, allows for a Denial of Service (DoS) attack. The stream_complete method executes the llm using a thread and retrieves the result via the get_response_gen method of the StreamingGeneratorCallbackHandler class. If the thread terminates abnormally before the _llm.predict is executed, there is no exception handling for this case, leading to an infinite loop in the get_response_gen function. This can be triggered by providing an input of an incorrect type, causing the thread to terminate and the process to continue running indefinitely.
References
- https://nvd.nist.gov/vuln/detail/CVE-2024-12704
- https://github.com/run-llama/llama_index/commit/d1ecfb77578d089cbe66728f18f635c09aa32a05
- https://github.com/run-llama/llama_index
- https://huntr.com/bounties/a0b638fd-21c6-4ba7-b381-6ab98472a02a
Source: GitHub Advisory Database, used under CC BY 4.0.