CVE-2024-8939: DoS Vulnerability in vllm JSON Web API

Bug 2312782 (CVE-2024-8939) - CVE-2024-8939 vllm: Denials of Service in vllm JSON web API Key Information: Bug ID: 2312782 CVE ID: CVE-2024-8939 Title: Denials of Service in vllm JSON web API Reported: 2024-09-17 08:14 UTC by OSIDB Bzimport Modified: 2024-09-17 15:41 UTC Status: NEW Product: Security Response Component: vulnerability Version: unspecified Hardware: All OS: Linux Priority: medium Severity: medium Target Milestone: --- Assignee: Product Security DevOps Team Doc Type: 1 Doc Text: A vulnerability was found in the ilab model serve component, where improper handling of the best_of parameter in the vllm JSON web API can lead to a Denial of Service (DoS). The API used for LLM-based sentence or chat completion accepts a best_of parameter to return the best completion from several options. When this parameter is set to a large value, the API does not handle timeouts or resource exhaustion properly, allowing an attacker to cause a DoS by consuming excessive system resources. This leads to the API becoming unresponsive, preventing legitimate users from accessing the service. Additional Information: Environment: Not specified Last Closed: Not applicable Embargoed: Not applicable Attachments: Description: An improper timeout handling vulnerability exists in the ilab model serve component, which wraps the vllm JSON web API for interaction with a Large Language Model (LLM). When processing completion requests, the API accepts a parameter best_of that can cause excessive processing time if set to a large value. This improper handling can lead to a Denial of Service (DoS), making the API unresponsive to legitimate users. The issue primarily affects instances where the API is exposed beyond localhost. Note: You need to log in before you can comment on or make changes to this bug.

Goal Reached Thanks to every supporter — we hit 100%!

CVE-2024-8939: DoS Vulnerability in vllm JSON Web API