ExLlamaV2 out-of-bounds write in GPTQ index handling
turboderp-org ExLlamaV2
Affected versions
| Product | Affected | Fixed in |
|---|---|---|
| turboderp-org ExLlamaV2 |
| No fix yet |
Original description
A flaw has been found in turboderp-org ExLlamaV2 up to 0.3.2. The impacted element is the function QMatrix::make_sequential of the file exllamav2/exllamav2_ext/cuda/q_matrix.cu of the component GPTQ Index Handler. Executing a manipulation of the argument g_idx can lead to out-of-bounds write. The attack needs to be launched locally. The project was informed of the problem early through an issue report but has not responded yet.
From the CVE record · VulDB