ExLlamaV3 out-of-bounds read in hash-MoE routing
Turboderp-org ExLlamaV3
Affected versions
| Product | Affected | Fixed in |
|---|---|---|
| Turboderp-org ExLlamaV3 |
|
|
Original description
A weakness has been identified in Turboderp-org ExLlamaV3 up to 1.6.3. The impacted element is the function routing_sel_norm_kernel of the file exllamav3/exllamav3_ext/routing.cu of the component hash-MoE routing. This manipulation of the argument gate.tid2eid causes out-of-bounds read. Remote exploitation of the attack is possible. Upgrading to version 1.6.4 is sufficient to resolve this issue. Patch name: c9a57ae832a3035e264e0a412e1daf4ebb699b98. Upgrading the affected component is recommended.