drm/gem: Fix inconsistent plane dimension calculation in drm_gem_fb_init_with_funcs()
Linux
Affected versions
| Product | Affected | Fixed in |
|---|---|---|
| Linux Linux |
|
Linux
| Product | Affected | Fixed in |
|---|---|---|
| Linux Linux |
|
≥ 4c3dbb2c312c9fafbac30d98c523b8b1f3455d78 · < 1a17ea9861e89585361caa8bc231bd22dc6dbe7d| No fix yet |
| Linux Linux |
|
|
In the Linux kernel, the following vulnerability has been resolved:
drm/gem: Fix inconsistent plane dimension calculation in drm_gem_fb_init_with_funcs()
drm_gem_fb_init_with_funcs() computes sub-sampled plane dimensions using plain integer division:
unsigned int width = mode_cmd->width / (i ? info->hsub : 1); unsigned int height = mode_cmd->height / (i ? info->vsub : 1);
However, the ioctl-level framebuffer_check() in drm_framebuffer.c uses drm_format_info_plane_width/height() which round up dimensions via DIV_ROUND_UP(). This inconsistency corrupts the subsequent GEM object size check for certain pixel format and dimension combinations.
For example, with NV12 (vsub=2) and a 1-pixel-tall framebuffer the GEM size validation path sees height=0 instead of height=1. The expression (height - 1) then wraps to UINT_MAX as an unsigned int, causing min_size to overflow and wrap back to a small value. A tiny GEM object therefore passes the size guard, yet when the GPU accesses the chroma plane it will read or write memory beyond the object's bounds.
Fix by replacing the open-coded divisions with drm_format_info_plane_width() and drm_format_info_plane_height(), which use DIV_ROUND_UP() and match the calculation already used in framebuffer_check().
From the CVE record · Linux
The Linux kernel’s DRM GEM framebuffer initialization can calculate subsampled plane dimensions incorrectly, allowing an undersized GEM object to pass validation. A local user who can submit a framebuffer with an affected pixel format and dimensions could cause the GPU to read or write beyond the object’s bounds. The input does not specify authentication requirements or additional user interaction.
Engineers running the Linux kernel should check their versions against the vendor advisory; affected versions are not specified in the input.