Commit e5bca59c authored by Janne Grunau's avatar Janne Grunau

itx: cancel 16 out of '(x * 2896) >> 12' to avoid integer overflows

Fixes an integer overflow in inv_dct4_1d with
clusterfuzz-testcase-dav1d_fuzzer-5634807321591808 and in inv_adst16_1d
with clusterfuzz-testcase-dav1d_fuzzer-5761827623927808. Credits to oss-fuzz.
parent 1d3f6364
Pipeline #3513 passed with stages
in 4 minutes and 52 seconds