Skip to content
Snippets Groups Projects
Commit 0c8a3461 authored by Henrik Gramner's avatar Henrik Gramner
Browse files

x86: Fix clipping in high bit-depth AVX2 4x16 IDCT 

Certain clips were incorrectly performed on negated values, which
caused things to be off-by-one in both directions. Correct this by
negating such values prior to clipping instead of afterwards.
parent cc9651f5
No related branches found
No related tags found
1 merge request!1453x86: Fix mismatches in high bit-depth AVX2 IDCT/IADST
Hide whitespace changes
Inline Side-by-side
Showing
with 40 additions and 26 deletions
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment

VideoLAN code repository instance