checkasm: decrease cdef filter min damping value

The chroma damping being set to luma damping - 1, we need to decrease
the minimum damping value to ensure a proper clipping test for
clip(0, d - log2(s)).
parent ada9231c
......@@ -67,7 +67,7 @@ static void check_cdef_filter(const cdef_fn fn, const int w, const int h,
memcpy(c_src, src, (10 * 16 + 8) * sizeof(pixel));
const int lvl = 1 + (rnd() % 62);
const int damping = 3 + (rnd() & 3) + bitdepth_min_8;
const int damping = 3 + (rnd() & 3) + bitdepth_min_8 - (w == 4 || (rnd() & 1));
const int pri_strength = (lvl >> 2) << bitdepth_min_8;
int sec_strength = lvl & 3;
sec_strength += sec_strength == 3;
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment