• Janne Grunau's avatar
    itx: clip according to spec, fixes #103, #158 · 5098b23a
    Janne Grunau authored
    This does not adjust the AVX2 asm. The asm clips in many places to the
    required range (16-bit signed) for performance reason. No mismatch
    observed with coefs generated by the forward transform in checkasm in
    10 thousand runs.
    5098b23a
Name
Last commit
Last update
doc Loading commit data...
include Loading commit data...
src Loading commit data...
tests Loading commit data...
tools Loading commit data...
.gitignore Loading commit data...
.gitlab-ci.yml Loading commit data...
CONTRIBUTING.md Loading commit data...
COPYING Loading commit data...
NEWS Loading commit data...
README.md Loading commit data...
THANKS.md Loading commit data...
meson.build Loading commit data...
meson_options.txt Loading commit data...