Remove 422 check from cdef loop

Tested in isolation, this appears to be faster, but hard to tell overall.

Not 100% sure, this is a good idea, let me know what you think