Could occur on the 1st pass in combination with --fake-interlaced and
some input heights due to allocating a too small buffer.