Add various minor refmvs improvements

Henrik Gramnerrequested to merge
gramner/dav1d:refmvs_tweaks into master

Removes some redundant code and simplifies reallocation logic.

Merge request reports

VideoLAN code repository instance