They were meant to be freed by the call to dav1d_flush() at the beginning,
but before the previous commit that wasn't the case when decoding with one
frame thread.
This ensures they are explicity freed here and not depend on other functions
behaving correctly.