decode_frame: unref everything on decoding errors

Fixes frame ref leak with crash-5f55445c56a36f28259bc742dd08b2c5ba42045d.
7 jobs for master in 3 minutes and 23 seconds (queued for 1 second)