demux: mkv: fix some attachment reading issues

There was a potential infinite loop (on out of memory).

And a bit of code cleaning too.