dvd_udf: fix bogus return values on error

The functions are supposed to return 0 on error.

Added in b1f3681b.

And use ssize_t internally as DVDReadLBUDF() can return an error or the block count.