We do not really want to load libv4l2 or libmediaclient when the cache
generator describes the V4L2 plugin. We really want to load them when
we actually use the V4L2 plugin.

This incidentally avoids nested dynamic library loading (and works
around a leak in glibc).

This partially reverts ef46dc6c.