This fixes undefined behaviors when the native display is destroyed before the
VADisplay is terminated. This caused a crash or invalid surfaces with the DRM
native display when changing between 2 vouts. For X11, no crashes were
observed, probably because the native display was already hold by the window.