video_output: update the filter pool when update_format succeeds

Fixes #28381 (closed)

Also add update_format() to glwin32 and some minor fixes and debugging.