They fail as soon as we resize:
NVWGF2UM: Failed to run Algo 2 of Stream 1. D3D11: Removing Device.
The processor mode (same code without VSR turned on) works fine with those drivers.
I thought it could have something to do with occational odd sizes when resizing but it fails even when adjusting the size (1 pixel less or 1 pixel more) and even by recreating the whole video processor/output texture each time.