contrib: don't set the build mode in the CMake toolchain file

It doesn't describe the toolchain we use. We can pass the value as a regular flag.

So we can adjust the debug/release mode per target.

Plus: only build Qt with symbols when PDB is enabled.