VLC doesn't remember last used volume

I've been using VLC player for many years and without touching much of the default settings, it always remember my last used volume (eg. If I close the player at volume 45% and reopen VLC, it will be at 45%), it even remember last used volume for multiple devices.

After reformatting Windows 10 and reinstalled VLC, this doesn't seem to be the case anymore, now it will always starts at 100%. I've checked the Audio setting under preference (Always reset audio start level to: Uncheck) and under All settings in Audio section (Remember the audio volume: Check).

I've tried reinstalling VLC 3.0.18, resetting settings, reinstalling audio drivers with the same result. I've found some solution where I have to set the Output module under Audio settings to DirectX audio output instead of the default Automatic, that worked and it will remember my last used volume however it doesn't remember if I last mute or not.

I have another PC with VLC installed that I've used for years. I check the settings to be the same as default:

1. Always reset audio start level to: Uncheck
2. Remember the audio volume: Check
3. Output module: Automatic But that VLC player 3.0.18 on that PC remembers my last volume used and even remember if I last muted or not.

Not so sure why is this the case with that freshly installed PC.