VLC 4: Continue playback setting is not respected

The simple preferences Continue playback setting is not respected at all, even if it is set to Never or Always it asks if the playback should be continued:

Additionally this message disappears after a while, but there is no indication of when it will disappear or that it will disappear at all.