[3.0.x] Lua: Make scripts compatible with Lua 5.4

Makes the scripts compatible with Lua 5.4, while at it, backport some minor changes to stay closer to master and fix minor issues, making future backports easier too.

Fixes #25036 (closed) for VLC 3.0