SFTP stuck on asking for password

Description

I want to connect to a home server via SFTP. The account on the server is set up to do password-based auth. Logging in via SSH with the given password works. But trying to connect from VLC just repeatedly asks for the username/password, the dialogue just pops up every time I enter the details.

Expected behavior

Browse SFTP share.

Actual behavior

Back to login-dialogue every time.

Steps to reproduce

Add server to favourites
Enter server / path info
Enter user details

Context

App version

VLC-3.1.7

Android version

8.0.0

Device model

TPM171E (Philips EU TV)