The "close" action cannot work once VLC is already killed.
So this button is not relevant, and even misleading for most user.
The standard behavior on Android (cf Play Music & Spotify) is to not offer additional action for notification removal. Swipe is the standard way to clear the notifications.
VideoLAN code repository instance