Problem playing x265 hevc 10bits with vlc-3.0.0 in hw decoding on nVidia

I have re-encoded some of my BD with handbrake to use x265 hevc and the vlc-3.0.0-rc and vlc nightly have problem decoding the video. It drops a lot of frame. \

But if I use the release vlc-2.2.8 it seems to work fine.

This is the out from mediainfo for the video part:

Video
ID : 1
Format : HEVC
Format/Info : High Efficiency Video Coding
Format profile : Main 10@L6.2@Main
Codec ID : V_MPEGH/ISO/HEVC
Duration : 8 min 46 s
Width : 1 918 pixels
Height : 1 080 pixels
Display aspect ratio : 16:9
Frame rate mode : Constant
Frame rate : 23.976 (24000/1001) FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 10 bits
Default : Yes
Forced : No 

Vlc build: vlc-4.0.0-20180115-0509-dev-win64.exe

Here is the log (vlc.log): https://pastebin.com/FQNwUy72

Here is the sample mkv file (x265 hevc hanbrake encode): http://www31.zippyshare.com/v/SYtSSe7X/file.html