Repeatedly pressing Next Frame will consistently crash the player

When frame advancing any mp4 file, after about 10-20 frames or so VLC will just stop frame advancing the video and proceed to do all sorts of weird things. It might stay stuck on a freeze frame, or replay the sound from the beginning of the video but fail to show the actual video, or anything but actually frame advancing the video.