frame by frame feature stops working for short videos

I create a lot of short mp4s with shot segments from my tennis matches. I then use the "frame by frame" feature (e key) to step through interesting parts of those short videos. For videos that are less than 60 seconds the "frame by frame" feature stops working, often around the middle of the video. It just won't advance to the next frame anymore.