VLC doesn't buffer videos on Mounted gvfs-smb share

If I mount a samba share in nautilus, and try to stream the video via vlc its extremely laggy, because vlc does no buffering, regardless of what I set the network cache to in the preferences. VLC seems to be treating these as local files. The only way I can get it to buffer properly is to set the regular "file caching" option to something like 6000ms, which is far from ideal.