Stuttering once per second every 1 second with 3.0.10 or higher when playing AAC

When upgrading from 3.0.8 to 3.0.10 my usual radio stream started stuttering. After upgrading to the latest nightly build the problem was much worse, playing a few ms of audio once every 10 seconds. When going back to 3.0.8 everything was playing smoothly again.

The stream file can be found here: http://www.abc.net.au/res/streaming/audio/aac/dig_music.pls

I also tested an mp3 version of the stream and that one does not stutter.