This was happening to me, I found out that it was because I didn't have my laptop plugged in. I got it hooked up to the monitor, had the keyboard plugged in, the mouse in, the headphones ready to go... but I forgot to plug in the power brick. So the game was either running in battery-saver mode or some sort of lower-power mode. It was rather unfortunate when I ran out of power as the host and ruined the game for everyone.
However, the sort of... skipping, audio went away when I got plugged the laptop into the wall. I was wondering why the audio was doing that before it crashed.
If you arn't using a laptop, maybe your getting low on memory while the game is running or something?