I've got the same problem, and I have already set the audio accel. to zero. It improved it somewhat, but still skips all over the place.
Otherwise, loving the game :)
As to difficulty, I promise that you can get better. I was getting my backside booted for quite a while but am now doing much...