The seasons are caused by the orientation of the Earth's tilted axis relative to the sun. E.g the north pole is tilted towards the sun during summer of the northern hemisphere, and away from the sun in winter.
Now imagine the Earth being magically held in place, instead of orbiting around the sun. This would almost stop the seasons from advancing, but not entirely. There would still be a slow 26000 year cycle of the seasons, because the Earth's axis precesses much like a spinning top. It's this effect that speeds up the cycle of the seasons by about 20 minutes each year. (1 year/26000 is about 20 minutes)
It's pretty random. It's mostly caused by gravitation from the sun and moon, and counteracted by the Earth's spin; faster spin would mean slower precession.