Because the heat of your face and your breathing warms the side of the pillow that you are sleeping on.Knight, why is the other side of the pillow always cooler than the side you're sleeping on?
Either that... or you are sleeping on a bed of ice!