It takes a bit of thinking about but if the universe is expanding - the explaination used is dots on a balloon. As it is blown up the dots move away from each other. Viewing from any dot shows the other dots moving away.
The really freaky thing is that just as it is the balloon expanding which causes the dots to move away from each other - so it is space itself expanding that causes the galaxies to appear to be moving away from us.
Hat tip wreck1080 kiwiblog general debate comments