Your metabolism slows down as you get older.

This is true, but it's not as drastic as you might think. The real culprit here is not your metabolism, but your body's ability to gain and keep muscle mass. The metabolism does slow down a bit, but not enough to make you gain insane amounts of weight or anything like that. Your body just looks different because you can't maintain all those massive muscles you had in your twenties.