You peel oranges with your fingers.
How you should be doing it: Cut off the ends of the orange, just as deep as the skin goes. Then create a shallow cut all the down the orange skin and open up the orange, leaving all the pieces neatly on the strip of skin, ready to be picked off and eaten.