The Pilgrims did not have buckles on their hats or wear the same, dark colored clothing. The popularized image of pilgrims was created in the 19th century (3 centuries later) when buckles were a symbol of quaintness. More info on Wikipedia.
.