The name Big Ben does not refer to the tower within the British Houses of Parliament, but just the bell itself. The structure that holds the bell has its own name, The Elizabeth Tower, and no one knows for certain in whose honor the bell was named Big Ben. One theory states that it was named after Benjamin Count, a heavyweight boxing champion.