The set was actually rebuilt twice from 1955 to 1985. Because the first Marty McFly was Eric Stoltz. He was replaced 40 hours of footage later when the directors realized that he was actually a miscast and took Michael J. Fox.
Very good and brave decision, as I can’t imagine BTTF with someone else other than Fox.
Below you’ll see several comparative pictures from footage with Eric Stoltz.