The village of Döllersheim dates all the way back to the 12th century, as its name was first mentioned in 1143, in a deed issued by Duke Henry XI of Bavaria. Near Döllersheim, there was a hamlet named Strones, where in 1837 Alois Hitler, the father of Adolf Hitler, was born the illegitimate son of the local peasantwoman Maria Schicklgruber. Since Strones did not have a chapel, Maria went to the Döllersheim parish to record the birth with the local priest.

After Austria was annexed by Nazi Germany in 1938, Hitler ordered Döllersheim and several other smaller neighbouring villages to be evacuated in favour of a large military training area. The residents were forcibly relocated and their houses bombed as part of military training operations.

Since 1981, some areas of the village, like the Romanesque parish church of Saints Peter and Paul were opened to the general public, although other areas are still operated by the Austrian Armed Forces.