He also opened up about the difficult relationship with his police officer father, calling him the “stress dispensary in our house”