When an Islamophobic group tried to recruit him as a mascot for their organisation, it was the final straw