Ironically, he’s been accused of being ‘too masculine’ and “trying too hard to be like a cisgendered male”