#7 there is a small screw underneath one of the two cylinders. Loose it and you can pull out the holder.
But still mounted the wrong way..

#38 Actually I like it like that; it has more sense of motion, but turning one tile 90 degrees is simple enough.