What makes rotations averaging hard?