If you wrench it side to side quickly you could in theory strip the gears; this is easy to do on small, plastic geared servos, but on metal geared ones = not so much. I'd just be gentle when handling electronics, avoid fondling things more than neccessery.
