Would It be ok to ask?

I dont think it would be out of line for you to request that at all. The managers know about your problem, so they shouldnt make a big deal out of it. They should rotate the position so that other people can get the experience and be more flexible and be able to do more tasks in the work area.