Is it okay going to the gym with a friend if you're the guy and she's the girl? Would it be uncomfortable? A friend really wants to go but I'm not sure about it.

I would say it's fine. If I and the girl went to the same gym and she asked me if we could go together, I wouldn't feel awkward. I'd say yes. She's a friend after all.