I find James harmless. He's far less problematic than some others we've seen like Bobby, Bryan, Ashton, etc. The ones that get angry when a women isn't interested or respond the way they'd like them to.
James was up-front that he's looking for fun. Yes, he flirted with all the women, Elizabeth was the one who reciprocated with interest. He's been respectful towards her. If anything, she's the one we see telling everyone their business. I also don't blame him for freaking out a bit when she started talking marriage or for being a bit hurt that she didn't defend him to Rachel. Finally, I think his friendship with Izzy shows that he doesn't see all women as potential sexual conquests unlike some (see Bobby, Bryan & Ashton).
Rachel is a mess. I think she's drinking a lot more than we realize. Hoping that being on this show helps her see that. I understand why hearing about her behavior was triggering for Captain Lee. They did a nice job with the montage.