Sex is not in the marriage vow, but lack of sex is a reason for divorce, at least in NY. It is called alienation of affection and is grounds for divorce. I know because that's what my ex claimed even though it wasn't true. I agreed because I just wanted him to go away.
Edited to add: There are no grounds for mean , nasty, drunk. So I took the fall!