I'm not married, but if I were, I wouldn't leave my wife for a QoS. While the sexual life might be more exciting, the chances of the vanilla side with a QoS being as good as it was with your vanilla wife is pretty slim.
Not to say it can't be as good, but for an immediate move like your premise suggests, probably not.