Because people are human beings and not property? They're your spouse, not your possession, and still possess free agency.

Which is one of the reasons why (simplifying) we don't legislate morality, and it's not illegal to be an asshole.

What about divorce? The logical conclusion of your scenario is that divorce should be illegal too, as you made a huge commitment to your partner, and now you want to break it?