Do you have the "right"?  So sweetie, please.  Of course you have the right!!  Don't let anyone take away your power.  You deserve to be treated really well and should never think you must take accept being treated badly. 

You have every right to tell him that. He doesn't own you. Why would you even consider being in a relationship that effects your health negatively?

Life is too short.  Tell him to act right or remove yourself from his toxic ways.