He sounds controlling, all take and no give. You aren't in a relationship. He has no right to tell you to be faithful to something that doesn't exist.
How does this make you feel? If the answer isn't "uplifted," end it. You can truly relax and enjoy what happens when you're with a better boyfriend.