As the brilliant Maya Angelou said: When someone tells you who they are, believe them. Also, I can't help but wonder what has happened in your life that makes you so little of yourself.
You're in love with him, he's still in love with his wife. He only has lust for you, not love.