Can I Loose My Deposit On A Rental Place If I Change My Mind On Taking The Place?

I gave a deposit to hold a house for rent. One week later I changed my mind and decided not to rent the place. The landlord told me that deposits are not refundable and would not give me my deposit back. He said that he turned down 3 other people that were interested in the house. He called those people back but they had already found other places. He said not only does he have to rerun the add, but he claims he is going to loose this month rent now. Does he have the right to keep my deposit.