No he can't. If there was any issues with the condition the property was in when you moved out you wouldn't get your deposit back. That's the purpose of a landlord taking a deposit from tenants when they first move in. Sounds like he's just trying it on!