I agree with Gatorblu and Rooster!
Your boss is very unprofessional. Not sure why he needs to tell you he has a "soft spot for you". Bosses shouldn't show favorites.
My guess is that he wants to treat you as any employee, but you may remind him of someone so he gives you little more leeway.