I am with you, I walk around barefoot all the time. However, there are some health risks. The most obvious is the possiblity of stepping on something that punctures the skin and causes infection. There is also the possibility of picking up a parasite, though it has never happened to me.
Verrucas ,plantar warts are infectious and easily spread. They are caused by a virus . H.P.V . you are more likely to slip and injure yourself on some surfaces.
Apart from injury from standing on something sharp or being bitten, there's not much health risk if you wash them often. I walk around and drive barefoot all the time in the summer