Igor Pluskota
Igor Pluskota voted up Tom Jackson's answer

From the internet:

"Taste: Goat milk is definitely different than cows milk. It is strong in flavor that may take some time to get used to."

Here's an interesting comparison chart on the two:

www.prevention.com/content/which-healthier-goat-milk-vs-cow-