From the internet:
"Taste: Goat milk is definitely different than cows milk. It is strong in flavor that may take some time to get used to."
Here's an interesting comparison chart on the two:
www.prevention.com/content/which-healthier-goat-milk-vs-cow-