Can You Feed A Kitten Goat Milk?

No, it should just have its moms milk or KMR (kitten replacement formula) that you can buy at your local pet store.

They have to have formula specifically designed for them as that is what has the vitamin's and nutrient's and thing's in levels that are best for them. Most thing's not made for cat's lack the taurine they HAVE to have (all cat's any age) for one thing or they may have problem's as a result. Most often affecting their eyes.  If they are very young the replacement formula should have colostrum in it to help build the immune system.
If you aren't experienced with caring for young animal's you should have someone who is show you what temperature they need to be at for digestion, how to stimulate if needed, how much to feed and how often and what signs to look for that something is going wrong. Things like 'forcing', too much flow, and feeding in the wrong position can cause them to inhale the liquid and particles may end up in the lungs and cause aspiration. It's a lot of work. Good luck.

Yes, you absolutely can! I don't know who answered this, but they are very wrong. Goat milk is the best replacement for a mother cat's milk, and is far easier to digest than KMR, which is made of a cow milk base and is harder for them to digest. I have been in animal rescue for 17 years, and have had far more success with goat milk than ANY other replacement.
Please search online for an appropriate recipe.