Yes, I'd be annoyed. If I was a vegetarian and going to a potluck, I'd make my own dish, and eat whatever else was there without meat. I sure wouldn't expect a completely vegetarian spread.