Often the hardest part about having a food allergy is how people react to it. Having food allergies can cause anxiety, isolation, and fear of dining out. People aren’t always empathetic to garlic allergies and don’t consider their responses when you tell them you’re allergic to garlic.