Can you be allergic to a smell?

Smell is very small particles of the substance in question, so yes you can be allergic to a smell. An example would be people who are severely allergic to peanuts. The very small amount you'd be in contact with to smell it can be enough to trigger an allergic reaction.