Micro- Aggression

I have one micro-aggression experience.  When I meet other spanish people like myself and I say I am spanish they usually start talking in spanish because they assume I speak it. I usually give them a weird look and then they say "you're spanish but dont speak spanish?!?!. This is offensive because they dont understand my background and it comes off as really offensive.