do ppl actually find the crossfit body off-putting in the lifestyle?

right so me n the wife both compete, she's 5x rx'd athlete, i'm a masters lifter, we're both visibly... a lot. shredded, vascular, big traps the works. been on a few aussie ls forums n irl meets in melbourne and we keep getting this Vibe where ppl assume we're intimidating or "too much"... had a couple last weekend literally back out at the door bc the wife "looked too fit" lol... is this just a thing? do average bodies actually feel weird playing w gym ppl? bc honestly we're the softest goofiest dorks once the clothes come off, we just happen to deadlift on weekends... starting to feel like our hobby is sabotaging our other hobby ffs