"you look normal" is the compliment that keeps stinging

every couple who has met me has said some version of "oh wow you're actually normal" or "you're not what we expected" or "you're so well-spoken" and at first i took it as a win like ok cool im clearing the bar. but lately it's starting to grate because... what was the bar exactly. it's basically saying "we assumed you'd be a creep until proven otherwise" which means every single guy walks in already assumed creep. is there a way to push back on this gently without sounding defensive, or do i just keep eating the backhanded compliment because that's the cost of doing business