primary school teacher in a small town... terrified of running into a parent at a club

so im a yr3 teacher in a market town in yorkshire, population basically nothing, and dh and i have been swinging for about a year. we drive 90min to a club in leeds because obvs i cant be seen anywhere local. but last weekend i swear to god i saw a dad from drop off across the room and i had a full on stomach drop... turns out it wasnt him just a lookalike but ngl ive not slept properly since. the school is C of E, parents are nosy af, and one whiff and im done not just the job but probably the whole village would know by tuesday lol. how do other teachers do this?? do i just need to accept clubs are off limits and stick to online/holidays abroad? feeling really conflicted bc i love what we do as a couple but the anxiety is starting to outweigh the fun tbh...