Exactly! That's completely valid. People will judge regardless of what you do. I don't know what you teach, but I will say this. I would not be where I am today if it weren't for some of my college professors and mentors. They have had such a profound, positive impact on me & my life/career. And I STILL thank them to this day.
So if the risk of being judged is the price you pay to be a teacher that could potentially reach and impact a student in such a way, I think it's worth it, right?