Tired of being made to feel guilty that I have a fully remote and stress-free job

This is a bit of a rant, but I didn’t really know where else to vent about this. I’ve been working a fully remote job in software development for the past few years now. I work from home pretty much every day, and as a result I’m fully in control of my schedule (unless I have Zoom meetings) and have a very good work-life balance. My previous job was in the office 5 days a week and I hated it, so I worked very hard to get myself out of that situation and find a job that lets me work from anywhere and set my own schedule. I’m very happy with my job now and I feel like I’ve hit the jackpot. I’m paid well, get to set my own schedule and also work in an interesting field with great people.

However, sometimes when I hear about my friends or relatives talking about how stressful their 9-5 office jobs are, I feel guilty that I don’t have to spend 2+ hours commuting each day, or have to deal with cutthroat office politics, long work hours and other downsides of working in an office. To make matters worse, sometimes people make offhand comments about me working from home. For example my friend was telling me about how much overtime he’s been putting in to deliver a new project for his job, and then asked me if I’d ever have to do something similar. He then said, “Oh wait nevermind, you work from home so you don’t need to put in overtime.”

I was meeting up with another friend for dinner the other night, and when he arrived, he said he was 10 minutes late because he had to finish up a bunch of work before leaving the office. He then asked me if I’d come from the office too, and then when I reminded him I worked from home, he said something like “Oh lucky you, so you can basically just leave whenever you want”.

I know these were just casual remarks, but they kind of show how people don’t take remote work seriously and think that I’m not really doing a “real job”. At the same time, I do admit that my job doesn’t stress me out nearly as much as it would if I were in the office full time, because no one’s breathing down my back or micromanaging me. But I’m tired of feeling guilty for not having a stressful, draining office job, and choosing to prioritize my free time and mental health instead. I just keep having this nagging feeling that I’m not being as productive a member of a society as my peers who work office jobs, and that I should be working in an office like everyone else. Especially when I talk to people who are fully in the office, I can’t help but feel guilty as if I’ve somehow cheated the system and it isn’t fair that everyone else has to spend their entire day trapped in a cubicle but I don’t. Do any other remote workers feel the same way? And what’s the best way to deal with these feelings?