Battling with non sufferers

We’ve all met them, the ‘you have anxiety? Don’t worry so much?’ Or the ‘you’re depressed? Well stop being miserable’ I don’t know why they can’t understand it! Being such an empathetic myself I always put myself in other peoples shoes and feel how they feel, so I don’t understand why people are so ignorant to mental health. I’ve been told ‘you know your work doesn’t help, you just don’t want to do anything to help yourself so you’re doing it to yourself’ but it’s not so easy to change your exterior surroundings. There are so many things out of our control and people don’t understand that. You can’t just quit work because you need money to live (unfortunately) and you have working commitments, trainings etc you can’t always just up and leave. Everyone knows that so why be that a*s saying ‘just change’. Winds me up.