Sometimes simply doing something for yourself is considered inconsiderate or even selfish. The idea of helping others is sometimes pushed so far that people expect you to do it at the expense of yourself.
And of course there are those that are willing to give the shirts off their own back but it should be a choice, not something you’ve been guilted into.
People might call you inconsiderate for choosing to prioritise yourself over them and it might hurt your feelings. It might hurt so much that you decide to keep putting other people first. But the other option is to accept that persons opinion and continue doing what is best for you because you matter too.