I think the people who call you selfish for not wanting to have children are the people who decided to have children out of the fear that they might be considered selfish for not having children or because others pressured them to. They are just projecting their insecurities on you.