It is impossible to not hurt someone. Humans unconsciously hurt others by simply existing. Whether you are alive or dead, you keep hurting people. Getting involved will hurt them, but trying not to get involved might hurt them too. But if it's someone you don't care about, you won't notice you've hurt them. What's important is your awareness of it. It's because you care about them, that you feel like you've hurt them. Caring about someone means being resolved to the fact that you'll hurt them. The more people care for each other, the farther out of reach certain things get. But that's not something to be sad about, I think it's probably something to be proud of.