Sometimes friends move in different directions, it’s a natural part of life. You may prefer to hang out with a new crowd and some people will naturally be left behind. No doubt about it, when you leave people behind they will complain that you’ve changed. What they are complaining about is not that you’ve changed, but you’re no longer doing what is convenient for them.
Not everyone will understand your journey. That’s fine. It’s not their journey to make sense of. It’s yours.
See the most popular comeback when someone says you’ve changed determined by I should have said voters.