Well I wasn't one of those people and I actually liked talking to you until I found out how you'd been treating him which I could see for myself and heard from him directly, so I wasn't influenced by those people to whom you're referring.

Have an ounce of accountability. Apologize to him without expecting anything (including an acceptance) in return, and then just leave him alone, avoid his angry friends, and start making friends of your own outside his circles. By putting the blame on everyone else, you're being incredibly childish and it isn't a good look, trust me.