Is it okay to hang out with "non Christians"?

I'm 20 years old, I surrendered to Christ about 6 years ago. I have a personal relationship with Jesus Christ. Just recently, I made a new friend who is a male 22 year old with a 3 year old daughter. And I hang out with him a lot. I do not "like" this guy, nor do I drink or do anything like that with him or any of his friends. However, my "Christian" friends told me that I should not hang out with him, nor would God approve. They accused me of being easily impressionable and told me that it would be irresponsible as a Christian to hang out with a non Christian. They threatened our friendship with it. However, I spoke to God this morning and I felt at peace with hanging out with these people I do feel God is going to use me to reach them. However, I don't plan on forcing myself or my God upon him. My friends refuse to speak to me until I rid myself with these 'heathens" that I call my friends. Jesus himself hung out with prostitutes, tax collectors, and all about bad people. And I realize I'm not Jesus. But these are people. And Jesus loves people. and I love people. And I pray before I hang out with these people, as I pray before I begin most activities. But is it really such a sin to hang out with certain people? Do Christians really have a right to decide who is worthy to walk into the kingdom of God? Shouldn't we just love on people, love people, and show them them amazingness of our God?