Intelligence, forgiveness

I am attracted to his intelligence, quick mind and intuition. BUT he is not circumspect which I am.  He just blurts out whatever he's thinking and because he is always trying to help everyone else I am starting to feel like I am an afterthought, and he says things like "if someone wants me out of their life it doesn't bother me".  He tries to hurt me but I know its just because he doesn't think I will keep putting up with his behaviour, or is it?  Can see how this would all become too much.