his talking exhausts me

how should I deal with this? should I ask him to stop talking when I can't listen anymore? we don't live together and I feel guilty for being glad we don't!  he blurted out something inappropriate and I told him he had no filter, he didn't respond but didn't seem to mind me saying it.