Being someone's second option hurts like fucking hell...

I know when you're in a relationship, you're suppose to talk to your partner about your issues, but I don't really have an option. Little bit more on that in a moment. It's wrong, and I know that. But I need some advice and I don't know where else to go. Here's the problem. Whenever we're around my bf's mom he makes me feel like I'm his second option. Hell, even when we're not around her. It's almost like shes God and she walks on water. He worships her. If she falls he's by her side helping her off her feet in 2 seconds flat. Me? He asks me if I'm ok and goes on his merry way. I'll be the first one to admit I have some jealousy issues and problems with low self-esteem. I'm also the one with ADHD (non-hyperactive) in the relationship. Now, I get that she is his mom and she won't be around forever, but guess what. Neither will he and neither will I. Especially me if I'm in the right here and this keeps up. He doesn't live with her anymore, but just a short 4 hr drive and tada he's there. He and I live together and see each other all the time. Talking to him is not really an option because me, my bf and his family are all on vacation and I don't want to start an argument and ruin it for him. He'll get defensive and not truelly listen to me. He'll accuse me of being self-centered, selfish etc and it'll only make things worse. Am I being ridiculous or do I have every right to be upset?