Should i dump ny bf FOR THESE REASONS?

So my boyfriend and I have been together for 5 weeks. He has a great personality and is sweet. The only problem I have is looks. He's 16 and I am 14. Except it looks the other way around. He's sooooo skinny. And I have a body that Is meant for athletics but I can stand to lose 20 lbs. I am also taller. But like 2 or 3 in. So bottom line Is should I break up wif him? He's a lot skinnier than I am, and shorter. Is that odd? Would u judge? PLEASE ASNWER HONESLTY!