Why do people assume this about me?

I think it depends on the age and maturity of the people around you. Whether or not they think it, it doesn't matter. Go for the one you like, and forget what everyone else assumes. Good luck, hon.