College rugby -- at least in North America -- is not particularly high level. The first sides of the top-ranked amateur clubs are generally stronger. That said, it really depends on the size of the props. If they are 6'4" then there might be binding issues. If you are fast, strong and agressive enough you might consider switching to loose foward. Agression trumps size in those positions. And of course scrum half is always an option if you have (or can learn) the necessary handliing and kicking skills.
I'm assuming because you say college you are in the US. I think you will just need to be careful, what I mean is to avoid situations where you will get wrecked such as when you go head on into a prop but I wouldn't worry about your height props are meant to be short
No right size
No you are not to small
