The biggest challenge is aerodynamics. If you're over 6'3" and want to be at all comfortable you're going to present a much larger frontal area than someone shorter.