I feel not being understood when pronunciation is off is more of a France french issue.
You will be understood eitherway in Canada (given you speak with french Canadians). But I sometime have difficulty being understood by frenchmans, less so with other french speaking cultures
It would be like a speaker who can’t distinguish the uh sound in “but” with the ih sound in “bit”. Is it really the native English speaker’s fault if he can’t understand that personal dialect?
France’s vowel inventory is bigger than (or just as big as) English’s, and it has a lot more homophones. I imagine all the context goes toward disambiguating the actual homophones and not the arbitrary sets of words foreigners can’t pronounce because they don’t want to learn the accents (the system is not that hard and completely predictable).