My point was not about discerning track from grass, but about driving in acttual grass. Current self-driving tech uses sensors that are useless in high grass.
As for "emergency behavior" (emergent behavior, I guess) - we do not know how LLMs are trained. Thus, what you consider "emergency behavior," could very well be a part of training.
AIs need training before they can do things.*
*They just might be learning to do things without being trained based on the emergency behavior I see in LLMs.