I was thinking it's a bit like developing powered flight and saying steam engines won't work. It's true they didn't but the internal combustion engine was developed which did. It was still an engine machined from metal but with a different design. I think LLM -> AGI will go like that - some design evolved from LLMs but different in important ways.