> different to the experience you get from prompting
In my experience no. The agents get trapped by the exact programming pitfalls a junior would. The LLM is basically a 16 year old who read a given languages For Dummies book cover to cover 3-4x and has the syntax down but understands little about actually programming especially once you run into any real complexity. However 100% of those limitations can be overcome by proper architecture, testing, specification / requirements analysis (which is a lost art in the time of Agile but which I am a master of), and a sprinkle of technical strategic guidance. Especially the agent doesn’t understand its limitations so you need to have an eye for when it’s working on a problem that’s outside the competency its token window can produce. I could go on for 2 hours but bottom line is IMHO there’s more to it than this simple claim.
In my experience no. The agents get trapped by the exact programming pitfalls a junior would. The LLM is basically a 16 year old who read a given languages For Dummies book cover to cover 3-4x and has the syntax down but understands little about actually programming especially once you run into any real complexity. However 100% of those limitations can be overcome by proper architecture, testing, specification / requirements analysis (which is a lost art in the time of Agile but which I am a master of), and a sprinkle of technical strategic guidance. Especially the agent doesn’t understand its limitations so you need to have an eye for when it’s working on a problem that’s outside the competency its token window can produce. I could go on for 2 hours but bottom line is IMHO there’s more to it than this simple claim.