At the risk of coming across as a smart aleck, 40 years of experience building software.
What experienced software engineers have is a sense of taste - this looks like good code and/or design, that doesn't. But they don't have data; they have, at best, a couple of anecdotes. It's more a sense of "that was harder to work with than it should have been; that approach seems to have drawbacks". But you only get a few examples of that in a career.
And there are very few outfits compiling usable data that could shape the approaches that software engineers use.
So I don't think how humans got there was primarily data.
how much real-world data do you think went into the evolution of the human brain and all its learning algorithms?
having 40 years of experience building software gives you no more insight into that than having 40 years of experience using language gives you insight into where your language skills come from
The discussion is about algorithms automating writing software.
The human brain did not evolve to write software. It evolved to get a good enough answer fast enough to survive, not to solve the kind of problem that is involved in software.
Yeah, I know, the human brain is able to learn to do software. But that isn't what it evolved to do.
