A better question is, given a significant corpus of complex functionality, can it implement complex code in a language that it knows, but in which it has only seen lower complexity code?
Can it transfer knowledge across languages with shared underlying domains?
I think given that it's been trained on everything ever written, we should suppose the answer is no.
It has always been possible, in the last century, to build a NN-like system: it's a trivial optimization problem.
What was lacking was the 1 exabyte of human-produced training data necessary to bypass actual mechanisms of intelligence (procedural-knowledge generation via exploration of one's environment, etc.).
Can it transfer knowledge across languages with shared underlying domains?