Exactly. The step to formalize mathematics through computation is just the logical consequence of the program of the formalizers.

The idea actually goes back to Leibnitz, who was very much overoptimistic about computability, but already conceived of the idea of a logic machine, which could deter the truth value of any statement.