I don't see why. Drones are pretty simple manufacturing wise. The issue at scale is the supply chain of cheap motors, cheap control boards, and cheap batteries.
which, the factory that builds drones or the drones themselves?
What would stop someone from building their own cargo container sized drone factory that takes parts like motors, pcbs, batteries in one end and spits out finished drones on the other?