Yeah, but then we're discussing opponents with nuclear arsenals and ICBM programs. Those opponents are generally reluctant to nuke stuff, or commit acts of war similar to nuking stuff.

But yes, a space elevator would be difficult to defend in World War III.