If HFT was genuinely good for the entire market than absolute latency would be what matters but it is only relative latency between HFT firms that matter because they are all competing against each other using the same tactics where whoever is fastest wins.