Abstract: With the continuous growth of large language model (LLM) sizes, individual datacenters are increasingly insufficient to support LLM training. Cross-datacenter training has become a feasible ...