Principles and Practice of Parallel Programming

• COCCL: A Collective Communication Library Supporting Easy Integration and Configuration of Customized Compression for Scalable LLM Training
• CCL-D: A High-Precision Diagnostic System for Slow and Hang Anomalies in Large-Scale Model Training