High-Performance Computing for AI: Scalable Deep Learning Systems

Date:

Invited lecture at NUS HPC-AI Lab during visiting scholar period under Prof. Yang You’s supervision. Presented research on scalable deep learning systems, distributed training optimization, and efficient model parallelism. Covered advanced topics including gradient compression, mixed-precision training, and memory-efficient attention mechanisms. Discussed applications of HPC-AI in large-scale biological data analysis, particularly for single-cell genomics and protein structure prediction. Explored future directions in federated learning and edge computing for life sciences.