Grants

Ongoing

  1. Compression of Large-scale Transformer-based Models with Random Matrix Methods: From Scaling Law to Dynamic Adaptive Model Compression

    2026–2029 · PI · NSFC General Program · NSFC-12571561

    Co-PI: Cosme Louart

  2. Foundations of Machine Learning for Understanding Large Models

    2025–2030 · Co-PI · National Key R&D Program of China (Youth Scientist Project) · 2025YFA1018600

    PI: Jun Shu

  3. Theory and Methods for Large-scale Machine Learning via RMT

    2026–2028 · PI · HUST Basic Research Support Program (Mathematics Track) · 2025BRSXB0004

Completed

  1. Generalization Theory for Transformer-based Models via Random Matrix Methods

    2024–2026 · PI · Guangdong Key Lab Open Fund · OFA00003

    Co-PI: Jeff Yao

  2. Fundamental Limits of Pruning Deep Neural Network Models via Random Matrix Methods

    2023–2025 · PI · NSFC Youth Program · NSFC-62206101

  3. Random Matrix Theory and Information Bottleneck for Neural Network Compression

    2021–2022 · PI · CCF-Hikvision Open Fund · 20210008

    Co-PI: Kai Wan