Publications

2023

  1. Efficiently Programming Large Language Models using SGLang
    Zheng, Lianmin, Yin, Liangsheng,  Xie, Zhiqiang, Huang, Jeff, Sun, Chuyue, Yu, Cody Hao, Cao, Shiyi, Kozyrakis, Christos, Stoica, Ion, Gonzalez, Joseph E., Barrett, Clark, and Sheng, Ying
    2023
  2. FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPU
    Sheng, Ying, Zheng, Lianmin, Yuan, Binhang, Li, Zhuohan, Ryabinin, Max, Fu, Daniel Y.,  Xie, Zhiqiang, Chen, Beidi, Barrett, Clark, Gonzalez, Joseph E., Liang, Percy, Ré, Christopher, Stoica, Ion, and Zhang, Ce
    2023
  3. An Extensible, Data-Oriented Architecture for High-Performance, Many-World Simulation
    Shacklett, Brennan, Rosenzweig, Luc Guy,  Xie, Zhiqiang, Sarkar, Bidipta, Szot, Andrew, Wijmans, Erik, Koltun, Vladlen, Batra, Dhruv, and Fatahalian, Kayvon
    ACM Trans. Graph. 2023
  4. The Benefit of Hindsight: Tracing Edge-Cases in Distributed Systems
    Zhang, Lei,  Xie, Zhiqiang, Anand, Vaastav, Vigfusson, Ymir, and Mace, Jonathan
    NSDI 2023
  5. The Odd One Out: Energy is Not Like Other Metrics
    Anand, Vaastav,  Xie, Zhiqiang, Stolet, Matheus, De Viti, Roberta, Davidson, Thomas, Karimipour, Reyhaneh, Alzayat, Safya, and Mace, Jonathan
    SIGENERGY Energy Inform. Rev. 2023

2022

  1. Efficient Flow Scheduling in Distributed Deep Learning Training with Echelon Formation
    Pan, Rui, Lei, Yiming, Li, Jialong,  Xie, Zhiqiang, Yuan, Binhang, and Xia, Yiting
    HotNets 2022
  2. Graphiler: Optimizing Graph Neural Networks with Message Passing Data Flow Graph
    Xie, Zhiqiang, Wang, Minjie, Ye, Zihao, Zhang, Zheng, and Fan, Rui
    MLSys 2022

2021

  1. Graphiler: A Compiler for Graph Neural Network
    Xie, Zhiqiang, Ye, Zihao, Wang, Minjie, Zhang, Zheng, and Fan, Rui
    GNNSys 2021
  2. Dual-side sparse tensor core
    Wang, Yang, Zhang, Chen,  Xie, Zhiqiang, Guo, Cong, Liu, Yunxin, and Leng, Jingwen
    ISCA 2021

2020

  1. Rammer: Enabling Holistic Deep Learning Compiler Optimizations with rTasks
    Ma, Lingxiao*,  Xie, Zhiqiang*, Yang, Zhi, Xue, Jilong, Miao, Youshan, Cui, Wei, Hu, Wenxiang, Yang, Fan, Zhang, Lintao, and Zhou, Lidong
    OSDI 2020, *equal contributions