Lin Zheng

I am a third-year Ph.D. student in the Department of Computer Science at the University of Hong Kong (HKU), supervised by Lingpeng Kong, Ping Luo, and Ben Kao. In 2021, I received my Bachelor degree in the School of Computer Science and Engineering, Sun Yat-sen University, working with Qinliang Su.

Email / CV / Scholar / Twitter / Github

Research

My research interests include machine learning and natural language processing. I've been working on developing efficient attention mechanisms and better generative models for text as well as code.

* indicates equal contribution.

Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models
Jiacheng Ye*, Shansan Gong*, Liheng Chen*, Lin Zheng, Jiahui Gao, Han Shi, Chuan Wu, Zhenguo Li Wei Bi, Lingpeng Kong
arXiv preprint, 2024
paper / code

Self-Infilling Code Generation
Lin Zheng Jianbo Yuan, Zhi Zhang, Hongxia Yang, Lingpeng Kong
arXiv preprint, 2023
paper / code

A Reparameterized Discrete Diffusion Model for Text Generation
Lin Zheng Jianbo Yuan, Lei Yu, Lingpeng Kong
arXiv preprint, 2023
paper / code

Retrieved Sequence Augmentation for Protein Representation Learning
Chang Ma, Haiteng Zhao, Lin Zheng, Jiayi Xin, Qintong Li, Lijun Wu, Zhihong Deng, Yang Lu, Qi Liu, Lingpeng Kong
arXiv preprint, 2023
paper / code

Attentive Multi-Layer Perceptron for Non-autoregressive Generation
Shuyang Jiang, Jun Zhang, Jiangtao Feng, Lin Zheng, Lingpeng Kong
ECML/PKDD, 2023
paper / code

Linear Attention via Orthogonal Memory
Jun Zhang, Shuyang Jiang, Jiangtao Feng, Lin Zheng, Lingpeng Kong
arXiv preprint, 2023
paper

CAB: Comprehensive Attention Benchmarking on Long Sequence Modeling
Jun Zhang, Shuyang Jiang, Jiangtao Feng, Lin Zheng, Lingpeng Kong
ICML, 2023
paper / code

Efficient Attention via Control Variates
Lin Zheng, Jianbo Yuan, Chong Wang, Lingpeng Kong
ICLR, 2023 (oral)
paper / code

Linear Complexity Randomized Self-attention Mechanism
Lin Zheng, Chong Wang, Lingpeng Kong
ICML, 2022
paper / code

Ripple Attention for Visual Perception with Sub-quadratic Complexity
Lin Zheng, Huijie Pan, Lingpeng Kong
ICML, 2022
paper

Cascaded Head-colliding Attention
Lin Zheng, Zhiyong Wu, Lingpeng Kong
ACL, 2021
paper / code

Generative Semantic Hashing Enhanced via Boltzmann Machines
Lin Zheng, Qinliang Su, Dinghan Shen, Changyou Chen
ACL, 2020
paper / code

Teaching

Spring 2022 and Spring 2023: TA for COMP3314B Machine Learning

Service

Reviewer: ACL 2021, NAACL 2021, ICML 2022-2024, NeurIPS 2022-2023, etc.

Source code from Jon Barron's website.