Yawei Li (李亚伟)


Biography


I am a Lecturer at ETH Zürich. I work with Prof. Luca Benini and Prof. Luc Van Gool. I also collaborate closely with Dr. Radu Timofte and Dr. Michele Magno.

My research focus on efficient deep learning and artificial intelligence algorithms and systems with applications to vision, language, and biosignals. In particular, I am interested in the following topics:

  • Foundation model for biosignals
  • Efficient deep neural network design (vision)
  • Model quantization and pruning (vision and language)
  • Model deployment on RISC-V cores (vision and language)
  • DNN on embedded systems (biosignal, vision)

We have open positions and projects on the topics. Please check the details about the projects in the following section.

Project


We are looking for self-motivated PhD and Master students working on the development, optimization, and deployment of foundation models. In particular, we have the following projects and open positions.

News


Apr. 2024 Report for the 9th NTIRE Challenge on Efficient SR is online now.
Mar. 2024 We open PhD positions on Secure Machine Learning on RISC-V Servers and Accelerators. at ETH Zürich
Feb. 2024 One paper is accepted by CVPR 2024! Check the paper here.
Feb. 2024 VRT is accepted by IEEE TIP! Check the paper here.
Feb. 2024 KGT paper is online. Check the paper here.
Jan. 2024 We are organizing the 9th NTIRE Challenge on Efficient Super-Resolution.
Dec. 2023 I start as a Lecturer at ETH Zürich!
Nov. 2023 Our work on smart glasses is online. Check the paper here.
Sep. 2023 One paper is accepted by Machine Intelligence Research. Check the paper here.
Aug. 2023 TinyTracker is accepted by IEEE Sensors. Check the paper here.
Apr. 2023 LSDIR dataset is accepted as a workshop paper at CVPR 2023. Check the paper here.
Mar. 2023 One paper is accepted by ICME. Check the paper here.
Feb. 2023 Two papers are accepted by CVPR2023. GRL sets the new state-of-the-art for 7 image restoration tasks.
Jan. 2023 We are organizing the NTIRE 2023 Challenge on Efficient Super-Resolution, Image Denosing, and Image Super-Resolution (x4).
Jul. 2022 One paper is accepted by ECCV 2022.
Apr. 2022 I start as a Postdoc researcher at the Computer Vision Lab of ETH Zürich!
Feb. 2022 I defended my thesis!
Feb. 2022 Random pruning paper is accepted by CVPR 2022.
Jan. 2022 We are organizing the NTIRE 2022 Challenge on Efficient Super-Resolution.
Jul. 2021 Efficient GCN paper is accepted by ICCV 2021!
Apr. 2021 Our work on efficient graph convolutional networks is available on arXiv! Check the paper here.
Mar. 2021 Three papers are accepted by CVPR 2021! Check the papers here. The Heterogeneity Hypothesis. DASR. MOCDA.
Dec. 2020 I'm going to serve as as a Senior PC member for IJCAI 2021.
Sep. 2020 DPIR paper is online. Check the paper here.
Aug. 2020 Code of DHP is available. Check it here.
Jul. 2020 DHP paper is accepted by ECCV2020!
Jul. 2020 The Heterogeneity Hypothesis paper is online now. Check it on Arxiv.
Apr. 2020 DASR paper is online (Arxiv).
Mar. 2020 DHP paper is online (Arxiv)
Feb. 2020 One paper accepted by CVPR2020.
Jul. 2019 One paper accepted by ICCV2019.
Jul. 2019 I won the best poster presentation at ICVSS.
Feb. 2019 One paper accepted by CVPR2019.

Research


Selected Publications

ATD-SR

Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionary

Leheng Zhang, Yawei Li, Xingyu Zhou, Xiaorui Zhao, Shuhang Gu
IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024.
[Paper] [GitHub Repository]

GRL

Efficient and explicit modelling of image hierarchies for image restoration

Yawei Li, Yuchen Fan, Xiaoyu Xiang, Denis Demandolx, Rakesh Ranjan, Radu Timofte, Luc Van Gool
IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023.
[Paper] [GitHub Repository]

localvit

LocalViT: Analyzing Locality in Vision Transformers

Yawei Li, Kai Zhang, Jiezhang Cao, Radu Timofte, Michele Magno, Luca Benini, Luc Van Gool
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2023.
[Paper] [GitHub Repository]

random_pruning

Revisiting Random Channel Pruning for Neural Network Compression

Yawei Li, Kamil Adamczewski, Wen Li, Shuhang Gu, Radu Timofte, Luc Van Gool
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022.
[Paper]

efficient_gcn

Towards Efficient Graph Convolutional Networks for Point Cloud Handling

Yawei Li, He Chen, Zhaopeng Cui, Radu Timofte, Marc Pollefeys, Gregory Chirikjian, Luc Van Gool
IEEE/CVF International Conference on Computer Vision (ICCV), 2021.
[Paper] [GitHub Repository]

DPIR

Plug-and-Play Image Restoration with Deep Denoiser Prior

Kai Zhang, Yawei Li, Wangmeng Zuo, Lei Zhang, Luc Van Gool, and Radu Timofte
IEEE Transactions on Pattern Analysis and Machine Intelligence, 2021.
[Paper] [GitHub Repository]

Heterogeneity Hypothesis

The Heterogeneity Hypothesis: Finding Layer-Wise Dissimilated Network Architecture

Yawei Li, Wen Li, Martin Danelljan, Kai Zhang, Shuhang Gu, Luc Van Gool, and Radu Timofte
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
[Paper] [GitHub Repository] [Slides] [Poster]

DASR 

Unsupervised Real-world Image Super Resolution via Domain-distance Aware Training

Yunxuan Wei, Shuhang Gu, Yawei Li, Longcun Jin
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
[Paper] [GitHub Repository]

DASR 

Cluster, Split, Fuse, and Update: Meta-Learning for Open Compound Domain Adaptive Semantic Segmentation

Rui Gong, Yuhua Chen, Danda Pani Paudel, Yawei Li, Ajad Chhatkuli, Wen Li, Dengxin Dai, Luc Van Gool
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2021.
[Paper]

DHP 

DHP: Differentiable Meta Pruning via HyperNetworks

Yawei Li, Shuhang Gu, Kai Zhang, Luc Van Gool, and Radu Timofte
European Conference on Computer Vision and Pattern Recognition (ECCV), 2020.
[Paper] [GitHub Repository] [Slides] [Video] [Video in Chinese]

AIM2020_efficient_sr 

AIM 2020 Challenge on Efficient Super-Resolution: Methods and Results

Kai Zhang, Martin Danelljan, Yawei Li, Radu Timofte, and others
European Conference on Computer Vision and Pattern Recognition Workshops (ECCVW), 2020.
[Paper] [GitHub Repository]

Group Sparsity 

Group sparsity: The Hinge Between Filter Pruning and Decomposition for Network Compression

Yawei Li, Shuhang Gu, Christoph Mayer, Luc Van Gool, and Radu Timofte
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2020.
[Paper] [GitHub Repository]

Filter Basis 

Learning filter basis for convolutional neural network compression

Yawei Li, Shuhang Gu, Luc Van Gool, and Radu Timofte
IEEE International Conference on Computer Vision (ICCV) , 2019.
[Paper] [GitHub Repository]

SGN 

Self-guided network for fast image denoising

Shuhang Gu, Yawei Li, Luc Van Gool, and Radu Timofte
IEEE International Conference on Computer Vision (ICCV), 2019.
[Paper] [GitHub Repository]

3D Appearance SR 

3D appearance super-resolution with deep learning

Yawei Li, Vagia Tsiminaki, Radu Timofte, Marc Pollefeys, and Luc van Gool
IEEE International Conference on Computer Vision and Pattern Recognition (CVPR), 2019.
[Paper] [GitHub Repository]

CARN 

CARN: Convolutional anchored regression network for fast and accurate single image super-resolution

Yawei Li, Eirikur Agustsson, Shuhang Gu, Radu Timofte, and Luc Van Gool
European Conference on Computer Vision Workshop (ECCVW), 2018.
[Paper] [GitHub Repository]

ACMMM 

Multiview Video Super-Resolution via Information Extraction and Merging

Yawei Li, Xiaofeng Li, Zhizhong Fu, and Wenli Zhong
ACM International Conference on Multimedia (ACM MM), 2016.
[Paper]

Services


PhD Student Supervision

  • Mengjiao Ma, start soon
  • Morin Lucas, 03/2024-now
  • Bin Ren, 08/2023-now
  • Pietro Bonazzi, 04/23-now

Master Student Supervision

  • Cyrill Knecht, start soon
  • Alexandru Dimofte, 03/24-now
  • Glenn Anta Bucagu, 03/24-now
  • Yutong Xiang, 01/24-now
  • Maurits Reitsma, 10/23-now
  • Sebastian Jäger, 09/23-12/23
  • Huseyin Ziya Imamoglu, 11/20-10/21
  • Silvio Paganucci, 10/19-03/20

Outstanding Reviewer

  • Asian Conference on Computer Vision (ACCV), 2020

Senior Program Committe (SPC) Member

  • AAAI Conference on Artificial Intelligence (AAAI), 2024
  • AAAI Conference on Artificial Intelligence (AAAI), 2023
  • International Joint Conference on Artificial Intelligence (IJCAI), 2021

Workshop and Challenge Organization

Teaching

  • 2023 Fall, 227-0085-11L: Deep Learning for Image Manipulation. Lecturers: Yawei Li, Luc Van Gool.
  • 2020 Fall, 227-0085-11L: Deep Learning for Image Manipulation. Lecturers: Luc Van Gool.
  • 2019 Fall, 263-5902-00L: Computer Vision. Lecturers: Marc Pollefeys, Vittorio Ferrari Luc Van Gool
  • 2018 Fall, 263-5902-00L: Computer Vision. Lecturers: Marc Pollefeys, Vittorio Ferrari Luc Van Gool
  • 2017 Fall, 263-5902-00L: Computer Vision. Lecturers: Luc Van Gool, Vittorio Ferrari, Andreas Geiger

Conference Reviewer

  • Computer Vision and Pattern Recognition (CVPR)
  • International Conference on Computer Vision (ICCV)
  • The European Conference on Computer Vision (ECCV)
  • Neural Information Processing Systems (NeurIPS)
  • The International Conference on Learning Representations (ICLR)
  • The International Conference on Machine Learning (ICML)
  • AAAI Conference on Artificial Intelligence (AAAI)
  • The International Joint Conference on Artificial Intelligence (IJCAI)
  • ACM International Conference on Multimedia (ACM MM)
  • Asian Conference on Computer Vision (ACCV)
  • Winter Conference on Applications of Computer Vision (WACV)
  • Pacific Graphics

Journal Reviewer

  • IEEE Transactions on Pattern Analysis and Machine Intelligence
  • International Journal of Computer Vision
  • Transactions on Machine Learning Research
  • IEEE Transactions on Image Processing
  • Neural Networks
  • International Journal of Intelligent Systems
  • Neurocomputing
  • Journal of Systems Architecture
  • PLOS ONE

Yawei Li © 2024. All rights reserved. Powered by Bootstrap.