Shaoshuai Shi Postdoctoral Researcher Department of Computer Vision and Machine Learning Max Planck Institute for Informatics Email: shaoshuaics [at] gmail [dot] com [Google Scholar]   [GitHub]

About Me

I am a postdoctoral researcher at Max Planck Institute for Informatics (MPI-INF), working with Prof. Bernt Schiele. I obtained my Ph.D. degree from Multimedia Lab (MMLab) of The Chinese University of Hong Kong (CUHK), supervised by Prof. Xiaogang Wang and Prof. Hongsheng Li. Before that, I received my bachelor’s degree from the Computer Science Honor Class of Harbin Institute Technology (HIT).

My research interests focus on computer vision and deep learning, especially the 3D scene understanding, object detection, motion prediction and autonomous driving / robotics related topics.

News

• [2022/09] Three papers accepted by NeurIPS 2022.
• [2022/09] One paper (ST3D++) accepted by IEEE TPAMI.
• [2022/09] The source code of MPPNet has been released to OpenPCDet, ranking 1st place on Waymo 3D object detection leaderboard.
• [2022/07] One paper accepted by ECCV 2022.
• [2022/06] Champion of Waymo Open Dataset Motion Prediction challenge 2022.
• [2022/03] One paper accepted by CVPR 2022.
• [2022/01] The source code of PV-RCNN++ has been released to OpenPCDet.
• [2021/07] Two papers accepted by ICCV 2021.
• [2021/07] I was awarded World Artificial Intelligence Conference Rising Star Award, see the news from WAIC.
• [2021/03] Two papers accepted by CVPR 2021.
• [2020/10] I was awarded Google PhD Fellowship 2020, see the news from Google AI Blog.
• [2020/06] Highly optimized PyTorch codebase OpenPCDet for LiDAR-based 3D scene understanding is released.
• [2020/06] We won 1st place among all LiDAR-only methods / 2nd place among all methods on 3D Detection, 3D Tracking, Domain Adaptation three tracks of Waymo Open Dataset challenge. See the official blog post from Waymo.

General Codebase

OpenPCDet: An Open-source Toolbox for 3D Object Detection from Point Cloud OpenPCDet Development Team June 2020 [Code]   [Bibtex]

@misc{openpcdet2020,
    title={OpenPCDet: An Open-source Toolbox for 3D Object Detection from Point Clouds},
    author={OpenPCDet Development Team},
    howpublished = {\url{https://github.com/open-mmlab/OpenPCDet}},
    year={2020}
}

Publications

*: Equal Contribution      #: Corresponding Author

• Motion Transformer with Global Intention Localization and Local Movement Refinement
  Shaoshuai Shi, Li Jiang, Dengxin Dai, Bernt Schiele
  Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS), 2022
  Ranked 1st place on Waymo motion prediction and interaction prediction two leaderboards (May, 2022).

• CAGroup3D: Class-Aware Grouping for 3D Object Detection on Point Clouds
  Haiyang Wang*, Lihe Ding*, Shaocong Dong, Shaoshuai Shi#, Aoxue Li, Jianan Li, Zhenguo Li, Liwei Wang#
  Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS), 2022

• Towards Efficient 3D Object Detection with Knowledge Distillation
  Jihan Yang, Shaoshuai Shi, Runyu Ding, Zhe Wang, Xiaojuan Qi
  Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS), 2022

• MTR-A: 1st Place Solution for 2022 Waymo Open Dataset Challenge–Motion Prediction
  Shaoshuai Shi, Li Jiang, Dengxin Dai, Bernt Schiele
  Technical report of 1st place solution to Waymo Motion Prediction Challenge at Workshop on Autonomous Driving of CVPR 2022 (CVPRW), 2022.
  Won the champion of Waymo Open Dataset Motion Prediction Challenge 2022 (June, 2022).

• MPPNet: Multi-Frame Feature Intertwining with Proxy Points for 3D Temporal Object Detection
  Xuesong Chen*, Shaoshuai Shi*#, Benjin Zhu, Ka Chun Cheung, Hang Xu, Hongsheng Li#
  European Conference on Computer Vision (ECCV), 2022.  [Code]  
  Ranked 1st place on Waymo 3D object detection leaderboard (June, 2022).

• RBGNet: Ray-based Grouping for 3D Object Detection
  Haiyang Wang, Shaoshuai Shi# , Ze Yang, Rongyao Fang, Qi Qian, Hongsheng Li, Bernt Schiele, Liwei Wang
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022.  [Code]  

• ST3D++: Self-training for Unsupervised Domain Adaptation on 3D Object Detection
  Jihan Yang, Shaoshuai Shi, Zhe Wang, Hongsheng Li, Xiaojuan Qi
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), accepted, 2022.

• LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detector
  Xiaoyang Guo, Shaoshuai Shi, Xiaogang Wang, Hongsheng Li
  International Conference on Computer Vision (ICCV), 2021.  [Code]  

• Guided Point Contrastive Learning for Semi-Supervised Point Cloud Semantic Segmentation
  Li Jiang, Shaoshuai Shi, Zhuotao Tian, Xin Lai, Shu Liu, Chi-Wing Fu, Jiaya Jia
  International Conference on Computer Vision (ICCV), 2021.

• PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detection
  Shaoshuai Shi, Li Jiang, Jiajun Deng, Zhe Wang, Chaoxu Guo, Jianping Shi, Xiaogang Wang, Hongsheng Li
  Preprint, arXiv:2102.00463.  [Code]  

• ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection
  Jihan Yang*, Shaoshuai Shi*, Zhe Wang, Hongsheng Li, Xiaojuan Qi
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.  [Code]  

• Back-tracing Representative Points for Voting-based 3D Object Detection in Point Clouds
  Bowen Cheng, Lu Sheng, Shaoshuai Shi, Ming Yang, Dong Xu
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.  [Code]  

• Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detection
  Jiajun Deng, Shaoshuai Shi, Peiwei Li, Wengang Zhou, Yanyong Zhang, Houqiang Li
  AAAI Conference on Artificial Intelligence (AAAI), 2021.  [Code]  

• The Top-Performing LiDAR-only Solutions for 3D Detection / 3D Tracking / Domain Adaptation of Waymo Open Dataset Challenges
  Shaoshuai Shi, Chaoxu Guo, Jihan Yang, Hongsheng Li
  Technical report of top-performing LiDAR-only solutions to Waymo Open Dataset Challenges at Workshop on Autonomous Driving of CVPR 2020 (CVPRW), 2020.  [Code]  

• PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection
  Shaoshuai Shi, Chaoxu Guo, Li Jiang, Zhe Wang, Jianping Shi, Xiaogang Wang, Hongsheng Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.  [Code]  
  Ranked 1st place on KITTI 3D object detection benchmark (Car, Nov 2019 - Aug 2020).

• PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation
  Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020. [Oral]  [Code]  
  Ranked 1st place on ScanNet 3D Semantic instance benchmark (Nov-16 2019).

• From Points to Parts: 3D Object Detection from Point Cloud with Part-aware and Part-aggregation Network
  Shaoshuai Shi, Zhe Wang, Jianping Shi, Xiaogang Wang, Hongsheng Li
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), accepted, 2020.   [Code]
  ESI Hot and Highly Cited Paper (top 0.1%).
  Ranked 1st place on KITTI 3D object detection benchmark (Car, July-9 2019).

• SegVoxelNet: Exploring Semantic Context and Depth-aware Features for 3D Vehicle Detection from Point Cloud
  Hongwei Yi, Shaoshuai Shi, Mingyu Ding, Jiankai Sun, Kui Xu, Hui Zhou, Zhe Wang, Sheng Li, Guoping Wang
  International Conference on Robotics and Automation (ICRA), 2020.

• PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud
  Shaoshuai Shi, Xiaogang Wang, Hongsheng Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.   [Code-v1] [Code-v2]
  The top-10 cited papers among all CVPR-2019 papers (March, 2021), refer to here.

• Feature Intertwiner for Object Detection
  Hongyang Li, Bo Dai, Shaoshuai Shi, Wanli Ouyang, Xiaogang Wang
  International Conference on Learning Representation (ICLR), 2019.

• GAL: Geometric Adversarial Loss for Single-View 3D-Object Reconstruction
  Li Jiang, Shaoshuai Shi, Xiaojuan Qi, Jiaya Jia
  European Conference on Computer Vision (ECCV), 2018. [Oral]

• FP-DNN: An Automated Framework for Mapping Deep Neural Networks onto FPGAs with RTL-HLS Hybrid Templates
  Yijin Guan, Hao Liang, Ningyi Xu, Wenqiang Wang, Shaoshuai Shi, Xi Chen, Guangyu Sun, Wei Zhang, Jason Cong
  IEEE Field-Programmable Custom Computing Machines (FCCM), 2017.

Experience

• Postdoc Researcher, Oct 2021 - Present, Max Planck Institute for Informatics, Germany.
  Advised by Prof. Bernt Schiele.

• Research Intern, Mar 2019 - Feb 2021, Autonomous Driving Group of SenseTime, Shenzhen, China.
  Working with Dr. Zhe Wang and Dr. Jianping Shi.

• Research Intern, July 2016 - July 2017, System Group of Microsoft Research Asia (MSRA), Beijing, China.
  Advised by Prof. Ningyi Xu.

Honors & Awards

• Champion of Waymo Open Dataset Motion Prediction challenge, 2022.
• World Artificial Intelligence Conference (WAIC) Rising Star Award (17 selected world-wide), 2021.
• Google PhD Fellowship in machine perception (10 selected world-wide), 2020.
• Hong Kong PhD Fellowship (The highest scholarship for PhD students in Hong Kong), 2017-2021
• National Scholarship, 2014, 2015, 2016
• Silver Prize of China Collegiate Programming Contest (CCPC 2015), 2015
• Second Prize of China Undergraduate Mathematical Contest in Modeling (CUMCM 2015), 2015
• Gold Prize of China Collegiate Programming Contest (CCPC) of Northeast Area, 2015