Shaoshuai Shi Postdoctoral Researcher Department of Computer Vision and Machine Learning Max Planck Institute for Informatics Email: shaoshuaics [at] gmail [dot] com [Google Scholar]   [GitHub]

About Me

I am a postdoctoral researcher at Max Planck Institute for Informatics (MPI-INF), working with Prof. Bernt Schiele. I obtained my Ph.D. degree from Multimedia Lab (MMLab) of The Chinese University of Hong Kong (CUHK), supervised by Prof. Xiaogang Wang and Prof. Hongsheng Li. Before that, I received my bachelor’s degree from the Computer Science Honor Class of Harbin Institute Technology (HIT) in 2017. My research interests focus on computer vision and deep learning, especially the 3D scene understanding, object detection and autonomous driving related topics.

News

• The source code of PV-RCNN++ has been released to OpenPCDet.
• Two papers got accepted by ICCV 2021.
• I was awarded the World Artificial Intelligence Conference (WAIC) Rising Star Award, see the news from WAIC.
• Two papers got accepted by CVPR 2021.
• I was awarded Google PhD Fellowship 2020, see the news from Google AI Blog.
• Highly optimized PyTorch codebase OpenPCDet for LiDAR-based 3D scene understanding is released, including the implementation of PV-RCNN, the 1st place method in the KITTI 3D detection leaderboard.
• We won the 1st place among all LiDAR-only methods / 2nd place among all methods on 3D Detection, 3D Tracking, Domain Adaptation three tracks of the Waymo Open Dataset challenge. See the official blog post from Waymo.
• Two papers with one oral got accepted by CVPR 2020.

Codebase

OpenPCDet: An Open-source Toolbox for 3D Object Detection from Point Cloud OpenPCDet Development Team June 2020 [Code]   [Bibtex]

@misc{openpcdet2020,
    title={OpenPCDet: An Open-source Toolbox for 3D Object Detection from Point Clouds},
    author={OpenPCDet Development Team},
    howpublished = {\url{https://github.com/open-mmlab/OpenPCDet}},
    year={2020}
}

Publications

• ST3D++: Self-training for Unsupervised Domain Adaptation on 3D Object Detection
  Jihan Yang, Shaoshuai Shi, Zhe Wang, Hongsheng Li, Xiaojuan Qi
  Technical report, arXiv:2108.06682.

• LIGA-Stereo: Learning LiDAR Geometry Aware Representations for Stereo-based 3D Detector
  Xiaoyang Guo, Shaoshuai Shi, Xiaogang Wang, Hongsheng Li
  International Conference on Computer Vision (ICCV), 2021.  [Code]  

• Guided Point Contrastive Learning for Semi-Supervised Point Cloud Semantic Segmentation
  Li Jiang, Shaoshuai Shi, Zhuotao Tian, Xin Lai, Shu Liu, Chi-Wing Fu, Jiaya Jia
  International Conference on Computer Vision (ICCV), 2021.

• ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detection
  Jihan Yang*, Shaoshuai Shi*, Zhe Wang, Hongsheng Li, Xiaojuan Qi (*co-first authors)
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.  [Code]  

• Back-tracing Representative Points for Voting-based 3D Object Detection in Point Clouds
  Bowen Cheng, Lu Sheng, Shaoshuai Shi, Ming Yang, Dong Xu
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021.  [Code]  

• PV-RCNN++: Point-Voxel Feature Set Abstraction With Local Vector Representation for 3D Object Detection
  Shaoshuai Shi, Li Jiang, Jiajun Deng, Zhe Wang, Chaoxu Guo, Jianping Shi, Xiaogang Wang, Hongsheng Li Technical report, arXiv:2102.00463.  [Code]  

• Voxel R-CNN: Towards High Performance Voxel-based 3D Object Detection
  Jiajun Deng, Shaoshuai Shi, Peiwei Li, Wengang Zhou, Yanyong Zhang, Houqiang Li
  AAAI Conference on Artificial Intelligence (AAAI), 2021.  [Code]  

• The Top-Performing LiDAR-only Solutions for 3D Detection / 3D Tracking / Domain Adaptation of Waymo Open Dataset Challenges
  Shaoshuai Shi, Chaoxu Guo, Jihan Yang, Hongsheng Li
  Technical report of top-performing LiDAR-only solutions to Waymo Open Dataset Challenges at Workshop of CVPR 2020.  [Code]  

• PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection
  Shaoshuai Shi, Chaoxu Guo, Li Jiang, Zhe Wang, Jianping Shi, Xiaogang Wang, Hongsheng Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020.  [Code]  
  Ranked 1st place on KITTI 3D object detection benchmark (Car, Nov-16 2019).

• PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation
  Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2020. [Oral]  [Code]  
  Ranked 1st place on ScanNet 3D Semantic instance benchmark (Nov-16 2019).

• From Points to Parts: 3D Object Detection from Point Cloud with Part-aware and Part-aggregation Network
  Shaoshuai Shi, Zhe Wang, Jianping Shi, Xiaogang Wang, Hongsheng Li
  IEEE Transactions on Pattern Analysis and Machine Intelligence (T-PAMI), accepted.   [Code]
  Ranked 1st place on KITTI 3D object detection benchmark (Car, July-9 2019).

• SegVoxelNet: Exploring Semantic Context and Depth-aware Features for 3D Vehicle Detection from Point Cloud
  Hongwei Yi, Shaoshuai Shi, Mingyu Ding, Jiankai Sun, Kui Xu, Hui Zhou, Zhe Wang, Sheng Li, Guoping Wang
  International Conference on Robotics and Automation (ICRA), 2020.

• PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud
  Shaoshuai Shi, Xiaogang Wang, Hongsheng Li
  IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2019.   [Code-v1] [Code-v2]
  The top-10 cited papers among all CVPR-2019 papers (March, 2021), refer to here.

• Feature Intertwiner for Object Detection
  Hongyang Li, Bo Dai, Shaoshuai Shi, Wanli Ouyang, Xiaogang Wang
  International Conference on Learning Representation (ICLR), 2019.

• GAL: Geometric Adversarial Loss for Single-View 3D-Object Reconstruction
  Li Jiang, Shaoshuai Shi, Xiaojuan Qi, Jiaya Jia
  European Conference on Computer Vision (ECCV), 2018. [Oral]

• FP-DNN: An Automated Framework for Mapping Deep Neural Networks onto FPGAs with RTL-HLS Hybrid Templates
  Yijin Guan, Hao Liang, Ningyi Xu, Wenqiang Wang, Shaoshuai Shi, Xi Chen, Guangyu Sun, Wei Zhang, Jason Cong
  IEEE Field-Programmable Custom Computing Machines (FCCM), 2017.

Invited Talks

• [2020-06-24] VALSE Webinar: Deep Learning on Point Clouds for 3D Object Detection. [Link (Chinese)]
• [2020-06-16] PV-RCNN: The Top-Performing LiDAR-only Solutions for 3D Detection / 3D Tracking / Domain Challenges of Waymo Open Dataset Challenges. [Link]

Experience

• Postdoc Researcher, Oct 2021 - Now, Department of Computer Vision and Machine Learning, Max Planck Institute for Informatics, Germany.
  Advised by Prof. Bernt Schiele.

• Research Intern, Mar 2019 - Feb 2021, Autonomous Driving Group of SenseTime, Shenzhen, China.
  Working with Dr. Zhe Wang and Dr. Jianping Shi.

• Research Intern, July 2016 - July 2017, System Group of Microsoft Research Asia (MSRA), Beijing, China.
  Advised by Prof. Ningyi Xu.

Honors & Awards

• World Artificial Intelligence Conference (WAIC) Rising Star Award, 2021.
• Google PhD Fellowship in machine perception (10 selected world-wide), 2020.
• Hong Kong PhD Fellowship (The highest scholarship for PhD students in Hong Kong), 2017-2021
• National Scholarship, 2014, 2015, 2016
• Silver Prize of China Collegiate Programming Contest (CCPC 2015), 2015
• Second Prize of China Undergraduate Mathematical Contest in Modeling (CUMCM 2015), 2015
• Gold Prize of China Collegiate Programming Contest (CCPC) of Northeast Area, 2015
• First Prize of Mathematical Modeling Contest of Northeast Area, 2015
• First Class Scholarship of HIT (six times at each semester), 2014-2016