Yangang Wang 
王雁刚
Associate Professor
PhD advisor
School of Automation
Southeast University, Nanjing 210096, China
Opening PhD and Master Positions
Yangang Wang is currently an associate professor in School of Automation at Southeast University (SEU). Before joining in SEU, he worked as a research scientist at Microsoft Research Asia (MSRA) from 2014 to 2017. He received his Ph.D. in 2014 from Department of Automation at Tsinghua University, advised by Prof. Qionghai Dai. His primary research area involves in Computer Vision, Computer Graphics and Virtual Reality. His most recent research interests are digital virtual human (DVH) and dynamic shape reconstruction with single or multiview cameras (a.k.a. markerless motion capture), including
  • 3D/4D human capture, modeling and reconstruction
  • Hand pose acquisition, modeling and simulation
  • Body shape reconstruction, simulation and control
  • Tiny motion or vibration sensing, measurement and analysis
He is a program committee member of AAAI2019-2022, Chinagraph2020-2022 and CICAI2022. He also serves as the paper reviewer of SIGGRAPH / TVCG / TPAMI / CVPR / ICCV / NeurIPS and etc.
Background
  • 2017.09 – CurrentAssociate Professor, Southeast University, Nanjing, China
  • 2014.07 – 2017.08Research Scientist, Microsoft Research Asia (MSRA), Beijing, China
  • 2012.10 – 2013.03Visiting Student, LGG, EPFL, Lausanne, Switzerland
  • 2009.09 – 2014.07Ph.D., Tsinghua University, Beijing, China
  • 2005.09 – 2009.07B.E., Southeast University, Nanjing, China
Southeast University | Microsoft Research Asia | BBNC of Tsinghua University
News
  • 10 / 2024 – I was invited to give a talk entitled "Dynamic Human Motion Capture" at Capital University of Physical Education And Sports, Beijing.
  • 10 / 2024 – I was invited to give a talk entitled "Artifical Intelligence and Future Trends" at the "Qingma Project" university-level training class in Anhui Province.
  • 04 / 2024 – I was invited to give a talk on the popularization of science and technology, specifically focusing on humanoid robots, to the freshmen students at Jiangsu Dafeng Senior High School.
  • 01 / 2024 – I have accepted the invitation to serve as an Area Chair for ACM MM 2024.
  • 12 / 2023 – I was invited to give a talk entitled "Vision-based 4D Cardiac Reconstruction" at the MICAD 2023.
  • 10 / 2023 – I accepted the invitation to give a talk on the salon of Young Elite Scientists Sponsorship Program at the 19th Young Scientists Conference of the CSIG.
  • 09 / 2023 – I was invited to give a presentation on the technical innovation achievements related to the "Multi-camera High-speed Synchronization Capture System and its Applications" in Jianye High-tech Zone, Nanjing.
  • 07 / 2023 – Congratulations to Zhipeng Yu (Bachelor, 2022) for Excellent Bachelor Thesis of Jiangsu Province. Media News!
  • 07 / 2023 – 4 papers were accepted by ICCV 2023.
  • 07 / 2023 – Congratulations to Tianshu Zhang (Master, 2022) for Excellent Master Thesis of Southeast University.
  • 06 / 2023 – I was invited to give a seminar talk on digital virtual human to the sophomore students of Jiangsu Dafeng Senior High School.
  • 06 / 2023 – Congratulations to Zesong Yang (Bachelor, 2023) for Excellent Bachelor Thesis of Southeast University.
  • 03 / 2023 – My students and I won the 1st place in the competition of 2022 GigaCrowd challenge.
  • 02 / 2023 – I served as a poster chair of China3DV 2023.
  • 01 / 2023 – I was invited to give a short course at ICDT 2023.
  • 12 / 2022 – I was invited to give a talk entitled "video based human reconstruction and motion capture" at the Symposium on Frontier Technologies of Virtual Reality 2022.
  • 10 / 2022 – Congratulations to Buzhen Huang (Ph.D. Candidate, 2022) for Style3D Graduate Fellowship issued by CCF CAD/CG.
  • 07 / 2022 – Congratulations to Tianshu Zhang and Qiaomu Ren on receiving their Master degrees. Yiming Xie, Yunqi Zhao and Xi Zhao on receiving their Bachelor degrees. Zhipeng Yu and Yiming Xie on obtaining the title of outstanding undergraduate (2022) at Southeast University. Wish them the very best of luck in all their future endeavors!
  • 06 / 2022 – I was invited to give the 2022 commencement speech at the School of Automation, Southeast University.
  • 06 / 2022 – Congratulations to Zhipeng Yu (Bachelor, 2022) for Excellent Bachelor Thesis of Southeast University.
  • 03 / 2022 – 2 papers were accepted by CVPR 2022.
  • 02 / 2022 – A talk for the freshman of Southeast University on vision based digital virtual human. This is a short summary from the student union of the school of automation at Southeast university.
  • 11 / 2021 – I was invited to give a talk at the annual academic committee meetings of the Key Laboratory of Measurement and Control of Complex Systems of Engineering, Ministry of Education, Nanjing, China.
  • 09 / 2021 – Congratulations to Baowen Zhang (Bachelor, 2020) for Excellent Bachelor Thesis of Jiangsu Province. Media News!
  • 08 / 2021 – 2 papers were accepted by ICCV 2021.
  • 07 / 2021 – Congratulations to Wenlin Zhuang and Zhengyi Zhao on receiving their Master degrees. Tianyao Wang, Yue Han and Heng Tan on receiving their Bachelor degrees. Yuan Yang and Yue Han on obtaining the title of outstanding undergraduate (2021) at Southeast University. Wish them the very best of luck in all their future endeavors!
  • 06 / 2021 – I was invited to give a talk at the Young Scientists Forum of China 3DV.
  • 06 / 2021 – I served as the final judge of the Global AI innovation contest (Track 2) , which is held in Hangzhou.
  • 04 / 2021 – A little thought about how undergraduates do research. This is a short interview from the student union of the school of automation at Southeast university.
  • 12 / 2020 – I attended the Young Scientists Forum of China Society of Image and Graphics and reported the annual progress to the youth committee of CSIG.
  • 07 / 2020 – I was invited to give a talk at the 20th national conference on image and graphics (NCIG 2020).
  • 06 / 2020 – Congratulations to Cong Zeng and Yinjun Chu on receiving their Master degrees. Tiankai Hang, Baowen Zhang, Yuchen Zhang and Bin Yu on receiving their Bachelor degrees. Wish them the very best of luck in all their future endeavors!
  • 06 / 2020 – Congratulations to Baowen Zhang (Bachelor, 2020) for Excellent Bachelor Thesis of Southeast University.
  • 02 / 2020 – Our paper "Object-Occluded Human Shape and Pose Estimation from a Single Color Image" was accepted as oral presentation by CVPR 2020. Media News!
  • 01 / 2020 – I was awarded as Young Elite Scientists Sponsorship Program by CAST.(中国科协青年人才托举工程)
  • 12 / 2019 – I was awarded as "Zhishan Young Scholor" of Southeast University.
  • 11 / 2019 – Our paper "SRHandNet: Real-time 2D Hand Pose Estimation with Simultaneous Region Localization" was accepted by TIP.
  • 07 / 2019 – Congratulations to Peilin Shen and Shiyu Zhao on receiving their Master degrees. Wish them the very best of luck in all their future endeavors!
  • 06 / 2019 – Congratulations to Tianshu Zhang (Bachelor, 2019), Zimeng Zhao (Bachelor, 2019) and Keyi Yu (Bachelor, 2019) for Excellent Bachelor Thesis of Southeast University.
  • 04 / 2019 – I won the second prize (9 / 194) of Teaching Competition for Young Teachers of Southeast University.
  • 03 / 2019 – I was invited to give a talk at Graphics Interface (GI) 2019.
  • 11 / 2018 – We have released the OneHand10K dataset. Please send me E-mail for requesting the dataset.
  • 10 / 2018 – Our paper "Mask-pose Cascaded CNN for 2D Hand Pose Estimation from Single Color Image" was accepted by TCSVT.
  • 10 / 2018 – I was invited to give a talk entitled "motion capture with linear blend skinning" at the GAMES platform.
  • 09 / 2018 – I was awarded as the talent of Jiangsu Province "Double Innovation Program".(江苏省双创计划人才)
  • 08 / 2018 – I was served as the judge of 2018 Chinese Undergraduate Computer Design Contest (AI) at NJUPT, Nanjing, China.
  • 07 / 2018 – I gave a talk entitled "dynamic 3D reconstruction" at the technical panel of Southeast University, Nanjing, China.
  • 05 / 2018 – I gave a talk entitled "motion capture and computer vision: challenges and opportunities" at the 2018 annual conference of Jiangsu Association of Automation, Nanjing, China.
  • 09 / 2017 – I left MSRA and joined in Southeast University, Nanjing, China.
  • 06 / 2017 – I gave a talk entitled "video-based motion capture" at SenseTime, Beijing, China.
  • 06 / 2017 – I moved to this new homepage.
  • 04 / 2017 – Our paper "Outdoor Markerless Motion Capture with Sparse Handheld Video Cameras" was accepted by TVCG.
  • 08 / 2016 – Thanks to my wife! My kid was born
  • 07 / 2016 – Our patent "Method, Apparatus And System For 3D Face Tracking" was filed with the U.S. Patent and Trademark Office.
  • 09 / 2015 – Our paper "Robust Non-rigid Motion Tracking and Surface Reconstruction Using L0 Regularization" was accepted by ICCV.
  • 08 / 2015 – I gave a talk about the future 3D presentation at Microsoft Annual Kickoff in Dunhuang, Gansu Province, China.
  • 07 / 2014 – I received my Ph.D. from Tsinghua University and joined in MSRA, Beijing, China.
  • 06 / 2014 – I gave a talk on markerless motion capture at IDL Baidu, Beijing, China.
Publications
Follow my work on Google Scholar
GraspDiff: Grasping Generation for Hand-Object Interaction with Multimodal Guided Diffusion IEEE Transactions on Visualization and Computer Graphics (TVCG), 2024 Binghui Zuo, Zimeng Zhao, Wenqian Sun, Xiaohan Yuan, Zhipeng Yu, and Yangang Wang Paper    Webpage (coming soon)
TexDC: Text-Driven Disease-Aware 4D Cardiac Cine MRI Images Generation Asian Conference on Computer Vision (ACCV), 2024 Cong Liu, Xiaohan Yuan, and Yangang Wang Paper (coming soon)    Webpage (coming soon)    Code (coming soon)
Accurate and Real-time Variant Hand Pose Estimation Based on Gray Code Bounding Box Representation IEEE Sensors Journal, 2024 Yangang Wang, Wenqian Sun, and Ruting Rao Paper
Closely Interactive Human Reconstruction with Proxemics and Physics-Guided Adaption IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2024 Buzhen Huang, Chen Li, Chongyang Xu, Liang Pan, Yangang Wang and Gim Hee Lee Paper
Music Conditioned Generation for Human-centric Video IEEE Signal Processing Letters, 2024 Zimeng Zhao, Binghui Zuo, and Yangang Wang Paper
Synthesizing Physically Plausible Human Motions in 3D Scenes International Conference on 3D Vision (3DV), 2024 Liang Pan, Jingbo Wang, Buzhen Huang, Junyu Zhang, Haofan Wang, Xu Tang and Yangang Wang Paper    Code
4D Myocardium Reconstruction with Decoupled Motion and Shape Model IEEE/CVF International Conference on Computer Vision (ICCV), 2023 Xiaohan Yuan, Cong Liu and Yangang Wang Paper    Webpage    Code    Dataset
Reconstructing Groups of People with Hypergraph Relational Reasoning IEEE/CVF International Conference on Computer Vision (ICCV), 2023 Buzhen Huang, Jingyi Ju, Zhihao Li and Yangang Wang Paper    Webpage    Dataset
Reconstructing Interacting Hands with Interaction Prior from Monocular Images IEEE/CVF International Conference on Computer Vision (ICCV), 2023 Binghui Zuo, Zimeng Zhao, Wenqian Sun, Wei Xie, Zhou Xue and Yangang Wang Paper    Webpage    Code    Dataset
Nonrigid Object Contact Estimation With Regional Unwrapping Transformer IEEE/CVF International Conference on Computer Vision (ICCV), 2023 Wei Xie, Zimeng Zhao, Shiying Li, Binghui Zuo and Yangang Wang Paper    Webpage
Simultaneously Recovering Multi-Person Meshes and Multi-View Cameras with Human Semantics IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2023 Buzhen Huang, Jingyi Ju, Yuan Shu and Yangang Wang Paper
Physics-Guided Human Motion Capture with Pose Probability Modeling International Joint Conferences on Artificial Intelligence (IJCAI), 2023 Jingyi Ju, Buzhen Huang, Chen Zhu, Zhihao Li and Yangang Wang Paper    Code
HMDO : Markerless Multi-view Hand Manipulation Capture with Deformable Objects (Public dataset: HMDO, 12 deformable objects, 21600 frames) International Conference on Computational Visual Media (CVM), 2023 (Recommended publishing on Graphical Models) Wei Xie*, Zhipeng Yu*, Zimeng Zhao, Binghui Zuo and Yangang Wang (*contribute equally) Paper    Webpage    Dataset
Semi-supervised Hand Appearance Recovery via Structure Disentanglement and Dual Adversarial Discrimination IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2023 Zimeng Zhao, Binghui Zuo, Zhiyu Long and Yangang Wang Paper    Webpage   
Skeleton Extraction for Articulated Objects with the Spherical Unwrapping Profiles IEEE Transactions on Visualization and Computer Graphics (TVCG), 2023 Zimeng Zhao, Wei Xie, Binghui Zuo and Yangang Wang Paper    Webpage   
Slice-mask based 3D Cardiac Shape Reconstruction from CT Volume (Public dataset: LV-CT-Healthy) Asian Conference on Computer Vision (ACCV), 2022 Xiaohan Yuan, Cong Liu, Fu Feng, Yinsu Zhu and Yangang Wang Paper    Code    Dataset
Object-Occluded Human Shape and Pose Estimation with Probabilistic Latent Consistency IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022 Tianshu Zhang*, Buzhen Huang* and Yangang Wang (*contribute equally) Paper    Dataset
Pose2UV: Single-shot Multi-person Mesh Recovery with Deep UV Prior (Public dataset: 3DMPB) IEEE Transactions on Image Processing (TIP), 2022 Tianshu Zhang*, Buzhen Huang* and Yangang Wang (*contribute equally) Paper    Webpage    Video    Dataset
DeepCloth: Neural Garment Representation for Shape and Style Editing IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022 Zhaoqi Su, Tao Yu, Yangang Wang and Yebin Liu Paper
Neural MoCon: Neural Motion Control for Physically Plausible Human Motion Capture IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022 Buzhen Huang, Liang Pan, Yuan Yang, Jingyi Ju and Yangang Wang Paper    Webpage    Video
Stability-driven Contact Reconstruction From Monocular Color Images (Public dataset: 20 subjects, 25 calibrated views) IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022 Zimeng Zhao, Binghui Zuo, Wei Xie and Yangang Wang Paper    Webpage    Video    Dataset
SUPPLE: Extracting Hand Skeleton with Spherical Unwrapping Profiles International Conference on 3D Vision (3DV), 2021 Zimeng Zhao, Ruting Rao and Yangang Wang Paper    Poster
Dynamic Multi-person Mesh Recovery from Uncalibrated Multi-view Cameras International Conference on 3D Vision (3DV), 2021 Buzhen Huang, Yuan Shu, Tianshu Zhang and Yangang Wang Paper    Video    Code    Poster
TravelNet: Self-supervised Physically Plausible Hand Motion Learning from Monocular Color Images IEEE/CVF International Conference on Computer Vision (ICCV), 2021 Zimeng Zhao, Xi Zhao and Yangang Wang Paper    Video    Dataset
Interacting Two-Hand 3D Pose and Shape Reconstruction from Single Color Image IEEE/CVF International Conference on Computer Vision (ICCV), 2021 Baowen Zhang, Yangang Wang, Xiaoming Deng, Yinda Zhang, Ping Tan, Cuixia Ma and Hongan Wang Paper    Code
Music2Dance: DanceNet for Music-driven Dance Generation ACM Transactions on Multimedia Computing, Communications and Applications (TOMM), 2021 Wenlin Zhuang, Congyi Wang, Siyu Xia, Jinxiang Chai, and Yangang Wang Paper    Video
Personalized Hand Modeling from Multiple Postures with Multi-view Color images Computer Graphics Forum (Pacific Graphics), 2020 Yangang Wang, Ruting Rao and Changqing Zou Paper    Dataset
Object-Occluded Human Shape and Pose Estimation from a Single Color Image (Oral presentation) IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020 Tianshu Zhang*, Buzhen Huang* and Yangang Wang (*contribute equally) Paper    Webpage    Code    Dataset
Hand-3D-Studio: A New Multi-view System for 3D Hand Reconstruction (Public dataset: 200+ hand 3D meshes, 20K RGB images, 15 calibrated views) International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2020 Zhengyi Zhao, Tianyao Wang, Siyu Xia and Yangang Wang Paper    Webpage    Dataset
SRHandNet: Real-time 2D Hand Pose Estimation with Simultaneous Region Localization IEEE Transactions on Image Processing (TIP), 2019 Yangang Wang, Baowen Zhang and Cong Peng Paper    Webpage    Code
Mask-pose Cascaded CNN for 2D Hand Pose Estimation from Single Color Image (Public dataset: OneHand10K) IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2019 Yangang Wang, Cong Peng and Yebin Liu Paper    Webpage    Code    Dataset
Phase-Based Non-Contact Vibration Measurement for High Speed Magnetically Suspended Rotor IEEE Transactions on Instrumentation and Measurement (TIM), 2019 Cong Peng, Cong Zeng and Yangang Wang Paper
Camera-based Micro-vibration Measurement for Lightweight Structure using an Improved Phase-based Motion Extraction IEEE Sensors Journal, 2019 Cong Peng, Cong Zeng and Yangang Wang Paper
Multi-scale Adaptive Structure Network for Human Pose Estimation from Color Images Asian Conference on Computer Vision (ACCV), 2018 Wenlin Zhuang, Cong Peng, Siyu Xia and Yangang Wang Paper
Shape and Pose Estimation for Closely Interacting Persons Using Multi-view Images Computer Graphics Forum (Pacific Graphics), 2018 Kun Li, Nianhong Jiao, Yebin Liu, Yangang Wang and Jingyu Yang Paper
Outdoor Markerless Motion Capture with Sparse Handheld Video Cameras IEEE Transactions on Visualization and Computer Graphics (TVCG), 2018 Yangang Wang, Yebin Liu, Xin Tong, Qionghai Dai and Ping Tan Paper    Webpage
Robust Non-Rigid Motion Tracking and Surface Reconstruction Using L0 Regularization IEEE Transactions on Visualization and Computer Graphics (TVCG), 2018 KaiWen Guo, Feng Xu, Yangang Wang, Yebin Liu and Qionghai Dai Paper
Depth Estimation by Parameter Transfer With a Lightweight Model for Single Still Images IEEE Transactions on Circuits and Systems for Video Technology (TCSVT), 2017 Hongwei Qin, Xiu Li, Yangang Wang, Yongbing Zhang and Qionghai Dai Paper   
Normalized Filter Pool for Prior Modeling of Nature Images Machine Vision and Applications, 2016 Yangang Wang, Jinli Suo and Qionghai Dai Paper   
Robust Non-Rigid Motion Tracking and Surface Reconstruction Using L0 Regularization IEEE International Conference on Computer Vision (ICCV), 2015 KaiWen Guo, Feng Xu, Yangang Wang, Yebin Liu and Qionghai Dai Paper
DEPT: Depth Estimation by Parameter Transfer for Single Still Images Asian Conference on Computer Vision (ACCV), 2014 Xiu Li, HongWei Qin, Yangang Wang, Yongbing Zhang and Qionghai Dai Paper   
Human Performance Capture Using Multiple Handheld Kinects Book Chapter: Computer Vision and Machine Learning with RGB-D Sensors, 2014 Yebin Liu, Genzhi Ye, Yangang Wang, Qionghai Dai and Christian Theobalt Paper   
A Parametric Model for Describing the Correlation Between Single Color Images and Depth Maps IEEE Signal Processing Letters, 2014 Yangang Wang, Ruiping Wang and Qionghai Dai Paper
Online Modeling for Realtime Facial Animation ACM Transactions on Graphics (SIGGRAPH), 2013 Sofien Bouaziz, Yangang Wang and Mark Pauly Paper
Video-based Hand Manipulation Capture Through Composite Motion Control ACM Transactions on Graphics (SIGGRAPH), 2013 Yangang Wang, Jianyuan Min, Jianjie Zhang, Yebin Liu, Feng Xu, Qionghai Dai and Jinxiang Chai Paper    Webpage   
Ph.D. Thesis
(in Chinese)
Markerless Motion Capture and Motion Retargeting Department of Automation, Tsinghua University, July 2014 Yangang Wang
People
We are a dynamic group of graduate and undergraduate students. Currently, I am looking for PhD and masters (3-4 per year) and talent undergraduate students to work with 3D capture, modeling and reconstruction. If you are with background or strong interest in computer graphics, computer vision, signal processing, 3D vision and deep learning, please feel free to contact me.
Graduate Students
Xiaohan Yuan
Zhipeng Yu
Buzhen Huang
Jingyi Ju
Cong Liu
Wenqian Sun
Zhengheng Rui
Shiying Li
Chen Zhu
Zijing Wu
Yuzhou Zheng
Lin Zhou
Alumni
2024
Wei Xie (Selected Graduate, Hunan)
Liang Pan (HongKong U.)
Zhiyu Long (Tsinghua)
Xiaoye Liang (Beihang U.)
Yuncong Wu (HIT)
2023
Ruting Rao (Unity)
Zesong Yang (Zhejiang U.)
Yue Zhang (TUM)
2022
Tianshu Zhang (mihoyo)
Qiaomu Ren (Alibaba)
Yiming Xie (Tsinghua)
Yunqi Zhao (Tsinghua)
Xi Zhao (Cornell)
2021
Wenlin Zhuang (Alibaba)
Zhengyi Zhao (Alibaba)
Zenglan Su (Zhejiang U.)
Yue Han (Zhejiang U.)
Tianyao Wang (Shanghai Jiao Tong)
Heng Tan (U. Lehigh)
2020
Cong Zeng (Hua Wei)
Yinjun Chu (Baidu)
Baowen Zhang (ISCAS)
Yuchen Zhang (Duke)
Tiankai Hang (MSRA)
Bin Yu (CMCC)
2019
Peilin Shen (mei tuan)
Shiyu Zhao (CCB)
Keyi Yu (Pennsylvania)
2018
Yunzhi Lin (Geogia Tech)
Qikai Yang (UIUC)
Tiande Kou (cambricon)
Collaborators (partial list)
Qionghai Dai
Professor
Tsinghua University
Jinxiang Chai
Associate Professor
Texas A&M University
Professor
Tsinghua University
Xin Tong
Principal Researcher
Microsoft Research Asia
Ping Tan
Associate Professor
Simon Fraser University
Xun Cao
Professor
Nanjing University
Ruiping Wang
Researcher
ICT, CAS
Jinli Suo
Associate Professor
Tsinghua University