Yuxiang ZHOU

I am Research Engineer @ Google DeepMind.
View Profile Contact me

Who am I?

I recieved my Ph.D in Computing at Imperial College London, UK, in 2019, under the supervision of Prof. Stefanos Zafeiriou. Currently, I am a Senior Research Engineer at DeepMind.

Research Topic: Solve Robotics. Third Person Imitation Learning. Research on Statistical Deformable Models with Dense Shapes. Estimate dense correspondence between shapes without landmark. Apply model fitting and tracking on highly deformable and articulated objects under unconstrained conditions.

See my portfolio Contact me

Skills & Attributes

Python
JavaScript, HTML5, CSS3, SQL, PHP
C, C++, C#, Java, Objective-C
Haskell, Prolog, Visual Basic, Assembly Code

My Specialities

AI Researcher

Computer Vision, Robotics, Reinforcement Learning, Thrid Person Imitation Learning

Software Engineer

Python, C++, Java, Mobile App

Full Stack Web Developer

Front-End, Back-End and Databases.

Education

Oct 2014 - Sep 2019
Computer Science Ph.D
Imperial College London, UK
Oct 2010 - Sep 2014
MEng Computing
Imperial College London, UK
Sep 2007 - Sep 2009
A-Level
Leicester Grammar School, UK

Jobs

Dec 2018 – Current
Research Engineer @ Google DeepMind
Google DeepMind, London, UK
Sep 2017 – Mar 2018
Research Internship - Deep Reinforcement Learning and Robotics
Google Brain & DeepMind, London, UK
10/2016 – 04/2017 & 10/2015 – 04/2016 & 10/2014 – 04/2015 & 10/2012 – 04/2013
Teaching Assistant
Department of Computing, Imperial College London, UK
Apr 2013 - Sep 2013
Industrial Placement - Mobile Development
Bloomberg L.P., London, UK

Languages

Mandarin Chinese
English

Publications

RoboCat: A Self-Improving Foundation Agent for Robotic Manipulation

Konstantinos Bousmalis*, Giulia Vezzani*, Dushyant Rao*, Coline Devin*, Alex X. Lee*, Maria Bauza*, Todor Davchev*, Yuxiang Zhou*, Agrim Gupta*, Akhil Raju, Antoine Laurens, Claudio Fantacci, Valentin Dalibard, Martina Zambelli, Murilo Martins, Rugile Pevceviciute, Michiel Blokzijl, Misha Denil, Nathan Batchelor, Thomas Lampe, Emilio Parisotto, Konrad Żołna, Scott Reed, Sergio Gómez Colmenarejo, Jon Scholz, Abbas Abdolmaleki, Oliver Groth, Jean-Baptiste Regli, Oleg Sushkov, Tom Rothörl, José Enrique Chen, Yusuf Aytar, Dave Barker, Joy Ortiz, Martin Riedmiller, Jost Tobias Springenberg, Raia Hadsell, Francesco Nori, Nicolas Heess


@article{bousmalis2023robocat,
  title={RoboCat: A Self-Improving Foundation Agent for Robotic Manipulation},
  author={Bousmalis, Konstantinos and Vezzani, Giulia and Rao, Dushyant and Devin, Coline and Lee, Alex X and Bauza, Maria and Davchev, Todor and Zhou, Yuxiang and Gupta, Agrim and Raju, Akhil and others},
  journal={arXiv preprint arXiv:2306.11706},
  year={2023}
}
                        

Lossless Adaptation of Pretrained Vision Models For Robotic Manipulation

Mohit Sharma, Claudio Fantacci, Yuxiang Zhou, Skanda Koppula, Nicolas Heess, Jon Scholz, Yusuf Aytar


@article{sharma2023lossless,
  title={Lossless Adaptation of Pretrained Vision Models For Robotic Manipulation},
  author={Sharma, Mohit and Fantacci, Claudio and Zhou, Yuxiang and Koppula, Skanda and Heess, Nicolas and Scholz, Jon and Aytar, Yusuf},
  journal={arXiv preprint arXiv:2304.06600},
  year={2023}
}
                        

How to Spend Your Robot Time: Bridging Kickstarting and Offline Reinforcement Learning for Vision-based Robotic Manipulation

Alex X Lee*, Coline Devin*, Jost Tobias Springenberg*, Yuxiang Zhou, Thomas Lampe, Abbas Abdolmaleki, Konstantinos Bousmalis


@article{lee2022spend,
    title={How to Spend Your Robot Time: Bridging Kickstarting and Offline Reinforcement Learning for Vision-based Robotic Manipulation},
    author={Lee, Alex X and Devin, Coline and Springenberg, Jost Tobias and Zhou, Yuxiang and Lampe, Thomas and Abdolmaleki, Abbas and Bousmalis, Konstantinos},
    journal={arXiv preprint arXiv:2205.03353},
    year={2022}
}
                        

Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapes

Alex X. Lee*, Coline Devin*, Yuxiang Zhou*, Thomas Lampe*, Konstantinos Bousmalis*, Jost Tobias Springenberg*, Arunkumar Byravan, Abbas Abdolmaleki, Nimrod Gileadi, David Khosid, Claudio Fantacci, Jose Enrique Chen, Akhil Raju, Rae Jeong, Michael Neunert, Antoine Laurens, Stefano Saliceti, Federico Casarini, Martin Riedmiller, Raia Hadsell, Francesco Nori


@inproceedings{lee2021beyond,
    title={Beyond Pick-and-Place: Tackling Robotic Stacking of Diverse Shapes},
    author={Lee, Alex X and Devin, Coline Manon and Zhou, Yuxiang and Lampe, Thomas and Bousmalis, Konstantinos and Springenberg, Jost Tobias and Byravan, Arunkumar and Abdolmaleki, Abbas and Gileadi, Nimrod and Khosid, David and others},
    booktitle={5th Annual Conference on Robot Learning},
    year={2021}
}
                        

Learning rich touch representations through cross-modal self-supervision

Martina Zambelli, Yusuf Aytar, Francesco Visin, Yuxiang Zhou, Raia Hadsell.


@article{zambelli2021learning,
  title={Learning rich touch representations through cross-modal self-supervision},
  author={Zambelli, Martina and Aytar, Yusuf and Visin, Francesco and Zhou, Yuxiang and Hadsell, Raia},
  journal={arXiv preprint arXiv:2101.08616},
  year={2021}
}
                        

Learning Dexterous Manipulation from Suboptimal Experts

Rae Jeong, Jost Tobias Springenberg, Jackie Kay, Daniel Zheng, Yuxiang Zhou, Alexandre Galashov, Nicolas Heess, Francesco Nori.


@article{jeong2020learning,
  title={Learning Dexterous Manipulation from Suboptimal Experts},
  author={Jeong, Rae and Springenberg, Jost Tobias and Kay, Jackie and Zheng, Daniel and Zhou, Yuxiang and Galashov, Alexandre and Heess, Nicolas and Nori, Francesco},
  journal={arXiv preprint arXiv:2010.08587},
  year={2020}
}
                        

Self-supervised sim-to-real adaptation for visual robotic manipulation

Rae Jeong, Yusuf Aytar, David Khosid, Yuxiang Zhou, Jackie Kay, Thomas Lampe, Konstantinos Bousmalis, Francesco Nori.


@inproceedings{jeong2020self,
  title={Self-supervised sim-to-real adaptation for visual robotic manipulation},
  author={Jeong, Rae and Aytar, Yusuf and Khosid, David and Zhou, Yuxiang and Kay, Jackie and Lampe, Thomas and Bousmalis, Konstantinos and Nori, Francesco},
  booktitle={2020 IEEE International Conference on Robotics and Automation (ICRA)},
  pages={2718--2724},
  year={2020},
  organization={IEEE}
}
                        

Retinaface: Single-stage dense face localisation in the wild

Jiankang Deng, Jia Guo, Yuxiang Zhou, Jinke Yu, Irene Kotsia, Stefanos Zafeiriou.


@article{deng2019retinaface,
  title={Retinaface: Single-stage dense face localisation in the wild},
  author={Deng, Jiankang and Guo, Jia and Zhou, Yuxiang and Yu, Jinke and Kotsia, Irene and Zafeiriou, Stefanos},
  journal={arXiv preprint arXiv:1905.00641},
  year={2019}
}
                        

Meshgan: Non-linear 3d morphable models of faces

Shiyang Cheng, Michael Bronstein, Yuxiang Zhou, Irene Kotsia, Maja Pantic, Stefanos Zafeiriou.


@article{cheng2019meshgan,
  title={Meshgan: Non-linear 3d morphable models of faces},
  author={Cheng, Shiyang and Bronstein, Michael and Zhou, Yuxiang and Kotsia, Irene and Pantic, Maja and Zafeiriou, Stefanos},
  journal={arXiv preprint arXiv:1903.10384},
  year={2019}
}
                        

Dense 3d face decoding over 2500fps: Joint texture & shape convolutional mesh decoders

Yuxiang Zhou, Jiankang Deng, Irene Kotsia, Stefanos Zafeiriou.


@inproceedings{zhou2019dense,
  title={Dense 3d face decoding over 2500fps: Joint texture \& shape convolutional mesh decoders},
  author={Zhou, Yuxiang and Deng, Jiankang and Kotsia, Irene and Zafeiriou, Stefanos},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  pages={1097--1106},
  year={2019}
}
                        

UV-GAN: Adversarial Facial UV Map Completion for Pose-invariant Face Recognition

Jiankang Deng , Shiyang Cheng , Niannan Xue , Yuxiang Zhou , Stefanos Zafeiriou.


@inproceedings{deng2018uv,
  title={Uv-gan: Adversarial facial uv map completion for pose-invariant face recognition},
  author={Deng, Jiankang and Cheng, Shiyang and Xue, Niannan and Zhou, Yuxiang and Zafeiriou, Stefanos},
  booktitle={Proceedings of the IEEE conference on computer vision and pattern recognition},
  pages={7093--7102},
  year={2018}
}
                        

Improve Accurate Pose Alignment and Action Localization by Dense Pose Estimation

Yuxiang Zhou , Jiankang Deng , Stefanos Zaferiou.


@inproceedings{zhou2018improve,
  title={Improve accurate pose alignment and action localization by dense pose estimation},
  author={Zhou, Yuxiang and Deng, Jiankang and Zafeiriou, Stefanos},
  booktitle={2018 13th IEEE International Conference on Automatic Face \& Gesture Recognition (FG 2018)},
  pages={480--484},
  year={2018},
  organization={IEEE}
}
                        

Cascade Multi-view Hourglass Model for Robust 3D Face Alignment

Jiankang Deng , Yuxiang Zhou , Shiyang Cheng , Stefanos Zaferiou.


@inproceedings{deng2018cascade,
  title={Cascade multi-view hourglass model for robust 3d face alignment},
  author={Deng, Jiankang and Zhou, Yuxiang and Cheng, Shiyang and Zaferiou, Stefanos},
  booktitle={2018 13th IEEE International Conference on Automatic Face \& Gesture Recognition (FG 2018)},
  pages={399--403},
  year={2018},
  organization={IEEE}
}
                        

Joint Multi-view Face Alignment in the Wild

Jiankang Deng , George Trigeorgis , Yuxiang Zhou , Stefanos Zafeiriou.


@article{deng2019joint,
  title={Joint multi-view face alignment in the wild},
  author={Deng, Jiankang and Trigeorgis, George and Zhou, Yuxiang and Zafeiriou, Stefanos},
  journal={IEEE Transactions on Image Processing},
  volume={28},
  number={7},
  pages={3636--3648},
  year={2019},
  publisher={IEEE}
}
                        

Marginal Loss for Deep Face Recognition

Jiankang Deng , Yuxiang Zhou , Stefanos Zafeiriou.


@inproceedings{deng2017marginal,
  title={Marginal loss for deep face recognition},
  author={Deng, Jiankang and Zhou, Yuxiang and Zafeiriou, Stefanos},
  booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops},
  pages={60--68},
  year={2017}
}
                        

Estimating Correspondences of Deformable Objects "In-the-wild"

Yuxiang Zhou , Epameinondas Antonakos , Anastasios Roussos , Stefanos Zafeiriou.


@inproceedings{zhou2016estimating,
  title={Estimating correspondences of deformable objects" in-the-wild"},
  author={Zhou, Yuxiang and Antonakos, Epameinondas and Alabort-i-Medina, Joan and Roussos, Anastasios and Zafeiriou, Stefanos},
  booktitle={Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition},
  pages={5791--5801},
  year={2016}
}
                        

Semi-autonomous Data Enrichment Based on Cross-task Labelling of Missing Targets for Holistic Speech Analysis

Yue Zhang , Yuxiang Zhou , Jie Shen , Björn Schuller.


@inproceedings{zhang2016semi,
  title={Semi-autonomous data enrichment based on cross-task labelling of missing targets for holistic speech analysis},
  author={Zhang, Yue and Zhou, Yuxiang and Shen, Jie and Schuller, Bj{\"o}rn},
  booktitle={2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
  pages={6090--6094},
  year={2016},
  organization={IEEE}
}