Dr. Chuang Yu (于 闯

Co-founder of Talk in MLLM (Multimodal Large Language Model)


Research Fellow on Affective Interaction with AI with Prof. Nadia Berthouze at UCL Interaction Centre (UCLIC). 


Research Associate on Trustworthy/Cognitive Robotics and AI at Prof. Angelo Cangelosi's Lab-Cognitive Robotics Lab (COROLAB) of the University of Manchester on project UKRI TAS Node in Trust (funding). 

As a Co-Investigator,  I also work on UKRI TAS Integrated Project - Verifiably Human-Centric Robot Assisted Dressing


I received my Ph.D. degree at ASR Group (Autonomous Systems and Robotics) of U2IS, ENSTA-Paris,  IP-Paris (Institut Polytechnique de Paris) supervised by Prof. Adriana Tapus. My past works in Paris are mainly about multimodal human behavior understanding and robot behaviors synthesis with deep learning.

Focus: Human-centric Robotics with AI; Explainable Robotics with AI; Trustworthy Robotics with AI; Cognitive  Robotics; Human-Robot Interaction.


    CV     Teach            Talk     Review

    Organization        Association

Chuang Yu, Baris Serhan, Marta Romeo, Angelo Cangelosi.  "Robot Theory of Mind with Reverse Psychology." LBR on IEEE/ACM HRI 2023                                     


Lanmiao Liu, Chuang Yu, Siyang Song, Zhidong Su, Adriana Tapus.  "Human Gesture Recognition with a Flow-based Model for Human Robot Interaction." LBR on IEEE/ACM HRI 2023                                     


Chuang Yu, Heng Zhang, Zhegong Shangguan, Xiaoxuan Hei, Angelo Cangelosi, Adriana Tapus. "Speech-driven Robot Face Action Generation with Deep Generative Model for Social Robots." ICSR 2022 – 14th International Conference on Social Robotics

 PDF      Link     [Finalist Best Conference Paper]

Hongbo Zhu, Chuang Yu, Angelo Cangelosi. "Affective Human-Robot Interaction with Multimodal Explanations." ICSR 2022 – 14th International Conference on Social Robotics

 PDF   Link   [Finalist Best Student Paper]

Heng Zhang, Chuang Yu, Adriana Tapus. "Towards a Framework for Social Robot Co-speech Gesture Generation with Semantic Expression." ICSR 2022 – 14th International Conference on Social Robotics

Zhegong Shangguan, Chuang Yu, Wenjie Huang, Zexuan Sun, Adriana Tapus. "What do I look like? A Conditional GAN Based Robot Facial Self-Awareness Approach." ICSR 2022 – 14th International Conference on Social Robotics

Chuang Yu, Helen Hastie, Angelo Cangelosi. "Human-aware Robot Social Behaviour Dynamic for Trustworthy Human-Robot Interaction." Social and Cognitive Interactions for Assistive Robotics (SCIAR) workshop on  IEEE/RSJ IROS 2022

 PDF    Presentation Video              Cite

Heng Zhang, Chuang Yu, Adriana Tapus. "Why do you think this joke told by robot is funny? The humor style matters." IEEE RO-MAN 2022 (31st IEEE International Conference on Robot & Human Interactive Communication)

 PDF         IEEE Xplore

Zhegong Shangguan, Chuang Yu, Adriana Tapus. "What do I look like? Dataset for Social Robot Facial Expression Self-Awareness." Robot Curiosity in Human-Robot Interaction (RCHRI) workshop on  IEEE/ACM HRI 2022

 PDF     Video

Hongbo Zhu, Chuang Yu, Angelo Cangelosi. "Explainable Emotion Recognition for Trustworthy Human-Robot Interaction." Context-Awareness in Human-Robot Interaction Approaches and Challenges workshop on  IEEE/ACM HRI 2022



Chuang Yu, Changzeng Fu, Rui Chen, Adriana Tapus.  "First Attempt of Gender-free Speech Style Transfer for Genderless Robot."  LBR on IEEE/ACM HRI 2022                                     

 [Best LBR Award]

ACM            PDF

Chuang Yu, Adriana Tapus. "One-2-many Robot Talking Gesture Synthesis with Generative Model and Evaluation. "  [on the way]

Chuang Yu, Adriana Tapus. "Long-life Emotion Recognition for Social Robot with Human in the Loop. "  [Under review Journal]

Chuande Liu, Bingtuan Gao, Chuang Yu and Adriana Tapus. ”Self-protective motion planning for mobilemanipulators in a dynamic door-closing workspace. " Industrial robot: an international journal . 2021  

Chuande Liu, Chuang Yu, Bingtuan Gao, Syed Awais Ali Shah, Adriana Tapus. "Towards a balancing safety against performance approach in human-robot co-manipulation for door-closing emergencies."  Complex & Intelligent Systems. 2021 

Chuang Yu, Adriana Tapus. "SRG3: Speech-Driven Robot Gesture Generation with GAN."  [Oral] ICARCV 2020. 2020 16th International Conference on Control, Automation, Robotics and Vision (ICARCV), China, 2020

Paper     Demo video

Chuang Yu,  Adriana Tapus. "Multimodal Emotion Recognition with Thermal and RGB-D Cameras for Human-Robot Interaction."  HRI 2020 LBR. Companion of the 2020 ACM/IEEE International Conference on Human-Robot Interaction. 

Paper                   Video

Chuang Yu, Adriana Tapus. "Interactive Robot Learning for Multimodal Emotion Recognition."  ICSR 2019 Springer International Conference on Social Robotics. 


Chuang Yu. "Emotion Detection from Gait and Thermal Face for Social Robot." Best Poster Prize in " Journée de l'ED INTERFACES 2019". 


Chuang Yu,  Adriana Tapus. "Human Emotion Detection based on Gait Data and Facial Thermal Images." Oral in "PFIA-2018 Robotics & AI "

Paper        Page  

Mei Shuai, Chuang Yu, Mingyue Song. "A kind of vision-based gait assessment method in the exoskeleton robot system." CN108022248A, 2018-05-11. [Patent]


Mei Shuai, Mingyue Song, Chuang Yu. "A kind of intelligent sensing footwear gait analysis system based on plantar pressure." CN108013878A, 2018-05-11.  [Patent]