Welcome...

dr. K.P. Truong (Khiet)

Associate Professor

About Me

How people talk and understand each other has always fascinated me. The big question for me is how to develop technology that understands spoken language: how can we make automatic speech recognition more intelligent?. Besides what is said, there is also a lot of information in how something is said: aspects of physical, emotional, and mental states resonate in the voice, both consciously and unconsciously. I am particularly interested in the automatic interpretation of this implicit information, with the aim of, for example, enabling conversational agents (such as Siri) to respond more appropriately to children or older adults, or to develop apps that offer remote support to people suffering from depression.

After studying Linguistics (specialisation Language and Speech Technology) in Utrecht, I ended up at TNO where I investigated automatic emotion recognition in speech. Then I went to the University of Twente, Human Media Interaction where I am still working on the automatic analysis of nonverbal aspects in speech communication (e.g. laughing, backchanneling) in human-human, and human-machine interaction. Besides doing research I also teach speech processing, affective computing, and interaction technology.

Expertise

Engineering & Materials Science
Audiovisual
Robots
Speech Recognition
Medicine & Life Sciences
Laughter
Social Sciences
Acoustics
Dementia
Humor
Reminiscence

Research

My research mainly focuses on automatically analyzing and interpreting nonverbal aspects in speech communication that say something about how the conversation is going, and what someone's physical, socio-emotional, and mental state is. My goal is to make automatic speech recognition more intelligent. Among other things, I have worked on automatic detection of laughter, automatic emotion recognition in speech, and automatic generation of backchannels for artificial agents. Currently, I am supervising a number of PhD students who are researching multimodal emotion expression in older adults, and responsible design for child-robot interaction. I am also supervising master students in their research on technology for vulnerable people (e.g. people with dementia, people with multiple disabilities), and human-robot interaction.

You can also read more about my research here https://www.utwente.nl/en/research/researchers/featured-scientists/truong/index/ and on my personal website http://khiettruong.space/ 

Publications

Recent
Pompe, B. L. , Velner, E. , & Truong, K. P. (2022). The Robot That Showed Remorse: Repairing Trust with a Genuine Apology. In Proceedings of the 31st IEEE International Conference on Robot and Human Interactive Communication (RO-MAN): Social, Asocial, and Antisocial Robots (pp. 260-265). IEEE. https://doi.org/10.1109/RO-MAN53752.2022.9900860
Martikainen, K., Karlgren, J. , & Truong, K. P. (2022). Exploring audio-based stylistic variation in podcasts. 2343-2347. Paper presented at INTERSPEECH 2022, Incheon, Korea, Republic of. https://doi.org/10.21437/Interspeech.2022-10871
Beelen, T. , Velner, E. , Ordelman, R. , Truong, K. P. , Evers, V. , & Huibers, T. (2021). Let’s talk about it: Spoken conversational search with a robot for children. In CUI@CSCW: Inclusive and Collaborative Child-facing Voice Technologies: A workshop at the virtual ACM CSCW 2021 conference ACM Publishing.
Jansen, M-P. , Truong, K. P. , & Heylen, D. K. J. (2021). How Familiarity Influences the Frequency, Temporal Dynamics and Acoustics of Laughter. In 2021 9th International Conference on Affective Computing and Intelligent Interaction (ACII) (pp. 1-8) https://doi.org/10.1109/ACII52823.2021.9597414
De Boer, J. N., Voppel, A. E., Brederoo, S. G., Schnack, H. G. , Truong, K. P., Wijnen, F. N. K., & Sommer, I. E. C. (2021). Acoustic speech markers for schizophrenia-spectrum disorders: A diagnostic and symptom-recognition tool. Psychological medicine, 1-11. https://doi.org/10.1017/S0033291721002804
Neidlinger, K. L., Koenderink, S. , & Truong, K. P. (2021). Give the Body a Voice: Co-design with Profound Intellectual and Multiple Disabilities to Create Multisensory Wearables. In Y. Kitamura, A. Quigley, K. Isbister, & T. Igarashi (Eds.), CHI EA '21: Extended Abstracts of the 2021 CHI Conference on Human Factors in Computing Systems (pp. 1). [375] ACM SigCHI. https://doi.org/10.1145/3411763.3451797
Hover, Q. R. M. , Velner, E. , Beelen, T. , Boon, M. , & Truong, K. P. (2021). Uncanny, sexy, and threatening robots: The online community's attitude to and perceptions of robots varying in humanlikeness and gender. In HRI 2021 - Proceedings of the 2021 ACM/IEEE International Conference on Human-Robot Interaction (pp. 119-128). [3444661] (ACM/IEEE International Conference on Human-Robot Interaction). IEEE Computer Society Press. https://doi.org/10.1145/3434073.3444661
Catala, A. , Nazareth, D. S., Félix, P. , Truong, K. P. , & Westerhof, G. J. (2020). Emobook: A Multimedia Life Story Book App for Reminiscence Intervention. In MobileHCI '20: 22nd International Conference on Human-Computer Interaction with Mobile Devices and Services Association for Computing Machinery (ACM). https://doi.org/10.1145/3406324.3410717

UT Research Information System

Google Scholar Link

Affiliated Study Programmes

Master

Courses Academic Year  2022/2023

Courses in the current academic year are added at the moment they are finalised in the Osiris system. Therefore it is possible that the list is not yet complete for the whole academic year.
 

Courses Academic Year  2021/2022

Contact Details

Visiting Address

University of Twente
Faculty of Electrical Engineering, Mathematics and Computer Science
Citadel (building no. 09), room H235
Hallenweg 15
7522NH  Enschede
The Netherlands

Navigate to location

Mailing Address

University of Twente
Faculty of Electrical Engineering, Mathematics and Computer Science
Citadel  H235
P.O. Box 217
7500 AE Enschede
The Netherlands

Social Media