Skip to main navigation Skip to search Skip to main content

GPT-Driven Gestures: Leveraging Large Language Models to Generate Expressive Robot Motion for Enhanced Human-Robot Interaction

  • Liam Roy
  • , Elizabeth A. Croft
  • , Alex Ramirez
  • , Dana Kulic

Research output: Contribution to journalArticleResearchpeer-review

Abstract

Expressive robot motion is a form of nonverbal communication that enables robots to convey their internal states, fostering effective human-robot interaction. A key step in designing expressive robot motions is developing a mapping from the desired states the robot will express to the robot's hardware and available degrees of freedom (design space). This letter introduces a novel framework to autonomously generate this mapping by leveraging a large language model (LLM) to select motion parameters and their values for target robot states. We evaluate expressive robot body language displayed on a Unitree Go1 quadruped as generated by a Generative Pre-trained Transformer (GPT) provided with a set of adjustable motion parameters. Through a two-part study (N = 120), we compared LLM-generated expressive motions with both randomly selected and human-selected expressions. Our results show that participants viewing LLM-generated expressions achieve a significantly higher state classification accuracy over random baselines and perform comparably with human-generated expressions. Additionally, in our post-hoc analysis we find that the Earth Movers Distance provides a useful metric for identifying similar expressions in the design space that lead to classification confusion.

Original languageEnglish
Pages (from-to)4172-4179
Number of pages8
JournalIEEE Robotics and Automation Letters
Volume10
Issue number5
DOIs
Publication statusPublished - May 2025

Keywords

  • gesture, posture and facial expressions
  • Human-robot collaboration
  • multi-modal perception for HRI
  • natural machine motion
  • social HRI

Cite this