Skip to main content Accessibility help
×
×
Home

Analysis and generation of laughter motions, and evaluation in an android robot

  • Carlos Toshinori Ishi (a1), Takashi Minato (a1) and Hiroshi Ishiguro (a1)
Abstract

Laughter commonly occurs in daily interactions, and is not only simply related to funny situations, but also to expressing some type of attitudes, having important social functions in communication. The background of the present work is to generate natural motions in a humanoid robot, so that miscommunication might be caused if there is mismatching between audio and visual modalities, especially in laughter events. In the present work, we used a multimodal dialogue database, and analyzed facial, head, and body motion during laughing speech. Based on the analysis results of human behaviors during laughing speech, we proposed a motion generation method given the speech signal and the laughing speech intervals. Subjective experiments were conducted using our android robot by generating five different motion types, considering several modalities. Evaluation results showed the effectiveness of controlling different parts of the face, head, and upper body (eyelid narrowing, lip corner/cheek raising, eye blinking, head motion, and upper body motion control).

  • View HTML
    • Send article to Kindle

      To send this article to your Kindle, first ensure no-reply@cambridge.org is added to your Approved Personal Document E-mail List under your Personal Document Settings on the Manage Your Content and Devices page of your Amazon account. Then enter the ‘name’ part of your Kindle email address below. Find out more about sending to your Kindle. Find out more about sending to your Kindle.

      Note you can select to send to either the @free.kindle.com or @kindle.com variations. ‘@free.kindle.com’ emails are free but can only be sent to your device when it is connected to wi-fi. ‘@kindle.com’ emails can be delivered even when you are not connected to wi-fi, but note that service fees apply.

      Find out more about the Kindle Personal Document Service.

      Analysis and generation of laughter motions, and evaluation in an android robot
      Available formats
      ×
      Send article to Dropbox

      To send this article to your Dropbox account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Dropbox.

      Analysis and generation of laughter motions, and evaluation in an android robot
      Available formats
      ×
      Send article to Google Drive

      To send this article to your Google Drive account, please select one or more formats and confirm that you agree to abide by our usage policies. If this is the first time you use this feature, you will be asked to authorise Cambridge Core to connect with your <service> account. Find out more about sending content to Google Drive.

      Analysis and generation of laughter motions, and evaluation in an android robot
      Available formats
      ×
Copyright
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Corresponding author
Corresponding author: C. T. Ishi Email: carlos@atr.jp
References
Hide All
1Devillers, L.; Vidrascu, L.: Positive and negative emotional states behind the laughs in spontaneous spoken dialogs, in Proc. of Interdisciplinary Workshop on The Phonetics of Laughter, 2007, 3740.
2Campbell, N.: Whom we laugh with affects how we laugh, in Proc. of Interdisciplinary Workshop on The Phonetics of Laughter, 2007, 6165.
3Bennett, M.P.; Lengacher, C.: Humor and laughter may influence health: III. Laughter and health outcomes. Evidence-Based Complementary Altern. Med., 5 (1) (2008), 3740.
4Esposito, A.; Jain, L.C.: Modeling emotions in robotic socially believable behaving systems, in Esposito, A. and Jain, L.C. (eds.), Toward Robotic Socially Believable Behaving Systems - Volume I, Ch. 2, Springer, Cham, 914, 2016.
5Mehu, M.: Smiling and laughter in naturally occurring dyadic interactions: relationship to conversation, body contacts, and displacement activities. Hum. Ethol. Bull., 26 (1) (2011), 1028.
6Dupont, S. et al. . Laughter research: a review of the ILHAIRE project, in Esposito, A. and Jain, L.C. (eds.), Toward Robotic Socially Believable Behaving Systems – Volume I. Ch. 9, Springer, Cham, 147181, 2016.
7Ishi, C.; Liu, C.; Ishiguro, H.; Hagita, N.: Evaluation of formant-based lip motion generation in tele-operated humanoid robots, in Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS 2012), October, 2012, 23772382.
8Ishi, C.T.; Liu, C.; Ishiguro, H.; Hagita, N.: Head motion during dialogue speech and nod timing control in humanoid robots, in Proc. of 5th ACM/IEEE Int. Conf. on Human-Robot Interaction (HRI 2010), 2010, pp. 293300.
9Liu, C.; Ishi, C.; Ishiguro, H.; Hagita, N.: Generation of nodding, head tilting and gazing for human-robot speech interaction. Int. J. Humanoid Robotics (IJHR), 10 (1), (2013).
10Kurima, S.; Ishi, C.; Minato, T.; Ishiguro, H.: Online speech-driven head motion generating system and evaluation on a tele-operated robot, in Proc. IEEE Int. Symp. on Robot and Human Interactive Communication (ROMAN 2015), 2015, 529534.
11Ishi, C.; Hatano, H.; Ishiguro, H.: Audiovisual analysis of relations between laughter types and laughter motions, in Proc. Speech Prosody 2016, 2016, 806810.
12Ishi, C.; Funayama, T.; Minato, T.; Ishiguro, H.: Motion generation in android robots during laughing speech, Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS 2016), Oct., 2016, 33273332.
13Niewiadomski, R.; Pelachaud, C.: Towards multimodal expression of laughter, in Proc. of Int. Conf. on Intelligent Virtual Agents (IVA 2012), 2012, 231244.
14Niewiadomski, R. et al. . Laugh-aware virtual agent and its impact on user amusement, in Proc. of Int. Conf. on Autonomous Agents and Multiagent Systems (AAMAS2013), 2013, 619626.
15Ding, Y.; Prepin, K.; Huang, J.; Pelachaud, C.; Artieres, T.: Laughter animation synthesis, in Proc. of Autonomous Agents and Multiagent Systems (AAMAS2014), 2014, 773780.
16Niewiadomski, R.; Mancini, M.; Ding, Y.; Pelachaud, C.; Volpe, G.: Rhythmic Body Movements of Laughter, in Proc. of 16th Int. Conf. on Multimodal Interaction, 2014, 299306.
17Breazeal, C.: Emotion and sociable humanoid robots. Int. J. Hum. Comput. Stud., 59, 119155 (2003).
18Zecca, M.; Endo, N.; Momoki, S.; Itoh, K.; Takanishi, A.: Design of the humanoid robot KOBIAN - preliminary analysis of facial and whole body emotion expression capabilities-, Proc. of the 8th IEEE-RAS Int. Conf. on Humanoid Robots (Humanoids 2008), 2008, 487492.
19Dobs, K.; Bulthoff, I.; Schultz, J.: Use and usefulness of dynamic face stimuli for face perception studies – a review of behavioral findings and methodology. Front. Psychol., 9 (1355) (2018), 17.
20Ochs, M.; Niewiadomski, R.; Brunet, P.; Pelachaud, C.: Smiling virtual agent in social context. Cogn. Process, 13 (2) (2012), 519532.
21Ekman, P.; Davidson, R.J.; Friesen, W.V.: The Duchenne smile: emotional expression and brain physiology II. J. Pers. Soc. Psychol., 58 (2) (1990), 342353.
22Yehia, HC; Kuratate, T; Vatikiotis-Bateson E. Linking facial animation, head motion and speech acoustics. J. Phonetics. 30, (2002) 555568.
Recommend this journal

Email your librarian or administrator to recommend adding this journal to your organisation's collection.

APSIPA Transactions on Signal and Information Processing
  • ISSN: 2048-7703
  • EISSN: 2048-7703
  • URL: /core/journals/apsipa-transactions-on-signal-and-information-processing
Please enter your name
Please enter a valid email address
Who would you like to send this to? *
×

Keywords

Metrics

Full text views

Total number of HTML views: 0
Total number of PDF views: 0 *
Loading metrics...

Abstract views

Total abstract views: 0 *
Loading metrics...

* Views captured on Cambridge Core between <date>. This data will be updated every 24 hours.

Usage data cannot currently be displayed