Synthesis of Choreography for Service robots by poses extracted from a Ningyo Joruri’s Acting script using the Associative model

  • Masahiko Narita Advanced Institute of Industrial Technology
Keywords: Service Robot, Choreography, Joruri Puppets, Acting script, Associative model


What we should do with service robots to attract people’s attention and communicate more smoothly? We are proceeding with the robot OSONO project, which is referring to Ningyo Joruri puppets, with the theme of utilizing expressions that incorporate the "Performing arts and technology" that has been passed down through the ages. In this paper, we propose the associative model that clarifies the correspondence between Ningyo Joruri’s acting script of the performance, which does not include any choreographic information, and the actual choreography in the performance by the meaning. This is the key to systematize the choreography from Ningyo Joruri acting scripts. And by using these, we verify that the natural choreography of the service robot was created and synthesized. This method can provide highly diverse and flexible choreography than choreography based on "emotion", which is widely used currently.


Bunraku, ”Yoshitune Senbon Zakura”,,2013, [online]

Y. Chikaisi, “Joruri Neisau-shu”, Kodansha,1950.

S. Hayano, “Hachioji Kuruma Ningyo Nishikawa Kotanagiza”, Tachikawa Gengo BunkaKenkyukai, 2019.

M. Hayashi, “How to use puppets in Sagami Ningyo Shibai shimonaka-za” (Demonstrationrecords and handouts), Network-based Robot Service Research Committee, The Robotics So-ciety of Japan, 2019.

S. Nakagawa, “Finding the motion planning method which communicates the robot's emotionto human”, Journal of Osaka University, Art 36, pp. 139-146, 2013.

M. Narita, “An Essay on the Physical Properties of Signage Robots”, Bulletin of AdvancedInstitute of Industrial Technology, No.11, pp. 91-96,2017.

M. Narita, S. Nakagawa,” Physical Properties and choreography of Service Robot with refer-ence to Joruri Puppets”, Bulletin of Advanced Institute of Industrial Technology, No. 13, pp.61-66, 2019.

M. Narita, S. Nakagawa, “Physical properties of service robots which is referring to Joruripuppets”, YOGYA-KARTA: IEEE/IIAI AIT, pp. 158-162, 2019

M. Narita, S. Nakagawa, “An Implementation and a collection/systematization of the chore-ography for service robots -Knowledge obtained with reference to Joruri Puppet-“, Bulletinof Advanced Institute of Industrial Technology, Vol. 14, pp. 19-26, 2020.

M. Narita, S. Nakagawa, “Development of OSONO, a service robot with reference to Joruripuppet, and its Choreography”. IJSKM International Journal of Service and Knowledge Man-agement, Vol. 4, No. 2, pp. 54 -70, 2020.

M. Narita, S. Nakagawa, T. Izui, N. Matsuhira, “Evaluations of service robots referring toJoruri puppets, and a remote evaluations system”, IEEE/IIAI AIT 2021, pp. 47 -52, 2021.

M. Narita, “Extraction of choreography for service robots from an Ningyo Joruri Acting’sscript by associative model”, IIAI AIT 2021 winter, 2021

M. Narita, S. Nakagawa, “Systematizing the choreography of Ningyo Joruri by an Associa-tion Model from the perspective of a Service Robot”, Journal of the Robotics Society of Japan,Vol .40, pp. 263-266, 2022

Nina TAJIMA, Koichiro KATO, Eriko OKADA, Nobuto MATSUHIRA, Kanako AMANO,and Yuka KATO, “Walking Trajectory Measurement System for a Receptionist Robot”, IEEE International Conference on Mechatronics and Automation, pp.920-925, 2021.

S. Ohnishi, “Arts of Bunraku puppets”, Engeki Shuppansha, 1968.

S. Ohyatsu, “Ningyo Joruri's From and Choreography - From the case of Sagami puppet show-“, Network-based Robot Service Research Committee, The Robotics Society of Japan, 2021.

H. Tsurusawa, “Yukahon shu”,, 2017, [online].

S. Yamakawa, M.Yoshida, “Bunraku no Onna”, Tanko-sha, 2016

Y. Kato, T. Ikeda, S. Okano, N. Matsuhira,” A Method Predicting the Destination of a Pe-destrian for Voice Guidance of Communication Robots”, Journal of Information Processing-Society, Vol. 60, No. 2, pp. 572 -580, 2019.

A. Takeda, R. Koizumi, M. Arimichi, A. Sato, S. Ohyatsu, “The World of Sagami Ningyo Shibai”, Showa Women's University Koyo Museum, (2016).

Technical Papers