Topic Visualization System for Unfamiliar Couples in Face-to-Face Conversations

  • Yoko Nishihara Ritsumeikan University
  • Kodai Yoshimatsu Ritsumeikan University
  • Ryosuke Yamanishi Ritsumeikan University
  • Satoshi Miyake Ritsumeikan University
Keywords: Face-to-face conversation, Unfamiliar couples, Topic visualization, Silent time


This paper proposes a topic visualization system for unfamiliar couples in face-to-face conversations. Some of people are weak at making face-to-face conversations with people for the first time. It is so hard to find good topics for conversations. If any topic can not be found, a non-speech section will come to a conversation and will make them be more awkward. The proposed system visualizes topics to users. As inputting the user’s profile data into the system, conversation topics are visualized by referring the input. The proposed system recognizes their speeches in conversations, and detects non-speech sections in their conversation. If a non-speech section is detected, the system switches topics to new ones and presents the new topics to the users. They can continue their conversations if nonspeech sections come more than one time. We experimented the efficiency of the proposed system in decreasing non-speech time in conversations.

References (accessed on 16th March 2017)

Penelope Brown and Stephen C. Levinson, Politeness: Some universals in language usage, New York: Cambridge University Press, 1987.

Dagoberto Cruz-Sandoval, Friederike Eyssel, Jesus Favela, and Eduardo B. Sandoval, Towards a Conversational Corpus for Human-Robot Conversations, Towards a Conversational Corpus for Human-Robot Conversations, pp.99–107, 2017.

John Augustine Daly and James C. McCroskey, Avoiding communication: shyness, reticence, and communication apprehension, Sage Publications, 1984. (accessed on 16th March 2017)

William T. O’Donohue, Handbook of Psychological Skills Training: Clinical Techniques and Applications, Allyn and Bacon, 1995.

Jackie Gnepp and Debra L. Hess, Children’s understanding of verbal and facial display rules, Developmental Psychology, Vol. 22, pp.103–108, 1986.

Daniel Goleman, Emotional Intelligence, New York: Bantam Books, 1995.

Miho Hatanaka, Decision-making processes underlying conversational inhibition, Japanese Journal of Social Psychology, Vol.21, No.3, pp.187–200, 2006. (in Japanese)

Emiko Isogai and Takamasa Suzuki, DENSO Technical Communication Education, Journal of JSEE, Vol.54, No.5, pp.80–83, 2006. (accessed on 16th March 2017)

Tomas Mikolov, Kai Chen, Greg Corrado, Jeffrey Dean, Efficient Estimation of Word Representations in Vector Space, arXiv:1301.3781, 2013.

Norman Alm, Richard Dye, Gary Gowans, Jim Campbell, Arlene Astell, Maggie Ellis, A Communication Support System for Older People with Dementia, Computer, Vol. 40, Issue 5, 2007.

Masahiro Shiomi, Daisuke Sakamoto, Takayuki Kanda, Carlos Toshinori Ishi, Hiroshi Ishiguro, and Norihiro Hagita, A semi-autonomous communication robot - A field trial at a train station, 3rd International Conference on Human-Robot Interaction, 2008.

Wataru Sunayama, Yuki Shibata, and Yoko Nishihara, Topic Recommendation Method related to a Present Topic for Continuing a Conversation, Information Engineering Express, Vol. 3, No. 1, 2017.

Tian Xu, Hui Zhang, and Chen Yu, See You See Me: The Role of Eye Contact in Multimodal Human-Robot Interaction, ACM Transactions on. Interactive Intelligent Systems, Vol.6, No.1, pp.2:1–2:22, 2016.

Ryosuke Yamanishi, Satoshi Miyake, Yoko Nishihara, Junichi Fukumoto, Visualization of Profile Affinity with Thesaurus and Web Contents for Communication Support, CHI 2016 Symposium on Emerging Japanese HCI Research Collection, 2016.

Ye Kyaw Thu, Takuya Ishida, Naoto Iwahashi, Tomoaki Nakamura, and Takayuki Nagai, Symbol Grounding from Natural Conversation for Human-Robot Communication, Proceedings of the 5th International Conference on Human Agent Interaction, pp. 415–419, 2017.

Technical Papers