Updated on 2026/03/27

写真a

 
KUBOTA Tomonori
 
Organization
Graduate School of Engineering Information and Communication Engineering 2 Assistant Professor
Graduate School
Graduate School of Engineering
Undergraduate School
School of Engineering Electrical Engineering, Electronics, and Information Engineering
Title
Assistant Professor
External link

Degree 3

  1. Doctor of Philosophy in Engineering ( 2022.3   Osaka University ) 

  2. Master of Engineering ( 2019.3   Osaka University ) 

  3. Bachelor of Engineering ( 2017.3   Osaka University ) 

Research Interests 6

  1. Human-Robot Interaction

  2. Human-Agent Interaction

  3. Social Robot

  4. Operated Robot

  5. Semi-autonomous Robot

  6. Human-Computer Interaction

Research Areas 3

  1. Informatics / Intelligent informatics

  2. Informatics / Intelligent robotics

  3. Informatics / Human interfaces and interactions

Research History 6

  1. Nagoya University   Department of Information and Communication Engineering, Graduate School of Engineering   Assistant Professor

    2023.10

      More details

    Country:Japan

    researchmap

  2. Osaka University   Division of Systems Science and Applied Informatics, Department of Systems Innovation, Graduate School of Engineering Science   Visiting Faculty

    2022.4

      More details

    Country:Japan

    researchmap

  3. Nagoya University   Department of Information and Communication Engineering, Graduate School of Engineering   Designated Assistant Professor

    2022.4 - 2023.9

      More details

    Country:Japan

    researchmap

  4. Kyoto Women's University   Part-time Lecturer

    2020.10

      More details

    Country:Japan

    researchmap

  5. Japan Society for Promotion of Science   Research Fellow (DC2)

    2020.4 - 2022.3

      More details

    Country:Japan

    researchmap

  6. Osaka University   Graduate School of Engineering Science   Specially Appointed Researcher S

    2017.7 - 2020.3

      More details

    Country:Japan

    researchmap

▼display all

Committee Memberships 1

  1. ACM Transactions on Human-Robot Interaction   Associate Editor  

    2026.1   

      More details

    Committee type:Academic society

    researchmap

Awards 7

  1. IVRy賞

    2026.3   言語処理学会第32回年次大会   複数人同時対話における引継ぎのための抽象型の対話形式の対話要約の実証

    山下 紗苗, 望月 翔太, 星牟禮 健也, 馬場 淳, 窪田 智徳, 小川 浩平, 東中 竜一郎

     More details

    Award type:Award from Japanese society, conference, symposium, etc.  Country:Japan

    researchmap

  2. 若手卓越研究賞

    2025.12   The Human Interface Society   Investigation on influence of speech bubbles augmented to speakers in videos on listeners’ attitude interpretation

    Tomonori Kubota, Masaya Ishii, Yuki Iriyama

     More details

    Award type:Honored in official journal of a scientific society, scientific journal  Country:Japan

    researchmap

  3. 特選セッション発表認定、️対話発表賞、レコメンデモ認定(デモ・ポスター発表に関する専門委員推薦賞)、アサヒグループジャパン賞、CRI・ミドルウェア賞

    2025.8   Entertainment Computing 2025   漫才カラオケ:未経験者でも漫才を演じることを可能にする漫才実演支援システム

    Shunta Komatsu, Tomonori Kubota, Satoshi Sato, Kohei Ogawa

     More details

    Award type:Award from Japanese society, conference, symposium, etc.  Country:Japan

    researchmap

  4. Best Poster Nominee

    2024.11   The 12th International Conference on Human-Agent Interaction (HAI 2024)   Operator Enjoyment in Teleoperation of Customer Service Robots: Interface Design Guidelines from a Field Study

    Manato Uetake, Masaya Iwasaki, Tomonori Kubota, Jun Baba, Satoshi Sato, Kohei Ogawa

     More details

    Award type:Award from international society, conference, symposium, etc.  Country:United Kingdom

    researchmap

  5. 一般セッション優秀賞

    2024.9   Entertainment Computing 2024   大規模We-modeを生起させる視聴者参加型ゲームのデザイン

    Atsushi Kobayashi, Tomonori Kubota, Satoshi Sato, Kohei Ogawa

     More details

    Award type:Award from Japanese society, conference, symposium, etc.  Country:Japan

    researchmap

  6. Student Encouragement Award

    2024.3   Human-Agent Interaction Symposium 2024   Semi-autonomous touching method toward realization of touch therapy robot

    Ryoma Mitsuoka, Tomonori Kubota, Kohei Ogawa, Satoshi Sato

     More details

    Award type:Award from Japanese society, conference, symposium, etc.  Country:Japan

    researchmap

  7. Best Paper Nominee

    2023.12   The 11th International Conference on Human-Agent Interaction (HAI 2023)   Investigating the Intervention in Parallel Conversations

    Shota Mochizuki, Sanae Yamashita, Kazuyoshi Kawasaki, Reiko Yuasa, Tomonori Kubota, Kohei Ogawa, Jun Baba, Ryuichiro Higashinaka

     More details

    Award type:Award from international society, conference, symposium, etc. 

    researchmap

▼display all

 

Papers 19

  1. Parent-Child Dialogue Support Through Semi-autonomous Para-operated Robot in Home Learning Reviewed International journal

    Eiki Go, Tomonori Kubota, Masaya Iwasaki, Satoshi Sato, Kohei Ogawa

    Proceedings of the 21st International Conference on Persuasive Technology 2026 (Lecture Notes in Computer Science)   Vol. 16476   page: 66 - 80   2026.3

     More details

    Authorship:Lead author   Language:English   Publishing type:Research paper (international conference proceedings)   Publisher:Springer Nature Switzerland  

    The efficacy of educational robots in children’s school education and home learning has been established. There has been a growing demand for robots that effectively support parent-child learning at home, but the design of robots that can assist without disrupting their dialogue has remained unclear. This study proposes a novel form of robot for supporting home learning while promoting parent-child dialogue: a semi-autonomous para-operated robot, which is partially controlled by the parent from the side. We hypothesized that this approach, unlike autonomous robots which may reduce parental burden but lead to parental disengagement, would increase parental involvement through active operation. To validate this hypothesis, we conducted an experiment with parent-child pairs comparing three conditions: (1) no robot, (2) autonomous robot, and (3) the proposed semi-autonomous robot. The results revealed that the proposed robot significantly increased parental utterances without increasing parental burden compared to the other conditions, supporting our hypothesis. This study contributes by demonstrating the effectiveness of semi-autonomous para-operated robots in facilitating parent-child home learning.

    DOI: 10.1007/978-3-032-19687-3_6

    researchmap

  2. Investigation on influence of speech bubbles augmented to speakers in videos on listeners’ attitude interpretation Reviewed Open Access

    Tomonori Kubota, Masaya Ishii, Yuki Iriyama, Satoshi Sato, Kohei Ogawa

    The Transactions of Human Interface Society   Vol. 27 ( 4 ) page: 271 - 280   2025.11

     More details

    Authorship:Lead author, Corresponding author   Language:Japanese   Publishing type:Research paper (scientific journal)   Publisher:Human Interface Society  

    Online conversations through platforms like Zoom or AR-enabled dialogues with smart glasses offer the unique advantage of overlaying relevant information on screens. Recent research has introduced systems that augment speakers with speech bubbles containing either identical or alternative text to their verbal statements, aiming to enhance dialogue. However, these systems present an interpretive challenge: when spoken content and text in speech bubble convey different attitudes, it remains unclear which source listeners prioritize to form impressions of speakers. This study investigates how speech bubble augmentation influences listeners’ interpretation of speaker attitudes. We categorized these influences into three types: clarification, amplification/attenuation, and transformation of attitudes. Through three online experiments designed to examine each category, we confirmed all three types of influence. Notably, listeners demonstrated a tendency to prioritize speech bubble content over verbal statements when interpreting speaker attitudes. Our findings provide fundamental insights into the effects of speech bubble augmentation on human communication in digital interaction environments while acknowledging limitations in experimental scope and demographics that necessitate further research across diverse contexts.

    DOI: 10.11184/his.27.4_271

    Open Access

    researchmap

  3. Anomaly Detection in Human-Robot Interaction Using Multimodal Models Constructed from In-the-Wild Interactions Reviewed International journal

    Shota Mochizuki, Sanae Yamashita, Kenya Hoshimure, Jun Baba, Tomonori Kubota, Kohei Ogawa, Ryuichiro Higashinaka

    2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)     page: 880 - 886   2025.10

     More details

    Language:English   Publishing type:Research paper (international conference proceedings)   Publisher:IEEE  

    In recent years, numerous studies have been conducted on dialogue robots powered by large language models,enabling sophisticated interactions such as providing guidance and engaging in small talk. However, the interaction performance remains imperfect, and the robots sometimes cause problems during interactions. In this study, we aim to automatically detect such anomalies in human-robot interactions by creating a dataset and developing anomaly detection models. To this end, we created a dataset by manually annotating videos of in-the-wild interactions collected from our field experiment designed to test a framework of parallel conversations in which a human intervenes when a problem occurs in the interaction. Using this dataset, we trained classification models to construct anomaly detection models. We then conducted another field experiment in which the model’s detection results were presented as alerts to operators within the parallel conversation framework. The results confirmed that providing alerts on the basis of the anomaly detection model was useful for facilitating operator intervention.

    DOI: 10.1109/iros60139.2025.11246844

    researchmap

  4. How to Elicit Enjoyment in Teleoperation of Customer Service Robots?: Initial Investigation of a Gamified Interface and Proposal of Design Guidelines Reviewed Open Access

    Manato Uetake, Masaya Iwasaki, Tomonori Kubota, Jun Baba, Satoshi Sato, Kohei Ogawa

    IPSJ Transactions: Digital Practices   Vol. 6 ( 4 ) page: 1 - 12   2025.10

     More details

    Language:Japanese   Publishing type:Research paper (scientific journal)   Publisher:Information Processing Society of Japan  

    With the progression of labor shortages and an aging society, the implementation of customer service robots is advancing, with particular attention being paid to teleoperated robots. However, previous studies have indicated that operators experience monotony after continuous operation for a certain period due to a lack of enjoyment, ultimately leading to decreased motivation to continue customer service tasks. Therefore, the first objective of this research was to develop an interface that elicits operator enjoyment and verify its effectiveness. Furthermore, the second objective was to compile design guidelines for interfaces that enhance operator enjoyment. To facilitate operator enjoyment, two types of interfaces were developed, focusing on degrees of freedom and gamification elements. We then conducted experiments as conversation and teleoperation experience events with robots in a shopping mall using these interfaces to verify their effectiveness. Moreover, we focused on operator laughter as an indicator of enjoyment and conducted detailed qualitative analysis. As a result, questionnaires regarding operator enjoyment showed that operators enjoyed using both interfaces, achieving the first objective. Additionally, qualitative analysis suggested that three elements - the ease of anonymity, appropriate limitations on operational freedom, and sharing experiences within the operator group - are important factors in eliciting operator enjoyment, thus achieving the second objective.

    Open Access

    researchmap

    Other Link: https://ipsj.ixsq.nii.ac.jp/records/2004541

  5. Manzai Karaoke: A Real-Time Visual Guidance System for Assisting Japanese Double Act Performance Reviewed International journal Open Access

    Shunta Komatsu, Tomonori Kubota, Satoshi Sato, Kohei Ogawa

    The 24th IFIP International Conference on Entertainment Computing (Lecture Notes in Computer Science)   Vol. 16042   page: 219 - 232   2025.8

     More details

    Authorship:Lead author   Language:English   Publishing type:Research paper (international conference proceedings)   Publisher:Springer Nature Switzerland  

    While the common way to enjoy two-person comedic dialogue, such as double act, is by watching it, performing Japanese manzai has recently gained attention for its entertainment value and effectiveness in improving dialogue skills. However, performing manzai is challenging, as it requires memorizing scripts and mastering its unique intonation, actions, and timing. In this study, we propose “Manzai Karaoke,” a real-time visual guidance system that assists two-person manzai performances. Similar to karaoke, this system provides script line displays and nonverbal performance cues, enabling inexperienced users to perform manzai. To design an interface that meets the key requirements—allowing users to perform with ease and ensuring audience amusement—we conducted a two-step prototyping and user study. The first step validated the feasibility of real-time comedy performance assistance, revealing that in addition to displaying script lines, guidance on intonation, emotion, actions, and timing is essential. The second step demonstrated that the implemented interface incorporating these elements effectively meets the requirements. This study contributes to the field of entertainment computing by demonstrating the potential of visual guidance and providing design recommendations for assisting novice manzai performances.

    DOI: 10.1007/978-3-032-02555-5_16

    Open Access

    researchmap

    Other Link: https://www.youtube.com/watch?v=KS-UzKOM-20

  6. Method for Building a Community-Oriented Agent with a Dialogue Ability Adapted to the Community Reviewed International journal

    Atsushi Kobayashi, Tomonori Kubota, Satoshi Sato, Kohei Ogawa

    IEEE Access   Vol. 13   page: 98144 - 98157   2025.6

     More details

    Authorship:Lead author, Corresponding author   Language:English   Publishing type:Research paper (scientific journal)   Publisher:Institute of Electrical and Electronics Engineers (IEEE)  

    Autonomous dialogue agents are expected to be applied in multi-party dialogue where three or more agents or people converse. In multi-party dialogue, autonomous dialogue agents that perform one-tomany dialogue with interlocutors assembled for specific purposes, such as communities, are useful, because these agents can be applied to provide information and entertainment to communities. For such applications, autonomous dialogue agents need to be acceptable and attractive to community members, but no method has been established to achieve this. Therefore, we aim to realize a ‘‘Community-Oriented Agent’’ (COA) that is acceptable and attractive to community members through dialogue.We proposed a method for building an autonomous dialogue function of COA, which consists of two essential steps: 1) Collect dialogue examples among the community members by creating a situation in which multiple members of the community converse with other members through operating the agent; 2) Build the agent’s autonomous dialogue function by utilizing the collected examples. To validate this method, we developed a ‘‘COAsystem’’ to implement the approach and conducted the experiment. In the experiment, using this system, we collected actual dialogue examples among community members, and then asked the members to evaluate the autonomous dialogue agents built using these examples. The results showed that the members evaluated an autonomous dialogue agent built using dialogue examples collected within their community as acceptable and attractive, but it was also shown that it is difficult to build such an agent if there are not enough participants in the dialogue when collecting dialogue examples.

    DOI: 10.1109/access.2025.3575708

    researchmap

  7. Blurring Self-touch Improves Sense of Body Ownership in Incongruence Between VR Avatar and Real User’s Body Part Reviewed International journal Open Access

    Kodai Hiramatsu, Tomonori Kubota, Satoshi Sato, Kohei Ogawa

    17th International Conference on Virtual, Augmented and Mixed Reality, Held as Part of the 27th HCI International Conference (Lecture Notes in Computer Science)   Vol. 15790   page: 325 - 335   2025.5

     More details

    Authorship:Lead author   Language:English   Publishing type:Research paper (international conference proceedings)   Publisher:Springer  

    As an application of Virtual Reality (VR) technology, VR programs have been proposed to simulate on-site experiences, such as practical training, in a virtual environment. To make users feel as if they are actually experiencing these activities in the virtual environment, it is important to design the program to increase the sense of body ownership and presence. However, in practical applications of such VR programs, little is known about the negative effects of using consumer-grade VR devices with limited tracking capabilities on body ownership and presence, and about methods to mitigate these effects. Limitations in tracking capabilities can cause discrepancies in the positional alignment of body parts between the user and their avatar, leading to incongruence between visual information and tactile feedback when users touch their own bodies. Developing methods to mitigate the effects of such inconsistent self-touch is essential for making VR programs accessible at the consumer level. The purpose of this study is to investigate the negative effects of incongruent self-touch on the sense of body ownership and presence and to develop a novel method to mitigate these effects by using visual effects to blur the areas where self-touch occurs. The results of the preliminary experiment suggest that VR devices with low tracking capabilities negatively effect the quality of the VR program experience, and the proposed method utilizing visual effects to mitigate this impact has shown potential effectiveness.

    DOI: 10.1007/978-3-031-93715-6_20

    Open Access

    researchmap

    Other Link: https://hdl.handle.net/2237/0002012925

  8. Investigation of the conditions for continuous information conveyance by two autonomous conversational agents Reviewed International journal

    Takamichi Isowa, Kohei Ogawa, Satoshi Sato, Tomonori Kubota, Hiroshi Ishiguro

    Frontiers in Robotics and AI   Vol. 12   page: 1417488   2025.4

     More details

    Language:English   Publishing type:Research paper (scientific journal)   Publisher:Frontiers Media SA  

    Introduction: In recent years, information conveyance through conversation using agents such as robots and avatars has gained attention. Among them, conversation by two agents has been shown to encourage effective information conveyance. Previous studies have also demonstrated that incorporating subjective information, such as emotions, into conversations enhances this effect. Therefore, a medium for information conveyance involving two autonomous agents and including subjective information is expected to be effective.

    Methods: In this study, such a medium was implemented, and the conditions necessary for it to convey information continuously were investigated. Objective information was defined as the content of existing news, and subjective information was defined as the preference toward the news. A frame structure was used for organizing objective information, and a network structure was used for subjective information. A method was developed to autonomously obtain both types of information. This knowledge was then distributed to two agents, who exchanged it and attempted to understand each other through conversation.

    Results: Experiments were conducted to determine whether the subjective information obtained autonomously by the agents was as natural and consistent as that of humans. Further experiments examined the conditions for enabling continuous information conveyance using the medium.

    Discussion: The results indicated that conveying important information first and using robots rather than text were effective strategies for maintaining continuous information conveyance.

    DOI: 10.3389/frobt.2025.1417488

    researchmap

  9. Proposal of a self-instructional training support system and examination of self-instructional text presentation interface using a speech bubble Reviewed

    Kei Hyodo, Tomonori Kubota, Satoshi Sato, Kohei Ogawa

    The Transactions of Human Interface Society   Vol. 27 ( 1 ) page: 43 - 46   2025.2

     More details

    Authorship:Lead author   Language:Japanese   Publishing type:Research paper (scientific journal)  

    In this study, we propose an overall self-instructional training support system and tested the effectiveness of a self-instructional text presentation interface using a speech bubble. While the automated generation of self-instructional texts could make the training more accessible, previous research shows that if the texts are not self-created, the effectiveness of the training decreases. To overcome this, we design an interface that displays a real-time video of the user’s face with superimposed speech bubbles containing self-instructional text. Through online experiments, we demonstrated that the interface enhances users’ internalization of the generated text, potentially improving the effectiveness of computer-assisted self-instructional training.

    DOI: 10.11184/his.27.1_43

    researchmap

  10. Voice Volume Gauge to Encourage Vocal Adaptation of an Operator of a Teleoperated Social Robot Reviewed International journal Open Access

    Keigo Matsushima, Tomonori Kubota, Haruka Murakami, Satoshi Sato, Kohei Ogawa

    Proceedings of the 12th International Conference on Human-Agent Interaction     page: 91 - 99   2024.11

     More details

    Authorship:Lead author   Language:English   Publishing type:Research paper (international conference proceedings)   Publisher:ACM  

    Teleoperated social robots have been widely studied and employed, yet their operation interfaces provide limited information to the operator, causing difficulties in grasping the dialogue situation compared to face-to-face interactions. Particularly with conventional interfaces, operators face challenges with vocal adaptation due to the inability to assess the distance between the robot and the interlocutor. Consequently, operators struggle to determine the appropriate volume level for clear communication, leading to insecurity about their vocalization’s effectiveness. In this study, we propose a novel approach to address this issue: a voice volume gauge that enables operators to adjust their voice volume by displaying the difference between their current volume and the estimated optimal volume on the interface. We implemented the gauge and conducted a subjective evaluation experiment, which demonstrated no usability concerns for operators and a reduction in their insecurity levels. Furthermore, preliminary objective evaluation results based on speech analysis suggest that utilizing the gauge may bring operators’ vocalizations closer to those in face-to-face dialogues. The contribution of this paper lies in providing a simple interface design method to aid in solving the vocal adaptation problem for teleoperated robot applications.

    DOI: 10.1145/3687272.3688313

    Open Access

    researchmap

    Other Link: https://hdl.handle.net/2237/0002011728

  11. Influence of the Behavior of a Para-Operated Social Robot on the Impression Interlocutors Have of the Operator: an Online Study Reviewed

    Tomonori KUBOTA, Kohei OGAWA

    Journal of Japan Society for Fuzzy Theory and Intelligent Informatics   Vol. 36 ( 4 ) page: 695 - 702   2024.11

     More details

    Authorship:Lead author, Corresponding author   Language:Japanese   Publishing type:Research paper (scientific journal)   Publisher:Japan Society for Fuzzy Theory and Intelligent Informatics  

    As research and applications of operated social robots continue to advance, a para-operated social robot has also been proposed, in which the robot and its operator exist in the same space, and the robot, operator, and interlocutor can interact face-to-face. Contributing to the promotion of human-human interaction by such robots, we considered that the operator could improve their interpersonal impression by making the robot say favorable utterances through operation during the dialog. This paper reports the results from the online video survey conducted to investigate the following hypothesis considering the robot-operator distance; Operator’s interpersonal impression is improved by making the robot say favorable utterances through operating. The results of the surveys conducted at different distances between the robot and the operator show that the impression of the operator was improved by the robot’s favorable humorous utterances when they are in close, but not when they are far apart. We consider that the findings contribute to the potential of dialog promotion by para-operated robots and suggest the importance of focusing on the positional relationship factor in the influence of robots on human-human relationships.

    DOI: 10.3156/jsoft.36.4_695

    researchmap

  12. Learning Anomaly Detection Models for Human-Robot Interaction Reviewed International journal

    Shota Mochizuki, Sanae Yamashita, Reiko Yuasa, Tomonori Kubota, Kohei Ogawa, Ryuichiro Higashinaka

    2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN)     page: 1720 - 1725   2024.8

     More details

    Language:English   Publishing type:Research paper (international conference proceedings)   Publisher:IEEE  

    Dialogue robots powered by large language models can generate advanced utterances. However, the interaction performance is not yet perfect, and the robots sometimes cause problems during interactions. In this study, to detect anomalies in human-robot interactions, we created a dataset and constructed anomaly detection models. For the dataset creation, we collected videos of human-robot interactions in a framework where humans intervene when a dialogue breakdown occurs and labeled the scenes where humans intervened as anomalies. Using this dataset, we built classification models and deep metric learning models utilizing encoders for video, audio, and multimodal information. The results showed that we could successfully train the models and achieve an accuracy and F1-score of over 80%. The performance of the deep metric learning models surpassed that of the classification models, thus demonstrating the importance of separating the differences between classes. We also clarified the importance of audio information.

    DOI: 10.1109/ro-man60168.2024.10731184

    researchmap

  13. Semi-autonomous touch method merging robot’s autonomous touch and user-operated touch for improving user experience in robot touch Reviewed International journal

    Ryoma Mitsuoka, Tomonori Kubota, Satoshi Sato, Kohei Ogawa

    Scientific Reports   Vol. 14   page: 17667   2024.7

     More details

    Authorship:Corresponding author   Language:English   Publishing type:Research paper (scientific journal)   Publisher:Springer Science and Business Media LLC  

    The demand for therapeutic robots to alleviate mental health problems is growing. Studies have shown that people’s mental health improves when they are touched. Consequently, therapeutic robots are designed to alleviate stress through robot’s autonomous touch. However, robot’s autonomous touch can sometimes cause discomfort to recipients. This paper proposes a semi-autonomous touch method that merges robot’s autonomous touch with user-operated touch to mitigate discomfort while maintaining the sensation of being touched by another person. We conducted an experiment involving 24 participants who were touched on the neck by robots under three conditions: robot’s autonomous touch, user-operated touch, and the proposed semi-autonomous touch method condition. Additionally, the study investigated participants’ impressions of the robot in each condition. The results showed that semi-autonomous touch condition mitigated discomfort more effectively compared with the robot’s autonomous touch method condition. It also enhanced the feeling of being touched by another person entity and suppressed interaction boredom compared with the user-operated touch method condition. Participants reported higher trustworthiness and perceived friendliness in robots utilizing the semi-autonomous touch method compared to those with autonomous touch method condition. These findings indicate that robots featuring the proposed semi-autonomous touch method can provide a comforting experience, leveraging the therapeutic benefits of being touched by another person, and underscore their potential in mental health applications.

    DOI: 10.1038/s41598-024-67964-0

    researchmap

  14. Self-Instructional Training Interface Using a Speech Bubble That Facilitates Users to Internalize the Automatically Generated Texts Reviewed International journal Open Access

    Kei Hyodo, Tomonori Kubota, Satoshi Sato, Kohei Ogawa

    2024 IEEE 48th Annual Computers, Software, and Applications Conference (COMPSAC)     page: 2089 - 2094   2024.7

     More details

    Authorship:Lead author   Language:English   Publishing type:Research paper (international conference proceedings)   Publisher:IEEE  

    Interactive systems that enable people to easily access mental health care in their daily lives are being studied. Self-instruction training, which is a kind of cognitive-behavioral therapy, is expected to be effective for general-purpose mental health care, but the difficulty for users to create self-instructional texts by themselves has hindered its widespread use. Furthermore, it is not sufficient to simply use a computer-assisted method for the training in which the computer automatically generates the self-instructional texts. This is because previous studies have shown that users do not feel self-instructional texts that are not created by themselves are their thoughts, and consequently cannot internalize the content of the texts, reducing the effectiveness of the training. In this study, we focused on the interface design that facilitates users to internalize automatically generated self-instructional texts, toward the realization of a self-instructional training support system. We proposed an interface that shows the real-time captured video of a user's face like a mirror and superimposes a speech bubble containing a self-instructional text to be connected to the user's face and confirmed the interface facilitates the user's internalization of the text through online experiments. The contribution of this paper is to provide a novel interface design for computer-assisted self-instructional training.

    DOI: 10.1109/compsac61105.2024.00334

    Open Access

    researchmap

    Other Link: https://hdl.handle.net/2237/0002011511

  15. Investigating the Intervention in Parallel Conversations Reviewed International journal

    Shota Mochizuki, Sanae Yamashita, Kazuyoshi Kawasaki, Reiko Yuasa, Tomonori Kubota, Kohei Ogawa, Jun Baba, Ryuichiro Higashinaka

    Proceedings of the 11th International Conference on Human-Agent Interaction     page: 30 - 38   2023.12

     More details

    Language:English   Publishing type:Research paper (international conference proceedings)   Publisher:ACM  

    In recent years, a framework of parallel conversations has been proposed to facilitate efficient conversations through cooperation between humans and dialogue systems. This approach aims to enable simultaneous conversations with multiple users by enabling the system to handle basic conversation and human operators to intervene when problems arise in the system’s conversation. Previous studies on parallel conversations have primarily focused on delegating simple exchanges such as greetings and acknowledgments to the system, with humans taking over for more complex interactions like providing guidance. Recent advancements in large language models may change this situation, enabling dialogue systems to engage in more advanced interactions. In this study, to examine which interventions will be made when large language models are utilized, we placed six dialogue robots based on large language models in an actual facility and conducted a field experiment involving parallel conversations for about a month. Our analysis of the collected data on dialogues and interventions showed that the most frequent interventions were made for supporting interactions when the system failed to react to the user utterances, indicating the limitations of using large language models alone and clarifying our next steps for facilitating smoother parallel conversations.

    DOI: 10.1145/3623809.3623863

    researchmap

  16. Investigating the Effects of Dialogue Summarization on Intervention in Human-System Collaborative Dialogue Reviewed International journal

    Sanae Yamashita, Shota Mochizuki, Kazuyoshi Kawasaki, Tomonori Kubota, Kohei Ogawa, Jun Baba, Ryuichiro Higashinaka

    Proceedings of the 11th International Conference on Human-Agent Interaction     page: 316 - 324   2023.12

     More details

    Language:English   Publishing type:Research paper (international conference proceedings)   Publisher:ACM  

    Dialogue systems are widely utilized in chatbots and call centers. However, it is often difficult for such systems to deliver fully autonomous dialogue. For users to have a better dialogue experience, a framework for human-system collaborative dialogue is proposed in which a human operator takes over the dialogue when needed, engaging in conversation with the user instead of the system (we call this process intervention). Operators join the dialogue in the middle; therefore, it is believed that dialogue summarization can be helpful for interventions. However, it is currently unclear whether dialogue summarization is actually useful. Therefore, in this study, we aim to investigate the usefulness of dialogue summaries for interventions through a field experiment conducted at an actual facility combining an aquarium and a zoo. The results of the field experiment revealed that dialogue summaries were more useful for intervention than dialogue history. Furthermore, we found no differences in the word categories included in the operator utterances during interventions irrespective of whether the dialogue history or dialogue format summary was presented to the operators, suggesting that dialogue format summary has content similar to that of dialogue history but improves the usefulness in intervention.

    DOI: 10.1145/3623809.3623889

    researchmap

  17. Alignment of the attitude of teleoperators with that of a semi-autonomous android Reviewed International journal Open Access

    Tomonori Kubota, Kohei Ogawa, Yuichiro Yoshikawa, Hiroshi Ishiguro

    Scientific Reports   Vol. 12   page: 10473   2022.6

     More details

    Authorship:Lead author, Corresponding author   Language:English   Publishing type:Research paper (scientific journal)   Publisher:Nature Portfolio  

    Studies on social robots that can communicate with humans are increasingly important. In particular, semi-autonomous robots have shown potential for practical applications in which robot autonomy and human teleoperation are jointly used to accomplish difficult tasks. However, it is unknown how the attitude represented in the autonomous behavior of the robots affects teleoperators. Previous studies reported that when humans play a particular role, their attitudes align with that role. The teleoperators of semi-autonomous robots also play the role given to the robots and may assimilate their autonomous expression. We hypothesized that the attitude of teleoperators may align with that of robots through teleoperation. To verify this, we conducted an experiment with conditions under which a participant operated a part of the body of an android robot that autonomously expressed a preferential attitude toward a painting and a condition under which they did not. Experimental results demonstrated that the preferential attitude of participants who teleoperated the android aligned statistically significantly more with that of the robot in comparison to those who did not teleoperate it, thereby supporting our hypothesis. This finding is novel regarding attitude change in teleoperators of semi-autonomous robots and can support the implementation of effective human-robot collaboration systems.

    DOI: 10.1038/s41598-022-13829-3

    Open Access

    researchmap

  18. Development and Verication of an Onsite-operated Android Robot Working Cooperatively with Humans in a Real Store Reviewed

    Tomonori Kubota, Takamichi Isowa, Kohei Ogawa, Hiroshi Ishiguro

    The Transactions of Human Interface Society   Vol. 22 ( 3 ) page: 275 - 290   2020.8

     More details

    Authorship:Lead author, Corresponding author   Language:Japanese   Publishing type:Research paper (scientific journal)   Publisher:Human Interface Society  

    While the potential of adopting robots interacting with humans in stores was shown in the previous studies, however robots that can work with people in stores and provide services have not taken root in society yet. In this paper, we realized an android robot which can help the duties of the salespersons at a boutique as well as provide mental support by cooperating with them. We considered that it is important for such robots to not only serve the customers but also support the salespersons. Therefore, we first interviewed salespersons at a boutique to find out what they expect from the robot. The result of the survey showed that they mainly expect three points from the robot: 1) reducing the workload of salesperson, 2) providing mental support for salesperson, and 3) assisting salesperson to establish a good relationship with the customer. To deal with these issues, we implemented an onsite-operated android. Through an 11-day field experiment in a boutique, in which the salespersons used the android, it was observed that the android could contribute to the salespersons in some situation of the work, and more possibilities for the android to contribute to the salespersons in some different aspects was investigated.

    DOI: 10.11184/his.22.3_275

    CiNii Research

    researchmap

  19. Implementation and Evaluation of Chat-oriented Dialogue System for an Android Robot in Live Streaming Media in Which Users Can Speak at Any Time Reviewed

    Tomonori Kubota, Kohei Ogawa, Hiroshi Ishiguro

    Transactions of the Japanese Society for Artificial Intelligence   Vol. 33 ( 1 ) page: DSH-G_1-13   2018.1

     More details

    Authorship:Lead author, Corresponding author   Language:Japanese   Publishing type:Research paper (scientific journal)   Publisher:The Japanese Society for Artificial Intelligence  

    In this study, we developed and evaluated a dialogue system which enables an android robot to have a chat with users on Niconico Live provided by Dwango Co., Ltd. which is a live streaming service. In Niconico Live, broadcasters can talk to users who write comments displayed on the video stream. Therefore, by using Niconico Live chat, we eliminated speech recognition errors which can occur during speech conversations. In addition, the dialogue system can keep consistency of conversation by selecting the comment to which it can correctly respond because many comments are shown simultaneously on the video stream. The dialogue system was designed as a retrieval-based one which finds the appropriate response to user's utterance from a dialogue corpus. Therefore, we collected a dialogue corpus containing 4,460 pairs of comments and robot responses by teleoperating the android robot talking with users, as a first step. In the next step, we completed the dialogue system on Niconico Live integrating the dialogue corpus into it. To evaluate the performance of the dialogue system, we recorded the conversation between the android and users while running the designed system. After that, we showed the recorded conversation to evaluators and asked them how they feel about the naturalness and consistency of the conversation. Results of the experiment indicate that Niconico Live users perceived the responses of the dialogue system to be natural and found the chat with the android entertaining. Through this study, we demonstrated the applicability of the dialogue system on Niconico Live. However, it is difficult to discuss its effectiveness when applying it to other situations or other communication media such as a humanoid robot or a virtual agent. Therefore, as a future work, conducting a comparative experiment might lead to better understanding of the effectiveness of the dialogue system for androids.

    DOI: 10.1527/tjsai.DSH-G

    CiNii Research

    researchmap

▼display all

MISC 33

  1. 複数人同時対話における引継ぎのための抽象型の対話形式の対話要約の実証

    山下 紗苗, 望月 翔太, 星牟禮 健也, 馬場 淳, 窪田 智徳, 小川 浩平, 東中 竜一郎

    言語処理学会 第32回年次大会 発表論文集     page: 1759 - 1763   2026.3

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)  

    対話システムと人間が協調して対話サービスを提供する枠組みとして,複数人同時対話が提案されている.この枠組みでは,対話に問題が生じた際に,人間のオペレータが,対話要約を基に進行中の対話を引継ぐ.我々はこれまでに,抽象型の対話形式要約 (Dialogue Format Summary; DFS) を提案し,複数人同時対話における有用性を調査してきた.しかし,先行研究では,オペレータは進行中の各対話を把握する時間的な余裕があり,負荷が高い条件で発揮されうるDFSの利点が表れなかった可能性がある.そこで,本研究では,低負荷条件と高負荷条件を設定した大規模な実証実験を行い,高負荷条件においてDFSが対話の引継ぎに適していることを示した.

    researchmap

  2. A Platform for Scalable Development of Migrating ITACO Agents Across Multiple Devices Reviewed

    Ayumu Tamiya , Tomonori Kubota , Eiki Go , Ryoto Kobayashi , Satoshi Sato , Kohei Ogawa

    Proceedings of the 13th International Conference on Human-Agent Interaction     page: 491 - 493   2025.11

     More details

    Language:English   Publishing type:Research paper, summary (international conference)  

    DOI: 10.1145/3765766.3765876

  3. AR-Based Interface for Semi-Autonomous Para-Operated Dialogue Robot Reviewed

    Tomonori Kubota , Eiki Go , Satoshi Sato , Kohei Ogawa

    Proceedings of the 13th International Conference on Human-Agent Interaction     page: 381 - 383   2025.11

     More details

    Authorship:Lead author   Language:English   Publishing type:Research paper, summary (international conference)  

    DOI: 10.1145/3765766.3765818

  4. Designing Migrating Agents: Key Factors for Preserving Identity Perception Reviewed International journal

    Ryoto Kobayashi, Tomonori Kubota, Satoshi Sato, Kohei Ogawa

    Proceedings of the 13th International Conference on Human-Agent Interaction     page: 397 - 399   2025.11

     More details

    Authorship:Lead author   Language:English   Publishing type:Research paper, summary (international conference)   Publisher:ACM  

    Agents that migrate across different devices can provide seamless support for users in various contexts. However, little is known about how users determine whether a migrating agent remains the same individual across different devices. To explore the key factors influencing users’ perception of agent continuity before and after migration, we conducted two experiments. In Experiment 1, we examined how users’ perception is influenced when two visually identical agents differ in any of the three factors: voice, memory, or speaking style. Experiment 2 tested whether maintaining the factors identified as critical in Experiment 1 would enable users to perceive the agent as the same individual after it migrated from a robot to headphones. Results suggest that while changes in the factors can disrupt perceived continuity, preserving them enables consistent identity perception before and after migration, even when the agent’s appearance changes.

    DOI: 10.1145/3765766.3765825

    researchmap

  5. Teleoperation System Enabling Operator-Robot Dialogue for Reducing Operator Boredom during Long-Duration Tasks Reviewed International journal

    Manato Uetake, Tomonori Kubota, Masaya Iwasaki, Shota Mochizuki, Sanae Yamashita, Ao Guo, Kenya Hoshimure, Jun Baba, Ryuichiro Higashinaka, Satoshi Sato, Kohei Ogawa

    Proceedings of the 13th International Conference on Human-Agent Interaction     page: 386 - 388   2025.11

     More details

    Language:English   Publishing type:Research paper, summary (international conference)   Publisher:ACM  

    Teleoperated customer service robots have attracted attention to improve customer service efficiency. However, operators experience boredom during long-duration operation due to monotony and idle time, leading to decreased task motivation. This study proposes and evaluates a method to reduce operator boredom through dialogue with the robot to be operated. Field experiments demonstrated that operator-robot dialogue significantly reduced boredom and contributed to maintaining task engagement during long-duration operation.

    DOI: 10.1145/3765766.3765821

    researchmap

  6. Semi-Autonomous Para-Operated Robot for Supporting Parent-Child Dialogue in Home Learning Reviewed International journal

    Eiki Go, Tomonori Kubota, Masaya Iwasaki, Satoshi Sato, Kohei Ogawa

    Proceedings of the 13th International Conference on Human-Agent Interaction     page: 372 - 374   2025.11

     More details

    Authorship:Lead author   Language:English   Publishing type:Research paper, summary (international conference)   Publisher:ACM  

    Educational robots prove effective in children’s learning, but designing robots that support parent-child dialogue during home learning remains unclear. This study proposes a semi-autonomous para-operated robot that parents partially control while engaging with their child. We hypothesized that unlike autonomous robots which may reduce parental engagement [1], this approach would increase parental involvement through active operation. We conducted an experiment with parent-child pairs comparing no robot, autonomous robot, and the proposed semi-autonomous robot conditions. Results showed the proposed robot significantly increased parental utterances without increasing parental burden, demonstrating its effectiveness in facilitating parent-child home learning dialogue.

    DOI: 10.1145/3765766.3765877

    researchmap

  7. Personality Trait Analysis System Using Dialogue Simulation with Autonomous Agents Reviewed International journal

    Kei Hyodo, Tomonori Kubota, Satoshi Sato, Hideki Tanaka, Kohei Ogawa

    Proceedings of the 13th International Conference on Human-Agent Interaction     page: 392 - 394   2025.11

     More details

    Language:English   Publishing type:Research paper, summary (international conference)   Publisher:ACM  

    In personality trait analysis, self-evaluation through questionnaire methods is widely used due to ease of implementation and analysis. However, respondents can easily provide false evaluation scores based on their intentions. This study proposes a method to obtain truthful evaluation scores from dialogue records through dialogue simulation with autonomous agents for questionnaire items. Since dialogue requires immediate responses and detailed explanations, we hypothesized this method would be less prone to deception compared to traditional questionnaire methods. We developed a comprehensive system using Large Language Models that handles everything from setting dialogue situations based on questionnaire items to conducting dialogues with autonomous agents, and automatically evaluating dialogue records. In preliminary experiments, we found that evaluation scores from the proposed method when participants were prompted to lie were close to truthful questionnaire responses when participants were prompted to answer truthfully. These findings suggest the effectiveness of psychological measurement through dialogue with autonomous agents.

    DOI: 10.1145/3765766.3765823

    researchmap

  8. ぼかし効果を適用した自己接触によってVRアバタへの身体所有感を向上させる手法の開発

    平松 広大, 窪田 智徳, 佐藤 理史, 小川 浩平

    第30回日本バーチャルリアリティ学会大会     2025.9

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)   Publisher:日本バーチャルリアリティ学会  

    バーチャルリアリティ体験において、ユーザとアバタの身体部位にずれが生じると、自己接触時に視覚と触覚の不整合が発生し、身体所有感の低下が懸念される。本研究では、ずれが発生した部位にブラー効果を適用することで不整合の知覚を低減する手法を開発し、その有効性を検証した。実験により、提案手法が不整合の悪影響を軽減し、身体所有感の維持に寄与することを確認した。

    researchmap

    Other Link: https://conference.vrsj.org/ac2025/program/3C1.html

  9. 漫才カラオケ:未経験者でも漫才を演じることを可能にする漫才実演支援システム

    小松 駿太, 窪田 智徳, 佐藤 理史, 小川 浩平

    エンタテインメントコンピューティング2025     2025.8

     More details

    Authorship:Lead author   Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)   Publisher:情報処理学会 エンタテインメントコンピューティング研究会  

    漫才には鑑賞だけでなく,実演して笑いを取る楽しさもあるが,人が漫才を演じることは難しい.本研究では,漫才のネタの台詞や演じ方(間・抑揚・動作など)をカラオケのように視覚的に提示して,2 人組の漫才実演をリアルタイムに支援する漫才カラオケを提案する.これにより,ユーザは楽しく漫才を演じられ,聴衆もその漫才を見て楽しめる体験の創出を目指す.プロトタイピングとユーザスタディを通じて,ユーザが負担なく楽しみながら,聴衆にとっても楽しめる漫才を実演できるインタフェースを開発した.

    researchmap

    Other Link: https://www.youtube.com/watch?v=KS-UzKOM-20

  10. 操作者と操作対象ロボットとの対話により長時間操作の退屈感を低減する遠隔操作システムの開発

    植竹 眞斗, 窪田 智徳, 岩﨑 雅矢, 望月 翔太, 山下 紗苗, 郭 傲, 星牟禮 健也, 馬場 惇, 東中 竜一郎, 佐藤 理史, 小川 浩平

    2025年度人工知能学会全国大会(第39回)     2025.5

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)   Publisher:一般社団法人 人工知能学会  

    遠隔操作型対話ロボットは、対話業務の効率化を実現する手段として注目を集めている。しかし長時間の操作においては、操作者は単調さや閑暇に起因する退屈さを感じ、タスクへのモチベーションが低下してしまう課題がある。そこで本研究では、操作者が操作対象のロボットと対話しながらタスクに従事することで、操作者の退屈感を低減する手法を提案する。過去の研究では、同様のアプローチをルールベースの対話機能により実現し、操作者のストレス緩和を目指した例がある。本研究の目的は、(1)長時間利用に耐える柔軟な対話が可能な、大規模言語モデルを用いた生成的対話機能を備えた操作システムの実現と、(2)操作者とロボットとの対話による退屈感低減効果の検証である。参加者1人あたりロボットを5時間操作してもらう14日間のフィールド実験の結果、実装したシステムにより操作者の退屈感が有意に低減することが示された。よって、操作者とロボットの対話は長時間操作における操作者の退屈感を軽減し、タスクへの従事モチベーションの維持に寄与することが示唆された。本稿は、遠隔操作型対話ロボットの実用における操作者の快適性向上のための知見を提供する。

    DOI: 10.11517/pjsai.JSAI2025.0_3Q6GS802

    researchmap

  11. 対話シミュレーションを用いた性格特性分析システムの開発

    兵頭 佳, 窪田 智徳, 佐藤 理史, 田中 秀樹, 小川 浩平

    2025年度人工知能学会全国大会(第39回)     2025.5

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)   Publisher:一般社団法人 人工知能学会  

    人の性格特性の分析において,実施や分析の容易さから質問紙法による自己評価が広く用いられている.しかし,質問紙法では,質問項目が抽象的で回答が困難な場合があり,先行研究においても自己評価による分析結果の信頼性の低さが指摘されている.そこで本研究では,質問紙法において被分析者が評定しづらい質問項目に対して,対話シミュレーションを通じた行動から分析できる手法を提案する.提案手法では,質問項目から具体的な対話状況を設定し,被分析者と自律エージェントの対話を自動で分析して評定値を得る.これにより,自己評定では正確な分析が困難であった質問項目に観察法を適用することで,具体的な行動に基づく分析結果を低コストで得ることができると考えた.実装には,大規模言語モデルを活用し,対話状況の設定から自動評定までを一貫して行うシステムを開発した.予備実験では,第三者評定と提案手法による評定結果を比較し,提案手法の妥当性を検証した.

    DOI: 10.11517/pjsai.JSAI2025.0_2D5GS903

    researchmap

  12. 実インタラクション映像から構築したマルチモーダルモデルを用いた人とロボットのインタラクションにおける異常検出

    望月 翔太, 山下 紗苗, 星牟禮 健也, 馬場 惇, 窪田 智徳, 小川 浩平, 東中 竜一郎

    言語処理学会第31回年次大会(NLP2025)     page: 3148 - 3152   2025.3

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)   Publisher:言語処理学会  

    本研究では,人とロボットのインタラクションにおいて生じる異常を自動で検出するモデルを構築することを目的とし,データセットの作成および異常検出モデルの構築を行った.具体的には,人とロボットのインタラクションに問題が生じた際に人間が介入する複数人同時対話の枠組みにおいて収集されたインタラクション映像に対して,正常か異常かを人手でアノテーションすることでデータセットを作成した.そして,作成したデータセットを用いて分類モデルを学習することで異常検出モデルを構築した.さらに,複数人同時対話の枠組みを検証する実証実験を実施し,モデルの検出結果をアラートとして提示することがオペレータの介入に有用であることを確認した.

    researchmap

  13. Semi-Autonomous Para-Operated Robot in Home Education for Enhancing Parent-Child Interaction

    Eiki Go, Tomonori Kubota, Masaya Iwasaki, Satoshi Sato, Kohei Ogawa

    Human-Agent Interaction Symposium 2025     2025.3

     More details

    Authorship:Lead author   Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)  

    researchmap

  14. Development of a low-noise and home-use touch robot

    Ryoma Mitsuoka, Tomonori Kubota, Satoshi Sato, Kohei Ogawa

    Human-Agent Interaction Symposium 2025     2025.3

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)  

    researchmap

  15. Exploring Sense of Agency and Ownership over Cybernetic Avatars: Practical Implications Reviewed International journal

    Tomonori Kubota, Koki Miyahara, Kei Hyodo, Yuki Amemiya, Ryoma Mitsuoka, Amr Eid, Kohei Ogawa

    Proceedings of the 12th International Conference on Human-Agent Interaction     page: 361 - 363   2024.11

     More details

    Authorship:Lead author   Language:English   Publishing type:Research paper, summary (international conference)   Publisher:ACM  

    Cybernetic avatars (CAs), robots or CG agents operated remotely by humans, are increasingly used for remote communication, offering potential for applications such as telework. However, the usability of these systems, particularly regarding the operator’s sense of agency (SoA) and sense of ownership (SoO), remains underexplored. We conducted an experiment using a commercially employed CA system. The results showed that operators can experience SoA and SoO over on-screen CG avatars, supporting the system’s basic usability. Additionally, the results suggest that limiting operator hand movements might better maintain SoA in environments with a delay in the reflection of operators’ movement on CAs. These findings have preliminary implications for CA system usage, highlighting the need to consider trade-offs between operation and system responsiveness.

    DOI: 10.1145/3687272.3690882

    researchmap

    Other Link: https://hdl.handle.net/2237/0002011729

  16. Operator Enjoyment in Teleoperation of Customer Service Robots: Interface Design Guidelines from a Field Study Reviewed International journal

    Manato Uetake, Masaya Iwasaki, Tomonori Kubota, Jun Baba, Satoshi Sato, Kohei Ogawa

    Proceedings of the 12th International Conference on Human-Agent Interaction     page: 364 - 366   2024.11

     More details

    Language:English   Publishing type:Research paper, summary (international conference)   Publisher:ACM  

    Various customer service robots’ teleoperation interfaces (I/Fs) have been developed for human-robot collaboration. However, a previous study has indicated a lack of operator enjoyment. This study aims to design an I/F that elicits operator enjoyment and identifies the factors that contribute to this enjoyment. We developed two I/Fs: a high degree of freedom I/F and a gradual flexibility degree of freedom I/F based on gamification to elicit operator enjoyment. Using these I/Fs, we conducted a field study in a real shopping mall to investigate the operators’ experiences. As a result, the operators in this experiment greatly enjoyed using our I/Fs. The results showed that our I/Fs could elicit operator enjoyment with the following three I/F factors suggested as potentially important design guidelines: ease of use through anonymity, moderate restriction of freedom, and sharing experiences with a group of operators.

    DOI: 10.1145/3687272.3690883

    researchmap

    Other Link: https://hdl.handle.net/2237/0002011730

  17. Navigating Gender Influences in Avatar-Based Communication Reviewed International journal

    Amr Eid, Tomonori Kubota, Satoshi Sato, Kohei Ogawa

    Proceedings of the 12th International Conference on Human-Agent Interaction     page: 384 - 386   2024.11

     More details

    Language:English   Publishing type:Research paper, summary (international conference)   Publisher:ACM  

    This study investigates the effects of both operator and avatar gender on the perceived ease of communication and creepiness of the avatars. Utilizing a mixed-methods 2 by 2 approach (male operator, female operator; male avatar, female avatar), we conducted an experiment involving 148 participants. The results indicate significant variations in perceived avatar impressions influenced by the gender alignment between the operator and the avatar. Specifically, female-operator-female-avatar group rated as the easiest to talk to, most interesting and least in the creepiness metric. These results suggest that for low-friction conversational encounters using female-operator-female-avatars might be most suitable.

    DOI: 10.1145/3687272.3690891

    researchmap

    Other Link: https://hdl.handle.net/2237/0002011731

  18. Impact of Data Size and Recording Environments on the Performance of Anomaly Detection in Human-Robot Interaction

    Shota Mochizuki, Sanae Yamashita, Tomonori Kubota, Kohei Ogawa, Ryuichiro Higashinaka

    Workshop on Spoken Dialogue Systems for Cybernetic Avatars (SDS4CA) in 25th Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL 2024)     2024.9

     More details

    Language:English  

    researchmap

  19. 大規模We-modeを生起させる視聴者参加型ゲームのデザイン

    Atsushi Kobayashi, Tomonori Kubota, Satoshi Sato, Kohei Ogawa

    Entertainment Computing 2024     2024.9

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)   Publisher:IPSJ Special Interest Group on Entertainment Computing  

    researchmap

  20. Influence of the degree of abstractness of the operating method of a semi-autonomous robot on the operator's sense of operation and direction

    Yuki AMEMIYA, Tomonori KUBOTA, Kohei OGAWA, Satoshi SATO

    The 38th Annual Conference of the Japanese Society for Artificial Intelligence     2024.5

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)   Publisher:The Japanese Society for Artificial Intelligence  

    A semi-autonomous robot is being researched and applied, in which the robot's autonomy and human operation cooperate to accomplish practical tasks. Because such robots are both autonomous and operability, when an operator operates the robot, they may feel as if they are operating a tool that serves as their other self (sense of operation), while at the same time, they may feel as if they are giving direction to another person, the agent (sense of direction). However, the factors to make a difference in how the operator feels senses of operation and direction are not clear, and there is a lack of understanding of how this difference affects cooperation with the robot. In this study, we clarified whether an operator feels a sense of operation or direction changes depending on the degrees of abstractness of the operation method, and that which sense is preferred depends on an operator and task content. Therefore, the results of this paper suggest the importance of interaction design between an operator and the robot, which focuses on how an operator feels when operating the robot, for the application of semi-autonomous robots.

    DOI: 10.11517/pjsai.JSAI2024.0_3T5OS6b02

    researchmap

  21. 固有表現を対象とした小説登場人物検出

    Kazumi Oshima, Tomonori Kubota, Kohei Ogawa, Satoshi Sato

        page: 728 - 733   2024.3

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)   Publisher:The Association for Natural Language Processing  

    researchmap

  22. Semi-autonomous touching method toward realization of touch therapy robot

    Ryoma Mitsuoka, Tomonori Kubota, Satoshi Sato, Kohei Ogawa

    Human-Agent Interaction Symposium 2024     2024.3

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)  

    researchmap

  23. Anomaly Detection in Human-Robot Interaction using Multimodal Information

    Shota Mochizuki, Sanae Yamashita, Reiko Yuasa, Tomonori Kubota, Kohei Ogawa, Ryuichiro Higashinaka

    Human-Agent Interaction Symposium 2024     2024.3

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)  

    researchmap

  24. Voice Volume Gauge to Encourage Appropriate Vocal Adjustment of an Operator of a Teleoperated Social Robot: Development and Preliminary Evaluation

    Keigo Matsushima, Tomonori Kubota, Kohei Ogawa, Satoshi Sato

    Human-Agent Interaction Symposium 2024     2024.3

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)  

    researchmap

  25. Effects of the Behavior of a Para-operated Robot on the Impression of the Operator: a Preliminary Online Study Considering the Robot-operator Distance Reviewed International journal

    Tomonori Kubota, Kohei Ogawa

    Proceedings of the 11th International Conference on Human-Agent Interaction     page: 356 - 358   2023.12

     More details

    Authorship:Lead author   Language:English   Publishing type:Research paper, summary (international conference)   Publisher:ACM  

    While research and applications of operated social robots that can be used as operators’ avatars have been conducted, a para-operated social robot has also been proposed, in which the robot and its operator exist in the same space, and the operator, robot, and interlocutor can interact with each other. From the findings of human-human-robot interaction research, it is known that the robot’s behavior influences the interpersonal relationships of the people involved in the dialog. However, there is no knowledge of how the operator is perceived by the interlocutor when the operations by the operator are unveiled. This paper reports preliminary results from two online surveys conducted to investigate the following question considering the robot-operator distance; Does the impression of the operator improve in unveiled para-operation when the operator operates the robot and has it say favorable utterances? The results of the two video surveys conducted at different distances between the robot and the operator show that the impression of the operator was improved by the robot’s favorable humorous utterances when the distance was close, but not when the distance was further apart. We consider that the findings contribute to the potential application of unveiled para-operated robots and suggest the importance of considering the distance factor in the influence of robots on human-human relationships.

    DOI: 10.1145/3623809.3623924

    researchmap

  26. Perception of Complex Emotion from an Android Robot's Body and Vocal Expressions

    Hisako W. Yamamoto, Kohei Ogawa, Tomonori Kubota, Moi Katsuma, Misuzu Yamazaki, Takashi Minato, Hiroshi Ishiguro, Akihiro Tanaka

    The 40th Annual Meeting of Japanese Cognitive Science Society     page: 80 - 83   2023.9

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)   Publisher:Japanese Cognitive Science Society  

    researchmap

  27. Proposal for Semi-Auto Touching Method for Realization of Active Touching Robot

    Ryoma Mitsuoka, Tomonori Kubota, Kohei Ogawa, Satoshi Sato

    Tokai-Section Joint Conference on Electrical, Electronics, Information, and Related Engineering     2023.8

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)  

    researchmap

  28. Investigation for measuring and controlling an operator’s sense of operation/direction for a semi-autonomous robot

    Yuki AMEMIYA, Tomonori KUBOTA, Kohei OGAWA, Satoshi SATO

    The 37th Annual Conference of the Japanese Society for Artificial Intelligence     2023.6

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)   Publisher:The Japanese Society for Artificial Intelligence  

    A semi-autonomous robot is becoming important because it can accomplish practical tasks through collaboration between the robot’s autonomy and human operation. However, it is still unclear how a semi-autonomous robot is recognized by its operator who collaborates with it, and understanding this point is critical for application of the robot.For example, the attribution of responsibility for task failure or success may be affected depending on whether an operator treats the robot as a sidekick or a mere tool.In this study, we developed a psychological scale to measure whether an operator feels a sense of operation (tool-likeness) or direction (human-likeness) when they command it. Then, we conducted the experiment to investigate the hypothesis that the degrees of abstractness of the command affect the operator's recognition of a semi-autonomous robot. The results showed that high and low abstractness tended to evoke a sense of direction and operation, respectively.

    DOI: 10.11517/pjsai.JSAI2023.0_3I5OS4c04

    researchmap

  29. Method for Building an Autonomous Dialogue Agent with an Ability for Interaction Adapted to the Characteristics of the User Community

    Atsushi KOBAYASHI, Tomonori KUBOTA, Kohei OGAWA, Satoshi SATO

    The 37th Annual Conference of the Japanese Society for Artificial Intelligence     2023.6

     More details

    Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)   Publisher:The Japanese Society for Artificial Intelligence  

    An autonomous dialogue agent is expected to engage in live chat like Virtual YouTubers or to give classes and lectures in application of one-to-many dialogue where the agent interacts with multiple interlocutors forming a community. In one-to-one dialogue, the effectiveness has been shown that an agent interacts with its interlocutor adapting to their characteristics. However, in one-to-many dialogue with community members, no method has been established to realize an agent with the dialogue ability adapted to the characteristics of the community. In this study, we proposed a two-step method to build such an agent: (1) collecting dialogue examples from chat in which community members operate an agent to interact with the other members, (2) developing the agent by using these examples. We conducted experiments to verify this method with our developed system enabling dialogue examples collection and agent implementation. The results suggested that it is possible to collect dialogue examples that reflect the characteristics of a community and to realize an agent capable of dialogue adapted to the characteristics.

    DOI: 10.11517/pjsai.JSAI2023.0_2K4GS903

    researchmap

  30. 博士論文集 2021.10~2022.9授与 "Studies on Cooperation Between Tele/Para-Operatable Semi-Autonomous Robots and Their Operators"

    Tomonori Kubota

    Journal of the Japanese Society for Artificial Intelligence   Vol. 38 ( 1 ) page: 52 - 52   2023.1

     More details

    Language:Japanese   Publishing type:Book review, literature introduction, etc.   Publisher:The Japanese Society for Artificial Intelligence  

    DOI: 10.11517/jjsai.38.1_46

    researchmap

  31. ワタシの論文読みどころ "人と共働する近接操作型アンドロイドロボットの開発と実店舗での検証"

    Tomonori Kubota

    Journal of Human Interface Society   Vol. 22 ( 3 ) page: 32 - 32   2020.8

     More details

    Language:Japanese   Publishing type:Book review, literature introduction, etc.   Publisher:Human Interface Society  

    researchmap

  32. An Attitude of a Teleoperator Manipulating a Part of an Android’s Body Gets Close to an Attitude the Android Autonomously Expresses

    Tomonori Kubota, Kohei Ogawa, Yuichiro Yoshikawa, Hiroshi Ishiguro

    The 1st International Symposium on Symbiotic Intelligent Systems     2019.1

     More details

    Authorship:Lead author   Language:English   Publisher:Symbiotic Intelligent Systems Research Center  

    researchmap

  33. Androidol U: Steps towards a chat-oriented dialogue android on Niconico Live for acquisition of its socially significant presence

    Tomonori Kubota, Kohei Ogawa, Hiroshi Ishiguro

    The 31st Annual Conference of the Japanese Society for Artificial Intelligence, 2017     2017.5

     More details

    Authorship:Lead author, Corresponding author   Language:Japanese   Publishing type:Research paper, summary (national, other academic conference)   Publisher:The Japanese Society for Artificial Intelligence  

    DOI: 10.11517/pjsai.JSAI2017.0_2N23

    researchmap

▼display all

Presentations 3

  1. 遠隔社会参加に向けたゲーム化ロボット操作システム Invited

    窪田智徳

    病気療養中の高校生を応援する支え合い井戸端セミナー 愛知大会  2026.3.8  NPO法人未来ISSEY

     More details

    Event date: 2026.3

    Language:Japanese   Presentation type:Public lecture, seminar, tutorial, course, or other speech  

    Venue:愛知県産業労働センター ウインクあいち 会議室1001   Country:Japan  

  2. Horizons of Human-Avatar Interaction Invited International conference

    Tomonori Kubota

    HAI Horizons: Showcasing Early-Career Research from Non-Native English Speakers (Workshop at the 13th International Conference on Human-Agent Interaction)  2025.11.10 

     More details

    Event date: 2025.11

    Language:English   Presentation type:Oral presentation (invited, special)  

    Venue:Keio University Hiyoshi Campus Raiosha   Country:Japan  

    Avatars, operated robots and CG agents, are developed for applications like remote work. Semi-autonomous avatars are especially promising, enabling a collaboration where humans and avatars complement each other; operators handle complex tasks while the avatar's autonomy manages high-load duties. While most research on semi-autonomous systems has focused on task efficiency, the interaction between the operator and the avatar (Human-Avatar Interaction) remains underexplored. This raises key questions: What interface designs enable seamless collaboration? Can a semi-autonomous avatar shift between a tool and an interactive partner? In this talk, I will present our research on designing interfaces and interaction to foster effective human-avatar collaboration in real-world settings.

    researchmap

    Other Link: https://hai-conference.net/hai2025/hai-workshop-list/#w4

  3. ゲーム化されたアバター遠隔操作システムの実現

    窪田 智徳

    Cybernetic Avatar Startups  2025.9.16  アバター共生社会プロジェクト

     More details

    Event date: 2025.9

    Language:Japanese   Presentation type:Public lecture, seminar, tutorial, course, or other speech  

    Venue:Blooming Camp by さくらインターネット   Country:Japan  

    長時間のアバター操作業務では、操作者の飽きが課題となります。そこで我々は、アバターの遠隔操作をゲーム化することで、操作者が楽しみながら働けるシステムの実現を目指しています。開発中のシステムでは、タスクの成功に応じたポイント獲得や動的なBGM生成で、ゲーム的な操作体験を可能にします。本講演では、操作インタフェースのデザインやVLMを用いた実世界認識によるポイントフィードバック機構を紹介します。

    researchmap

Other research activities 1

  1. Research Assistant, Autonomous Robots Research Group, JST ERATO ISHIGURO Symbiotic Human-Robot Interaction Project

    2017.7
    -
    2020.3

     More details

Research Project for Joint Research, Competitive Funding, etc. 2

  1. International Exchange Grants for the second semester (International Conference Presentation)

    2023.12

    Tateisi Science and Technology Foundation  International Exchange Grants for the second semester (International Conference Presentation) 

    Tomonori Kubota

      More details

    Grant type:Competitive

    Grant amount:\624000 ( Direct Cost: \600000 、 Indirect Cost:\24000 )

  2. 遠隔操作型対話ロボットの操作者の適切な声量調整の実現に向けた、操作インタフェース上に表示できる声量ゲージの開発

    2023.4 - 2024.3

    牧誠記念研究助成 

    窪田 智徳

      More details

    Authorship:Principal investigator  Grant type:Competitive

    Grant amount:\1000000 ( Direct Cost: \1000000 )

KAKENHI (Grants-in-Aid for Scientific Research) 2

  1. 拡張現実インタフェースを用いた無言の意思疎通により人と共働する対話ロボットの開発

    Grant number:25K21248  2025.4 - 2028.3

    Japan Society for the Promotion of Science  Grants-in-Aid for Scientific Research  Grant-in-Aid for Early-Career Scientists

    Tomonori Kubota

      More details

    Authorship:Principal investigator  Grant type:Competitive

    Grant amount:\4810000 ( Direct Cost: \3700000 、 Indirect Cost:\1110000 )

    researchmap

  2. Realization of a practical semi-autonomous social robot focusing on the effectiveness for both its teleoperator and its interlocutor

    Grant number:20J13662  2020.4 - 2022.3

    Japan Society for the Promotion of Science  Grants-in-Aid for Scientific Research  Grant-in-Aid for JSPS Fellows

    Tomonori Kubota

      More details

    Authorship:Principal investigator 

    Grant amount:\2100000 ( Direct Cost: \2100000 )

    researchmap

 

Teaching Experience (On-campus) 4

  1. Fundamental Computer Programing with Exercises

    2024

  2. 電気電子情報工学実験第1

    2024

  3. Fundamental Computer Programing with Exercises

    2023

  4. Experiments on Electrical, Electronic and Information Engineering 2

    2023

Teaching Experience (Off-campus) 1

  1. Introduction to Robotic Society

    2020.10 Kyoto Women's University)

     More details

    Level:Undergraduate (liberal arts)  Country:Japan

    researchmap

 

Social Contribution 8

  1. ゲーム感覚で接客ロボット操作/漫才カラオケ&英語カラオケ体験

    Role(s):Demonstrator

    NPO法人未来ISSEY  病気療養中の高校生を応援する支え合い井戸端セミナー 愛知大会  2026.3

     More details

    Audience: General

    Type:Seminar, workshop

  2. ComoNe案内ロボットと会話してみよう!

    Role(s):Demonstrator

    東海国立大学機構 Common Nexus  コモの市 #01  2025.9

     More details

    Audience: General

    Type:Science festival

    researchmap

  3. ゲーム化されたアバター遠隔操作システムの実現

    Role(s):Demonstrator

    アバター共生社会プロジェクト  Cybernetic Avatar Startups  2025.9

     More details

    Audience: Researchesrs, Company

    Type:Seminar, workshop

    長時間のアバター操作業務では、操作者の飽きが課題となります。そこで我々は、アバターの遠隔操作をゲーム化することで、操作者が楽しみながら働けるシステムの実現を目指しています。本展示では、VLMを用いた実世界認識によるポイントフィードバックや動的なBGM生成機能を搭載した、ゲーム化されたアバター遠隔操作システムを体験いただけます。

    researchmap

  4. Techno Frontier Seminar 2025

    Role(s):Lecturer, Planner

    School of Engineering / Graduate School of Engineering, Nagoya University, The KDDI Foundation, Center for Low-temperature Plasma Sciences, Nagoya University  2025.8

     More details

    Audience: High school students

    Type:Seminar, workshop

    researchmap

  5. ロボットとの会話と遠隔操作をしてみよう

    Role(s):Demonstrator

    東海国立大学機構 Common Nexus  コモの市 #00  2025.7

     More details

    Audience: General

    Type:Science festival

    researchmap

  6. 雑談でさぐる? パートナーAIとの暮らし

    Role(s):Organizing member, Demonstrator

    The National Museum of Emerging Science and Innovation  Mirai can NOW 第9弾「AIとえがく?わたしスタイル in 20XX」関連イベント  2025.4

     More details

    Type:Seminar, workshop

    researchmap

  7. Let's talk with android "U"

    Role(s):Organizing member, Demonstrator

    The National Museum of Emerging Science and Innovation  Demonstration experiment  2022.8

     More details

    Type:Seminar, workshop

    researchmap

  8. Special Exhibit of Android

    Role(s):Appearance, Planner, Demonstrator

    Osaka University  Lalaport EXPOCITY  2018.11

     More details

    Type:Science festival

    researchmap

▼display all

Media Coverage 25

  1. 「なんでだよ」は「ノー・ウェイ!」英語で"漫才カラオケ" 中高生が体験してみると?プロのお笑いコンビも高評価【香川】 TV or radio program

    RSK Sanyo Broadcasting  RSKイブニングニュース  2026.1

     More details

    Author:Other 

    researchmap

  2. 「英語カラオケ」で中高生が英会話を学ぶ! TV or radio program

    RNC  RNC news every.  2026.1

     More details

    Author:Other 

    researchmap

  3. 英語で笑いを取るのは「Very Exciting!」 名古屋大学開発のシステムで高校生が英語漫才に挑戦 高松市 TV or radio program

    KSB  2026.1

     More details

    Author:Other 

    researchmap

  4. あなたも〝たくろう〟目指せるかも?「漫才支援システム」学生が開発 Internet

    The Asahi Shimbun Company  withnews  2025.12

     More details

    Author:Other 

    researchmap

  5. DREAM PITCH「漫才カラオケ」 TV or radio program

    J-WAVE  INNOVATION WORLD  2025.12

     More details

    Author:Other 

    researchmap

  6. 画面のセリフ読めばプロ級?!「漫才カラオケ」 Newspaper, magazine

    The Yomiuri Shimbun  読売中高生新聞  2025.12

     More details

    Author:Other 

    researchmap

  7. 爆笑間違いなし!? ???ができるカラオケ TV or radio program

    NHK  世界!オモシロ学者のスゴ動画祭12  2025.12

     More details

    Author:Other 

    researchmap

  8. 誰でもプロに“漫才カラオケ” TV or radio program

    TV TOKYO Corporation  WORLD BUSINESS SATELLITE  2025.11

     More details

    Author:Other 

    researchmap

  9. 「漫才カラオケ」開発 セリフ・抑揚・間を先導 名大大学院工学研究科 Newspaper, magazine

    The Mainichi Newspapers Co., Ltd.  The Mainichi Shimbun  Aichi  2025.11

     More details

    Author:Other 

    researchmap

  10. M-1夢じゃない? カラオケ感覚で漫才できるシステム、名大が開発 Internet

    The Mainichi Newspapers Co., Ltd.  Mainichi Shimbun Digital  2025.11

     More details

    Author:Other 

    researchmap

  11. 手軽にM-1参戦気分? プロめざす大学院生が「漫才カラオケ」開発 Internet

    The Asahi Shimbun Company  The Asahi Shimbun (Digital)  2025.10

     More details

    Author:Other 

    researchmap

  12. THE FOCUS(漫才カラオケ関連) TV or radio program

    ZIP-FM  MORNING BOOOOOOST  2025.10

     More details

    Author:Other 

    researchmap

  13. 「漫才カラオケ」でプロの笑いを“伝授” 名古屋の大学院生が開発 TV or radio program

    Nagoya Broadcasting Network Co.,Ltd.  ドデスカ+  2025.10

     More details

    Author:Other 

    researchmap

  14. お笑いの新たなビジネスモデルを生むか「漫才カラオケ」 Internet

    Forbes JAPAN Web-News  2025.10

     More details

    Author:Other 

    researchmap

  15. 名大が開発した「漫才カラオケ」とは? - “笑わせること”が秘める可能性 Internet

    Mynavi News  TECH+  2025.10

     More details

    Author:Other 

    researchmap

  16. カラオケのように漫才を演じられる「漫才カラオケ」を開発 Internet

    kusuguru inc.  nazology  2025.10

     More details

    Author:Other 

    researchmap

  17. 誰でも爆笑させられる漫才カラオケ TV or radio program

    RF RADIO NIPPON CO.,LTD.  SWEET!!  2025.9

     More details

    Author:Other 

    researchmap

  18. 爆笑間違いなし? 「漫才カラオケ」、名古屋大が開発 プロのネタなどを追体験できるシステム Internet

    ITmedia Inc.  ITmedia NEWS  Innovative Tech  2025.9

     More details

    Author:Other 

    researchmap

  19. “カラオケ感覚”で漫才ができる…名古屋大学が開発、支援システムが面白い Internet

    THE NIKKAN KOGYO SHIMBUN, LTD.  Newswitch  2025.9

     More details

    Author:Other 

    researchmap

  20. 漫才“カラオケ感覚” 名大が支援システム Newspaper, magazine

    THE NIKKAN KOGYO SHIMBUN, LTD.  The Nikkan Kogyo Shimbun  2025.9

     More details

    Author:Other 

    researchmap

  21. 名大、ロボと雑談で退屈感低減 遠隔接客者向けシステム Newspaper, magazine

    THE NIKKAN KOGYO SHIMBUN,LTD.  The Nikkan Kogyo Shimbun  2025.6

     More details

    Author:Other 

    researchmap

  22. ⼈型ロボの態度、操作者に影響 Newspaper, magazine

    Nikkei Inc.  NIKKEI BUSINESS DAILY  p. 7  2022.9

     More details

    Author:Other 

    researchmap

  23. アンドロイドの態度、操作者の心理に影響 名古屋大学 Internet

    Nikkei Inc.  The Nikkei  2022.8

     More details

    Author:Other 

    researchmap

  24. ロボットが示す好み 操作者も同調の傾向 Newspaper, magazine

    The Science News Ltd.  The Science News  2022.7

     More details

    Author:Other 

    researchmap

  25. ロボットの自律動作が遠隔操作者の心理に影響を与える、名大などが証明 Internet

    Mynavi Corporation  TECH+  2022.6

     More details

    Author:Other 

    researchmap

▼display all

Academic Activities 1

  1. Session Chair International contribution

    Role(s):Panel moderator, session chair, etc.

    The 12th International Conference on Human-Agent Interaction  ( Swansea University ) 2024.11

     More details

    Type:Academic society, research group, etc. 

    researchmap