Information processing device, communication support device, and communication support system

Patent metadata

Field	Value
Publication number	US-2024412560-A1
Application number	US-202218703768-A
Country	US
Kind code	A1
Filing date	Sep 7, 2022
Priority date	Nov 1, 2021
Publication date	Dec 12, 2024
Grant date	—

Abstract

An information processing device according to the present disclosure includes: a first emotion estimation section configured to generate first emotion data by estimating emotion of a user on the basis of a result of detection made by a first sensing section configured to detect behavior of the user, the behavior being used for communication; a second emotion estimation section configured to generate second emotion data by estimating emotion of the user on the basis of a result of detection made by a second sensing section configured to detect movement or response of the user, the movement or response not being used for communication; an emotion data generation section configured to decide a combination ratio between the first emotion data and the second emotion data, and to generate third emotion data by combining the first emotion data and the second emotion data with use of the decided combination ratio; and a communication section configured to transmit the third emotion data.

First claim

1 . An information processing device comprising:
a first emotion estimation section configured to generate first emotion data by estimating emotion of a user on a basis of a result of detection made by a first sensing section configured to detect behavior of the user, the behavior being used for communication; a second emotion estimation section configured to generate second emotion data by estimating emotion of the user on a basis of a result of detection made by a second sensing section configured to detect movement or response of the user, the movement or response not being used for communication; an emotion data generation section configured to decide a combination ratio between the first emotion data and the second emotion data, and to generate third emotion data by combining the first emotion data and the second emotion data with use of the decided combination ratio; and a communication section configured to transmit the third emotion data.

2 . The information processing device according to claim 1 , wherein the emotion data generation section is configured to decide the combination ratio on a basis of the first emotion data.

3 . The information processing device according to claim 2 , wherein
the first emotion data includes a first component indicating an arousal level and a second component indicating an emotional valence, and the emotion data generation section is configured to decide the combination ratio on a basis of the first component in the first emotion data.

4 . The information processing device according to claim 1 , wherein
the emotion data generation section further includes an analysis section configured to analyze atmosphere of communication on a basis of a result of detection made by the first sensing section, and the emotion data generation section is configured to decide the combination ratio on a basis of a result of analysis made by the analysis section.

5 . The information processing device according to claim 1 , further comprising
a user interface section configured to display the third emotion data.

6 . The information processing device according to claim 5 , wherein
the third emotion data includes a first component indicating an arousal level and a second component indicating an emotional valence, and the user interface section is configured to display the third emotion data by orienting the first component and the second component of the third emotion data to a first direction and a second direction on a display screen of the user interface section.

7 . The information processing device according to claim 5 , wherein
the emotion data generation section is configured to monitor change in emotion indicated by the third emotion data, and the user interface section is configured to change a display mode of the third emotion data on a basis of a result of monitoring done by the emotion data generation section.

8 . The information processing device according to claim 5 , wherein
the user interface section is configured to accept an operation input of the combination ratio from the user, and the emotion data generation section is configured to generate the third emotion data by combining the first emotion data and the second emotion data with use of the combination ratio accepted by the user interface section.

9 . The information processing device according to claim 1 , comprising
a user interface section, wherein the communication section is further configured to receive fourth emotion data transmitted from a communication partner, and the user interface section is configured to display the fourth emotion data.

10 . A communication support device comprising:
a first sensing section configured to detect behavior of a user, the behavior being used for communication; a first emotion estimation section configured to generate first emotion data by estimating emotion of the user on a basis of a result of detection made by the first sensing section; a second sensing section configured to detect movement or response of the user, the movement or response not being used for communication; a second emotion estimation section configured to generate second emotion data by estimating emotion of the user on a basis of a result of detection made by the second sensing section, an emotion data generation section configured to decide a combination ratio between the first emotion data and the second emotion data, and to generate third emotion data by combining the first emotion data and the second emotion data with use of the decided combination ratio; and a communication section configured to transmit the third emotion data.

11 . A communication support system comprising:
a first communication support device; and a second communication support device, wherein the first communication support device includes
a first sensing section configured to detect behavior of a user, the behavior being used for communication,
a first emotion estimation section configured to generate first emotion data by estimating emotion of the user on a basis of a result of detection made by the first sensing section,
a second sensing section configured to detect movement or response of the user, the movement or response not being used for communication,
a second emotion estimation section configured to generate second emotion data by estimating emotion of the user on a basis of a result of detection made by the second sensing section,
an emotion data generation section configured to decide a combination ratio between the first emotion data and the second emotion data, and to generate third emotion data by combining the first emotion data and the second emotion data with use of the decided combination ratio, and
a first communication section configured to transmit the third emotion data to the second communication support device, and
the second communication support device includes
a second communication section configured to receive the third emotion data, and
a user interface section configured to display the third emotion data received by the second communication section.

Assignees

• Sony Group Corp

Inventors

• Yoshikawa Kiyoshi

Classifications

• A61B5/165

  Evaluating the state of mind, e.g. depression, anxiety · CPC title

• G10L25/63

  for estimating an emotional state · CPC title

• G06F3/015

  Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection · CPC title

• G06F3/011

  Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00) · CPC title

• G06F2203/011

  Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns · CPC title