Information analysis system, information analysis method, and non-transitory recording medium

Patent metadata

Field	Value
Publication number	US-12592008-B2
Application number	US-202318511177-A
Country	US
Kind code	B2
Filing date	Nov 16, 2023
Priority date	Nov 30, 2022
Publication date	Mar 31, 2026
Grant date	Mar 31, 2026

Abstract

An information analysis system includes a communication terminal including first circuitry and an information analysis apparatus including second circuitry. The first circuitry acquires image information and voice information of a plurality of participants participating in an online event and transmits, to the information analysis apparatus, the image information and the voice information. The second circuitry performs analysis on a state of the plurality of participants based on the image information and the voice information transmitted from the communication terminal, and generates, based on the state of the plurality of participants, a state notification to be displayed on the communication terminal.

First claim

The invention claimed is:

1 . An information analysis system, comprising:
a communication terminal including first circuitry; and an information analysis apparatus including second circuitry, the first circuitry being configured to:
acquire image information and voice information of a plurality of participants participating in an online event; and
transmit, to the information analysis apparatus, the image information and the voice information,
the second circuitry being configured to:
perform analysis on a state of the plurality of participants based on the image information and the voice information transmitted from the communication terminal; and
generate, based on the state of the plurality of participants, a state notification to be displayed on the communication terminal,
wherein the first circuitry is further configured to display, on a display, the state notification, the state notification being transmitted from the information analysis apparatus,
wherein the first circuitry is further configured to display, on the display, an icon for playing an explanatory video for informing each of the plurality of participants of a purpose of performing analysis on the state of the plurality of participants, and
wherein the first circuitry is further configured to display, on the display, an acquisition permission selection component for selecting whether to permit data acquisition for the analysis.

2 . The information analysis system of claim 1 , wherein
the image information includes at least one of information related to nodding or information related to smiling included in an image of each of the plurality of participants, the image being obtained during the online event, the voice information includes information related to utterance of each of the plurality of participants during the online event, and the second circuitry is configured to perform the analysis on the state of the plurality of participants based on the information related to the utterance and at least one of the information related to the nodding or the information related to the smiling.

3 . The information analysis system of claim 2 , wherein
the second circuitry is configured to perform the analysis on the state of the plurality of participants with a machine learning model applied to the at least one of the information related to the nodding or the information related to the smiling.

4 . The information analysis system of claim 1 , wherein
the communication terminal includes a plurality of communication terminals communicably connected to each other, and the second circuitry is configured to perform the analysis on the state of the plurality of participants based on the image information and the voice information transmitted from a specific one of the plurality of communication terminals used by a specific one of the plurality of participants or each of the plurality of communication terminals used by a corresponding one of the plurality of participants.

5 . The information analysis system of claim 2 , wherein
the state of the plurality of participants includes: a facial expression state detected for each of the plurality of participants based on at least one of a number of nods or a number of smiles; and a state of activity level of the plurality of participants based on the facial expression state detected for each of the plurality of participants, and wherein the second circuitry is configured to generate the state notification based on the facial expression state detected for each of the plurality of participants and the state of the activity level.

6 . The information analysis system of claim 5 , wherein
the state notification includes at least one of a chart and a comment, the chart being a result of visually representing the facial expression state detected for each of the plurality of participants and the state of the activity level, the comment being on a result of the analysis and to a specific one of the plurality of participants.

7 . The information analysis system of claim 1 , wherein
the second circuitry is further configured to store, in a memory, face image data of the plurality of participants who is to participate in the online event and an electronic mail address of each of the plurality of participants to register participant information for the online event in advance before the online event is carried out.

8 . The information analysis system of claim 1 , wherein
the second circuitry is further configured to transmit the state notification to the communication terminal.

9 . The information analysis system of claim 1 , wherein
the first circuitry is further configured to display, on the display, a notification reception selection component for selecting whether to receive a notification related to a result of the analysis after the analysis is completed.

10 . The information analysis system of claim 1 , wherein
the first circuitry is further configured to display, on the display, a disclosure permission selection component for selecting whether to permit disclosure of a result of the analysis related to one of the plurality of participants to a specific one of the plurality of participants.

11 . An information analysis method, comprising:
performing analysis on a state of a plurality of participants participating in an online event, based on image information and voice information of the plurality of participants, the image information and the voice information being transmitted from a communication terminal acquiring the image information and the voice information; and
generating, based on the analyzed state of the plurality of participants, a state notification to be displayed on the communication terminal,
wherein the method further comprises:
displaying, on a display, the state notification, the state notification being transmitted from the information analysis apparatus,
displaying, on the display, an icon for playing an explanatory video for informing each of the plurality of participants of a purpose of performing analysis on the state of the plurality of participants, and
displaying, on the display, an acquisition permission selection component for selecting whether to permit data acquisition for the analysis.

12 . A non-transitory recording medium storing a plurality of instructions which, when executed by one or more processors, causes the processors to perform a method, the method comprising:
performing analysis on a state of a plurality of participants participating in an online event, based on image information and voice information of the plurality of participants, the image information and the voice information being transmitted from a communication terminal acquiring the image information and the voice information; and
generating, based on the analyzed state of the plurality of participants, a state notification to be displayed on the communication terminal,
wherein the method further comprises:
displaying, on a display, the state notification, the state notification being transmitted from the information analysis apparatus,
displaying, on the display, an icon for playing an explanatory video for informing each of the plurality of participants of a purpose of performing analysis on the state of the plurality of participants, and
displaying, on the display, an acquisition permission selection component for selecting whether to permit data acquisition for the analysis.

Assignees

• Hagita Kentaroh
• Nagano Takuya
• Suzuki Yuuki
• Saito Ryo
• Otsuki Takashi
• Ouchida Shigeru
• Izumiya Kazuma
• Ricoh Co Ltd

Inventors

• Hagita Kentaroh
• Nagano Takuya
• Suzuki Yuuki
• Saito Ryo
• Otsuki Takashi
• Ouchida Shigeru
• Izumiya Kazuma

Classifications

• H04N7/15

  Conference systems · CPC title

• G06V40/174 Primary

  Facial expression recognition · CPC title

• G10L15/08

  Speech classification or search · CPC title

• G06T11/60

  Creating or editing images; Combining images with text · CPC title

• G06T11/26 Primary

  Drawing of charts or graphs · CPC title