Information processing device, information processing method, and recording medium

Patent metadata

Field	Value
Publication number	US-2024021198-A1
Application number	US-202318348190-A
Country	US
Kind code	A1
Filing date	Jul 6, 2023
Priority date	Jul 13, 2022
Publication date	Jan 18, 2024
Grant date	—

Abstract

An information processing device includes a microphone that acquires a speech signal, and at least one processor. In a case in which the processor determines a wake word is included in first recognition data derived from the speech signal, when the processor determines that control information, that is information related to a control processing, is included in second recognition data derived from the speech signal after the wake word, the processor executes a first control processing corresponding to the control information. When the processor determines that the control information is included in third recognition data derived from the speech signal acquired by the microphone during a first period after a predetermined condition related to an event that occurs after the wake word is satisfied or during execution of the first control processing, the processor executes a second control processing corresponding to the control information included in the third recognition data.

First claim

1 . An information processing device comprising:
a microphone that acquires a speech signal; and at least one processor, wherein in a case in which the processor determines that a wake word is included in first recognition data derived from the speech signal,
when the processor determines that control information, that is information related to a control processing, is included in second recognition data derived from the speech signal after the wake word, the processor executes a first control processing corresponding to the control information, and
when the processor determines that the control information is included in third recognition data derived from the speech signal acquired by the microphone during a first period after a predetermined condition related to an event that occurs after the wake word is satisfied or during execution of the first control processing, the processor executes a second control processing corresponding to the control information included in the third recognition data.

2 . The information processing device according to claim 1 , wherein when the processor determines that the control information is included in the third recognition data derived from the speech signal, the processor executes the second control processing even when the wake word is not included in the third recognition data.

3 . The information processing device according to claim 1 , wherein the predetermined condition is satisfied when the execution of the first control processing ends.

4 . The information processing device according to claim 2 , wherein
when the processor determines that a control parameter related to a control processing is included in first output information output as a result of the first control processing being executed, the processor applies the control parameter at a time of execution of the second control processing.

5 . The information processing device according to claim 4 , wherein
the processor determines whether there is relevance between information included in the first output information and information included in a parameter table, and when the processor determines that there is relevance, the processor determines that the control parameter is included in the first output information.

6 . The information processing device according to claim 1 , wherein
the processor predicts, based on the second control processing, an action of a user after the second control processing, the predetermined condition is satisfied when the execution of the first control processing ends or the predicted action is detected, and in a case in which the processor detects that the user performs the estimated action during a second period after execution of the second control processing ends, when the processor determines that the third recognition data, derived from the speech signal acquired by the microphone during the first period after detection, is included in the control information, the processor further executes a new second control processing corresponding to the control information included in the third recognition data.

7 . The information processing device according to claim 6 , wherein
the processor predicts, based on the second control processing and an action table, the action of the user, in a case in which the processor detects that the user performs the estimated action during the second period after the execution of the second control processing ends, the processor determines whether there is relevance between the control information included in the third recognition data, derived from the speech signal acquired by the microphone during the first period after detection, and information included in the action table, and when the processor determines that there is relevance, the processor executes a new second control processing corresponding to the control information included in the third recognition data.

8 . The information processing device according to claim 1 , wherein the processor outputs an elapsed amount of time from a start to an end of the first period.

9 . An information processing method for an information processing device including a microphone that acquires a speech signal, and at least one processor, the method comprising:
in a case in which the processor determines that a wake word is included in first recognition data derived from the speech signal,
when the processor determines that control information, that is information related to a control processing, is included in second recognition data derived from the speech signal after the wake word, executing, by the processor, a first control processing corresponding to the control information; and
when the processor determines that the control information is included in third recognition data derived from a speech signal acquired by the microphone during a first period after a predetermined condition related to an event that occurs after the wake word is satisfied or during execution of the first control processing, executing, by the processor, a second control processing corresponding to the control information included in the third recognition data.

10 . The information processing method according to claim 9 , wherein when the processor determines that the control information is included in the third recognition data derived from the speech signal, the processor executes the second control processing even when the wake word is not included in the third recognition data.

11 . The information processing method according to claim 9 , wherein the predetermined condition is satisfied when the execution of the first control processing ends.

12 . The information processing method according to claim 9 , wherein
when the processor determines that a control parameter related to a control processing is included in first output information output as a result of the first control processing being executed, the processor applies the control parameter at a time of execution of the second control processing.

13 . The information processing method according to claim 12 , wherein
the processor determines whether there is relevance between information included in the first output information and information included in a parameter table, and when the processor determines that there is relevance, the processor determines that the control parameter is included in the first output information.

14 . The information processing method according to claim 9 , wherein
the processor predicts, based on the second control processing, an action of a user after the second control processing, the predetermined condition is satisfied when the execution of the first control processing ends or the predicted action is detected, and in a case in which the processor detects that the user performs the estimated action during a second period after execution of the second control processing ends, when the processor determines that the third recognition data, derived from the speech signal acquired by the microphone during the first period after detection, is included in the control information, the processor further executes a new second control processing corresponding to the control information included in the third recognition data.

15 . The information processing method according to claim 14 , wherein
the processor predicts, based on the second control processing and an action table, the action of the user, in a case in which the processor detects that the user performs the estimated action during the second period after the execution of the second control processing ends, the processor determines whether there is rele

Assignees

• Casio Computer Co Ltd

Inventors

• Mizuno Kimiyasu
• Sakurai Keiichi
• Suzuki Hideo
• Nakamura Koki
• Suzuki Karen
• Yu Bing

Classifications

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• G10L2015/088

  Word spotting · CPC title

• G10L17/24 Primary

  the user being prompted to utter a password or a predefined phrase · CPC title

• G10L15/30

  Distributed recognition, e.g. in client-server systems, for mobile phones or network applications · CPC title