Information processing device and information processing method

Patent metadata

Field	Value
Publication number	US-12147808-B2
Application number	US-201915733885-A
Country	US
Kind code	B2
Filing date	Mar 8, 2019
Priority date	Jun 7, 2018
Publication date	Nov 19, 2024
Grant date	Nov 19, 2024

Abstract

To automatically determine a more memorable macro name. Provided is an information processing device that comprises an utterance learning adaptation unit that executes clustering pertaining to a plurality of function execution instructions by a user and estimates, as a macro, a cluster that includes the plurality of function execution instructions and a response control unit that controls the presentation of information pertaining to the macro, wherein the utterance learning adaptation unit determines a name for the estimated macro on the basis of a context acquired at the time of issuing the plurality of function execution instructions included in the cluster, the response control unit controls a notification of the macro name to the user, and the plurality of function execution instructions include at least one function execution instruction issued via an utterance.

First claim

The invention claimed is:

1. An information processing device, comprising:
circuitry configured to:
capture a plurality of images of a user and a peripheral environment of the user;
recognize a plurality of states of the user and the peripheral environment based on the captured plurality of images;
execute a clustering operation on a plurality of function execution instructions of the user, wherein the plurality of function execution instructions includes at least one function execution instruction issued through an utterance of the user;
estimate, as a macro, a cluster that includes the plurality of function execution instructions, based on the recognition and the execution of the clustering operation;
automatically determine a name for the estimated macro, based on the recognition and a first context of the plurality of function execution instructions included in the cluster, wherein acquisition of the first context is at a time of issuance of the plurality of function execution instructions;
control each of a notification of the determined name and presentation of information associated with the estimated macro, to the user; and
control registration of the estimated macro in association with the determined name, wherein,
the registered macro executes in response to utterance of the determined name by the user, and
in a case where the registered macro has a degree of dependency on a second context that is different from the first context used at a time of registration, as a history of execution of the plurality of function execution instructions accumulates, the circuitry is further configured to update the name of the registered macro based on the second context.

2. The information processing device according to claim 1 , wherein the circuitry is further configured to
determine the name for the estimated macro based on the first context and content of the plurality of function execution instructions included in the cluster.

3. The information processing device according to claim 2 , wherein the circuitry is further configured to
determine the name of the estimated macro to include a gist of the first context and a gist of the plurality of function execution instructions included in the cluster.

4. The information processing device according to claim 1 , wherein the circuitry is further configured to
determine, based on a high dependency context among a plurality of acquired contexts, the name for the estimated macro.

5. The information processing device according to claim 1 , wherein, in a case where the registered macro is similar to the estimated macro, the circuitry is further configured to
determine the name for the estimated macro based on a difference between the estimated macro and the registered macro.

6. The information processing device according to claim 5 , wherein the circuitry is further configured to determine the name for the estimated macro based on
a difference in a context between the estimated macro and the registered macro, or
a difference in the plurality of function execution instructions included in the cluster of the estimated macro and the registered macro.

7. The information processing device according to claim 6 , wherein the circuitry is further configured to
determine the name for the estimated macro based on a difference in a periodic context between the estimated macro and the registered macro.

8. The information processing device according to claim 6 , wherein the circuitry is further configured to
determine the name for the estimated macro based on excessive or deficient function execution instructions between the estimated macro and the registered macro.

9. The information processing device according to claim 1 , wherein
the circuitry is further configured to revise the registered macro based on a feedback from the user, and
the feedback is with respect to a function that has been executed based on the registered macro.

10. The information processing device according to claim 9 , wherein, in a case where the user gives an instruction to revise an execution content of the function that has been executed based on the registered macro, the circuitry is further configured to create the execution content related to the function that is variable in the registered macro.

11. The information processing device according to claim 9 , wherein, in a case where the user gives an instruction to revise an execution content of the function that has been executed based on the registered macro, the circuitry is further configured to update the execution content related to the function in the registered macro.

12. The information processing device according to claim 1 , wherein
the circuitry is further configured to estimate, based on a feedback from the user, a new macro that reflects the feedback, and
the feedback is with respect to a function executed based on the registered macro.

13. The information processing device according to claim 1 , wherein the circuitry is further configured to estimate the cluster as the macro based on a degree of composition of the cluster or a detection frequency of the cluster.

14. An information processing device, comprising:
circuitry configured to:
control, in a case where a user utters a name of a registered macro, execution of a plurality of functions that corresponds to the registered macro,
capture a plurality of images of the user and a peripheral environment of the user, and
recognize a plurality of states of the user and the peripheral environment based on the captured plurality of images, wherein
the registered macro is based on the recognition and a clustering operation on a plurality of function execution instructions issued by the user,
the plurality of function execution instructions includes at least one function execution instruction issued through an utterance of the user,
the name of the registered macro is automatically determined based on the recognition and a first context of the plurality of function execution instructions,
the first context is a context acquired at a time of issuance of the plurality of function execution instructions, and
in a case where the registered macro has a degree of dependency on a second context that is different from the first context used at a time of registration, as a history of execution of the plurality of function execution instructions accumulates, the circuitry is further configured to update the name of the registered macro based on the second context.

15. The information processing device according to claim 14 , wherein, in a case where the first context which is used to determine the name of the registered macro matches a context which is acquired at a point the user makes an utterance for instruction to execute the registered macro, the circuitry is further configured to
cause execution of the plurality of functions corresponding to the registered macro, even in a case where the user has made an utterance with omission of a context wording contained in the name of the registered macro.

16. The information processing device according to claim 14 , wherein the circuitry is further configured to control display of an utterance guide that supports execution of the registered macro by the user.

17. The information processing device according to claim 16 , wherein the circuitry is further configured to control display of the utterance guide in a case where an intention of an utterance by the user matches at least one of a plurality of intentions defined for the registered macro.

18. An information p

Assignees

• Sony Corp

Inventors

• Iwase Hiro
• Taki Yuhei
• Sawai Kunihito

Classifications

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L15/063

  Training · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/165

  Management of the audio stream, e.g. setting of volume, audio stream path · CPC title