Multiple skills processing

Patent metadata

Field	Value
Publication number	US-2023115420-A1
Application number	US-202217945320-A
Country	US
Kind code	A1
Filing date	Sep 15, 2022
Priority date	Mar 6, 2019
Publication date	Apr 13, 2023
Grant date	—

Abstract

Described herein is a system for enabling a user to perform complex goals using multiple skills/applications of an intelligent assistant device. Skills may register as consumers of an action or providers of an action, and the consumer skills may be configured to invoke provider skills to perform actions. The system receives a request to perform an action from a skill along with some action data. The system validates the action data, selects another skill to perform the action, and forwards the request to the selected skill to perform the action.

First claim

1 .- 20 . (canceled)

21 . A computer-implemented method, comprising:
receiving first data to enable a first application capable of performing a first action to request performance of a second action that is performable by at least one other application different than the first application; after receiving the first data, receiving input data; determining, using the input data, that the first action is to be performed using the first application; sending, to the first application, a first request to perform the first action; receiving, from the first application and after sending the first request, a second request to perform the second action, the second action being determined by the first application; determining, using the first data, that the first application is authorized to request performance of the second action; determining a second application is capable of performing the second action; and sending, to the second application, a third request to perform the second action.

22 . The computer-implemented method of claim 21 , further comprising:
receiving the first data from the first application.

23 . The computer-implemented method of claim 21 , further comprising:
determining a user profile associated with the input data; and determining, based at least in part on the user profile, that the first application is permitted to execute with respect to the input data.

24 . The computer-implemented method of claim 21 , further comprising:
detecting, by a first device, a user input corresponding to the input data; executing, by the first device, the first application; and executing, by the first device, the second application.

25 . The computer-implemented method of claim 21 , further comprising:
receiving a user input corresponding to an indication for the first application to be permitted to request performance of the second action; and based at least in part on the user input, determining the first data.

26 . The computer-implemented method of claim 21 , further comprising:
after receiving the input data and prior to sending the third request, determining that second data is required to perform the second action by the second application; and generating output data requesting the second data from a user device.

27 . The computer-implemented method of claim 21 , further comprising:
processing, by a first component, the second request and stored data to determine the second action, wherein the stored data indicates which of a plurality of applications are associated with which of a plurality of actions.

28 . The computer-implemented method of claim 21 , further comprising:
determining, by the first application, second data corresponding to execution of the second action; and sending, from the first application to the second application, the second data.

29 . The computer-implemented method of claim 21 , further comprising:
determining, by the first application, second data corresponding to execution of the second action by the second application; and causing a user device to display an output corresponding to the second data.

30 . The computer-implemented method of claim 21 , further comprising:
receiving audio data corresponding to an utterance; and performing speech processing on the audio data to determine the input data.

31 . A system comprising:
at least one processor; and at least one memory comprising instructions that, when executed by the at least one processor, cause the system to:
receive first data to enable a first application capable of performing a first action to request performance of a second action that is performable by at least one other application different than the first application;
after receipt of the first data, receiving input data;
determine, using the input data, that the first action is to be performed using the first application;
send, to the first application, a first request to perform the first action;
receive, from the first application and after sending the first request, a second request to perform the second action, the second action being determined by the first application;
determine, using the first data, that the first application is authorized to request performance of the second action;
determine a second application is capable of performing the second action; and
send, to the second application, a third request to perform the second action.

32 . The system of claim 31 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
receive the first data from the first application.

33 . The system of claim 31 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
determine a user profile associated with the input data; and determine, based at least in part on the user profile, that the first application is permitted to execute with respect to the input data.

34 . The system of claim 31 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
detecting, by a first device, a user input corresponding to the input data; execute, by the first device, the first application; and execute, by the first device, the second application.

35 . The system of claim 31 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
receive a user input corresponding to an indication for the first application to be permitted to request performance of the second action; and based at least in part on the user input, determine the first data.

36 . The system of claim 31 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
after receipt of the input data and prior to sending the third request, determine that second data is required to perform the second action by the second application; and generate output data requesting the second data from a user device.

37 . The system of claim 31 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
process, by a first component, the second request and stored data to determine the second action, wherein the stored data indicates which of a plurality of applications are associated with which of a plurality of actions.

38 . The system of claim 31 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
determine, by the first application, second data corresponding to execution of the second action; and send, from the first application to the second application, the second data.

39 . The system of claim 31 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
determine, by the first application, second data corresponding to execution of the second action by the second application; and cause a user device to display an output corresponding to the second data.

40 . The system of claim 31 , wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:
re

Assignees

• Amazon Tech Inc

Inventors

• Dabas Rohin
• Schuring Troy Dean
• Tonge Rashmi
• Montgomery Michael James
• Singh Kevindra Pal
• Baran Adam
• Thomas David
• Okwara Nnenna Eleanya

Classifications

• G10L15/30

  Distributed recognition, e.g. in client-server systems, for mobile phones or network applications · CPC title

• G06F3/167 Primary

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L15/1815

  Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title