Providing virtual personal assistance with multiple VPA applications

Patent metadata

Field	Value
Publication number	US-11508376-B2
Application number	US-201816234356-A
Country	US
Kind code	B2
Filing date	Dec 27, 2018
Priority date	Apr 16, 2013
Publication date	Nov 22, 2022
Grant date	Nov 22, 2022

Abstract

The activities of multiple virtual personal assistant (VPA) applications are coordinated. For example, different portions of a conversational natural language dialog involving a user and a computing device may be handled by different VPAs.

First claim

The invention claimed is:

1. A method, comprising:
receiving an input from a first virtual assistant application of a first device;
using the input, identifying a second virtual assistant application;
determining pairing data;
transmitting the pairing data to the first virtual assistant application for the first virtual assistant application to establish a communicative coupling between the first virtual assistant application and the second virtual assistant application;
wherein the second virtual assistant application is to, in response to the input, generate an output intent or cause a second device to present output;
wherein the method is performed by one or more computing devices.

2. The method of claim 1 , wherein the input comprises any one or more of the following: a dialog request message, an input intent, a text string, natural language dialog, a network address, a device identifier.

3. The method of claim 1 , wherein the pairing data is usable to establish the communicative coupling using any one or more of the following: a cellular network, a telephone network, a local area network, a wide area network, a public network, the Internet, a short-range wireless network, a Wi-Fi connection, a near-field communication (NFC) connection, an optical communication connection, a BLUETOOTH connection.

4. The method of claim 1 , wherein the first virtual assistant application is a general-purpose application and the second virtual assistant application is a domain-specific application or the first virtual assistant application is a first domain-specific virtual assistant application and the second virtual assistant application is a second domain-specific virtual assistant application.

5. The method of claim 1 , comprising, in response to the input, enabling access, by the first virtual assistant application, to a domain-specific model or a user preference model or a domain-specific task flow or user preference task flow.

6. The method of claim 1 , wherein the communicative coupling comprises a direct communication connection between the first virtual assistant application and the second virtual assistant application or a communicative coupling of more than two virtual assistant applications.

7. The method of claim 1 , wherein the input is received from the first virtual assistant application and the pairing data is transmitted to the first virtual assistant application using an application program interface (API).

8. The method of claim 1 , comprising executing a communication protocol over the communicative coupling and monitoring communications between the first virtual assistant application and the second virtual assistant application using the communication protocol.

9. The method of claim 1 , comprising any one or more of the following: determining the second virtual assistant application by querying a directory service, adding a new virtual assistant application to the directory service, removing a virtual assistant application from the directory service, generating statistics relating to activity levels of virtual assistant applications that are registered with the directory service.

10. The method of claim 1 , wherein the first and second virtual assistant applications comprise, individually or in combination, any one or more of the following: an e-commerce application, a website, a user-personal virtual assistant application, a device-based virtual assistant application, a hierarchical network of virtual assistants, a home-based virtual assistant application, a heating, ventilation and cooling (HVAC) virtual assistant application, a single-user virtual assistant application, a multiple-user virtual assistant application, a single domain virtual assistant application, a multiple-domain virtual assistant application, a military virtual assistant application, a business virtual assistant application, a family virtual assistant application, a social virtual assistant application, an entertainment virtual assistant application.

11. A computer-program product embodied in one or more non-transitory machine-readable storage medium, including instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:
receiving an input from a first virtual assistant application of a first device;
using the input, identifying a second virtual assistant application;
determining pairing data;
transmitting the pairing data to the first virtual assistant application for the first virtual assistant application to establish a communicative coupling between the first virtual assistant application and the second virtual assistant application;
wherein the second virtual assistant application is to, in response to the input, generate an output intent or cause a second device to present output.

12. The computer-program product of claim 11 , wherein the input comprises any one or more of the following: a dialog request message, an input intent, a text string, natural language dialog, a network address, a device identifier.

13. The computer-program product of claim 11 , wherein the pairing data is usable to establish the communicative coupling using any one or more of the following: a cellular network, a telephone network, a local area network, a wide area network, a public network, the Internet, a short-range wireless network, a Wi-Fi connection, a near-field communication (NFC) connection, an optical communication connection, a BLUETOOTH connection.

14. The computer-program product of claim 11 , wherein the first virtual assistant application is a general-purpose application and the second virtual assistant application is a domain-specific application or the first virtual assistant application is a first domain-specific virtual assistant application and the second virtual assistant application is a second domain-specific virtual assistant application.

15. The computer-program product of claim 11 , wherein the instructions, when executed by one or more processors, cause the one or more processors to perform operations comprising, in response to the input, enabling access, by the first virtual assistant application, to a domain-specific model or a user preference model or a domain-specific task flow or user preference task flow.

16. The computer-program product of claim 11 , wherein the communicative coupling comprises a direct communication connection between the first virtual assistant application and the second virtual assistant application or a communicative coupling of more than two virtual assistant applications.

17. The computer-program product of claim 11 , wherein the input is received from the first virtual assistant application and the pairing data is transmitted to the first virtual assistant application using an application program interface (API).

18. The computer-program product of claim 11 , wherein the instructions, when executed by one or more processors, cause the one or more processors to perform operations comprising executing a communication protocol over the communicative coupling and monitoring communications between the first virtual assistant application and the second virtual assistant application using the communication protocol.

19. The computer-program product of claim 11 , wherein the instructions, when executed by one or more processors, cause the one or more processors to perform operations comprising any one or more of the following: determining the second virtual assistant application by querying a directory service, adding a new virtual assistant application to the direct

Assignees

• Stanford Res Inst Int

Inventors

• Nitz Kenneth C
• Lincoln Patrick D

Classifications

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L15/30 Primary

  Distributed recognition, e.g. in client-server systems, for mobile phones or network applications · CPC title

• G06Q30/06

  Buying, selling or leasing transactions · CPC title

• G10L15/1822 Primary

  Parsing for meaning understanding · CPC title

• G10L15/32

  Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems · CPC title