Server based intelligent personal assistant services

Patent metadata

Field	Value
Publication number	US-11330100-B2
Application number	US-201815884294-A
Country	US
Kind code	B2
Filing date	Jan 30, 2018
Priority date	Jul 9, 2014
Publication date	May 10, 2022
Grant date	May 10, 2022

Abstract

Systems and methods for augmenting an appliance device with an intelligent personal assistant. Exemplary methods include: receiving, by the appliance device, an identifier for a called party; initiating a voice call using the received identifier; monitoring audio of the voice call; determining the monitored audio includes a predetermined wake word; beginning communications with the intelligent personal assistant, the communications including at least a portion of the monitored audio, the portion of the monitored audio comprising a request for the intelligent personal assistant; receiving a result from the intelligent personal assistant, the result being responsive to the request; receiving indicia that the voice call is over from at least one of the called party and a calling party; and terminating the voice call using the indicia.

First claim

What is claimed is:

1. A computing service for providing a server based intelligent personal assistant service comprising:
a VoIP service configured to:
receive a VoIP audio stream based on a call between a first party and a second party;
detect a predetermined wake word from the VoIP audio stream during the call;
access a server based intelligent personal assistant service over the Internet using a query while the call is ongoing, the query including a portion of the VoIP audio stream;
receive a result over the Internet from the server based intelligent personal assistant service, the result being responsive to the query; and
provide the result to at least one of the first or second party using a connection that provides one- or two-way communications, the connection being established by the server based intelligent personal assistant service; and

the computing service, comprising:
at least compute and storage capabilities to service at least one party, wherein the compute and storage capabilities are configured to provide the server based intelligent personal assistant service to the first and second party, the server based intelligent personal assistant service being configured to:
receive the query over the Internet from the VoIP service, the query including a portion of the VoIP audio stream;
establish the connection with at least one of the first or the second party, the connection being separate from the call maintained between the first party and the second party;
determine a request for the server based intelligent personal assistant service from the query; and
generate and provide a result by the server based intelligent personal assistant service, the result being responsive to the request.

2. The service according to claim 1 , wherein the VoIP service is configured to determine when the VoIP audio stream received an indicia that the call is over from the at least one of the first or second party.

3. The service according to claim 1 , wherein the VoIP service is integrated in a premises network.

4. The service according to claim 3 , wherein the VoIP service is integrated into a premises router.

5. The service according to claim 1 , wherein the query comprises a request for real-time information including at least one of traffic, currency exchange rate, score of a sporting event, and news.

6. The service according to claim 1 , wherein the query causes the server based intelligent personal assistant service to search at least one of a calendar of the first party, a calendar of the second party, an email account of the first party, an email account of the second party, Wikipedia articles, IMDb, television schedule, movie show times, theater show times, and restaurant hours.

7. The service of claim 1 , wherein the predetermined wake word is at least one predetermined word for activating the server based intelligent personal assistant service.

8. The service of claim 1 , wherein the server is a cloud-based server.

9. A method for providing a server based intelligent personal assistant services comprising:
receiving by a VoIP service a VoIP audio stream based on a call between a first party and a second party;
detecting by the VoIP service a predetermined wake word from the VoIP audio stream during the call;
accessing from the VoIP service a server based intelligent personal assistant service over the Internet using a query while the call is ongoing, the query including a portion of the VoIP audio stream;
receiving by the server based intelligent personal assistant service the query;
establishing by the server based intelligent personal assistant service a connection that is separate from the call, the connection providing one- or two-way communications with at least one of the first or second party;
determining a request for the server based intelligent personal assistant service from the query;
generating a result by the server based intelligent personal assistant service, the result being responsive to the request; and
providing the result to the at least one of the first or second party using the connection established by the server based intelligent personal assistant service.

10. The method of claim 9 , wherein the VoIP service is configured to determine when the VoIP audio stream received an indicia that the call is over from at least one of the first or second party.

11. The method of claim 9 , wherein the VoIP service is integrated in a premises network.

12. The method of claim 11 , wherein the VoIP service is integrated into a premises router.

13. The method of claim 9 , wherein the query comprises a request for real-time information including at least one of traffic, currency exchange rate, score of a sporting event, and news.

14. The method of claim 9 , wherein the query causes the server based intelligent personal assistant service to search at least one of a calendar of the first party, a calendar of the second party, an email account of the first resource party, an email account of the second party, Wikipedia articles, IMDb, television schedule, movie show times, theater show times, and restaurant hours.

15. The method of claim 9 , wherein the predetermined wake word is at least one predetermined word for activating the server based intelligent personal assistant service.

16. The method of claim 9 , wherein the server is a cloud-based server.

17. A system comprising:
a VoIP network device; and
a server based intelligent personal assistant device, the VoIP network device configured to:
receive a VoIP audio stream based on a call between a first party and a second party;
detect a predetermined wake word from the VoIP audio stream during the call;
access a server based intelligent personal assistant service over the Internet using a query while the call is ongoing, the query including a portion of the VoIP audio stream;
receive a result over the Internet from the server based intelligent personal assistant service, the result being responsive to the query; and
provide the result to at least one of the first or second party using a connection that allows one- or two-way communications established by the server based intelligent personal assistant service with the at least one of the first party or the second party; and

the server based intelligent personal assistant device, comprising:
at least compute and storage capabilities to service at least one party, wherein the compute and storage capabilities are configured to provide the server based intelligent personal assistant service to the first and second party, the server based intelligent personal assistant service being configured to:
receive the query over the Internet from a VoIP service, the query including a portion of the VoIP audio stream;
establish the connection allowing the one- or two-way communications with the at least one of the first or second party;
determine a request for the server based intelligent personal assistant service from the query;
generate a result by the server based intelligent personal assistant service, the result being responsive to the request; and
provide the result to the at least one of the first or second party using the connection.

18. The system of claim 17 , wherein the VoIP service is configured to determine when the VoIP audio stream received an indicia that the call is over from the at least one of the first or second party.

19. The system of claim 17 , wherein the VoIP service is integrated in a premises network.

20. The system of claim 19 , where

Assignees

• Ooma Inc

Inventors

• White Thaddeus
• Osterlund Karl
• Farrand Tobin E
• Vasudev Arvind
• Hart Douglas
• Bryan David A
• Gillon William M

Classifications

• G08C2201/31

  Voice input · CPC title

• H04L12/283

  Processing of data at an internetworking point of a home automation network · CPC title

• H04L12/281

  indicating a format for calling an appliance service function in a home automation network (for remote control or remote monitoring of applications H04L67/025) · CPC title

• H04M3/527

  Centralised call answering arrangements not requiring operator intervention · CPC title

• H04M3/42102 Primary

  Making use of the called party identifier · CPC title