Voice recognition query response systems and methods for generating query responses using information from a vehicle

Patent metadata

Field	Value
Publication number	US-9626966-B2
Application number	US-201414575790-A
Country	US
Kind code	B2
Filing date	Dec 18, 2014
Priority date	Dec 18, 2013
Publication date	Apr 18, 2017
Grant date	Apr 18, 2017

Abstract

Embodiments are disclosed for an in-vehicle computing system comprising a communication interface communicatively coupled to a query response server, a processor, and a storage device. The storage device configured to collect and store vehicle and user interaction data and configured to store instructions executable by the processor to receive a voice query from a user, translate the voice query into a text query, send the text query to a query response server, receive a result from the query response server, the result including one or more placeholders representing data to be retrieved from a storage device local to the head unit, replace the one or more placeholders with information from the storage device to form an updated result; and present the updated result to the user.

First claim

The invention claimed is:

1. An in-vehicle computing system of a vehicle, the in-vehicle computing system comprising:
a communication interface communicatively coupled to a query response server;
a processor; and
a storage device, the storage device configured to collect and store vehicle and user interaction data and configured to store instructions executable by the processor to:
receive a voice query from a user;
translate the voice query into a text query;
send the text query to the query response server;
receive, at the in-vehicle computing system, a result from the query response server, the result including information from the query response sever and one or more placeholders representing additional information to be retrieved from a storage device local to the in-vehicle computing system;
replace the one or more placeholders with information from the storage device to form an updated result; and
present the updated result to the user.

2. The in-vehicle computing system of claim 1 , further comprising an inter-vehicle system communication module configured to communicate with one or more vehicle systems via a Controller Area Network (CAN) bus of the vehicle, and wherein the instructions are further executable to replace the one or more placeholders with information from a sensor of the vehicle received via the CAN bus.

3. The in-vehicle computing system of claim 1 , wherein translating the voice query into a text query includes sending the voice query to a voice recognition server external to the vehicle, and wherein the result from the query response server includes predefined text in addition to the one or more placeholders representing additional text to be filled in with data retrieved from the storage device local to the in-vehicle computing system.

4. An in-vehicle computing system comprising:
a communication interface communicatively coupled to a query response server;
a processor; and
a storage device, the storage device configured to collect and store vehicle and user interaction data for a vehicle and configured to store instructions executable by the processor to:
receive a voice query from a user;
send the voice query to a voice recognition server;
receive a text query from the voice recognition server;
send the text query to the query response server;
receive, at the in-vehicle computing system, a result from the query response server, the result including information from the query response server and requesting additional information included in the vehicle and user interaction data;
send the requested additional information to the query response server;
receive an updated result from the query response server; and
present the updated result to the user.

5. The in-vehicle computing system of claim 4 , further comprising a display device and wherein presenting the updated result to the user comprises displaying the updated result to the user.

6. The in-vehicle computing system of claim 4 , wherein receiving the result from the query response server comprises receiving a result from matching the text query to one of a plurality of text queries located in one or more Artificial Intelligence Markup Language (AIML) files associated with one or more pre-defined responses.

7. The in-vehicle computing system of claim 6 , wherein the one or more pre-defined responses includes information for the text query in addition to a marker serving as a placeholder for data to be retrieved by one or more of the in-vehicle computing system and the query response server.

8. The in-vehicle computing system of claim 7 , wherein the marker is recognizable by the query response server as identifying data that is stored in a storage device that is local to the query response server.

9. The in-vehicle computing system of claim 7 , wherein the marker is recognizable by the query response server as identifying data that is stored in a storage device that is local to the in-vehicle computing system.

10. The in-vehicle computing system of claim 7 , wherein the marker is recognizable by the query response server as identifying a correlation request for correlating data in one or more of a storage device local to the query response server and a storage device local to the in-vehicle computing system.

11. A method in an in-vehicle computing system within a passenger compartment of a vehicle, the method comprising:
receiving a voice query from a user;
translating the voice query into a text query;
sending the text query to a query response server;
receiving, at the in-vehicle computing system, a result from the query response server, the result including information for the text query and one or more placeholders representing additional information for the text query to be retrieved from a storage device local to the in-vehicle computing system;
replacing the one or more placeholders with information from the storage device to form an updated result; and
presenting the updated result to the user.

12. The method of claim 11 , further comprising prompting the user for the voice query.

13. The method of claim 11 , further comprising determining if the result from the query response server is a valid result corresponding to a response to the voice query.

14. The method of claim 13 , further comprising confirming the voice query responsive to determining that the result from the query response server is not a valid result.

15. The method of claim 11 , further comprising fetching data requested by the one or more placeholders by querying a sensor identified by the one or more placeholders.

16. A method, comprising:
recording vehicle information for a vehicle onboard the vehicle;
responsive to a voice request, sending a representation of the voice request and the recorded vehicle information to a remote server;
receiving, from the remote server, a response to the voice request, the response including a marker and aggregated data from one or more other vehicles;
updating the response with additional information retrieved from onboard the vehicle responsive to the marker; and
presenting the updated response in the vehicle.

17. The method of claim 16 , wherein the updating includes performing one or more calculations according to a formula represented by the marker with the onboard vehicle data.

18. The method of claim 16 , wherein the updating includes performing one or more calculations according to a formula represented by the marker with the aggregated vehicle data, the updating performed in the vehicle.

19. The method of claim 16 wherein the representation is in the form of human readable text.

Assignees

• Harman Int Ind

Inventors

• Berndt Joshua
• Roy Tirtha
• Sieczko Michael
• Slominski Joshua
• Kant Chandra

Classifications

• G10L15/22 Primary

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title