Vehicle function control with sensor based validation

Patent metadata

Field	Value
Publication number	US-2025037716-A1
Application number	US-202418914823-A
Country	US
Kind code	A1
Filing date	Oct 14, 2024
Priority date	Oct 3, 2017
Publication date	Jan 30, 2025
Grant date	—

Abstract

The present disclosure is generally related to a data processing system to validate vehicular functions in a voice activated computer network environment. The data processing system can improve the efficiency of the network by discarding action data structures and requests that invalid prior to their transmission across the network. The system can invalidate requests by comparing attributes of a vehicular state to attributes of a request state.

First claim

What is claimed:

1 . A method implemented by one or more processors, the method comprising:
receiving user input from a user located in a vehicle, the user input being received by a vehicle computing device of the vehicle; determining, based on sensor data generated by one or more sensors of the vehicle, a vehicle state of the vehicle; generating, based on the user input received from the user located in the vehicle and based on the vehicle state of the vehicle, an action data structure; transmitting, to a data processing system and via an application programming interface (API), the action data structure, wherein transmitting the action data structure to the data processing system causes the data processing system to:
generate response data based on processing the action data structure; and
transmit, to the vehicle computing device via the API, the response data; and
causing the vehicle computing device to provide content, that is based on the response data and that is responsive to the user input, for presentation to the user.

2 . The method of claim 1 , wherein the user input is an audio input query, and wherein the action data structure is generated based on the audio input query.

3 . The method of claim 1 , wherein the response data that is generated by the data processing system and based on processing the action data structure is one or more of: audio-based, text-based, video-based, or image based.

4 . The method of claim 3 , wherein the response data is audio-based, and wherein causing the vehicle computing device to provide the content, that is based on the response data and that is responsive to the user input, for presentation to the user comprises:
causing the content to be audibly rendered via one or more speaker of the vehicle computing device of the vehicle.

5 . The method of claim 3 , wherein the response data is text-based, video-based, or image based, and wherein causing the vehicle computing device to provide the content, that is based on the response data and that is responsive to the user input, for presentation to the user comprises:
causing the content to be audibly rendered via a display of the vehicle computing device of the vehicle.

6 . The method of claim 1 , wherein transmitting the action data structure to the data processing system further causes the data processing system to:
obtain, from a data provider and via the API, additional data, wherein generating the response data is further based on processing, along with the action data structure, the additional data.

7 . The method of claim 6 , wherein the additional data comprises or more of: location data associated with a location of the vehicle, or weather data associated with the location of the vehicle.

8 . A system comprising:
at least one processor; and memory storing instructions that, when executed, cause the at least one processor to be operable to:
receive user input from a user located in a vehicle, the user input being received by a vehicle computing device of the vehicle;
determine, based on sensor data generated by one or more sensors of the vehicle, a vehicle state of the vehicle;
generate, based on the user input received from the user located in the vehicle and based on the vehicle state of the vehicle, an action data structure;
transmit, to a data processing system and via an application programming interface (API), the action data structure, wherein transmitting the action data structure to the data processing system causes the data processing system to:
generate response data based on processing the action data structure; and

transmit, to the vehicle computing device via the API, the response data; and
cause the vehicle computing device to provide content, that is based on the response data and that is responsive to the user input, for presentation to the user.

9 . The system of claim 8 , wherein the user input is an audio input query, and wherein the action data structure is generated based on the audio input query.

10 . The system of claim 8 , wherein the response data that is generated by the data processing system and based on processing the action data structure is one or more of: audio-based, text-based, video-based, or image based.

11 . The system of claim 10 , wherein the response data is audio-based, and wherein the instructions to cause the vehicle computing device to provide the content, that is based on the response data and that is responsive to the user input, for presentation to the user comprise instructions to:
cause the content to be audibly rendered via one or more speaker of the vehicle computing device of the vehicle.

12 . The system of claim 10 , wherein the response data is text-based, video-based, or image based, and wherein the instructions to cause the vehicle computing device to provide the content, that is based on the response data and that is responsive to the user input, for presentation to the user comprise instructions to:
cause the content to be audibly rendered via a display of the vehicle computing device of the vehicle.

13 . The system of claim 8 , wherein transmitting the action data structure to the data processing system further causes the data processing system to:
obtain, from a data provider and via the API, additional data, wherein generating the response data is further based on processing, along with the action data structure, the additional data.

14 . The system of claim 13 , wherein the additional data comprises or more of: location data associated with a location of the vehicle, or weather data associated with the location of the vehicle.

15 . A non-transitory computer-readable storage medium storing instructions that, when executed by at least one processor, cause the at least one processor to be operable to:
receive user input from a user located in a vehicle, the user input being received by a vehicle computing device of the vehicle; determine, based on sensor data generated by one or more sensors of the vehicle, a vehicle state of the vehicle; generate, based on the user input received from the user located in the vehicle and based on the vehicle state of the vehicle, an action data structure; transmit, to a data processing system and via an application programming interface (API), the action data structure, wherein transmitting the action data structure to the data processing system causes the data processing system to:
generate response data based on processing the action data structure; and
transmit, to the vehicle computing device via the API, the response data; and
cause the vehicle computing device to provide content, that is based on the response data and that is responsive to the user input, for presentation to the user.

16 . The non-transitory computer-readable storage medium of claim 15 , wherein the user input is an audio input query, and wherein the action data structure is generated based on the audio input query.

17 . The non-transitory computer-readable storage medium of claim 15 , wherein the response data that is generated by the data processing system and based on processing the action data structure is one or more of: audio-based, text-based, video-based, or image based.

18 . The non-transitory computer-readable storage medium of claim 17 , wherein the response data is audio-based, and wherein, in causing the vehicle computing device to provide the content, that is based on the response data and that is responsive to the user input, for presentation to the user, the at least one processor is operable to:
cause t

Assignees

• Google Llc

Inventors

• Ramic Haris
• Aggarwal Vikram
• Gali Moises Morgenstern
• Schairer David Roy
• Chen Yao

Classifications

• G10L15/26

  Speech to text systems (G10L15/08 takes precedence) · CPC title

• B60W50/087

  where the control system corrects or modifies a request from the driver · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G10L2015/223

  Execution procedure of a spoken command · CPC title

• B60Y2400/30

  Sensors · CPC title