Methods and Systems for Communicating Content to Connected Vehicle Users Based Detected Tone/Mood in Voice Input

Patent metadata

Field	Value
Publication number	US-2016104486-A1
Application number	US-201514949883-A
Country	US
Kind code	A1
Filing date	Nov 24, 2015
Priority date	Apr 22, 2011
Publication date	Apr 14, 2016
Grant date	—

Abstract

Methods, systems and cloud processing are provided for coordinating and processing user input provided to vehicles during use. One example is for processing voice inputs at a vehicle to identify a mood of a user and then modifying or customizing the vehicle response based on the detected mood, physical characteristic and/or physiological characteristic of the user. One example includes sending, to a cloud processing server, data from the vehicle. The vehicle includes an on-board computer for processing instructions for the vehicle and processing wireless communication to exchange data with the cloud processing server. The method then receives, at the vehicle, data for a user account to use the vehicle. The cloud processing server uses the user account to identify a user profile of a user. Then, receiving, from the cloud processing server, voice profiles for the user profile. Each voice profile is associated with a tone identifier or audio signature. The voice profiles for the user are learned from a plurality of voice inputs made to the vehicle by the user in one or more prior sessions of use of the vehicle. The method further includes receiving, by on-board computer, a voice input. For the voice input, processing, by on-board computer, the voice input to identify a voice profile that is correlated to the voice input and generating a vehicle response for the voice input. The vehicle response is moderated based on the tone identifier of the identified voice profile. In one example, the tone identifier is used to infer a mood of the user, and the moderation of the vehicle response assists in selecting a type of response by the vehicle and/or setting made to a vehicle system.

First claim

What is claimed is:

1 . A method for processing voice inputs at a vehicle, comprising,
(a) sending, to a cloud processing server, data from the vehicle, the vehicle including an on-board computer for processing instructions for the vehicle and processing wireless communication to exchange data with the cloud processing server; (b) receiving, at the vehicle, data for a user account to use the vehicle, the cloud processing server uses the user account to identify a user profile of a user; (c) receiving, from the cloud processing server, voice profiles for the user profile, each voice profile being associated with a tone identifier, the voice profiles for the user being learned from a plurality of voice inputs made to the vehicle by the user in one or more prior sessions of use of the vehicle; (d) receiving, by on-board computer, a voice input, and for the voice input,
(i) processing, by on-board computer, the voice input to identify a voice profile that is correlated to the voice input;
(ii) generating a vehicle response for the voice input, the vehicle response is moderated based on the tone identifier of the identified voice profile.

2 . The method of claim 1 , wherein the tone identifiers identify a mood of the user.

3 . The method of claim 2 , wherein the mood of the user includes one or more of a normal mood, a frustrated mood, an agitated mood, an upset mood, a hurried mood, an urgency mood, a rushed mood, a stressed mood, a calm mood, a passive mood, a sleepy mood, a happy mood, or an excited mood, or combinations of two or more thereof.

4 . The method of claim 1 , wherein the tone identifiers identify a dialect of the user.

5 . The method of claim 4 , wherein the dialect of the user includes one or more of a language dialect, a country dialect, a geographic region dialect, an age dialect, or combinations of two or more thereof.

6 . The method of claim 1 , wherein the user account is accessed using login data at the vehicle, the login data defined by credentials of the user.

7 . The method of claim 6 , wherein the login data includes one or more of a password, a wireless login code, a biometric identifier, a gesture, or a pairing between a device of the user and logic of the on-board computer.

8 . The method of claim 1 , wherein the on-board computer is configured select the vehicle response from among a plurality of alternate vehicle response for the voice input as defined by predefined mapping between the tone identifier and the plurality of alternate vehicle response.

9 . The method of claim 1 , wherein the voice profiles and associated tone identifiers are stored in storage of the cloud processing server and a copy of select ones of the voice profiles and associated tone identifiers is stored in storage of the vehicle, wherein updates to the voice profiles and tone identifiers is processed periodically or upon login by the user profile at the vehicle.

10 . A method executed by a processor of electronics of a vehicle, comprising,
receiving voice input of a user at a microphone of the vehicle to command input or request information from a voice input interface of the vehicle, the voice input interface being in communication with the microphone; analyzing the voice input of the user by electronics of the vehicle to identify a voice profile for the voice input, the voice profile being associated with a tone identifier; processing the tone identifier by electronics of the vehicle to select a vehicle response from among a plurality of vehicle responses for the voice input, the selection of the vehicle response using a mapping of tone identifiers to select ones of the plurality of vehicle responses, the mapping being customized for the user, and the mapping being stored in association with a user account on the vehicle and on storage of a cloud processing system, the vehicle having electronics for communicating with the cloud processing system for managing settings in the user account, the settings including the mapping, the electronics of the vehicle is configured to send data regarding the user responses to the cloud processing system for processing, and the mapping of tone identifiers to select ones of the plurality of vehicle responses being updated based on one or more processed user responses that are responsive to one or more of the plurality of vehicle responses returned for one or more voice inputs over time, wherein the processed user responses are analyzed by the cloud processing system to identify which of the plurality of vehicle responses should be updated in the mapping to improve the customization for the user; receiving, by the electronics of the vehicle from the cloud processing system updates to the settings for the user account, the updates to the settings including updates to the mapping based on the one or more voice inputs over time; and processing, by the electronics of the vehicle, the updates to the mapping to select a vehicle response for the voice input, the vehicle response is configured to make an operational setting for a vehicle system function on the vehicle.

11 . The method of claim 10 , wherein a plurality of voice profiles are associated with the user.

12 . The method of claim 10 , wherein receiving the voice input further includes,
capturing an audio sample of the voice input; processing the audio sample to remove ambient noise; identifying frequency and magnitude characteristics in the audio sample generating signature markers for the audio sample based on the frequency and magnitude characteristics.

13 . The method of claim 12 , wherein the analyzing of the voice input to identify voice profiles includes,
filtering the voice profiles associated with the user account of the user to find a voice profile having a threshold level of signature markers to the audio sample associated with the voice input.

14 . The method of claim 12 , wherein the tone identifiers identify a mood of the user.

15 . The method of claim 14 , wherein the mood of the user includes one or more of a normal mood, a frustrated mood, an agitated mood, an upset mood, a hurried mood, an urgency mood, a rushed mood, a stressed mood, a calm mood, a passive mood, a sleepy mood, a happy mood, an excited mood, or combinations of two or more thereof.

14 . The method of claim 10 , wherein the tone identifies when additional information is to be provided or not provided to the user based on the tone.

15 . The method of claim 14 , wherein the additional information includes advertising data, or discount data, or related information that is in addition to the requested information or instructed command found in the voice input.

16 . The method of claim 10 , wherein the voice profile use based on the tone assists in moderating when to provide additional information to the user or when to avoid providing additional information to the user.

17 . The method of claim 10 , wherein the tone identifier is associated with an audio signature.

18 . The method of claim 10 , wherein the mapping is obtained from a user's data graph that is constructed from learning.

19 . A vehicle including an on-board computer for processing voice input, comprising,
a microphone interfaced with the on-board computer; cache memory for storing a sample of audio data received from the microphone, the audio data being a voice input directed to the vehicle; and a processor of the on-board computer configured process the sample of audio data to identify markers in frequency and m

Assignees

• Penilla Angel A
• Penilla Albert S

Inventors

• Penilla Angel A
• Penilla Albert S

Classifications

• B60R16/0373

  Voice control (in general G10L) · CPC title

• H04L67/12

  specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks · CPC title

• H04L67/1097

  for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS] · CPC title

• H04L67/306

  User profiles · CPC title

• G10L25/57

  for processing of video signals · CPC title