Vehicle output based on local language/dialect

Patent metadata

Field	Value
Publication number	US-11900916-B2
Application number	US-202217896394-A
Country	US
Kind code	B2
Filing date	Aug 26, 2022
Priority date	Mar 13, 2020
Publication date	Feb 13, 2024
Grant date	Feb 13, 2024

Abstract

Described herein are systems, methods, and computer readable media for dynamically determining a language variant to use for vehicle output to a vehicle occupant based on the vehicle's location. A geographic region may include multiple sub-regions, each of which may be associated with a respective one or more language variants. As an example, a geographic region may be a state or province, and each sub-region may have one or more dialects that are spoken by individuals in that sub-region. In some cases, a particular dialect may be predominant in a given sub-region. As a vehicle traverses a travel path, it may determine its current location, which geographic sub-region includes that location, and which language variant (e.g., dialect) is predominant there. That language variant may then be selected for in-vehicle communication with a vehicle occupant. The vehicle location determination may be made at or near where the occupant entered the vehicle.

First claim

What is claimed is:

1. A computer-implemented method for selecting and presenting vehicle output in a particular language variant depending on an identity of an occupant of a vehicle, the method comprising:
determining that a first occupant has entered the vehicle at a first location;
setting an output to a first language variant corresponding to the first location;
determining that a second occupant has entered the vehicle at a second location;
changing the output to a second language variant corresponding to the second location;
receiving feedback from the first occupant or the second occupant regarding the second language variant based on sensor data; and
based on the feedback, selectively switching the output to a third language variant.

2. The computer-implemented method of claim 1 , wherein the feedback comprises an indication of positive or negative sentiment; and the selectively switching comprises, in response to the indication of negative sentiment, switching the output to the third language variant.

3. The computer-implemented method of claim 1 , wherein the selectively switching comprises, in response to the indication of positive sentiment, retaining the output as the second language variant.

4. The computer-implemented method of claim 1 , further comprising:
in response to the indication of negative sentiment, at a future occasion when the second occupant enters the vehicle at the second location from an exterior of the vehicle, setting or changing the output to the third language variant.

5. The computer-implemented method of claim 1 , wherein the feedback is based on mannerisms or body movements of the first occupant or the second occupant.

6. The computer-implemented method of claim 1 , wherein the feedback is based on audible sounds or speech of the first occupant or the second occupant.

7. The computer-implemented method of claim 1 , wherein the feedback is based on an elapsed time between the output of the second language variant and a response from the first occupant or the second occupant.

8. The computer-implemented method of claim 1 , wherein the feedback is based on a number of times the first occupant or the second occupant requests clarification of the output of the second language variant.

9. The computer-implemented method of claim 1 , wherein the second location is within an overlapping area of multiple geographic sub-regions, and the second language variant is associated with a particular geographic sub-region towards which the vehicle is moving or with a particular geographic sub-region whose center is closest to the second location.

10. A system for selecting and presenting vehicle output in a particular language variant to a vehicle occupant, the system comprising:
at least one processor; and
at least one memory storing computer-executable instructions, wherein the at least one processor is configured to access the at least one memory and execute the computer-executable instructions to:
determine that a first occupant has entered the vehicle at a first location;
set an output to a first language variant corresponding to the first location;
determine that a second occupant has entered the vehicle at a second location;
change the output to a second language variant corresponding to the second location;
receive feedback from the first occupant or the second occupant regarding the second language variant based on sensor data; and
based on the feedback, selectively switch the output to a third language variant.

11. The system of claim 10 , wherein the feedback comprises an indication of positive or negative sentiment; and the selectively switching comprises, in response to the indication of negative sentiment, switching the output to the third language variant.

12. The system of claim 10 , wherein the selectively switching comprises, in response to the indication of positive sentiment, retaining the output as the second language variant.

13. The system of claim 10 , wherein the at least one processor is configured to execute the computer-executable instructions to:
in response to the indication of negative sentiment, at a future occasion when the second occupant enters the vehicle at the second location from an exterior of the vehicle, set or change the output to the third language variant.

14. The system of claim 10 , wherein the feedback is based on mannerisms or body movements of the first occupant or the second occupant.

15. The system of claim 10 , wherein the feedback is based on audible sounds or speech of the first occupant or the second occupant.

16. The system of claim 10 , wherein the feedback is based on an elapsed time between the output of the second language variant and a response from the first occupant or the second occupant.

17. The system of claim 10 , wherein the feedback is based on a number of times the first occupant or the second occupant requests clarification of the output of the second language variant.

18. The system of claim 10 , wherein the second location is within an overlapping area of multiple geographic sub-regions, and the second language variant is associated with a particular geographic sub-region towards which the vehicle is moving or with a particular geographic sub-region whose center is closest to the second location.

Assignees

• Pony Ai Inc

Inventors

• Diehl Peter G
• Dingli Robert

Classifications

• G10L15/005 Primary

  Language recognition · CPC title

• G06F16/9537

  Spatial or temporal dependent retrieval, e.g. spatiotemporal queries · CPC title

• G10L15/1815

  Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• G10L2015/227

  of the speaker; Human-factor methodology · CPC title