Smart tutorial that learns and adapts

Patent metadata

Field	Value
Publication number	US-10083620-B2
Application number	US-201615224378-A
Country	US
Kind code	B2
Filing date	Jul 29, 2016
Priority date	Jul 29, 2016
Publication date	Sep 25, 2018
Grant date	Sep 25, 2018

Abstract

Methods, apparatuses, and non-transitory computer readable storage media for a smart tutorial that adapts are described. The smart tutorial may assist in the operation of a vehicle including generating a situational profile that includes driver identity data, vehicle state data, or extra-vehicular state data. The situational profile is compared to assistance profiles that include aggregate identity data, aggregate vehicular state data, or aggregate extra-vehicular state data. The assistance profiles correspond to assistance instructions. Based on the comparison, similarity values corresponding to the assistance profiles are generated based on the comparison between the situational profile and the assistance profiles. The greatest similarity value corresponds to the assistance profile that is most similar to the situational profile. In response to the usage frequency value exceeding a usage frequency threshold value, the assistance instruction that corresponds to the assistance profile that is most similar to the situational profile may be selected.

First claim

What is claimed is:

1. A method of providing a smart tutorial for operation of a vehicle, the method comprising:
generating, by a processor, a situational profile including driver identity data, vehicle state data, or extra-vehicular state data, wherein the driver identity data includes a plurality of usage frequency values corresponding to a plurality of assistance instructions, the vehicle state data is based on vehicle control states for a vehicle, and the extra-vehicular state data is based on extra-vehicular object states corresponding to one or more extra-vehicular objects;
comparing, by the processor, the situational profile to a plurality of assistance profiles including aggregate identity data corresponding to the driver identity data, aggregate vehicular state data corresponding to the vehicular data, or aggregate extra-vehicular state data corresponding to the extra-vehicular data, wherein the plurality of assistance profiles corresponds to the plurality of assistance instructions;
generating, by the processor, based on the comparison between the situational profile and the plurality of assistance profiles, a plurality of similarity values corresponding to the plurality of assistance profiles, wherein a greatest similarity value of the plurality of similarity values corresponds to the assistance profile of the plurality of assistance profiles that is most similar to the situational profile and to the usage frequency value of the plurality of usage frequency values that corresponds to the assistance profile; and
in response to the usage frequency value exceeding a usage frequency threshold value, selecting, by the processor, the assistance instruction of the plurality of assistance instructions that corresponds to the assistance profile that is most similar to the situational profile, wherein the assistance instruction is associated with one or more control system inputs for changing the vehicle control states.

2. The method of claim 1 , further comprising:
generating, by the processor, an assistance indication based on the assistance instruction, wherein the assistance indication includes an audible indication, a visual indication, or a haptic indication.

3. The method of claim 1 , further comprising:
activating, by the processor, in response to the driver identity data indicating autonomous systems control, the one or more control system inputs to change the vehicle control states in accordance with the selected one of the plurality of assistance instructions.

4. The method of claim 2 , further comprising:
detecting, by the processor, a feedback input that activates one or more control system inputs;
determining, by the processor, when the feedback input is in accordance with the assistance indication;
in response to the feedback input being in accordance with the assistance instruction, converting, by the processor, the situational profile into a format that corresponds to the plurality of assistance profiles; and
adding, by the processor, the situational profile to the plurality of assistance profiles.

5. The method of claim 4 , wherein the determining that the feedback input is in accordance with the assistance instruction is based at least in part on the feedback input occurring before a predetermined time period has elapsed.

6. The method of claim 4 , further comprising:
modifying, by the processor, the driver identity data based on the feedback input; and
increasing, by the processor, the usage frequency threshold value in response to the feedback input being in accordance with the assistance instruction.

7. The method of claim 1 , further comprising:
obtaining, by the processor, from one or more remote computing devices, an adversity status value associated with geographical condition data, weather forecast data, traffic condition data, traffic incident data, or vehicle transportation network data; and
modifying, by the processor, the usage frequency threshold value based on the adversity status value, wherein the modifying includes increasing or decreasing the usage frequency threshold value based on the adversity status value.

8. The method of claim 1 , further comprising:
determining, by the processor, a vehicle path for the vehicle, and extra-vehicular paths for the extra-vehicular objects, wherein the extra-vehicular paths are based on an extra-vehicular velocity and extra-vehicular orientation of the extra-vehicular objects, and the vehicle path is based on a vehicle velocity and vehicle orientation of the vehicle;
determining, by the processor, when the vehicle path will intercept at least one of the extra-vehicular paths; and
delaying, by the processor, the selecting the assistance instruction until after the vehicle path has been adjusted to avoid the extra-vehicular paths by changing the vehicle velocity or the vehicle orientation.

9. The method of claim 1 , wherein the plurality of assistance instructions includes an instruction to activate the one or more control system inputs or deactivate the one or more control system inputs, the one or more control system inputs including autonomous driving inputs, intelligent cruise control inputs, predictive forward collision warning inputs, lane departure prevention inputs, intelligent braking assist, or blind spot warning inputs.

10. An apparatus for operating a smart tutorial in a vehicle, the apparatus comprising:
a non-transitory memory; and
a processor configured to execute instructions stored in the non-transitory memory to:
generate a situational profile including driver identity data, vehicle state data, or extra-vehicular state data, wherein the driver identity data includes a plurality of usage frequency values corresponding to a plurality of assistance instructions, the vehicle state data is based on vehicle control states for a vehicle, and the extra-vehicular state data is based on extra-vehicular object states corresponding to one or more extra-vehicular objects;
compare the situational profile to a plurality of assistance profiles including aggregate identity data corresponding to the driver identity data, aggregate vehicular state data corresponding to the vehicular data, or aggregate extra-vehicular state data corresponding to the extra-vehicular data, wherein the plurality of assistance profiles corresponds to the plurality of assistance instructions;
generate based on the comparison between the situational profile and the plurality of assistance profiles, a plurality of similarity values corresponding to the plurality of assistance profiles, wherein a greatest similarity value of the plurality of similarity values corresponds to the assistance profile of the plurality of assistance profiles that is most similar to the situational profile and to the usage frequency value of the plurality of usage frequency values that corresponds to the assistance profile; and
in response to the usage frequency value exceeding a usage frequency threshold value, select the assistance instruction of the plurality of assistance instructions that corresponds to the assistance profile that is most similar to the situational profile, wherein the assistance instruction is associated with one or more control system inputs for changing the vehicle control states.

11. The apparatus of claim 10 , wherein the processor is further configured to execute instructions stored in the non-transitory memory to:
generate an assistance indication based on the assistance instruction, wherein the assistance indication includes an audible indication, a visual indication, or a haptic indication.

12. The apparatus of claim 10 , wherein the processor is further configured to execute instructions stored in the

Assignees

• Nissan North America Inc
• Renault Sas

Inventors

• Nishijima David M
• Cordesses Lionel
• Hougard Simon

Classifications

• G09B9/042 Primary

  providing simulation in a real vehicle (G09B9/052, G09B9/058 take precedence) · CPC title

• H04N7/18

  Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast · CPC title

• H04W4/90

  Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS] · CPC title

• G09B19/167

  Control of land vehicles · CPC title

• B60R21/0134

  responsive to imminent contact with an obstacle {, e.g. using radar systems} · CPC title