Smart tutorial for gesture control system

Patent metadata

Field	Value
Publication number	US-11243613-B2
Application number	US-201916525302-A
Country	US
Kind code	B2
Filing date	Jul 29, 2019
Priority date	Apr 3, 2014
Publication date	Feb 8, 2022
Grant date	Feb 8, 2022

Abstract

A method includes monitoring a plurality of system inputs, and detecting a behavioral pattern performed by a user and associated with the plurality of system inputs, When the behavioral pattern is detected, the method includes associating, in a memory, a gesture with at least one action, the at least one action being determined by the plurality of system inputs, and, upon detecting the gesture, executing the action associated with the gesture.

First claim

What is claimed is:

1. A method, comprising:
monitoring a plurality of system inputs;
detecting a behavioral pattern performed by a user and associated with the plurality of system inputs;
when the behavioral pattern is detected, associating, in a memory, a gesture with at least one action, the at least one action being determined by the plurality of system inputs, wherein the action associated with the gesture enables a plurality of system outputs;
monitoring a subsequent input, wherein the subsequent input is associated with a contradictory vehicle output canceling one of the plurality of system outputs;
determining whether the subsequent input is associated with a negative driving behavior; and
initiating a self-healing action based on the subsequent input being associated with the contradictory vehicle output and based on whether the subsequent input is associated with the negative driving behavior, wherein the self-healing action is associated with a desired vehicle output.

2. The method of claim 1 , including presenting the user with a plurality of options to customize the gesture.

3. The method of claim 2 , wherein the plurality of options to customize the gesture includes presenting the user with a plurality of pre-defined gestures, the user being able to select a desired gesture from the plurality of pre-defined gestures.

4. The method of claim 2 , further including the steps of presenting the user with a plurality of actions to associate with the gesture.

5. The method of claim 4 , wherein the plurality of actions to associate with the gesture includes allowing the user to at least one of add and remove actions associated with the gesture.

6. The method of claim 1 , wherein the plurality of system inputs correspond to a plurality of sub-systems.

7. The method of claim 1 , comprising initiating the self-healing action based on a Markovian process.

8. The method of claim 1 , comprising initiating the self-healing action based on a threshold number of subsequent inputs being associated with the contradictory vehicle output canceling one of the plurality of system outputs.

9. The method of claim 1 , comprising initiating the self-healing action based on a time of day or a percentage of time that the contradictory vehicle output is detected.

10. A method for developing customized gestures in an implicit gesture control system based on user behavior, comprising:
monitoring a plurality of actions performed by a user;
detecting behavioral patterns associated with the plurality of actions performed by the user;
correlating a series of system outputs to the detected behavioral patterns;
instructing the user to perform a suggested gesture, the suggested gesture associated with the series of system outputs;
executing the series of system outputs when the user performs the suggested gesture;
instructing the user to accept or reject the executed series of system outputs associated with the suggested gesture;
determining whether the suggested gesture is associated with a negative driving behavior; and
initiating a self-healing action when the user rejects the executed series of system outputs associated with the suggested gesture, the self-healing action based on a subsequent input associated with a contradictory output canceling one of the executed series of system outputs and based on whether the suggested gesture is associated with the negative driving behavior, wherein the self-healing action is associated with a desired vehicle output.

11. The method of claim 10 , wherein the user is instructed to perform the suggested gesture by an audio command.

12. The method of claim 10 , wherein the user is instructed to perform the suggested gesture by a visual command.

13. The method of claim 10 , wherein the user is instructed to perform the suggested gesture automatically after a behavioral pattern has been detected.

14. A learning tutorial system, the system comprising:
a processor, the processor in communication with a plurality of sensors coupled to a vehicle;
the processor being configured to perform the steps of:
monitoring a plurality of system inputs;
detecting behavioral patterns associated with the plurality of system inputs;
prompting a user to perform a gesture, the gesture associated with the detected behavioral patterns, wherein the gesture enables a system output;
determining whether the subsequent input is associated with a negative driving behavior;
monitoring a subsequent input, wherein the subsequent input is associated with a contradictory output canceling one of the system output; and
initiating a self-healing action based on the subsequent input being associated with the contradictory output and based on whether the subsequent input is associated with the negative driving behavior, wherein the self-healing action is associated with a desired vehicle output.

15. The system of claim 14 , wherein the processor is further configured present the user with a plurality of options to customize the gestures.

16. The system of claim 14 , wherein the processor is in further communication with a vehicle infotainment device.

17. The system of claim 16 , wherein the processor can accept inputs from the infotainment device indicating the plurality of options selected by the user.

18. The system of claim 14 , comprising initiating the self-healing action based on a Markovian process.

19. The system of claim 14 , comprising initiating the self-healing action based on a threshold number of subsequent inputs being associated with the contradictory output canceling one of the system output.

20. The system of claim 14 , comprising initiating the self-healing action based on a time of day or a percentage of time that the contradictory output is detected.

Assignees

• Honda Motor Co Ltd
• Edge 3 Tech Llc

Inventors

• Yamamoto Stuart Masakazu
• El Dokor Tarek A

Classifications

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06V40/113

  Recognition of static hand signs · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title