Smart tutorial for gesture control system

Patent metadata

Field	Value
Publication number	US-2016187992-A1
Application number	US-201514874175-A
Country	US
Kind code	A1
Filing date	Oct 2, 2015
Priority date	Apr 3, 2014
Publication date	Jun 30, 2016
Grant date	—

Abstract

A method includes monitoring a plurality of system inputs, and detecting a behavioral pattern performed by a user and associated with the plurality of system inputs, When the behavioral pattern is detected, the method includes associating, in a memory, a gesture with at least one action, the at least one action being determined by the plurality of system inputs, and, upon detecting the gesture, executing the action associated with the gesture.

First claim

What is claimed is:

1 . A method, comprising:
monitoring a plurality of system inputs; detecting a behavioral pattern performed by a user and associated with the plurality of system inputs; when the behavioral pattern is detected, associating, in a memory, a gesture with at least one action, the at least one action being determined by the plurality of system inputs; and upon detecting the gesture, executing the action associated with the gesture.

2 . The method of claim 1 , including presenting the user with a plurality of options to customize the gesture.

3 . The method of claim 2 , wherein the plurality of options to customize the gesture includes presenting the user with a plurality of pre-defined gestures, the user being able to select a desired gesture from the plurality of pre-defined gestures.

4 . The method of claim 2 , further including the steps of presenting the user with a plurality of actions to associate with the gesture.

5 . The method of claim 4 , wherein the plurality of actions to associate with the gesture includes allowing a user to at least one of add and remove actions associated with the gesture.

6 . The method of claim 1 , wherein the plurality of system inputs correspond to a plurality of sub-systems.

7 . The method of claim 6 , wherein the plurality of sub-systems includes at least one of a navigation system, a phone system and a music system.

8 . The method of claim 1 , further comprising the step of instructing the system to store the gesture and associated action in a system memory.

9 . The method of claim 1 , wherein the action associated with the gesture enables a plurality of system outputs.

10 . A method for developing customized gestures in an implicit gesture control system based on user behavior, comprising:
monitoring a plurality of actions performed by a user; detecting behavioral patterns associated with the plurality of actions performed by the user; correlating a series of system outputs to the detected behavioral patterns; instructing the user to perform a suggested gesture, the suggested gesture associated with the series of system outputs; executing the series of system outputs when the user performs the suggested gesture, and instructing the user to accept or reject the executed series of system outputs associated with the suggested gesture.

11 . The method of claim 10 , wherein the user is instructed to perform a suggested gesture by an audio command.

12 . The method of claim 10 , wherein the user is instructed to perform a suggested gesture by a visual command.

13 . The method of claim 10 , wherein the user is instructed to perform a suggested gesture automatically after a behavioral pattern has been detected.

14 . A learning tutorial system, the system comprising:
a processor, the processor in communication with a plurality of sensors coupled to a vehicle; the processor being configured to perform the steps of:
monitoring a plurality of system inputs;
detecting behavioral patterns associated with the plurality of system inputs;
prompting a user to perform a gesture, the gesture associated with the detected behavioral patterns; and
executing an action associated with the gesture when the gesture is performed by the user.

15 . The system of claim 14 , wherein the processor is further configured present the user with a plurality of options to customize the gestures.

16 . The system of claim 14 , wherein the processor is in further communication with a vehicle infotainment device.

17 . The system of claim 16 , wherein the processor can accept inputs from the infotainment device indicating the plurality of options selected by a user.

18 . The system of claim 16 , wherein the system can prompt a user to perform a gesture using the infotainment device.

19 . The system of claim 14 , wherein the plurality of sensors sense the plurality of system inputs presented to a plurality of vehicle subsystems.

20 . The system of claim 14 , wherein the plurality of vehicle subsystems includes at least one of a navigation system, a phone system and a music system.

Assignees

• Honda Motor Co Ltd
• Edge 3 Technologies Inc

Inventors

• Yamamoto Stuart
• El Dokor Tarek A

Classifications

• G06F3/167

  Audio in a user interface, e.g. using voice commands for navigating, audio feedback · CPC title

• G06F3/04883

  for inputting data by handwriting, e.g. gesture or text · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title