Display device and operating method thereof

Patent metadata

Field	Value
Publication number	US-9436290-B2
Application number	US-201414457951-A
Country	US
Kind code	B2
Filing date	Aug 12, 2014
Priority date	Mar 27, 2014
Publication date	Sep 6, 2016
Grant date	Sep 6, 2016

Abstract

A method of controlling a display device, and which includes obtaining, via camera of the display device, a user's image; recognizing, via a controller of the display device, a user's hand gesture from the obtained user's image; and when the recognized user's hand gesture does not match a pre-stored gesture, displaying, via a display of the display device, a function guide including different hand gestures different than the recognized user's hand gesture for guiding a user's selection for performing a function of the display device.

First claim

What is claimed is:

1. A method of controlling a display device, the method comprising:
obtaining, via a camera of the display device, a user's image;
recognizing, via a controller of the display device, a user's hand gesture from the obtained user's image; and
if the recognized user's hand gesture does not match a pre-stored gesture, displaying, via a display of the display device, a function guide including different hand gestures different than the recognized user's hand gesture for guiding a user's selection for performing a function of the display device,
wherein the different hand gestures include a plurality of similar hand gestures representing a gesture pattern similar to the recognized user's hand gesture,
wherein the function guide comprises:
an image of the recognized user's hand gesture; and
a plurality of images of the different hand gestures,
wherein the images of the different hand gestures are disposed around the image of the recognized user's hand gesture,
wherein the method further comprises:
recognizing, by using the obtained user's image, that the user's hand is moved toward a direction where one image corresponding to a different hand gesture among the plurality of images of the different hand gestures is disposed,
selecting the image of a different hand gesture corresponding to the direction based on a recognition result, and
performing a function of the display device corresponding to the selected image of the different hand gesture, and
wherein the function of the display device represents a function related to an edition or a play of a media content.

2. The method according to claim 1 , wherein each of the images of the different hand gestures is disposed at the top, bottom, left, and right of the image of the recognized user's hand gesture.

3. The method according to claim 2 , wherein the function guide further comprises a plurality of function inducers disposed between the image of the recognized hand gesture and the images of each of the different hand gestures and inducing a user's selection to perform a function corresponding to each of the different hand gestures.

4. The method according to claim 3 , wherein the function guide further comprises a plurality of similarity indicators representing a degree of similarity between each of the different hand gestures and the recognized user's hand gesture.

5. The method according to claim 4 , further comprising:
obtaining an input for selecting a specific different hand gesture from the different hand gestures; and
performing a function of the display device corresponding to the selected specific different hand gesture.

6. The method according to claim 5 , wherein the obtaining of the input for selecting the specific different hand gesture comprises obtaining an input for selecting the specific different hand gesture by detecting a movement direction of the user's hand.

7. The method according to claim 1 , wherein the function guide comprises:
images of a plurality of basic hand gestures representing a basic gesture pattern pre-specified or predetermined by the user; and
text disposed at one side of each image of the basic hand gestures and representing a function of each of the plurality of basic hand gestures, and
wherein each image of the basic hand gestures is disposed around the image of the recognized user's hand gesture.

8. The method according to claim 1 , further comprising recognizing the user's face from the obtained user's image,
wherein the displaying of the function guide comprises, when the recognized user's hand gesture is not the pre-stored gesture, displaying the function guide based on a position relationship of the recognized user's face and the recognized user's hand gesture.

9. The method according to claim 8 , wherein when the recognized user's hand gesture is not the pre-stored gesture, the displaying of the function guide based on the position relationship of the recognized user's face and the recognized user's hand gesture comprises:
detecting whether the recognized user's hand gesture is disposed at the right or left based on the user's face; and
displaying the function guide based on a detection result,
wherein the function guide comprises:
images of a plurality of similar hand gestures representing a gesture pattern similar to the recognized user's hand gesture; and
text disposed at one side of each image of the plurality of similar hand gestures and representing a function of each of the plurality of similar hand gestures, and
wherein each image of the plurality of similar hand gestures is disposed around the recognized user's hand gesture.

10. The method according to claim 8 , wherein when the recognized user's hand gesture is not the pre-stored gesture, the displaying of the function guide based on the position relationship of the recognized user's face and the recognized user's hand gesture comprises:
detecting whether the recognized user's hand gesture is disposed at the right or left based on the user's face; and
displaying the function guide based on a detection result,
wherein the function guide comprises:
images of a plurality of basic hand gestures representing a basic gesture pattern; and
text disposed at one side of each of the plurality of basic hand gestures and representing a function of each of the plurality of basic hand gestures,
wherein each image of the plurality of basic hand gestures is disposed around the recognized user's hand gesture.

11. A display device, comprising:
a display;
a memory configured to store gestures;
a camera configured to obtain a user's image; and
a controller configured to:
recognize a user's hand gesture from the obtained user's image, and
if the recognized user's hand gesture does not match a pre-stored gesture, display on the display a function guide including different hand gestures different than the recognized user's hand gesture for guiding a user's selection for performing a function of the display device,
wherein the different hand gestures include a plurality of similar hand gestures representing a gesture pattern similar to the recognized user's hand gesture,
wherein the function guide comprises:
an image of the recognized user's hand gesture; and
a plurality of images of the different hand gestures,
wherein the images of the different hand gestures are disposed around the image of the recognized user's hand gesture,
wherein the controller is further configured to:
recognize, by using the obtained user's image, that the user's hand is moved toward a direction where one image corresponding to a different hand gesture among the plurality of images of the different hand gestures is disposed,
select the image of a different hand gesture corresponding to the direction based on a recognition result, and
perform a function of the display device corresponding to the selected image of the different hand gesture, and
wherein the function of the display device represents a function related to an edition or a play of a media content.

12. The display device according to claim 11 , wherein each of the images of the different hand gestures is disposed at the top, bottom, left, and right of the image of the recognized user's hand gesture.

13. The display device according to claim 12 , wherein the function guide further comprises a plurality of function inducers disposed between the image of the recognized hand gesture and the images of each of the different hand gestures and inducing a user's selection to perform a function corresponding to each of the different hand gestures.

14. The display device according to claim 13 , wher

Assignees

• Lg Electronics Inc

Inventors

• Kang Sangkyu
• Ahn Wooseok
• Lee Eunyul
• Park Sewon
• Shin Dongheon

Classifications

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06K9/00355

  Physics · mapped topic

• G06V40/28

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title