Video display device recognizing a gesture of a user to perform a control operation and operating method thereof

Patent metadata

Field	Value
Publication number	US-10372225-B2
Application number	US-201415320181-A
Country	US
Kind code	B2
Filing date	Jul 29, 2014
Priority date	Jun 20, 2014
Publication date	Aug 6, 2019
Grant date	Aug 6, 2019

Abstract

An operating method of a video display device, and which includes obtaining an image of a user of the video display device; generating a plurality of gesture areas for the user from the obtained image; recognizing a position of a gesture object of the user from the plurality of generated gesture areas; recognizing a gesture of the user from the obtained image; and performing a control operation corresponding to the position of the recognized gesture object and the recognized gesture.

First claim

The invention claimed is:

1. An operating method of a video display device, the method comprising:
obtaining an image of a user of the video display device;
generating a plurality of gesture areas for the user from the obtained image;
recognizing a position of a gesture object of the user from the plurality of generated gesture areas;
recognizing a gesture of the user from the obtained image;
recognizing a posture of the user from the obtained image;
performing a control operation corresponding to the recognized position of the gesture object and the recognized gesture based on the recognized posture of the user,
wherein the performing of the control operation comprises performing different control operations according to the recognized posture of the user even when the recognized gesture and the recognized position of the gesture object are identical,
wherein the recognized posture of the user includes at least one of a user's standing posture, a user's sitting posture and a user's lying posture, and
wherein the performing different control operations according to the recognized posture of the user comprises:
performing a first control operation when the recognized posture of the user is a user's standing posture and the recognized gesture is a first recognized gesture and the recognized position of the gesture object is a first recognized position, and
performing a second control operation when the recognized posture of the user is a user's lying posture and the recognized gesture is the first recognized gesture and the recognized position of the gesture object is the first recognized position, the second control operation being different than the first control operation.

2. The method according to claim 1 , wherein the generating of the plurality of gesture areas for the user comprises:
recognizing a position of a reference object of the user; and
generating the plurality of gesture areas based on the recognized reference object.

3. The method according to claim 2 , wherein the generating of the plurality of gesture areas based on the recognized reference object comprises generating gesture areas vertically or horizontally based on the reference object.

4. The method according to claim 2 , wherein the performing of the control operation comprises performing different control operations according to the recognized position of the gesture object even when the recognized gesture is identical.

5. The method according to claim 1 , wherein the gesture object comprises an object corresponding to the user's gesture.

6. The method according to claim 1 , wherein the performing of the control operation comprises performing at least one control operation among channel switching, volume adjustment, screen enlargement, screen reduction, screen movement, pointer movement, screen setting, and sound setting of the video display device.

7. The method according to claim 1 , further comprising recognizing a user's position from the obtained image.

8. The method according to claim 7 , further comprising determining a gesture recognition rate indicating a degree of recognizing the user's gesture based on the recognized user's posture and the recognized user's position.

9. The method according to claim 8 , wherein the recognizing of the user's gesture comprises recognizing the user's gesture based on the determined gesture recognition rate.

10. A video display device comprising:
an image acquisition unit obtaining an image of a user of the video display device; and
a control unit generating a plurality of gesture areas for the user from the obtained image, recognizing a position of a gesture object of the user from the plurality of generated gesture areas, recognizing a gesture of the user from the obtained image, recognizing a posture of the user from the obtained image, and performing a control operation corresponding to the recognized position of the gesture object and the recognized gesture based on the recognized posture of the user,
wherein the control unit is further configured to perform different control operations according to the recognized posture of the user even when the recognized gesture and the recognized position of the gesture object are identical,
wherein the recognized posture of the user includes at least one of a user's standing posture, a user's sitting posture and a user's lying posture, and
wherein the performing different control operations according to the recognized posture of the user comprises:
performing a first control operation when the recognized posture of the user is a user's standing posture and the recognized gesture is a first recognized gesture and the recognized position of the gesture object is a first recognized position, and
performing a second control operation when the recognized posture of the user is a user's lying posture and the recognized gesture is the first recognized gesture and the recognized position of the gesture object is the first recognized position, the second control operation being different than the first control operation.

11. The device according to claim 10 , wherein the control unit recognizes a position of a reference object of the user and generates the plurality of gesture areas based on the recognized reference object.

12. The device according to claim 11 , wherein the control unit performs different control operations according to the position of the recognized gesture object even when the recognized gesture of the user is identical.

13. The device according to claim 10 , wherein the control unit recognizes a user's position from the obtained image and determines a gesture recognition rate indicating a degree of recognizing the user's gesture based on the recognized posture of the user and the recognized user's position.

14. The device according to claim 13 , wherein the control unit recognizes the user's gesture based on the determined gesture recognition rate.

15. The device according to claim 10 , wherein the control unit performs at least one control operation among channel switching, volume adjustment, screen enlargement, screen reduction, screen movement, pointer movement, screen setting, and sound setting based on the position of the recognized gesture object and the recognized gesture.

Assignees

• Lg Electronics Inc

Inventors

• Ahn Wooseok
• Kang Sangkyu
• Oh Hyeongchul
• Park Sewon

Classifications

• H04N5/4403

  Electricity · mapped topic

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• H04N21/42206 Primary

  characterized by hardware details · CPC title

• H04N21/4223

  Cameras (H04N23/00 takes precedence) · CPC title

• G06K9/00355

  Physics · mapped topic