Image display apparatus and pointing method for same

Patent metadata

Field	Value
Publication number	US-9910507-B2
Application number	US-201415027108-A
Country	US
Kind code	B2
Filing date	Oct 1, 2014
Priority date	Oct 2, 2013
Publication date	Mar 6, 2018
Grant date	Mar 6, 2018

Abstract

An image display apparatus that automatically adjust a pointing direction of a remote controller to almost match with a position of a pointer on a screen, and a pointing method performed by the image display apparatus are provided. The image display apparatus includes a reference angle detector configured to detect a reference angle formed by the pointing direction of the remote controller with respect to a reference direction set for a display; a remote control direction detector configured to detect a remote control direction which is a direction in which the remote controller is viewed, from a reference point set on the display; and a standard direction adjuster configured to adjust a standard direction set in the remote controller so that the standard direction reaches the reference point on the display as viewed from the remote controller, based on the reference angle and the remote control direction.

First claim

The invention claimed is:

1. An image display apparatus comprising:
a reference angle detector configured to detect a reference angle formed by a pointing direction of a remote controller with respect to a reference direction set for a display;
a remote control direction detector configured to detect a remote control direction which is a direction in which the remote controller is viewed, from a reference point set on the display;
a standard direction adjuster configured to adjust a standard direction set in the remote controller so that the standard direction reaches the reference point set on the display as viewed from the remote controller, based on the reference angle and the remote control direction; and
a controller configured to control a pointer to be displayed at a corresponding position on the display, based on a pointing angle that is formed by the pointing direction of the remote controller with respect to the standard direction.

2. The image display apparatus of claim 1 , wherein the reference angle detector comprises a reference angle calculator configured to calculate the reference angle based on a reference direction set as a direction value output by a direction sensor provided in the remote controller when the pointing direction of the remote controller is perpendicular to the display and based on a remote control direction set as a direction value output by the direction sensor in correspondence with the pointing direction of the remote controller.

3. The image display apparatus of claim 1 , further comprising a pointing angle calculator configured to calculate the pointing angle based on a reference pointing angle and an angular velocity output by an angular velocity sensor provided in the remote controller,
wherein the standard direction adjuster sets an angle formed by the pointing direction with respect to the standard direction, as the reference pointing angle, in the pointing angle calculator.

4. The image display apparatus of claim 3 , wherein the pointing angle calculator stores a previous remote control direction corresponding to when the standard direction was adjusted in the past, and calculates the pointing angle when a difference between the previous remote control direction and a current remote control direction is equal to or greater than a threshold value.

5. The image display apparatus of claim 1 , wherein the remote control direction detector comprises:
a camera disposed on the display to be able to photograph the remote controller; and
a remote control direction angle calculator configured to calculate a remote control direction angle formed by the remote control direction with respect to a direction perpendicular to the display, based on an image captured by the camera.

6. The image display apparatus of claim 5 , wherein
the camera is disposed on a horizontal edge of the display to have a photographing direction parallel to a vertical plane perpendicular to the display,
the remote control direction angle calculator comprises:
a first remote control detector configured to calculate a first remote control direction angle made by the direction perpendicular to the display and a direction obtained by projecting the remote control direction to a horizontal plane, based on the image captured by the camera; and
a second remote control detector configured to calculate a second remote control direction angle made by the direction perpendicular to the display and a direction obtained by projecting the remote control direction to the vertical plane, based on the image captured by the camera, a photographing angle made by the display and the photographing direction, a distance from the camera to the remote controller, and a length of a vertical edge of the display, and
the standard direction adjuster adjusts the standard direction so that the standard direction reaches the reference point on the display as viewed from the remote controller, based on the reference angle, the first remote control direction angle, and the second remote control direction angle.

7. The image display apparatus of claim 1 , wherein
the controller comprises:
a position calculator configured to calculate a corresponding position on the display, based on the pointing angle; and
a display controller configured to control the pointer to be displayed on the corresponding position, and
the position calculator calculates the corresponding position so that a distance from the reference point to the corresponding position for each unit angle of the pointing angle increases with an increase in a distance from the display to the remote controller.

8. A pointing method comprising:
detecting a reference angle formed by a pointing direction of a remote controller with respect to a reference direction set for a display;
detecting a remote control direction which is a direction in which the remote controller is viewed, from a reference point set on the display;
adjusting a standard direction set in the remote controller so that the standard direction reaches the reference point set on the display as viewed from the remote controller, based on the reference angle and the remote control direction; and
controlling a pointer to be displayed at a corresponding position on the display, based on a pointing angle that is formed by the pointing direction of the remote controller with respect to the standard direction.

9. The pointing method of claim 8 , wherein the detecting of the reference angle comprises calculating the reference angle based on a reference direction set as a direction output by a direction sensor provided in the remote controller when the pointing direction of the remote controller is perpendicular to the display and based on a remote control direction set as a direction output by the direction sensor in correspondence with the pointing direction of the remote controller.

10. The pointing method of claim 8 , further comprising calculating the pointing angle based on a reference pointing angle and an angular velocity output by an angular velocity sensor provided in the remote controller,
wherein an angle formed by the pointing direction with respect to the standard direction is set as the reference pointing angle.

11. The pointing method of claim 8 , wherein the detecting of the remote control direction comprises calculating a remote control direction angle formed by the remote control direction with respect to a direction perpendicular to the display, based on an image captured by a camera mounted on the display to be able to photograph the remote controller.

12. The pointing method of claim 11 , wherein
the camera is mounted on an edge of the display parallel to one of a horizontal plane and a vertical plane perpendicular to the display, to have a photographing direction parallel to a surface other than one of the horizontal plane and the vertical plane,
the calculating of the remote control direction angle comprises:
calculating a first remote control direction angle made by the direction perpendicular to the display and a direction obtained by projecting the remote control direction to the one plane, based on the image captured by the camera; and
calculating a second remote control direction angle made by the direction perpendicular to the display and a direction obtained by projecting the remote control direction to the other plane, based on the image captured by the camera, a photographing angle made by the display and the photographing direction, a distance from the camera to the remote controller, and a length of an edge of the display that is parallel to the other plane, and
the adjusting of the standard direction comprises adjusting the standard

Assignees

• Samsung Electronics Co Ltd

Inventors

• Okuno Yoshiaki
• Hirasawa Kousuke
• Yamamoto Murakami Edwardo Arata
• Choi Sang On

Classifications

• H04N21/44218

  Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV programme (methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45) · CPC title

• G06F3/0308

  comprising a plurality of distinctive and separately oriented light emitters or reflectors associated to the pointing device, e.g. remote cursor controller with distinct and separately oriented LEDs at the tip whose radiations are captured by a photo-detector associated to the screen · CPC title

• G06F3/017 Primary

  Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883) · CPC title

• G06F3/0325

  using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image · CPC title

• H04N21/42222

  Additional components integrated in the remote control device, e.g. timer, speaker, sensors for detecting position, direction or movement of the remote control, microphone or battery charging device · CPC title