Techniques for stabilizing a display scene output

Patent metadata

Field	Value
Publication number	US-9720496-B2
Application number	US-201414220744-A
Country	US
Kind code	B2
Filing date	Mar 20, 2014
Priority date	Mar 20, 2014
Publication date	Aug 1, 2017
Grant date	Aug 1, 2017

Abstract

Various embodiments are generally directed to an apparatus and method for determining when an eye is focused on a display scene and determining movement of the eye based on image information when the eye is focused on the display scene. Various embodiments may also include detecting motion of an apparatus based on motion information and adjusting at least one of a position and a size of a frame in the display scene based on at least one of the movement of the eye and the motion of the apparatus.

First claim

What is claimed is:

1. An apparatus, comprising:
an tracking component to determine when an eye is focused on a display scene and to determine motion of the eye based on image information;
one or more motion sensor components to detect motion of the apparatus based on motion information; and
a compensation component to adjust at least one of a position and a size of a frame in the display scene based on at least one of the motion of the eye and the motion of the apparatus, adjustment of the position of the frame to shift the frame in at least one of a horizontal direction or a vertical direction and adjustment of the size of the frame to adjust at least one of a height or a width of the frame, the compensation component to:
adjust the height from a top edge of the frame when the movement of the eye is in a downward direction, when the motion of the apparatus is in an upward direction, or both;
adjust the height from a bottom edge of the frame when the movement of the eye is in an upward direction, when the motion of the apparatus is in a downward direction, or both;
adjust the width from a left edge of the frame when the movement of the eye is in a right direction, when the motion of the apparatus is in an left direction, or both; and
adjust the width from a right edge of the frame when the movement of the eye is in a left direction, when the motion of the apparatus is in a right direction, or both.

2. The apparatus of claim 1 , the tracking component to use the motion information based on the detected motion of the apparatus when determining the motion of the eye, the motion information to be used as a motion estimate when calculating the motion of the eye.

3. The apparatus of claim 1 , the compensation component to shift the frame in a same direction as the motion of the eye when adjusting the position.

4. The apparatus of claim 1 , the compensation component to shift the frame in an opposite direction of the motion of the apparatus when adjusting the position.

5. The apparatus of claim 1 , the compensation component to adjust at least one of the position and the size of the frame based only on the determined motion of the eye when no motion of the apparatus is detected and based only on the motion of the apparatus when no motion of the eye occurs.

6. The apparatus of claim 1 , comprising:
a camera component to detect the image information; and
a display component to present the frame in the display scene as part of a video stream on a display device.

7. The apparatus of claim 6 , the display component to present the frame as part of the video stream at a 120 Hz refresh rate.

8. At least one non-transitory computer-readable storage medium comprising a plurality of instructions that when executed enable processing circuitry to:
determine when an eye is focused on a display scene;
detect movement of the eye based on image information when the eye is focused on the display scene;
detect motion of an apparatus based on motion information; and
adjust at least one of a position and a size of a frame in the display scene based on at least one of the movement of the eye and the motion of the apparatus, adjustment of the position of the frame to shift the frame in at least one of a horizontal direction or a vertical direction and adjustment of the size of the frame to adjust at least one of a height or width of the frame;
adjust the height from a top edge of the frame when the movement of the eye is in a downward direction, when the motion of the apparatus is in an upward direction, or both;
adjust the height from a bottom edge of the frame when the movement of the eye is in an upward direction, when the motion of the apparatus is in a downward direction, or both;
adjust the width from a left edge of the frame when the movement of the eye is in a right direction, when the motion of the apparatus is in an left direction, or both; and
adjust the width from a right edge of the frame when the movement of the eye is in a left direction, when the motion of the apparatus is in a right direction, or both.

9. The at least one non-transitory computer-readable storage medium of claim 8 comprising the plurality of instructions that when executed enable the processing circuitry to use the motion information when detecting the movement of the eye, the motion information to be used as a motion estimate when calculating the movement of the eye.

10. The at least one non-transitory computer-readable storage medium of claim 8 comprising the plurality of instructions that when executed enable the processing circuitry to shift the frame in a same direction as the movement of the eye when adjusting the position.

11. The at least one non-transitory computer-readable storage medium of claim 8 comprising the plurality of instructions that when executed enable the processing circuitry to shift the frame in an opposite direction of the motion of the apparatus when adjusting the position.

12. The at least one non-transitory computer-readable storage medium of claim 8 comprising the plurality of instructions that when executed enable the processing circuitry to adjust at least one of the position and the size of the frame based only on the movement of the eye when no motion is detected and based only on the motion of the apparatus when no movement of the eye is detected.

13. A computer-implemented method, comprising:
determining when an eye is focused on a display scene;
determining movement of the eye based on image information when the eye is focused on the display scene;
detecting motion of an apparatus based on motion information; and
adjusting at least one of a position and a size of a frame in the display scene based on at least one of the movement of the eye and the motion of the apparatus, adjustment of the position of the frame to shift the frame in at least one of a horizontal direction or a vertical direction and adjustment of the size of the frame to adjust at least one of a height or a width of the frame;
adjusting the height from a top edge of the frame when the movement of the eye is in a downward direction, when the motion of the apparatus is in an upward direction, or both;
adjusting the height from a bottom edge of the frame when the movement of the eye is in an upward direction, when the motion of the apparatus is in a downward direction, or both;
adjusting the width from a left edge of the frame when the movement of the eye is in a right direction, when the motion of the apparatus is in an left direction, or both; and
adjusting the width from a right edge of the frame when the movement of the eye is in a left direction, when the motion of the apparatus is in a right direction, or both.

14. The computer-implemented method of claim 13 , comprising using the motion information when determining the movement of the eye, the motion information to be used as a motion estimate when calculating the movement of the eye.

15. The computer-implemented method of claim 13 , comprising:
shifting the frame in a same direction as the movement of the eye when adjusting the position.

16. The computer-implemented method of claim 13 comprising:
shifting the frame in an opposite direction of the motion of the apparatus when adjusting the position.

17. The computer-implemented method of claim 13 , comprising:
adjusting at least one of the position and the size of the frame based only on the movement of the eye when no motion is detected and based only on the motion of the apparatus when no movement of the eye is determined.

Assignees

• Intel Corp

Inventors

• Cancel Olmo Ramon
• Parikh Kunjal
• Baskaran Rajashree
• Zhang Daniel

Classifications

• H04N23/635

  Region indicators; Field of view indicators · CPC title

• H04N23/611

  where the recognised objects include parts of the human body · CPC title

• H04N23/61

  based on recognised objects · CPC title

• G06F1/1626

  with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs] · CPC title

• H04N5/23293

  Electricity · mapped topic