Apparatus and method for correcting image for image projection device with cognitive function on user and environment

Patent metadata

Field	Value
Publication number	US-9596441-B2
Application number	US-201414449017-A
Country	US
Kind code	B2
Filing date	Jul 31, 2014
Priority date	Jan 2, 2014
Publication date	Mar 14, 2017
Grant date	Mar 14, 2017

Abstract

Disclosed is a method of correcting an input image when projecting the input image using an image projection device. The method includes obtaining information on a projection surface on which the input image is to be projected and information on a user's position through at least one image sensor, performing geometric correction on the input image based on the information on the projection surface and the information on the user's position, performing color correction on the input image based on the information on the projection surface, and performing brightness correction on the input image based on the information on the projection surface.

First claim

What is claimed is:

1. A method of correcting an input image when projecting the input image using an image projection device, the method comprising:
obtaining information on a projection surface on which the input image is to be projected and information on a user's position through at least one image sensor;
calculating relative position information between the user and the projection surface based on the information on the projection surface and the information on the user's position;
setting a virtual plane based on the relative position information between the user and the projection surface;
performing geometric correction on the input image based on the virtual plane;
performing color correction on the input image based on the information on the projection surface; and
performing brightness correction on the input image based on the information on the projection surface.

2. The method of claim 1 , wherein the information on the projection surface includes information on at least one of a position, shape, material, color, and light condition of the projection surface.

3. The method of claim 2 , wherein an area division of the projection surface is performed based on at least one of information on the material of the projection surface and information on the color of the projection surface, and the color correction on the input image is performed for each divided area.

4. The method of claim 3 , wherein the color correction for the input image is performed by adjusting at least one of a red-green-blue (RGB) gain, a brightness gain, and a contrast gain for each divided area.

5. The method of claim 1 , wherein the at least one image sensor is based on a stereo vision, time of flight (TOF), or structured light.

6. A method of correcting an input image when projecting the input image using an image projection device, the method comprising:
obtaining information on a shape and position of a projection surface on which the input image is to be projected through at least one image sensor;
calculating relative position information between the user and the projection surface based on the information on the shape and the projection surface and information on a user's position;
setting a virtual plane based on the relative position information between the user and the projection surface; and
performing geometric correction on the input image based on information on the virtual plane.

7. The method of claim 6 , wherein a distance difference Δd between the projection surface and the virtual plane is calculated on the basis of the user, and the geometric correction on the input image is performed based on the Δd.

8. The method of claim 6 , further comprising:
obtaining at least one of information on a material of the projection surface and information on a color of the projection surface through the at least one image sensor; and
performing color correction on the input image based on at least one of the information on the material of the projection surface and the information on the color of the projection surface.

9. The method of claim 8 , wherein an area division on the projection surface is performed based on at least one of the information on the material of the projection surface and the information on the color of the projection surface, and the color correction on the input image is performed for each divided area.

10. The method of claim 9 , wherein the color correction for the input image is performed by adjusting at least one of a red-green-blue (RGB) gain, a brightness gain, and a contrast gain for each divided area.

11. The method of claim 8 , further comprising:
obtaining information on a light condition of the projection surface through the at least one image sensor; and
performing brightness correction on the input image based on the information on the light condition of the projection surface.

12. The method of claim 11 , wherein the at least one image sensor is based on a stereo vision, time of flight (TOF), or structured light.

13. An image correction apparatus for an image projection device, the image correction apparatus comprising:
at least one image sensor which obtains information on a projection surface on which an input image is to be projected through the image projection device, and information on a user's position;
a relative coordinate calculation unit which calculates a relative position of the projection surface based on the information on the projection surface and the information on the user's position, and generates a virtual plane;
a projection surface state detection unit which detects state information on at least one of a shape, material, color, and light condition of the projection surface based on the information on the projection surface; and
an input image correction unit which corrects the input image based on the virtual plane and the state information of the projection surface,
wherein the relative coordinate calculation unit obtains a distance difference Δd for the projection surface and the virtual plane, and the input image correction unit performs geometric correction on the input image based on the distance difference Δd.

14. The image correction apparatus of claim 13 , wherein the at least one image sensor obtains information on the projection surface including information on at least one of a position, shape, material, color, and light condition of the projection surface.

15. The image correction apparatus of claim 14 , wherein the input image correction unit performs brightness correction on the input image based on the state information on the light condition of the projection surface.

16. An image correction apparatus for an image projection device, the image correction apparatus comprising:
at least one image sensor which obtains information on a projection surface on which an input image is to be projected through the image projection device, and information on a user's position;
a relative coordinate calculation unit which calculates a relative position of the projection surface based on the information on the projection surface and the information on the user's position, and generates a virtual plane;
a projection surface state detection unit which detects state information on at least one of a shape, material, color, and light condition of the projection surface based on the information on the projection surface; and
an input image correction unit which corrects the input image based on the virtual plane and the state information of the projection surface,
wherein the projection surface state detection unit performs area division on the projection surface based on at least one of the state information on the material of the projection surface and the state information on the color of the projection surface, and the input image correction unit performs color correction on the input image for each divided area.

Assignees

• Electronics & Telecommunications Res Inst

Inventors

• Shin Ho Chul

Classifications

• H04N9/3185

  Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14) · CPC title

• H04N9/3194

  including sensor feedback · CPC title

• H04N9/3182 Primary

  Colour adjustment, e.g. white balance, shading or gamut (white balance per se H04N9/73; control of amplitude of colour signals H04N9/68; colour control circuits for displays in general G09G5/02, G09G3/2003, G09G3/3607) · CPC title