Image processing device, image display system, image processing method, and program

Patent metadata

Field	Value
Publication number	US-11825245-B2
Application number	US-202017026899-A
Country	US
Kind code	B2
Filing date	Sep 21, 2020
Priority date	Mar 27, 2018
Publication date	Nov 21, 2023
Grant date	Nov 21, 2023

Abstract

The present invention provides an image processing device that reproduces the color of an input image more faithfully under different environment illumination without the need to prepare a different signal separation LUT for different environment illumination. An image processing device in one embodiment of the present invention generates data for generating an overlap image by overlapping an image formed by an image forming device and an image projected by an image projection device. The image processing device includes a generation unit configured to, based on input image data, generate first image data for the image forming device and second image data for the image projection device, a first acquisition unit configured to acquire environment illumination information relating to environment illumination in generating the overlap image, and a correction unit configured to correct the second image data based on the environment illumination information.

First claim

The invention claimed is:

1. An image processing device that generates data for generating an overlap image by overlapping an image formed by an image forming device and an image projected by an image projection device, the image processing device comprising:
one or more memories that store a set of instructions; and
one or more processors that execute the instructions to cause the image processing device to:
acquire variation information that identifies variations in a brightness of environment illumination from a first environment to a second environment;
set, based on the variation information, environment reference illumination and generate, by separating a signal of input image data based on the set environment reference illumination, first image data for the image forming device and second image data for the image projection device;
acquire environment illumination information relating to environment illumination in generating the overlap image; and
correct the second image data based on the environment illumination information.

2. The image processing device according to claim 1 , wherein the instructions, when executed by the one or more processors further cause the image processing device to:
generate a lookup table for correcting the second image data based on the environment illumination information and the first image data, and corrects the second image data based on the generated lookup table.

3. The image processing device according to claim 1 , wherein
the environment illumination information is information obtained by measuring the environment illumination using a sensor.

4. The image processing device according to claim 3 , wherein
the environment illumination information is information obtained by measuring the environment illumination using a spectral sensor.

5. The image processing device according to claim 1 , wherein
the environment illumination information is an information represents a spectral distribution of the environment illumination.

6. The image processing device according to claim 1 , wherein the instructions, when executed by the one or more processors further cause the image processing device to:
generate the first image data and the second image data so that a correction amount in a correction performed is within a correctable range for a predetermined range of the environment illumination information.

7. The image processing device according to claim 1 , wherein the instructions, when executed by the processor further cause the image processing device to:
acquire a color reproduction range of the image projection device, and
generate the first image data and the second image data based on the variation information and the color reproduction range.

8. The image processing device according to claim 1 , wherein
the environment reference illumination is determined in accordance with designation of a user.

9. The image processing device according to claim 8 , wherein the instructions, when executed by the processor further cause the image processing device to:
display a user interface for the user to designate the environment reference illumination, and
display an area in which a correction amount in a correction performed is not within the correctable range on the user interface.

10. The image processing device according to claim 1 , wherein the instructions, when executed by the processor further cause the image processing device to:
perform correction so as to compensate for a change in color of the overlap image in accordance with a change in the environment illumination.

11. A non-transitory computer readable storage medium storing a program for causing a computer to perform an image processing method of generating data for generating an overlap image by overlapping an image formed by an image forming device and an image projected by an image projection device, the image processing method comprising:
acquiring variation information that identifies variations in a brightness of environment illumination from a first environment to a second environment
setting, based on the variation information, environment reference illumination;
generating, by separating a signal of input image data based on the set environment reference illumination, first image data for the image forming device and second image data for the image projection device;
acquiring environment illumination information relating to environment illumination in generating the overlap image; and
correcting the second image data based on the environment illumination information.

12. The image processing device according to claim 1 , wherein the instructions, when executed by the processor further cause the image processing device to:
correct the second image data based on the first image data and the environment illumination information.

13. A computer-implemented method for generating data for generating an overlap image by overlapping an image formed by an image forming device and an image projected by an image projection device, the computer-implemented method comprising:
acquiring variation information that identifies variations in a brightness of environment illumination from a first environment to a second environment;
setting, based on the variation information, environment reference illumination;
generating, by separating a signal of input image data based on the set environment reference illumination, first image data for the image forming device and second image data for the image projection device;
acquiring environment illumination information relating to environment illumination in generating the overlap image; and
correcting the second image data based on the environment illumination information.

14. The image processing device according to claim 1 , wherein the instructions, when executed by the processor further cause the image processing device to:
set, as the environment reference illumination, environment illumination having an average brightness between a brightness of illumination of the first environment and a brightness of illumination of the second environment.

Assignees

• Canon Kk

Inventors

• Moribe Shoei

Classifications

• H04N9/3182 Primary

  Colour adjustment, e.g. white balance, shading or gamut (white balance per se H04N9/73; control of amplitude of colour signals H04N9/68; colour control circuits for displays in general G09G5/02, G09G3/2003, G09G3/3607) · CPC title

• G03B21/134

  Projectors combined with typing apparatus or with printing apparatus · CPC title

• G09G3/002

  to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT · CPC title

• G09G5/377

  for mixing or overlaying two or more graphic patterns (G09G5/02, G09G5/397 take precedence) · CPC title

• H04N1/00835 Primary

  Detecting external or ambient light · CPC title