Image projection system and image projection method

Patent metadata

Field	Value
Publication number	US-9529371-B2
Application number	US-201414325422-A
Country	US
Kind code	B2
Filing date	Jul 8, 2014
Priority date	Jul 10, 2013
Publication date	Dec 27, 2016
Grant date	Dec 27, 2016

Abstract

An image projection system projects a single image on an image projection region from a plurality of image projection sections and includes section that detects checker intersection coordinates in a corrected checkered sheet image, a section that calculates a first projective transformation matrix from the checker intersection coordinates, a section that generates first and second spatial code images, a section that acquires boundary lines in the first and second spatial code images, and acquires first intersection coordinates of the boundary lines, a section that calculates a second projective transformation matrix for projective transformation of the first intersection coordinates, transformed using the first projective transformation matrix, into second intersection coordinates distributed over an entire sub-region of the image projection region, and a section that transforms image data by using the second projective transformation matrix.

First claim

What is claimed is:

1. An image projection system for projecting a single image on an image projection region by projecting images on different sub-regions within the image projection region from a plurality of image projection sections, the system comprising:
an image-taking section configured to take, via a lens, an image of a checkered sheet placed in the image projection region;
a correction section configured to correct lens-induced distortion of the taken checkered sheet image by using an internal parameter of the image-taking section;
a checker intersection coordinate detection section configured to detect, with sub-pixel precision, checker intersection coordinates in the corrected checkered sheet image;
a first transformation matrix calculation section configured to calculate a first projective transformation matrix for projective transformation of the detected checker intersection coordinates into checker intersection coordinates located at equal or substantially equal intervals in the image projection region;
a generation section configured to correct, when first positive images and first negative images of an 8-bit vertical Gray code pattern projected on a first sub-region of the image projection region from a given one of the image projection sections are taken by the image-taking section, lens-induced distortion of the taken first positive images and first negative images by using the internal parameter of the image-taking section, and generate a first spatial code image whose code value changes in a lateral direction based on the corrected first positive images and first negative images, and to correct, when second positive images and second negative images of an 8-bit horizontal Gray code pattern projected on the first sub-region from the given image projection section are taken by the image-taking section, lens-induced distortion of the taken second positive images and second negative images by using the internal parameter of the image-taking section, and generate a second spatial code image whose code value changes in a longitudinal direction based on the corrected second positive images and second negative images;
a boundary coordinate acquisition section configured to obtain, with sub-pixel precision, an intersection of brightness profiles in the corrected first positive images and first negative images, and obtain, with sub-pixel precision, an intersection of brightness profiles in the corrected second positive images and second negative images, thus acquiring the obtained intersections as boundary coordinates;
an intersection acquisition section configured to acquire, based on the acquired boundary coordinates, a first boundary line connecting the boundary coordinates of the same code value in the first spatial code image, acquire, based on the acquired boundary coordinates, a second boundary line connecting the boundary coordinates of the same code value in the second spatial code image, and combine the first and second spatial code images, thus acquiring first intersection coordinates of the first and second boundary lines;
a second transformation matrix calculation section configured to transform the acquired first intersection coordinates by using the first projective transformation matrix, and calculate a second projective transformation matrix for projective transformation of the transformed first intersection coordinates into second intersection coordinates distributed over the entire first sub-region; and
an image data correction section configured to transform, using the second projective transformation matrix, image data to be outputted to the given image projection section, thus correcting the image data; wherein
the second transformation matrix calculation section is configured to transform the first intersection coordinates transformed by using the first projective transformation matrix and the second intersection coordinates to be distributed over the entire first sub-region into coordinates of a local coordinate system specific to the given image projection section, and then calculate the second projective transformation matrix.

2. The image projection system according to claim 1 , wherein the second intersection coordinates distributed over the entire first sub-region are intersection coordinates of the first and second boundary lines obtained when the first boundary line in the first spatial code image and the second boundary line in the second spatial code image are placed in a grid pattern in the first sub-region.

3. The image projection system according to claim 2 , wherein when the first and second boundary lines are placed in a grid pattern in the first sub-region and a size of an input image of the given image projection section is “X” by “Y” pixels, a value of “j” obtained when a value of {Y+(j−1)}/j (where “j” is a positive integer) is closest to a number of the first boundary lines is defined as an interval between the first boundary lines, and a value of “k” obtained when a value of {X+(k−1)}/k (where “k” is a positive integer) is closest to a number of the second boundary lines is defined as an interval between the second boundary lines.

4. An image projection method for projecting a single image on an image projection region by projecting images on different sub-regions within the image projection region from a plurality of image projection sections, the method comprising:
preparing an image-taking section that takes an image via a lens, and a plurality of image projection sections that project images on the different sub-regions within the image projection region;
taking an image of a checkered sheet placed in the image projection region by the image-taking section;
correcting lens-induced distortion of the taken checkered sheet image by using an internal parameter of the image-taking section;
detecting, with sub-pixel precision, checker intersection coordinates in the corrected checkered sheet image;
calculating a first projective transformation matrix for projective transformation of the detected checker intersection coordinates into checker intersection coordinates located at equal or substantially equal intervals in the image projection region;
correcting, when first positive images and first negative images of an 8-bit vertical Gray code pattern projected on a first sub-region of the image projection region from a given one of the image projection sections are taken by the image-taking section, lens-induced distortion of the taken first positive images and first negative images by using the internal parameter of the image-taking section, and generating a first spatial code image whose code value changes in a lateral direction based on the corrected first positive images and first negative images;
correcting, when second positive images and second negative images of an 8-bit horizontal Gray code pattern projected on the first sub-region from the given image projection section are taken by the image-taking section, lens-induced distortion of the taken second positive images and second negative images by using the internal parameter of the image-taking section, and generating a second spatial code image whose code value changes in a longitudinal direction based on the corrected second positive images and second negative images;
obtaining, with sub-pixel precision, an intersection of brightness profiles in the corrected first positive images and first negative images, and obtaining, with sub-pixel precision, an intersection of brightness profiles in the corrected second positive images and second negative images, thus acquiring the obtained intersections as boundary coordinates;
acquiring, based on the acquired boundary coordinates, a first boundary line connecting the boundary coordinates of the same code value in the first spatial code image, acquiring, based on the acquired boundary

Assignees

• Roland Dg Corp

Inventors

• Nakamura Yasutoshi

Classifications

• B29C64/393

  for controlling or regulating additive manufacturing processes · CPC title

• B33Y50/02

  for controlling or regulating additive manufacturing processes · CPC title

• B29C67/0088

  Operations & Transport · mapped topic

• B29C67/0062

  Operations & Transport · mapped topic

• G05D25/02 Primary

  characterised by the use of electric means · CPC title