Markerless geometric registration of multiple projectors on extruded surfaces using an uncalibrated camera
US-9195121-B2 · Nov 24, 2015 · US
US9532018B2 · US · B2
| Field | Value |
|---|---|
| Publication number | US-9532018-B2 |
| Application number | US-201414341094-A |
| Country | US |
| Kind code | B2 |
| Filing date | Jul 25, 2014 |
| Priority date | Jul 26, 2013 |
| Publication date | Dec 27, 2016 |
| Grant date | Dec 27, 2016 |
A practical reading order for non-experts. Skip the full description unless you need deep technical detail.
What the patent document calls the invention.
A short plain-language summary of the technical disclosure.
Who owns or filed the patent and who is credited as inventor.
Filing, priority, publication, and grant dates set the timeline.
The legal scope of protection — read this for what is actually claimed.
Technology tags used to group this patent with similar filings.
Prior art links and similar publications in this corpus.
Official abstract text for this publication.
A projection system includes projection units configured to project an image on a projection body; a preparing unit configured to prepare calibration-use images; an extraction unit configured to extract, from each of the calibration-use images, at least grating points indicating a distortion in a projected image of one of the projection units and alignment points of the projected image of the one of the projection units or another one of the projection units; a conversion unit configured to convert, onto a common coordinate system, the grating points of the projected images of the projection units extracted from the calibration-use images, based on alignment points common to the calibration-use images; and a geometric correction coefficient calculation unit configured to calculate a geometric correction coefficient for providing a projection image to be projected from the projection units, based on the grating points on the common coordinate system.
Opening claim text (preview).
What is claimed is: 1. A projection system, comprising: a plurality of projection units configured to project an image on a projection body; a taken image preparation unit configured to prepare a plurality of calibration-use images; an extraction unit configured to extract, from each of the plurality of calibration-use images, at least grating points indicating a distortion in a projected image of one of the plurality of projection units and alignment points of the projected image of the one of the plurality of projection units or a projected image of another one of the plurality of projection units; a conversion unit configured to convert, onto a common coordinate system, the grating points of the projected images of the plurality of projection units extracted from the plurality of calibration-use images by the extraction unit, based on alignment points common to the plurality of calibration-use images; a geometric correction coefficient calculation unit configured to calculate a geometric correction coefficient for providing a projection image to be projected from the plurality of projection units, based on the grating points on the common coordinate system; an image output unit configured to output, to at least one of the plurality of projection units, a calibration image including both of or one of a grating pattern defining grating points of the projected image and an alignment pattern defining alignment points between the plurality of calibration-use images; and a scene preparation unit configured to prepare a plurality of calibration projection scenes each including the calibration image to be output to at least one of the plurality of projection units, such that (a) in an arrangement of the projected images, projection units adjacent to each other among the plurality of projection units do not both project a grating pattern in the same calibration projection scene, (b) all of the plurality of calibration projection scenes include at least one grating pattern of the plurality of projection units, and (c) the plurality of calibration projection scenes constitute a tree structure by a connection based on an alignment pattern projected by one of the plurality of projection units common to the plurality of calibration projection scenes. 2. The projection system according to claim 1 , wherein the scene preparation unit prepares one or more of the plurality of calibration projection scenes, such that in an arrangement of the projected images, one of the projection units adjacent to each other projects at least a grating pattern, and another one of the projection units adjacent to each other projects an alignment pattern, and the scene preparation unit prepares a last one of the plurality of calibration projection scenes, such that a last one of the plurality of projection units projects both of a grating pattern and an alignment pattern. 3. The projection system according to claim 1 , wherein the scene preparation unit prepares a first one of the plurality of calibration projection scenes, such that in an arrangement of the projected images, projection units in a first group among the plurality of projection units project at least a grating pattern, the scene preparation unit prepares a second one of the plurality of calibration projection scenes, such that projection units in a second group among the plurality of projection units, which are each adjacent to one of the projection units in the first group, project at least a grating pattern, and the scene preparation unit prepares the first one and the second one of the plurality of calibration projection scenes, such that at least a common one of the plurality of projection units, which is common to the first one and the second one of the plurality of calibration projection scenes, projects an alignment pattern. 4. The projection system according to claim 1 , wherein the alignment pattern is arranged at a peripheral position of an area where the grating pattern is arranged, in the projected image. 5. The projection system according to claim 1 , wherein the conversion unit performs projection conversion based on a coordinate of an alignment pattern common to a first calibration-use image and a second calibration-use image among the plurality of calibration-use images prepared by the taken image preparation unit, the projection conversion being performed for converting the grating points from a coordinate system of the second calibration-use image to a coordinate system of the first calibration-use image. 6. The projection system according to claim 1 , further comprising: a blending coefficient calculation unit configured to detect, for each of the plurality of projection units, an overlapping area between a projected image of a target projection unit and a projected image of an adjacent projection unit adjacent to the target projection unit, and calculate a blending coefficient for adjusting an overlapping amount between the projected image of the target projection unit and the projected image of the adjacent projection unit. 7. The projection system according to claim 6 , further comprising: a correction processing unit provided for each of the plurality of projection units, the correction processing unit being configured to generate an intermediate image for each of the plurality of projection units from an image that is a target of projection, based on the geometric correction coefficient calculated by the geometric correction coefficient calculation unit, and to calculate the projection image for each of the plurality of projection units from the intermediate image, based on the blending coefficient calculated by the blending coefficient calculation unit. 8. The projection system according to claim 1 , further comprising: both of or one of a plurality of projection devices acting as the plurality of projection units; and an imaging device configured to take images of the plurality of calibration-use images. 9. An image processing device for performing projection with the use of plurality of projection units, the image processing device comprising: a taken image preparation unit configured to prepare a plurality of calibration-use images; an extraction unit configured to extract, from each of the plurality of calibration-use images, at least grating points indicating a distortion in a projected image of one of the plurality of projection units and alignment points of the projected image of the one of the plurality of projection units or a projected image of another one of the plurality of projection units; a conversion unit configured to convert, onto a common coordinate system, the grating points of the projected images of the plurality of projection units extracted from the plurality of calibration-use images by the extraction unit, based on alignment points common to the plurality of calibration-use images; and a geometric correction coefficient calculation unit configured to calculate a geometric correction coefficient for providing a projection image to be projected from the plurality of projection units, based on the grating points on the common coordinate system, wherein the extraction unit extracts, from each of the plurality of calibration-use images, both of or one of the grating points and the alignment points, wherein each of the plurality of calibration-use images includes at least one calibration-use projected image including both of or one of a grating pattern defining grating points of the projected image and an alignment pattern defining alignment points between the plurality of calibration-use images, and the taken image preparation unit prepares the plurality of calibration-use images each including the at least one calibration-us
involving a deformation of the sample pattern or of the reference pattern; Elastic matching · CPC title
Illumination specially adapted for pattern recognition, e.g. using gratings · CPC title
Scale or resolution adjustment (scaling in general G06T3/40; resolution modifying circuits for displays in general G09G5/391) · CPC title
Physics · mapped topic
Physics · mapped topic
Related publications grouped by family.
Answers are generated from the same data shown on this page.