Image generating system, image generating method, and image generating apparatus

Patent metadata

Field	Value
Publication number	US-2017192219-A1
Application number	US-201615388159-A
Country	US
Kind code	A1
Filing date	Dec 22, 2016
Priority date	Jan 6, 2016
Publication date	Jul 6, 2017
Grant date	—

Abstract

An image generating system that generates a focal image of a target object on a virtual focal plane located between a plurality of illuminators and an image sensor (b) carries out the following (c) through (f) for each of a plurality of pixels constituting the focal image, (c) carries out the following (d) through (f) for each of the positions of the plurality of illuminators, (d) calculates a position of a target point that is a point of intersection of a straight line connecting a position of the pixel on the focal plane and a position of the illuminator and a light receiving surface of the image sensor, (e) calculates a luminance value of the target point in the captured image by the illuminator on the basis of the position of the target point, (f) applies the luminance value of the target point to the luminance value of the pixel, and (g) generates the focal image of the target object on the focal plane by using a result of applying the luminance value at each of the plurality of pixels.

First claim

What is claimed is:

1 . An image generating system, comprising:
a plurality of illuminators; an image sensor on which a target object is to be placed; and at least one control circuit, wherein the image generating system generates a focal image of the target object on a virtual focal plane located between the plurality of illuminators and the image sensor, wherein the plurality of illuminators sequentially illuminate the target object, wherein the image sensor acquires a captured image of the target object each time the plurality of illuminators illuminate the target object, and wherein the at least one control circuit
(a) acquires information on the focal plane located between the plurality of illuminators and the image sensor,
(b) carries out the following (c) through (f) for each of a plurality of pixels constituting the focal image,
(c) carries out the following (d) through (f) for each of positions of the plurality of illuminators,
(d) calculates a position of a target point, the target point being a point of intersection of a straight line connecting a position of the pixel on the focal plane and the position of the illuminator and a light receiving surface of the image sensor,
(e) calculates a luminance value of the target point in the captured image acquired when the target object is illuminated from the position of the illuminator on the basis of the position of the target point on the light receiving surface of the image sensor,
(f) applies the luminance value of the target point to a luminance value of the pixel,
(g) generates the focal image of the target object on the focal plane by using a result of applying the luminance value at each of the plurality of pixels, and
(h) outputs the generated focal image of the target object.

2 . An image generating system, comprising:
a plurality of illuminators; an image sensor on which a target object is to be placed; and at least one control circuit, wherein the image generating system generates a focal image of the target object on a virtual focal plane located between the plurality of illuminators and the image sensor, wherein the plurality of illuminators sequentially illuminate the target object, wherein the image sensor acquires a captured image of the target object each time the plurality of illuminators illuminate the target object, and wherein the at least one control circuit
(a) acquires information on the focal plane located between the plurality of illuminators and the image sensor,
(b) carries out the following (c) through (f) for each of a plurality of the captured images,
(c) acquires positional information of the illuminator that corresponds to the captured image,
(d) carries out the following (e) and (f) for each of a plurality of first pixels included in the captured image,
(e) calculates a position of a point of intersection of a straight line connecting a position of the first pixel on a light receiving surface of the image sensor and a position of the illuminator and the focal plane,
(f) applies a luminance value of the first pixel to a luminance value of one or more second pixels, included in a plurality of second pixels constituting the focal image, that correspond to the position of the point of intersection on the focal plane,
(g) generates the focal image of the target object on the focal plane by using a result of applying the luminance values of the plurality of second pixels, and
(h) outputs the generated focal image of the target object.

3 . The image generating system according to claim 1 ,
wherein each of the plurality of illuminators includes
a light source, and
a shading plate located between the light source and the target object and having a pinhole,
wherein the light source irradiates the target object with diffused light through the pinhole.

4 . The image generating system according to claim 1 , further comprising:
a display, wherein the display displays the focal image output from the at least one control circuit.

5 . The image generating system according to claim 1 ,
wherein a range for an illumination position is determined on the basis of the information on the focal plane, and wherein an illuminator, among the plurality of illuminators, that corresponds to the range for the illumination position sequentially illuminates the target object.

6 . An image generating method of generating a focal image on a virtual focal plane located between a plurality of illuminators and an image sensor, the focal image being of a target object located on the image sensor, the image generating method comprising:
(b1) acquiring a plurality of captured images of the target object captured while sequentially illuminating the target object by using the plurality of illuminators; (b2) acquiring information on the focal plane located between the plurality of illuminators and the image sensor; (b3) carrying out the following (b4) through (b7) for each of a plurality of pixels constituting the focal image; (b4) carrying out the following (b5) through (b7) for each of positions of the plurality of illuminators; (b5) calculating a position of a target point, the target position being a point of intersection of a straight line connecting a position of the pixel on the focal plane and the position of the illuminator and a light receiving surface of the image sensor; (b6) calculating a luminance value of the target point in a captured image acquired while the target object is illuminated from the position of the illuminator on the basis of the position of the target point on the light receiving surface of the image sensor; (b7) applying the luminance value of the target point to a luminance value of the pixel; (b8) generating the focal image of the target object on the focal plane by using a result of applying the luminance value at each of the plurality of pixels; and (b9) outputting the generated focal image of the target object, wherein at least one of the above (b1) through (b9) is carried out by a control circuit.

7 . An image generating method of generating a focal image on a virtual focal plane located between a plurality of illuminators and an image sensor, the focal image being of a target object located on the image sensor, the image generating method comprising:
(b1) acquiring a plurality of captured images of the target object captured while sequentially illuminating the target object by using the plurality of illuminators; (b2) acquiring information on the focal plane located between the plurality of illuminators and the image sensor; (b3) carrying out the following (b4) through (b7) for each of the plurality of captured images; (b4) acquiring positional information of an illuminator that corresponds to the captured image; (b5) carrying out the following (b6) and (b7) for each of a plurality of first pixels included in the captured image; (b6) calculating a position of a point of intersection of a straight line connecting a position of the first pixel on a light receiving surface of the image sensor and a position of the illuminator and the focal plane; (b7) applying a luminance value of the first pixel to a luminance value of one or more second pixels, included in a plurality of second pixels constituting the focal image, that correspond to the position of the point of intersection on the focal plane; (b8) generating the focal image of the target object on the focal plane by using a result of applying the luminance values of the plurality of second pixels; and (b9) outputting the generated focal image of the target object, wherein at least one of the above (bl) through (b9) is carried out by a control circuit.

8 . The image generating method according to claim 6 , further comprisi

Assignees

• Panasonic Ip Man Co Ltd

Inventors

• Kato Yumiko
• Sawada Yoshihide
• Iwasaki Masahiro
• Mukaigawa Yasuhiro
• Kubo Hiroyuki

Classifications

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• H04N23/56

  provided with illuminating means · CPC title

• H04N23/74

  by influencing the scene brightness using illuminating means · CPC title

• H04N5/2256

  Electricity · mapped topic

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title