Imaging device, system, method and program for converting a first image into a plurality of second images

Patent metadata

Field	Value
Publication number	US-11310481-B2
Application number	US-201816170635-A
Country	US
Kind code	B2
Filing date	Oct 25, 2018
Priority date	Oct 26, 2017
Publication date	Apr 19, 2022
Grant date	Apr 19, 2022

Abstract

An imaging device for converting a first image into a plurality of second images, the imaging device comprising a light receiving unit having a first aperture configured to receive light of the first image, a light reflecting unit configured to reflect the light received by the light receiving unit along a number of paths having a predetermined number of reflections within the light reflecting unit according to a portion of the first aperture from which the light originated, and a light output unit configured to output at least a subset of the paths of light reflected by the light reflecting unit as a plurality of second images, the second images having a focal length associated with the predetermined number of reflections experienced by the corresponding paths of light through the light reflecting unit.

First claim

The invention claimed is:

1. An imaging system for converting a first image into a plurality of second images, the imaging system comprising:
a first lens having a first aperture configured to receive light of the first image;
a light reflector configured to reflect the light received by the first lens along a number of paths having a predetermined number of reflections within the light reflector according to a portion of the first aperture from which the light originated;
a second lens configured to output at least a subset of the paths of light reflected by the light reflector as a plurality of second images, the second images having a focal length associated with the predetermined number of reflections experienced by the corresponding paths of light through the light reflector;
image capture circuitry configured to capture information constituting the plurality of second images output by the second lens; and
image processing circuitry configured to process the information constituting the plurality of second images captured by the image capture circuitry and to determine, from the information constituting the plurality of second images, a first depth information for forming a three-dimensional image using a focal length of at least one of the plurality of second images based on a number of reflections.

2. The imaging system according to claim 1 , wherein the light reflector comprises a solid rod having a refractive index such that the light received from the first lens is reflected along the number of paths having a predetermined number of reflections within the light reflector by total internal reflection within the solid rod.

3. The imaging system according to claim 1 , wherein the light reflector comprises a tunnel configured such that the light received from the first lens is reflected along the number of paths having a predetermined number of reflections within the light reflector by reflection off the internal surfaces of the tunnel.

4. The imaging system according to claim 1 , wherein the light reflector is a quadratic light reflecting unit and the plurality of second images are output by the second lens as a grid.

5. The imaging system according to claim 1 , wherein the second lens is configured such that the subset of the paths of light output by the second lens comprises light experiencing no reflections, light experiencing a single reflection and light experiencing a double reflection within the light reflector.

6. The imaging system according to claim 1 , wherein the image processing circuitry is further configured to determine from the information constituting the plurality of second images disparity information between at least two of the plurality of second. images.

7. The imaging system according to claim 6 , wherein the image processing circuitry is further configured to determine a second depth information using the disparity information.

8. The imaging system according to claim 1 , wherein the image processing circuitry is further configured to use at least one depth information determined from the information constituting the plurality of second images in order to generate a resultant image having an extended depth of field.

9. The imaging system according to claim 8 , wherein generating t resultant image having an extended depth of field further comprises performing a sharpness transfer function between the plurality of second images.

10. The imaging system according to claim 1 , wherein the image processing circuitry is further configured to use the information constituting the plurality of second images in order to generate a resultant multiview image.

11. The imaging system according to claim 1 , wherein the image processing configured to compare to focus levels of the plurality of second images determine the first depth information.

12. A medical device comprising an imaging system according to claim 1 positioned between a probe and an image sensor.

13. A method of operating an imaging device for converting a first image into a plurality of second images, the method comprising:
controlling a first lens of the imaging device having a first aperture to receive light of the first image;
controlling a light reflector of the imaging device to reflect the light received by the first lens along a number of paths having a predetermined number of reflections within the light reflector according to a portion of the first aperture from which the light originated;
controlling a second lens of the imaging device to output at least a subset of the paths of light reflected by the light reflector as a plurality of second images, the second images having a focal length associated with the predetermined number of reflections experienced by the corresponding paths of light through the light reflector;
capturing information constituting the plurality of second images output by the second lens; and
processing the information constituting the plurality of second images captured, processing including determining a first depth information for forming a three-dimensional image using a focal length of at least one of the plurality of second images by comparing focus levels of the plurality of second images based on a number of reflections.

14. The method according to claim 13 , wherein determining a first depth information includes comparing focus levels of the plurality of second images.

15. A non-transitory computer readable medium having stored thereon a program that, when executed by a computer, causes the computer to perform a method according to claim 13 .

16. An imaging system for converting a first image into a plurality of second images, the imaging system comprising:
a first lens having a first aperture configured to receive light of the first image;
a light reflector configured to reflect the light received by the first lens along a number of paths having a predetermined number of reflections within the light reflector according to a portion of the first aperture from which the light originated;
a second lens configured to output at least a subset of the paths of light reflected by the light reflector as a plurality of second images, the second images having a focal length associated with the predetermined number of reflections experienced by the corresponding paths of light through the light reflector;
image capture circuitry configured to capture information constituting the plurality of second images output by the second lens; and
image processing circuitry configured to process the information constituting the plurality of second images captured by the image capture circuitry, wherein the image processing circuitry is further configured to use the information constituting the plurality of second images from different numbers of reflections to generate multiple unique three-dimensional images.

Assignees

• Sony Corp

Inventors

• Springer Paul
• Emmerich Thimo
• Facius Zoltan

Classifications

• H04N23/673

  based on contrast or high frequency components of image signals, e.g. hill climbing method · CPC title

• H04N23/60

  Control of cameras or camera modules · CPC title

• H04N23/555 Primary

  for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes · CPC title

• H04N23/74

  by influencing the scene brightness using illuminating means · CPC title

• H04N23/73

  by influencing the exposure time · CPC title