Imaging device, method and program for producing images of a scene having an extended depth of field with good contrast

Patent metadata

Field	Value
Publication number	US-11699215-B2
Application number	US-201816642382-A
Country	US
Kind code	B2
Filing date	Sep 5, 2018
Priority date	Sep 8, 2017
Publication date	Jul 11, 2023
Grant date	Jul 11, 2023

Abstract

An imaging device for producing images of a scene, the imaging device comprising: a first and a second hyperchromatic lens being arranged in a stereoscopic configuration to receive light from the scene; image sensor circuitry configured to capture a first and second image of the light encountered by the first and the second lens respectively; processor circuitry configured to: produce depth information using the captured first and second images of the scene and produce a resultant first and second image of the scene using both the captured first and second image and the depth information.

First claim

The invention claimed is:

1. An imaging device for producing images of a scene, the imaging device comprising:
a first and a second hyperchromatic lens being arranged in a stereoscopic configuration to receive light from the scene;
image sensor circuitry configured to capture a first and second image of the light encountered by the first and the second lens respectively;
processor circuitry configured to:
produce depth information using the captured first and second images of the scene and produce a resultant first and second image of the scene using both the captured first and second image and the depth information;
partition the captured first and second images into regions corresponding to a resolution of the depth information;
obtain for each region of the captured first and second images an image sharpness level for each colour channel using the depth information;
determine for each region of the captured first and second image the colour channel having the highest sharpness level;
produce the resultant first and second image of the scene by transporting for each region of each of the captured first and second images the image sharpness level from the colour channel having the highest sharpness level to the corresponding region in the complementary colour channels for that image; and
perform a depth information propagation calculation to produce depth information having a resolution corresponding to the resolution of the captured first and second images and wherein each region corresponds to a single pixel.

2. The imaging device according to claim 1 , wherein the image sensor circuitry is configured to detect a first plurality of colour channels for the first captured image and a second plurality of colour channels for the second captured image.

3. The imaging device according to claim 2 , wherein the first and second plurality of colour channels can be selected from infrared, red, green, blue and ultraviolet.

4. The imaging device according to claim 1 , wherein the processor circuitry is further configured to produce the depth information by comparing corresponding pixels between the captured first and second image where the contrast level of the pixels exceeds a given threshold value.

5. The imaging device according to claim 1 , wherein the resultant first and second image of the scene are images having an extended depth of field.

6. The imaging device according to claim 1 , further comprising a light source.

7. The imaging device according to claim 6 , wherein the light source is formed from at least one Light Emitting Diode or at least one Laser.

8. The imaging device according to claim 1 , wherein the image sensor circuitry comprises a 4K sensor.

9. The imaging device according to claim 1 , wherein the imaging device is an endoscope.

10. The imaging device according to claim 1 , wherein the imaging device is a medical imaging device.

11. The imaging device according claim 1 , wherein the imaging device is an industrial imaging device.

12. A method for producing images of a scene, the method comprising:
receiving light from a scene using a first and a second hyperchromatic lens arranged in a stereoscopic configuration;
capturing a first and second image of the light encountered by the first and second lens respectively;
producing depth information using the captured first and second images of the scene;
producing a resultant first and second image of the scene using both the first and second image and the depth information;
partitioning the captured first and second images into regions corresponding to a resolution of the depth information;
obtaining for each region of the captured first and second images an image sharpness level for each colour channel using the depth information;
determining for each region of the captured first and second image the colour channel having the highest sharpness level;
producing the resultant first and second image of the scene by transporting for each region of each of the captured first and second images the image sharpness level from the colour channel having the highest sharpness level to the corresponding region in the complementary colour channels for that image; and
performing a depth information propagation calculation to produce depth information having a resolution corresponding to the resolution of the captured first and second images and wherein each region corresponds to a single pixel.

13. The method according to claim 12 , further comprising producing the depth information by comparing corresponding pixels between the captured first and second image where a contrast level of the pixels exceeds a given threshold value.

14. A non-transitory recording medium storing a computer program for controlling a computer to perform a method for producing images of a scene, the method comprising:
receiving light from a scene using a first and a second hyperchromatic lens arranged in a stereoscopic configuration;
capturing a first and second image of the light encountered by the first and second lens respectively;
producing depth information using the captured first and second images of the scene;
producing a resultant first and second image of the scene using both the first and second image and the depth information;
partitioning the captured first and second images into regions corresponding to a resolution of the depth information;
obtaining for each region of the captured first and second images an image sharpness level for each colour channel using the depth information;
determining for each region of the captured first and second image the colour channel having the highest sharpness level;
producing the resultant first and second image of the scene by transporting for each region of each of the captured first and second images the image sharpness level from the colour channel having the highest sharpness level to the corresponding region in the complementary colour channels for that image; and
performing a depth information propagation calculation to produce depth information having a resolution corresponding to the resolution of the captured first and second images and wherein each region corresponds to a single pixel.

15. The non-transitory recording medium according to claim 14 , wherein the method further comprises producing the depth information by comparing corresponding pixels between the captured first and second image where a contrast level of the pixels exceeds a given threshold value.

Assignees

• Sony Corp

Inventors

• Springer Paul
• Facius Zoltan
• Emmerich Thimo

Classifications

• A61B1/00009

  of image signals during a use of endoscope · CPC title

• A61B1/00186

  with imaging filters · CPC title

• H04N23/56

  provided with illuminating means · CPC title

• H04N23/555

  for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes · CPC title

• A61B1/00193

  adapted for stereoscopic vision · CPC title