Optical scope system for capturing an image of a scene

Patent metadata

Field	Value
Publication number	US-11146723-B2
Application number	US-201716464688-A
Country	US
Kind code	B2
Filing date	Dec 14, 2017
Priority date	Dec 16, 2016
Publication date	Oct 12, 2021
Grant date	Oct 12, 2021

Abstract

An optical device for capturing an image of a scene, the optical device comprising: a plurality of image sensors each operable to capture a respective initial image of the scene; a lens arrangement operable to receive light from the scene and to form each initial image on each respective image sensor, each image sensor being located at a different respective distance from the lens arrangement; and an image processor operable to generate the captured image of the scene on the basis of image data from one or more of the captured initial images.

First claim

The invention claimed is:

1. An optical scope system for capturing an image of a scene, the optical scope system comprising:
a plurality of image sensors each operable to capture a respective initial image of the scene, each of the image sensors is operable to capture light using a different respective one of red, green and blue (RGB) color channels; and
at least one lens to receive light from the scene and to form each initial image on each respective image sensor, each image sensor being located at a different respective distance from the at least one lens; and
an image processor operable to:
divide each of the captured initial images into predetermined portions;
determine an image sharpness level for corresponding predetermined portions of each of the captured initial images;
determine the highest one of the determined image sharpness levels; and
generate, on the basis of image data from each of the captured initial images, the captured image of the scene so that a portion of the captured image of the scene corresponding to the corresponding predetermined portions of each of the captured initial images has a sharpness level equal to the determined highest image sharpness level, including
transporting the image sharpness level of the one of the corresponding predetermined portions of the captured initial images which has the determined highest image sharpness level to the other corresponding predetermined portions of the captured initial images; and
combining the one of the corresponding predetermined portions of the captured initial images which has the determined highest image sharpness level with the other corresponding predetermined portions of the captured initial images to which the determined highest image sharpness level has been transported.

2. The optical scope system according to claim 1 , wherein each of the plurality of image sensors is located along a different respective optical path with respect to the at least one lens.

3. The optical scope system according to claim 1 , herein the at least one lens receives light from the scene captured by an optical instrument and to form the initial image of the scene on each image sensor using the received light, wherein the distance of each respective image sensor from the at least one lens is determined on the basis of one or more characteristics of the optical instrument.

4. The optical scope system according to claim 3 , comprising a plurality of image sensor adjustment devices each operable to adjust the distance of a respective one of the image sensors from the at least one lens.

5. The optical scope system according to claim 4 , comprising:
a user interface operable to receive information from a user for determining the distance of each respective image sensor from the at least one lens; and
a controller operable to control the image sensor adjustment devices to adjust the distance of each respective image sensor from the at least one lens on the basis the received information.

6. The optical scope system according to claim 4 , comprising:
an instrument interface operable to receive information from the optical instrument for determining the distance of each respective image sensor from the at least one lens; and
a controller operable to control the image sensor adjustment devices to adjust the distance of each respective image sensor from the at least one lens on the basis the received information.

7. The optical scope system according to claim 6 , wherein the information for determining the distance of each respective image sensor from the at least one lens comprises (a) the distance of each respective image sensor from the at least one lens, (b) one or more optical properties of the optical instrument on the basis of which the controller is configured to calculate the distance of each respective image sensor from the at least one lens, or (c) an identifier of the optical instrument on the basis of which the controller is configured to consult a database in order to obtain the distance of each respective image sensor from the at least one lens or the one or more optical properties of the optical instrument for calculating the distance of each respective image sensor from the at least one lens.

8. The optical scope system according to claim 3 , wherein the optical instrument is an endoscope.

9. The optical scope system according to claim 8 , wherein the endoscope is a medical endoscope.

10. An endoscopic system comprising an optical scope system according to claim 3 and an optical instrument configured to capture light from the scene for use by the at least one lens of the optical instrument in forming an initial image of the scene on each image sensor of the optical instrument.

11. A method of capturing an image of a scene in an optical scope system, the method comprising:
capturing a plurality of initial images of the scene, each initial image of the scene being captured using a respective one of a plurality of image sensors, wherein each image sensor is located at a different respective distance from at least one lens to receive light from the scene and to form each initial image on each respective image sensor, each of the image sensors is operable to capture light using a different respective one of red, green and blue (RGB) color channels r;
dividing each of the captured initial images into predetermined portions;
determine an image sharpness level for corresponding predetermined portions of each of the captured initial images;
determining the highest one of the determined image sharpness levels; and
generating, on the basis of image data from each of the captured initial images, the captured image of the scene so that a portion of the captured image of the scene corresponding to the corresponding predetermined portions of each of the captured initial images has a sharpness level equal to the determined highest image sharpness level generating including
transporting the image sharpness level of the one of the corresponding predetermined portions of the captured initial images which has the determined highest image sharpness level to the other corresponding predetermined portions of the captured initial images; and
combining the one of the corresponding predetermined portions of the captured initial images which has the determined highest image sharpness level with the other corresponding predetermined portions of the captured initial images to which the determined highest image sharpness level has been transported.

12. A non-transitory recording medium storing a computer program for controlling a computer to perform a method according to claim 11 .

13. An optical scope system for capturing an image of a scene comprising circuitry configured to perform a method according to claim 11 .

Assignees

• Sony Corp

Inventors

• Emmerich Thimo
• Facius Zoltan
• Springer Paul

Classifications

• G02B23/2484 Primary

  Arrangements in relation to a camera or imaging device (processing or control of video signals generated by an endoscope H04N23/60, H04N23/70) · CPC title

• H04N23/617

  Upgrading or updating of programs or applications for camera control · CPC title

• H04N23/676

  Bracketing for image capture at varying focusing conditions · CPC title

• H04N23/62

  Control of parameters via user interfaces · CPC title

• H04N23/67

  Focus control based on electronic image sensor signals · CPC title