Optical scope system for capturing an image of a scene

Patent metadata

Field	Value
Publication number	US-11729522-B2
Application number	US-202117495828-A
Country	US
Kind code	B2
Filing date	Oct 7, 2021
Priority date	Dec 16, 2016
Publication date	Aug 15, 2023
Grant date	Aug 15, 2023

Abstract

An optical device for capturing an image of a scene, the optical device comprising: a plurality of image sensors each operable to capture a respective initial image of the scene; a lens arrangement operable to receive light from the scene and to form each initial image on each respective image sensor, each image sensor being located at a different respective distance from the lens arrangement; and an image processor operable to generate the captured image of the scene on the basis of image data from one or more of the captured initial images.

First claim

The invention claimed is:

1. An optical scope system for capturing an image of a scene, the optical scope system comprising:
a plurality of image sensors each operable to capture a respective initial image of the scene;
at least one lens to receive light from the scene and to form each initial image on each respective image sensor, each image sensor being located at a different respective distance from the at least one lens and at an angle relative to other image sensors; and
an image processor operable to:
divide each of the captured initial images into predetermined portions;
determine an image sharpness level for corresponding predetermined portions of each of the captured initial images;
determine the highest one of the determined image sharpness levels; and
generate, on the basis of image data from each of the captured initial images, the captured image of the scene the captured image of the scene so that a portion of the captured image of the scene corresponding to the corresponding predetermined portions of each of the captured initial images has a sharpness level equal to the determined highest image sharpness level.

2. The optical scope system according to claim 1 , wherein:
each of the image sensors is operable to capture light using each of red, green and blue (RGB) colour channels; and
the image processor is operable to generate the portion of the captured image of the scene corresponding to the corresponding portions the captured initial images on the basis of the one of the corresponding portions of the captured initial images which has the determined highest image sharpness level.

3. The optical scope system according to claim 1 , wherein:
the image processor is operable to generate the portion of the captured image of the scene corresponding to the corresponding portions of the captured initial images by:
transporting the image sharpness level of the one of the corresponding portions of the captured initial images which has the determined highest image sharpness level to the other corresponding portions of the captured initial images; and
combining the one of the corresponding portions of the captured initial images which has the determined highest image sharpness level with the other corresponding portions of the captured initial images to which the determined highest image sharpness level has been transported.

4. The optical scope system according to claim 1 , wherein each of the plurality of image sensors is located along a different respective optical path with respect to the at least one lens.

5. The optical scope system according to claim 1 , wherein the lens arrangement is operable to receive light from the scene captured by an optical instrument and to form the initial image of the scene on each image sensor using the received light, wherein the distance of each respective image sensor from the at least one lens is determined on the basis of one or more characteristics of the optical instrument.

6. The optical scope system according to claim 5 , comprising a plurality of image sensor adjustment devices each operable to adjust the distance of a respective one of the image sensors from the at least one lens.

7. The optical scope system according to claim 6 , comprising:
a user interface operable to receive information from a user for determining the distance of each respective image sensor from the at least one lens; and
a controller operable to control the image sensor adjustment devices to adjust the distance of each respective image sensor from the at least one lens on the basis the received information.

8. The optical scope system according to claim 6 , comprising:
an instrument interface operable to receive information from the optical instrument for determining the distance of each respective image sensor from the at least one lens; and
a controller operable to control the image sensor adjustment devices to adjust the distance of each respective image sensor from the at least one lens on the basis the received information.

9. The optical scope system according to claim 8 , wherein the information for determining the distance of each respective image sensor from the at least one lens comprises (a) the distance of each respective image sensor from the lens arrangement, (b) one or more optical properties of the optical instrument on the basis of which the controller is configured to calculate the distance of each respective image sensor from the at least one lens, or (c) an identifier of the optical instrument on the basis of which the controller is configured to consult a database in order to obtain the distance of each respective image sensor from the at least one lens or the one or more optical properties of the optical instrument for calculating the distance of each respective image sensor from the lens arrangement.

10. The optical scope system according to claim 5 , wherein the optical instrument is an endoscope.

11. The optical scope system according to claim 10 , wherein the endoscope is a medical endoscope.

12. An endoscopic system comprising an optical scope system according to claim 5 and an optical instrument configured to capture light from the scene for use by the lens arrangement of the optical device in forming an initial image of the scene on each image sensor of the optical device.

13. A method of capturing an image of a scene in an optical scope system, the method comprising:
capturing a plurality of initial images of the scene, each initial image of the scene being captured using a respective one of a plurality of image sensors, wherein each image sensor is located at a different respective distance from at least one lens and at an angle relative to other image sensors, each image sensor being operable to receive light from the scene and to form each initial image on each respective image sensor;
dividing each of the captured initial images into predetermined portions;
determining an image sharpness level for corresponding predetermined portions of each of the captured initial images;
determining the highest one of the determined image sharpness levels; and
generating, on the basis of image data from each of the captured initial images, the captured image of the scene so that a portion of the captured image of the scene corresponding to the corresponding predetermined portions of each of the captured initial images has a sharpness level equal to the determined highest image sharpness level.

14. A non-transitory recording medium storing a computer program for controlling a computer to perform a method according to claim 13 .

15. An optical scope system for capturing an image of a scene comprising means configured to perform a method according to claim 13 .

16. The method according to claim 13 , further comprising:
transporting the image sharpness level of the one of the corresponding predetermined portions of the captured initial images which has the determined highest image sharpness level to the other corresponding predetermined portions of the captured initial images; and
combining the one of the corresponding predetermined portions of the captured initial images which has the determined highest image sharpness level with the other corresponding predetermined portions of the captured initial images to which the determined highest image sharpness level has been transported into a combined image.

Assignees

• Sony Group Corp

Inventors

• Emmerich Thimo
• Facius Zoltan
• Springer Paul

Classifications

• H04N23/959 Primary

  by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics · CPC title

• A61B1/00188

  with focusing or zooming features · CPC title

• A61B1/045

  Control thereof · CPC title

• H04N23/16

  Optical arrangements associated therewith, e.g. for beam-splitting or for colour correction · CPC title

• H04N23/55

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title