Determining depth information from a single camera

Patent metadata

Field	Value
Publication number	US-11647175-B2
Application number	US-202017113011-A
Country	US
Kind code	B2
Filing date	Dec 5, 2020
Priority date	Dec 6, 2019
Publication date	May 9, 2023
Grant date	May 9, 2023

Abstract

An optical system comprises an imaging lens for imaging an object to an image and a sensing pixel array for detecting lights from the object toward the image. The sensing pixel array comprises a first sensing pixel and a second sensing pixel, each sensing pixel comprising a microlens covering a one-dimensional series of photodiodes having n photodiodes. A photodiode at an end of the one-dimensional series of photodiodes of the first sensing pixel detects a first light from the object toward the image, and a photodiode at an opposite end of the one-dimensional series of photodiodes of the second sensing pixel detects a second light from the object toward the image, where the first light and the second light pass opposite parts of the imaging lens.

First claim

What is claimed is:

1. An optical system comprising,
an imaging lens for imaging an object to an image; and
a sensing pixel array for detecting lights from the object, wherein each light passes different part of the imaging lens toward the image;
wherein the sensing pixel array comprises a first sensing pixel and a second sensing pixel, each sensing pixel comprising a microlens covering a one-dimensional series of photodiodes having n photodiodes, n is integer larger than two;
wherein a photodiode at an end of the one-dimensional series of photodiodes of the first sensing pixel detects a first light from the object toward the image, and a photodiode at an opposite end of the one-dimensional series of photodiodes of the second sensing pixel detects a second light from the object toward the image;
wherein the first light and the second light pass opposite parts of the imaging lens; and
wherein positions of the first sensing pixel and the second sensing pixel are used to determine a distance of the object to the imaging lens.

2. The optical system of claim 1 , wherein each of the first and second sensing pixels comprises the microlens covering a two-dimensional array of photodiodes having n×n photodiodes, n is integer larger than two, and wherein the two-dimensional array of photodiodes having n×n photodiodes includes the one-dimensional series of photodiodes having n photodiodes.

3. The optical system of claim 1 , wherein positions of the first sensing pixel and the second sensing pixel are determined by a correlation of a right image and a left image, wherein the right image comprises the first light detected by the photodiode at the end of the one-dimensional series of photodiodes of the first sensing pixel, and the left image comprises the second light detected by the photodiode at the opposite end of the one-dimensional series of photodiodes of the second sensing pixel.

4. The optical system of claim 1 , wherein n is 3.

5. The optical system of claim 1 , wherein photodiodes of the one-dimensional series of photodiodes having n photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the one-dimensional series of photodiodes having n photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is same as the second color.

6. The optical system of claim 1 , wherein photodiodes of the one-dimensional series of photodiodes having n photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the one-dimensional series of photodiodes having n photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is different from the second color.

7. The optical system of claim 2 , wherein photodiodes of the two-dimensional array of photodiodes having n×n photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the two-dimensional array of photodiodes having n×n photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is same as the second color.

8. The optical system of claim 2 , wherein photodiodes of the two-dimensional array of photodiodes having n×n photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the two-dimensional array of photodiodes having n×n photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is different from the second color.

9. An optical system comprising,
an imaging lens for imaging an object to an image;
a sensing pixel array for detecting lights from the object passing the imaging lens toward the image; and
a mask centered at an optical axis of the optical system blocking lights from the object passing central part of the imaging lens toward the image;
wherein the sensing pixel array comprises a first sensing pixel and a second sensing pixel, each sensing pixel comprising a microlens covering a pair of photodiodes;
wherein a photodiode at a side of the pair of photodiodes of the first sensing pixel detects a first light from the object toward the image, and a photodiode at an opposite side of the pair of photodiodes of the second sensing pixel detects a second light from the object toward the image;
wherein the first light and the second light pass opposite parts of the imaging lens; and
wherein positions of the first sensing pixel and the second sensing pixel are used to determine a distance of the object to the imaging lens.

10. The optical system of claim 9 , wherein each of the first and second sensing pixels comprises the microlens covering a two-dimensional array of photodiodes having 2×2 photodiodes, and wherein the two-dimensional array of photodiodes having 2×2 photodiodes includes the pair of photodiodes.

11. The optical system of claim 9 , wherein positions of the first sensing pixel and the second sensing pixel are determined by a correlation of a right image and a left image, wherein the right image comprises the first light detected by the photodiode at a side of the pair of photodiodes of the first sensing pixel, and the left image comprises the second light detected by the photodiode at an opposite side of the pair of photodiodes of the second sensing pixel.

12. The optical system of claim 9 , wherein photodiodes of the pair of photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the pair of photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is same as the second color.

13. The optical system of claim 9 , wherein photodiodes of the pair of photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the pair of photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is different from the second color.

14. The optical system of claim 10 , wherein photodiodes of the two-dimensional array of photodiodes having 2×2 photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the two-dimensional array of photodiodes having 2×2 photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is same as the second color.

15. The optical system of claim 10 wherein photodiodes of the two-dimensional array of photodiodes having 2×2 photodiodes of the first sensing pixel are covered by a color filter of a first color, and photodiodes of the two-dimensional array of photodiodes having 2×2 photodiodes of the second sensing pixel are covered by a color filter of a second color, the first color is different from the second color.

16. The optical system of claim 9 , wherein the mask is removable.

17. The optical system of claim 9 , wherein the mask is a circular mask.

18. The optical system of claim 9 , wherein the mask is a cross shape mask.

19. The optical system of claim 9 , wherein the mask is a liquid crystal switch blocking lights from the object passing central part of the imaging lens toward the image.

20. The optical system of claim 19 , wherein the liquid crystal switch has an opaque part of one of circular shape and cross shape.

Assignees

• Omnivision Tech Inc

Inventors

• Mann Richard
• Padmanabhan Badrinath
• Fowler Boyd
• Bonakdar Alireza
• Funatsu Eiichi

Classifications

• G06T7/571

  from focus · CPC title

• H04N13/257

  Colour aspects · CPC title

• H04N23/672

  based on the phase difference signals · CPC title

• H04N13/218 Primary

  using spatial multiplexing · CPC title

• G06T7/593

  from stereo images · CPC title