Image sensors for robust on chip phase detection, and associated system and methods

Patent metadata

Field	Value
Publication number	US-9485442-B1
Application number	US-201514714997-A
Country	US
Kind code	B1
Filing date	May 18, 2015
Priority date	May 18, 2015
Publication date	Nov 1, 2016
Grant date	Nov 1, 2016

Abstract

An image sensor for on-chip phase detection includes a pixel array for capturing an image of a scene, wherein the pixel array has a plurality of horizontal phase-detection rows, each including phase-detection pixels for detecting horizontal change in the scene, and a plurality of vertical phase-detection columns, each including phase-detection pixels for detecting vertical change in the scene, and wherein each of the horizontal phase-detection rows intersects each of the vertical phase-detection columns. A phase-detection method includes generating a pair of horizontal line profiles using one of a plurality of phase-detection rows; generating a pair of vertical line profiles using one of a plurality of phase-detection columns intersecting with the one of a plurality of phase-detection rows; and determining phase shift associated with at least one arbitrarily oriented edge in a scene, based upon the pair of horizontal line profiles and the pair of vertical line profiles.

First claim

What is claimed is:

1. An image sensor for on-chip phase detection, comprising:
a pixel array for capturing an image of a scene, the pixel array including:
a plurality of horizontal phase-detection rows, each including a first plurality of phase-detection pixels, comprising a plurality of left-masked pixels and a plurality of right-masked pixels, for detecting horizontal change in the scene, and
a plurality of vertical phase-detection columns, each including a second plurality of phase-detection pixels, comprising a plurality of top-masked pixels and a plurality of bottom-masked pixels, for detecting vertical change in the scene;

wherein each of the plurality of horizontal phase-detection rows intersects each of the plurality of vertical phase-detection columns.

2. The image sensor of claim 1 ,
the left-masked pixels and the right-masked pixels, of each of the horizontal phase-detection rows, being arranged in a horizontally oriented series of phase-detection pixel pairs, each phase-detection pixel pair including one of the left-masked pixels and one of the right-masked pixels; and
the top-masked pixels and the bottom-masked pixels, of each of the vertical phase-detection columns, being arranged in a vertically oriented series of phase-detection pixel pairs, each phase-detection pixel pair including one of the top-masked pixels and one of the bottom-masked pixels.

3. The image sensor of claim 2 ,
within each of the horizontal phase-detection rows, the left-masked pixels being vertically offset from the right-masked pixels; and
within each of the vertical phase-detection columns, the top-masked pixels being horizontally offset from the bottom-masked pixels.

4. The image sensor of claim 1 , each of the phase-detection pixels being adjacent only to pixels, of the pixel array, that are not phase-detection pixels.

5. The image sensor of claim 1 ,
each of the horizontal phase-detection rows spanning horizontal extent of the pixel array; and
each of the vertical phase-detection columns spanning vertical extent of the pixel array.

6. The image sensor of claim 5 ,
the plurality of horizontal phase-detection rows comprising at least ten phase-detection rows; and
the plurality of vertical phase-detection columns comprising at least ten phase-detection columns.

7. An image sensor for on-chip phase detection, comprising:
a pixel array for capturing an image of a scene, the pixel array being composed of a plurality of color pixel groups for generating a color image of the scene, each of the color pixel groups having a plurality of types of color-sensitive pixels sensitive to a respective plurality of colors, the pixel array including:
(a) a plurality of horizontal phase-detection rows, each including a first plurality of phase-detection pixels for detecting horizontal change in the scene, and
(b) a plurality of vertical phase-detection columns, each including a second plurality of phase-detection pixels for detecting vertical change in the scene,
each of the plurality of vertical phase-detection columns intersecting each of the plurality of horizontal phase-detection rows, all of the first and second phase-detection pixels being of same one of the plurality of types;

the plurality of color pixel groups including:
a plurality of non-phase-detection color pixel groups including no phase-detection pixels, and
a plurality of phase-detection color pixel groups, each including at most one of the phase-detection pixels and being adjacent to at most two other ones of the phase-detection color pixel groups.

8. A phase-detection method using an image sensor with on-chip phase-detection pixels, the method comprising:
generating a pair of horizontal line profiles for light from left and right directions, respectively, using one of a plurality of horizontal phase-detection rows of the image sensor, the pair of horizontal line profiles comprising (a) a line profile produced by a plurality of left-masked pixels arranged in a first horizontal pixel row and (b) a line profile produced by a plurality of right-masked pixels arranged in a second horizontal pixel row;
generating a pair of vertical line profiles for light from up and down directions, respectively, using one of a plurality of vertical phase-detection columns of the image sensor, the one of a plurality of vertical phase-detection columns intersecting the one of a plurality of horizontal phase-detection rows, the pair of vertical line profiles comprising (a) a line profile produced by a plurality of top-masked pixels arranged in a first vertical pixel column and (b) a line profile produced by a plurality of bottom-masked pixels arranged in a second vertical pixel column; and
determining phase shift associated with at least one arbitrarily oriented edge in a scene viewed by the image sensor, based upon the pair of horizontal line profiles and the pair of vertical line profiles.

9. The method of claim 8 , further comprising:
adjusting focus of an imaging objective to reduce the phase shift.

10. The method of claim 9 , further comprising:
capturing an image of the scene using the image sensor.

11. The method of claim 10 ,
the step of generating a pair of horizontal line profiles comprising using a first portion of a plurality of phase-detection pixels associated with the plurality of horizontal phase-detection rows;
the step of generating a pair of vertical line profiles comprising using a second portion of a plurality of phase-detection pixels associated with the plurality of vertical phase-detection columns; and
the method further comprising correcting contribution to the image, from each of the phase-detection pixels associated with the plurality of horizontal phase-detection rows and each of the phase-detection pixels associated with the plurality of vertical phase-detection columns, based upon respectively adjacent non-phase-detection pixels of corresponding color-sensitivity.

12. The method of claim 8 , the step of determining phase shift comprising:
identifying feature, associated with the arbitrarily oriented edge, in at least one of (a) the pair of horizontal line profiles and (b) the pair of vertical line profiles;
evaluating, for at least one of (a) the pair of horizontal line profiles and (b) the pair of vertical line profiles, phase shift of the feature; and
defining the phase shift of the arbitrarily oriented edge as the value of the phase shift of the feature.

13. A phase-detection method using an image sensor with on-chip phase-detection pixels arranged in a plurality of horizontal phase-detection rows and a plurality of vertical phase-detection columns, the method comprising:
selecting a region of interest having arbitrary location and being associated with the arbitrarily oriented edge, the region of interest having extent sufficient to include (a) at least one portion of at least one of the plurality of horizontal phase-detection rows and (b) at least one portion of at least one of the plurality vertical columns of phase-detection pixels;
generating a pair of horizontal line profiles for light from left and right directions, respectively, for each of the at least one portion of each of the at least one of the plurality of horizontal phase-detection rows;
generating a pair of vertical line profiles for light from up and down directions, respectively, for each of the at least one portion of each of the at least one of the plurality of vertical phase-detection columns; and
determining phase shift associated with at least one arbitrarily oriented edge in a scene viewed by the image sensor, based upon one or more pairs of line profiles measured in the step of generating a

Assignees

• Omnivision Tech Inc
• Omnivision Technololgies Inc

Inventors

• Li Chengjun
• Liu Guansong
• Shan Jizhang
• Pang Chin Poh

Classifications

• H04N25/136

  using complementary colours · CPC title

• H04N25/704 Primary

  Pixels specially adapted for focusing, e.g. phase difference pixel sets · CPC title

• H04N23/672 Primary

  based on the phase difference signals · CPC title

• H04N23/54 Primary

  Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils · CPC title

• H04N23/55

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title