High-dynamic range image sensor and image-capture method

Patent metadata

Field	Value
Publication number	US-11064134-B2
Application number	US-201916558499-A
Country	US
Kind code	B2
Filing date	Sep 3, 2019
Priority date	Jun 5, 2019
Publication date	Jul 13, 2021
Grant date	Jul 13, 2021

Abstract

An image sensor includes a pixel array, and a first, second, and an intermediate memory-element. The memory-elements store, respectively, a first, second, and an intermediate exposure value. The pixel array includes pixel-subarrays each including a rescue pixel and a first, second, and third plurality of contiguous pixels. Each of the first plurality of pixels is connected to the first memory-element and spans diagonally-opposite corners of the pixel-subarray. Each of the second plurality of pixels is connected to the second memory-element and located on a first side of the first plurality of pixels. Each of the third plurality of pixels is connected to the second memory-element and located on a second side of the first plurality of pixels. The rescue-pixel is connected to the intermediate memory-element and is (i) located on one of the first side and the second side and/or (ii) adjacent to one of the first plurality of pixels.

First claim

What is claimed is:

1. An image sensor comprising:
a first memory element, a second memory element, and an intermediate memory element storing, respectively, a first exposure value, a second exposure value, and an intermediate exposure value between the first exposure value and the second exposure value, a relative difference between the first exposure value and the second exposure value exceeding ten percent; and
a pixel array including a plurality of rectangular pixel-subarrays, each including:
a first plurality of contiguous pixels each electrically connected to the first memory element and spanning diagonally-opposite corners of the rectangular pixel-subarray in a first direction,
a second plurality of contiguous pixels each electrically connected to the second memory element and located on a first side of the first plurality of contiguous pixels,
a third plurality of contiguous pixels each electrically connected to the second memory element and located on a second side of the first plurality of contiguous pixels, opposite the first side, and
a rescue-pixel electrically connected to the intermediate memory element and being at least one of (i) located on one of the first side and the second side and (ii) adjacent to one of the first plurality of contiguous pixels.

2. The image sensor of claim 1 , a total number of rescue pixels being between two percent and ten percent of a total number of pixels of the pixel array.

3. The image sensor of claim 1 , the intermediate exposure value differing from the first exposure value by at least fifty percent of the first exposure value.

4. The image sensor of claim 1 ,
each rescue-pixel being one of a red pixel aligned beneath a red color filter, a green pixel aligned beneath a green color filter, and a blue pixel aligned beneath a blue color filter;
the rescue-pixel being a two-by-two quadruplet of rescue-pixels including either (a) four red pixels, (b) four green pixels, (c) four blue pixels, or (d) one red pixel, two corner-adjacent green pixels, and one blue pixel, the image sensor further comprising:
a plurality of microlenses center-aligned to a respective two-by-two quadruplet.

5. The image sensor of claim 1 , the intermediate memory element being a single memory element storing the intermediate exposure value, the rescue-pixel being a first pair of side-adjacent rescue-pixels each electrically connected to the single memory element.

6. The image sensor of claim 5 , the first pair of side-adjacent rescue-pixels being beneath a same microlens.

7. The image sensor of claim 5 , the plurality of rectangular pixel-subarrays including a first rectangular pixel-subarray side-adjacent to a second rectangular pixel-subarray, the rescue-pixel of the first rectangular pixel-subarray being side-adjacent to the rescue-pixel of the second rectangular pixel-subarray.

8. The image sensor of claim 7 , the rescue-pixel of the first rectangular pixel-subarray and the rescue-pixel of the second rectangular pixel-subarray being beneath a same microlens.

9. The image sensor of claim 1 ,
the first memory element including a first plurality of memory sub-elements each storing the first exposure value; and
the second memory element including a second plurality of memory sub-elements each storing the second exposure value.

10. An image sensor comprising:
a first memory element, a second memory element, and an intermediate memory element storing, respectively, a low exposure value, a high exposure value, and an intermediate exposure value between the low exposure value and the high exposure value;
a pixel array including a plurality of red pixels aligned beneath a red color filter, a plurality of green pixels aligned beneath a green color filter, and a plurality of blue pixels aligned beneath a blue color filter;
the pixel array further including:
a plurality of low-exposure pixel-subarrays each including one red pixel, two green pixels, and one blue pixel in a Bayer configuration and each electrically connected to the first memory element, each one of the plurality of low-exposure pixel-subarrays being corner-adjacent to a different one of the plurality of low-exposure pixel-subarrays;
a plurality of high-exposure pixel-subarrays each including one red pixel, two green pixels, and one blue pixel in a Bayer configuration and each electrically connected to the second memory element, each one of the plurality of high-exposure pixel-subarrays being corner-adjacent to a different one of the plurality of high-exposure pixel-subarrays;
a plurality of green-red side-adjacent pixel-pairs each (a) electrically connected to the intermediate memory element and (b) including (i) a first intermediate-exposure green pixel and (ii) an intermediate-exposure red pixel that is part of a first two-by-two pixel non-Bayer subarray including a green pixel corner-adjacent to either a blue or a red pixel; and
a plurality of green-blue side-adjacent pixel-pairs each (a) electrically connected to the intermediate memory element and (b) including (i) a second intermediate-exposure green pixel and (ii) an intermediate-exposure blue pixel that is part of a second two-by-two pixel non-Bayer subarray including a green pixel corner-adjacent to either a blue or a red pixel.

11. The image sensor of claim 10 ,
the first two-by-two pixel non-Bayer subarray including a red pixel side-adjacent to the intermediate-exposure red pixel; and
the second two-by-two pixel non-Bayer sub array including a blue pixel side-adjacent to the intermediate-exposure blue pixel.

12. The image sensor of claim 10 ,
the first two-by-two pixel non-Bayer subarray including (i) a first green pixel of the plurality of green pixels, (ii) a first blue pixel of the plurality of blue pixels, and a (iii) first red pixel of the plurality of red pixels that are, respectively, corner-adjacent, side-adjacent, and side-adjacent to the intermediate-exposure red pixel, each of the first red pixel, the first green pixel, and the first blue pixel being electrically connected to a memory element storing a same first exposure value; and
the second two-by-two pixel non-Bayer subarray including (i) a first green pixel of the plurality of green pixels, (ii) a first blue pixel of the plurality of blue pixels, and a (iii) first red pixel of the plurality of red pixels that are, respectively, corner-adjacent, side-adjacent, and side-adjacent to the intermediate-exposure blue pixel, each of the first red pixel, the first green pixel, and the first blue pixel being electrically connected to a memory element storing a same second exposure value.

13. The image sensor of claim 12 , each of the first exposure value and the second exposure value being equal to one of the value and the high exposure value.

14. The image sensor of claim 10 , each of the first intermediate-exposure green pixel and the second intermediate-exposure green pixel being part of a respective two-by-two pixel Bayer subarray.

15. The image sensor of claim 10 ,
the intermediate memory element including a plurality of single memory elements each storing the intermediate exposure value;
for each of the plurality of green-red side-adjacent pixel-pairs, the first intermediate-exposure green pixel and the intermediate-exposure red pixel being electrically connected to a same single memory element of the plurality of single memory elements; and
for each of the plurality of green-blue side-adjacent pixel-pairs, the second intermediate-exposure green pixel and the intermediate-exposure blue pixel being electrically connected to a same single memory element of the plurality of single memory elements.

Assignees

• Omnivision Tech Inc

Inventors

• Liu Chengming
• Dai Tiejun
• Mann Richard

Classifications

• H04N25/11

  Arrangement of colour filter arrays [CFA]; Filter mosaics · CPC title

• H04N25/583

  with different integration times · CPC title

• H04N23/741 Primary

  by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors · CPC title

• H04N23/71 Primary

  Circuitry for evaluating the brightness variation · CPC title

• H04N25/57

  Control of the dynamic range · CPC title