Method and apparatus for increasing the resolution of a time of flight pixel array

Patent metadata

Field	Value
Publication number	US-10054673-B2
Application number	US-201815888163-A
Country	US
Kind code	B2
Filing date	Feb 5, 2018
Priority date	Jul 20, 2015
Publication date	Aug 21, 2018
Grant date	Aug 21, 2018

Abstract

An apparatus is described having an image signal processor. The image signal processor has a plurality of depth calculation units to calculate a respective time of flight depth value for different pixel array locations. Each of the plurality of depth calculation units is to receive a response signal from a same pixel in a pixel array so that the plurality of depth calculation units are able to calculate multiple depth values for the different locations of the pixel array from respective response signals from different groups of pixels in the pixel array of which the pixel is a member. Each of the groups include pixels of different receive clock phases sufficient to calculate a respective depth value. Another apparatus is also described where multiple depth values are similarly calculated from different groups of pixels that each include a same pixel but where a depth calculation unit calculates each of the multiple depth values.

First claim

The invention claimed is:

1. A computer-implemented method comprising:
providing, by a particular pixel that is a member of multiple different pixel groups and that has an associated receive clock phase, a time of flight response signal to multiple depth calculation units that are each configured to calculate a depth value for a respective one of the multiple different pixel groups of which the particular pixel is a member; and
calculating, by the multiple depth calculation units, different depth values from different sets of response signals that are provided by the multiple different pixel groups each of said different sets of response signals being generated with receive clock phases sufficient to perform a time of flight depth calculation, and each of said different sets of response signals sharing only the time of flight response signal provided by the particular pixel that is a member of the multiple different pixel groups.

2. The method of claim 1 , wherein the different depth values are concurrently generated.

3. The method of claim 1 , wherein the different depth values are calculated using with logic circuitry.

4. The method of claim 1 , wherein the different depth values are calculated using executing program code.

5. The method of claim 4 , comprising executing the program code on a multi-threaded processor where a different thread is allocated to a different time of flight depth calculation.

6. A system comprising one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
providing, by a particular pixel that is a member of multiple different pixel groups and that has an associated receive clock phase, a time of flight response signal to multiple depth calculation units that are each configured to calculate a depth value for a respective one of the multiple different pixel groups of which the particular pixel is a member; and
calculating, by the multiple depth calculation units, different depth values from different sets of response signals that are provided by the multiple different pixel groups each of said different sets of response signals being generated with receive clock phases sufficient to perform a time of flight depth calculation, and each of said different sets of response signals sharing only the time of flight response signal provided by the particular pixel that is a member of the multiple different pixel groups.

7. The system of claim 6 , wherein the different depth values are concurrently generated.

8. The system of claim 6 , wherein the different depth values are calculated using with logic circuitry.

9. The system of claim 6 , wherein the different depth values are calculated using executing program code.

10. The system of claim 9 , wherein the operations comprise executing the program code on a multi-threaded processor where a different thread is allocated to a different time of flight depth calculation.

11. A computer-readable storage device storing instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
providing, by a particular pixel that is a member of multiple different pixel groups and that has an associated receive clock phase, a time of flight response signal to multiple depth calculation units that are each configured to calculate a depth value for a respective one of the multiple different pixel groups of which the particular pixel is a member; and
calculating, by the multiple depth calculation units, different depth values from different sets of response signals that are provided by the multiple different pixel groups each of said different sets of response signals being generated with receive clock phases sufficient to perform a time of flight depth calculation, and each of said different sets of response signals sharing only the time of flight response signal provided by the particular pixel that is a member of the multiple different pixel groups.

12. The device of claim 11 , wherein the different depth values are concurrently generated.

13. The device of claim 11 , wherein the different depth values are calculated using with logic circuitry.

14. The device of claim 11 , wherein the different depth values are calculated using executing program code.

15. The device of claim 14 , wherein the operations comprise executing the program code on a multi-threaded processor where a different thread is allocated to a different time of flight depth calculation.

Assignees

• Google Llc

Inventors

• Cardei Vlad Constantin

Classifications

• H04N25/771

  comprising storage means other than floating diffusion · CPC title

• G06T7/50

  Depth or shape recovery · CPC title

• G01S17/894

  Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar · CPC title

• G06T15/20

  Perspective computation · CPC title

• G01S7/4808 Primary

  Evaluating distance, position or velocity data · CPC title