Time-of-flight down-up sampling using a compressed guide

US2021400217A1 · US · A1

Patent metadata
FieldValue
Publication numberUS-2021400217-A1
Application numberUS-202016908722-A
CountryUS
Kind codeA1
Filing dateJun 22, 2020
Priority dateJun 22, 2020
Publication dateDec 23, 2021
Grant date

How to read this patent

A practical reading order for non-experts. Skip the full description unless you need deep technical detail.

  1. Title

    What the patent document calls the invention.

  2. Abstract

    A short plain-language summary of the technical disclosure.

  3. Assignees and inventors

    Who owns or filed the patent and who is credited as inventor.

  4. Key dates

    Filing, priority, publication, and grant dates set the timeline.

  5. First independent claim

    The legal scope of protection — read this for what is actually claimed.

  6. CPC / IPC classifications

    Technology tags used to group this patent with similar filings.

  7. Citations and related patents

    Prior art links and similar publications in this corpus.

Abstract

Official abstract text for this publication.

A method for time-of-flight (ToF) guided down-up sampling includes calculating a guide function from a full resolution output of a ToF sensor, downsampling the full resolution output by a predetermined scaling factor, calculating a downsampled depth data from the downsampled output and upsampling the downsampled depth data to full resolution using the full resolution guide function.

First claim

Opening claim text (preview).

What is claimed is: 1 . A method for time-of-flight (ToF) guided down-up sampling, the method comprising the steps of: calculating a guide function from a full resolution output of a ToF sensor; downsampling the full resolution output by a predetermined scaling factor; calculating a downsampled depth data from the downsampled output; and upsampling the downsampled depth data to full resolution using the full resolution guide function. 2 . The method of claim 1 , further comprising filtering the full resolution output. 3 . The method of claim 1 , further comprising: processing the downsampled output in an image signal processing (ISP) chain; and calculating a full resolution point cloud from the full resolution depth data. 4 . The method of claim 1 , wherein the output includes a set of phase measurements A 0 , A 90 , A 180 and A 270 that are samples of a correlation of a received signal and a reference signal, and are represented as four images at the full resolution output of the ToF sensor. 5 . The method of claim 4 , further comprising calculating first and second phase differences from the full resolution output, wherein the guide function is defined as A 0 + A 90 ⁢ A 180 + A 270 4 , the first phase difference is defined as A 270 −A 0 and the second phase difference is defined as A 0 −A 180 . 6 . The method of claim 1 , wherein upsampling the downsampled depth data to full resolution comprises: representing the downscaled depth data in an upscaled domain according to Z ^ ⁡ [ i , j ] = z d ⁡ [ i a , j a ] , wherein {circumflex over (Z)} is the depth data on the upscaled domain, z d is the downscaled depth data, and α is the down-up sampling factor; and reconstructing the full resolution depth data according to Z ^ i , j = ∑ n ∈ supp ⁢ ⁢ i ⁢ ∑ m ∈ supp ⁢ ⁢ j ⁢ Z ^ n , m ⁢ W S ⁡ ( Guide n , m , Guide i , j ) ⁢ Mask n , m ∑ n ∈ supp ⁢ ⁢ i ⁢ ∑ m ∈ supp ⁢ ⁢ j ⁢ W S ⁡ ( Guide

Assignees

Inventors

Classifications

  • H04N25/705Primary

    Pixels for depth measurement, e.g. RGBZ · CPC title

  • Noise processing, e.g. detecting, correcting, reducing or removing noise · CPC title

  • Time delay measurement, e.g. operational details for pixel components (signal extraction and conditioning G01S7/493); Phase measurement · CPC title

  • G01S17/894Primary

    Three-dimensional [3D] imaging with simultaneous measurement of time-of-flight at a two-dimensional [2D] array of receiver pixels, e.g. time-of-flight cameras or flash lidar · CPC title

  • with phase comparison between the received signal and the contemporaneously transmitted signal · CPC title

Patent family

Related publications grouped by family.

External sources

Frequently asked questions

Answers are generated from the same data shown on this page.

What does patent US2021400217A1 cover?
A method for time-of-flight (ToF) guided down-up sampling includes calculating a guide function from a full resolution output of a ToF sensor, downsampling the full resolution output by a predetermined scaling factor, calculating a downsampled depth data from the downsampled output and upsampling the downsampled depth data to full resolution using the full resolution guide function.
Who is the assignee on this patent?
Samsung Electronics Co Ltd
What technology area does this patent fall under?
Primary CPC classification H04N25/705. Mapped technology areas include Electricity.
When was this patent published?
Publication date Thu Dec 23 2021 00:00:00 GMT+0000 (Coordinated Universal Time) (A1). Legal status and post-grant events are not shown on this page.
What related patents are in patentsdb?
We list 3 related publications on this page (citations in our corpus or others sharing the same primary CPC).