Processing a point cloud

Patent metadata

Field	Value
Publication number	US-11949889-B2
Application number	US-201916962646-A
Country	US
Kind code	B2
Filing date	Jan 21, 2019
Priority date	Jan 19, 2018
Publication date	Apr 2, 2024
Grant date	Apr 2, 2024

Abstract

At least one embodiment relates to a method for padding a first depth image representative of depth values of nearer points of a point cloud frame and a second depth image representative of depth values of farther points of a point cloud frame. The method also comprises encoding a video stream including a time-interleaving of said encoded first and second images. There is also provided a method comprising decoding a video stream to provide a first depth image representative of depth values of nearer points of a point cloud frame and a second depth image representative of depth values of farther points of a point cloud frame; and filtering pixel values of the second depth image by using pixel values of the first depth image.

First claim

The invention claimed is:

1. A method, comprising:
padding a first depth image representative of a first set of depth values of first points of a point cloud frame, wherein the first points are nearer points of a point cloud from a projection plane;
padding a second depth image representative of a second set of depth values of second points of the point cloud frame, wherein the second points are farther points of the point cloud from the projection plane, and wherein one of the padded first depth image or the padded second depth image is predicted by using the other of the padded first depth image or the padded second depth image as a reference image; and
encoding a video stream comprising interleaving of the first set of depth values of the padded first depth image and the second set of depth values of the padded second depth image of the point cloud frame.

2. A device comprising at least one processor configured to perform a method according to claim 1 .

3. A method, comprising:
receiving a video stream comprising a first depth image that is interleaved with a second depth image, wherein the first depth image is representative of a first set of depth values of first points associated with a point cloud frame, the first points being nearer points of a point cloud from a projection plane, and wherein the second depth image is representative of a second set of depth values of second points associated with the point cloud frame, the second points being farther points of the point cloud from the projection plane;
deinterleaving the first set of depth values of the first depth image and the second set of depth values of the second depth image associated with the point cloud frame; and
filtering pixel values of the second depth image by using pixel values of the first depth image and a surface thickness.

4. The method of claim 3 , wherein filtering pixel values of the second depth image is based on differences between the pixel values of the first depth image and the pixel values of the second depth image.

5. The method of claim 4 , wherein filtering pixel values comprises a clipping of the differences.

6. The method of claim 5 , wherein the clipping is based on a given range.

7. The method of claim 6 , wherein the given range extends from 0 to the surface thickness.

8. The method of claim 6 , wherein at least one bound of the given range is transmitted.

9. A computer program product including instructions stored on a non-transitory computer-readable medium which, when the program is executed by one or more processors, causes the one or more processors to carry out a method according to claim 3 .

10. A non-transitory computer-readable medium including instructions for causing one or more processors to perform a method according to claim 1 .

11. A non-transitory computer-readable medium including instructions for causing one or more processors to perform a method according to claim 3 .

12. A device, comprising:
a processor configured to:
receive a video stream comprising a first depth image that is interleaved with a second depth image, wherein the first depth image is representative of a first set of depth values of first points associated with a point cloud frame, the first points being nearer points of a point cloud from a projection plane, and wherein the second depth image is representative of a second set of depth values of second points associated with the point cloud frame, the second points being farther points of the point cloud from the projection plane;
deinterleave the first set of depth values of the first depth image and the second set of depth values of the second depth image associated with the point cloud frame; and
filter pixel values of the second depth image by using pixel values of the first depth image and a surface thickness.

13. The device of claim 12 , wherein filtering pixel values of the second depth image is based on differences between the pixel values of the first depth image and the pixel values of the second depth image.

14. The device of claim 13 , wherein filtering pixel values comprises a clipping of the differences.

15. The device of claim 14 , wherein the clipping is based on a given range.

16. The device of claim 15 , wherein the given range extends from 0 to the surface thickness.

17. The device of claim 15 , wherein at least one bound of the given range is transmitted.

Assignees

• Interdigital Vc Holdings Inc

Inventors

• Chevet Jean-Claude
• Llach Pinsach Joan
• Cai Kangying

Classifications

• H04N19/88 Primary

  involving rearrangement of data among different coding units, e.g. shuffling, interleaving, scrambling or permutation of pixel data or permutation of transform coefficient data among different blocks · CPC title

• H04N19/80

  Details of filtering operations specially adapted for video compression, e.g. for pixel interpolation (H04N19/635, H04N19/86 take precedence) · CPC title

• H04N19/503

  involving temporal prediction (adaptive coding with adaptive selection between spatial and temporal predictive coding H04N19/107; adaptive coding with adaptive selection among a plurality of temporal predictive coding modes H04N19/109) · CPC title

• H04N19/33

  in the spatial domain · CPC title

• H04N19/182 Primary

  the unit being a pixel · CPC title