Method and apparatus for encoding a point cloud representing three-dimensional objects

Patent metadata

Field	Value
Publication number	US-2019108655-A1
Application number	US-201816153741-A
Country	US
Kind code	A1
Filing date	Oct 6, 2018
Priority date	Oct 6, 2017
Publication date	Apr 11, 2019
Grant date	—

Abstract

A colored point cloud is encoded as at least two images. The point cloud is projected onto two maps, the second map comprising a set of blocks. An interest value is computed for each block of the second map as a function of the number of points of the point cloud projected onto the given block, not already projected on the first map. The first image is encoded in the stream as obtained by the projection while blocks of the second image are encoded according to their interest value. Blocks comprising no or a few new points over the first image and/or comprising a frontier are encoded in manner that minimize their bitrate as the information they carry is already stored in the first image.

First claim

1 . A method of encoding a three-dimensional point cloud, the method comprising:
projecting the point cloud onto a first surface to obtain a first image and onto a second surface to obtain a second image, the second image comprising a plurality of blocks, pixels of the first and the second image comprising a depth attribute; determining, for each block of the second image, an interest value relative to the number of points of the point cloud projected onto said block and not projected onto the first image; and encoding said first image and encoding blocks of said second image wherein a block of the second image is encoded according to a local quantization parameter determined according to the interest value of said block.

2 . The method of claim 1 , wherein a block of the second image is a block of a block-based encoding codec and wherein said encoding of the first image and blocks of the second image is performed according to said codec.

3 . The method of claim 1 , wherein said interest value is determined as a function of a ratio between a number of points projected onto said block and not projected onto said first image and of an average number of neighbor pixels in said block

4 . The method of claim 1 , wherein the depth attribute of pixels of a block of the second image is set to a predetermined depth value if the interest value of said block is lower than a threshold.

5 . The method of claim 1 , wherein pixels of the first and the second images comprise a color attribute and wherein the color attribute of pixels of a block of the second image are set to a predetermined color value if the interest value of said block is lower than a threshold.

6 . The method of claim 1 , wherein a block of the second image is encoded in a SKIP mode if the interest value of said block is lower than a threshold.

7 . The method of claim 1 , wherein depth attributes and color attributes of the second image are stored in a pair of one depth image and one texture image.

8 . A device for encoding a three-dimensional point cloud, the device comprising a memory associated with at least one processor configured to:
project the point cloud onto a first surface to obtain a first image and onto a second surface to obtain a second image, the second image comprising a plurality of blocks, pixels of the first and the second image comprising a depth attribute; determine, for each block of the second image, an interest value relative to the number of points of the point cloud projected onto said block and not projected onto the first image; and encode said first image and encode blocks of said second image wherein a block of the second image is encoded according to a local quantization parameter determined according to the interest value of the block.

9 . The device of claim 8 , wherein said processor is configured to determine said interest value associated with a block as a function of a ratio between a number of points projected onto said block and not projected onto said first image and of an average number of neighbor pixels in said block.

10 . The device of claim 8 , wherein the depth attribute of pixels of a block of the second image is set to a predetermined depth value if the interest value of said block is lower than a threshold

11 . The device of claim 8 , wherein a block of the second image is encoded in a SKIP mode if the interest value of said block is lower than a threshold

12 . The device of claim 8 , wherein depth attributes and color attributes of the second image are stored in a pair of one depth image and one texture image.

13 . A stream carrying data representative of a three-dimensional point cloud, the stream encoding a first image and a second image, pixels of said first and second images comprising at least a depth attribute and blocks of said second image being encoding according to an interest value determined, for each block, according to the number of points of said point cloud projected onto said block and not projected onto first image.

Assignees

• Interdigital Vc Holdings Inc

Inventors

• Lasserre Sebastien
• Ricard Julien
• Olivier Yannick

Classifications

• G06T9/001 Primary

  Model-based coding, e.g. wire frame · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T2207/20021

  Dividing image into blocks, subimages or windows · CPC title

• G06T15/40

  Hidden part removal · CPC title

• G06T7/50

  Depth or shape recovery · CPC title