Multi-plane image compression

Patent metadata

Field	Value
Publication number	US-12450780-B2
Application number	US-202117926532-A
Country	US
Kind code	B2
Filing date	Jun 18, 2021
Priority date	Jun 19, 2020
Publication date	Oct 21, 2025
Grant date	Oct 21, 2025

Abstract

Example methods, apparatus, systems and articles of manufacture (e.g., physical storage media) to implement multi-plane image (MPI) compression are disclosed. Example apparatus disclosed herein include an interface to access an input multiplane image stack corresponding to a source camera viewpoint, the input multiplane image stack including a plurality of texture images and a corresponding plurality of alpha images, ones of the alpha images including pixel values representative of transparency of corresponding pixels in respective ones of the texture images. Disclosed example apparatus also include a compressed image encoder to at least one of (i) convert the plurality of texture images to a single composite texture image to generate a compressed multiplane image stack, or (ii) convert the plurality of alpha images to a single composite alpha image to generate the compressed multiplane image stack. In some disclosed examples, the interface is to output the compressed multiplane image stack.

First claim

What is claimed is:

1. An apparatus to compress multiplane image stacks, the apparatus comprising:
interface circuitry;
machine readable instructions; and
at least one programmable circuit to be programmed based on the machine readable instructions to:
access an input multiplane image stack corresponding to a source camera viewpoint, the input multiplane image stack including a plurality of texture images and a corresponding plurality of alpha images, ones of the alpha images including pixel values representative of transparency of corresponding pixels in respective ones of the texture images; and
at least one of (i) replace the plurality of texture images with a source camera image associated with the source camera viewpoint corresponding to the input multiplane image stack to convert the plurality of texture images to a single composite texture image, or (ii) convert the plurality of alpha images to a single composite alpha image including a composite alpha value at a pixel position of the single composite alpha image, the composite alpha value based on a combination of an alpha plane index value and a bias value, the alpha plane index value based on a value of a source camera depth image at the pixel position, the bias value based on the alpha plane index value and the value of the source camera depth image at the pixel position, the source camera depth image associated with the source camera viewpoint corresponding to the input multiplane image stack;
generate a compressed multiplane image stack based on at least one of the single composite texture image or the single composite alpha image; and
output the compressed multiplane image stack.

2. The apparatus of claim 1 , wherein the single composite texture image is a first composite texture image, and one or more of the at least one programmable circuit is to:
access a second input multiplane image stack including a second plurality of texture images and a corresponding second plurality of alpha images;
combine the second plurality of texture images based on the second plurality of alpha images to convert the second plurality of texture images to a second composite texture image; and
generate a second compressed multiplane image stack based on the second composite texture image.

3. The apparatus of claim 2 , wherein to combine the second plurality of texture images based on the second plurality of alpha images, one or more of the at least one programmable circuit is to weight pixel values of ones of the second plurality of texture images by pixel values of ones of the second plurality of alpha images corresponding respectively to the ones of the second plurality of texture images to determine a plurality of alpha weighted texture images.

4. The apparatus of claim 3 , wherein to combine the second plurality of texture images based on the second plurality of alpha images, one or more of the at least one programmable circuit is to average the alpha weighted texture images to determine the single second composite texture image, the second composite texture image including alpha weighted pixel values at respective pixel positions of the second composite texture image.

5. The apparatus of claim 1 , wherein the single composite alpha image is a first composite alpha image, and one or more of the at least one programmable circuit is to:
access a second input multiplane image stack including a second plurality of texture images and a corresponding second plurality of alpha images; and
convert the second plurality of alpha images to a second composite alpha image by:
identifying a first alpha plane index value corresponding to a first one of the second plurality of alpha images with a largest alpha value among the second plurality of alpha images at a first pixel position of the second input multiplane image stack;
identifying a second alpha plane index value corresponding to a neighbor alpha image of the first one of the second plurality of alpha images with a next largest alpha value among the second plurality of alpha images at the first pixel position;
determining a bias value for the first pixel position, the bias value for the first pixel position based on the largest alpha value and the next largest alpha value at the first pixel position; and
combining the first alpha plane index value and the bias value for the first pixel position to determine a composite alpha value to include in the second composite alpha image at the first pixel position.

6. The apparatus of claim 1 , wherein one or more of the at least one programmable circuit is to generate the compressed multiplane image stack based on the single composite texture image and the single composite alpha image.

7. At least one non-transitory computer readable medium comprising computer readable instructions to cause at least one programmable circuit to at least:
access an input multiplane image stack corresponding to a source camera viewpoint, the input multiplane image stack including a plurality of texture images and a corresponding plurality of alpha images, ones of the alpha images including pixel values representative of transparency of corresponding pixels in respective ones of the texture images;
at least one of (i) replace the plurality of texture images with a source camera image associated with the source camera viewpoint corresponding to the input multiplane image stack to convert the plurality of texture images to a single composite texture image, or (ii) convert the plurality of alpha images to a single composite alpha image including a composite alpha value at a pixel position of the single composite alpha image, the composite alpha value based on a combination of an alpha plane index value and a bias value, the alpha plane index value based on a value of a source camera depth image at the pixel position, the bias value based on the alpha plane index value and the value of the source camera depth image at the pixel position, the source camera depth image associated with the source camera viewpoint corresponding to the input multiplane image stack;
generate a compressed multiplane image stack based on at least one of the single composite texture image or the single composite alpha image; and
output the compressed multiplane image stack.

8. The at least one non-transitory computer readable medium of claim 7 , wherein the single composite texture image is a first composite texture image, and the instructions are to cause one or more of the at least one programmable circuit to:
access a second input multiplane image stack including a second plurality of texture images and a corresponding second plurality of alpha images;
combine the second plurality of texture images based on the second plurality of alpha images to convert the second plurality of texture images to a second composite texture image; and
generate a second compressed multiplane image stack based on the second composite texture image.

9. The at least one non-transitory computer readable medium of claim 8 , wherein to combine the second plurality of texture images based on the second plurality of alpha images, the instructions are to cause one or more of the at least one programmable circuit to weight pixel values of ones of the second plurality of texture images by pixel values of ones of the second plurality of alpha images corresponding respectively to the ones of the second plurality of texture images to determine a plurality of alpha weighted texture images.

10. The at least one non-transitory computer readable medium of claim 9 , wherein to combine the second plurality of texture images based on the second plurality of alpha images, the instructions are to cause one or more of the at least one programmable circuit to

Assignees

• Intel Corp

Inventors

• Janus Scott
• Boyce Jill
• Divekar Atul
• Tanner Jason
• Bhatia Sumit
• Lee Penne Y

Classifications

• H04N19/597

  specially adapted for multi-view video sequence encoding · CPC title

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/90

  using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals · CPC title

• G06T9/00 Primary

  Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00) · CPC title

• H04N19/21 Primary

  with binary alpha-plane coding for video objects, e.g. context-based arithmetic encoding [CAE] · CPC title