Systems, methods and apparatus for compressing video content

Patent metadata

Field	Value
Publication number	US-12003692-B2
Application number	US-202117545156-A
Country	US
Kind code	B2
Filing date	Dec 8, 2021
Priority date	Apr 11, 2016
Publication date	Jun 4, 2024
Grant date	Jun 4, 2024

Abstract

A device includes a processor that is configured to obtain first facets of a first wide field-of-view image. An object is identified in a facet of the first facets. A second wide field-of-view image is obtained. A location of the object is identified in the second wide field-of-view image. Using the location of the object, the second wide field-of-view image is partitioned into second facets such that no boundary of any of the second facets overlaps the object. The second facets are then encoded in a compressed bitstream.

First claim

What is claimed is:

1. A device, comprising:
a processor configured to:
obtain first facets of a first wide field-of-view image;
identify an object in a facet of the first facets;
obtain a second wide field-of-view image;
identify a location of the object in the second wide field-of-view image;
partition, using the location of the object, the second wide field-of-view image into second facets such that no boundary of any of the second facets overlaps the object; and
encode the second facets in a compressed bitstream.

2. The device of claim 1 , wherein to encode the second facets in the compressed bitstream comprises to:
duplicate one of the second facets to obtain a duplicate facet;
obtain a frame, wherein the frame comprises the duplicate facet and the second facets, and wherein the frame comprises the one of the second facets and the duplicate facet as distinct facets; and
encode the frame.

3. The device of claim 2 , wherein to duplicate the one of the second facets to obtain the duplicate facet comprises to:
obtain a transformed facet from the one of the second facets; and
combine the transformed facet with the second facets to obtain the frame.

4. The device of claim 3 , wherein the transformed facet is obtained from the one of the second facets using at least one of a rotation operation or a translation operation.

5. The device of claim 4 , wherein the rotation operation is one of a 900 counterclockwise rotation operation, a 90° clockwise rotation operation, or a 1800 rotation operation.

6. The device of claim 2 , wherein a number of facets in the second facets is 6 and a number of facets in the frame is 12.

7. The device of claim 6 , wherein the facets of the frame are arranged in 3 rows and 4 columns.

8. The device of claim 2 , wherein a number of facets in the second facets is 6 and a number of facets in the frame is 18.

9. The device of claim 8 , wherein the facets of the frame are arranged in 3 rows and 6 columns.

10. The device of claim 1 , wherein the second wide field-of-view image is partitioned into the second facets using a projection operation.

11. A method for reducing decoding artefacts, comprising:
performing a first cube projection operation on a first wide field-of-view image to obtain first facets;
identifying an object in one of the first facets;
performing a second cube projection operation on a second wide field-of-view image to obtain second facets,
wherein the second cube projection operation is such that no boundary of any of the second facets overlaps the object, and
wherein the second wide field-of-view image is obtained at a different time from the first wide field-of-view image; and

encoding at least one of the second facets using at least one of the first facets.

12. The method of claim 11 , wherein encoding at least one of the second facets using at least one of the first facets comprises:
obtaining a reference frame using the first facets; and
encoding the first facets using the reference frame.

13. The method of claim 12 , wherein obtaining the reference frame using the first facets comprises:
duplicating at least one of the first facets to obtain a duplicate facet; and
obtaining the reference frame, wherein the reference frame comprises the duplicate facet and the first facets, and wherein the reference frame comprises the at least one of the first facets and the duplicate facet as distinct facets.

14. The method of claim 13 , wherein the duplicate facet is obtained using at least one of a rotation operation or a translation operation.

15. The method of claim 14 , wherein the rotation operation is one of a 900 counterclockwise rotation operation, a 90° clockwise rotation operation, or a 1800 rotation operation.

16. The method of claim 13 , wherein a number of the first facets is smaller than a number of facets in the reference frame.

17. The method of claim 16 , wherein the number of the first facets is 6 and the number of facets in the reference frame is at least 10.

18. A non-transitory computer readable medium storing instructions operable to cause one or more processors to perform operations to reduce decoding artefacts, the operations comprising to:
obtain a first image and a second image, wherein the first image and the second image are images of a wide field-of-view image;
use parallax information obtained using an overlap region between the first image and the second image to detect relative distances of a first object and a second object in at least one of the first image or the second image from one or more imaging devices used to obtain the first image and the second image, wherein the first object is detected to be farther away than the second object;
partition the wide field-of-view image into facets based on the relative distances such that no boundary of any of the facets overlaps the second object; and
encode the facets of the wide field-of-view image.

19. The non-transitory computer readable medium of claim 18 , wherein to encode the facets of the wide field-of-view image comprises to:
obtain, from one of the facets, a transformed facet, wherein the transformed facet is obtained using at least one of a rotation operation or a translation operation; and
encode at least one of the facets using the transformed facet.

20. The non-transitory computer readable medium of claim 19 , wherein the rotation operation is one of a 90° counterclockwise rotation operation, a 90° clockwise rotation operation, or a 180° rotation operation.

Assignees

• Gopro Inc

Inventors

• Abbas Adeel
• Adsumilli Balineedu Chowdary
• Newman David

Classifications

• H04N13/161 Primary

  Encoding, multiplexing or demultiplexing different image signal components (for multi-view video sequence encoding H04N19/597) · CPC title

• H04N13/111

  Transformation of image signals corresponding to virtual viewpoints, e.g. spatial image interpolation · CPC title

• H04N13/194

  Transmission of image signals · CPC title

• H04N13/243

  using three or more two-dimensional [2D] image sensors · CPC title

• H04N13/282

  for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems · CPC title