System and method of streaming 3-D wireframe animations

Patent metadata

Field	Value
Publication number	US-10262439-B2
Application number	US-201815916547-A
Country	US
Kind code	B2
Filing date	Mar 9, 2018
Priority date	Aug 20, 2002
Publication date	Apr 16, 2019
Grant date	Apr 16, 2019

Abstract

Optimal resilience to errors in packetized streaming 3-D wireframe animation is achieved by partitioning the stream into layers and applying unequal error correction coding to each layer independently to maintain the same overall bitrate. The unequal error protection scheme for each of the layers combined with error concealment at the receiver achieves graceful degradation of streamed animation at higher packet loss rates than approaches that do not account for subjective parameters such as visual smoothness.

First claim

We claim:

1. A method comprising:
partitioning, via a processor, a three-dimensional wireframe mesh corresponding to a video scene according to (1) a natural object within the three-dimensional wireframe mesh and (2) a motion of the natural object, to yield a first partition comprising the natural object and a second partition;
organizing the first partition and the second partition into respective layers based on a first visual smoothness value for the first partition and a second visual smoothness value associated with the second partition; and
generating one or more bitstreams including the respective layers for transmission.

2. The method of claim 1 , wherein the second partition comprises a second natural object having a second motion.

3. The method of claim 2 , further comprising:
computing the first visual smoothness value for the first partition; and
computing the second visual smoothness value for the second partition.

4. The method of claim 1 , further comprising:
applying unequal error protection to the respective layers, wherein the unequal error protection applied to each layer of the respective layers is based on a respective bitrate value for each layer of the respective layers.

5. The method of claim 1 , wherein each layer of the respective layers comprises one of a node and a group of nodes within the three-dimensional wireframe mesh.

6. The method of claim 1 , further comprising encoding a particular layer in the respective layers to be resilient to packet errors.

7. The method of claim 1 , wherein a number of nodes within a portion of the respective layers is associated with an output bit rate of the portion.

8. A system comprising:
a processor; and
a computer-readable storage medium storing instructions which, when executed by the processor, cause the processor to perform operations comprising:
partitioning a three-dimensional wireframe mesh corresponding to a video scene according to (1) a natural object within the three-dimensional wireframe mesh and (2) a motion of the natural object, to yield a first partition comprising the natural object and a second partition;
organizing the first partition and the second partition into respective layers based on a first visual smoothness value for the first partition and a second visual smoothness value associated with the second partition; and
generating one or more bitstreams including the respective layers for transmission.

9. The system of claim 8 , wherein the second partition comprises a second natural object having a second motion.

10. The system of claim 9 , wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:
computing the first visual smoothness value for the first partition; and
computing the second visual smoothness value for the second partition.

11. The system of claim 8 , wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:
applying unequal error protection to the respective layers, wherein the unequal error protection applied to each layer of the respective layers is based on a respective bitrate value for each layer of the respective layers.

12. The system of claim 8 , wherein each layer of the respective layers comprises one of a node and a group of nodes within the three-dimensional wireframe mesh.

13. The system of claim 8 , wherein the computer-readable storage medium stores additional instructions which, when executed by the processor, cause the processor to perform operations further comprising:
encoding a particular layer in the respective layers to be resilient to packet errors.

14. The system of claim 8 , wherein a number of nodes within a portion of the respective layers is associated with an output bit rate of the portion.

15. A computer-readable storage device storing instructions which, when executed by a processor, cause the processor to perform operations comprising:
partitioning a three-dimensional wireframe mesh corresponding to a video scene according to (1) a natural object within the three-dimensional wireframe mesh and (2) a motion of the natural object, to yield a first partition comprising the natural object and a second partition;
organizing the first partition and the second partition into respective layers based on a first visual smoothness value for the first partition and a second visual smoothness value associated with the second partition; and
generating one or more bitstreams including the respective layers for transmission.

16. The computer-readable storage device of claim 15 , further comprising producing a three-dimensional packetized streaming signal representative of a scene comprising animation associated with the respective layers.

17. The computer-readable storage device of claim 15 , further comprising partitioning the respective layers according to a visual importance of each layer of the respective layers.

18. The computer-readable storage device of claim 15 , wherein a number of nodes within a portion of the respective layers is associated with an output bit rate of the portion.

19. The computer-readable storage device of claim 15 , wherein the computer-readable storage device stores additional instructions which, when executed by the processor, cause the processor to perform operations comprising:
applying unequal error protection to the respective layers, wherein the unequal error protection applied to each layer of the respective layers is based on a respective bitrate value for each layer of the respective layers.

20. The computer-readable storage device of claim 19 , wherein the unequal error protection comprises optimizing a distribution of a bit budget allocation amongst the respective layers.

Assignees

• At & T Ip Ii Lp

Inventors

• Ostermann Joern
• Varakliotis Sokratis

Classifications

• H04N19/36

  Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability · CPC title

• H04N19/895

  in combination with error concealment · CPC title

• H04N19/67

  involving unequal error protection [UEP], i.e. providing protection according to the importance of the data · CPC title

• H04N19/154

  Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147) · CPC title

• G06T9/001 Primary

  Model-based coding, e.g. wire frame · CPC title