System and method of streaming 3-D wireframe animations

Patent metadata

Field	Value
Publication number	US-9454828-B2
Application number	US-201514737691-A
Country	US
Kind code	B2
Filing date	Jun 12, 2015
Priority date	Aug 20, 2002
Publication date	Sep 27, 2016
Grant date	Sep 27, 2016

Abstract

Optimal resilience to errors in packetized streaming 3-D wireframe animation is achieved by partitioning the stream into layers and applying unequal error correction coding to each layer independently to maintain the same overall bitrate. The unequal error protection scheme for each of the layers combined with error concealment at the receiver achieves graceful degradation of streamed animation at higher packet loss rates than approaches that do not account for subjective parameters such as visual smoothness.

First claim

We claim:

1. A method comprising:
processing, via a processor, parameters n, FR, Sp, and F of video data via a channel bitrate algorithm, wherein the parameters are located in a block-of-packets structure for each layer of a plurality of layers of video data, n is a number of lines in the block-of-packets structure, Sp is a number of columns in the block-of-packets structure, FR is a sequence frame rate, and F is a number of data frames in the block-of-packets structure for a respective layer of the plurality of layers, wherein the channel bitrate algorithm produces a bitrate value for each layer in the plurality of layers based on a product of n, FR, and Sp to yield a result, the result being divided by F, to yield bitrate values; and
applying, via the processor, unequal error protection to a layer of the plurality of layers according to the bitrate values produced by the channel bitrate algorithm.

2. The method of claim 1 , wherein the layer of the plurality of layers comprises one of a node and a group of nodes within a wireframe mesh.

3. The method of claim 1 , further comprising encoding a particular layer in the plurality of layers to be resilient to packet errors.

4. The method of claim 1 , wherein a number of nodes within a portion of the plurality of layers is associated with an output bit rate of the portion.

5. The method of claim 1 , further comprising producing a three-dimensional packetized streaming signal representative of a scene comprising animation associated with the plurality of layers of video data.

6. The method of claim 1 , further comprising partitioning the plurality of layers according to a visual importance of each respective layer in the plurality of layers.

7. The method of claim 1 , wherein the unequal error protection comprises optimizing a distribution of a bit budget allocation amongst the plurality of layers.

8. A system comprising:
a processor; and
a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising:
processing parameters n, FR, Sp, and F of video data via a channel bitrate algorithm, wherein the parameters are located in a block-of-packets structure for each layer of a plurality of layers of video data, n is a number of lines in the block-of-packets structure, Sp is a number of columns in the block-of-packets structure, FR is a sequence frame rate, and F is a number of data frames in the block-of-packets structure for a respective layer of the plurality of layers, wherein the channel bitrate algorithm produces a bitrate value for each layer in the plurality of layers based on a product of n, FR, and Sp to yield a result, the result being divided by F, to yield bitrate values; and
applying unequal error protection to a layer of the plurality of layers according to the bitrate values produced by the channel bitrate algorithm.

9. The system of claim 8 , wherein the layer of the plurality of layers comprises one of a node and a group of nodes within a wireframe mesh.

10. The system of claim 8 , the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising encoding a particular layer in the plurality of layers to be resilient to packet errors.

11. The system of claim 8 , wherein a number of nodes within a portion of the plurality of layers is associated with an output bit rate of the portion.

12. The system of claim 8 , the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising producing a three-dimensional packetized streaming signal representative of a scene comprising animation associated with the plurality of layers of video data.

13. The system of claim 8 , the computer-readable storage medium having additional instructions stored which, when executed by the processor, result in operations comprising partitioning the plurality of layers according to a visual importance of each respective layer in the plurality of layers.

14. The system of claim 8 , wherein the unequal error protection comprises optimizing a distribution of a bit budget allocation amongst the plurality of layers.

15. A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:
processing parameters n, FR, Sp, and F of video data via a channel bitrate algorithm, wherein the parameters are located in a block-of-packets structure for each layer of a plurality of layers of video data, n is a number of lines in the block-of-packets structure, Sp is a number of columns in the block-of-packets structure, FR is a sequence frame rate, and F is a number of data frames in the block-of-packets structure for a respective layer of the plurality of layers, wherein the channel bitrate algorithm produces a bitrate value for each layer in the plurality of layers based on a product of n, FR, and Sp to yield a result, the result being divided by F, to yield bitrate values; and
applying unequal error protection to a layer of the plurality of layers according to the bitrate values produced by the channel bitrate algorithm.

16. The computer-readable storage device of claim 15 , wherein the layer of the plurality of layers comprises one of a node and a group of nodes within a wireframe mesh.

17. The computer-readable storage device of claim 15 , having additional instructions stored which, when executed by the computing device, result in operations comprising encoding a particular layer in the plurality of layers to be resilient to packet errors.

18. The computer-readable storage device of claim 15 , wherein a number of nodes within a portion of the plurality of layers is associated with an output bit rate of the portion.

19. The computer-readable storage device of claim 15 , having additional instructions stored which, when executed by the computing device, result in operations comprising producing a three-dimensional packetized streaming signal representative of a scene comprising animation associated with the plurality of layers of video data.

20. The computer-readable storage device of claim 15 , having additional instructions stored which, when executed by the computing device, result in operations comprising partitioning the plurality of layers according to a visual importance of each respective layer in the plurality of layers.

Assignees

• At & T Ip Ii Lp

Inventors

• Ostermann Joern
• Varakliotis Sokratis

Classifications

• H04N19/36

  Scalability techniques involving formatting the layers as a function of picture distortion after decoding, e.g. signal-to-noise [SNR] scalability · CPC title

• G06T9/001 Primary

  Model-based coding, e.g. wire frame · CPC title

• H04N13/194

  Transmission of image signals · CPC title

• H04N19/67

  involving unequal error protection [UEP], i.e. providing protection according to the importance of the data · CPC title

• H04N19/895

  in combination with error concealment · CPC title