Extending prediction modes and performance of video codecs

Patent metadata

Field	Value
Publication number	US-9483845-B2
Application number	US-201313871180-A
Country	US
Kind code	B2
Filing date	Apr 26, 2013
Priority date	Apr 26, 2013
Publication date	Nov 1, 2016
Grant date	Nov 1, 2016

Abstract

A video frame compression system includes a rendering engine that provides a current video frame and current additional rendering information. Additionally, the video frame compression system includes a warping engine that generates a warped video frame, wherein the warped video frame is a transformation of a previous video frame that is based on the current additional rendering information. Further, the video frame compression system includes a video encoder that compresses the current video frame by using the warped video frame as a reference frame and separately compresses the current additional rendering information. Still further, the video frame compression system includes a packetizer that provides main and auxiliary data streams corresponding to the compressed current video frame and the compressed current additional rendering information, respectively. A video frame decompression system and methods of video frame compression and decompression are also provided.

First claim

What is claimed is:

1. A video frame compression system, comprising:
a rendering engine that provides a current video frame and current additional rendering information that differs from the current video frame;
a warping engine that generates a warped video frame, wherein the warped video frame is a transformation of a previous video frame that is based on the current additional rendering information; and
a video encoder that compresses the current video frame by using the warped video frame as a reference frame and separately compresses the current additional rendering information.

2. The system as recited in claim 1 further comprising a packetizer that provides main and auxiliary data streams corresponding to the compressed current video frame and the compressed current additional rendering information, respectively.

3. The system as recited in claim 1 wherein the current additional rendering information is selected from the group consisting of:
a camera projection matrix; and
a Z-depth buffer.

4. The system as recited in claim 1 wherein the video encoder conforms to the H.264/AVC Video Coding Standard.

5. A method of video frame compression, comprising:
providing a current video frame and current additional rendering information that is different data than said current video frame;
generating a warped video frame, wherein the warped video frame is a transformation of a previous video frame that is based on the current additional rendering information; and
compressing the current video frame by using the warped video frame as a reference frame and separately compressing the current additional rendering information, wherein said generating and said compressing are performed by a processor.

6. The method as recited in claim 5 further comprising packetizing the compressed current video frame and the compressed additional rendering information into main and auxiliary data streams, respectively.

7. The method as recited in claim 5 wherein the current additional rendering information is selected from the group consisting of:
a camera projection matrix; and
a Z-depth buffer.

8. The method as recited in claim 5 wherein compressing the current video frame and the current additional rendering information conforms to the H.264/AVC Video Coding Standard.

9. A video frame decompression system, comprising:
a depacketizer that provides a compressed current video frame and compressed additional rendering information;
an auxiliary video decoder that decodes the compressed additional rendering information to provide current additional rendering information;
a warping engine that reconstructs a warped video frame, wherein the warped video frame is a transformation of a previous video frame that is based on the current additional rendering information; and
a main video decoder that decodes the compressed current video frame by using the warped video frame as a reference frame to provide a current video frame.

10. The system as recited in claim 9 wherein the main and auxiliary decoders are at least portions of a same decoder.

11. The system as recited in claim 9 wherein the current additional rendering information is provided by using previous additional rendering information as a reference.

12. The system as recited in claim 9 wherein the current additional rendering information is selected from the group consisting of:
a camera projection matrix; and
a Z-depth buffer.

13. The system as recited in claim 9 wherein the main and auxiliary video decoders conform to the H.264/AVC Video Coding Standard.

14. A method of video frame decompression, comprising:
depacketizing a compressed current video frame and compressed additional rendering information;
decoding the compressed additional rendering information to provide current additional rendering information;
reconstructing a warped video frame, wherein the warped video frame is a transformation of a previous video frame that is based on the current additional rendering information; and
decoding the compressed current video frame by using the warped video frame as a reference frame to provide a current video frame, wherein said depacketizing and said reconstructuring are performed by a processor.

15. The method as recited in claim 14 wherein the current additional rendering information is provided by using previous additional rendering information as a reference.

16. The method as recited in claim 14 wherein the current additional rendering information is selected from the group consisting of:
a camera projection matrix; and
a Z-depth buffer.

17. The method as recited in claim 14 wherein the main and auxiliary video encoders conform to the H.264/AVC Video Coding Standard.

Assignees

• Nvidia Corp

Inventors

• Azar Hassane S
• Pajak Dawid
• Eckart Stefan
• Mohapatra Swagat

Classifications

• G06T9/00 Primary

  Image coding (bandwidth or redundancy reduction for static pictures H04N1/41; coding or decoding of static colour picture signals H04N1/64; methods or arrangements for coding, decoding, compressing or decompressing digital video signals H04N19/00) · CPC title

• G06T9/001 Primary

  Model-based coding, e.g. wire frame · CPC title

• H04N19/61

  in combination with predictive coding · CPC title

• H04N19/54

  using feature points or meshes · CPC title

• H04N19/20

  using video object coding · CPC title