Encoding and reconstruction of residual data based on support information

Patent metadata

Field	Value
Publication number	US-9961345-B2
Application number	US-201313894417-A
Country	US
Kind code	B2
Filing date	May 14, 2013
Priority date	May 14, 2012
Publication date	May 1, 2018
Grant date	May 1, 2018

Abstract

Decoder processor hardware reproduces a support plane including a set of support values. The set of support values is derived from combining a sequence of multiple original sets of values. The decoder processor hardware receives compensation information. The decoder processor hardware utilizes the compensation information to produce preliminary renditions of the multiple original sets of values based on the set of support values. Encoder processor hardware processes a sequence of original sets of values. The encoder processor hardware utilizes the values of the original sets in the sequence to produce a set of support values, the set of support values representing a baseline to reproduce a rendition of each of the original sets of values. The encoder processor hardware generates reconstruction data to include data corresponding to the set of support values, the reconstruction data indicates how to reconstruct the original sets of values using the set of support values.

First claim

We claim:

1. A method comprising:
via computer processor hardware, performing image-processing operations of:
processing a sequence of original sets of image values, each of the original sets representing a different video frame in the sequence;
utilizing the sequence of original sets of image values to produce a set of support values, the set of support values being a temporal combination of the original sets of image values and representing an image baseline from which to reproduce a rendition of each of the original sets of image values in the sequence; and
generating reconstruction data to include data corresponding to the set of support values, the reconstruction data indicating how to reconstruct the original sets of image values based on the set of support values;
wherein the original sets of image values includes a first image frame and a second image frame, the first image frame encoded to indicate a first object and a second object, the second image frame encoded to indicate the second object and a third object, the first object absent from the second image frame, the third object absent from the first image frame;
wherein the set of support values is a single image frame defining attributes of the first object, the second object, and the third object, the method further comprising:
producing the reconstruction data to indicate how to: i) reconstruct the first image frame including a rendition of the first object and a rendition of the second object from the set of support values, and ii) reconstruct the second image frame including a rendition of the second object and a rendition of the third object from the set of support values.

2. The method as in claim 1 further comprising:
for a given original set of image values in the sequence: producing a first portion of the reconstruction data based on the given original set of image values and the set of support values.

3. The method as in claim 1 further comprising:
deriving a preliminary rendition of a given original set of image values in the sequence based at least in part on the set of support values;
producing a set of residual values, the set of residual values representing differences between the given original set of image values and the preliminary rendition of the given original set of image values; and
storing the set of residual values as part of the reconstruction data, the residual values representing adjustment values indicating how to modify the preliminary rendition to produce a final rendition of the given original set of image values.

4. The method as in claim 3 further comprising:
producing motion compensation information indicating how to derive the preliminary rendition of the given original set of image values based on the set of support values; and
storing the motion compensation information as part of the reconstruction data.

5. The method as in claim 1 , wherein producing the set of support values comprises:
analyzing setting information associated with the sequence of original sets of image values;
identifying a first group of elements, the first group of elements present in a first original set of image values in the sequence, the first group of elements associated with a first location in the first original set of image values;
identifying a second group of elements, the second group of elements present in a second original set of image values in the sequence, the second group of elements associated with a second location in the second original set of image values in the sequence;
mapping the second group of elements to the first group of elements;
generating motion compensation information mapping the second group of elements to the first group of elements;
utilizing the motion compensation information to produce a rendition of the second group of elements as an overlay with respect to the first group of elements; and
utilizing a combination of the first group of elements and the rendition of the second group of elements to derive settings for a corresponding portion of the set of support values.

6. The method as in claim 5 , wherein the motion compensation information is first motion compensation information; and
wherein producing the set of support values further comprises:
identifying a third group of elements, the third group of elements present in a third original set of image values in the sequence, the third group of elements associated with a third location in the third original set of image values;
mapping the third group of elements to the first group of elements;
generating second motion compensation information mapping the third group of elements to the first group of elements;
utilizing the second motion compensation information to produce a rendition of the third group of elements as an overlay with respect to the first group of elements; and
utilizing a combination of the first group of elements, the rendition of the second group of elements, and the rendition of the third group of elements to derive settings for a corresponding portion of the set of support values.

7. The method as in claim 6 , wherein utilizing the combination to derive the settings for the corresponding portion is-includes executing an operation selected from the group consisting of:
i) weighted average,
ii) arithmetic mean,
iii) median, and
iv) mode.

8. The method as in claim 5 , wherein the set of support values represents a support plane, the method further comprising:
in response to detecting that a difference between an element setting in the rendition of the second group of elements and a corresponding element in the first group of elements is greater than a threshold value, assigning a default value to a corresponding element in the support plane.

9. The method as in claim 1 further comprising:
applying operations to the set of support values to produce a set of reference values, the operations selected from the group consisting of:
i) resampling calculations,
ii) motion-compensation operations, and
iii) equalization operations.

10. The method as in claim 5 , wherein settings for the first group of elements in the first original set of image values is substantially equal to settings of corresponding coordinates in the set of support values; and
wherein settings for the second group of elements in the second original set of image values is substantially different than settings of corresponding coordinates in the set of support values.

11. The method as in claim 5 further comprising:
producing a plane of motion compensation settings for the second original set of image values, the plane of motion compensation settings indicating that a first group of elements resides in a motion zone in which settings of elements in the first group are derivable at least in part based on the set of support values; and
producing a portion of the plane of motion compensation settings for the second original set of image values to a default setting, the portion residing outside the motion zone, the default setting indicating that a corresponding second group of elements in the second original set of image values is not to be derived from the set of support values.

12. The method as in claim 1 , wherein the set of support values represents a first portion of the reconstruction data, the method further comprising:
producing a second portion of the reconstruction data to include residual reconstruction data corresponding to one of the original sets of image values in the sequence; and
generating synch-marking information to indicate a location of the second portion in the reconstruction data.

13. The method as in claim 1 , wherein the set

Assignees

• Rossato Luca
• Meardi Guido
• V Nova Int Ltd

Inventors

• Rossato Luca
• Meardi Guido

Classifications

• H04N19/94

  Vector quantisation · CPC title

• H04N19/635

  characterised by filter definition or implementation details · CPC title

• H04N19/87

  involving scene cut or scene change detection in combination with video compression · CPC title

• H04N19/23

  with coding of regions that are present throughout a whole video segment, e.g. sprites, background or mosaic · CPC title

• H04N19/59

  involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution · CPC title