Signal element coding format compatability within a hierarchical coding scheme using multiple resolutions

Patent metadata

Field	Value
Publication number	US-11677989-B2
Application number	US-201917284328-A
Country	US
Kind code	B2
Filing date	Oct 9, 2019
Priority date	Oct 9, 2018
Publication date	Jun 13, 2023
Grant date	Jun 13, 2023

Abstract

There is provided a method for encoding and decoding a signal. The method comprises receiving a first signal ( 900 ) and a second signal ( 960 ), the first and second signals comprising different versions of a common content, the first signal ( 900 ) using a first signal element coding format and the second signal ( 960 ) using a second signal element coding format. The first signal ( 900 ) is encoded by a lower encoding module ( 1103 ) to generate a lower encoded signal ( 910 ). The lower encoded signal ( 910 ) is decoded to generate a lower decoded signal. The lower decoded signal is processed by at least converting from the first signal element coding format to the second signal element coding format and up-sampling, to produce a processed signal. The processed signal and the second signal ( 960 ) are processed by an upper encoding module ( 1107 ) to generate an upper encoded signal ( 920 ).

First claim

The invention claimed is:

1. A method of encoding a signal, the method comprising:
receiving a first signal and a second signal, the first and second signals comprising different versions of a common content, the first signal using a first signal element coding format and the second signal using a second signal element coding format;
encoding, by a lower encoding module, the first signal to generate a lower encoded signal;
decoding the lower encoded signal to generate a lower decoded signal;
processing the lower decoded signal by at least converting from the first signal element coding format to the second signal element coding format and upsampling, to produce a processed signal, wherein the step of processing the lower decoded signal comprises:
upsampling the lower decoded signal to generate an up-sampled signal and processing, at an intermediate encoder, the up-sampled signal and the first signal to generate an intermediate encoded signal;
decoding the lower encoded signal and the intermediate encoded signal in combination to generate an intermediate decoded signal; and
converting the intermediate decoded signal from the first signal element coding format to the second signal element coding format to produce the processed signal; and

processing, by an upper encoding module, the processed signal and the second signal to generate an upper encoded signal.

2. The method of claim 1 , wherein first signal element coding format represents a first colour space and the second signal element coding format represents a second colour space.

3. The method of claim 1 , wherein the intermediate encoded signal comprises an enhancement signal that has residual data representing a difference between the first signal as a reference signal and the up-sampled signal as a reconstructed version of the reference signal.

4. The method of claim 1 , wherein the intermediate encoded signal is decoded and processed with an up-sampled version of the lower decoded signal to output an intermediate reconstructed signal.

5. A method of decoding a signal, the method comprising:
decoding, by a lower decoding module, a lower encoded signal to generate a lower decoded signal in a first signal element coding format;
decoding, by an intermediate decoding module, an intermediate encoded signal to generate an intermediate decoded signal,
upsampling the lower decoded signal to generate an up-sampled signal;
processing at the intermediate decoder module, the up-sampled signal and the intermediate decoded signal in combination to generate an intermediate reconstructed signal;
processing the intermediate reconstructed signal by at least converting from the first signal element coding format to a second signal element coding format and upsampling, to produce an upper reconstructed signal;
decoding, by an upper decoding module, an upper encoded signal to generate an upper decoded signal;
processing the upper reconstructed signal and the upper decoded signal by the upper decoding module to generate an upper combined decoded signal which is a reconstruction of an original signal in the second signal element coding format.

6. The method of claim 5 , wherein first signal element coding format represents a first colour space and the second signal element coding format represents a second colour space.

7. The method of claim 5 , wherein the lower decoded signal has a standard dynamic range, SDR, and the upper combined decoded signal has a high dynamic range, HDR, the HDR format having a higher luminance and/or wider colour range than the SDR format.

8. The method of claim 5 , wherein the lower decoded signal has a first bit depth, and the upper reconstructed signal has a second bit depth, wherein the first bit depth is lower than the second bit depth.

9. The method of claim 5 , wherein the first signal element coding format is at a first level of quality and the second signal element coding format is at a second level of quality, wherein the second level of quality is higher than the first level of quality.

10. The method of claim 5 , wherein upper decoded signal is an enhancement signal that comprises residual data for adjusting the upper reconstructed signal to reconstruct an original signal in the second signal element coding format.

11. The method of claim 5 , wherein the intermediate decoded signal is an enhancement signal that comprises residual data for adjusting the up-sampled signal to reconstruct an original signal in the first signal element coding format.

12. The method of claim 5 , wherein the step of processing the lower decoded signal comprises converting the intermediate reconstructed signal from a first colour space to a second colour space.

13. The method of claim 5 , comprising sensing if a connected display is unable to display the second signal element coding format, and if so, outputting the intermediate reconstructed signal.

14. The method of claim 6 , comprising selecting to convert the upper combined decoded signal back to the first signal element coding format when a display is capable of displaying only the first signal element coding format.

15. The method of claim 5 , wherein the lower encoded signal comprises all frames of the upper combined decoded signal, wherein each frame in the lower encoded signal is decoded by the lower decoding module and provides a base version of the upper combined decoded signal, and wherein the upper encoded signal comprises enhancement information for each frame of the base version.

16. The method of claim 5 , wherein the step of converting from the first signal element coding format to the second signal element coding format is non-linear.

17. The method of claim 5 , wherein the step of converting from the first signal element coding format to the second signal element coding format is non-predictive.

18. A non-transitory computer-readable storage medium comprising instructions which when executed by a processor cause the processor to:
decode, by a lower decoding module, a lower encoded signal to generate a lower decoded signal in a first signal element coding format;
decode, by an intermediate decoding module, an intermediate encoded signal to generate an intermediate decoded signal,
upsample the first decoded signal to generate an up-sampled signal;
process at the intermediate decoder module, the up-sampled signal and the intermediate decoded signal in combination to generate an intermediate reconstructed signal;
process the intermediate reconstructed signal by at least converting from the first signal element coding format to a second signal element coding format and upsampling, to produce an upper reconstructed signal;
decode, by an upper decoding module, an upper encoded signal to generate an upper decoded signal;
process the upper reconstructed signal and the upper decoded signal by the upper decoding module to generate an upper combined decoded signal which is a reconstruction of an original signal in the second signal element coding format.

Assignees

• V Nova Int Ltd

Inventors

• Ferrara Simone
• Meardi Guido

Classifications

• H04N21/234327 Primary

  by decomposing into layers, e.g. base layer and one or more enhancement layers · CPC title

• H04N19/46

  Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) · CPC title

• H04N19/30 Primary

  using hierarchical techniques, e.g. scalability (H04N19/63 takes precedence) · CPC title

• H04N19/98 Primary

  Adaptive-dynamic-range coding [ADRC] · CPC title

• H04N19/184

  the unit being bits, e.g. of the compressed video stream · CPC title