Device-consistent techniques for predicting absolute perceptual video quality

Patent metadata

Field	Value
Publication number	US-11758148-B2
Application number	US-202017093449-A
Country	US
Kind code	B2
Filing date	Nov 9, 2020
Priority date	Dec 12, 2016
Publication date	Sep 12, 2023
Grant date	Sep 12, 2023

Abstract

In various embodiments, a perceptual quality application determines an absolute quality score for encoded video content viewed on a target viewing device. In operation, the perceptual quality application determines a baseline absolute quality score for the encoded video content viewed on a baseline viewing device. Subsequently, the perceptual quality application determines that a target value for a type of the target viewing device does not match a base value for the type of the baseline viewing device. The perceptual quality application computes an absolute quality score for the encoded video content viewed on the target viewing device based on the baseline absolute quality score and the target value. Because the absolute quality score is independent of the viewing device, the absolute quality score accurately reflects the perceived quality of a wide range of encoded video content when decoded and viewed on a viewing device.

First claim

What is claimed is:

1. A computer-implemented method, comprising:
receiving, at a first type of viewing device, encoded video content from a server machine;
performing at least one decoding operation on the encoded video content to generate re-constructed video content, wherein the re-constructed video content is associated with an absolute quality score that is calculated based on both the first type of viewing device and a quality of source video content from which the encoded video content is derived; and
displaying at least one frame of the re-constructed video content on the first type of viewing device.

2. The computer-implemented method of claim 1 , further comprising computing the absolute quality score based on a base quality score that reflects a base type of viewing device and a first device equation that converts base quality scores associated with the base type of viewing device to absolute quality scores associated with the first type of the first viewing device.

3. The computer-implemented method of claim 1 , further comprising computing a baseline quality score associated with a base type viewing device based on a model that is associated with a spatial resolution of the source video content.

4. The computer-implemented method of claim 1 , further comprising computing a plurality of absolute quality scores associated with the first type of viewing device based on a device equation associated with the first type of viewing device and a plurality of base quality scores associated with a plurality of encodes and a base type of viewing device.

5. The computer-implemented method of claim 4 , further comprising selecting the device equation from a plurality of device equations based on the first type of viewing device.

6. The computer-implemented method of claim 4 , wherein the device equation comprises a polynomial that is generated based on a first set of mean opinion scores associated with a base type of viewing device and a second set of mean opinion scores associated with the first type of viewing device.

7. The computer-implemented method of claim 1 , wherein the absolute quality score reflects a spatial resolution of the source video content from which the encoded video content is derived.

8. The computer-implemented method of claim 1 , wherein the absolute quality score predicts a perceived visual quality of the re-constructed video content when viewed on the first type of viewing device.

9. The computer-implemented method of claim 1 , wherein the first type of viewing device comprises a mobile device, a laptop device, or a television device.

10. One or more non-transitory computer-readable media including instructions that, when executed by one or more processors, cause the one or more processors to perform the steps of:
receiving, at a first type of viewing device, encoded video content from a server machine;
performing at least one decoding operation on the encoded video content to generate re-constructed video content, wherein the re-constructed video content is associated with an absolute quality score that is calculated based on both the first type of viewing device and a quality of source video content from which the encoded video content is derived; and
displaying at least one frame of the re-constructed video content on the first type of viewing device.

11. The one or more non-transitory computer-readable media of claim 10 , further comprising computing the absolute quality score based on a base quality score that reflects a base type of viewing device and a first device equation that converts base quality scores associated with the base type of viewing device to absolute quality scores associated with the first type of the first viewing device.

12. The one or more non-transitory computer-readable media of claim 10 , further comprising computing a baseline quality score associated with a base type viewing device based on a model that is associated with a spatial resolution of the source video content.

13. The one or more non-transitory computer-readable media of claim 10 , further comprising computing a plurality of absolute quality scores associated with the first type of viewing device based on a device equation associated with the first type of viewing device and a plurality of base quality scores associated with a plurality of encodes and a base type of viewing device.

14. The one or more non-transitory computer-readable media of claim 13 , further comprising selecting the device equation from a plurality of device equations based on the first type of viewing device.

15. The one or more non-transitory computer-readable media of claim 13 , wherein the device equation comprises a polynomial that is generated based on a first set of mean opinion scores associated with a base type of viewing device and a second set of mean opinion scores associated with the first type of viewing device.

16. The one or more non-transitory computer-readable media of claim 10 , wherein the absolute quality score reflects a spatial resolution of the source video content from which the encoded video content is derived.

17. The one or more non-transitory computer-readable media of claim 10 , wherein the absolute quality score predicts a perceived visual quality of the re-constructed video content when viewed on the first type of viewing device.

18. The one or more non-transitory computer-readable media of claim 10 , wherein the first type of viewing device comprises a mobile device, a laptop device, or a television device.

19. A system, comprising:
one or more memories storing instructions; and
one or more processors that are coupled to the one or more memories and, when executing the instructions, are configured to perform the steps of:
receiving, at a first type of viewing device, encoded video content from a server machine;
performing at least one decoding operation on the encoded video content to generate re-constructed video content, wherein the re-constructed video content is associated with an absolute quality score that is calculated based on both the first type of viewing device and a quality of source video content from which the encoded video content is derived; and
displaying at least one frame of the re-constructed video content on the first type of viewing device.

20. The system of claim 19 , wherein the one or more processors are further configured to compute the absolute quality score based on a base quality score that reflects a base type of viewing device and a first device equation that converts base quality scores associated with the base type of viewing device to absolute quality scores associated with the first type of the first viewing device.

21. The system of claim 19 , wherein the one or more processors are further configured to compute a baseline quality score associated with a base type viewing device based on a model that is associated with a spatial resolution of the source video content.

22. The system of claim 19 , wherein the one or more processors are further configured to compute a plurality of absolute quality scores associated with the first type of viewing device based on a device equation associated with the first type of viewing device and a plurality of base quality scores associated with a plurality of encodes and a base type of viewing device.

23. The system of claim 22 , wherein the one or more processors are further configured to select the device equation from a plurality of device equations based on the firs

Assignees

• Netflix Inc

Inventors

• Li Zhi
• Aaron Anne
• Moorthy Anush
• Bampis Christos

Classifications

• H04N19/154 Primary

  Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion (use of rate-distortion criteria H04N19/147) · CPC title

• H04N17/004

  for digital television systems · CPC title

• H04N21/23418

  involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title

• H04N21/23439

  for generating different versions · CPC title

• H04N19/59

  involving spatial sub-sampling or interpolation, e.g. alteration of picture size or resolution · CPC title