Detection of amount of judder in videos

Patent metadata

Field	Value
Publication number	US-12587654-B2
Application number	US-202418432918-A
Country	US
Kind code	B2
Filing date	Feb 5, 2024
Priority date	Feb 6, 2023
Publication date	Mar 24, 2026
Grant date	Mar 24, 2026

Abstract

A method receives a video. The method analyzes information for a pixel of a frame in the video to determine a first value and a second value for the pixel. The first value is based on an image structure formed by the pixel in the frame and the second value is based on interframe motion of the image structure at the pixel. A third value is determined for an amount of judder based on the first value and the second value. The method outputs the third value to evaluate the video.

First claim

What is claimed is:

1 . A method comprising:
receiving, by a computing device, a video; analyzing, by the computing device, information for a pixel of a frame in the video to determine a first value and a second value for the pixel, wherein:
the first value is based on an image structure formed by the pixel in the frame and the second value is based on interframe motion of the image structure at the pixel,
the first value comprises a first change of a characteristic in a direction of the interframe motion of the image structure at the pixel, and
the second value comprises a second change in the interframe motion of the image structure at the pixel;
determining, by the computing device, a third value for an amount of judder based on the first value and the second value; and outputting, by the computing device, the third value to evaluate the video.

2 . The method of claim 1 , wherein determining the third value for the amount of judder comprises:
using a function that represents a relationship based on the first value and the second value to determine the amount of judder.

3 . The method of claim 2 , wherein:
the first value comprises a magnitude of an intensity change of the pixel, the second value comprises the interframe motion of the image structure at the pixel, and the function represents a relationship between the magnitude of the intensity change and the interframe motion.

4 . The method of claim 3 , wherein:
the amount of judder is determined based on an intersection of the magnitude of the intensity change and the interframe motion using the function.

5 . The method of claim 3 , wherein:
the amount of judder varies non-linearly based on the magnitude of the intensity change and the interframe motion.

6 . The method of claim 1 , wherein determining the first value comprises:
determining a combination of an image gradient and the interframe motion of the image structure at the pixel to generate a magnitude of an intensity change in the direction of interframe motion.

7 . The method of claim 6 , wherein the image gradient comprises a difference of a characteristic between the pixel and another pixel.

8 . The method of claim 1 , wherein:
the frame comprises a first frame, and the interframe motion comprises a difference of a position of the pixel in the first frame and a second frame.

9 . The method of claim 1 , further comprising:
analyzing a plurality of pixels of the frame to determine respective first values for the image structure and respective second values for the interframe motion for the plurality of pixels; determining a plurality of third values for the amount of judder based on the respective first value and the respective second value for the plurality of pixels; and determining a fourth value for the plurality of pixels using the plurality of third values.

10 . The method of claim 9 , wherein the fourth value represents the amount of judder for a portion of the video.

11 . The method of claim 10 , wherein:
the frame comprises a first frame, the portion of the video comprises the first frame, and one or more other fourth values is determined for one or more other frames.

12 . The method of claim 1 , wherein another pixel in another frame that includes interframe motion that is parallel to the direction of the interframe motion is not analyzed for an amount of judder.

13 . The method of claim 1 , further comprising:
determining an amount of judder for other frames; identifying a portion of the video based on the amount of judder determined for the frame and the other frames; and performing a judder mitigation process on the portion of the video to mitigate the amount of judder.

14 . The method of claim 1 , further comprising:
determining an amount of judder for frames of the video, wherein the amount of judder for the frame is based on the amount of judder for the pixel; comparing the amount of judder for the frames of the video to a threshold; determining a portion of the video that meets the threshold; and performing a judder mitigation process on the portion of the video.

15 . The method of claim 14 , wherein performing the judder mitigation process comprises:
determining a setting for the judder mitigation process based on the amount of judder for frames of the portion of the video; and performing the judder mitigation process using the setting.

16 . A non-transitory computer-readable storage medium having stored thereon computer executable instructions, which when executed by a computing device, cause the computing device to be operable for:
receiving a video; analyzing information for a pixel of a frame in the video to determine a first value and a second value for the pixel, wherein:
the first value is based on an image structure formed by the pixel in the frame and the second value is based on interframe motion of the image structure at the pixel,
the first value comprises a first change of a characteristic in a direction of the interframe motion of the image structure at the pixel, and
the second value comprises a second change in the interframe motion of the image structure at the pixel;
determining a third value for an amount of judder based on the first value and the second value; and outputting the third value to evaluate the video.

17 . The non-transitory computer-readable storage medium of claim 16 , wherein determining the amount of judder comprises:
using a function that represents a relationship based on the first value and the second value to determine the amount of judder.

18 . The non-transitory computer-readable storage medium of claim 16 , wherein:
the first value comprises a magnitude of an intensity change in the direction of the interframe motion of the image structure at the pixel, and the second value comprises the interframe motion of the image structure at the pixel.

19 . The non-transitory computer-readable storage medium of claim 16 , further operable for:
analyzing a plurality of pixels of the frame to determine respective first values for the image structure and respective second values for the interframe motion for the plurality of pixels; determining a plurality of third values for the amount of judder based on the respective first value and the respective second value for the plurality of pixels; and determining a fourth value for the plurality of pixels using the plurality of third values.

20 . An apparatus comprising:
one or more computer processors; and a computer-readable storage medium comprising instructions for controlling the one or more computer processors to be operable for: receiving a video; analyzing information for a pixel of a frame in the video to determine a first value and a second value for the pixel, wherein:
the first value is based on an image structure formed by the pixel in the frame and the second value is based on interframe motion of the image structure at the pixel,
the first value comprises a first change of a characteristic in a direction of the interframe motion of the image structure at the pixel, and
the second value comprises a second change in the interframe motion of the image structure at the pixel;
determining a third value for an amount of judder based on the first value and the second value; and outputting the third value to evaluate the video.

Assignees

• Disney Entpr Inc

Inventors

• Schroers Christopher Richard
• Sloan Blake
• Jacobs Mitchel
• Labrozzi Scott
• Hattori Shinobu
• Klose Felix

Classifications

• H04N19/137

  Motion inside a coding unit, e.g. average field, frame or block difference · CPC title

• G06V10/751

  Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching · CPC title

• H04N19/159 Primary

  Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction · CPC title