Methods and systems for masking multimedia data

Patent metadata

Field	Value
Publication number	US-12022093-B2
Application number	US-202217827988-A
Country	US
Kind code	B2
Filing date	May 30, 2022
Priority date	Mar 18, 2011
Publication date	Jun 25, 2024
Grant date	Jun 25, 2024

Abstract

Several methods and systems for masking multimedia data are disclosed. In an embodiment, a method for masking includes performing a prediction for at least one multimedia data block based on a prediction mode of a plurality of prediction modes. The at least one multimedia data block is associated with a region of interest (ROI). A residual multimedia data associated with the at least one multimedia data block is generated based on the prediction. A quantization of the residual multimedia data is performed based on a quantization parameter (QP) value. The QP value is variable such that varying the QP value controls a degree of masking of the ROI.

First claim

What is claimed is:

1. A method comprising:
receiving, by a processor, a first frame of a video stream;
receiving, by the processor, a second frame of the video stream, wherein the second frame includes a region of interest;
determining, by the processor, a motion vector between the region of interest and the first frame;
determining, by the processor, a selected prediction mode for the region of interest from a plurality of prediction modes, wherein:
the selected prediction mode is based on the motion vector; and
the selected prediction mode is a worst prediction mode of the plurality of prediction modes; and

determining, by the processor, a prediction of the region of interest of the second frame based on the selected prediction mode.

2. The method of claim 1 , wherein:
the first frame includes a set of boundaries; and
the first frame includes padding outside the set of boundaries.

3. The method of claim 2 , wherein: the first frame includes a set of corners located with the padding outside the set of boundaries.

4. The method of claim 3 , wherein: each of the set of corners is gray.

5. The method of claim 3 , wherein: the motion vector points to one of the set of corners.

6. The method of claim 1 , further comprising generating, by the processor, residual data associated with the region of interest based on the prediction.

7. The method of claim 6 , further comprising quantizing, by the processor, the residual data based on a quantization parameter value,
the quantization parameter value being variable such that varying the quantization parameter value controls a degree of masking of the region of interest.

8. A device comprising:
one or more processors; and
a non-transitory computer readable storage medium storing a program for execution by the one or more processors, the program including instructions causing the one or more processors to:
receive a first frame of a video stream;
receive a second frame of the video stream, wherein the second frame includes a region of interest;
determine a motion vector between the region of interest and the first frame;
determine a selected prediction mode for the region of interest from a plurality of prediction modes, wherein:
the selected prediction mode is based on the motion vector; and
the selected prediction mode is a worst prediction mode of the plurality of prediction modes; and

determine a prediction of the region of interest of the second frame based on the selected prediction mode.

9. The device of claim 8 , wherein:
the first frame includes a set of boundaries; and
the first frame includes padding outside the set of boundaries.

10. The device of claim 9 , wherein the first frame includes a set of corners located with the padding outside the set of boundaries.

11. The device of claim 10 , wherein each of the set of corners is gray.

12. The device of claim 10 , wherein the motion vector points to one of the set of corners.

13. The device of claim 8 , wherein the instructions further comprise instructions to generate residual data associated with the region of interest based on the prediction.

14. The device of claim 13 , wherein the instructions further comprise instructions to quantize the residual data based on a quantization parameter value,
the quantization parameter value being variable such that varying the quantization parameter value controls a degree of masking of the region of interest.

15. A system comprising:
a prediction module configured to:
receive a first frame of a video stream and a second frame of the video stream, wherein the second frame includes a region of interest; and
determine a motion vector between the region of interest and the first frame; and

a prediction mode determination module configured to:
determine a selected prediction mode for the region of interest from a plurality of prediction modes, wherein:
the selected prediction mode is based on the motion vector; and
the selected prediction mode is a worst prediction mode of the plurality of prediction modes;

determine a prediction of the region of interest of the second frame based on the selected prediction mode; and
output residual data based on the prediction.

16. The system of claim 15 , wherein:
the first frame includes a set of boundaries; and
the first frame includes padding outside the set of boundaries.

17. The system of claim 16 , wherein the first frame includes a set of corners located with the padding outside the set of boundaries.

18. The system of claim 17 , wherein each of the set of corners is gray.

19. The system of claim 17 , wherein the motion vector points to one of the set of corners.

20. The system of claim 15 , further comprising a quantization module configured to receive the residual data and quantize the residual data, wherein:
the residual data is associated with the region of interest; and
the residual data is quantized based on a quantization parameter value.

Assignees

• Texas Instruments Inc

Inventors

• Dutt Yashwant
• Desappan Kumar
• Goswami Piyali

Classifications

• H04N19/157

  Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter · CPC title

• H04N19/124

  Quantisation · CPC title

• H04N19/103

  Selection of coding mode or of prediction mode · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title

• H04N19/167 Primary

  Position within a video image, e.g. region of interest [ROI] · CPC title