Measuring remote video display with embedded pixels

Patent metadata

Field	Value
Publication number	US-9674518-B2
Application number	US-201314137515-A
Country	US
Kind code	B2
Filing date	Dec 20, 2013
Priority date	Dec 20, 2013
Publication date	Jun 6, 2017
Grant date	Jun 6, 2017

Abstract

Methods, systems, and computer programs are provided for managing remote display performance. One method includes an operation for determining pixel data for a group of macroblocks, each macroblock having a group of pixels. The macroblocks are for embedding in respective video frames of a video stream. The pixel data for each pixel in each macroblock is calculated with a formula based on the frame number of the respective video frame and on the location of the pixel within the macroblock. Farther, the method includes operations for embedding the macroblocks in the respective video frames, and for transmitting the video frames with the embedded macroblocks to a remote client. A performance metric for the transmitted video stream is calculated based on the macroblocks received at the remote client by comparing the received macroblocks to the expected macroblocks based on the formula.

First claim

What is claimed is:

1. A method for determining a performance metric corresponding to a video stream transmitted from a server computing device to a remote client, comprising:
determining pixel data for a plurality of macroblocks, each macroblock having a plurality of pixels, the macroblocks defined to be embedded in respective video frames of the video stream, wherein the pixel data for each pixel in each macroblock is based on a frame number of a respective video frame and a location of the pixel within the macroblock; wherein determining pixel data further includes: calculating RGB values for each pixel, the RGB values including a red value, a green value, and a blue value;
embedding the macroblocks in the respective video frames;
transmitting the video frames with the embedded macroblocks to the remote client, wherein the video frames are displayed on the remote client;
wherein the remote client calculates expected macroblocks; and
wherein the performance metric for the transmitted video stream is calculated based on a comparison of the macroblocks received at the remote client and the expected macroblocks, wherein operations of the method are executed by a processor.

2. The method as recited in claim 1 , wherein calculating RGB values for each pixel further includes:
calculating the red value as ((k 1 ·n+k 2 ·x+k 3 ·y) modulo k 4 ) AND 0xFF;
calculating the green value as ((k 5 ·n+k 6 ·x+k 7 ·y) modulo k 8 ) AND 0xFF; and
calculating the blue value as ((k 9 ·n+k 10 ·x+k 11 ·y) modulo k 12 ) AND 0xFF,
wherein k 1 -k 12 are predetermined constants, n is the frame number, and x and y are coordinates of the pixel within the macroblock.

3. The method as recited in claim 2 , wherein a location of each macroblock within the respective video frame is different from a location of the macroblock inserted in a previous video frame.

4. A method for determining a performance metric corresponding to a video stream transmitted from a server computing device to a remote client, comprising:
determining pixel data for a plurality of macroblocks, each macroblock having a plurality of pixels, the macroblocks defined to be embedded in respective video frames of the video stream, wherein the pixel data for each pixel in each macroblock is based on a frame number of a respective video frame and a location of the pixel within the macroblock;
embedding the macroblocks in the respective video frames;
embedding metadata in pixel values of the macroblock;
transmitting the video frames with the embedded macroblocks to the remote client, wherein the video frames are displayed on the remote client;
calculating, at the remote client, expected macroblocks; and
wherein the performance metric for the transmitted video stream is calculated based on a comparison of the macroblocks received at the remote client and the expected macroblocks, wherein operations of the method are executed by a processor.

5. The method as recited in claim 4 , wherein the metadata includes a predetermined marker and the frame number.

6. The method as recited in claim 4 , wherein calculating the performance metric further includes:
determining first pixel values for a first expected macroblock based on the frame number of a received video frame and locations of each pixel within the first expected macroblock; and
comparing the first expected macroblock to a respective received macroblock embedded in the received video frame.

7. The method as recited in claim 4 , wherein calculating the performance metric further includes:
calculating the performance metric utilizing a Peak Signal-to-Noise Ratio (PSNR) algorithm based on comparing a received macroblock and an expected macroblock.

8. The method as recited in claim 4 , wherein embedding the macroblocks further includes:
embedding the macroblocks in the video stream; and
storing the video stream with the embedded macroblocks in permanent storage before transmitting the video frames.

9. A method for determining a performance metric corresponding to a video stream transmitted from a server computing device to a remote client, comprising:
determining pixel data for a plurality of macroblocks, each macroblock having a plurality of pixels, the macroblocks defined to be embedded in respective video frames of the video stream, wherein the pixel data for each pixel in each macroblock is based on a frame number of a respective video frame and a location of the pixel within the macroblock;
embedding the macroblocks in the respective video frames;
transmitting the video frames with the embedded macroblocks to the remote client, wherein the video frames are displayed on the remote client;
calculating, at the remote client, expected macroblocks; and
wherein the performance metric for the transmitted video stream is calculated based on a comparison of the macroblocks received at the remote client and the expected macroblocks, wherein operations of the method are executed by a processor;
wherein embedding the macroblocks further includes:
intercepting each video frame as the video frame is sent to the remote client; and
inserting the macroblock in each intercepted video frame before transmitting each video frame.

10. A non-transitory computer-readable storage medium storing a computer program for determining a performance metric corresponding to a video stream transmitted from a server computing device to a remote client, the computer-readable storage medium comprising:
program instructions for calculating pixel data for a plurality of macroblocks, each macroblock having a plurality of pixels, the macroblocks defined to be embedded in respective video frames of the video stream, wherein the pixel data for each pixel in each macroblock is calculated based on a frame number of the respective video frame and a location of the pixel within the macroblock, wherein calculating pixel data further includes:
program instructions for calculating RGB values for each pixel, the RGB values including a red value, a green value, and a blue value;

program instructions for embedding the macroblocks in the respective video frames; and
program instructions for transmitting the video frames with the embedded macroblocks to the remote client, wherein the video frames are displayed on the remote client, wherein the remote client is configured to:
calculate expected macroblocks;
calculate the performance metric for the transmitted video stream based on a comparison of the macroblocks received at the remote client and the expected macroblocks; and
store the performance metric in memory.

11. The non-transitory computer-readable storage medium as recited in claim 10 , wherein calculating RGB values further includes:
program instructions for calculating the red value as ((k 1 ·n+k 2 ·x+k 3 ·y) modulo k 4 ) AND 0xFF;
program instructions for calculating the green value as ((k 5 ·n+k 6 ·x+k 7 ·y) modulo k 8 ) AND 0xFF; and

program instructions for calculating the blue value a as ((k 9 ·n+k 10 ·x+k 11 ·y) modulo k 12 ) AND 0xFF, wherein k 1 -k 12 are predetermined constants, n is the frame number, and x and y are coordinates of the pixel within the macroblock.

12. The non-transitory computer-readable storage medium as recited in claim 10 , wherein embedding the macroblocks further includes:
program instructions for embedding the macroblocks in the video stream; and
program instructions for storing the video stream with the embedded macroblocks in permanent storage before transmitting the video frames.

13. A non-transitory computer-readable storage medium storing a computer program for determining a performance metric corresponding to a video stream t

Assignees

• Vmware Inc

Inventors

• Agrawal Banit
• Spracklen Lawrence
• Bidarkar Rishi

Classifications

• H04N17/02 Primary

  for colour television signals · CPC title

• H04N17/004

  for digital television systems · CPC title

• H04N19/46

  Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) · CPC title