Pixel perturbation for transmission of meta-information

Patent metadata

Field	Value
Publication number	US-9866724-B2
Application number	US-201514743580-A
Country	US
Kind code	B2
Filing date	Jun 18, 2015
Priority date	Jun 18, 2015
Publication date	Jan 9, 2018
Grant date	Jan 9, 2018

Abstract

Techniques disclosed herein provide an approach using pixel perturbation to transmit information. In one embodiment, a pixel perturbation engine perturbs pixels of an image to encode meta-information therein. In particular, the perturbation engine may perform controlled perturbation of pixel bits which are unlikely to affect visual quality are perturbed, such as perturbing the least significant bits in one or more channels of a RGB or YUV image. Higher order bits may also be perturbed in color channels such as the blue or UV channels that the human eye is less sensitive to. To mitigate loss of information, the information may be encoded using error correcting codes. After the image having meta-information encoded therein is transmitted to a client device, the meta-information may be recovered and used to determine performance of the virtual desktop infrastructures (VDI) system.

First claim

What is claimed is:

1. A computer-implemented method of encoding information in an image transmitted from a first computing device to a second computing device, comprising:
receiving an image;
perturbing at least one bit in each pixel of a plurality of pixels selected from the received image to encode information therein, wherein at least one other bit in each of the plurality of selected pixels is not perturbed, and wherein bits in one or more bit positions that are higher than one or more least significant bit positions are perturbed in a blue but not a green channel where the received image is a RGB image or a UV but not a Y channel where the received image is a YUV image; and
subsequent to the perturbing, transmitting the image having the information encoded therein to the second computing device.

2. The method of claim 1 , wherein the perturbing includes perturbing one or more least significant bits in one or more channels of the selected pixels of the received image.

3. The method of claim 2 , wherein the bits are perturbed after a quantization step performed during lossy compression of the received image.

4. The method of claim 1 , wherein the perturbed pixels are pixels in one or more scan lines or pixel tiles.

5. The method of claim 1 , wherein the received image is a displayed image of a virtual desktop.

6. The method of claim 5 , wherein the information includes meta-information for benchmarking or capacity planning of a virtual desktop infrastructure (VDI) service providing the virtual desktop.

7. The method of claim 6 , wherein the meta-information includes at least one of information indicating the start or end of an operation, information indicating the intended movement of a window, information indicating which applications are running, information indicating whether a particular window is showing, a frame number, a page number, coordinates of an inner frame, a watermark, and a document identifier.

8. The method of claim 1 , wherein the information is encoded using an error correcting code.

9. The method of claim 1 , wherein the information is repeatedly encoded for redundancy.

10. A non-transitory computer-readable storage medium containing a program which, when executed by one or more processors, performs operations for encoding information in an image transmitted from a first computing device to a second computing device, the operations comprising:
receiving an image;
perturbing at least one bit in each pixel of a plurality of the selected pixels selected from the received image to encode information therein, wherein at least one other bit in each of the plurality of selected pixels is not perturbed, and wherein bits in one or more bit positions that are higher than one or more least significant bit positions are perturbed in a blue but not a green channel where the received image is a RGB image or a UV but not a Y channel where the received image is a YUV image; and
subsequent to the perturbing, transmitting the image having the information encoded therein to the second computing device.

11. The computer-readable storage medium of claim 10 , wherein the perturbing includes perturbing one or more least significant bits in one or more color channels of the selected pixels of the received image.

12. The computer-readable storage medium of claim 11 , wherein the bits are perturbed after a quantization step performed during lossy compression of the received image.

13. The computer-readable storage medium of claim 10 , wherein the perturbed pixels are pixels in one or more scan lines or pixel tiles.

14. The computer-readable storage medium of claim 10 , wherein the information includes meta-information for benchmarking or capacity planning of a virtual desktop infrastructure (VDI) service providing a virtual desktop.

15. The computer-readable storage medium of claim 14 , wherein the meta-information includes at least one of information indicating the start or end of an operation, information indicating the intended movement of a window, information indicating which applications are running, information indicating whether a particular window is showing, a frame number, a page number, coordinates of an inner frame, a watermark, and a document identifier.

16. The computer-readable storage medium of claim 10 , wherein the information is encoded using an error correcting code.

17. The computer-readable storage medium of claim 10 , wherein the information is repeatedly encoded for redundancy.

18. A system, comprising:
a processor; and
a memory, wherein the memory includes a program executable in the processor to perform operations for encoding information in an image transmitted from the system to another computing device, the operations comprising:
receiving an image,
perturbing at least one bit in each pixel of a plurality of pixels selected from the received image to encode information therein, wherein at least one other bit in each of the plurality of selected pixels is not perturbed, and wherein bits in one or more bit positions that are higher than one or more least significant bit positions are perturbed in a blue but not a green channel where the received image is a RGB image or a UV but not a Y channel where the received image is a YUV image, and
subsequent to the perturbing, transmitting the image having the information encoded therein to the other computing device.

Assignees

• Vmware Inc

Inventors

• Kurkure Uday
• Sivaraman Hari
• Farkas Peter
• He Xingze

Classifications

• G06T2201/0202

  whereby the quality of watermarked images is measured; Measuring quality or performance of watermarking methods; Balancing between quality and robustness · CPC title

• H04N1/32309

  in colour image data · CPC title

• G06T2201/0081

  whereby both original and watermarked images are required at decoder, e.g. destination-based, non-blind, non-oblivious · CPC title

• G06T2201/0051

  Embedding of the watermark in the spatial domain · CPC title

• G06T7/0002

  Inspection of images, e.g. flaw detection · CPC title