Method of managing display data

Patent metadata

Field	Value
Publication number	US-11164288-B2
Application number	US-201916727878-A
Country	US
Kind code	B2
Filing date	Dec 26, 2019
Priority date	Jan 4, 2019
Publication date	Nov 2, 2021
Grant date	Nov 2, 2021

Abstract

A compositor receives, from each of a plurality of originating devices, compressed and/or encrypted image data portions of a frame of image data, together with portion metadata for each of the compressed and/or encrypted image data portions. Frame metadata for the frame of image data. The compositor then composites the image data portions without decompressing and/or decrypting them, based on the portion and frame metadata, by generating composited frame metadata for the composited image frame and amending the portion metadata for each of the compressed and/or encrypted image data portions to indicate a location of the compressed and/or encrypted image data portions in the composited image frame. The compressed and/or encrypted image data portions, the composited frame metadata and the amended portion metadata are then transmitted by the compositor to a display control device.

First claim

The invention claimed is:

1. A method of managing display data from a plurality of originating devices for display on a shared display, the method comprising:
receiving, at a compositor from each of the plurality of originating devices, compressed and/or encrypted image data portions of a frame of image data;
receiving, at the compositor from each of the plurality of originating devices, portion metadata for each of the compressed and/or encrypted image data portions indicating a location of the compressed and/or encrypted image data portions in the frame of image data from a particular originating device, a size of the compressed and/or encrypted image data portions, and compression and/or encryption parameters and/or protocols;
receiving, at the compositor from each of the plurality of originating devices, frame metadata for the frame of image data indicating a size of the frame of image data and a format of the frame of image data;
compositing, by the compositor, the compressed and/or encrypted image data portions without decompressing and/or decrypting the compressed and/or encrypted image data portions, based on the portion and frame metadata, by:
generating composited frame metadata for a composited image frame, wherein the composited frame metadata indicates a size of the composited image frame and a format of the composited image frame; and
amending the portion metadata for each of the compressed and/or encrypted image data portions from the plurality of originating devices to indicate pixel coordinate locations of the compressed and/or encrypted image data portions in the composited image frame; and

transmitting, by the compositor to a display control device, the compressed and/or encrypted image data portions without decompressing and/or decrypting the compressed and/or encrypted image data portions, the composited frame metadata and the amended portion metadata, including the location of the compressed and/or encrypted image data portions in the composited image frame, and the compression and/or encryption parameters and/or protocols.

2. The method of claim 1 , wherein the compositing comprises amending the portion metadata to indicate a different size of the compressed and/or encrypted image data portions in the composited image frame.

3. The method of claim 1 , wherein different image data portions are compressed and/or encrypted using different compression and/or encryption parameters and/or protocols.

4. The method of claim 1 , wherein the compositing comprises generating the composited frame metadata and amending the portion metadata so that the compressed and/or encrypted image data portions from each of the plurality of originating devices are arranged to maintain the frame of image data from each of the plurality of originating devices separately in the composited image frame.

5. The method of claim 1 , wherein the compositing comprises generating the composited frame metadata and amending the portion metadata so that the compressed and/or encrypted image data portions from each of the plurality of originating devices are arranged in a grid-like pattern in the composited image frame.

6. The method of claim 1 , wherein the compositing comprises generating the composited frame metadata and amending the portion metadata so that the compressed and/or encrypted image data portions from each of the plurality of originating devices do not overlap in the composited image frame.

7. The method of claim 1 , further comprising, receiving by the compositor, instructions indicating where the frames of image data from different ones of the plurality of originating devices are to be arranged in the composited image frame, and wherein compositing comprises generating the composited frame metadata and amending the portion metadata so that the compressed and/or encrypted image data portions from each of the plurality of originating devices are arranged in the composited image frame according to the received instructions.

8. The method of claim 1 , wherein the compressed and/or encrypted image data portions are received from each of the plurality of originating devices at independent rates, as they are generated by the plurality of originating devices and the compressed and/or encrypted image data portions are transmitted by the compositor to the display control device at a rate independent of the rates at which the compressed and/or encrypted image data portions are received from each of the plurality of originating devices.

9. The method of claim 1 , wherein the compositor further receives uncompressed and/or unencrypted image data portions and composites them together with the compressed and/or encrypted image data portions without decompressing and/or decrypting the compressed and/or encrypted image data portions.

10. A system for managing display data from a plurality of originating devices for display on a shared display comprising:
a non-transitory memory storing instructions; and
one or more hardware processors coupled to the non-transitory memory and configured to execute the instructions from the non-transitory memory to cause the system to perform operations comprising:
receiving, at a compositor from each of the plurality of originating devices, compressed and/or encrypted image data portions of a frame of image data;
receiving, at the compositor from each of the plurality of originating devices, portion metadata for each of the compressed and/or encrypted image data portions indicating a location of the compressed and/or encrypted image data portions in the frame of image data from a particular originating device, a size of the compressed and/or encrypted image data portions, and compression and/or encryption parameters and/or protocols;
receiving, at the compositor from each of the plurality of originating devices, frame metadata for the frame of image data indicating a size of the frame of image data and a format of the frame of image data;
compositing the compressed and/or encrypted image data portions without decompressing and/or decrypting the compressed and/or encrypted image data portions, based on the portion and frame metadata, by:
generating composited frame metadata for a composited image frame, wherein the composited frame metadata indicates a size of the composited image frame and a format of the composited image frame; and
amending the portion metadata for each of the compressed and/or encrypted image data portions from the plurality of originating devices to indicate pixel coordinate locations of the compressed and/or encrypted image data portions in the composited image frame; and

transmitting, to a display control device, the compressed and/or encrypted image data portions without decompressing and/or decrypting the compressed and/or encrypted image data portions, the composited frame metadata and the amended portion metadata, including the location of the compressed and/or encrypted image data portions in the composited image frame, and the compression and/or encryption parameters and/or protocols.

11. The system of claim 10 , wherein the compositing further comprises amending the portion metadata to indicate a different size of the compressed and/or encrypted image data portions in the composited image frame.

12. The system of claim 10 , wherein different image data portions are compressed and/or encrypted using different compression and/or encryption parameters and/or protocols.

13. The system of claim 10 , wherein the compositing further comprises generating the composited frame metadata and amending the portion metadata so that the compressed and/or encrypted image data portions from each of the plurality of originatin

Assignees

• Displaylink Uk Ltd

Inventors

• Hargreaves Dave
• Dunn David
• Morse Douglas

Classifications

• G09G5/026

  Control of mixing and/or overlay of colours in general (G09G5/022 and G09G5/024 take precedence) · CPC title

• G09G2340/0435

  Change or adaptation of the frame rate of the video stream · CPC title

• H04N5/45

  Picture in picture {, e.g. displaying simultaneously another television channel in a region of the screen} · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• H04N7/15

  Conference systems · CPC title