Method of managing display data

Patent metadata

Field	Value
Publication number	US-11580619-B2
Application number	US-202117492466-A
Country	US
Kind code	B2
Filing date	Oct 1, 2021
Priority date	Jan 4, 2019
Publication date	Feb 14, 2023
Grant date	Feb 14, 2023

Abstract

A compositor receives, from each of a plurality of originating devices, compressed and/or encrypted image data portions of a frame of image data, together with portion metadata for each of the compressed and/or encrypted image data portions. Frame metadata for the frame of image data. The compositor then composites the image data portions without decompressing and/or decrypting them, based on the portion and frame metadata, by generating composited frame metadata for the composited image frame and amending the portion metadata for each of the compressed and/or encrypted image data portions to indicate a location of the compressed and/or encrypted image data portions in the composited image frame. The compressed and/or encrypted image data portions, the composited frame metadata and the amended portion metadata are then transmitted by the compositor to a display control device.

First claim

What is claimed:

1. A method for displaying images on a shared display, the method comprising:
receiving a plurality of frames of image data from a plurality of originating devices, respectively, each frame of the plurality of frames including one or more image data portions that are compressed in accordance with one or more compression algorithms and respective portion metadata associated with each of the compressed image data portions, the portion metadata associated with each compressed image data portion indicating a location of the compressed image data portion in relation to the frame;
amending the portion metadata in each frame of the plurality of frames, without decompressing any of the compressed image data portions included in the frame, so that the portion metadata associated with each of the compressed image data portions indicates a pixel coordinate location of the compressed image data portion in a composited image frame, the composited image frame being a composite of the plurality of frames; and
transmitting, to the shared display, the one or more compressed image data portions included in each of the plurality of frames and the amended portion metadata associated with each of the compressed image data portions.

2. The method of claim 1 , wherein the portion metadata associated with each compressed image data portion further indicates a size of the compressed image data portion and the amending of the portion metadata associated with each compressed image data portion changes the size of the compressed image data portion indicated by the portion metadata.

3. The method of claim 1 , wherein the portion metadata and the amended portion metadata associated with each compressed image data portion further indicate one or more compression parameters or protocols associated with the compressed image data portion.

4. The method of claim 3 , wherein the portion metadata and the amended portion metadata associated with different compressed image data portions indicate different compression parameters or protocols.

5. The method of claim 1 , wherein the amending of the portion metadata comprises:
arranging the compressed image data portions so that each of the plurality of frames is separately represented in the composited image frame.

6. The method of claim 1 , wherein the amending of the portion metadata comprises:
arranging the compressed image data portions in a grid-like pattern in the composited image frame.

7. The method of claim 1 , wherein the amending of the portion metadata comprises:
arranging the compressed image data portions to not overlap in the composited image frame.

8. The method of claim 1 , wherein the amending of the portion metadata comprises:
receiving instructions indicating an arrangement of the plurality of frames relative to the composited image frame; and
arranging the compressed image data portions in the composited image frame based on the received instructions.

9. The method of claim 1 , wherein a rate at which the compressed image data portions are transmitted to the shared display is independent of any rates at which the compressed image data portions are received from the plurality of originating devices.

10. The method of claim 1 , further comprising:
receiving one or more uncompressed image data portions; and
compositing the one or more uncompressed image data portions together with the compressed image data portions in the composited image frame without decompressing any of the compressed image data portions.

11. The method of claim 1 , further comprising:
generating composited frame metadata indicating a size and format of the composited image frame; and
transmitting the composited frame metadata to the shared display.

12. The method of claim 11 , wherein each of the plurality of frames further includes frame metadata indicating a size and format of the frame that is different than the size and format of the composited frame.

13. A system for displaying images on a shared display comprising:
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, causes the system to:
receive a plurality of frames of image data from a plurality of originating devices, respectively, each frame of the plurality of frames including one or more image data portions that are compressed in accordance with one or more compression algorithms and respective portion metadata associated with each of the compressed image data portions, the portion metadata associated with each compressed image data portion indicating a location of the compressed image data portion in relation to the frame;
amend the portion metadata in each frame of the plurality of frames, without decompressing any of the compressed image data portions included in the frame, so that the portion metadata associated with each of the compressed image data portions indicates a pixel coordinate location of the compressed image data portion in a composited image frame, the composited image frame being a composite of the plurality of frames; and
transmit, to the shared display, the one or more compressed image data portions included in each of the plurality of frames and the amended portion metadata associated with each of the compressed image data portions.

14. The system of claim 13 , wherein the portion metadata associated with each compressed image data portion further indicates a size of the compressed image data portion and the amending of the portion metadata associated with each compressed image data portion changes the size of the compressed image data portion indicated by the portion metadata.

15. The system of claim 13 , wherein the portion metadata and the amended portion metadata associated with each compressed image data portion further indicate one or more compression parameters or protocols associated with the compressed image data portion.

16. The system of claim 13 , wherein the amending of the portion metadata comprises:
receiving instructions indicating an arrangement of the plurality of frames relative to the composited image frame; and
arranging the compressed image data portions in the composited image frame based on the received instructions.

17. The system of claim 13 , wherein a rate at which the compressed image data portions are transmitted to the shared display is independent of any rates at which the compressed image data portions are received from the plurality of originating devices.

18. The system of claim 13 , wherein execution of the instructions further causes the system to:
receive one or more uncompressed image data portions; and
composite the one or more uncompressed image data portions together with the compressed image data portions in the composited image frame without decompressing any of the compressed image data portions.

19. The system of claim 13 , wherein execution of the instructions further causes the system to:
generate composited frame metadata indicating a size and format of the composited image frame; and
transmit the composited frame metadata to the shared display.

20. A system comprising:
a shared display;
a plurality of originating devices configured to output a plurality of frames of image data, respectively, for display on the shared display, each frame of the plurality of frames including one or more image data portions that are compressed in accordance with one or more compression algorithms and respective portion metadata associated with each of the compressed image data portions, the portion metad

Assignees

• Displaylink Uk Ltd

Inventors

• Hargreaves David
• Dunn David
• Morse Douglas

Classifications

• H04N5/45

  Picture in picture {, e.g. displaying simultaneously another television channel in a region of the screen} · CPC title

• G09G2340/02

  Handling of images in compressed format, e.g. JPEG, MPEG · CPC title

• G06F3/14

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• G09G5/026

  Control of mixing and/or overlay of colours in general (G09G5/022 and G09G5/024 take precedence) · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title