Resilient transmission of raw video streams over an IP communication network

Patent metadata

Field	Value
Publication number	US-10917650-B2
Application number	US-201816033112-A
Country	US
Kind code	B2
Filing date	Jul 11, 2018
Priority date	Jul 11, 2018
Publication date	Feb 9, 2021
Grant date	Feb 9, 2021

Abstract

Systems, methods, and computer program products relating to resilient transmission of a media stream over a communication network. A plurality of data packets are received over a communications network. The plurality of data packets relate to a first source video portion transformed using a geometric transform. The geometric transform is configured to modify a location of pixels in the first source video portion such that a plurality of adjacent pixels in the first source video portion are not adjacent after transformation. A received video portion is assembled based on the plurality of data packets. The received video portion is transformed, using an inverse of the geometric transform, to generate a second source video portion. The second source video portion and the first source video portion include a plurality of matching pixels.

First claim

We claim:

1. A method comprising:
receiving a plurality of data packets over a communications network, the plurality of data packets relating to a first source video portion transformed using a geometric transform, wherein the geometric transform is configured to modify a location of pixels in the first source video portion to increase a distance between pixels in a plurality of pairs of adjacent pixels in the first source video portion, such that the pixels in the plurality of pairs of adjacent pixels in the first source video portion are no longer adjacent after transformation;
assembling a received video portion based on the plurality of data packets; and
transforming the received video portion, using an inverse of the geometric transform, to generate a second source video portion, wherein the second source video portion and the first source video portion include a plurality of matching pixels.

2. The method of claim 1 , further comprising:
determining that at least one data packet relating to the first source video portion was lost during transmission over the communications network; and
recreating pixel data in the second source video portion to compensate for the lost at least one packet.

3. The method of claim 2 , wherein recreating pixel data further comprises:
identifying a first pixel in the second source video portion with missing color values;
selecting a plurality of reference pixels adjacent to the first pixel in the second source video portion; and
determining the color value for the first pixel based on the color values of the plurality of reference pixels.

4. The method of claim 1 , wherein the geometric transform increases the distance between the pixels in the plurality of pairs of adjacent pixels such that the previously adjacent pixels in the plurality of pairs of adjacent pixels have a distance above a pre-determined threshold distance after transformation.

5. The method of claim 1 , wherein one or more individual packets in the plurality of data packets include pixel data for two or more pixels that are adjacent in a transformed first video source portion and are not adjacent in the first source video portion prior to transformation.

6. The method of claim 1 , wherein the first source video portion comprises supplementary image data and base image data, and wherein the supplementary image data and the base image data are separately transformed, using the geometric transform, prior to transmission over the communications network.

7. The method of claim 1 , wherein the first source video portion is part of a real-time video transmission.

8. The method of claim 1 , wherein the communication network is an IP communication network, and wherein the data packets are received using Real-time Transport Protocol (RTP).

9. A system, comprising:
a processor; and
a memory storing a program, which, when executed on the processor, performs an operation, the operation comprising:
receiving a plurality of data packets over a communications network, the plurality of data packets relating to a first source video portion transformed using a geometric transform, wherein the geometric transform is configured to modify a location of pixels in the first source video portion to increase a distance between pixels in a plurality of pairs of adjacent pixels in the first source video portion, such that the pixels in the plurality of pairs of adjacent pixels in the first source video portion are no longer adjacent after transformation;
assembling a received video portion based on the plurality of data packets; and
transforming the received video portion, using an inverse of the geometric transform, to generate a second source video portion, wherein the second source video portion and the first source video portion include a plurality of matching pixels.

10. The system of claim 9 , the operation further comprising:
determining that at least one data packet relating to the first source video portion was lost during transmission over the communications network; and
recreating pixel data in the second source video portion to compensate for the lost at least one packet.

11. The system of claim 10 , wherein recreating pixel data further comprises:
identifying a first pixel in the second source video portion with missing color values;
selecting a plurality of reference pixels adjacent to the first pixel in the second source video portion; and
determining the color value for the first pixel based on the color values of the plurality of reference pixels.

12. The system of claim 9 , wherein the geometric transform increases the minimum distance between the pixels in the plurality of pairs of adjacent pixels such that the previously adjacent pixels in the plurality of pairs of adjacent pixels have a distance above a pre-determined threshold distance after transformation.

13. The system of claim 9 , wherein one or more individual packets in the plurality of data packets include pixel data for two or more pixels that are adjacent in a transformed first video source portion and are not adjacent in the first source video portion prior to transformation.

14. The system of claim 9 , wherein the first source video portion comprises supplementary image data and base image data, and wherein the supplementary image data and the base image data are separately transformed, using the geometric transform, prior to transmission over the communications network.

15. A non-transitory computer program product, the computer program product comprising:
a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation, the operation comprising:
transforming a first source video portion using a geometric transform, wherein the geometric transform is configured to modify a location of pixels in the first source video portion to increase a distance between pixels in a plurality of pairs of adjacent pixels in the first source video portion, such that the pixels in the plurality of pairs of adjacent pixels in the first source video portion are no longer adjacent after transformation; and
transmitting a plurality of data packets, relating to the transformed first source video portion, over a communication network, wherein the plurality of data packets are configured to be received and used to generate a second source video portion using an inverse of the geometric transform, and wherein the second source video portion and the first source video portion include a plurality of matching pixels.

16. The non-transitory computer program product of claim 15 , the operation further comprising:
determining that at least one data packet relating to the first source video portion was lost during transmission over the communications network; and
recreating pixel data in the second source video portion to compensate for the lost at least one packet.

17. The non-transitory computer program product of claim 15 , wherein the geometric transform increases the distance between the pixels in the plurality of pairs of adjacent pixels such that the previously adjacent pixels in the plurality of pairs of adjacent pixels have a distance above a pre-determined threshold distance after transformation.

18. The non-transitory computer program product of claim 15 , wherein one or more individual packets in the plurality of data packets include pixel data for two or more pixels that are adjacent in a transformed first video source portion and are not adjacent in the first sou

Assignees

• Cisco Tech Inc

Inventors

• Hawari Mohammed
• Desmouceaux Yoann
• Enguehard Marcel
• Augustin Aloÿs C
• Surcouf Andre

Classifications

• H04L65/762

  at the source  (reformatting of additional data in video distribution servers H04N21/2355) · CPC title

• H04L65/65

  Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP] · CPC title

• H04L65/612

  for unicast · CPC title

• H04N21/64322 Primary

  IP · CPC title

• H04L65/80

  Responding to QoS · CPC title