Method, an apparatus and a computer program product for streaming of immersive video

Patent metadata

Field	Value
Publication number	US-12495131-B2
Application number	US-202318342392-A
Country	US
Kind code	B2
Filing date	Jun 27, 2023
Priority date	Jul 4, 2022
Publication date	Dec 9, 2025
Grant date	Dec 9, 2025

Abstract

The embodiments relate to a method and technical equipment for implementing the method. The method comprises receiving an omnidirectional video; determining a marker identifying a viewport for a client device; determining a region of the omnidirectional video frame based, at least partially, on the viewport; encoding the determined region with a marker for synchronized operation between the client device and a server; packetizing the encoded region; and transmitting the packetized region to the client device.

First claim

The invention claimed is:

1 . An apparatus comprising:
at least one processor; and at least one memory storing instructions that, when executed with the at least one processor, cause the apparatus at least to:
receive an omnidirectional video;
determine a marker identifying a request for a viewport for a client device;
determine a region of a frame of the omnidirectional video based, at least partially, on the viewport;
encode the determined region, along with the marker, for a synchronized operation between the client device and a server;
packetize the encoded region; and
transmit the packetized region to the client device.

2 . The apparatus according to claim 1 , wherein the marker has been specified by the client device and is one of the following: a color code, a watermark, a symbol, or an identification.

3 . The apparatus according to claim 2 , wherein the marker comprises a color code that is defined such that each byte is either 0x00 or 0xFF to make the marker identifiable from encoding and decoding processes.

4 . The apparatus according to claim 1 , wherein the marker is associated with an operational metadata, used by the client device and the server.

5 . The apparatus according to claim 4 , wherein the operational metadata comprises a viewport definition and/or orientation data of the omnidirectional video.

6 . The apparatus according to claim 5 , wherein the orientation data comprises rendering parameters.

7 . The apparatus according to claim 1 , wherein a location of the marker is one or more corners in the determined region.

8 . The apparatus according to claim 7 , wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to:
indicate in or along with a bitstream a type and/or the location of the marker that is used in the frame of the omnidirectional video.

9 . The apparatus according to claim 1 , wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to:
generate a parameter to be transmitted in or along a bitstream, the parameter indicating at least a location of the marker.

10 . The apparatus according to claim 1 , wherein the marker identifies a viewing direction requested by the client device.

11 . The apparatus according to claim 1 , wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to:
generate viewport margins around the viewport, the viewport margins comprising a location of the marker.

12 . The apparatus according to claim 1 , wherein the at least one memory stores instructions that, when executed with the at least one processor, cause the apparatus to:
determine a delivery mode and the marker from the request from the client device.

13 . A method, comprising:
receiving an omnidirectional video; determining a marker identifying a request for a viewport for a client device; determining a region of a frame of the omnidirectional video based, at least partially, on the viewport; encoding the determined region, along with the marker, for a synchronized operation between the client device and a server; packetizing the encoded region; and transmitting the packetized region to the client device.

14 . The method according to claim 13 , wherein the marker has been specified by the client device and is one of the following: a color code, a watermark, a symbol, or an identification.

15 . The method according to claim 14 , wherein the marker comprises a color code that is defined such that each byte is either 0x00 or 0xFF to make the marker identifiable from encoding and decoding processes.

16 . The method according to claim 13 , wherein the marker is associated with an operational metadata, used by the client device and the server.

17 . The method according to claim 16 , wherein the operational metadata comprises a viewport definition and/or orientation data of the omnidirectional video.

18 . The method according to claim 17 , wherein the orientation data comprises rendering parameters.

19 . The method according to claim 13 , wherein a location of the marker is one or more corners in the determined region.

20 . The method according to claim 19 , further comprising:
indicating in or along with a bitstream a type and/or the location of the marker that is used in the frame of the omnidirectional video.

Assignees

• Nokia Technologies Oy

Inventors

• Lepistö Mikael
• You Yu
• Mate Sujeet Shyamsundar
• Ahsan Saba

Classifications

• H04N13/194

  Transmission of image signals · CPC title

• H04N13/167

  Synchronising or controlling image signals · CPC title

• H04N19/17 Primary

  the unit being an image region, e.g. an object · CPC title

• H04N19/46

  Embedding additional information in the video signal during the compression process (H04N19/517, H04N19/68, H04N19/70 take precedence) · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title