Advanced signaling of a most-interested region in an image

Patent metadata

Field	Value
Publication number	US-10565463-B2
Application number	US-201715591805-A
Country	US
Kind code	B2
Filing date	May 10, 2017
Priority date	May 24, 2016
Publication date	Feb 18, 2020
Grant date	Feb 18, 2020

Abstract

A device for determining information for video data includes one or more processors implemented in circuitry that are configured to determine one or more most-interested regions of a plurality of regions of an image of video data from data representative of the one or more most-interested regions. The one or more processors are further configured to generate a request specifying the one or more most-interested regions using the data representative of the one or more most-interested regions and output the request to a server device.

First claim

What is claimed is:

1. A method of determining information for video, the method comprising:
determining, by a processor of a client device, the processor implemented in circuitry, one or more most-interested regions of a plurality of regions of an image of video data from data representative of the one or more most-interested regions;
generating, by the processor, a request specifying the one or more most-interested regions using the data representative of the one or more most-interested regions;
outputting, by the processor, the request specifying the one or more most-interested regions to a server device;
receiving, by the processor from the server device, video data for the one or more most-interested regions;
outputting, by the processor after outputting the request specifying the one or more most-interested regions, a request specifying one or more other regions of the image to the server device; and
receiving, by the processor from the server device, video data for the one or more other regions.

2. The method of claim 1 , further comprising:
generating, by the processor, the request specifying the one or more other regions of the image using a user's field of view (FOV).

3. The method of claim 1 , wherein determining the one or more most-interested regions comprises extracting most-interested regions data from a supplemental enhancement information (SEI) message, wherein the most-interested regions data represents the one or more most-interested regions.

4. The method of claim 1 , wherein determining the one or more most-interested regions comprises extracting most-interested regions data from a sample group box included in file format header information, wherein the most-interested regions data represents the one or more most-interested regions.

5. The method of claim 1 , wherein determining the one or more most-interested regions comprises extracting most-interested regions data from a sample table box or a track fragment included in file format header information, wherein the most-interested regions data represents the one or more most-interested regions.

6. The method of claim 1 , wherein determining the one or more most-interested regions comprises extracting most-interested regions data from a segment index box included in file format header information, wherein the most-interested regions data represents the one or more most-interested regions.

7. The method of claim 1 , wherein determining the one or more most-interested regions comprises extracting most-interested regions data from a dynamic adaptive streaming over HTTP (DASH) media presentation description (MPD), wherein the most-interested regions data represents the one or more most-interested regions.

8. The method of claim 1 , wherein determining the one or more most-interested regions comprises determining, for each most-interested region of the one or more most-interested regions, a plurality of values for a plurality of syntax elements representative of a position of a respective most-interested region relative to a base region and a size of the respective most-interested region relative to the base region.

9. The method of claim 7 , wherein determining the plurality of values for the plurality of syntax elements comprises, for each most-interested region of the one or more most-interested regions:
extracting a value for a first syntax element representative of a left horizontal offset of the respective most-interested region relative to the base region;
extracting a value for a second syntax element representative of a top vertical offset of the respective most-interested region relative to the base region;
extracting a value for a third syntax element representative of a width of the respective most-interested region relative to the base region; and
extracting a value for a fourth syntax element representative of a height of the respective most-interested region relative to the base region.

10. The method of claim 1 , wherein determining the one or more most-interested regions comprises extracting one or more tile identifiers representative of one or more tiles of the image, wherein the one or more tiles are spatially collocated with the one or more most-interested regions.

11. The method of claim 1 , wherein determining the one or more most-interested regions comprises extracting one or more group identifiers representative of one or more regions of the plurality of regions of the image.

12. The method of claim 1 , wherein determining the one or more most-interested regions comprises extracting one or more track identifiers representative of one or more tracks, each track of the one or more tracks including video coding layer (VCL) data for the one or more most-interested regions.

13. The method of claim 1 , wherein determining the one or more most-interested regions comprises extracting one or more representation identifiers representative of one or more representations of the image, each representation of the one or more representations including video coding layer (VCL) data for the one or more most-interested regions.

14. The method of claim 1 , wherein determining the one or more most-interested regions comprises:
extracting one or more base tile track identifiers representative of one or more base tile tracks; and
extracting most-interested regions data from the one or more base tile tracks using the one or more base tile track identifiers.

15. The method of claim 1 , wherein determining the one or more most-interested regions comprises determining one or more syntax elements representative of an image order count, the image order count indicating that the data representative of the one or more most-interested regions applies to the image.

16. A device for determining information for video data, the device comprising one or more processors implemented in circuitry that are configured to:
determine one or more most-interested regions of a plurality of regions of an image of video data from data representative of the one or more most-interested regions;
generate a request specifying the one or more most-interested regions using the data representative of the one or more most-interested regions;
output the request specifying the one or more most-interested regions to a server device;
receive, from the server device, video data for the one or more most-interested regions;
output, after outputting the request specifying the one or more most-interested regions, a request specifying one or more other regions of the image to the server device; and
receive, from the server device, video data for the one or more other regions.

17. The device of claim 16 , wherein, to determine the one or more most-interested regions, the one or more processors are further configured to extract most-interested regions data from a supplemental enhancement information (SEI) message, wherein the most-interested regions data represents the one or more most-interested regions.

18. The device of claim 16 , wherein, to determine the one or more most-interested regions, the one or more processors are further configured to extract most-interested regions data from a sample group box, a sample table box, a track fragment, or a segment index box included in file format header information, wherein the most-interested regions data represents the one or more most-interested regions.

19. The device of claim 16 , wherein, to determine the one or more most-interested regions, the one or more processors are further configured to extract most-interested regions data from a dynamic adapt

Assignees

• Qualcomm Inc

Inventors

• Wang Ye-Kui
• Hendry Fnu

Classifications

• H04N21/2353 Primary

  specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata · CPC title

• H04N21/4728 Primary

  for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region · CPC title

• H04N21/234327

  by decomposing into layers, e.g. base layer and one or more enhancement layers · CPC title

• H04N19/70

  characterised by syntax aspects related to video coding, e.g. related to compression standards · CPC title

• H04N19/167

  Position within a video image, e.g. region of interest [ROI] · CPC title