Method for accessing a spatio-temporal part of a compressed video sequence using decomposed access request

Patent metadata

Field	Value
Publication number	US-9258530-B2
Application number	US-201113639838-A
Country	US
Kind code	B2
Filing date	Apr 8, 2011
Priority date	Apr 9, 2010
Publication date	Feb 9, 2016
Grant date	Feb 9, 2016

Abstract

A processing method and an associated device for accessing a spatio-temporal part of a compressed video sequence.
The method includes the following steps:
obtaining a request for access to the part by identifying a temporal section defined between initial and final times of the initial and final spatial regions—different from the initial region of the sequence at the initial and final times; decomposing the access request into a plurality of elementary requests for access to a video fragment, each elementary request identifying a fixed spatial region to extract in a temporal sub-interval of the temporal section; and

exploiting at least one elementary request to access video fragments constituting the part to access.

First claim

The invention claimed is:

1. A processing method for accessing a spatio-temporal part of a compressed video sequence, comprising a step of obtaining a request for access to the spatio-temporal part by identifying a temporal section defined between an initial time (t i ) and a final time (t f ) in said sequence, characterized in that:
the access request identifies an initial spatial region of the sequence at the initial time, and a final spatial region of the sequence at the final time that is different from the initial spatial region;
and the method comprises the steps of:
decomposing the access request into a plurality of elementary requests successively and in a temporal order for access to a video fragment of the sequence, each elementary request identifying a fixed spatial region to extract in a temporal sub-interval of said temporal section; and
exploiting at least one elementary request to access at least one video fragment constituting the spatio-temporal part to access;
wherein the method further comprises a step of dynamically adjusting the decomposition of the access request during the processing of elementary requests,
wherein the adjusting step comprises the re-computation of the elementary requests not yet exploited into a plurality of elementary requests associated with temporal sub-intervals of modified duration, and
wherein a location and a size of the fixed spatial region are fixed between the initial time and the final time of the elementary requests.

2. A method according to claim 1 , comprising the steps of:
transmitting the elementary request to a server device storing said video sequence and receiving, in return, at least one corresponding extracted fragment; and
re-computing the elementary requests not yet exploited on the basis of the received fragment.

3. A method according to claim 1 , in which the decomposition or possible re-computation of the elementary requests not yet exploited and the associated modification of the duration depend on a performance criterion of a client terminal establishing the access request and/or of a server device storing said video sequence and/or of a communication network linking the client terminal and the server device.

4. A method according to claim 1 , in which the duration of the temporal sub-intervals corresponding to the elementary requests depends on the spatial accessibility of image data composing the video sequence.

5. A method according to claim 1 , in which the video sequence being compressed using a temporal prediction mechanism, the duration of the temporal sub-intervals corresponding to the elementary requests depends on the period separating two images without temporal dependency in the video sequence.

6. A method according to claim 5 , wherein a temporal sub-interval is aligned with images of the video sequence which are not compressed by temporal prediction.

7. A method according to claim 5 , in which the initial time is offset to align with the last image of the video sequence that precedes the initial time and that is not compressed by temporal prediction.

8. A method according to claim 1 , wherein the decomposition into elementary requests is implemented at a client terminal establishing said access request.

9. A method according to claim 1 , wherein the decomposition into elementary requests is implemented at a server device storing said compressed video sequence.

10. A method according to claim 9 , wherein the server device makes available to a client terminal the list of the elementary requests.

11. A method according to claim 1 , wherein the decomposition into elementary requests is implemented at an intermediate device located on a communication network between a client terminal making said access request and a server device storing said compressed video sequence.

12. A method according to claim 11 , wherein said intermediate device is a proxy which receives the access request from the client terminal, sends each of the elementary requests to the server device, stores each of the video fragments received from the server device and transmits a response to the access request from the client terminal that is established on the basis of the stored video fragments.

13. A method according to claim 1 , in which the decomposition of the access request comprises iteratively determining the duration of the temporal sub-intervals.

14. A method according to claim 13 , wherein said iterative determining comprises iteratively sub-dividing the temporal sub-intervals for as long as the ratio between the estimated costs of transmitting the video fragments respectively corresponding to a sub-interval after iteration and to a sub-interval before iteration is less than a threshold value.

15. A method according to claim 1 , in which the elementary request comprises at least one parameter defining the fixed spatial region, and a component representing a spatial variation of the fixed spatial region during the corresponding temporal sub-interval.

16. A processing method for accessing a spatio-temporal part of a compressed video sequence, comprising a step of obtaining a request for access to the spatio-temporal part by identifying a temporal section defined between an initial time (t i ) and a final time (t f ) in said sequence, characterized in that:
the access request identifies an initial spatial region of the sequence at the initial time, and a final spatial region of the sequence at the final time that is different from the initial spatial region;
and the method comprises the steps of:
decomposing the access request into a plurality of elementary requests successively and in a temporal order for access to a video fragment of the sequence, each elementary request identifying a fixed spatial region to extract in a temporal sub-interval of said temporal section; and
exploiting at least one elementary request to access at least one video fragment constituting the spatio-temporal part to access;
wherein the decomposition comprises a step of performing linear interpolation, along a temporal axis, of two intermediate spatial regions corresponding to the two extreme times of the temporal sub-interval, on the basis of the initial and final spatial regions, and
wherein a location and a size of the fixed spatial region are fixed between the initial time and the final time of the elementary requests.

17. A method according to claim 16 , wherein said fixed spatial region associated with said temporal sub-interval encompasses said corresponding two intermediate spatial regions.

18. A means of non-transitory information storage, possibly totally or partially removable, that is readable by a computer system, comprising instructions for a computer program adapted to implement the method according claim 16 , when the program is loaded and executed by the computer system.

19. A processing device for accessing a spatio-temporal part of a compressed video sequence on the basis of an access request, the access request identifying a temporal section defined between an initial time and a final time in the sequence, characterized in that:
the access request furthermore identifies an initial spatial region of the sequence at the initial time, and a final spatial region of the sequence at the final time that is different from said initial spatial region;
and the device comprises:
a processor; and
a memory containing instructions that, when executed by the processor, perform operations comprising:
decomposing the access request into a plurality of elementary requests successively and in a

Assignees

• Denoual Franck
• Fablet Youenn
• Canon Kk

Inventors

• Denoual Franck
• Fablet Youenn

Classifications

• H04N21/2668

  Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles {(information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063)} · CPC title

• H04N7/17336 Primary

  Handling of requests in head-ends · CPC title

• H04N21/234363

  by altering the spatial resolution, e.g. for clients with a lower screen resolution · CPC title

• H04N21/6587

  Control parameters, e.g. trick play commands, viewpoint selection · CPC title

• H04N21/4728

  for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region · CPC title