Apparatus, Method And Computer Program Product For Scene Synthesis

Patent metadata

Field	Value
Publication number	US-2016100110-A1
Application number	US-201514873432-A
Country	US
Kind code	A1
Filing date	Oct 2, 2015
Priority date	Oct 2, 2014
Publication date	Apr 7, 2016
Grant date	—

Abstract

There is provided methods, apparatuses and computer program products for obtaining a media presentation as a seed media; and obtaining one or more criteria for content extraction. Information relating to media presentations among a set of media presentations is examined to find out relevance information regarding the context and/or content of the media presentations by using the seed media and the one or more criteria. On the basis of the examination, one or more media presentations among the set of media presentations corresponding with the one or more criteria are extracted.

First claim

1 . A method for an apparatus, comprising:
obtaining a media presentation as a seed media; obtaining one or more criteria for content extraction; examining information relating to media presentations among a set of media presentations to find out relevance information regarding at least one of the context or content of the media presentations by using the seed media and the one or more criteria; and on the basis of the examination, extracting one or more media presentations among the set of media presentations corresponding with the one or more criteria.

2 . A method according to claim 1 , wherein the one or more criteria comprises one or more of the following:
one or more visual objects of interests in the seed media; one or more non-visual objects of interests in a scene of the seed media; object of interest relevance with a social network; object of interest relevance with previous object of interest preferences; position in a three dimensional space of a device captured the seed media; or object of interest appearance frequency.

3 . A method according to claim 1 further comprising using the extracted media presentation to form a synthesized presentation.

4 . A method according to claim 3 further comprising forming the synthesized presentation by combining two or more extracted media presentations.

5 . A method according to claim 1 further comprising using the selected media presentation as a higher quality media presentation of the seed media.

6 . A method according to claim 1 , wherein the set of media presentations comprises media presentations captured at a same event than the seed media.

7 . A method according to claim 6 , wherein extracting one or more media presentations comprises:
comparing a pose estimate of a capturing device used for capturing the one or more media presentations with a pose of the seed media; and selecting the media presentation, the pose estimate of the capturing device used for capturing the media presentation having a closest match with the pose of the seed media.

8 . An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following:
obtain a media presentation as a seed media; obtain one or more criteria for content extraction; examine information relating to media presentations among a set of media presentations to find out relevance information regarding at least one of the context or content of the media presentations by using the seed media and the one or more criteria; and on the basis of the examination, extract one or more media presentations among the set of media presentations corresponding with the one or more criteria.

9 . An apparatus according to claim 8 , said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to use one or more of the following criteria:
one or more visual objects of interests in the seed media; one or more non-visual objects of interests in a scene of the seed media; object of interest relevance with a social network; object of interest relevance with previous object of interest preferences; position in a three dimensional space of a device captured the seed media; or object of interest appearance frequency.

10 . An apparatus according to claim 8 , said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:
using the extracted media presentation to form a synthesized presentation.

11 . An apparatus according to claim 10 , said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:
forming the synthesized presentation by combining two or more extracted media presentations.

12 . An apparatus according to claim 8 , said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform at least the following:
using the selected media presentation as a higher quality media presentation of the seed media.

13 . An apparatus according to claim 8 , said at least one memory stored with code thereon, which when executed by said at least one processor, causes the apparatus to perform said extracting one or more media presentations by:
comparing a pose estimate of a capturing device used for capturing the one or more media presentations with a pose of the seed media; and selecting the media presentation, the pose estimate of the capturing device used for capturing the media presentation having a closest match with the pose of the seed media.

14 . A computer program product including one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to perform at least the following:
obtain a media presentation as a seed media; obtain one or more criteria for content extraction; examine information relating to media presentations among a set of media presentations to find out relevance information regarding at least one of the context or content of the media presentations by using the seed media and the one or more criteria; and on the basis of the examination, extract one or more media presentations among the set of media presentations corresponding with the one or more criteria.

15 . A computer program product according to claim 14 including one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to use one or more of the following criteria:
one or more visual objects of interests in the seed media;
one or more non-visual objects of interests in a scene of the seed media;
object of interest relevance with a social network;
object of interest relevance with previous object of interest preferences;
position in a three dimensional space of a device captured the seed media; or
object of interest appearance frequency.

16 . A computer program product according to claim 14 including one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to perform at least the following:
using the extracted media presentation to form a synthesized presentation.

17 . A computer program product according to claim 16 including one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to perform at least the following:
forming the synthesized presentation by combining two or more extracted media presentations.

18 . A computer program product according to claim 14 including one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to perform at least the following:
using the selected media presentation as a higher quality media presentation of the seed media.

19 . A computer program product according to claim 14 including one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to perform said extracting one or more media presentations by:
comparing a pose estimate of a capturing device used for capturing the one or more media presentations with a pose of the seed media; and
selecting the media presentation, the pose estimate of the capturing device used fo

Assignees

• Nokia Technologies Oy

Inventors

• Mate Sujeet Shyamsundar
• Alenius Sakari

Classifications

• H04N21/2187 Primary

  Live feed · CPC title

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• H04N23/661

  Transmitting camera control signals through networks, e.g. control via the Internet · CPC title

• G06T7/0042

  Physics · mapped topic