Systems and methods for automatically generating supplemental content for a media asset based on a user's personal media collection

Patent metadata

Field	Value
Publication number	US-10853405-B2
Application number	US-201816161976-A
Country	US
Kind code	B2
Filing date	Oct 16, 2018
Priority date	Feb 22, 2018
Publication date	Dec 1, 2020
Grant date	Dec 1, 2020

Abstract

Systems and methods describe presenting media to a user at a user device, determining a location relevant to the media, determining whether the user has visited a vicinity of the location by searching through information related to the user, and based on to determining that the user has visited the vicinity of the location searching through the user's personal collection of media in a time window corresponding to the user's visit to retrieve personal media related to the location, and generating for display, based on the searching, a list of personal media related to the location relevant to the media being presented at the user device.

First claim

What is claimed is:

1. A method to generate a comparative view of a video asset being consumed by a user with generated supplemental content, where the supplemental content is generated using user generated content related to a location referenced in the video asset, the method comprising:
presenting a frame of the video asset to the user at a user device;
determining a location at which contents depicted in an image that is presented in the frame resides;
determining whether the user has visited a vicinity of the location by searching through a profile related to the user; and
in response to determining that the user visited the vicinity of the location:
extracting from the frame a first portion of the frame that includes the image and excludes a second portion of the frame that does not include the image;
searching through user generated media in a period of time when the user is determined to have visited the location to retrieve a set of media that corresponds to the location;
performing an image comparison between a personal image within the set of media and the first portion;
determining, based on the image comparison, whether there is a match between the personal image and the first portion; and
in response to determining a match, generating a comparative view of the first portion with the personal image.

2. The method of claim 1 , wherein generating the comparative view of the first portion with the personal image further comprises:
simultaneously displaying the first portion and the personal image.

3. The method of claim 1 , wherein determining whether there is a match between the personal image and the first portion further comprises:
determining a landmark present in the first portion;
searching for the presence of the landmark in the personal image within the set of media;
in response to determining a presence of the landmark in the personal image:
comparing the landmark in the personal image to the landmark in the first portion.

4. The method of claim 1 , wherein determining whether media in the first set of media corresponds to the location further comprises:
determining, at the time of generation of each user generated media, a current location of the user; and
saving the determined current location as part of a geotag along with each user generated media.

5. The method of claim 2 , wherein the determining whether media in the first set of set of media corresponds to the location further comprises:
extracting the geotag from a media in the first set of media;
determining a respective location of the media from the extracted geotag;
comparing the respective location of the media in the first set of media to the location; and
based on the comparing, determining whether the respective location of the media in the first set of media is within a predetermined distance from the location.

6. The method of claim 1 , wherein determining whether the time stamp of the media generated by the user is within the determined period of time, further comprises:
saving, along with the media generated by the user, the time stamp indicating the time of generation of the media.

7. The method of claim 1 , wherein retrieving a history of physical locations to which the user has visited further comprises:
extracting the user's calendar from the user's profile;
determining from the user's calendar, events that indicate travel of the user from one place to another;
determining from the events, itineraries of the user's trips to various physical locations; and
determining from the itineraries, the period of time, during which the user visited the physical location.

8. The method of claim 1 , wherein determining whether the time stamp of the media generated by the user is within the determined period of time, further comprises:
extracting a time from the time stamp from a media in the user generated media;
comparing the extracted time to the period of time to determine whether the extracted time is within the period of time; and
in response to determining that the extracted time is within the period of time:
classifying the media associated with the extracted time to the first set of media.

9. The method of claim 7 , wherein searching through the media further comprises:
determining from itineraries of the user's trips, a second user that accompanied the user to the location; and
searching through media generated by the second user to retrieve a third set of media that corresponds to the location.

10. The method of claim 9 , wherein generating for consumption the second set of media further comprises:
determining a presence of the user and a presence of a landmark specific to the location in components of the third set of media; and
based on the determining, generating for consumption, the third set of media along with the second set of media.

11. A system to generate a comparative view of a video asset being consumed by a user with generated supplemental content, where the supplemental content is generated using user generated content related to a location referenced in the video asset, the system comprising:
control circuitry configured to:
present a frame of the video asset to the user at a user device;
determine a location at which contents depicted in an image that is presented in the frame resides;
determine whether the user has visited a vicinity of the location by searching through a profile related to the user; and
in response to determining that the user visited the vicinity of the location:
extract from the frame a first portion of the frame that includes the image and excludes a second portion of the frame that does not include the image;
search through user generated media in a period of time when the user is determined to have visited the location to retrieve a set of media that corresponds to the location;
perform an image comparison between a personal image within the set of media and the first portion;
determine, based on the image comparison, whether there is a match between the personal image and the first portion; and
in response to determining a match, generate a comparative view of the first portion with the personal image.

12. The system of claim 11 , wherein generating the comparative view of the first portion with the personal image further comprises:
simultaneously displaying the first portion and the personal image.

13. The system of claim 11 , wherein determining whether there is a match between the personal image and the first portion further comprises:
determine a landmark present in the first portion;
search for the presence of the landmark in the personal image within the set of media;
in response to determining a presence of the landmark in the personal image:
compare the landmark in the personal image to the landmark in the first portion.

14. The system of claim 11 , wherein control circuitry configured to determine whether media in the first set of media corresponds to the location is further configured to:
determine, at the time of generation of each user generated media, a current location of the user; and
save the determined current location as part of a geotag along with each user generated media.

15. The system of claim 11 , wherein the control circuitry configured to determine whether media in the first set of set of media corresponds to the location is further configured to:
extract the geotag from a media in the first set of media;
determine a respective location of the media from the extracted geotag;
compare the respective location of the media in the first set of media to the location; and
b

Assignees

• Rovi Guides Inc

Inventors

• Case Michael
• Carlberg Marvin

Classifications

• G06F16/41

  Indexing; Data structures therefor; Storage structures · CPC title

• G06F16/435

  Filtering based on additional data, e.g. user or group profiles · CPC title

• G06F16/438

  Presentation of query results · CPC title

• G06F16/4393 Primary

  Multimedia presentations, e.g. slide shows, multimedia albums · CPC title

• G06F16/489

  using time information · CPC title