Augmented reality content recommendation

Patent metadata

Field	Value
Publication number	US-9998790-B1
Application number	US-201715474726-A
Country	US
Kind code	B1
Filing date	Mar 30, 2017
Priority date	Mar 30, 2017
Publication date	Jun 12, 2018
Grant date	Jun 12, 2018

Abstract

Methods and systems are described herein for providing streamlined access to media assets of interest to a user. The method includes determining that a supplemental viewing device, through which a user views a field of view, is directed at a first field of view. The method further involves detecting that the supplemental viewing device is now directed at a second field of view, and determining that a media consumption device is within the second field of view. A first media asset of interest to the user that is available for consumption via the media consumption device is identified, and the supplemental viewing device generates a visual indication in the second field of view. The visual indication indicates that the first media asset is available for consumption via the media consumption device, and the visual indication tracks a location of the media consumption device in the second field of view.

First claim

What is claimed is:

1. A method for providing a media asset recommendation using a supplemental viewing device, the method comprising:
receiving with a supplemental viewing device, through which a user wearing the supplemental viewing device views a field of view, a first image of a first field of view;
detecting a first plurality of objects within the first image of the first field of view;
determining that the detected first plurality of objects does not include any media consumption device;
receiving, with the supplemental viewing device, a second image;
comparing the first image with the second image;
detecting, based on the comparing, that the supplemental viewing device is now directed at a second field of view that is different from the first field of view;
detecting a second plurality of objects within the second field of view;
determining, based on the detected second plurality of objects within the second field of view, that a media consumption device that was not within the first field of view is within the second field of view; and
in response to determining that the media consumption device that was not within the first field of view is within the second field of view:
transmitting a request for information about media available for consumption via the media consumption device, the request including data identifying the media consumption device;
determining, based on information received in response to the request, a first media asset of interest to the user that is available for consumption via the media consumption device; and
generating, by the supplemental viewing device, a visual indication in the second field of view, wherein the visual indication indicates that the first media asset is available for consumption via the media consumption device, and wherein the visual indication tracks a location of the media consumption device in the second field of view.

2. The method of claim 1 , wherein detecting a second plurality of objects within the second field of view comprises:
analyzing the second image, using an image recognition algorithm, to identify a plurality of sub-images, wherein each sub-image of the plurality of sub-images corresponds to an object within the first image;
transmitting the plurality of sub-images to a database;
receiving, from the database, a plurality of object identifiers identifying the second plurality of objects, each of the plurality of object identifiers corresponding to a respective sub-image of the plurality of sub-images; and
storing the received plurality of object identifiers.

3. The method of claim 2 , wherein determining that a media consumption device that was not within the first field of view is within the second field of view comprises:
retrieving the plurality of object identifiers;
transmitting a request for object metadata describing each of the second plurality of objects, the request including the plurality of object identifiers;
receiving object metadata describing each of the second plurality of objects;
identifying, based on the received object metadata, a type corresponding to each object of the second plurality of objects;
comparing, for each of the plurality of objects, the type corresponding to each object with a plurality of types each corresponding to a known media consumption device; and
based on comparing, for each of the plurality of objects, the type corresponding to each object with the plurality of types, determining that the second plurality of objects includes the media consumption device.

4. The method of claim 1 wherein determining a first media asset of interest to the user that is available for consumption via the media consumption device comprises:
receiving, in response to the request, metadata describing a plurality of media assets available for consumption via the media consumption device;
retrieving a user profile associated with the supplemental viewing device, the user profile including a set of user preferences;
comparing the set of user preferences with the metadata describing the plurality of media assets available via the media consumption device; and
identifying, based on comparing the set of user preferences with the metadata describing the plurality of media assets available via the media consumption device, the first media asset of interest to the user, wherein the metadata describing the first media asset of interest to the user matches at least one user preference of the set of user preferences.

5. The method of claim 1 further comprising:
determining that a second media consumption device that was not within the first field of view is within the second field of view;
determining a second media asset of interest to the user that is available for consumption via the second media consumption device, wherein the second media asset is of less interest to the user than the first media asset; and
generating, by the supplemental viewing device, a second visual indication in the second field of view, wherein the second visual indication indicates that the second media asset is available for consumption via the second media consumption device, and wherein the visual indication that indicates that the first media asset is available for consumption is more visually prominent than the second visual indication.

6. The method of claim 5 further comprising:
determining a first media type corresponding to the first media asset of interest to the user;
determining a second media type corresponding to the second media of asset of interest to the user, wherein the second media type is different from the first media type;
selecting a first visual property for the visual indication based on the first media asset type; and
selecting a second visual property for the second visual indication based on the second media asset type, wherein the second visual property is different from the first visual property; and
generating the visual indication and the second visual indication according to the selected first visual property and the selected second visual property.

7. The method of claim 1 further comprising:
detecting that the supplemental viewing device is now directed at a third field of view;
obtaining a third image of the third field of view;
analyzing the contents of the obtained third image to determine that the media consumption device is within the third field of view; and
updating the location of the visual indication such that the visual indication appears to the user to track the location of the media consumption device in the third field of view.

8. The method of claim 1 further comprising:
determining that the location of the media consumption device in the second field of view is at a perimeter of the second field of view;
detecting that the supplemental viewing device is now directed at a third field of view;
determining that the location of the media consumption device is not at the perimeter of the third field of view; and
modifying the visual indication to identify the first media asset of interest to the user.

9. The method of claim 1 further comprising:
storing data defining a first predefined surface in a physical space accessible to the user;
detecting that the supplemental viewing device is now directed at a third field of view;
obtaining a third image of the third field of view;
determining, based on the contents of the third image, that the third field of view includes the first predefined surface; and
in response to determining that the third field of view includes the first predefined surface, generating, by the supplemental viewing device, a display of information such that the information appears to the user to be displayed on the first predefined surface.

Assignees

• Rovi Guides Inc

Inventors

• Logan Jonathan A
• Liston Alexander W
• Thomas William L
• Dalbec Gabriel C
• Schmidt Margret B
• Burns Mathew C
• Gupta Ajay Kumar

Classifications

• H04N21/23418

  involving operations for analysing video streams, e.g. detecting features or characteristics (television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59) · CPC title

• H04N21/47214

  for content reservation or setting reminders; for requesting event notification, e.g. of sport results or stock market (stock exchange data over packet-switching network H04L12/1804; push services over packet-switching network H04L12/1859; notification of incoming messages in packet switching networks H04L51/224) · CPC title

• H04N21/4668 Primary

  for recommending content, e.g. movies · CPC title

• H04N21/4524

  involving the geographical location of the client (retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00) · CPC title

• H04N21/4756

  for rating content, e.g. scoring a recommended movie · CPC title