Augmented reality display for content consumption based on field of view

Patent metadata

Field	Value
Publication number	US-11979630-B2
Application number	US-202117539620-A
Country	US
Kind code	B2
Filing date	Dec 1, 2021
Priority date	Dec 1, 2021
Publication date	May 7, 2024
Grant date	May 7, 2024

Abstract

Systems and methods are presented herein for generating an augmented reality (“AR”) display with user interface (“UI”) elements that respond to changes in pupil characteristics in response to detecting device streaming content. A media stream playing on a device that is within a threshold distance of the AR device is detected. The source of the media stream is identified. The AR device queries the source of the media stream for a consumption option. An AR overlay is generated and comprises selectable UI elements corresponding to the consumption options. In response to receiving an input at a UI element, the AR overlay is generated based on the consumption option.

First claim

What is claimed is:

1. A method, comprising:
detecting a first media stream playing on a first device that is within a threshold distance of an augmented reality (“AR”) device;
detecting a second media stream playing on a second device that is within the threshold distance of the AR device;
accessing a first piece of subject matter data related to the first media stream and a second piece of subject matter data related to the second media stream;
accessing a profile associated with a user, wherein the profile comprises viewing history data related to the user;
calculating a first score for the first media stream being played on the first device, wherein the first score is calculated based on the viewing history data and the first piece of subject matter data;
calculating a second score for the second media stream being played on the second device, wherein the second score is calculated based on the viewing history data and the second piece of subject matter data;
selecting the first media stream based on the first score and the second score;
identifying, using the AR device, a content server associated with the first media stream being played on the first device;
querying, using the AR device, the content server associated with the first media stream for a consumption option for the first media stream in response to identifying the content server associated with the first media stream being played on the first device;
receiving the consumption option from the content server associated with the first media stream;
receiving a parameter from the content server associated with the first media stream;
generating, using the AR device, a first AR overlay that comprises at least one user interface (“UI”) element that corresponds to the consumption option for the first media stream, wherein at least a portion of the AR overlay is associated with the parameter from the content server associated with the first media stream;
receiving an input corresponding to an interaction with the at least one UI element; and
in response to receiving the input, performing one or more of:
modifying the playing of the first media stream playing on the first device based on the consumption option; and
generating, using the AR device, a second AR overlay related to the consumption option.

2. The method of claim 1 , wherein the first media stream playing on the first device is within a field of view of the AR device.

3. The method of claim 1 , wherein detecting the first media stream playing on the first device that is within the threshold distance of the AR device comprises:
determining a first location of the AR device;
determining a second location of the first device playing the first media stream;
determining a distance between the first location and the second location; and
comparing the distance to the threshold distance.

4. The method of claim 1 , wherein detecting the first media stream playing on the first device that is within the threshold distance of the AR device comprises:
activating a local communication network at the AR device;
determining a distance corresponding to at least one device responsive to the local communication network based on a response corresponding to the at least one device; and
comparing the distance to the threshold distance.

5. The method of claim 1 , wherein identifying, using the AR device, the content server associated with the first media stream comprises identifying the content server based on metadata associated with the first media stream.

6. The method of claim 1 , wherein the at least one UI element comprises at least one identifier, wherein the at least one identifier is associated with at least one content item available via the first media stream.

7. The method of claim 6 , wherein the at least one identifier comprises at least one of an image corresponding to content available via the first media stream, a portion of at least one video available via the first media stream, and at least one identifier of the content server associated with the first media stream.

8. The method of claim 1 , wherein the consumption option comprises at least one of controlling the first media stream on the first device, modifying display options corresponding to the first media stream on the first device, controlling the first media stream on the AR device, and modifying display options corresponding to the first media stream on the AR device.

9. The method of claim 1 , wherein receiving the input corresponding to the interaction with the at least one UI element comprises:
determining at least one pupil is within a threshold distance of the AR device;
determining a first iteration of a pupil characteristic, wherein the first iteration corresponds to a first time stamp;
determining a second iteration of the pupil characteristic, wherein the second iteration corresponds to a second time stamp later than the first time stamp;
comparing the first iteration to the second iteration;
in response to determining the first iteration is different from the second iteration, comparing a magnitude of difference to an input deviation threshold; and
in response to determining the magnitude meets or exceeds the input threshold, generating an executable instruction based on the at least one UI element corresponding to the pupil characteristic.

10. The method of claim 9 , wherein the pupil characteristic comprises at least one of a pupil size, a blink rate, and a light reflection magnitude.

11. The method of claim 1 , wherein modifying the playing of the first media stream playing on the first device based on the consumption option comprises executing a modification instruction based on the consumption option.

12. The method of claim 11 , wherein the modification instruction comprises at least one of a playback command, a caption setting modification, and an interface display modification.

13. The method of claim 1 , further comprising:
generating for display an interface, wherein the interface comprises the at least one UI element, wherein each of the at least one UI elements corresponds to at least one of a display setting or content available for consumption;
determining that a pupil corresponding to a user is within a threshold distance of the interface;
detecting at least one pupil characteristic of the pupil;
determining, based on the pupil characteristic, at least one modification for the interface; and
modifying the interface based on the at least one modification.

14. A system comprising:
input/output circuitry configured to:
receive an input corresponding to an interaction with at least one user interface (“UI”) element;

control circuitry configured to:
detect a first media stream playing on a first device that is within a threshold distance of an augmented reality (“AR”) device;
detect a second media stream playing on a second device that is within the threshold distance of the AR device;
access a first piece of subject matter data related to the first media stream and a second piece of subject matter data related to the second media stream;
access a profile associated with a user, wherein the profile comprises viewing history data related to the user;
calculate a first score for the first media stream being played on the first device, wherein the first score is calculated based on the viewing history data and the first piece of subject matter data;
calculate a second score for the second media stream being played on the second device, wherein the second score is calculated based on the viewing history data and the second piece of subject matter data;
select the first media stream bas

Assignees

• Rovi Guides Inc

Inventors

• Sharma Saloni
• Alapati Greeshma Jagadha Phani Lakshmi
• Sreekanth Harshith Kumar Gejjegondanahally
• Bhadula Ishan
• Gill Simranjeet
• Kumar Sourabh
• Channapragada Srikanth
• Sehgal Vivek
• Harb Reda

Classifications

• H04N21/4222 Primary

  Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy (remote control device for a television receiver integrated into a mobile phone H04M1/72415) · CPC title

• G06F3/013

  Eye tracking input arrangements (G06F3/015 takes precedence) · CPC title

• G06F3/0481

  based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance · CPC title

• G06F3/04847

  Interaction techniques to control parameter settings, e.g. interaction with sliders or dials · CPC title

• G06F3/14

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title