Enhanced interactive features for a video presentation system

Patent metadata

Field	Value
Publication number	US-12406405-B2
Application number	US-202117643893-A
Country	US
Kind code	B2
Filing date	Dec 13, 2021
Priority date	Dec 13, 2021
Publication date	Sep 2, 2025
Grant date	Sep 2, 2025

Abstract

A system, related operating methods, and computer readable storage media are disclosed here. The disclosed subject matter relates to methods of providing augmented reality features in connection with presentation of video content. A disclosed method involves: causing presentation of a video program at a user device associated with a viewing user; obtaining metadata associated with the video program; processing a live video feed that includes the viewing user; generating augmented reality overlay content for the live video feed, wherein visual appearance of at least some of the augmented reality overlay content is influenced by the obtained metadata; and causing presentation of an enhanced version of the live video feed at the user device associated with the viewing user, the enhanced version of the live video feed comprising the augmented reality overlay content.

First claim

What is claimed is:

1. A method comprising:
receiving a first video feed comprising a visual appearance of a first viewer captured by a user-facing camera of a first user device;
streaming a live program for presentation on the first user device and on a second user device,
wherein the live program is displayed with the first video feed of the first viewer viewing the live program on the first user device, and
wherein the live program and the first video feed are displayed with a second video feed of a second viewer viewing the live program on the second user device;
receiving program metadata describing events occurring in the live program;
generating an augmented reality overlay relevant to the live program in response to the program metadata describing the events occurring in the live program, the first video feed of the first viewer viewing the live program, and the second video feed of the second viewer viewing the live program; and
displaying the generated augmented reality overlay over the first video feed on the first user device and on the second user device, wherein the augmented reality overlay modifies the visual appearance of the first viewer in the first video feed,
wherein the augmented reality overlay moves at least partially from the visual appearance of the first viewer in the first video feed to a visual appearance of the second viewer in the second video feed in response to a first action by the first viewer in the first video feed,
wherein the augmented reality overlay reacts to a second action by the visual appearance of the second viewer in the second video feed.

2. The method of claim 1 , wherein the program metadata comprises at least one of:
data that identifies subject matter of the live program;
data that identifies a title of the live program;
data that identifies timing of the live program;
data that identifies people, characters, sports teams, organizations, companies, objects, or entities that appear in the live program;
data that identifies weather conditions;
data that identifies environmental conditions;
data that identifies scoring updates for a sporting event that appears in the live program;
data that identifies plays, events, or activity for a sporting event that appears in the live program; and
data that identifies a location associated with subject matter of the live program.

3. The method of claim 1 , further comprising obtaining user-specific data associated with the first viewer, wherein the first video feed of the first viewer is adapted based on the obtained user-specific data.

4. The method of claim 3 , wherein the user-specific data comprises at least one of:
user profile data;
data that identifies a location of the first viewer;
account data for the first viewer;
subscription data for the first viewer;
historical viewing data for the first viewer;
an augmented reality theme selected by the first viewer;
at least one emoji selected by the first viewer;
user-selected preferences of the first viewer;
at least one augmented reality item selected by the first viewer;
a user avatar for the first viewer; and
a user profile picture for the first viewer.

5. The method of claim 1 , further comprising causing presentation of a graphical user interface (GUI) element at the first user device, the GUI element enabling selection of at least one augmented reality item for inclusion in the augmented reality overlay.

6. The method of claim 5 , further comprising:
detecting an event of interest in the live program; and
updating selectable elements in the GUI element to enable selection of at least one event-influenced augmented reality item for inclusion in the augmented reality overlay, wherein the selectable elements are contextually related to the event of interest.

7. The method of claim 1 , wherein a user-interactable augmented reality feature of the augmented reality overlay comprises a graphical representation of a moving sports object that appears in the live program, wherein the second viewer interacts with the moving sports object in the second video feed.

8. The method of claim 1 , wherein the augmented reality overlay comprises a ball, and wherein the first action by the first viewer in the first video feed comprises a throwing motion to throw the ball from the first video feed.

9. A system comprising:
at least one processor; and
at least one processor-readable medium associated with the at least one processor, the at least one processor-readable medium storing processor-executable instructions configurable to be executed by the at least one processor to perform an automated process of providing augmented reality features in connection with a live presentation of a video program on a media playback application, the automated process comprising:
obtaining imagery of a first viewer in real time while the first viewer is viewing the live presentation of the video program on a first user device running the media playback application, the imagery of the first viewer comprising a visual appearance of the first viewer;
obtaining real time metadata that describes events occurring within the video program;
processing the real time metadata to generate an augmented reality overlay relevant to the live presentation and for application to the imagery of the first viewer,
wherein the augmented reality overlay modifies a visual appearance of the first viewer; and
providing the augmented reality overlay and the visual appearance of the first viewer for presentation with the live presentation of the video program by a second user device running the media playback application,
wherein a visual appearance of a second viewer viewing the live presentation on the second user device is presented on the second user device adjacent the visual appearance of the first viewer,
wherein the augmented reality overlay moves at least partially from the visual appearance of the first viewer to the visual appearance of the second viewer in response to a first action by the visual appearance of the first viewer,
wherein the augmented reality overlay reacts to a second action by the visual appearance of the second viewer.

10. The system of claim 9 , wherein the first user device comprises a user-facing camera; and
wherein obtaining the imagery of the first viewer further comprises receiving a live video feed from the user-facing camera.

11. The system of claim 9 , wherein the real time metadata comprises at least one of:
data that identifies subject matter of the video program;
data that identifies a title of the video program;
data that identifies timing of the video program;
data that identifies people, characters, sports teams, organizations, companies, objects, or entities that appear in the video program;
data that identifies weather conditions;
data that identifies environmental conditions;
data that identifies scoring updates for a sporting event that appears in the video program;
data that identifies plays, events, or activity for a sporting event that appears in the video program; and
data that identifies a location associated with subject matter of the video program.

12. The system of claim 9 , wherein the automated process further comprises:
obtaining user-specific data associated with the first viewer,
wherein the visual appearance of the first viewer is adapted by the obtained user-specific data.

13. The system of claim 12 , wherein the user-specific data comprises at least one of:
user profile data;
data that identifies a location of the first viewer;
account data for the first viewer;
subscription data for the first viewer;
historical viewing data

Assignees

• Sling Media Pvt Ltd
• Dish Network Technologies India Pvt Ltd

Inventors

• Eluvan Rakesh
• Kumar Amit
• Ranganathan Gopikumar

Classifications

• G06F3/04842

  Selection of displayed objects or displayed text elements (G06F3/0482 takes precedence) · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06V20/46

  Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames · CPC title

• G06V2201/10

  Recognition assisted with metadata · CPC title

• G06V20/42

  of sport video content · CPC title