Augmented experience of media presentation events

Patent metadata

Field	Value
Publication number	US-2017006356-A1
Application number	US-201514788845-A
Country	US
Kind code	A1
Filing date	Jul 1, 2015
Priority date	Jul 1, 2015
Publication date	Jan 5, 2017
Grant date	—

Abstract

Architecture that provides an augmented user experience with a smooth, enriched, and personalized information flow during a live competitive event such as a sports game or non-live media presentations. A user having a user device with the application components installed can experience an automatic synchronization of content with the entities, activities, and moments occurring in live match being watched. This is achieved through logic applied on a combination of different inputs and entities/activities/moments continuously identified based on at least natural language processing technologies. The user experience associated with media presentation of the event on a first user device is augmented by the automatic identification of a live match, the teams, stadium, players, etc., and generation/presentation of highly related content on a second user device with which the user is currently interacting.

First claim

What is claimed is:

1 . A system, comprising:
an event identification component configured to listen and identify, from at least one of voice or textual signals of a media presentation, a sporting event and entities associated with the sporting event, the media presentation part of an event-watching experience for a user on a first user device; a content generation component configured to generate sets of mixed content related to the sporting event, the entities, and implicitly indicated user preferences, and to synchronize the sets of mixed content with corresponding activities occurring as part of the sporting event, notable moments of the sporting event, and the entities of the sporting event; an augmentation component configured to augment the event-watching experience of the media presentation with the sets of mixed content on a second user device via which the user is currently interacting; and at least one hardware processor configured to execute computer-executable instructions in a memory, the instructions executed to enable the event identification component, the content generation component, and the augmentation component.

2 . The system of claim 1 , wherein the event identification component is configured to perform natural language processing and speech pattern analysis on speech signals of the media presentation of the sporting event and recognition of textual content to identify the entities.

3 . The system of claim 1 , wherein the event identification component is configured to identify participants in the sporting event.

4 . The system of claim 1 , wherein the event identification component is configured to identify a commentator of the sporting event, and from which commentator identification is derived additional information that includes participants, player and game moments, significant plays that occur during the sporting event and that impact outcome of the sporting event, and notable players.

5 . The system of claim 1 , wherein the content generation component is configured to access user display history as relates to the sporting event and choose a next set of mixed content to be served as complementary to the media presentation to the second user device based on user content consumption patterns and history.

6 . The system of claim 1 , further comprising a sentiment component configured to capture user sentiment during discussions of the activities occurring as part of the sporting event.

7 . The system of claim 1 , further comprising discussion component configured to generate virtual rooms and enable access to the virtual rooms for discussions related to the sporting event and the entities.

8 . A method, comprising acts of:
identifying entities, activities, and moments of a media presentation of a competitive event on a first device as part of an event-watching experience, the entities, activities, and moments identified based in part on audio signals received as part of the media presentation; generating sets of content related to the identified entities, activities, and moments of the competitive event; and augmenting the event-watching experience by presenting the sets of content on a second user device via which the user is currently interacting.

9 . The method of claim 8 , further comprising automatically identifying the competitive event free of any input from the user.

10 . The method of claim 8 , further comprising automatically identifying a speaking entity of the competitive event based on at least one of natural language processing and speech pattern analysis on voice signals or textual data recognized as part of presentation of the competitive event.

11 . The method of claim 8 , further comprising identifying a previously-unknown commentator of the competitive event based on analysis of style, structure, speed and flow of words of the previously-unknown commentator.

12 . The method of claim 8 , further comprising synthesizing a set of content personalized to the user and presenting the set of personalized content to the user on the second user device via which the user is currently interacting.

13 . The method of claim 8 , further comprising analyzing user discussions as relate to the competitive event, and identifying sentiment levels about the competitive event, specific moments of the competitive event, teams, and associated team entities.

14 . The method of claim 13 , further comprising updating the sets of content based on the user discussions and sentiment levels.

15 . The method of claim 8 , further comprising creating event-related virtual rooms as part a live feed of the competitive event and for user discussions related to the competitive event.

16 . The method of claim 8 , further comprising continually updating composition of the sets of content for a given user based on corresponding changes in at least one of implicit preferences and behaviors or explicit preferences and behaviors of the user during the competitive event.

17 . A method, comprising acts of:
as part of a media presentation, identifying a sports event, and entities, activities, and moments associated with the sports event as presented on a first device for viewing by a user and independent of any user input; automatically identifying a speaking entity of the sports event based on natural language processing and speech pattern analysis; generating sets of mixed content related to the sports event, the entities, activities, and moments and aligning the sets of mixed content to the activities, the moments, and the entities of the sports event; and augmenting the media presentation of the entities, activities, and moments of the sports event with the sets of mixed content on a second user device via which the user is currently interacting.

18 . The method of claim 17 , further comprising updating the sets of content based on changes in the entities, activities, and moments of the sports event.

19 . The method of claim 17 , further comprising synthesizing a set of content personalized to the user and presenting the set of personalized content to the user on the second user device via which the user is currently interacting.

20 . The method of claim 17 , further comprising continually updating composition of the sets of mixed content for a given user based on corresponding changes in at least one of implicit preferences and behaviors of the user or explicit preferences and behaviors of the user during the sports event.

Assignees

• Microsoft Corp

Inventors

• Krasadakis Georgios

Classifications

• H04N21/4532

  involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18) · CPC title

• G10L17/005

  Physics · mapped topic

• H04N21/25891

  being end-user preferences (retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18) · CPC title

• G10L15/22

  Procedures used during a speech recognition process, e.g. man-machine dialogue · CPC title

• H04N21/4788

  communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} · CPC title