Augmented display from conversational monitoring

Patent metadata

Field	Value
Publication number	US-12143673-B2
Application number	US-202318225983-A
Country	US
Kind code	B2
Filing date	Jul 25, 2023
Priority date	Jun 26, 2018
Publication date	Nov 12, 2024
Grant date	Nov 12, 2024

Abstract

Systems and methods are provided for generating for display an indication of a segment of media content relevant to a voice communication. This may be accomplished by a media guidance application that monitors a voice communication between users. The media up guidance application determines that a first user is describing media content. In response to determining that the first user is describing the media content, the media guidance application retrieves media asset viewing history of the first user. The media guidance application determines, based on metadata of each media asset in the media asset viewing history of the first user and the voice communication, a media asset that the first user is describing. The media guidance application determines, based on metadata of the media asset, a segment of the media asset that the first user is describing. The media guidance application generates, for display, an indication of the segment.

First claim

What is claimed is:

1. A method for generating for display an indication of a segment of media content relevant to a voice communication, the method comprising:
selecting a first word of a plurality of words spoken by a first user during the voice communication between a first user and a second user;
comparing the first word of the plurality of words with a plurality of keywords, wherein each of the plurality of keywords indicate that media content is being described;
determining, based on the comparing, that the first word matches a keyword of the plurality of keywords;
in response to determining that the first word matches the keyword, updating a word matching score of the first word with a weight associated with the keyword; and
in response to determining that the word matching score is greater than a threshold value:
retrieving, from a metadata repository, metadata corresponding to each of a plurality of media asset identifiers of media assets previously viewed by the first user;
determining, based on comparing the metadata corresponding to each of the plurality of media asset identifiers with the first word, a media asset that the first user is describing;
retrieving metadata for each of a plurality of segments of the media asset;
determining, based on the metadata for each of the plurality of segments and the first word, a segment of the media asset; and
generating, for display to the second user, the indication of the segment.

2. The method of claim 1 , further comprising:
transmitting a list of candidate segments from a media asset with a largest amount of metadata matching the words extracted from the conversation between the first user and second user.

3. The method of claim 1 , further comprising:
transmitting, to the first user, a request to confirm that the segment was correctly identified, wherein the request comprises the indication of the segment; and
receiving, in response to the request to confirm, a response from the first user.

4. The method of claim 3 , further comprising:
determining whether the response from the first user indicates that the segment was correctly identified; and
transmitting, in response to determining that the segment was not correctly identified, to the first user a request to identify the correct media asset.

5. The method of claim 1 , wherein determining, based on comparing the metadata corresponding to each of the plurality of media asset identifiers with the first word, a media asset that the first user is describing comprises:
calculating, for each of the plurality of media assets, an amount of words of the plurality of words that match a corresponding media asset; and
determining the media asset that the first user is describing based on the calculated amount of words for each corresponding media asset.

6. The method of claim 1 , wherein selecting a first word of a plurality of words spoken by a first user during the voice communication between a first user and a second user comprises:
monitoring the voice communication between the first user at a first communication device and the second user at a second communication device; and
extracting from the voice communication the plurality of words spoken by the first user.

7. The method of claim 1 , wherein a media guidance application retrieves the keywords from a remote server and updates a local data store with updated keywords.

8. The method of claim 1 , wherein determining a segment of the media asset comprises:
receiving a corresponding data structure with the corresponding metadata associated with each of the plurality of segments.

9. The method of claim 1 , wherein generating for display, to the second user, the indication of the segment comprises:
identifying an electronic device associated with the second user; and
generating for display the indication of the segment on the electronic device.

10. The method of claim 1 , wherein retrieving metadata corresponding to each of a plurality of media asset identifiers of media assets previously viewed by the first user comprises:
transmitting, to a profile server, a request for a media asset viewing history of the first user, wherein the request comprises an identifier of the first user; and
receiving, in response to the request for the media asset viewing history, the plurality of media asset identifiers, wherein each of the plurality of media asset identifiers identifies a media asset the first user has previously consumed.

11. A system for generating for display an indication of a segment of media content relevant to a voice communication, the method comprising:
communication circuitry; and
control circuitry configured to:
select a first word of a plurality of words spoken by a first user during the voice communication between a first user and a second user;
compare the first word of the plurality of words with a plurality of keywords, wherein each of the plurality of keywords indicate that media content is being described;
determine, based on the comparing, that the first word matches a keyword of the plurality of keywords;
in response to determining that the first word matches the keyword, update a word matching score of the first word with a weight associated with the keyword; and
in response to determining that the word matching score is greater than a threshold value:
retrieve, from a metadata repository, metadata corresponding to each of a plurality of media asset identifiers of media assets previously viewed by the first user;
determine, based on comparing the metadata corresponding to each of the plurality of media asset identifiers with the first word, a media asset that the first user is describing;
retrieve metadata for each of a plurality of segments of the media asset;
determine, based on the metadata for each of the plurality of segments and the first word, a segment of the media asset; and
generate, for display to the second user, the indication of the segment.

12. The system of claim 11 , wherein the control circuitry is further configured to:
transmit a list of candidate segments from a media asset with a largest amount of metadata matching the words extracted from the conversation between the first user and second user.

13. The system of claim 11 , wherein the control circuitry is further configured to:
transmit, to the first user, a request to confirm that the segment was correctly identified, wherein the request comprises the indication of the segment; and
receive, in response to the request to confirm, a response from the first user.

14. The system of claim 13 , wherein the control circuitry is further configured to:
determine whether the response from the first user indicates that the segment was correctly identified; and
transmit, in response to determining that the segment was not correctly identified, to the first user a request to identify the correct media asset.

15. The system of claim 11 , wherein the control circuitry is further configured to determine, based on comparing the metadata corresponding to each of the plurality of media asset identifiers with the first word, a media asset that the first user is describing by:
calculating, for each of the plurality of media assets, an amount of words of the plurality of words that match a corresponding media asset; and
determining the media asset that the first user is describing based on the calculated amount of words for each corresponding media asset.

16. The system of claim 11 , wherein the control circuitry is further configured to select a first word of a plurality of words spoken by a first user du

Assignees

• Adeia Guides Inc

Inventors

• Mccarty Michael K
• Roe Glen E

Classifications

• H04N21/8456 Primary

  by decomposing the content in the time domain, e.g. in time segments · CPC title

• H04N21/4828

  for searching programme descriptors (retrieval of video data G06F16/739) · CPC title

• H04N21/4788

  communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} · CPC title

• H04N21/4532

  involving end-user characteristics, e.g. viewer profile, preferences (monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18) · CPC title

• H04N21/44213

  Monitoring of end-user related data (arrangements for monitoring the users' behaviour or opinions in broadcast systems H04H60/33) · CPC title