System and method for automated network search and companion display of result relating to audio-video metadata

Patent metadata

Field	Value
Publication number	US-10587833-B2
Application number	US-56119309-A
Country	US
Kind code	B2
Filing date	Sep 16, 2009
Priority date	Sep 16, 2009
Publication date	Mar 10, 2020
Grant date	Mar 10, 2020

Abstract

Embodiments disclosed herein include systems and methods which allow consumers of audio-visual content (such as movies and television programs) to obtain dynamic additional content about programs and movies being watched, and customize that additional content to their personal preferences and behaviors.

First claim

What is claimed is:

1. An audio-visual entertainment system for use in conjunction with a display, the audio-visual entertainment system comprising:
a processor configured to:
obtain an audio-visual content having a plurality of video frames;
identify, after obtaining, the audio-visual content;
request a dataprint associated with the identified audio-visual content from a dataprint server over a network, wherein the dataprint includes a plurality of video frame numbers each corresponding to a different video frame of the plurality of video frames of the audio-visual content, wherein first video frame numbers of the plurality of video frame numbers of the dataprint are associated with one or more of first cast members and first scene locations in one or more first video frames of the plurality of video frames of the audio-visual content, and second video frame numbers of the plurality of video frame numbers of the dataprint are associated with one or more of second cast members and second scene locations in one or more second video frames of the plurality of video frames of the audio-visual content;
obtain, in response to the request for the dataprint, the dataprint associated with the identified audio-visual content from the dataprint server over the network;
start playing the audio-visual content on the display;
while playing the audio-visual content on the display, access the dataprint to generate first queries based on the first one or more of the cast members and the first scene locations associated with the first video frame numbers while the one or more first video frames of the plurality of video frames of the audio-visual content are being currently played on the display;
send the first queries over the network;
receive first data over the network in response to the first queries, wherein the first data relates to the one or more of the first cast members and the first scene locations associated with the first video frame numbers;
display the first data while playing the one or more first video frames of the plurality of video frames of the audio-visual content on the display;
while playing the audio-visual content on the display, access the dataprint to generate second queries based on the second one or more of the cast members and the second scene locations associated with the second video frame numbers while the one or more second video frames of the plurality of video frames of the audio-visual content are being currently played on the display;
send the second queries over the network;
receive second data over the network in response to the second queries, wherein the second data relates to the one or more of the second cast members and the second scene locations associated with the second video frame numbers; and
display the second data while playing the one or more second video frames of the plurality of video frames of the audio-visual content on the display.

2. The audio-visual entertainment system of claim 1 , wherein the first data and the second data are displayed in a second display area of the display that comprises a picture within a first display area displaying the audio-visual content.

3. The audio-visual entertainment system of claim 1 , wherein the audio-visual content comprises an audio file.

4. The audio-visual entertainment system of claim 1 , wherein the audio-visual content comprises a video file.

5. The audio-visual entertainment system of claim 1 , wherein the first data comprises a video stream, an audio stream, an image stream, and a text stream.

6. The audio-visual entertainment system of claim 1 , wherein the first data and the second data are displayed on a different display.

7. The audio-visual entertainment system of claim 1 , wherein the dataprint comprises audio-visual metadata and script data associated with the audio-visual content.

8. The audio-visual entertainment system of claim 7 , wherein at least some of the audio-visual metadata and script data are associated with specified portions of the audio-visual content.

9. The audio-visual entertainment system of claim 1 , wherein the processor is configured to obtain the dataprint separately from obtaining the audio-visual content.

10. The audio-visual entertainment system of claim 1 , wherein the first queries comprise search engine queries.

11. The audio-visual entertainment system of claim 10 , wherein the first queries further comprise queries of proprietary content related to the first video frame numbers of the audio-visual content.

12. The audio-visual entertainment system of claim 11 , wherein the first queries further comprise queries of public content.

13. The audio-visual entertainment system of claim 1 , wherein the first queries are also based on query usage guidelines associated with a particular user of the audio-visual entertainment system, wherein the query usage guidelines include user selected preferences.

14. The audio-visual entertainment system of claim 13 , wherein the user selected preferences selected by the user comprise topical preferences and data-type preferences.

15. The audio-visual entertainment system of claim 1 , wherein processor is further configured to display the most relevant query result if a plurality of query results are received.

16. The audio-visual entertainment system of claim 1 , wherein the processor is further configured to refresh the first queries after a predetermined period of time.

17. A method for use by an audio-visual entertainment system in conjunction with a display, the method comprising:
obtaining an audio-visual content having a plurality of video frames;
identifying, after the obtaining, the audio-visual content;
requesting a dataprint associated with the identified audio-visual content from a dataprint server over a network, wherein the dataprint includes a plurality of video frame numbers each corresponding to a different video frame of the plurality of video frames of the audio-visual content, wherein first video frame numbers of the plurality of video frame numbers of the dataprint are associated with one or more of first cast members and first scene locations in one or more first video frames of the plurality of video frames of the audio-visual content, and second video frame numbers of the plurality of video frame numbers of the dataprint are associated with one or more of second cast members and second scene locations in one or more second video frames of the plurality of video frames of the audio-visual content;
obtaining, in response to the requesting of the dataprint the dataprint associated with the identified audio-visual content from the dataprint server over the network;
starting to play the audio-visual content on the display;
while playing the audio-visual content on the display, accessing the dataprint to generate first queries based on the first one or more of the cast members and the first scene locations associated with the first video frame numbers while the one or more first video frames of the plurality of video frames of the audio-visual content are being currently played on the display;
sending the first queries over the network;
receiving first data over the network in response to the first queries, wherein the first data relates to the one or more of the first cast members and the first scene locations associated with the first video frame numbers; and
displaying the first data while playing the one or more first video frames of the plurality of video frames of the audio-visual content on the display;
while playing the audio-visual content on the display, accessing the datapri

Assignees

• Mendeloff Todd Allen
• Bartley William Joseph
• Kwan Brian
• Jessen David
• Acosta Evan
• Disney Entpr Inc

Inventors

• Mendeloff Todd Allen
• Bartley William Joseph
• Kwan Brian
• Jessen David
• Acosta Evan

Classifications

• H04N21/4667

  Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections · CPC title

• H04N21/4722

  for requesting additional data associated with the content · CPC title

• H04N21/84

  Generation or processing of descriptive data, e.g. content descriptors {(systems specially adapted for using meta-information in broadcast systems H04H60/73)} · CPC title

• G06F16/738

  Presentation of query results · CPC title

• G06F16/78

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title