Annotating and indexing broadcast video for searchability

Patent metadata

Field	Value
Publication number	US-9788071-B2
Application number	US-201514676747-A
Country	US
Kind code	B2
Filing date	Apr 1, 2015
Priority date	Nov 3, 2014
Publication date	Oct 10, 2017
Grant date	Oct 10, 2017

Abstract

A method providing searchable streaming video broadcasts via an interactive media server, the interactive media server generates a live broadcast video stream for each of a plurality of interactive media sessions and a video provider server providing a connection to the live broadcast video stream for viewing, the method comprising receiving an interactive media events stream for each interactive media session from the interactive media server, generating statistics data for each interactive media session based upon the events stream, and generating a searchable index of a directory of the live broadcast video streams, the searchable index including a plurality of entries, each entry including (a) a link to the live broadcast video stream for a corresponding interactive media session provided by the video provider server, and (b) metadata associated with the corresponding interactive media session, the metadata generated based upon the statistics data for the corresponding interactive media session.

First claim

The invention claimed is:

1. A method for providing searchable streaming video broadcasts, the method comprising:
at an interactive media server, generating a live broadcast video stream for each of a plurality of interactive media sessions generated in response to a plurality of users interacting with interactive media applications on interactive media devices, wherein a state of the interactive media application and statistics produced by user input are associated with the live broadcast video stream and a video provider server provides a connection to the live broadcast video stream for viewing;
at a statistics server, receiving an interactive media events stream for each interactive media session from the interactive media server, the interactive media events stream generated by the user interacting with the interactive media application that generates interactive events including a state of the interactive media application in the interactive media events stream based on and in response to user input with the interactive media application, the interactive media events stream including at least one interactive media event;
generating data for each interactive media session based upon user interaction with the interactive media application, the data including the state of the interactive media application and statistics data about the interactive events in the interactive media events stream to be used for searching content available for viewing in near real-time and at a future time by a plurality of users; and
at an indexing server, generating a searchable index of a directory of live broadcast video streams or recordings of live broadcast video streams stored in a database, the searchable index searchable by data generated by user interaction with interactive media applications and including a plurality of entries, each entry including (a) a link to the live broadcast video stream or a recorded live broadcast video stream for a corresponding interactive media session provided by the video provider server, and (b) metadata associated with the corresponding interactive media session, the metadata being generated based upon the data for the corresponding interactive media session including the state of the interactive media application and the statistics data and used for subsequent searching by the plurality of users.

2. The method of claim 1 , further comprising, providing a search interface configured to:
receive a search query from a computing device;
look up one or more terms in the search query in the searchable index; and
send to the computing device a displayable list of one or more search results including at least one of the links corresponding to one of the live broadcast video streams provided by the video provider server.

3. The method of claim 2 , where the search query includes filters and search options related to the metadata.

4. The method of claim 2 , further comprising programmatically sending a list of links to live broadcast video streams based on user inputs generated via the interactive media devices from the indexing server to the interactive media devices.

5. The method of claim 1 , where a portion of the statistics data that is generated is determined by applying statistics rules set by a developer.

6. The method of claim 5 , further comprising altering the statistics rules in response to receiving a rule change request from a developer computing device.

7. The method of claim 1 , where the live broadcast video stream includes at least one of microphone input data and video input data from the interactive media device.

8. The method of claim 1 , where the metadata is time stamped corresponding to a temporal location in the live broadcast video stream.

9. The method of claim 1 , further comprising maintaining on a directory server the directory of the live broadcast video streams provided by the video provider server for each interactive media session, the directory including a list of links to live broadcast video streams for each interactive media session on the video provider server.

10. The method of claim 1 , where the step of generating the searchable index is implemented in near real-time.

11. A system for providing searchable video data, the system comprising:
an interactive media server to generate a plurality of interactive media sessions and a live broadcast video stream for each of the interactive media sessions in response to a plurality of users interacting with interactive media applications on interactive media devices, wherein a state of the interactive media application and statistics produced by user input are associated with the live broadcast video stream;
a video provider server to provide connections to the video data for viewing;
one or more computing devices each having at least one processor and associated memory, the processor configured to execute the following software programs:
a statistics engine configured to:
receive an interactive media events stream for each interactive media session from the interactive media server, the interactive media events stream generated by the user interacting with the interactive media application that generates interactive events including a state of the interactive media application in the interactive media events stream based on and in response to user input with the interactive media application, the interactive media events stream including at least one interactive media event;
generate data for each interactive media session based upon user interaction with the interactive media application, the data including the state of the interactive media application and statistics data about the interactive events in the interactive media events stream to be used for searching content available for viewing in near real-time and at a future time by a plurality of users; and
an indexing engine on an indexing server configured to generate a searchable index of a directory of the live broadcast video streams or recordings of live broadcast video streams stored in a database, the searchable index searchable by data generated by user interaction with interactive media applications and including a plurality of entries, each entry including (a) a link to the live broadcast video stream or a recorded live broadcast video stream for a corresponding interactive media session provided by the video provider server, and (b) metadata associated with the corresponding interactive media session, the metadata being generated based upon the data for the corresponding interactive media session including the state of the interactive media application and the statistics data and used for subsequent searching by the plurality of users.

12. The system of claim 11 , where the indexing server is configured to provide a search interface configured to:
receive a search query from a computing device;
look up one or more terms in the search query in the searchable index; and
send to the computing device a displayable list of one or more search results including at least one of the links corresponding to one of the live broadcast video streams provided by the video provider server.

13. The system of claim 11 , where the indexing server is further configured to inhibit indexing of a selected portion of the statistics data when the interactive media session is discontinued.

14. The system of claim 11 , where the metadata is time stamped corresponding to a temporal location in the corresponding live broadcast video stream.

15. The system of claim 11 , further comprising a directory server configured to maintain the directory of the live broadcast video st

Assignees

• Microsoft Technology Licensing Llc

Inventors

• Mason Joanna
• Wheeler Craig J
• Av Daniel
• Siebert Michael Ahmed Sengan
• Smith Gregory M
• Garcia Antonio Vargas

Classifications

• G06F17/3082

  Physics · mapped topic

• H04N21/4828 Primary

  for searching programme descriptors (retrieval of video data G06F16/739) · CPC title

• H04N21/8545

  for generating interactive applications · CPC title

• G06F17/30858

  Physics · mapped topic

• H04N21/8456

  by decomposing the content in the time domain, e.g. in time segments · CPC title