Identifying one or more events in content

Patent metadata

Field	Value
Publication number	US-12002219-B2
Application number	US-202217896682-A
Country	US
Kind code	B2
Filing date	Aug 26, 2022
Priority date	Oct 15, 2014
Publication date	Jun 4, 2024
Grant date	Jun 4, 2024

Abstract

According to some aspects, methods and systems may include receiving, by a computing device, metadata identifying an event occurring in a video program, and determining an expected motion of objects in the identified event. The methods and systems may further include analyzing motion energy in the video program to identify video frames in which the event occurs, and storing information identifying the video frames in which the event occurs.

First claim

The invention claimed is:

1. A method comprising:
receiving, by a computing device, metadata indicative of a time for a beginning of an event occurring in a video program and a time for an ending of the event;
determining, based on the metadata and based on a plurality of video frames associated with the video program:
a first video frame, from the plurality of video frames, comprising a first displayed time before the time for the beginning of the event; and
a second video frame, from the plurality of video frames, comprising a second displayed time after the time for the ending of the event;

selecting a portion of the video program, the portion comprising the first video frame, the second video frame, and video frames between the first video frame and the second video frame;
determining an expected motion energy of objects associated with the event;
determining, based on a comparison of motion energy of objects in the selected portion of the video program with the expected motion energy, one or more video frames, within the selected portion, in which the event occurs; and
storing information indicating the one or more video frames in which the event occurs.

2. The method of claim 1 , wherein determining the first video frame and the second video frame is based on performing optical character recognition on the plurality of video frames associated with the video program.

3. The method of claim 1 , wherein the first video frame comprises a first game clock showing the first displayed time, and wherein the second video frame comprises a second game clock showing the second displayed time.

4. The method of claim 1 , wherein a first game clock showing a third displayed time corresponding to the time for the beginning of the event is not visible in the video program, and wherein a second game clock showing a fourth displayed time corresponding to the time for the ending of the event is not visible in the video program.

5. The method of claim 1 , further comprising:
dividing one or more frames of the portion of the video program into a plurality of sections;
determining motion vectors of objects associated with one or more of the sections; and
wherein the determining the one or more video frames in which the event occurs is performed based on the motion vectors of the objects associated with the one or more of the sections and based on a rule indicative of expected motion vectors of the objects associated with the event.

6. The method of claim 1 , further comprising:
determining a change in display view in the portion of the video program from a first display view to a second display view; and
wherein the determining the one or more video frames in which the event occurs is performed based on the change in display view.

7. The method of claim 1 , further comprising:
receiving an indication of one or more environmental features in the one or more video frames in which the event occurs;
determining, based on the indication of the one or more environmental features, a key frame of the one or more video frames in which the event occurs; and
causing display of the key frame as a user-selectable thumbnail.

8. The method of claim 1 , wherein the determining the first video frame is performed based on one or more first audio features associated with the plurality of video frames; and
wherein the determining the second video frame is performed based on one or more second audio features associated with the plurality of video frames.

9. An apparatus comprising:
one or more processors; and
memory storing instructions that, when executed by the one or more processors, cause the apparatus to:
receive metadata indicative of a time for a beginning of an event occurring in a video program and a time for an ending of the event;
determine, based on the metadata and based on a plurality of video frames associated with the video program:
a first video frame, from the plurality of video frames, comprising a first displayed time before the time for the beginning of the event; and
a second video frame, from the plurality of video frames, comprising a second displayed time after the time for the ending of the event;

select a portion of the video program, the portion comprising the first video frame, the second video frame, and video frames between the first video frame and the second video frame;
determine an expected motion energy of objects associated with the event;
determine, based on a comparison of motion energy of objects in the selected portion of the video program with the expected motion energy, one or more video frames, within the selected portion, in which the event occurs; and
store information indicating the one or more video frames in which the event occurs.

10. The apparatus of claim 9 , wherein the instructions, when executed by the one or more processors, cause the apparatus to:
determine the first video frame and the second video frame based on performing optical character recognition on the plurality of video frames associated with the video program.

11. The apparatus of claim 9 , wherein the first video frame comprises a first game clock showing the first displayed time, and wherein the second video frame comprises a second game clock showing the second displayed time.

12. The apparatus of claim 9 , wherein a first game clock showing a third displayed time corresponding to the time for the beginning of the event is not visible in the video program, and wherein a second game clock showing a fourth displayed time corresponding to the time for the ending of the event is not visible in the video program.

13. The apparatus of claim 9 , wherein the instructions, when executed by the one or more processors, cause the apparatus to:
divide one or more frames of the portion of the video program into a plurality of sections;
determine motion vectors of objects associated with one or more of the sections; and
determine the one or more video frames in which the event occurs based on the motion vectors of the objects associated with the one or more of the sections and based on a rule indicative of expected motion vectors of the objects associated with the event.

14. The apparatus of claim 9 , wherein the instructions, when executed by the one or more processors, cause the apparatus to:
determine a change in display view in the portion of the video program from a first display view to a second display view; and
determine the one or more video frames in which the event occurs based on the change in display view.

15. The apparatus of claim 9 , wherein the instructions, when executed by the one or more processors, cause the apparatus to:
receive an indication of one or more environmental features in the one or more video frames in which the event occurs;
determine, based on the indication of the one or more environmental features, a key frame of the one or more video frames in which the event occurs; and
cause display of the key frame as a user-selectable thumbnail.

16. A non-transitory computer-readable medium storing instructions that, when executed, cause:
receiving, by a computing device, metadata indicative of a time for a beginning of an event occurring in a video program and a time for an ending of the event;
determining, based on the metadata and based on a plurality of video frames associated with the video program:
a first video frame, from the plurality of video frames, comprising a first displayed time before the time for the beginning of the event; and
a second video frame, from the plurality of video frames, comprising a second displayed time after th

Assignees

• Comcast Cable Comm Llc

Inventors

• Schwartz Erik
• Neumann Jan
• Sayyadi Hans
• Deichmann Stefan

Classifications

• G06T7/20 Primary

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• G06F16/48

  Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually · CPC title

• G06F16/745

  the internal structure of a single video sequence · CPC title

• G06F16/7867

  using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings · CPC title

• G06V20/42

  of sport video content · CPC title