Event analysis and tagging system

Patent metadata

Field	Value
Publication number	US-9619891-B2
Application number	US-201615184859-A
Country	US
Kind code	B2
Filing date	Jun 16, 2016
Priority date	Aug 26, 2010
Publication date	Apr 11, 2017
Grant date	Apr 11, 2017

Abstract

A system that analyzes data from sensors and video cameras to generated synchronized event videos and to automatically select or generate tags for an event. Enables creating, transferring, obtaining, and storing concise event videos generally without non-event video. Events stored in the database identifies trends, correlations, models, and patterns in event data. Tags may represent for example activity types, players, performance levels, or scoring results. The system may analyze social media postings to confirm or augment event tags. Users may filter and analyze saved events based on the assigned tags. The system may create highlight and fail reels filtered by metrics and by tags.

First claim

What is claimed is:

1. An event analysis and tagging system comprising:
at least one motion capture element configured to couple with a user or piece of equipment or mobile device coupled with the user, wherein said at least one motion capture element comprises
a sensor data memory;
a sensor configured to capture one or more values associated with an orientation, position, velocity, acceleration, angular velocity, and angular acceleration of said at least one motion capture element;
a first communication interface;
a microprocessor coupled with said sensor data memory, said sensor and said first communication interface, wherein said microprocessor is configured to collect data that comprises sensor values from said sensor;
store said data in said sensor data memory;
optionally analyze said data and recognize an event within said data to determine event data;
transmit said data or said event data associated with said event or both said data and said event data via said first communication interface;

a second memory comprising a database or computer memory or both;
wherein said microprocessor is configured to transmit said data or said event data to a computer comprising
a second communication interface configured to communicate with said first communication interface to obtain said data or said event data associated with said event or both said data and said event data;
wherein said computer is coupled with said second memory and is coupled with said second communication interface, wherein said computer is configured to receive
said data from said second communication interface and analyze said data and recognize said event within said data to determine said event data,
or

said event data from said second communication interface,
or

both said data and said event data from said second communication interface;
analyze said event data to form motion analysis data;
store said event data, or said motion analysis data, or both said event data and said motion analysis data in said second memory;
obtain an event start time and an event stop time from said event data;
obtain at least one video start time and at least one video stop time associated with at least one video;
synchronize said event data, said motion analysis data or any combination thereof with said at least one video based on
a first time associated with said data or said event data obtained from said at least one motion capture element coupled with said user or said piece of equipment or said mobile device coupled with the user and
at least one time associated with said at least one video to
obtain at least one synchronized event video without at least a portion of said at least one video that occurs outside of a timespan between said event start time to said event stop time;
store said at least one synchronized event video in said second memory without a store of said at least said portion of said at least one video that occurs outside of said timespan between said event start time to said event stop time;
analyze one or more of said event data, said motion analysis data, and said at least one video to determine one or more tags for said event; and,
store said one or more tags in said second memory.

2. The event analysis and tagging system of claim 1 , wherein said computer is further configured to
analyze one or more of text, audio, image, and video from a server to determine said one or more tags for said event.

3. The event analysis and tagging system of claim 2 , wherein said server comprises one or more of an email server, a social media site, a photo sharing site, a video sharing site, a blog, a wiki, a second database, a newsgroup, an RSS server, a multimedia repository, a document repository, and a text message server.

4. The event analysis and tagging system of claim 2 , wherein said computer is further configured to
generate an integrated event record comprising
said at least one synchronized event video, and
one or more media selected from said one or more of text, audio, image, and video from a server.

5. The event analysis and tagging system of claim 4 , wherein said computer is further configured to
publish said integrated event record to a social media site.

6. The event analysis and tagging system of claim 2 , wherein said analyze one or more of text, audio, image, and video comprises search said text for key words or key phrases related to said event.

7. The event analysis and tagging system of claim 1 , wherein said one or more tags represent one or more of
an activity type of said event;
a location of said event;
a timestamp of said event;
a stage of an activity associated with said event;
a player identity associated with said event;
a performance level associated with said event; and,
a scoring result associated with said event.

8. The event analysis and tagging system of claim 1 , wherein said computer is further configured to
publish said at least one synchronized event video and one or more of said one or more tags to a social media site.

9. The event analysis and tagging system of claim 1 , further comprising
a manual tagging interface configured to
accept one or more user selected tags for said event;
store said one or more user selected tags in said second memory with said event.

10. The event analysis and tagging system of claim 1 , further comprising
an event filter coupled to said second memory, wherein said event filter is configured to accept one or more filter tags;
return said at least one synchronized event video for events in said second memory having tags that match said one or more filter tags.

11. The event analysis and tagging system of claim 10 , wherein
said event filter is further configured to create a highlight reel comprising video for said events in said second memory having tags that match said one or more filter tags.

12. The event analysis and tagging system of claim 1 wherein said computer comprises at least one processor in said mobile device, a mobile phone, a smart phone, a smart watch, a camera, a laptop computer, a notebook computer, a tablet computer, a desktop computer, a server computer or any combination of any number of said mobile device, said mobile phone, said smart phone, said smart watch, said camera, said laptop computer, said notebook computer, said tablet computer, said desktop computer and said server computer and wherein said computer is further configured to transmit said at least one synchronized event video or a portion of said at least one synchronized event video to one or more of a repository, a viewer, a server, another computer, a social media site, said mobile device, a network, and an emergency service without a transmit of said at least said portion of said at least one video that occurs outside of said timespan between said event start time to said event stop time.

13. The event analysis and tagging system of claim 1 wherein said computer is further configured to display both of
said event data, said motion analysis data or any combination thereof that occurs during said timespan from said event start time to said event stop time;
and,

said at least one synchronized event video.

14. The event analysis and tagging system of claim 1 wherein
said computer is further configured to
discard or
instruct another computer to discard or
instruct a camera to discard

said at least said portion of said at least one video that occurs outside of said timespan between said event start time to said event stop time.

15. The event analysis and tagging system of claim 1 wherein said comput

Assignees

• Blast Motion Inc

Inventors

• Bose Bhaskar
• Gupta Piyush
• Haas Juergen
• Estrem Brian
• Bentley Michael
• Kaps Ryan

Classifications

• G08B21/043 Primary

  detecting an emergency event, e.g. a fall · CPC title

• G06V20/42

  of sport video content · CPC title

• A63F2300/105

  using inertial sensors, e.g. accelerometers, gyroscopes · CPC title

• G11B27/031

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title

• G06T7/20 Primary

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title