Event analysis system

Patent metadata

Field	Value
Publication number	US-9401178-B2
Application number	US-201514801341-A
Country	US
Kind code	B2
Filing date	Jul 16, 2015
Priority date	Aug 26, 2010
Publication date	Jul 26, 2016
Grant date	Jul 26, 2016

Abstract

Enables event analysis from sensors including environmental, physiological and motion capture sensors. Also enables displaying information based on events recognized using sensor data associated with a user, piece of equipment or based on previous motion analysis data from the user or other user(s) or other sensors. Enables intelligent analysis, synchronization, and transfer of generally concise event videos synchronized with motion data from motion capture sensor(s) coupled with a user or piece of equipment. Enables creating, transferring, obtaining, and storing concise event videos generally without non-event video. Events stored in the database identifies trends, correlations, models, and patterns in event data. Greatly saves storage and increases upload speed by uploading event videos and avoiding upload of non-pertinent portions of large videos. Creates highlight and fail reels filtered by metrics and can sort by metric. Compares motion trajectories of users and objects to optimally efficient trajectories, and to desired trajectories.

First claim

What is claimed is:

1. An event analysis system comprising:
at least one motion capture element configured to couple with a user or piece of equipment or mobile device coupled with the user, wherein said at least one motion capture element comprises
a sensor data memory;
a sensor configured to capture one or more values associated with an orientation, position, velocity, acceleration, angular velocity, and angular acceleration of said at least one motion capture element;
a first communication interface;
a microprocessor coupled with said sensor data memory, said sensor and said first communication interface, wherein said microprocessor is configured to collect data that comprises sensor values from said sensor;
store said data in said sensor data memory;
optionally analyze said data and recognize an event within said data to determine event data;
transmit said data or said event data associated with said event or both said data and said event data via said first communication interface;

a second memory comprising a database or computer memory or both;
said microcontroller configured to transmit said data or said event data to a computer comprising
a second communication interface configured to communicate with said first communication interface to obtain said data or said event data associated with said event or both said data and said event data;
wherein said computer is coupled with said second memory and is coupled with said second communication interface, wherein said computer is configured to
receive
said data from said second communication interface and analyze said data and recognize said event within said data to determine said event data,
or
said event data from said second communication interface,
or

both said data and said event data from said second communication interface;

analyze said event data to form motion analysis data;
store said event data, or said motion analysis data, or both said event data and said motion analysis data in said second memory;
obtain an event start time and an event stop time from said event data;
obtain at least one video start time and at least one video stop time associated with at least one video;
synchronize said event data, said motion analysis data or any combination thereof with said at least one video based on
a first time associated with said data or said event data obtained from said at least one motion capture element coupled with said user or said piece of equipment or said mobile device coupled with the user and
at least one time associated said at least one video to
obtain at least one synchronized event video without at least a portion of said at least one video that occurs outside of a timespan between said event start time to said event stop time; and,

store said at least one synchronized event video in said second memory without a store of said at least said portion of said at least one video that occurs outside of said timespan between said event start time to said event stop time.

2. The system of claim 1 wherein said computer comprises at least one processor in said mobile device, a mobile phone, a smart phone, a smart watch, a camera, a laptop computer, a notebook computer, a tablet computer, a desktop computer, a server computer or any combination of any number of said mobile device, said mobile phone, said smart phone, said smart watch, said camera, said laptop computer, said notebook computer, said tablet computer, said desktop computer and said server computer.

3. The system of claim 1 wherein said computer is further configured to
display said at least one synchronized event video comprising both of
said event data, said motion analysis data or any combination thereof that occurs during said timespan from said event start time to said event stop time;
and,
said at least one video captured during said timespan from said event start time to said event stop time.

4. The system of claim 1 wherein
said computer is further configured to
discard or
instruct another computer to discard or
instruct a camera to discard

said at least said portion of said at least one video that occurs outside of said event start time to said event stop time.

5. The system of claim 1 wherein said computer is further configured to
send a control message
locally to at least one camera coupled with said computer or
externally to said at least one camera

to modify video recording parameters of said at least one video based on said data or said event data or said motion analysis data;
wherein said video recording parameters comprise one or more of frame rate, resolution, color depth, color or grayscale, compression method, compression quality, and recording on or off.

6. The system of claim 4 , wherein
said sensor comprises an accelerometer that measures acceleration in one or more axes;
said recognize said event within said data comprises one or both of
compare a magnitude of said acceleration to an acceleration threshold value;
compare a change in said acceleration over a time interval to said acceleration change threshold value.

7. The system of claim 1 wherein said computer is further configured to transmit said at least one synchronized event video or a portion of said at least one synchronized event video to one or more of a repository, a viewer, a server, another computer, a social media site, said mobile device, a network, and an emergency service without a transmit of said at least said portion of said at least one video that occurs outside of said timespan between said event start time to said event stop time.

8. The system of claim 1 wherein said computer is further configured to
accept a metric associated with said at least one synchronized event video;
accept selection criteria associated with said metric;
determine a matching set of synchronized event videos that have values associated with said metric that pass said selection criteria;
create a list of, or display, said matching set of synchronized event videos or corresponding thumbnails thereof having said value associated with said metric associated with each of said matching set of synchronized event videos or said corresponding thumbnails;
or
generate a highlight reel or fail reel or both, of said matching set of synchronized event videos,
or
both said create said list of, or display said matching set of synchronized event videos or said corresponding thumbnails, and said generate said highlight reel or said fail reel or both.

9. The system of claim 1 wherein said computer is further configured to
select a motion variable that is a function of time, having as its domain an event time interval from said event start time to said event stop time;
select an efficiency function that maps trajectories of said motion variable to an efficiency value;
calculate an actual trajectory of said motion variable over said event time interval from one or more of said data, said event data, and said motion analysis data;
determine an optimal trajectory of said motion variable over said event time interval, wherein
said optimal trajectory same set of values of said motion variable as said actual trajectory at endpoints of said event time interval;
said optimal trajectory maximizes said efficiency function over a set of possible trajectories that have the same set of values of said motion variable as said actual trajectory at the endpoints of said event time interval; and,

calculate an efficiency index by comparing said actual trajectory to said optimal trajectory.

10. The system of claim

Assignees

• Blast Motion Inc

Inventors

• Bentley Michael
• Kaps Ryan
• Bose Bhaskar
• Gupta Piyush
• Haas Juergen
• Estrem Brian

Classifications

• A63F13/212

  using sensors worn by the player, e.g. for measuring heart beat or leg activity · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• G11B27/031 Primary

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title

• G06T7/20

  Analysis of motion (motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51) · CPC title

• A63F2300/69

  Involving elements of the real world in the game world, e.g. measurement in live races, real video · CPC title