Video and motion event integration system

Patent metadata

Field	Value
Publication number	US-9235765-B2
Application number	US-201414549422-A
Country	US
Kind code	B2
Filing date	Nov 20, 2014
Priority date	Aug 26, 2010
Publication date	Jan 12, 2016
Grant date	Jan 12, 2016

Abstract

Enables intelligent synchronization and transfer of generally concise event videos synchronized with motion data from motion capture sensor(s) coupled with a user or piece of equipment. Greatly saves storage and increases upload speed by uploading event videos and avoiding upload of non-pertinent portions of large videos. Provides intelligent selection of multiple videos from multiple cameras covering an event at a given time, for example selecting one with least shake. Enables near real-time alteration of camera parameters during an event determined by the motion capture sensor, and alteration of playback parameters and special effects for synchronized event videos. Creates highlight reels filtered by metrics and can sort by metric. Integrates with multiple sensors to save event data even if other sensors do not detect the event. Also enables analysis or comparison of movement associated with the same user, other user, historical user or group of users.

First claim

What is claimed is:

1. A video and motion event integration system comprising:
at least one motion capture element configured to couple with a user or piece of equipment or mobile device coupled with the user, wherein said at least one motion capture element comprises
a sensor memory;
a sensor configured to capture one or more values associated with an orientation, position, velocity and acceleration of said at least one motion capture element;
a first communication interface;
a microcontroller coupled with said sensor memory, said sensor and said first communication interface, wherein said microcontroller is configured to
collect data that comprises sensor values from said sensor;
store said data in said sensor memory;
optionally analyze said data and recognize an event within said data to determine event data;
transmit said data or said event data associated with said event or both said data and said event data via said first communication interface;

said microcontroller configured to transmit said data or said event data to a computer comprising
a memory;
a second communication interface configured to
communicate with said first communication interface to obtain said data or said event data associated with said event or both said data and said event data;

wherein said computer is coupled with said memory and is coupled with said second communication interface, wherein said computer is configured to
receive
 said data from said second communication interface and
 analyze said data and recognize an event within said data to determine event data
 or
 said event data from said second communication interface
 or
 both said data and said event data from said second communication interface;
analyze said event data to form motion analysis data;
store said event data, or said motion analysis data, or both said event data and said motion analysis data in said memory;
obtain an event start time and an event stop time from said event data;
obtain at least one video start time and at least one video stop time associated with at least one video;
synchronize said event data, said motion analysis data or any combination thereof with said at least one video based on
 a first time associated with said data or said event data obtained from said at least one motion capture element coupled with said user or said piece of equipment or said mobile device coupled with the user and
 at least one time associated said at least one video to create at least one synchronized event video;
obtain a subset of said at least one video comprising said at least one synchronized event video captured at least during a timespan from within said event start time to said event stop time without at least a portion of said at least one video that occurs outside of said timespan from within said event start time to said event stop time to said another computer.

2. The system of claim 1 wherein said computer is further configured to
display a synchronized event video comprising both of
said event data, said motion analysis data or any combination thereof that occurs during said timespan from said event start time to said event stop time and
said video captured during said timespan from said event start time to said event stop time.

3. The system of claim 1 wherein said computer is further configured to discard or instruct said another computer coupled with a camera to discard at least a portion of said at least one video outside of said event start time to said event stop time.

4. The system of claim 1 wherein said computer comprises at least one computer that is within a mobile device, a camera, a desktop computer, a server computer or any combination of any number of said mobile device, said camera, said desktop computer and said server computer.

5. The system of claim 1 wherein said computer is further configured to
accept a metric associated with said at least one synchronized event video;
display a plurality of synchronized event videos or plurality of corresponding thumbnails thereof along with a value associated with said metric for each of said plurality of synchronized event videos or said plurality of corresponding thumbnails.

6. The system of claim 5 wherein said computer is further configured to
accept a selection criteria for said metric;
display only those synchronized event videos or said thumbnails thereof that pass said selection criteria.

7. The system of claim 6 wherein said computer is further configured to
order said only those synchronized event videos or said thumbnails thereof according to a value of said metric.

8. The system of claim 6 wherein said computer is further configured to
generate a highlight reel of said plurality of synchronized event videos that pass said selection criteria.

9. The system of claim 1 wherein said computer is further configured to
select a first synchronized event video to display from said at least one synchronized event video for a particular time span that are associated with different cameras based on image analysis.

10. The system of claim 1 wherein said computer is further configured to
select a first synchronized event video to display from said at least one synchronized event video for a particular time span that are associated with different cameras based on image analysis wherein said image analysis comprises minimal shake detection.

11. The system of claim 1 wherein said computer is further configured to
send a control message local to said computer or external to said computer to at least one camera to modify video recording parameters of said at least one video based on said data or said event data or said motion analysis data.

12. The system of claim 11 wherein said video recording parameters comprise one or more of frame rate, resolution, color depth, color or grayscale, compression method, compression quality, and recording on or off.

13. The system of claim 1 wherein said computer is further configured to
accept a sound track;
analyze said sound track to determine time points of high audio amplitude associated with beats;
synchronize said beats with said event.

14. The system of claim 1 wherein said computer is configured to
display said at least one synchronized event video; and to
modify playback characteristics of said at least one synchronized event video based on said event data, said motion analysis data, or both,
wherein said modifications to playback characteristics may occur one or more times throughout the playback of said at least one synchronized event video.

15. The system of claim 14 wherein said modifications to playback characteristics comprise one or more of changes to playback speed, image brightness, image colors, image focus, image resolution, flashing special effects, use of graphic overlays or borders.

16. The system of claim 14 wherein said modifications to playback characteristics comprise slower motion playback as said event video approaches a sub-event of interest or as said event video approaches a peak value of a selected metric associated with said motion analysis data or said event data or both.

17. The system of claim 14 wherein said computer is further configured to
accept a sound track;
analyze said sound track to determine time points of high audio amplitude associated with beats;
play said sound track along with said at least one synchronized event video;
synchronize said beats with said event; and,
wherein said modifications to playback characteristics comprise one or more of modifying one or more of the vo

Assignees

• Blast Motion Inc

Inventors

• Bentley Michael
• Kaps Ryan
• Bose Bhaskar

Classifications

• G06K9/00711 Primary

  Physics · mapped topic

• G11B31/006

  with video camera or receiver · CPC title

• G06K9/00342

  Physics · mapped topic

• G11B27/022

  Electronic editing of analogue information signals, e.g. audio or video signals · CPC title

• G08B21/043

  detecting an emergency event, e.g. a fall · CPC title