Multi-sensor event correlation system

Patent metadata

Field	Value
Publication number	US-10748581-B2
Application number	US-201916460961-A
Country	US
Kind code	B2
Filing date	Jul 2, 2019
Priority date	Aug 26, 2010
Publication date	Aug 18, 2020
Grant date	Aug 18, 2020

Abstract

A sensor event detection and tagging system that analyzes data from multiple sensors to detect an event and to automatically select or generate tags for the event. Sensors may include for example a motion capture sensor and one or more additional sensors that measure values such as temperature, humidity, wind or elevation. Tags and event detection may be performed by a microprocessor associated with or integrated with the sensors, or by a computer that receives data from the microprocessor. Tags may represent for example activity types, players, performance levels, or scoring results. The system may analyze social media postings to confirm or augment event tags. Users may filter and analyze saved events based on the assigned tags. The system may create highlight and fail reels filtered by metrics and by tags.

First claim

What is claimed is:

1. A multi-sensor event correlation system comprising:
a sensor data source comprising at least one of
an environmental sensor,
a physiological sensor;

at least one motion capture element comprising
a sensor data memory;
a sensor configured to capture one or more values associated with an orientation, position, velocity, acceleration, angular velocity, and angular acceleration of said at least one motion capture element;
a first communication interface;
a microprocessor coupled with said sensor data memory, said sensor and said first communication interface, wherein said microprocessor is configured to collect data that comprises sensor values that include said one or more values from said sensor;
transmit said data via said first communication interface to a computer comprising
a computer memory; and,
a second communication interface configured to obtain said data;
wherein said computer is coupled with said computer memory and is coupled with said second communication interface;

wherein said at least one of said microprocessor or said computer is configured to
analyze said data and recognize an event within said data to determine event data;
obtain one or more other values associated with at least one of said environmental sensor, said physiological sensor;
correlate at least one of said data, said event data with said one or more other values associated with said at least one of said environmental sensor, said physiological sensor to determine at least one of
a type of event or true event or a false positive event selected from a plurality of types of events or
a type of equipment that said at least one motion capture element is coupled with selected from a plurality of types of equipment or
a type of activity indicated by said data or said event data selected from a plurality of types of activities.

2. The system of claim 1 , wherein said microprocessor is, or said computer is, or both said microprocessor and said computer are further configured to further determine one or more tags for said event and wherein said one or more tags represent one or more of an activity type of said event;
a location of said event;
a timestamp of said event;
a stage of an activity associated with said event;
a player identity associated with said event;
a performance level associated with said event; and,
a scoring result associated with said event.

3. The system of claim 2 wherein said microprocessor is, or said computer is, or both said microprocessor and said computer are further configured to analyze one or more of text, audio, image, and video from a server to determine said one or more tags for said event.

4. The system of claim 3 , wherein said server comprises one or more of an email server, a social media site, a photo sharing site, a video sharing site, a blog, a wiki, a database, a newsgroup, an RSS server, a multimedia repository, a document repository, and a text message server.

5. The system of claim 3 , wherein said analyze one or more of text, audio, image, and video comprises search said text for key words or key phrases related to said event.

6. The system of claim 3 , wherein said microprocessor is, or said computer is, or both said microprocessor and said computer are further configured to analyze said one or more of text, audio, image, and video from a server to confirm said event for a particular location and time to create a confirmed event.

7. The system of claim 1 wherein said at least one motion capture element is configured to couple with a user or piece of equipment or couple with a mobile device coupled with the user, and wherein said microprocessor is, or said computer is, or both said microprocessor and said computer are further configured to recognize a location of said sensor on said piece of equipment or said user based on said data or said event data.

8. The system of claim 1 wherein said microprocessor is, or said computer is, or both said microprocessor and said computer are further configured to collect said sensor values from said sensor based on a sensor personality selected from a plurality of sensor personalities, wherein the sensor personality is configured to control sensor settings to collect the data in an optimal manner with respect to a specific type of movement or said type of activity associated with a specific piece of equipment or type of clothing.

9. The system of claim 1 , wherein
said microprocessor is, or said computer is, or both said microprocessor and said computer are further configured to determine said false positive event as
detect a first value from said sensor values having a first threshold value and
detect a second value from said sensor values having a second threshold value within a time window;
signify a prospective event;
compare said prospective event to a characteristic signal associated with a typical event and eliminate any false positive events; and,
signify said true event if said prospective event is not said false positive event.

10. The system of claim 1 , wherein said microprocessor is, or said computer is, or both said microprocessor and said computer are further configured to recognize said at least one motion capture element with newly assigned locations after said at least one motion capture element is removed from a first piece of equipment and coupled with a second piece of equipment of a different type based on said data or event data.

11. The system of claim 1 wherein said at least one motion capture element is configured to couple with a user or piece of equipment or couple with a mobile device coupled with the user wherein said at least one motion capture element is contained within one or more of a motion capture element mount, said mobile device, a mobile phone, a smart phone, a smart watch, a camera, a laptop computer, a notebook computer, a tablet computer, a desktop computer, and a server computer, or any combination of any number of said motion capture element mount, said mobile device, said mobile phone, said smart phone, said smart watch, said camera, said laptop computer, said notebook computer, said tablet computer, said desktop computer and said server computer.

12. The system of claim 1 wherein said microprocessor is, or said computer is, or both said microprocessor and said computer are further configured to transmit said at least one of said data, said event data, said type of event, said true event, said false positive event, said type of equipment, said type of activity, and said one or more tags for said event to one or more of a repository, a viewer, a server, another computer, a social media site, a mobile device, a network, and an emergency service.

13. The system of claim 1
wherein said computer is further configured to
receive
said data from said second communication interface and analyze said data and recognize said event within said data to determine event data,
or
said event data from said second communication interface,
or
both said data and said event data from said second communication interface;

analyze said event data to form motion analysis data;
store said event data, or said motion analysis data, or both said event data and said motion analysis data in said computer memory;
obtain an event start time and an event stop time from said event data or from said motion analysis data;
obtain at least one video start time and at least one video stop time associated with at least one video;
synchronize said event data, said motion analysis data or any combination thereof with said
at least one video based on
a first time associated with said data or said event data obtai

Assignees

• Blast Motion Inc

Inventors

• Bose Bhaskar
• Bentley Michael
• Kaps Ryan

Classifications

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• G11B27/031 Primary

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title

• G06V20/42

  of sport video content · CPC title

• G06V40/23

  Recognition of whole body movements, e.g. for sport training · CPC title

• G06V20/44

  Event detection · CPC title