Extended time scale event detection

Patent metadata

Field	Value
Publication number	US-11514733-B1
Application number	US-201715485074-A
Country	US
Kind code	B1
Filing date	Apr 11, 2017
Priority date	Apr 11, 2017
Publication date	Nov 29, 2022
Grant date	Nov 29, 2022

Abstract

A system for extended time scale event detection includes a data storage device and a processor. The data storage device is configured to store sensor data associated with a vehicle. The processor is configured to analyze an extended time period of the sensor data to identify minor events. The minor events are detected using a minor event threshold. The processor is further configured to determine whether there are more than a threshold number of the minor events and, in the event there are more than a threshold number of the minor events, flag the minor events.

First claim

What is claimed is:

1. A system for extended time scale event detection, comprising:
a data storage device configured to store sensor data associated with a vehicle; and
a processor configured to:
identify major events in the stored sensor data, wherein a major event is detected using a major event threshold, the major event being a collision, a braking event, a turning event, an evasive maneuver, an incident related to a reportable requirement, an incident related to a maintenance issue, an incident related to an insurance issue, an incident related to a trainable issue, or any combination thereof;
flag the major events;
determine whether the stored sensor data includes a lookback indicator, wherein the lookback indicator comprises one or more of: a vehicle pulling over indicator, a multiple lane change indicator, a change in speed indicator, or an end of day indication;
in response to the determination that the stored sensor data includes the lookback indicator:
determine an extended time period of the sensor data based on one or more minor event types, wherein the one or more minor event types includes one or more of the following: a small impact, a small swerve, a rapid lane change, and/or a vehicle stop in a road shoulder, wherein the small impact is equal to or less than a first impact threshold and greater than a second impact threshold, the first impact threshold being larger than the second impact threshold, wherein the small swerve is equal to or less than a first swerve threshold and greater than a second swerve threshold, the first swerve threshold being larger than the second swerve threshold, and wherein the rapid lane change is equal to or less than a first lane change threshold and greater than a second lane change threshold, the first lane change threshold being larger than the second lane change threshold;
analyze the extended time period of the sensor data to identify minor events, wherein the minor events are detected using minor event thresholds, wherein the minor event thresholds are more sensitive thresholds than thresholds associated with corresponding major events or are more easily triggered thresholds than the thresholds associated with the corresponding major events, wherein the minor event thresholds are lower than the major event threshold, wherein each minor event is less than a corresponding major event threshold and is greater than or equal to a corresponding minor event threshold, and wherein the analyzing of the extended time period of the sensor data comprises:
determine a minor event type associated with a minor event; and
determine a threshold number of minor events based on a first minor event type or a second minor event type;

determine whether a number of the minor events over the extended time period is equal to or exceeds the threshold number of minor events; and
in response to the determination that the number of the minor events is equal to or exceeds the threshold number of minor events, flag the minor events; and

output the flagged events for training a driver of the vehicle, comprising to:
connect to a vehicle data server;
create a video clip associated with one of the flagged minor events based on a selected video duration, a marked time of interest, and added trigger information; and
output the video clip.

2. The system of claim 1 , wherein the sensor data comprises one or more of: video data, audio data, accelerometer data, GPS data, or vehicle state sensor data.

3. The system of claim 1 , wherein a continuous stream of sensor data is stored.

4. The system of claim 1 , wherein the data storage device comprises one of: a hard drive, an integrated circuit memory, a removable media storage device, a magnetic data storage device, an optical data storage device, a video cassette recorder, or a digital video recorder.

5. The system of claim 1 , wherein the threshold number of minor events comprises 0 minor events.

6. The system of claim 1 , wherein the threshold number of minor events is greater than 0 minor events.

7. The system of claim 1 , wherein one or more predetermined minor event types for detection are associated with the lookback indicator.

8. The system of claim 1 , wherein one or more minor event thresholds are associated with the lookback indicator.

9. The system of claim 1 , wherein the extended time period is associated with the lookback indicator.

10. The system of claim 1 , wherein flagging the minor events comprises providing an indication to store flag data associated with the minor event.

11. A method for extended time scale event detection, comprising:
storing sensor data associated with a vehicle;
identifying major events in the stored sensor data, wherein a major event is detected using a major event threshold, the major event being a collision, a braking event, a turning event, an evasive maneuver, an incident related to a reportable requirement, an incident related to a maintenance issue, an incident related to an insurance issue, an incident related to a trainable issue, or any combination thereof;
flagging the major events;
determining whether the stored sensor data includes a lookback indicator, wherein the lookback indicator comprises one or more of: a vehicle pulling over indicator, a multiple lane change indicator, a change in speed indicator, or an end of day indication;
in response to the determination that the stored sensor data includes the lookback indicator:
determining an extended time period of the sensor data based on one or more minor event types, wherein the one or more minor event types includes one or more of the following: a small impact, a small swerve, a rapid lane change, and/or a vehicle stop in a road shoulder, wherein the small impact is equal to or less than a first impact threshold and greater than a second impact threshold, the first impact threshold being larger than the second impact threshold, wherein the small swerve is equal to or less than a first swerve threshold and greater than a second swerve threshold, the first swerve threshold being larger than the second swerve threshold, and wherein the rapid lane change is equal to or less than a first lane change threshold and greater than a second lane change threshold, the first lane change threshold being larger than the second lane change threshold;
analyzing, using a processor, the extended time period of the sensor data to identify minor events, wherein the minor events are detected using minor event thresholds, wherein the minor event thresholds are more sensitive thresholds than thresholds associated with corresponding major events or are more easily triggered thresholds than the thresholds associated with the corresponding major events, wherein the minor event thresholds are lower than the major event threshold, wherein each minor event is less than a corresponding major event threshold and is greater than or equal to a corresponding minor event threshold, and wherein the analyzing of the extended time period of the sensor data comprises:
determining a minor event type associated with a minor event; and
determining a threshold number of minor events based on a first minor event type or a second minor event type;

determining whether a number of the minor events over the extended time period is equal to or exceeds the threshold number of minor events; and
in response to the determination that the number of the minor events is equal to or exceeds the threshold number of minor events, flagging the minor events; and

outputting the flagged events for training a driver of the vehicle, comprising:
connecting to a vehicle data server;
creating a video clip associated with one of the flagged minor events based on a sele

Assignees

• Lytx Inc

Inventors

• Krotosky Stephen
• Quach Quoc Chan
• Lambert Daniel

Classifications

• G07C5/0875

  using magnetic data carriers · CPC title

• G07C5/0866 Primary

  the electronic data carrier being a digital video recorder in combination with video camera · CPC title

• G07C5/0858

  wherein the data carrier is removable · CPC title

• G07C5/006

  Indicating maintenance · CPC title

• H04L67/12

  specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks · CPC title