Injury severity estimation by using in-vehicle perception

Patent metadata

Field	Value
Publication number	US-12230402-B2
Application number	US-202117471182-A
Country	US
Kind code	B2
Filing date	Sep 10, 2021
Priority date	Sep 10, 2021
Publication date	Feb 18, 2025
Grant date	Feb 18, 2025

Abstract

A monitoring system may include a memory having computer-readable instructions stored thereon and a processor operatively coupled to the memory. The processor may read and execute the computer-readable instructions to perform or control performance of operations. The operations may include receive, prior to a collision involving a vehicle, sensor data representative of a feature of an internal environment and determine the collision has occurred. The operations may include automatically instruct, based on the collision, a sensor to generate another sensor data representative of another feature of the internal environment. The operations may include receive the another sensor data from the sensor and compare the sensor data and the another sensor data to accident data corresponding to previous accidents. The accident data may include a diagnosed injury and an accident severity of each of the previous accidents. The operations may include determine a severity of the collision based on the comparison.

First claim

What is claimed is:

1. A driver monitoring system (DMS) comprising:
a memory having computer-readable instructions stored thereon; and
a processor operatively coupled to the memory and configured to read and execute the computer-readable instructions to perform or control performance of operations comprising:
receive, prior to a collision involving a vehicle, first sensor data representative of a first feature of an internal environment of the vehicle;
determine the collision has occurred;
automatically instruct, based on the collision, a sensor to generate second sensor data representative of a second feature of the internal environment of the vehicle;
receive the second sensor data from the sensor;
compare the first sensor data and the second sensor data to accident data corresponding to a plurality of previous accidents, the accident data comprising a diagnosed injury and an accident severity of each previous accident of the plurality of previous accidents; and
determine a severity of the collision based on the comparison.

2. The DMS of claim 1 , wherein the operations further comprise continuously transmit, responsive to determining the collision has occurred, a severity message to an emergency response center, the severity message representative of at least one of the severity of the collision, the first sensor data, the second sensor data, or a state of an occupant of the vehicle.

3. The DMS of claim 2 , wherein:
the operations further comprise receive an accident database comprising the accident data; and
the operation determine the severity of the collision comprises: identify a previous accident of the plurality of previous accidents that is similar to the collision based on the comparison, wherein the severity of the collision is determined based on the identified previous accident and the severity message further indicates an estimated injury of the occupant based on the diagnosed injury of the identified previous accident.

4. The DMS of claim 1 , wherein:
the first feature corresponds to at least one of a pose or a position of an occupant of the vehicle prior to and during the collision; and
the second feature corresponds to a state of the occupant of the vehicle after the collision.

5. The DMS of claim 1 , wherein the first feature corresponds to an interior surface of the internal volume, the operation determine the severity of the collision comprises determine a deformity of the interior surface based on a difference between the first feature prior to the collision and the first feature during the collision, wherein the severity of the collision is determined based on the deformity of the interior surface.

6. The DMS of claim 1 , wherein:
the first sensor data comprises kinematic information of an occupant of the vehicle, the kinematic information indicates at least one of a direction of a movement of the occupant relative to the vehicle during the collision, a velocity of the movement of the occupant during the collision, a pose of the occupant prior to the collision, a pose of the occupant during the collision, or a deformation of an interior surface of the vehicle during the collision; and
the second sensor data comprises medical information of the occupant, the medical information comprises at least one of a heart rate of the occupant, a body temperature of the occupant, a presence of external bleeding of the occupant, a consciousness state of the occupant, a facial expression of the occupant, a state of a skeletal structure of the occupant, or a respiratory rate of the occupant.

7. The DMS of claim 1 , wherein the sensor comprises at least one of a camera, a light detection and ranging sensor, an acoustic sensor, an accelerometer, an RGB-D sensor a heart rate sensor, an infrared sensor, or a respiratory sensor.

8. The DMS of claim 1 , wherein the operations further comprise:
identify, prior to the collision, a pose of an occupant of the vehicle;
compare the pose to a plurality of known risk poses;
determine a likelihood and severity of an injury to the occupant based on the comparison; and
responsive to the likelihood and severity of the injury to the occupant exceeding a threshold value, provide a message to the occupant indicating the occupant should change their pose.

9. The DMS of claim 1 , wherein the operations further comprise store the first sensor data and the second sensor data in the memory.

10. A non-transitory computer-readable medium having computer-readable instructions stored thereon that are executable by a processor to perform or control performance of operations comprising:
receive, prior to a collision involving a vehicle, first sensor data representative of a first feature of an internal environment of the vehicle;
determine the collision has occurred;
automatically instruct, based on the collision, a sensor to generate second sensor data representative of a second feature of the internal environment of the vehicle;
receive the second sensor data from the sensor;
compare the first sensor data and the second sensor data to accident data corresponding to a plurality of previous accidents, the accident data comprising a diagnosed injury and an accident severity of each previous accident of the plurality of previous accidents; and
determine a severity of the collision based on the comparison.

11. The non-transitory computer-readable medium of claim 10 , the operations further comprising continuously transmit, responsive to determining the collision has occurred, a severity message to an emergency response center, the severity message representative of at least one of the severity of the collision, the first sensor data, the second sensor data, or a state of an occupant of the vehicle.

12. The non-transitory computer-readable medium of claim 11 , wherein:
the operations further comprise receive an accident database comprising the accident data; and
the operation determine the severity of the collision comprises identify a previous accident of the plurality of previous accidents that is similar to the collision based on the comparison, wherein the severity of the collision is determined based on the identified previous accident and the severity message further indicates an estimated injury of the occupant based on the diagnosed injury of the identified previous accident.

13. The non-transitory computer-readable medium of claim 10 , wherein:
the first feature corresponds to at least one of a pose or a position of an occupant of the vehicle prior to and during the collision; and
the second feature corresponds to a state of the occupant of the vehicle after the collision.

14. The non-transitory computer-readable medium of claim 10 , wherein the first feature corresponds to an interior surface of the internal volume, the operation determine the severity of the collision comprises determine a deformity of the interior surface based on a difference between the first feature prior to the collision and the first feature during the collision, wherein the severity of the collision is determined based on the deformity of the interior surface.

15. The non-transitory computer-readable medium of claim 10 , wherein:
the first sensor data comprises kinematic information of an occupant of the vehicle, the kinematic information indicates at least one of a direction of a movement of the occupant relative to the vehicle during the collision, a velocity of the movement of the occupant during the collision, a pose of the occupant prior to the collision, a pose of the occupant during the collision, or a deformation of an interior surface of the vehicle during the collisi

Assignees

• Intel Corp

Inventors

• Pasch Frederik
• Gassmann Bernd
• Scholl Kay-Ulrich
• Buerkle Cornelius
• Oboril Fabian

Classifications

• B60W2420/408

  Radar; Laser, e.g. lidar · CPC title

• B60W2420/403

  Image sensing, e.g. optical camera · CPC title

• G06V20/597

  Recognising the driver's state or behaviour, e.g. attention or drowsiness · CPC title

• G08G1/164

  Centralised systems, e.g. external to vehicles · CPC title

• B60W2420/54

  Audio sensitive means, e.g. ultrasound · CPC title