Systems and methods for monitoring and maintaining stability of vehicle cargo

Patent metadata

Field	Value
Publication number	US-11587333-B2
Application number	US-202016785842-A
Country	US
Kind code	B2
Filing date	Feb 10, 2020
Priority date	Feb 10, 2020
Publication date	Feb 21, 2023
Grant date	Feb 21, 2023

Abstract

A system includes a plurality of sensors arranged in a vehicle to monitor an item in a storage area of a vehicle. The system comprises a data processing module configured to process data from the sensors, determine whether the item in the storage area of the vehicle is likely to move within the storage area or is likely to fall from the vehicle during travel, and generate a first indication that the item is likely to move within the storage area or is likely to fall from the vehicle during travel. The data processing module is configured to determine whether the item has moved within the storage area or has fallen from the vehicle during travel and generate a second indication that the item has moved within the storage area or has fallen from the vehicle during travel.

First claim

What is claimed is:

1. A system comprising:
a plurality of sensors arranged in a vehicle to monitor an item in a storage area of the vehicle; and
a data processing module configured to:
process data from the sensors;
determine whether the item in the storage area of the vehicle is likely to move within the storage area or is likely to fall from the vehicle during travel;
generate a first indication that the item is likely to move within the storage area or is likely to fall from the vehicle during travel;
determine whether the item has moved within the storage area or has fallen from the vehicle during travel; and
generate a second indication that the item has moved within the storage area or has fallen from the vehicle during travel,
wherein the data processing module comprises a neural network trained using machine learning to:
generate the first and second indications based on the data from the sensors and additional data regarding at least one of road design, road conditions, and speed limit of a route selected for travel, and historical driving behavior of a driver of the vehicle; and
provide an augmented notification to the driver via a human machine interface (HMI) in response to generating the first and second indication;
wherein the augmented notification in response to generating the first indication includes an augmented view of the item, a path in which the item is likely to move, and a prediction that the item is likely to fall from the vehicle; and
wherein the augmented notification in response to generating the second indication includes a navigation pin on a map indicating a location where the item has fallen from the vehicle and a route to return to the location.

2. The system of claim 1 wherein the first indication includes a suggestion regarding one or more of repositioning the item in the storage area, a route to a location to pull over for repositioning the item in the storage area, an alternate route for the travel, and a change in driving behavior.

3. The system of claim 1 wherein the data processing module is further configured to instruct a suspension subsystem to adjust suspension of the vehicle in response to determining that the item is likely to move within the storage area or is likely to fall from the vehicle during travel.

4. The system of claim 1 wherein the second indication includes an identification of the item, the location where the item fell from the vehicle, and the route to the location in response to determining that the item fell from the vehicle during travel.

5. The system of claim 1 wherein the data processing module is further configured to generate a message to send to another vehicle including a location where the item fell from the vehicle in response to determining that the item fell from the vehicle during travel.

6. The system of claim 1 wherein the data processing module is further configured to verify, before generating the first indication, whether the item is likely to move within the storage area or is likely to fall from the vehicle during travel using a combination of data received from two or more of the sensors.

7. The system of claim 1 wherein the data processing module is further configured to verify, before generating the second indication, whether the item has moved within the storage area or has fallen from the vehicle using a combination of data received from two or more of the sensors.

8. The system of claim 1 wherein the sensors include two or more of a camera, a weight sensor, a suspension sensor, a radar sensor, an ultrasonic sensor, and a tire pressure sensor.

9. The system of claim 1 wherein the storage area includes at least one of a trunk of the vehicle, a cargo area of the vehicle, a rack mounted on a roof of the vehicle, and a trailer hitched to the vehicle.

10. A system comprising:
a processor; and
a memory comprising instructions for execution by the processor to:
process data from a plurality of sensors arranged in a vehicle to monitor an item in a storage area of the vehicle;
determine whether the item in the storage area of the vehicle is likely to move within the storage area or is likely to fall from the vehicle during travel;
generate, using a neural network, a first indication that the item is likely to move within the storage area or is likely to fall from the vehicle during travel;
determine whether the item has moved within the storage area or has fallen from the vehicle during travel; and
generate, using the neural network, a second indication that the item has moved within the storage area or has fallen from the vehicle during travel,
wherein the neural network is trained using machine learning to:
generate the first and second indications based on the data from the sensors and additional data regarding at least one of road design, road conditions, and speed limit of a route selected for travel, and historical driving behavior of a driver of the vehicle; and
provide an augmented notification to the driver via a human machine interface (HMI) in response to generating the first and second indication;
wherein the augmented notification in response to generating the first indication includes an augmented view of the item, a path in which the item is likely to move, and a prediction that the item is likely to fall from the vehicle; and
wherein the augmented notification in response to generating the second indication includes a navigation pin on a map indicating a location where the item has fallen from the vehicle and a route to return to the location.

11. The system of claim 10 wherein the instructions further cause the processor to include in the first indication a suggestion regarding one or more of repositioning the item in the storage area, a route to a location to pull over for repositioning the item in the storage area, an alternate route for the travel, and a change in driving behavior.

12. The system of claim 10 wherein the instructions further cause the processor to adjust suspension of the vehicle in response to determining that the item is likely to move within the storage area or is likely to fall from the vehicle during travel.

13. The system of claim 10 wherein the instructions further cause the processor to include in the second indication an identification of the item, the location where the item fell from the vehicle, and the route to the location in response to determining that the item fell from the vehicle during travel.

14. The system of claim 10 wherein the instructions further cause the processor to generate a message to send to another vehicle including a location where the item fell from the vehicle in response to determining that the item fell from the vehicle during travel.

15. The system of claim 10 wherein the instructions further cause the processor to verify, before generating the first indication, whether the item is likely to move within the storage area or is likely to fall from the vehicle during travel using a combination of data received from two or more of the sensors.

16. The system of claim 10 wherein the instructions further cause the processor to verify, before generating the second indication, whether the item has moved within the storage area or has fallen from the vehicle using a combination of data received from two or more of the sensors.

17. The system of claim 10 wherein the sensors include two or more of a camera, a weight sensor, a suspension sensor, a radar sensor, an ultrasonic sensor, and a tire pressure sensor.

18. The system of claim 10 wherein the storage area includes at least

Assignees

• Gm Global Tech Operations Llc

Inventors

• Sim Jay H
• Glaser Daniel S
• Francisco Justin K
• Schultheis Udo W
• Szczerba Joseph F
• Glaser Yi G

Classifications

• G06N3/0499

  Feedforward networks · CPC title

• G06N3/09

  Supervised learning · CPC title

• G07C5/008

  communicating information to a remotely located station (transmission systems for measured values G08C) · CPC title

• B60G2400/90

  Other conditions or factors · CPC title

• G07C5/0866

  the electronic data carrier being a digital video recorder in combination with video camera · CPC title