Method for alerting a driver to objects left on a vehicle roof and alert system

Patent metadata

Field	Value
Publication number	US-12479362-B2
Application number	US-202318541335-A
Country	US
Kind code	B2
Filing date	Dec 15, 2023
Priority date	Dec 15, 2023
Publication date	Nov 25, 2025
Grant date	Nov 25, 2025

Abstract

A method for alerting a driver to objects left on a vehicle roof includes obtaining image data of an environment surrounding the vehicle. The image data includes a sequence of images captured by a camera. The method further includes detecting a person within the image data, and determining whether the person raised at least one arm above the vehicle roof, based on the image data. The method further includes generating a notification based on determining that the person raised at least one arm above the vehicle roof.

First claim

The invention claimed is:

1 . A method for alerting a driver to objects left on a vehicle roof, the method comprising:
obtaining image data of an environment surrounding the vehicle, the image data comprising a sequence of images captured by a camera; detecting a person in the image data; determining whether the person raised at least one arm above the vehicle roof, based on the image data; and generating a notification based on determining that the person raised at least one arm above the vehicle roof.

2 . The method of claim 1 , wherein determining whether the person raised at least one arm above the vehicle roof comprises detecting that the person's arm moves out of a field of view of the camera.

3 . The method of claim 1 , wherein determining whether the person raised at least one arm above the vehicle roof comprises
identifying the person's hands within the image data, and tracking position of the person's hands across the sequence of images.

4 . The method of claim 1 , wherein determining whether the person raised at least one arm above the vehicle roof comprises
recognizing keypoints of a skeletal structure of the person within the image data, and tracking positions of at least one of the recognized keypoints across the sequence of images.

5 . The method of claim 1 , further comprising:
detecting presence of an object in at least one of the person's hands within a frame of the image data when the person's hands were moving towards the vehicle roof; detecting absence of the object in the person's hands within a further frame of the image data when the person's hands were moving away from the vehicle roof, wherein the further frame is subsequent to the frame; and generating the notification further based on the detection of presence of the object followed by the subsequent detection of absence of the object.

6 . The method of claim 1 , further comprising:
detecting communication between a key fob and the vehicle, and wherein at least one of obtaining image data of the environment and detecting movement of the person's hands, is initiated based on detection of the communication.

7 . The method of claim 6 , further comprising at least one of:
turning on the camera based on detection of the communication; and detecting absence of communication between the key fob and the vehicle and stopping at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, based on detection of absence of the communication.

8 . The method of claim 1 , further comprising:
detecting power down of the vehicle propulsion system; wherein at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, is initiated based on detection of the power down of the vehicle propulsion system.

9 . The method of claim 8 , further comprising:
detecting opening of the vehicle doors after detection of the power down of the vehicle propulsion system, wherein at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, is initiated based on both the detection of the power down of the vehicle propulsion system and the detection of the opening of the vehicle doors.

10 . The method of claim 8 , further comprising:
detecting power on of the vehicle propulsion system; and stop at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, based on detection of the power on of the vehicle propulsion system.

11 . An alert system for alerting a driver to objects left on the vehicle roof, the alert system comprising:
a processor configured to obtain image data of an environment surrounding the vehicle, the image data comprising a sequence of images, wherein the processor is further configured to detect a person within the image data, wherein the processor is further configured to determine whether the person raised at least one arm above the vehicle roof, based on the image data; and a notification generator configured to generate a notification based on the processor determining that the person raised at least one arm above the vehicle roof.

12 . The alert system of claim 11 , further comprising:
a camera configured to capture the image data of the environment surrounding the vehicle.

13 . The alert system of claim 11 , wherein the processor is configured to determine whether the person raised at least one arm above the vehicle roof by at least one of:
(a) identifying the person's hands within the image data, and tracking position of the person's hands across the sequence of images, and (b) recognizing keypoints of a skeletal structure of the person within the image data, and tracking positions of at least one of the recognized keypoints across the sequence of images.

14 . The alert system of claim 11 , wherein the processor is further configured to detect presence of an object in at least one of the person's hands within a frame of the image data when the person's hands were moving towards the vehicle roof, and
wherein the processor is further configured to detect absence of the object in the person's hands within a further frame of the image data when the person's hands were moving away from the vehicle roof, the further frame being subsequent to the frame, and wherein the notification generator is configured to generate the notification further based on the detection of presence of the object followed by the subsequent detection of absence of the object.

15 . The alert system of claim 11 , further comprising:
a transceiver configured to detect communication between a key fob and the vehicle, and a controller configured to control the processor to initiate at least one of obtaining image data of the environment and detecting movement of the person's hands, based on detection of the communication by the transceiver.

16 . The alert system of claim 15 , wherein the controller is further configured to turn on the camera based on detection of the communication by the transceiver.

17 . The alert system of claim 15 , wherein the transceiver is further configured to detect absence of communication between the key fob and the vehicle, and
wherein the controller is further configured to control the processor to stop at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, based on detection of absence of the communication by the transceiver.

18 . The alert system of claim 11 , further comprising:
a power sensor configured to detect power down of the vehicle propulsion system; and a controller configured to control the processor to initiate at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, based on detection of the power down of the vehicle propulsion system by the power sensor.

19 . The alert system of claim 18 , further comprising:
a door sensor configured to detect opening of the vehicle doors after detection of the power down of the vehicle propulsion system by the power sensor, wherein the controller is configured to control the processor to initiate at least one of obtaining image data of the environment and determining whether the person raised at least one arm above the vehicle roof, based on both the detection of the pow

Assignees

• Continental Autonomous Mobility Us Llc

Inventors

• Burtch Joseph

Classifications

• H04N7/188

  Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253) · CPC title

• G06V40/28

  Recognition of hand or arm movements, e.g. recognition of deaf sign language (static hand signs G06V40/113) · CPC title

• G06V20/58

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• G06V40/11

  Hand-related biometrics; Hand pose recognition · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title