Alert system to output alert about occupant left in vehicle

Patent metadata

Field	Value
Publication number	US-11915574-B2
Application number	US-202217879475-A
Country	US
Kind code	B2
Filing date	Aug 2, 2022
Priority date	Aug 25, 2021
Publication date	Feb 27, 2024
Grant date	Feb 27, 2024

Abstract

An alert system configured to output an alert about an occupant being left in a vehicle includes an external-environment camera, a determiner, and an alert controller. The external-environment camera captures images at least one of which includes the occupant outside the vehicle. The determiner determines whether a child including an infant is likely to have been left in the vehicle. The alert controller outputs an alert if the child is likely to have been left in the vehicle. The determiner determines whether the child is likely to have been left in the vehicle, based on a change in the images from one of a presence state and an absence state of a person or an object outside the vehicle in a first image of the images to another of the presence state and the absence state of the person or the object in a second image of the images.

First claim

The invention claimed is:

1. An alert system comprising:
an external-environment camera configured to capture images outside of a vehicle;
a vehicle sensor configured to detect an operation of the vehicle that is performed when an occupant gets in or when the occupant gets out of the vehicle;
an actuator configured to change a direction of the external-environment camera to at least one of a downward direction and a backward direction in response to the vehicle sensor detecting the operation of the vehicle;
a determiner configured to determine whether a child is likely to have been left in the vehicle based on a change in the images from one of a presence state and an absence state of the occupant or an object outside the vehicle in a first image of the images to another of the presence state and the absence state of the occupant or the object in a second image of the images; and
an alert controller configured to output an alert in a case where the child is likely to have been left in the vehicle.

2. The alert system according to claim 1 ,
wherein the determiner is configured to:
determine a presence state or an absence state of the child outside the vehicle in the captured images by the external-environment camera every time the vehicle sensor detects the operation of the vehicle; and
determine whether the child has got in the vehicle based on a change in the captured images from the presence state of the child outside the vehicle to the absence state of the child outside the vehicle in the first image of the captured images, or whether the child has got out of the vehicle based on a change in the captured images from the absence state of the child outside the vehicle to the presence state of the child outside the vehicle in the second image of the captured images, each of the captured images being captured when the occupant has got in or got out of the vehicle.

3. The alert system according to claim 2 ,
wherein the determiner is configured to determine the presence state or the absence state of the child outside the vehicle in the captured images by the external-environment camera after the vehicle sensor has detected the operation of the vehicle and after the actuator has changed the direction of the external-environment camera to at least one of the downward direction or the backward direction.

4. The alert system according to claim 3 , further comprising an in-vehicle sensor configured to perform detection of the occupant inside the vehicle,
wherein the determiner is configured to determine whether the child is likely to have been left in the vehicle, based on the change in the presence state or the absence state of the occupant or the object outside the vehicle in the images and based on the detection of the occupant.

5. The alert system according to claim 3 , further comprising a memory configured to record a flag, a value of the flag being changed in a case where the determiner has determined that the child has got in or got out of the vehicle, wherein
the determiner is configured to:
determine whether the child is likely to have been left in the vehicle in a case where (1) the vehicle has stopped driving, (2) an operation for stopping the vehicle or getting out of the vehicle is performed, or (3) there is only the child in the vehicle; and
refer to the value of the flag to determine whether the child is likely to have been left in the vehicle, based on the change in the presence state or the absence state of the occupant or the object outside the vehicle in the images, and

the alert controller is configured to:
output the alert in a case where the determiner determines based on the value of the flag that the child is likely to have been left in the vehicle; and
output no alert in a case where the determiner determines based on the value of the flag that no child is likely to have been left in the vehicle.

6. The alert system according to claim 2 , further comprising a memory configured to record a flag, a value of the flag being changed in a case where the determiner has determined that the child has got in or got out of the vehicle, wherein
the determiner is configured to:
determine whether the child is likely to have been left in the vehicle in a case where (1) the vehicle has stopped driving, (2) an operation for stopping the vehicle or getting out of the vehicle is performed, or (3) there is only the child in the vehicle; and
refer to the value of the flag to determine whether the child is likely to have been left in the vehicle, based on the change in the presence state or the absence state of the occupant or the object outside the vehicle in the images, and

the alert controller is configured to:
output the alert in a case where the determiner determines based on the value of the flag that the child is likely to have been left in the vehicle; and
output no alert in a case where the determiner determines based on the value of the flag that no child is likely to have been left in the vehicle.

7. The alert system according to claim 2 , further comprising an in-vehicle sensor configured to perform detection of the occupant inside the vehicle,
wherein the determiner is configured to determine whether the child is likely to have been left in the vehicle, based on the change in the presence state or the absence state of the occupant or the object outside the vehicle in the images and based on the detection of the occupant.

8. The alert system according to claim 2 , wherein the vehicle sensor is constituted by at least one of a door lock sensor configured to detect locking/unlocking of a door of the vehicle or a door opening/closing sensor configured to detect opening/closing of the door of the vehicle.

9. The alert system according to claim 8 , further comprising a memory configured to record a flag, a value of the flag being changed in a case where the determiner has determined that the child has got in or got out of the vehicle, wherein
the determiner is configured to:
determine whether the child is likely to have been left in the vehicle in a case where (1) the vehicle has stopped driving, (2) an operation for stopping the vehicle or getting out of the vehicle is performed, or (3) there is only the child in the vehicle; and
refer to the value of the flag to determine whether the child is likely to have been left in the vehicle, based on a change in the presence state or the absence state of the occupant or the object outside the vehicle in the images, and

the alert controller is configured to:
output the alert in a case where the determiner determines based on the value of the flag that the child is likely to have been left in the vehicle; and
output no alert in a case where the determiner determines based on the value of the flag that no child is likely to have been left in the vehicle.

10. The alert system according to claim 8 , further comprising an in-vehicle sensor configured to perform detection of the occupant inside the vehicle,
wherein the determiner is configured to determine whether the child is likely to have been left in the vehicle, based on the change in the presence state or the absence state of the occupant or the object outside the vehicle in the images and based on the detection of the occupant.

11. The alert system according to claim 8 ,
wherein the determiner is configured to determine the presence state or the absence state of the child outside the vehicle in the captured images by the external-environment camera after the vehicle sensor has detected the operation of the vehicle and after the actuator has changed the direction of the external-environment camera to at least one of the downward direction or the backward dir

Assignees

• Subaru Corp

Inventors

• Kawamura Kousei
• Kanagawa Tomoya

Classifications

• G08B21/24 Primary

  Reminder alarms, e.g. anti-loss alarms · CPC title

• G06V20/58 Primary

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• G06V20/59

  inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions · CPC title

• H04N23/695

  Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects · CPC title

• B60Q5/005

  automatically actuated · CPC title