Determining and responding to an internal status of a vehicle

Patent metadata

Field	Value
Publication number	US-11619949-B2
Application number	US-202017068995-A
Country	US
Kind code	B2
Filing date	Oct 13, 2020
Priority date	Feb 21, 2018
Publication date	Apr 4, 2023
Grant date	Apr 4, 2023

Abstract

Aspects of the disclosure relate to determining and responding to an internal state of a self-driving vehicle. For instance, an image of an interior of the vehicle captured by a camera mounted in the vehicle is received. The image is processed in order to identify one or more visible markers at predetermined locations within the vehicle. The internal state of the vehicle is determined based on the identified one or more visible markers. A responsive action is identified action using the determined internal state, and the vehicle is controlled in order to perform the responsive action.

First claim

The invention claimed is:

1. A method of responding to an internal state of a vehicle, the method comprising:
identifying, by one or more processors, one or more visible markers and one or more partially or fully obscured markers at predetermined locations Within the vehicle;
determining, by the one or more processors, the internal state of the vehicle prior to starting a trip based on visibility of the identified markers;
determining, by the one or more processors, whether a passenger in the vehicle indicated by the internal state is a minor or a child; and
when the passenger is determined to be a minor or a child, performing, by the one or more processors, at least one of:
generating a notification requesting that additional information or physical action be provided; or
controlling the vehicle to respond to the internal state of the vehicle.

2. The method of claim 1 , wherein the vehicle is an autonomous vehicle.

3. The method of claim 1 , wherein the additional information or physical action is provided by an account holder that arranged the trip.

4. The method of claim 1 , further comprising sending the notification to a client computing device.

5. The method of claim 4 , further comprising receiving a response to the notification from the client computing device.

6. The method of claim 1 , wherein the notification is an audible notification played inside the vehicle.

7. The method of claim 1 , wherein the controlling the vehicle comprises controlling the vehicle to turn off an airbag adjacent to where the minor or child is sitting in the vehicle.

8. The method of claim 1 , wherein the controlling the vehicle comprises delaying the starting of the trip or pausing the trip.

9. The method of claim 1 , further comprising sending an image of an interior of the vehicle to a client computing device.

10. The method of claim 1 , wherein the internal state indicates one or more physical characteristics of the passenger.

11. The method of claim 1 , wherein the identifying comprises:
receiving, by the one or more processors, an image of interior of the vehicle captured by a camera mounted in the vehicle; and
processing, by the one or more processors, the image.

12. The method of claim 1 , wherein the additional information includes a confirmation that the minor or the child is allowed to ride in the vehicle.

13. The method of claim 1 , wherein the physical action includes placing the minor or the child in an appropriate seat of the vehicle.

14. The method of claim 13 , wherein the appropriate seat is a booster or a child's car seat.

15. The method of claim 13 , wherein the physical action includes restraining the minor or the child in the appropriate seat using an appropriate child restraint.

16. Apparatus for of responding to an internal state of a vehicle, the apparatus comprising:
a memory;
one or more cameras; and
one or more processors configured to:
access information stored in the memory:

use the one or more cameras to identify one or more visible markers and one or more partially or fully obscured markers at predetermined locations within the vehicle;
determine the internal state of the vehicle prior to starting a trip based on visibility of the identified markers;
determine whether a passenger in the vehicle indicated by the internal state is a minor or a child; and
when the passenger is determined to be a minor or a child, perform at least one of:
generate a notification requesting that additional information or physical action be provided; or
control the vehicle to respond to the internal state of the vehicle.

17. The apparatus of claim 16 , wherein the apparatus is comprised by the vehicle.

18. The apparatus of claim 16 , wherein the vehicle is an autonomous vehicle.

19. The apparatus of claim 16 , wherein the additional information or physical action is provided by an account holder that arranged the trip.

20. The apparatus of claim 16 , wherein the one or more processors are further configured to send the notification to a client computing device.

21. The apparatus of claim 20 , wherein the one or more processors are further configured to receive a response to the notification from the client computing device.

22. The apparatus of claim 16 , wherein the notification is an audible notification played inside the vehicle.

23. The apparatus of claim 16 , wherein the one or more processors are further configured to control the vehicle to turn off an airbag adjacent to where the minor or child is sitting in the vehicle.

24. The apparatus of claim 16 , wherein the one or more processors are further configured to control the Vehicle to delay the starting of the trip or pausing the trip.

25. The apparatus of claim 16 , wherein the one or more processors are further configured to send an image of an interior of the vehicle generated by the one or more cameras to a client computing device.

26. The apparatus of claim 16 , wherein the internal state indicates one or more physical characteristics of the passenger.

27. The apparatus of claim 16 , wherein the one or more processors are further configured to:
receive an image of an interior of the vehicle captured by the one or more cameras; and
process the image.

Assignees

• Waymo Llc

Inventors

• Wendel Andreas
• Ludwick Christopher Kennedy
• Feenstra Laurens Andreas

Classifications

• B60W60/00253

  Taxi operations · CPC title

• B60W2540/01

  Occupants other than the driver · CPC title

• B60W2540/049

  Number of occupants · CPC title

• B60N2/002

  Seats provided with an occupancy detection means mounted therein or thereon (detection means responsive to presence or absence of children B60N2/266) · CPC title

• B60N2210/18

  Infrared · CPC title