System and methods for assessing the interior of an autonomous vehicle

Patent metadata

Field	Value
Publication number	US-10479328-B2
Application number	US-201615343726-A
Country	US
Kind code	B2
Filing date	Nov 4, 2016
Priority date	Nov 4, 2016
Publication date	Nov 19, 2019
Grant date	Nov 19, 2019

Abstract

An autonomous vehicle includes interior sensors including a camera, IR camera, electro-chemical sensor, humidity sensor, and temperature sensor. Initial and final outputs of these sensors are captured for a trip conveying one or more passengers. If changes in the outputs of the sensors are detected, whether the final outputs of the sensors are acceptable may be evaluated. In some embodiments, an aggregation of the outputs is evaluated and found unacceptable even where individual outputs are acceptable. Outputs may be presented to a dispatcher to confirm that the outputs are unacceptable. If the outputs are found to be unacceptable, the vehicle may be autonomously driven to a cleaning station. Personal items may be identified in camera outputs and alerts generated in response.

First claim

The invention claimed is:

1. A system for a vehicle comprising:
a plurality of sensors each sensing a different property of an interior of the vehicle, the plurality of sensors including all of a visible light camera, an infrared (IR) camera, and an electrochemical sensor;
a controller coupled to the plurality of interior sensors and programmed to—
receive a first output for each sensor of the plurality of sensors;
receive a second output for each sensor of the plurality of sensors after receiving the first output for each sensor of the plurality of sensors;
for each sensor of the plurality of sensors—
calculate a change value that is a change between the first output and the second output for the each sensor; and
when the change value meets a threshold condition corresponding to the each sensor, invoke cleaning of the interior;

calculate an aggregate change as one of a sum and a weighted sum of the change values for the plurality of sensors;
compare the aggregate change to an aggregate threshold condition; and
when the aggregate change between the first outputs and the second outputs exceeds the aggregate threshold condition and the change value for each of the sensors of the plurality of sensors does not meet the threshold corresponding to the each sensor, invoke cleaning of the interior.

2. The system of claim 1 , wherein the plurality of sensors include a humidity sensor.

3. The system of claim 2 , wherein the controller is further programmed to, if the change between the first and second outputs of at least one of the electro-chemical sensor and humidity sensor meet a corresponding threshold conditions:
activate a ventilation system of the vehicle;
again measure outputs of the at least one of the electro-chemical sensor and humidity sensor; and
if the outputs of the at least one of the electro-chemical sensor and humidity sensor still meet the corresponding threshold conditions, invoking cleaning of the interior.

4. The system of claim 2 , wherein the controller is programmed to determine if the aggregate change between the second outputs and the first outputs meets the threshold condition by inputting the first outputs and second outputs into a machine learning model.

5. The system of claim 1 , wherein the controller is programmed to invoke cleaning of the interior comprises autonomously driving the vehicle to a cleaning station.

6. The system of claim 5 , wherein the controller is programmed to, if an aggregate change between the second outputs and the first outputs does not meet a threshold condition, autonomously driving the vehicle to a pick up location without first autonomously driving the vehicle to any cleaning station.

7. A method for evaluating a vehicle, the method comprising:
providing a plurality of sensors each sensing a different property of an interior of the vehicle, the plurality of sensors including all of a visible light camera, an infrared (IR) camera, and an electrochemical sensor;
receiving, by a controller coupled to the plurality of interior sensors, first outputs from the plurality of interior sensors;
receiving, by the controller, second outputs from the plurality of sensors after a trip in the vehicle by a passenger subsequent to receiving the first outputs;
calculating, by the controller, for each sensor of the plurality of sensors, a change value that is a change between the first output and the second output for the each sensor;
calculating, by the controller, an aggregate change as a weighted sum of the change values for the plurality of sensors;
comparing the aggregate change to a threshold condition;
determining, by the controller, that the aggregate change exceeds the threshold condition;
in response to determining that the aggregate change between the second outputs and the first outputs exceeds the threshold condition invoking, by the controller, cleaning of the interior.

8. The method of claim 7 , wherein the plurality of sensors include a humidity sensor.

9. The method of claim 8 , wherein the threshold condition is a first threshold condition;
wherein the method further comprises:
receiving, by the controller, third outputs of the plurality of sensors;
receiving, by the controller, fourth outputs of the plurality of sensors after receiving the third outputs;
determining, by the controller, that a change between the third and fourth outputs of any one of the camera, IR camera, electro-chemical sensor, and humidity sensor meets a corresponding threshold condition;
in response to determining that the change between the third and fourth outputs of any one of the camera, IR camera, electro-chemical sensor, and humidity sensor meets the corresponding threshold condition, invoking, by the controller, cleaning of the interior.

10. The method of claim 8 , further comprising:
determining outputs of at least one of the electro-chemical sensor and humidity sensor meet a corresponding threshold conditions;
in response to determining that outputs of at least one of the electro-chemical sensor and humidity sensor meets the corresponding threshold condition—
activating, by the controller, a ventilation system of the vehicle;
again measuring, by the controller, the outputs of the at least one of the electro-chemical sensor and humidity sensor; and
determining, by the controller, that the outputs of the at least one of the electro-chemical sensor and humidity sensor still meet the corresponding threshold conditions; and
in response to determining that the outputs of the at least one of the electro-chemical sensor and humidity sensor still meet the corresponding threshold conditions, invoking cleaning of the interior.

11. The method of claim 8 , further comprising determining that the aggregate change between the second outputs and the first outputs meets the threshold condition by inputting the first outputs and second outputs into a machine learning model.

12. The method of claim 7 , wherein invoking cleaning of the interior comprises autonomously driving the vehicle to a cleaning station.

13. The method of claim 12 , further comprising:
receiving, by the controller, third outputs of the plurality of sensors;
receiving, by the controller, fourth outputs of the plurality of sensors after receiving the third outputs;
determining, by the controller, that an aggregate change between the third outputs and the fourth outputs does not meet the threshold condition; and
in response to determining that the aggregate change between the third outputs and the fourth outputs does not meet the threshold condition, autonomously driving, by the controller, the vehicle to a pick up location without driving the vehicle to any cleaning station.

Assignees

• Ford Global Tech Llc

Inventors

• Reibling Michael E
• Chraim Ramzi Ahmad
• Cyr Steven Michael
• Siciak Ray C

Classifications

• B60W50/0098 Primary

  Details of control systems ensuring comfort, safety or stability not otherwise provided for · CPC title

• B60W10/00

  Conjoint control of vehicle sub-units of different type or different function (for propulsion of purely electrically-propelled vehicles with power supplied within the vehicle B60L50/00 - B60L58/00) · CPC title

• B60S1/64 Primary

  for cleaning vehicle interiors, e.g. built-in vacuum cleaners · CPC title

• B60S1/56

  specially adapted for cleaning other parts or devices than front windows or windscreens {(rear-view mirror arrangements mounted on vehicle exterior including cleaning devices B60R1/0602)} · CPC title

• G06Q10/20

  Administration of product repair or maintenance · CPC title