System and method for surveillance

Patent metadata

Field	Value
Publication number	US-11891090-B2
Application number	US-202217682346-A
Country	US
Kind code	B2
Filing date	Feb 28, 2022
Priority date	Oct 16, 2019
Publication date	Feb 6, 2024
Grant date	Feb 6, 2024

Abstract

Provided herein is a system and method implemented on a vehicle. The system comprises one or more sensors, one or more processors, and a memory storing instructions that, when executed by the one or more processors, causes the system to perform: obtaining data from the one or more sensors; comparing the obtained data from the one or more sensors with reference data; determining whether one or more characteristics of the obtained data deviate from corresponding characteristics of the reference data by more than a respective threshold; in response to determining that one or more characteristics of the data obtained deviate from corresponding characteristics of the reference data by more than a respective threshold, determining an action of the vehicle based on amounts of the one or more deviations; and performing the determined action.

First claim

What is claimed is:

1. A system comprising:
one or more sensors;
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, causes the system to perform:
when a vehicle is in an inactive status, obtaining first data from first sensors associated with the vehicle, and from one or more second sensors associated with a different vehicle, wherein the first sensors comprise a first portion of sensors associated with the vehicle that are active when the vehicle is in the inactive status, the sensors comprising a Lidar, an ultrasonic sensor, a radar sensor, a camera, a global positioning system (GPS), and an inertial measurement unit (IMU);
comparing the obtained first data from the first sensors with reference data;
determining whether one or more first characteristics of the obtained first data deviate from corresponding characteristics of the reference data by more than respective first thresholds;
in response to determining that one or more characteristics of the data obtained deviate from corresponding characteristics of the reference data by more than respective first thresholds:
activating a second portion of the sensors that were previously inactive on the vehicle when the vehicle is in the inactive status;
increasing a sampling rate of the first sensors; and
obtaining second data from the second portion of the sensors and the first sensors:

determining whether to evacuate a vehicle based on amounts by which second characteristics of the second data deviate from the corresponding characteristics of the reference data; and
in response to determining to evacuate the vehicle:
determining a mode of evacuation of the vehicle and determining an evacuation location from evacuation locations; and
evacuating the vehicle based on the determined mode and the evacuation location.

2. The system of claim 1 , wherein the obtaining of data additionally comprises determining an air quality index (AQI) within the threshold radius of the vehicle; and the determination of whether to evacuate the vehicle is additionally based on the AQI.

3. The system of claim 1 , wherein the obtaining of data additionally comprises determining objects carried by persons at a current location and respective levels of danger of the objects; and the determination of whether to evacuate the vehicle is additionally based on the levels of danger of the objects carried by the persons.

4. The system of claim 1 , wherein the obtaining of data additionally comprises determining whether a natural disaster is arising within the threshold radius, the natural disaster comprising a fire or a flooding; and
the determination of whether to evacuate the vehicle is additionally based on the determination of whether a natural disaster is arising.

5. The system of claim 4 , wherein the determination of whether a natural disaster is arising is based on a temperature gradient.

6. The system of claim 1 , wherein:
the data is indicative of an instantaneous density of other vehicles within a threshold radius of the vehicle;
the comparing of the obtained data comprises comparing the instantaneous density to a baseline level of a density of vehicles; and
the determination of whether of evacuate is in response to determining that the instantaneous density of other vehicles deviates from the baseline level by more than a threshold amount.

7. The system of claim 1 , wherein:
the data is indicative of a particulate concentration or a smoke concentration within a threshold radius of the vehicle;
the comparing of the obtained data comprises comparing the particulate concentration or the smoke concentration to a baseline level of a particulate concentration or a smoke concentration; and
the determination of whether of evacuate is in response to determining that the particulate concentration or the smoke concentration deviates from the baseline level by more than a threshold amount.

8. The system of claim 1 , wherein the instructions further cause the system to perform:
determining one or more velocities at which one or more persons are travelling towards the vehicle; and
the determination of whether of evacuate is based on the one or more velocities.

9. A method implemented by a computing system including one or more processors and storage media storing machine-readable instructions, wherein the method is performed using the one or more processors, the method comprising:
when a vehicle is in an inactive status, obtaining first data from first sensors associated with the vehicle, and from one or more second sensors associated with a different vehicle, wherein the first sensors comprise a first portion of sensors associated with the vehicle that are active when the vehicle is in the inactive status, the sensors comprising a Lidar, an ultrasonic sensor, a radar sensor, a camera, a global positioning system (GPS), and an inertial measurement unit (IMU);
comparing the obtained first data from the first sensors with reference data;
determining whether one or more first characteristics of the obtained first data deviate from corresponding characteristics of the reference data by more than respective first thresholds;
in response to determining that one or more characteristics of the data obtained deviate from corresponding characteristics of the reference data by more than respective first thresholds:
activating a second portion of the sensors that were previously inactive on the vehicle when the vehicle is in the inactive status;
increasing a sampling rate of the first sensors; and
obtaining second data from the second portion of the sensors and the first sensors;

determining whether to evacuate a vehicle based on amounts by which second characteristics of the second data deviate from the corresponding characteristics of the reference data; and
in response to determining to evacuate the vehicle:
determining a mode of evacuation of the vehicle and determining an evacuation location from evacuation locations; and
evacuating the vehicle based on the determined mode and the evacuation location.

10. The method of claim 9 , wherein the obtaining of data additionally comprises determining an air quality index (AQI) within the threshold radius of the vehicle; and the determination of whether to evacuate the vehicle is additionally based on the AQI.

11. The method of claim 9 , wherein the obtaining of data additionally comprises determining objects carried by persons at a current location and respective levels of danger of the objects; and the determination of whether to evacuate the vehicle is additionally based on the levels of danger of the objects carried by the persons.

12. The method of claim 9 , wherein:
the obtaining of data additionally comprises determining whether a natural disaster is arising within the threshold radius, the natural disaster comprising a fire or a flooding; and
the determination of whether to evacuate the vehicle is additionally based on the determination of whether a natural disaster is arising.

13. The method of claim 12 , wherein the determination of whether a natural disaster is arising is based on a temperature gradient.

14. The method of claim 9 , wherein:
the data is indicative of a particulate concentration or a smoke concentration within a threshold radius of the vehicle;
the comparing of the obtained data comprises comparing the particulate concentration or the smoke concentration to a baseline level of a particulate concentration or a smoke concentration; and
the determination of whether of evacuate is in response to determining that the particulate concentration or the smoke c

Assignees

• Pony Ai Inc

Inventors

• Dingli Robert

Classifications

• B60W60/0015 Primary

  specially adapted for safety · CPC title

• B60Q1/509

  specific to unauthorised use, e.g. for indicating stolen vehicles or infringements of traffic rules · CPC title

• B60Q1/545

  for indicating other traffic conditions, e.g. fog, heavy traffic · CPC title

• G05D1/0088

  characterized by the autonomous decision making process, e.g. artificial intelligence, predefined behaviours (using knowledge based models G06N5/00) · CPC title

• G05D1/0214

  in accordance with safety or protection criteria, e.g. avoiding hazardous areas (monitoring the location of vehicles within a certain area, e.g. forbidden or allowed areas, in traffic control systems for road vehicles G08G1/13) · CPC title