Methods for interacting with autonomous or semi-autonomous vehicle

Patent metadata

Field	Value
Publication number	US-10328769-B2
Application number	US-201816048124-A
Country	US
Kind code	B2
Filing date	Jul 27, 2018
Priority date	Jul 28, 2017
Publication date	Jun 25, 2019
Grant date	Jun 25, 2019

Abstract

Provided herein is a system for precise delivery of an item to a consumer by an autonomous or semi-autonomous vehicle. The system performs image recognition algorithms to detect a primary entrance, navigate from a street address to the primary entrance, and to validate the customer upon delivery.

First claim

What is claimed is:

1. A system for direct fulfillment of an order to a customer, the system comprising:
a) an autonomous or semi-autonomous vehicle comprising:
(i) a compartment having a compartment door, wherein the compartment is configured to secure an item associated with the order;
(ii) a compartment actuator configured to open and close the compartment door;
(iii) an autonomous or semi-autonomous propulsion system; and
(iv) one or more sensors configured to measure:
i) a specific area data corresponding to a customer address associated with the order; and
ii) a compartment status of the compartment, wherein the compartment status comprises at least one of an opened compartment status, a closed compartment status, an object blocking compartment status, a customer blocking compartment status, and an unblocked compartment status; and

b) the system further comprising a processor configured to provide a fulfillment application comprising:
(i) a communication module receiving at least one of the specific area data and the compartment status;
(ii) a navigation module directing the autonomous or semi-autonomous propulsion system of the autonomous or semi-autonomous vehicle to the customer address; and
(iii) a compartment door control module selecting and implementing a compartment door instruction, wherein the compartment door instruction comprises an open compartment door instruction or a close compartment door instruction based on the compartment status, the compartment door control module further selecting and implementing a pause compartment door instruction for a set waiting period if the compartment status comprises the blocked compartment status, the compartment door control module further selecting and implementing the pause compartment door instruction if the compartment status comprises the blocked compartment status while the compartment door is being closed, and the compartment door control module further selecting and implementing the close compartment door instruction once the compartment status comprises the unblocked compartment status; and

c) a mobile processor associated with the customer and configured to provide a customer application.

2. The system of claim 1 , wherein the fulfillment application further comprises a direct delivery module applying an object recognition algorithm to determine a primary entrance location based on the specific area data, and wherein the navigation module further directing the autonomous or semi-autonomous propulsion system of the autonomous or semi-autonomous vehicle from the customer address to the primary entrance location.

3. The system of claim 1 , wherein the one or more sensors comprise a RADAR, a LiDAR, a camera, a video camera, a proximity sensor, a contact sensor, a light sensor, an infrared sensor, a switch, or any combination thereof.

4. The system of claim 1 , wherein the specific area data comprises a three-dimensional spatial data.

5. The system of claim 2 , wherein the primary entrance location comprises at least one of a door, an entranceway, a pathway, a garage door, a gate, an atrium, a foyer, a gateway, and a driveway.

6. The system of claim 2 , wherein the customer application comprises a primary entrance selection module receiving the primary entrance location from the customer, wherein the customer submits the primary entrance location to the primary entrance selection module by selecting a pinpoint location on a map, and wherein the fulfillment application further comprises a customer preference database module storing the pinpoint location.

7. The system of claim 6 , wherein the map comprises a satellite image map.

8. The system of claim 1 , wherein the fulfillment application further comprises a photo module receiving an image of the customer, wherein the one or more sensors are further configured to measure a facial feature of the order recipient, and wherein the communication module further receives the facial feature, wherein the fulfillment application further comprises a facial recognition module applying a facial recognition algorithm to the facial feature of the order recipient and the image of the customer to confirm that the order recipient corresponds to the customer, wherein the compartment door control module selects and implements the compartment door instruction based on the confirmation, and wherein the customer application comprises a customer image input module capturing the image of the customer, transmitting the image of the customer to the photo module, and saving the image of the customer.

9. The system of claim 8 , wherein the image of the customer comprises a photograph of the customer, a photograph of an identification card associated with the customer, or both.

10. The system of claim 1 , wherein the fulfillment application further comprises a live identification card authentication module capturing a live image of an identification card of the order recipient, applying an identification card and text recognition algorithm to confirm that the identification card of the order recipient corresponds to the customer.

11. The system of claim 1 , wherein the communication module further receives an access authentication, and wherein the compartment door control module further or alternatively directs the compartment actuator to open the compartment door based on the access authentication.

12. The system of claim 11 , wherein the autonomous or semi-autonomous vehicle further comprises a customer interface configured to receive a passcode and transmit the access authentication to the communication module based on the passcode.

13. The system of claim 12 , wherein the fulfillment application further comprises a passcode module generating the passcode, submitting the passcode to the customer, and authenticating the received password.

14. The system of claim 1 , wherein the customer application comprises a compartment activation module receiving a compartment activation request from the customer, an administrator, or both to open or close the compartment door, and transmitting the compartment activation request to the compartment door control module based on the compartment activation request.

15. The system of claim 14 , wherein the compartment activation module further receives a current location of the customer and a current location of the vehicle, and wherein the compartment door control module directs the compartment actuator to open the compartment door based on the compartment activation request only when the current location of the customer is within a set proximity distance from the current location of the vehicle.

16. The system of claim 1 , wherein each vehicle further comprises a vehicle identification module configured to direct a vehicle indicator aboard the vehicle to emit a vehicle identification media, wherein the fulfillment application further comprises an indicator activation module transmitting an indicator activation instruction to the vehicle identification module, and wherein the indicator activation instruction comprises an identification pattern, wherein the identification pattern is associated with the order, the customer, the vehicle, or any combination thereof, wherein the vehicle identification media comprises the identification pattern, and wherein the customer application comprises an identification pattern display module receiving the identification pattern and displaying the identification pattern to the customer.

17. The system of claim 16 , wherein the vehicle indicator comprises a light, a display screen, a speaker, a car horn, or any combination there

Assignees

• Nuro Inc

Inventors

• Ferguson David
• Zhu Jiajun
• Ransohoff Nan

Classifications

• G01C21/343

  Calculating itineraries (travelling salesman problem G06Q10/04; optimisation of routes G06Q10/047) · CPC title

• G06N20/00

  Machine learning · CPC title

• G06Q10/08

  Logistics, e.g. warehousing, loading or distribution; Inventory or stock management · CPC title

• G01C21/3438

  Rendezvous; Ride sharing · CPC title

• B60R2021/346

  means outside vehicle body · CPC title