Autonomous vehicle rider drop-off to destination experience

Patent metadata

Field	Value
Publication number	US-11488073-B2
Application number	US-201916457799-A
Country	US
Kind code	B2
Filing date	Jun 28, 2019
Priority date	Jun 28, 2019
Publication date	Nov 1, 2022
Grant date	Nov 1, 2022

Abstract

An example method for assisting autonomous vehicle (AV) riders reach their destination after drop-off can include navigating the AV to a drop-off location associated with a user in the AV, receiving sensor data from sensors associated with the AV, determining, based on the sensor data, an orientation of the user in the AV and a location of the AV relative to a final destination of the user, generating a recommendation for how to exit the AV at the drop-off location based on the orientation of the user in the AV and the location of the AV relative to the final destination of the user, and providing the recommendation via a display, a speaker, a light-emitting device, and/or a client device, the recommendation including a visual indication of an exit direction or an AV door to use to exit the AV, audio instructions for exiting the AV, and/or visual exit instructions.

First claim

What is claimed is:

1. A method comprising:
navigating an autonomous vehicle (AV) to a drop-off location associated with a user in the AV;
receiving sensor data from one or more sensors associated with the AV;
determining, based on the sensor data, an orientation of the user in the AV and a location of the AV relative to a final destination of the user;
generating a recommendation for how to exit the AV at the drop-off location based on the orientation of the user in the AV and the location of the AV relative to the final destination of the user; and
in response to the user exiting the AV, tracking the user outside of the AV based on additional sensor data obtained from one or more sensors.

2. The method of claim 1 , wherein determining the orientation of the user in the AV comprises determining a seating location of the user within the AV, and wherein the recommendation for how to exit the AV comprises an indication of which AV door to use to exit the AV.

3. The method of claim 1 , wherein the one or more sensors comprise at least one of a camera sensor, a light detection and ranging (LIDAR) sensor, a radar sensor, a seat sensor, a seat belt sensor, and a global positioning system (GPS) sensor.

4. The method of claim 1 , further comprising:
providing the recommendation via at least one of a display in the AV, a speaker in the AV, a light-emitting device in the AV, and the client device associated with the user, wherein the recommendation comprises at least one of a visual indication of an exit direction or an AV door to use to exit the AV, audio instructions for exiting the AV, and visual exit instructions rendered on the display.

5. The method of claim 1 , further comprising:
generating the wayfinding information comprising directions from the drop-off location to the final destination of the user.

6. The method of claim 5 , wherein the wayfinding information is based on at least one of the orientation of the user in the AV, the location of the AV relative to the final destination, and a current location of the user relative to the final destination.

7. The method of claim 5 , further comprising:
providing the wayfinding information via at least one of a display in the AV, a speaker in the AV, and the client device associated with the user, wherein the wayfinding information comprises at least one of an audio output comprising the directions from the drop-off location to the final destination, a graphical preview of a path from the drop-off location to the final destination, a digital map comprising the directions from the drop-off location to the final destination, and a street view of an area outside of the AV.

8. The method of claim 1 , further comprising:
determining that the user has exited the AV; and
sending wayfinding information to a client device associated with the user, the wayfinding information comprising at least one of directions from a current location of the user to the final destination of the user, a digital map comprising the directions from the current location of the user to the final destination, a graphical preview of a path from the current location of the user to the final destination, audio instructions for traveling from the current location of the user to the final destination, and a street view of an area outside of the AV.

9. The method of claim 8 , further comprising:
sending a wayfinding update to the client device associated with the user, the wayfinding update being based on a tracked location of the user, wherein the one or more sensors for tracking the user after exiting the AV comprises at least one of a camera sensor on an exterior of the AV, a radar sensor on the exterior of the AV, a LIDAR sensor on the exterior of the AV, and a GPS sensor integral to the client device associated with the user.

10. The method of claim 9 , wherein the wayfinding update comprises at least one of course correction instructions, updated navigating instructions associated with the tracked location of the user and the final destination, an alternate route to the final destination, and environment cues.

11. An autonomous vehicle comprising:
a mechanical system;
a motor control system in communication with the mechanical system;
one or more processors; and
memory comprising instructions stored thereon which, when executed by the one or more processors, cause the one or more processors to:
navigate the autonomous vehicle (AV) to a drop-off location associated with a user in the AV;
receive sensor data from one or more sensors associated with the AV;
determine, based on the sensor data, an orientation of the user in the AV and a location of the AV relative to a final destination of the user;
generate a user recommendation for how to exit the AV at the drop-off location based on the orientation of the user in the AV and the location of the AV relative to the final destination of the user; and
in response to the user exiting the vehicle, track the user outside of the AV based on additional sensor data obtained from one or more sensors.

12. The autonomous vehicle of claim 11 , wherein determining the orientation of the user in the AV comprises determining a seating location of the user within the AV, wherein the user recommendation for how to exit the AV comprises an indication of which AV door to use to exit the AV, and wherein the one or more sensors comprise at least one of a camera sensor, a light detection and ranging (LIDAR) sensor, a radar sensor, a seat sensor, a seat belt sensor, and a global positioning system (GPS) sensor.

13. The autonomous vehicle of claim 11 , wherein the memory comprises additional instructions which, when executed by the one or more processors, cause the one or more processors to:
provide the user recommendation via at least one of a display in the AV, a speaker in the AV, a light-emitting device in the AV, and the client device associated with the user, wherein the user recommendation comprises at least one of a visual indication of an exit direction or an AV door to use to exit the AV, audio instructions for exiting the AV, and visual exit instructions rendered on a display.

14. The autonomous vehicle of claim 11 , wherein the memory comprises additional instructions which, when executed by the one or more processors, cause the one or more processors to:
generate the wayfinding information comprising directions from the drop-off location to the final destination of the user, wherein the wayfinding information is based on at least one of the orientation of the user in the AV, the location of the AV relative to the final destination, and a current location of the user relative to the final destination.

15. The autonomous vehicle of claim 14 , wherein the memory comprises additional instructions which, when executed by the one or more processors, cause the one or more processors to:
provide the wayfinding information via at least one of a display in the AV, a speaker in the AV, and the client device associated with the user, wherein the wayfinding information comprises at least one of an audio output comprising the directions from the drop-off location to the final destination, a graphical preview of a path from the drop-off location to the final destination, a digital map comprising the directions from the drop-off location to the final destination, and a street view of an area outside of the AV.

16. The autonomous vehicle of claim 11 , wherein the memory comprises additional instructions which, when executed by the one or more processors, cause the one or more processors to:
determine that the user has exited the AV; and

Assignees

• Gm Cruise Holdings Llc

Inventors

• Leary Jessica
• Foy Theresa
• Phan Soleil
• Benisty Tal
• Engle Stephanie

Classifications

• G06Q10/02 Primary

  Reservations, e.g. for tickets, services or events · CPC title

• G01C21/3423 Primary

  Multimodal routing · CPC title

• G08G1/166

  for active traffic, e.g. moving vehicles, pedestrians, bikes · CPC title

• B60Q9/00

  Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 {, e.g. haptic signalling} · CPC title

• G01C21/3688

  Systems comprising multiple parts or multiple output devices (not client-server), e.g. detachable faceplates, key fobs or multiple output screens · CPC title