Augmented reality detection for locating autonomous vehicles

Patent metadata

Field	Value
Publication number	US-11263787-B2
Application number	US-202016810652-A
Country	US
Kind code	B2
Filing date	Mar 5, 2020
Priority date	Mar 5, 2020
Publication date	Mar 1, 2022
Grant date	Mar 1, 2022

Abstract

Disclosed embodiments include methods, systems, and non-transitory computer readable medium for augmented reality detection for locating a particular autonomous vehicle. In a non-limiting embodiment, an illustrative method includes providing, by an electronic device to a remote server, a request for an autonomous vehicle. A first signal indicating that the autonomous vehicle is within an accessible range to an intended passenger is received by an electronic device. The passenger is prompted by the electronic device to orient an image sensor of the electronic device towards a designated area of the accessible range. The designated area is imaged by the image sensor for the autonomous vehicle. A visual representation of the imaged designated area is generated on a graphical user interface of the electronic device. The autonomous vehicle is identified within the generated visual representation.

First claim

What is claimed is:

1. A method of augmented reality detection for locating a particular autonomous vehicle, the method comprising:
providing, by an application executing on an electronic device associated with an intended passenger and to a remote server, a request for an autonomous vehicle;
receiving, by the application, a first signal indicating that the autonomous vehicle is within an accessible range of the intended passenger;
prompting, by the application, the passenger to orient an image sensor of the electronic device towards a designated area of the accessible range;
upon receiving imaging data from the image sensor associated with the designated area for the autonomous vehicle, generating, by the remote server, a visual representation of the imaged designated area for presentation on a graphical user interface of the application executing on the electronic device;
determining, by the remote server and based on inertial data embedded in the received imaging data, an orientation of the electronic device;
causing, by the remote server, a second signal to be transmitted from the autonomous vehicle, the second signal being a line of sight signal transmitted by the autonomous vehicle for capture by the image sensor of the electronic device;
upon receiving an indication that the second signal has been captured by the image sensor of the electronic device, identifying, by the remote server, the autonomous vehicle within the generated visual representation; and
causing, by the remote server and within the graphical user interface of the application, a presentation of the autonomous vehicle to the identified within the generated visual representation.

2. The method of claim 1 , wherein the processing of the second signal includes recording an intensity of the second signal as a function of the scanning to identify a vector between the electronic device and the autonomous vehicle.

3. The method of claim 1 , further comprising:
receiving, by the autonomous vehicle, a global positioning signal from one or more satellites;
determining, by the autonomous vehicle, a position of the autonomous vehicle within about one meter via one or more of the global positioning signal, high definition maps loaded on the autonomous vehicle, scanned information obtained by the autonomous vehicle, or imaged information obtained by the autonomous vehicle; and
providing, by the autonomous vehicle, the designated area to the remote server or the application on the electronic device,
wherein the designated area includes the position and the application on the electronic device causes a display of the high definition maps on the electronic device.

4. The method of claim 1 , further comprising:
selecting, by the remote server, the autonomous vehicle from a pool of autonomous vehicles; and
providing, by the remote server, the request to the autonomous vehicle.

5. The method according to claim 1 , wherein causing the presentation of the autonomous vehicle to be identified within the generated visual representation includes the application causing, on a display of the electronic device, an indication highlighting the autonomous vehicle to be displayed by at least one of superimposing an image on the autonomous vehicle, highlighting the autonomous vehicle with a geometric annotation, and highlighting the autonomous vehicle with a color annotation.

6. The method of claim 1 , wherein the designated area includes an obstruction covering at least a portion of the autonomous vehicle.

7. The method of claim 1 , wherein the first signal includes a Wi-Fi signal, a Bluetooth signal, or a pulsating laser light.

8. The method of claim 1 , further comprising providing access to the autonomous vehicle for the passenger via an access button on the graphical user interface of the application displayed on the electronic device.

9. A system for locating autonomous vehicles, the system comprising:
a computer processing system; and a computer memory,
wherein the computer processing system is configured to execute steps including:
providing, by an application executing on an electronic device associated with an intended passenger and to a remote server, a request for an autonomous vehicle;
receiving, by the application, a first signal indicating that the autonomous vehicle is within an accessible range of the intended passenger;
prompting, by the application, the passenger to orient an image sensor of the electronic device towards a designated area of the accessible range;
upon receiving imaging data from the image sensor associated with the designated area for the autonomous vehicle, generating, by the electronic device, a visual representation of the imaged designated area on a graphical user interface of the electronic device;
determining, by the remote server and based on inertial data embedded in the received imaging data, an orientation of the electronic device;
causing, by the remote server, a second signal to be transmitted from the autonomous vehicle, the second signal being a line of sight signal transmitted by the autonomous vehicle for capture by the image sensor of the electronic device;
upon receiving an indication that the second signal has been captured by the image sensor of the electronic device, identifying, by the remote server, the autonomous vehicle within the generated visual representation; and
causing, by the remote server and within the graphical user interface of the application, a presentation of the autonomous vehicle to be identified within the generated visual representation.

10. The system of claim 9 , wherein the processing the second signal includes recording an intensity of the second signal as a function of the scanning to identify a vector between the electronic device and the autonomous vehicle.

11. The system of claim 9 , further comprising:
receiving, by the autonomous vehicle, a global positioning signal from one or more satellites;
determining, by the autonomous vehicle, a position of the autonomous vehicle within about one meter via one or more of the global positioning signal, high definition maps loaded on the autonomous vehicle, scanned information obtained by the autonomous vehicle, or imaged information obtained by the autonomous vehicle; and
providing, by the autonomous vehicle, the designated area to the remote server or the application on the electronic device,
wherein the designated area includes the position and the application on the electronic device causes a display of the high definition maps on the electronic device.

12. The system of claim 9 , further comprising:
selecting, by the remote server, the autonomous vehicle from a pool of autonomous vehicles; and
providing, by the remote server, the request to the autonomous vehicle.

13. The system according to claim 9 , wherein causing the presentation of the autonomous vehicle to be identified within the generated visual representation includes the application causing, on a display of the electronic device, an indication highlighting the autonomous vehicle to be displayed by at least one of superimposing an image on the autonomous vehicle, highlighting the autonomous vehicle with a geometric annotation, or highlighting the autonomous vehicle with a color annotation.

14. The system of claim 9 , wherein the designated area includes an obstruction covering at least a portion of the autonomous vehicle.

15. The system of claim 9 , wherein the first signal includes a WiFi signal, a Bluetooth signal, or a pulsating laser light.

16. The system of claim 9 , further comprising providing access to the autonomous vehicle

Assignees

• Rivian Ip Holdings Llc

Inventors

• Hortop Matthew
• Hunt Patrick
• Trelfa Lacey

Classifications

• H04N23/64

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• H04N23/631

  Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters · CPC title

• G06T11/00 Primary

  Two-dimensional [2D] image generation · CPC title

• G06F3/0488

  using a touch-screen or digitiser, e.g. input of commands through traced gestures · CPC title

• G06V2201/08

  Detecting or categorising vehicles · CPC title