Systems and methods for pedestrian guidance via augmented reality

Patent metadata

Field	Value
Publication number	US-12347191-B2
Application number	US-202217962160-A
Country	US
Kind code	B2
Filing date	Oct 7, 2022
Priority date	Aug 12, 2022
Publication date	Jul 1, 2025
Grant date	Jul 1, 2025

Abstract

The following generally relates to using Augmented Reality (AR) to enhance pedestrian navigation. In some examples, AR techniques are applied to provide AR indications of a location of a group member that includes two or more AR devices. In these examples, AR techniques may be applied to determine a relative position of the group member and/or provide navigational guidance to the group member. In other examples, AR techniques are applied to provide AR-assisted pedestrian guidance. In these examples, AR techniques may be applied to present an AR display that includes information for a point of interest along a route.

First claim

What is claimed:

1. A computer-implemented method for Augmented (AR) assisted pedestrian guidance, the computer implemented method comprising:
obtaining, via one or more processors of an AR device, route information for a route to be traveled by a pedestrian wearing an AR viewer paired with the AR device, wherein the route information is obtained from a navigation application executing on the AR device;
detecting, via the one or more processors, that the pedestrian has egressed a vehicle;
in response to the detecting, via the one or more processors, causing the navigation application executing on the AR device to provide navigational instructions for the route via the AR viewer;
determining, via the one or more processors, a field of view of the AR viewer;
identifying, via the one or more processors, a point of interest (POI) related to the route within the field of view of the AR viewer, wherein the POI is a non-virtual object or location; and
based upon the field of view, presenting, via the one or more processors, an AR display that includes an AR indication related to the POI.

2. The computer-implemented method of claim 1 , wherein:
at least one of a personal electronic device or an on-board system of the vehicle is executing a navigation application configured to assist the pedestrian for in-vehicle navigation via the vehicle.

3. The computer-implemented method of claim 2 , wherein:
the AR device is the personal electronic device; and
providing the navigational instructions comprises:
switching, via the one or more processors, an output device from a display of the personal electronic device to the AR viewer.

4. The computer-implemented method of claim 1 , wherein determining the field of view of the AR viewer comprises:
obtaining, from an image sensor coupled to the AR viewer, set of image data of an environment included within the field of view.

5. The computer-implemented method of claim 4 , wherein identifying the POI comprises:
identifying, via the one or more processors, a point of interest associated with a navigational instruction along the route.

6. The computer-implemented method of claim 5 , wherein presenting the AR display comprises:
presenting, via the one or more processors, an indication of the navigational instruction proximate to a location of the POI.

7. The computer-implemented method of claim 4 , wherein identifying the POI comprises:
identifying, via the one or more processors, a POI along a tour route.

8. The computer-implemented method of claim 7 , wherein presenting the AR display comprises:
accessing, via the one or more processors, a POI database to obtain content related to the POI; and
presenting, via the one or more processors, an indication of the obtained content via the AR display.

9. The computer-implemented method of claim 4 , wherein identifying the POI comprises:
analyzing, via the one or more processors, the set of image data to identify a POI associated with low lighting.

10. The computer-implemented method of claim 9 , wherein presenting the AR display comprises:
accessing, via the one or more processors, a POI database to image data of the POI captured during daytime; and
overlaying, via the one or more processors, the image data on the POI via the AR display.

11. The computer-implemented method of claim 4 , further comprising:
analyzing, via the one or more processors, the set of image data to identify that a portion of the route is associated with low lighting;
analyzing, via the one or more processors, the set of image data to identify an alternate pathway associated with higher lighting conditions; and
generating, via the one or more processors, an alternate route that traverses the alternate pathway.

12. A system for Augmented Reality (AR) assisted pedestrian guidance via an AR device, the system comprising:
one or more processors; and
one or more non-transitory memories storing processor-executable instructions that, when executed by the one or more processors, cause the system to:
obtain route information for a route to be traversed by a pedestrian wearing an AR viewer paired with the AR device, wherein the route information is obtained from a navigation application executing on the AR device;
detecting that the pedestrian has egressed a vehicle;
in response to the detecting, cause the navigation application executing on the AR device to provide navigational instructions for the route via the AR viewer;
determine a field of view of the AR viewer;
identify a point of interest (POI) related to the route within the field of view of the AR viewer, wherein the POI is a non-virtual object or location; and
based upon the field of view, present an AR display that includes an AR indication related to the POI.

13. The system of claim 12 , wherein:
at least one of a personal electronic device or an on-board system of the vehicle is executing a navigation application configured to assist the pedestrian for in-vehicle navigation via the vehicle.

14. The system of claim 13 , wherein:
the AR device is the personal electronic device; and
to provide the navigational instructions, the instructions, when executed, cause the system to:
switch an output device from a display of the personal electronic device to the AR viewer.

15. The system of claim 12 , wherein to determine the field of view of the AR viewer, the instructions, when executed, cause the system to:
obtain, from an image sensor coupled to the AR viewer, set of image data of an environment included within the field of view.

16. The system of claim 15 , wherein to identify the POI, the instructions, when executed, cause the system to:
identify a point of interest associated with a navigational instruction along the route.

17. The system of claim 15 , wherein to identify the POI, the instructions, when executed, cause the system to:
identify a POI along a tour route.

18. The system of claim 17 , wherein to present the AR display, the instructions, when executed, cause the system to:
access a POI database to obtain content related to the POI; and
present an indication of the obtained content via the AR display.

19. The system of claim 15 , wherein the instructions, when executed, cause the system to:
analyze the set of image data to identify that a portion of the route is associated with low lighting;
analyze the set of image data to identify an alternate pathway associated with higher lighting conditions; and
generate an alternate route that traverses the alternate pathway.

20. The system of claim 15 , wherein to identify the POI, the instructions, when executed, cause the system to:
analyze the set of image data to identify a POI associated with low lighting.

21. A non-transitory computer-readable storage medium storing computer-executable instructions that when executed by one or more processors of an Augmented Reality (AR) device, cause the one or more processors to:
obtain route information for a route to be traversed by a pedestrian wearing an AR viewer paired with the AR device, wherein the route information is obtained from a navigation application executing on the AR device;
detecting that the pedestrian has egressed a vehicle;
in response to the detecting, cause the navigation application executing on the AR device to provide navigational instructions for the route via the AR viewer;
determine a field of view of the AR viewer;
identify a point of interest (POI) related to the route within the field of view of

Assignees

• State Farm Mutual Automobile Insurance Co

Inventors

• Fields Brian M
• Tofte Nathan L
• Williams Aaron C
• Harr Joseph P
• King Vicki

Classifications

• G01C21/3682

  output of POI information on a road map (G01C21/3614, G01C21/3685 take precedence) · CPC title

• G01C21/365

  Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself · CPC title

• G01C21/3647

  Guidance involving output of stored or live camera images or video streams · CPC title

• G01C21/3602

  Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera · CPC title

• G01C21/3476

  using point of interest [POI] information, e.g. a route passing visible POIs · CPC title