Systems and methods for pedestrian guidance via augmented reality

Patent metadata

Field	Value
Publication number	US-2024053162-A1
Application number	US-202217962160-A
Country	US
Kind code	A1
Filing date	Oct 7, 2022
Priority date	Aug 12, 2022
Publication date	Feb 15, 2024
Grant date	—

Abstract

The following generally relates to using Augmented Reality (AR) to enhance pedestrian navigation. In some examples, AR techniques are applied to provide AR indications of a location of a group member that includes two or more AR devices. In these examples, AR techniques may be applied to determine a relative position of the group member and/or provide navigational guidance to the group member. In other examples, AR techniques are applied to provide AR-assisted pedestrian guidance. In these examples, AR techniques may be applied to present an AR display that includes information for a point of interest along a route.

First claim

What is claimed:

1 . A computer-implemented method for Augmented Reality (AR) assisted pedestrian guidance, the method comprising:
obtaining, via one or more processors of an AR device, route information for a route to be traversed by a pedestrian wearing an AR viewer paired with the AR device; determining, via the one or more processors, a field of view of the AR viewer; identifying, via the one or more processors, a point of interest (POI) related to the route within the field of view of the AR viewer; and based upon the field of view, presenting, via the one or more processors, an AR display that includes an AR indication related to the POI.

2 . The computer-implemented method of claim 1 , wherein obtaining the route information comprises:
obtaining, via the one or more processors, route information from a navigation application executing on the AR device.

3 . The computer-implemented method of claim 2 , wherein:
at least one of a personal electronic device or an on-board system of a vehicle is executing a navigation application configured to assist the pedestrian for in-vehicle navigation via the vehicle; and wherein obtaining the route information comprises:
detecting, via the one or more processors, that the pedestrian has egressed the vehicle; and
causing, via the one or more processors, the navigation application executing on the AR device to provide navigational instructions for the route via the AR viewer.

4 . The computer-implemented method of claim 3 , wherein:
the AR device is the personal electronic device; and providing the navigational instructions comprises:
switching, via the one or more processors, an output device from a display of the personal electronic device to the AR viewer.

5 . The computer-implemented method of claim 1 , wherein determining the field of view of the AR viewer comprises:
obtaining, from an image sensor coupled to the AR viewer, set of image data of an environment included within the field of view.

6 . The computer-implemented method of claim 5 , wherein identifying the POI comprises:
identifying, via the one or more processors, a point of interest associated with a navigational instruction along the route.

7 . The computer-implemented method of claim 6 , wherein presenting the AR display comprises:
presenting, via the one or more processors, an indication of the navigational instruction proximate to a location of the POI.

8 . The computer-implemented method of claim 5 , wherein identifying the POI comprises:
identifying, via the one or more processors, a POI along a tour route.

9 . The computer-implemented method of claim 8 , wherein presenting the AR display comprises:
accessing, via the one or more processors, a POI database to obtain content related to the POI; and presenting, via the one or more processors, an indication of the obtained content via the AR display.

10 . The computer-implemented method of claim 5 , wherein identifying the POI comprises:
analyzing, via the one or more processors, the set of image data to identify a POI associated with low lighting.

11 . The computer-implemented method of claim 10 , wherein presenting the AR display comprises:
accessing, via the one or more processors, a POI database to image data of the POI captured during daytime; and overlaying, via the one or more processors, the image data on the POI via the AR display.

12 . The computer-implemented method of claim 5 , further comprising:
analyzing, via the one or more processors, the set of image data to identify that a portion of the route is associated with low lighting; analyzing, via the one or more processors, the set of image data to identify an alternate pathway associated with higher lighting conditions; and generating, via the one or more processors, an alternate route that traverses the alternate pathway.

13 . A system for Augmented Reality (AR) assisted pedestrian guidance via an AR device, the system comprising:
one or more processors; and one or more non-transitory memories storing processor-executable instructions that, when executed by the one or more processors, cause the system to:
obtain route information for a route to be traversed by a pedestrian wearing an AR viewer paired with the AR device;
determine a field of view of the AR viewer;
identify a point of interest (POI) related to the route within the field of view of the AR viewer; and
based upon the field of view, present an AR display that includes an AR indication related to the POI.

14 . The system of claim 1 , wherein obtaining the route information comprises:
obtain route information from a navigation application executing on the AR device.

15 . The system of claim 14 , wherein:
at least one of a personal electronic device or an on-board system of a vehicle is executing a navigation application configured to assist the pedestrian for in-vehicle navigation via the vehicle; and wherein to obtain the route information, the instructions, when executed, cause the system to:
detect that the pedestrian has egressed the vehicle; and
cause the navigation application executing on the AR device to provide navigational instructions for the route via the AR viewer.

16 . The system of claim 13 , wherein to determine the field of view of the AR viewer, the instructions, when executed, cause the system to:
obtain, from an image sensor coupled to the AR viewer, set of image data of an environment included within the field of view.

17 . The system of claim 16 , wherein to identify the POI, the instructions, when executed, cause the system to:
identify a point of interest associated with a navigational instruction along the route.

18 . The system of claim 16 , wherein to identify the POI, the instructions, when executed, cause the system to:
identify a POI along a tour route.

19 . The system of claim 18 , wherein to present the AR display, the instructions, when executed, cause the system to:
access a POI database to obtain content related to the POI; and present an indication of the obtained content via the AR display.

20 . The system of claim 16 , wherein the instructions, when executed, cause the system to:
analyze the set of image data to identify that a portion of the route is associated with low lighting; analyze the set of image data to identify an alternate pathway associated with higher lighting conditions; and generate an alternate route that traverses the alternate pathway.

21 . A non-transitory computer-readable storage medium storing computer-executable instructions that when executed by one or more processors of an Augmented Reality (AR) device, cause the one or more processors to:
obtain route information for a route to be traversed by a pedestrian wearing an AR viewer paired with the AR device; determine a field of view of the AR viewer; identify a point of interest (POI) related to the route within the field of view of the AR viewer; and based upon the field of view, present an AR display that includes an AR indication related to the POI.

Assignees

• State Farm Mutual Automobile Insurance Co

Inventors

• Fields Brian M
• Tofte Nathan L
• Williams Aaron C
• Harr Joseph P
• King Vicki

Classifications

• H04B10/116

  Visible light communication · CPC title

• G01C21/365 Primary

  Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself · CPC title

• G01C21/3476

  using point of interest [POI] information, e.g. a route passing visible POIs · CPC title

• G01C21/3682

  output of POI information on a road map (G01C21/3614, G01C21/3685 take precedence) · CPC title

• G01C21/3602

  Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera · CPC title