Systems and methods for finding group members via augmented reality

Patent metadata

Field	Value
Publication number	US-12154331-B2
Application number	US-202217962113-A
Country	US
Kind code	B2
Filing date	Oct 7, 2022
Priority date	Aug 12, 2022
Publication date	Nov 26, 2024
Grant date	Nov 26, 2024

Abstract

The following generally relates to using Augmented Reality (AR) to enhance pedestrian navigation. In some examples, AR techniques are applied to provide AR indications of a location of a group member that includes two or more AR devices. In these examples, AR techniques may be applied to determine a relative position of the group member and/or provide navigational guidance to the group member. In other examples, AR techniques are applied to provide AR-assisted pedestrian guidance. In these examples, AR techniques may be applied to present an AR display that includes information for a point of interest along a route.

First claim

What is claimed:

1. A computer-implemented method for finding group members via Augmented Reality (AR) paired with an AR viewer, the method comprising:
establishing, via one or more processors of an AR device, a group of AR devices that includes at least a second AR device;
obtaining, from an image sensor coupled to the AR viewer, a first set of image data of an environment included within a field of view of the image sensor;
obtaining, via the one or more processors, position data indicative of a location of the second AR device, wherein obtaining the position data comprises:
receiving, from the second AR device, a second set of image data generated by an image sensor coupled to a second AR viewer associated with the second AR device,
identifying, via the one or more processors, a point of interest (POI) included represented by both the first and second sets of image data, and
determining, via the one or more processors, a relative position of the second AR device by comparing at least one of a size of the POI, a perspective of the POI, and a position of the POI between the first and second sets of image data;

determining, via the one or more processors, a field of view of the AR viewer; and
based upon the location of the second AR device and the field of view of the AR viewer, presenting, via the one or more processors, an indication of the second AR device via the AR viewer.

2. The computer-implemented method of claim 1 , wherein obtaining the position data comprises:
obtaining, via the one or more processors, data generated by a position sensor of the second AR device.

3. The computer-implemented method of claim 1 , wherein obtaining the position data comprises:
detecting, via a photodetector paired with the AR viewer, light emitted by the second AR device.

4. The computer-implemented method of claim 3 , wherein:
the light emitted by the second AR device encodes an identifier associated with at least one of the second AR device or the group of AR devices; and
the method further comprises decoding the light emitted by the second AR device to derive the identifier.

5. The computer-implemented method of claim 3 , wherein the second AR device is an electronic device associated with a vehicle.

6. The computer-implemented method of claim 3 , wherein the second AR device is a personal electronic device.

7. The computer-implemented method of claim 1 , wherein obtaining the position data comprises:
receiving, from the second AR device, a set of image data generated by an image sensor coupled to a second AR viewer associated with the second AR device;
detecting, via the one or more processors, a POI represented by the set of image data;
comparing, via the one or more processors, the image data representative of the POI to image data in a POI database to identify the POI; and
obtaining, via the one or more processors, a location of the identified POI from the POI database.

8. The computer-implemented method of claim 1 , wherein presenting the indication of the second AR device comprises:
presenting, via the one or more processors, an AR indicator at a location within the field of view associated with the second AR device.

9. The computer-implemented method of claim 1 , wherein presenting the indication of the second AR device comprises:
presenting, via the one or more processors, navigational instructions to navigate to the second AR device.

10. The computer-implemented method of claim 9 , wherein presenting the navigational instructions comprises:
obtaining, via the one or more processors, mapping data associated with an environment of the first AR device;
obtaining, from an image sensor coupled to the AR viewer, a set of image data of the environment;
corresponding, via the one or more processors, the mapping data to the set of image data; and
overlaying, via the one or more processors, the navigational instructions onto the environment via the AR viewer.

11. The computer-implemented method of claim 9 , wherein presenting the navigational instructions comprises:
obtaining, from an image sensor coupled to the AR viewer, a set of image data of the environment of the first AR device;
analyzing, via the one or more processors, the set of image data to detect one or more navigable pathways within the environment; and
generating, via the one or more processors, the navigational instructions by determining a route between the first AR device and the second AR device that includes at least one detected navigable pathway.

12. The computer-implemented method of claim 1 , wherein:
the group includes a third AR device; and
the method further comprises:
obtaining, via the one or more processors, positional data indicative of a location of the third AR device; and
based upon the location of the third AR device and the field of view, presenting, via the one or more processors, an indication of the third AR device via the AR viewer.

13. The computer-implemented method of claim 1 , wherein obtaining the position data comprises:
querying, via the one or more processors, a location sharing permission associated with the second AR device; and
obtaining, via the one or more processors, the position data in response to satisfying the location sharing permission query.

14. A system for finding group members via an Augmented Reality (AR) device paired with an AR viewer, the system comprising:
one or more processors; and
one or more non-transitory memories storing processor-executable instructions that, when executed by the one or more processors, cause the system to:
establish a group of AR devices that includes at least a second AR device;
obtain, from an image sensor coupled to the AR viewer, a first set of image data of an environment included within a field of view of the image sensor;
obtain position data indicative of a location of the second AR device, wherein to obtain the position data, the instructions, when executed, cause the system to:
receive, from the second AR device, a second set of image data generated by an image sensor coupled to a second AR viewer associated with the second AR device,
identify a point of interest (POI) included represented by both the first and second sets of image data, and
determine a relative position of the second AR device by comparing at least one of a size of the POI, a perspective of the POI, and a position of the POI between the first and second sets of image data;

determine a field of view of the AR viewer; and
based upon the location of the second AR device and the field of view of the AR viewer, present an indication of the second AR device via the AR viewer.

15. The system of claim 14 , wherein to obtain the position data, the instructions, when executed, cause the system to:
obtain data generated by a position sensor of the second AR device.

16. The system of claim 14 , wherein to obtain the position data, the instructions, when executed, cause the system to:
detect, via a photodetector paired with the AR viewer, light emitted by the second AR device.

17. The system of claim 16 , wherein:
the light emitted by the second AR device encodes an identifier associated with at least one of the second AR device or the group of AR devices; and
the instructions, when executed, cause the system to decode the light emitted by the second AR device to derive the identifier.

18. The system of claim 14 , wherein to obtain the position data, the instructions, when executed, cause the system to:
receive, from the second AR device, a set of image data generated by an image s

Assignees

• State Farm Mutual Automobile Insurance Co

Inventors

• Fields Brian M
• Tofte Nathan L
• Williams Aaron C
• Harr Joseph P
• King Vicki

Classifications

• G01C21/3682

  output of POI information on a road map (G01C21/3614, G01C21/3685 take precedence) · CPC title

• G01C21/365

  Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself · CPC title

• G01C21/3647

  Guidance involving output of stored or live camera images or video streams · CPC title

• G01C21/3602

  Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera · CPC title

• G01C21/3476

  using point of interest [POI] information, e.g. a route passing visible POIs · CPC title