Methods and systems to facilitate passive relocalization using three-dimensional maps

Patent metadata

Field	Value
Publication number	US-12299918-B2
Application number	US-202217585439-A
Country	US
Kind code	B2
Filing date	Jan 26, 2022
Priority date	Jan 26, 2022
Publication date	May 13, 2025
Grant date	May 13, 2025

Abstract

A method includes accessing map data of an area of a real environment, the map data comprising three-dimensional feature descriptors describing features visible in the real environment. A plurality of map packages are generated based on the map data, wherein each of the map packages (1) corresponds to a two-dimensional sub-area within the area of the real environment, and (2) comprises a subset of the three-dimensional feature descriptors describing features visible in the sub-area. A first sequence of the plurality of map packages are broadcast through one or more base stations, wherein the first sequence is based on the two-dimensional sub-area of each of the map packages, wherein each of the map packages is configured to be received and used by an artificial-reality device to determine a pose of the artificial-reality device in the associated sub-area based on the associated subset of the three-dimensional feature descriptors.

First claim

What is claimed is:

1. A computer-implemented method comprising:
accessing map data of an area of a real environment, the map data comprising three-dimensional feature descriptors describing features visible in the real environment;
generating, based on the map data, a plurality of map packages, wherein each of the map packages (1) corresponds to a two-dimensional sub-area within the area of the real environment, and (2) comprises a subset of the three-dimensional feature descriptors describing features visible in the sub-area; and
sequentially broadcasting the plurality of map packages in a first predetermined sequence through one or more base stations, wherein a plurality of artificial-reality devices located in a two-dimensional sub-area are each configured to: receive, over a one-way communication channel, at least one of the plurality of map packages via at least one of the sequential broadcasts, and determine a pose of the artificial-reality device based on at least a portion of the three-dimensional feature descriptors included in the received at least one map package.

2. The method of claim 1 , wherein the associated sub-area corresponding to each of the map packages is equal.

3. The method of claim 1 , wherein the associated sub-area corresponding to each of the map packages is used by the artificial-reality device as a bounded search space to determine the pose of the artificial-reality device.

4. The method of claim 1 , wherein each of the map packages further comprises metadata containing information about a location of the associated sub-area in the real environment.

5. The method of claim 1 , wherein the predetermined sequence of the plurality of map packages are sequentially broadcast through the one or more base stations at different radio frequencies.

6. The method of claim 1 , wherein the predetermined sequence is further based on the associated subset of the three-dimensional feature descriptors comprising each map package in the first sequence.

7. The method of claim 1 , wherein a first base station of the one or more base stations is located within a first two-dimensional sub-area, wherein the first base station broadcasts a map package associated with the first two-dimensional sub-area.

8. The method of claim 1 , wherein the predetermined sequence of the plurality of map packages is broadcasted at a first frequency, further comprising:
sequentially broadcasting a second predetermined sequence of the plurality of map packages in a second predetermined sequence at a second frequency that is greater than the first frequency, wherein the subset of the three-dimensional feature descriptors of each map package in the second predetermined sequence of the plurality of map packages is a larger subset of the three-dimensional feature descriptors than the subset of the three-dimensional feature descriptors of each map package in the predetermined sequence the plurality of map packages.

9. The method of claim 1 , wherein a first artificial-reality device of the plurality of artificial-reality devices receives multiple of the plurality of map packages via multiple of the sequential broadcasts, and the first artificial-reality device is configured to:
filter the received map packages to identify one or more map packages for pose estimation, wherein a pose of the first artificial-reality device is determined based on the identified one or more map packages.

10. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:
access map data of an area of a real environment, the map data comprising three-dimensional feature descriptors describing features visible in the real environment;
generate, based on the map data, a plurality of map packages, wherein each of the map packages (1) corresponds to a two-dimensional sub-area within the area of the real environment, and (2) comprises a subset of the three-dimensional feature descriptors describing features visible in the sub-area; and
sequentially broadcast the plurality of map packages in a first predetermined sequence through one or more base stations, wherein a plurality of artificial-reality devices located in a two-dimensional sub-area are each configured to: receive, over a one-way communication channel, at least one of the plurality of map packages via at least one of the sequential broadcasts, and determine a pose of the artificial-reality device based on at least a portion of the three-dimensional feature descriptors included in the received at least one map package.

11. The media of claim 10 , wherein the associated sub-area corresponding to each of the map packages is equal.

12. The media of claim 10 , wherein the associated sub-area corresponding to each of the map packages is used by the artificial-reality device as a bounded search space to determine the pose of the artificial-reality device.

13. The media of claim 10 , wherein each of the map packages further comprises metadata containing information about a location of the associated sub-area in the real environment.

14. The media of claim 10 , wherein the predetermined sequence of the plurality of map packages are sequentially broadcast through the one or more base stations at different radio frequencies.

15. The media of claim 10 , wherein the predetermined sequence of the plurality of map packages is broadcasted at a first frequency, wherein the software is further operable to:
sequentially broadcast a second predetermined sequence of the plurality of map packages in a second predetermined sequence at a second frequency that is greater than the first frequency, wherein the subset of the three-dimensional feature descriptors of each map package in the second predetermined sequence of the plurality of map packages is a larger subset of the three-dimensional feature descriptors than the subset of the three-dimensional feature descriptors of each map package in the first predetermined sequence the plurality of map packages.

16. A system comprising:
one or more processors; and
one or more computer-readable non-transitory storage media coupled to one or more of the processors and comprising instructions operable when executed by one or more of the processors to cause the system to:
access map data of an area of a real environment, the map data comprising three-dimensional feature descriptors describing features visible in the real environment;
generate, based on the map data, a plurality of map packages, wherein each of the map packages (1) corresponds to a two-dimensional sub-area within the area of the real environment, and (2) comprises a subset of the three-dimensional feature descriptors describing features visible in the sub-area; and
sequentially broadcast the plurality of map packages in a first predetermined sequence through one or more base stations, wherein a plurality of artificial-reality devices located in a two-dimensional sub-area are each configured to: receive, over a one-way communication channel, at least one of the plurality of map packages via at least one of the sequential broadcasts, and determine a pose of the artificial-reality device based on at least a portion of the three-dimensional feature descriptors included in the received at least one map package.

17. The system of claim 16 , wherein the associated sub-area corresponding to each of the map packages is equal.

18. The system of claim 16 , wherein the associated sub-area corresponding to each of the map packages is used by the artificial-reality device as a bounded search space to determine the pose of th

Assignees

• Meta Platforms Tech Llc

Inventors

• Alaghi Armin
• Kal Muzaffer
• Lee Vincent
• Newcombe Richard Andrew

Classifications

• H04W4/06

  Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services · CPC title

• G06Q10/109

  Time management, e.g. calendars, reminders, meetings or time accounting · CPC title

• G06Q10/107

  Computer-aided management of electronic mailing [e-mailing] · CPC title

• G06Q30/0251

  Targeted advertisements · CPC title

• G06Q30/0643

  graphically representing goods, e.g. 3D product representation · CPC title