Guidance for collaborative map building and updating

Patent metadata

Field	Value
Publication number	US-12596014-B2
Application number	US-202318241181-A
Country	US
Kind code	B2
Filing date	Aug 31, 2023
Priority date	Aug 31, 2023
Publication date	Apr 7, 2026
Grant date	Apr 7, 2026

Abstract

A collaborative map building method is described in which if it is determined, for example, by a SLAM network edge, that a portion of a map corresponding to a target area of a first region is incomplete, a request to a device is transmitted to move toward the target area. The map is updated based on the scan performed by the device in the target area. Also described is a virtual image guide embodiment in which upon determining that a map of a target area of the first region is incomplete, a virtual guide image is generated on a device to appear at a target location. The user of the device is guided to the target area by the virtual image.

First claim

What is claimed is:

1 . A method comprising:
receiving a first transmission from a first device, the first transmission containing first image data for a target area; generating, by control circuitry, using the first image data, a map of the target area; determining that at least a portion of the map of the target area is incomplete; based at least in part on the determining that at least the portion of the map of the target area is incomplete, identifying a plurality of available devices; selecting at least one second device of the plurality of available devices based at least in part on a rule that permits entry to the target area for the at least one second device and prohibits entry to the target area for available devices of the plurality of available devices other than the at least one second device; based at least in part on the selecting the at least one second device, transmitting a request to the at least one second device to move toward the target area, wherein the transmitted request causes the at least one second device to display an image or map of at least a portion of the target area with a direction to move toward the target area or causes the at least one second device to automatically move toward the target area; receiving a second transmission from the at least one second device, the second transmission indicating containing second image data of the target area; and updating, according to the second image data, the map of the target area.

2 . The method of claim 1 , further comprising:
receiving a third transmission from a third device, the third transmission indicating a location of the third device; and determining that an image data retrieval capability of the at least one second device exceeds an image data retrieval capability of the third device, wherein the transmitting of the request to the at least one second device to move toward the target area is performed in response to the determining that the image data retrieval capability of the at least one second device exceeds the image data retrieval capability of the third device.

3 . The method of claim 2 , wherein the determining that the image data retrieval capability of the at least one second device exceeds the image data retrieval capability of the third device comprises: determining that the at least one second device retrieves image data in flight.

4 . The method of claim 2 , wherein the determining that the image data retrieval capability of the at least one second device exceeds the image data retrieval capability of the third device comprises:
determining that the at least one second device comprises an image sensor configured to provide a higher image resolution or a higher frame rate than provided by the third device, or that the at least one second device is configured to provide a higher bit transmission rate than provided by the third device.

5 . The method of claim 2 , wherein the determining that the image data retrieval capability of the at least one second device exceeds the image data retrieval capability of the third device comprises: determining that an image sensor of the at least one second device is positioned lower to the ground than is an image sensor of the third device.

6 . The method of claim 2 , further comprising:
storing in relation to the second image data one or more of an image resolution provided by the image sensor of the at least one second device, a frame rate provided by the image sensor of the at least one second device, or a bit transmission rate provided by the at least one second device.

7 . The method of claim 2 , further comprising:
determining, prior to the transmitting of the request to the at least one second device to move toward the target area, that the indicated location of the third device is closer to the target area than is a location of the at least one second device.

8 . The method of claim 1 , wherein the first device is a SLAM-enabled device, and the first transmission indicating the location of the first device comprises inertial measurement data obtained by the first device;
wherein the at least one second device is a SLAM-enabled device, and the second transmission indicating the location of the at least one second device comprises inertial measurement data obtained by the at least one second device; and the control circuitry is comprised in a SLAM network edge service.

9 . The method of claim 1 , wherein the at least one second device is a wearable device.

10 . The method of claim 1 , wherein the at least one second device is configured to provide an extended reality experience or an augmented reality experience.

11 . The method of claim 1 , wherein the at least one second device comprises an autonomous household appliance, an industrial robot, a robotic device, or an autonomous vehicle.

12 . A system comprising:
communication circuitry configured:
to receive a first transmission from a first device, the first transmission containing first image data for a target area; and
processing circuitry configured:
to generate, using the first image data, a map of the area;
to determine that at least a portion of the map of the target area is incomplete;
based at least in part on the determining that at least the portion of the map of the target area is incomplete, to identify a plurality of available devices;
to select at least one second device of the plurality of available devices based at least in part on a rule that permits entry to the target area for the at least one second device and prohibits entry to the target area for available devices of the plurality of available devices other than the at least one second device;
based at least in part on the selecting the at least one second device, to transmit a request to the at least one second device to move toward the target area, wherein the transmitted request causes the at least one second device to display an image or map of at least a portion of the target area with a direction to move toward the target area or causes the at least one second device to automatically move toward the target area;
to receive a second transmission from the at least one second device, the second transmission containing second image data of the target area; and
to update, according to the second image data, the map of the target area.

13 . The system of claim 12 , wherein the processing circuitry is further configured:
to receive a third transmission from a third device, the third transmission indicating a location of the third device; and to determine that an image data retrieval capability of the at least one second device exceeds an image data retrieval capability of the third device, wherein the transmitting of the request to the at least one second device to move toward the target area is performed in response to the determining that the image data retrieval capability of the at least one second device exceeds the image data retrieval capability of the third device.

14 . The system of claim 13 , wherein the determining that the image data retrieval capability of the at least one second device exceeds the image data retrieval capability of the third device comprises:
determining that the at least one second device retrieves image data in flight.

15 . The system of claim 13 , wherein the determining that the image data retrieval capability of the at least one second device exceeds the image data retrieval capability of the third device comprises:
determining that the at least one second device comprises an image sensor configured to provide a higher image resolution or a higher f

Assignees

• Adeia Guides Inc

Inventors

• Wannerberg Petter
• Phillips Christopher

Classifications

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• H04L67/131

  Protocols for games, networked simulations or virtual reality · CPC title

• G01C21/3848 Primary

  Data obtained from both position sensors and additional sensors · CPC title