System, method, and storage medium of distributed edge computing for cooperative augmented reality with mobile sensing capability

Patent metadata

Field	Value
Publication number	US-12587585-B2
Application number	US-202418806352-A
Country	US
Kind code	B2
Filing date	Aug 15, 2024
Priority date	Dec 15, 2021
Publication date	Mar 24, 2026
Grant date	Mar 24, 2026

Abstract

The present disclosure provides a system of distributed edge computing for cooperative augmented reality with mobile sensing capability. The system includes a plurality of nodes configured to generate a plurality of data streams; and a plurality of distributed edge servers configured to process one or more tasks using the plurality of data streams. An Apache Storm distributed stream processing platform is installed and properly configured on each distributed edge server; the plurality of distributed edge servers includes one or more service modules installed on each distributed edge server and configured to process the one or more tasks; and the plurality of distributed edge servers includes a master distributed edge server and a plurality of slave distributed edge servers; and a scheduler is installed on the master distributed edge server and configured to distribute the one or more tasks to the plurality of distributed edge servers.

First claim

What is claimed is:

1 . A system of distributed edge computing for cooperative augmented reality (AR) with mobile sensing capability, applied to a service-centric distributed resource-aware architecture (SCDRA), comprising:
a plurality of nodes, wherein the plurality of nodes includes a plurality of HoloLens nodes and a plurality of sensor nodes; and the plurality of nodes is configured to generate a plurality of data streams; and a plurality of distributed edge servers, configured to process one or more tasks using the plurality of data streams transmitted from the plurality of nodes, wherein:
an Apache Storm distributed stream processing platform is installed on each of the plurality of distributed edge servers; and the plurality of nodes and the plurality of distributed edge servers are connected to each other through a wireless network;
the plurality of distributed edge servers includes one or more service modules installed on each distributed edge server and configured to process the one or more tasks; and
the plurality of distributed edge servers includes a master distributed edge server and a plurality of slave distributed edge servers; the master distributed edge server is configured to manage the plurality of slave distributed edge servers; and an Apache Storm scheduler is installed on the master distributed edge server and configured to distribute the one or more tasks to the plurality of distributed edge servers.

2 . The system according to claim 1 , wherein:
the one or more tasks include one or more of object detection, cooperative floor plan building, cooperative situational awareness, location tracking, event tagging, target navigation, and model reconstruction.

3 . The system according to claim 1 , wherein:
the one or more tasks processed are shared among a plurality of users through the wireless network.

4 . The system according to claim 1 , wherein:
the SCDRA includes a physical layer, a management layer, and a service layer.

5 . The system according to claim 4 , wherein:
the physical layer includes the plurality of nodes and the plurality of distributed edge servers.

6 . The system according to claim 4 , wherein:
the management layer includes a plurality of components including node registry, network management, task schedular, service registry, storage management, and failure handling.

7 . A method of distributed edge computing for cooperative augmented reality (AR) with mobile sensing capability, applied to a service-centric distributed resource-aware architecture (SCDRA), comprising:
generating a plurality of data streams by a plurality of nodes, wherein the plurality of nodes includes a plurality of HoloLens nodes and a plurality of sensor nodes; and processing one or more tasks by a plurality of distributed edge servers using the plurality of data streams transmitted from the plurality of nodes, wherein:
an Apache Storm distributed stream processing platform is installed on each of the plurality of distributed edge servers; and the plurality of nodes and the plurality of distributed edge servers are connected to each other through a wireless network;
the plurality of distributed edge servers includes one or more service modules installed on each distributed edge server and configured to process the one or more tasks; and
the plurality of distributed edge servers includes a master distributed edge server and a plurality of slave distributed edge servers; the master distributed edge server is configured to manage the plurality of slave distributed edge servers; and an Apache Storm scheduler is installed on the master distributed edge server and configured to distribute the one or more tasks to the plurality of distributed edge servers.

8 . The method according to claim 7 , wherein:
the one or more tasks include one or more of object detection, cooperative floor plan building, cooperative situational awareness, location tracking, event tagging, target navigation, and model reconstruction.

9 . The method according to claim 7 , wherein:
the one or more tasks processed are shared among a plurality of users through the wireless network.

10 . The method according to claim 7 , wherein:
the SCDRA includes a physical layer, a management layer, and a service layer.

11 . The method according to claim 10 , wherein:
the physical layer includes the plurality of nodes and the plurality of distributed edge servers.

12 . The method according to claim 10 , wherein:
the management layer includes a plurality of components including node registry, network management, task schedular, service registry, storage management, and failure handling.

13 . A non-transitory computer-readable storage medium, containing program instructions for, when being executed by a processor, performing a method of distributed edge computing for cooperative augmented reality (AR) with mobile sensing capability, applied to a service-centric distributed resource-aware architecture (SCDRA), the method comprising:
generating a plurality of data streams by a plurality of nodes, wherein the plurality of nodes includes a plurality of HoloLens nodes and a plurality of sensor nodes; and processing one or more tasks by a plurality of distributed edge servers using the plurality of data streams transmitted from the plurality of nodes, wherein:
an Apache Storm distributed stream processing platform is installed on each of the plurality of distributed edge servers; and the plurality of nodes and the plurality of distributed edge servers are connected to each other through a wireless network;
the plurality of distributed edge servers includes one or more service modules installed on each distributed edge server and configured to process the one or more tasks; and
the plurality of distributed edge servers includes a master distributed edge server and a plurality of slave distributed edge servers; the master distributed edge server is configured to manage the plurality of slave distributed edge servers; and an Apache Storm scheduler is installed on the master distributed edge server and configured to distribute the one or more tasks to the plurality of distributed edge servers.

14 . The storage medium according to claim 13 , wherein:
the one or more tasks include one or more of object detection, cooperative floor plan building, cooperative situational awareness, location tracking, event tagging, target navigation, and model reconstruction.

15 . The storage medium according to claim 13 , wherein:
the one or more tasks processed are shared among a plurality of users through the wireless network.

16 . The storage medium according to claim 13 , wherein:
the SCDRA includes a physical layer, a management layer, and a service layer.

17 . The storage medium according to claim 16 , wherein:
the physical layer includes the plurality of nodes and the plurality of distributed edge servers.

18 . The storage medium according to claim 16 , wherein:
the management layer includes a plurality of components including node registry, network management, task schedular, service registry, storage management, and failure handling.

Assignees

• Intelligent Fusion Tech Inc

Inventors

• Zhao Qi
• Chen Genshe
• Pham Khanh
• Blasch Erik

Classifications

• H04L67/10

  in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• H04L67/131 Primary

  Protocols for games, networked simulations or virtual reality · CPC title

• G06V10/95

  structured as a network, e.g. client-server architectures · CPC title

• G06V10/809 Primary

  of classification results, e.g. where the classifiers operate on the same input data · CPC title