Remote collaboration between users utilizing at least one of augmented reality and virtual reality computing devices

Patent metadata

Field	Value
Publication number	US-12223852-B2
Application number	US-202217691817-A
Country	US
Kind code	B2
Filing date	Mar 10, 2022
Priority date	Mar 10, 2022
Publication date	Feb 11, 2025
Grant date	Feb 11, 2025

Abstract

An apparatus comprises at least one processing device configured to establish, utilizing a communication network, a remote collaboration session between first and second computing devices associated with first and second users, and to determine data to be exchanged between the first and second computing devices as part of the remote collaboration session. The first and second computing devices each comprise at least one of an augmented reality and a virtual reality computing device. The processing device is also configured to generate different logical network slices of the communication network, each logical network slice having a set of network characteristics associated with at least one type of the data to be exchanged between the first and second computing devices as part of the remote collaboration session. The processing device is further configured to communicate the different types of data between the first and second computing devices utilizing the logical network slices.

First claim

What is claimed is:

1. An apparatus comprising:
at least one processing device comprising a processor coupled to a memory;
the at least one processing device being configured to perform steps of:
establishing, utilizing one or more communication networks, a remote collaboration session between at least a first computing device associated with a first user at a first location and at least a second computing device associated with a second user at a second location different than the first location, wherein each of the first computing device and the second computing device comprises at least one of an augmented reality computing device and a virtual reality computing device;
determining two or more different types of data to be exchanged between the first computing device and the second computing device as part of the remote collaboration session, the two or more different types of data to be exchanged between the first computing device and the second computing device as part of the remote collaboration session comprising (i) at least one live video stream and (ii) digital guidance to be overlayed on at least a portion of the at least one live video stream, the digital guidance specifying one or more provisioning actions to be performed on one or more information technology assets at the first location;
generating two or more different logical network slices of the one or more communication networks, the two or more different logical network slices of the one or more communication networks comprising at least a first logical network slice having a first set of network characteristics for the at least one live video stream and at least a second logical network slice having a second set of network characteristics for the digital guidance to be overlayed on at least a portion of the at least one live video stream, the second set of network characteristics being different than the first set of network characteristics; and
communicating the two or more different types of data between the first computing device and the second computing device utilizing respective ones of the two or more different logical network slices of the one or more communication networks.

2. The apparatus of claim 1 wherein the at least one video stream comprises a first live video stream from the first computing device and at least a second live video stream from one or more video cameras at the first location.

3. The apparatus of claim 2 wherein the first logical network slice is utilized for the first live video stream and the second live video stream.

4. The apparatus of claim 2 wherein the first computing device comprises at least one augmented reality computing device, and wherein the first live video stream further comprises inertial measurement unit data from the at least one augmented reality computing device.

5. The apparatus of claim 2 wherein the second live video stream comprises a 360 degree panoramic view of the one or more information technology assets at the first location from one or more 360 degree panoramic video cameras at the first location.

6. The apparatus of claim 2 wherein the second live video stream comprises a 360 degree panoramic view of the one or more information technology assets at the first location that is stitched together from two or more non-360 degree panoramic video cameras at the first location.

7. The apparatus of claim 1 wherein the first set of network characteristics of the first logical network slice comprises a first data throughput level and a first latency, wherein the second set of network characteristics of the second logical network slice comprises a second data throughput level and a second latency, wherein the second data throughput level is lower than the first data throughput level, and wherein the second latency is lower than the first latency.

8. The apparatus of claim 1 wherein the digital guidance specifying the one or more provisioning actions to be performed on the one or more information technology assets at the first location comprises at least one audio stream for audio communications between the first user and the second user.

9. The apparatus of claim 1 wherein the first computing device comprises at least one augmented reality computing device, and wherein the digital guidance specifying the one or more provisioning actions to be performed on the one or more information technology assets at the first location comprises one or more annotations for digital overlay via the at least one augmented reality computing device.

10. The apparatus of claim 1 wherein the one or more communication networks comprise a 5G communication network.

11. The apparatus of claim 1 wherein the at least one processing device is further configured to perform the step of processing at least one of the two or more different types of data to be exchanged between the first computing device and the second computing device as part of the remote collaboration session utilizing one or more edge computing nodes of the one or more communication networks.

12. The apparatus of claim 11 wherein preprocessing said at least one of the two or more different types of data to be exchanged between the first computing device and the second computing device as part of the remote collaboration session utilizing one or more edge computing nodes of the one or more communication networks comprises at least one of pose estimation of the first user, object tracking of one or more information technology assets at the first location, and object recognition of the one or more information technology assets at the first location.

13. The apparatus of claim 1 wherein the first computing device comprises at least one augmented reality computing device, wherein the second computing device comprises at least one virtual reality computing device, wherein the at least one augmented reality computing device comprises at least one of augmented reality glasses and augmented reality lenses, and wherein the at least one virtual reality computing device comprises a head-mounted display.

14. The apparatus of claim 1 wherein the first user is associated with a first enterprise operating a data center at the first location, and wherein the second user is associated with a second enterprise providing support services to the first enterprise.

15. A computer program product comprising a non-transitory processor-readable storage medium having stored therein program code of one or more software programs, wherein the program code when executed by at least one processing device causes the at least one processing device to perform steps of:
establishing, utilizing one or more communication networks, a remote collaboration session between at least a first computing device associated with a first user at a first location and at least a second computing device associated with a second user at a second location different than the first location, wherein each of the first computing device and the second computing device comprises at least one of an augmented reality computing device and a virtual reality computing device;
determining two or more different types of data to be exchanged between the first computing device and the second computing device as part of the remote collaboration session, the two or more different types of data to be exchanged between the first computing device and the second computing device as part of the remote collaboration session comprising (i) at least one live video stream and (ii) digital guidance to be overlayed on at least a portion of the at least one live video stream, the digital guidance specifying one or more provisioning actions to

Assignees

• Dell Products Lp

Inventors

• Jia Zhen
• Sha Danqing
• He Bin
• Fong Victor
• Hou Anzhou

Classifications

• H04N23/698

  for achieving an enlarged field of view, e.g. panoramic image capture · CPC title

• G06T19/006

  Mixed reality (object pose determination, tracking or camera calibration for mixed reality G06T7/00) · CPC title

• G06V20/20

  in augmented reality scenes · CPC title

• H04L65/612

  for unicast · CPC title

• H04L65/80

  Responding to QoS · CPC title