System and method for determining location and navigating a datacenter using augmented reality and available sensor data

Patent metadata

Field	Value
Publication number	US-10966342-B2
Application number	US-201916263968-A
Country	US
Kind code	B2
Filing date	Jan 31, 2019
Priority date	Jan 31, 2019
Publication date	Mar 30, 2021
Grant date	Mar 30, 2021

Abstract

An information handling system for identifying equipment in a datacenter establishes a wireless communication link with an element of datacenter equipment, and receives identification information from the element. The identification information distinguishes the element from other elements of the datacenter equipment that are visibly indistinct from the first element. The information handling system further captures image data when the field of view of an imaging system includes the element, displays the image data on a display, matches a portion of the image data with an image object associated with the first and second elements, determines an identity of the element based upon the identification information and the image object, and displays an augmented reality overlay on the display over the image data. The augmented reality overlay co-locates the image object with the portion and includes the identity over the portion.

First claim

What is claimed is:

1. An information handling system for identifying equipment in a datacenter, the information handling system comprising:
a display;
an image library including image objects associated with various datacenter equipment;
a first wireless communication interface;
a second wireless communication interface and
an imaging system configured to capture image data from within a field of view of the imaging system;
wherein the information handling system is configured to:
establish a first wireless communication link with a first element of the datacenter equipment via the wireless communication interface;
receive first identification information from the first element via the first wireless communication link, the first identification information to distinguish the first element from a second element of the datacenter equipment, the first element being visibly indistinct from the second element, and to identify a use to which the element is configured to perform;
capture image data when the field of view includes the first element;
display the image data on the display;
match a first portion of the image data with a first image object associated with the first and second elements, wherein in matching the first portion of the image data with the first image object, the information handling system is further configured to compare the image data with a plurality of image objects including the first image object;
determine a confidence score for a first identity of the first element based upon the first identification information and the first image object, wherein in determining the confidence score, the information handling system is further configured to compare an identity associated with the first identification information with an identity associated with the first image object;
determine the first identity of the first element when the confidence score is higher than a threshold confidence score; and
establish a second wireless communication link with a datacenter management system via the second wireless communication interface;
receive, from the datacenter management system, a verification of the first identity of the first element;
display an augmented reality overlay on the display over the image data, wherein the augmented reality overlay co-locates the first image object with the first portion and includes the first identity over the first portion i

wherein the information handling system further comprising: a location device configured to determine a location of the information handling system; wherein the information handling system is further configured to: receive a map of the datacenter that includes a first location associated with the first element; determine a second location of the information handling system when the field of view includes the first element; and determine that the second location is proximate to the first location, wherein determining the first identity of the first element is further based upon the second location being proximate to the first location.

2. The information handling system of claim 1 , further configured to:
establish a third wireless communication link with the second element via the wireless communication interface;
receive second identification information from the second element via the third wireless communication link, the second identification information different from the first identification information;
match a second portion of the image data with the first image object, wherein the field of view further includes the second element; and
determine a second identity of the second element based upon the second identification information and the first image object, wherein the augmented reality overlay further co-locates the first image object with the second portion and includes the second identity over the second portion.

3. The information handling system of claim 2 , further configured to:
establish a fourth wireless communication link with a third element of datacenter equipment via the wireless communication interface, wherein the field of view further includes the third element;
receive third identification information from the third element via the fourth wireless communication link, the third identification information to distinguish the third element from the first element, the third element being visibly distinct from the first and second elements;
match a third portion of the image data with a second image object associated with the third element; and
determine a third identity of the third element based upon the third identification information and the second image object, wherein the augmented reality overlay further co-locates the second image object with the third portion and includes the third identity over the third portion.

4. The information handling system of claim 1 , wherein the location device includes at least one of a global positioning system locator and an accelerometer.

5. A method for identifying datacenter equipment in a datacenter, the method comprising:
establishing, via a first wireless communication interface of an information handling system, a first wireless communication link with a first element of the datacenter equipment;
receiving first identification information from the first element via the first wireless communication link, the first identification information to distinguish the first element from a second element of the datacenter equipment, the first element being visibly indistinct from the second element, and to identify a use to which the element is configured to perform;
capturing, with an imaging system of the information handling system configured to capture image data from within a field of view of the imaging system, image data when the field of view includes the first element;
displaying the image data on a display of the information handling system;
matching a first portion of the image data with a first image object associated with the first and second elements, wherein in matching the first portion of the image data with the first image object, the method further comprises comparing the image data with a plurality of image objects including the first image object;
determining a confidence score for a first identity of the first element based upon the first identification information and the first image object, wherein in determining the confidence score, the method further comprises comparing an identity associated with the first identification information with an identity associated with the first image object;
determining the first identity of the first element when the confidence score is higher than a threshold confidence score; and
establishing, via a second wireless communication interface of the information handling system, a second wireless communication link with a datacenter management system via the second wireless communication interface;
receiving, from the datacenter management system, a verification of the first identity of the first element;
displaying an augmented reality overlay on the display over the image data, wherein the augmented reality overlay co-locates the first image object with the first portion and includes the first identity over the first portion;
wherein the method further comprising: receiving a map of a datacenter that includes a first location associated with the first element; determining, by a location device of the information handling system configured to determine a location of the information handling system, a second location of the information handling system when the field of view includes the first element; and determining that the second location is proximate to the first location, wherein determining the first identity of the first element is further based upon the second location being proximate to t

Assignees

• Dell Products Lp

Inventors

• Lairsey Jeffrey M
• Rote Alexander P
• Kishore Saurabh
• Cox Robert V
• Shetty Sudhir Vittal
• Shrestha Saurav
• Barrett Robert

Classifications

• G06F3/04815

  Interaction with a metaphor-based environment or interaction object displayed as three-dimensional [3D], e.g. changing the user viewpoint with respect to the environment or object · CPC title

• G06F3/0346

  with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors · CPC title

• G06F3/0304

  Detection arrangements using opto-electronic means (constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042) · CPC title

• G06F1/1698

  the I/O peripheral being a sending/receiving arrangement to establish a cordless communication link, e.g. radio or infrared link, integrated cellular phone (details of antennas disposed inside a computer H01Q1/2266) · CPC title

• G06F1/1694

  the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer · CPC title