Systems and methods for augmenting reality during a site survey using an unmanned aerial vehicle

Patent metadata

Field	Value
Publication number	US-10832558-B2
Application number	US-201815864172-A
Country	US
Kind code	B2
Filing date	Jan 8, 2018
Priority date	Jan 8, 2018
Publication date	Nov 10, 2020
Grant date	Nov 10, 2020

Abstract

Systems and methods are provided for augmented reality during an automated site survey of a building using an unmanned aerial vehicle. Some methods can include retrieving a building information model of the building from a database device, receiving user input and, responsive thereto, transmitting navigation signals to the unmanned aerial vehicle to maneuver to a site survey position in the building and transmitting command signals to the unmanned aerial vehicle to conduct a RF test at the site survey position and return site survey results, and calculating signal degradation for the site survey position as a function of the site survey results and the building information model.

First claim

What is claimed is:

1. A method comprising:
retrieving a building information model of a building under test from a database device;
receiving first user input from a user via a user interface device and, responsive thereto, transmitting navigation signals to an unmanned aerial vehicle to maneuver to a site survey position in the building under test corresponding to a location marked, by a user, in the building information model and transmitting command signals to the unmanned aerial vehicle to conduct a RF test at the site survey position and return site survey results; and
determining signal degradation for the site survey position based upon the site survey results and elements in the building information model that have the potential to degrade the signal.

2. The method of claim 1 wherein the site survey results include a RSSI value obtained at the site survey position by a test device carried by the unmanned aerial vehicle.

3. The method of claim 2 further comprising:
mapping the RSSI value to the site survey position in the building information model; and
extracting elements in the building information model with a potential to degrade the RSSI value at the site survey position.

4. The method of claim 3 further comprising identifying one or more changes to the site survey position to improve the signal degradation of the RSSI value.

5. The method of claim 4 wherein the unmanned aerial vehicle carries a test device for conducting the RF test.

6. The method of claim 5 further comprising:
receiving second user input for identifying a marked location in the building information model corresponding to an installation location for the test device; and
identifying the site survey position based on the marked location.

7. The method of claim 6 further comprising receiving third user input to adjust the marked location pursuant to the one or more changes and, responsive thereto, transmitting the navigation signals to the unmanned aerial vehicle to maneuver to the site survey position corresponding to the marked location as adjusted.

8. The method of claim 1 further comprising:
combining, via control software, an image received from an image capture device on the unmanned aerial vehicle with a portion of the building information model to present an augmented view on a user interface device; and
displaying the augmented view of the building under test at the site survey position on the user interface device.

9. A method comprising:
retrieving a building information model of a building under test from a database device;
receiving first user input from a user via a user interface device and, responsive thereto, transmitting first navigation signals to an unmanned aerial vehicle to maneuver to a site survey position in the building under test when the building under test is in a first state of completion corresponding to a location marked, by a user, in the building information model and transmitting first command signals to the unmanned aerial vehicle to conduct a RF test at the site survey position when the building under test is in the first state of completion and return first site survey results responsive to the RF test at the site survey position when the building under test is in the first state of completion;
determining first signal degradation for the site survey position based upon the first site survey results and elements in the building information model that have the potential to degrade the signal;
receiving second user input from a user via a user interface device and, responsive thereto, transmitting second navigation signals to the unmanned aerial vehicle to maneuver to the site survey position in the building under test when the building under test is in a second state of completion and transmitting second command signals to the unmanned aerial vehicle to conduct the RF test at the site survey position when the building under test is in the second state of completion and return second site survey results responsive to the RF test at the site survey position when the building under test is in the second state of completion; and
determining second signal degradation for the site survey position based upon of the site survey results and elements in the building information model that have the potential to degrade the signal.

10. A system comprising:
a transceiver device;
a database device;
a user interface device;
a programmable processor; and
executable control software stored on a non-transitory computer readable medium,
wherein the programmable processor and the executable control software retrieve a building information model of a building under test from the database device,
wherein the user interface device receives first user input from a user, and responsive thereto, the transceiver device transmits navigation signals to an unmanned aerial vehicle to maneuver the unmanned aerial vehicle to a site survey position in the building under test corresponding to a location marked, by a user, in the building information model and transmits command signals to a test device carried by the unmanned aerial vehicle to conduct a RF test at the site survey position and return site survey results, and
wherein the programmable processor and the executable control software determine signal degradation for the site survey position based upon the site survey results and elements in the building information model that have the potential to degrade the signal.

11. The system of claim 10 wherein the site survey results include a RSSI value obtained at the site survey position by the test device.

12. The system of claim 11 wherein the programmable processor and the executable control software map the RSSI value to the site survey position in the building information model and extract elements in the building information model with a potential to degrade the RSSI value at the site survey position.

13. The system of claim 12 wherein the programmable processor and the executable control software identify one or more changes to the site survey position to improve the signal degradation of the RSSI value.

14. The system of claim 13 wherein the user interface device receives second user input for identifying a marked location in the building information model corresponding to an installation location for the test device, and wherein the programmable processor and the executable control software identify the site survey position based on the marked location.

15. The system of claim 14 wherein the user interface device receives third user input to adjust the marked location pursuant to the one or more changes and, responsive thereto, transmits the navigation signals to the unmanned aerial vehicle to maneuver to the site survey position corresponding to the marked location as adjusted.

16. The system of claim 1 wherein the transceiver device receives an image of the building under test at the site survey position from an image capture device on the unmanned aerial vehicle, and control software, combines the image with a portion of the building information model to present an augmented view on a user interface device.

17. The system of claim 10 wherein the user interface device includes a virtual reality wearable headset or virtual reality glasses or a handheld device.

18. The system of claim 10 wherein the transceiver device communicates with the unmanned aerial vehicle and the test device via a first communication medium, and wherein the transceiver device communicates with the user interface device via a second communication medium.

Assignees

• Honeywell Int Inc

Inventors

• S R Sasikumar
• M R Gowrishankar
• P Ranjith Kumar
• Joseph Kingslin

Classifications

• B64U2201/20

  Remote controls · CPC title

• H04B17/318 Primary

  Received signal strength · CPC title

• G05D1/2247

  providing the operator with simple or augmented images from one or more cameras · CPC title

• B64U2101/31

  for surveillance · CPC title

• B64U2101/26

  for manufacturing, inspections or repairs · CPC title