Virtual enhancement of security monitoring

Patent metadata

Field	Value
Publication number	US-11875656-B2
Application number	US-202217582640-A
Country	US
Kind code	B2
Filing date	Jan 24, 2022
Priority date	Mar 12, 2015
Publication date	Jan 16, 2024
Grant date	Jan 16, 2024

Abstract

Methods, systems, and apparatus, including computer programs encoded on storage devices, for monitoring, security, and surveillance of a property. In one aspect, a system includes a virtual reality headset, a plurality of cameras, a plurality of sensors that includes a first sensor, a control unit, wherein the control unit includes a network interface, a processor, a storage device that includes instructions to perform operations that comprise receiving data from the first sensor that is indicative of an alarm event, determining a location of the first sensor, identifying a set of one or more cameras from the plurality of cameras that are associated with the first sensor, selecting a particular camera from the identified set of one or more cameras; and transmitting one or more instructions to the particular camera that command the particular camera to stream a live video feed to a user interface of the virtual reality headset.

First claim

The invention claimed is:

1. A system comprising one or more computers and one or more storage devices on which are stored instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
selecting, from among a plurality of cameras included in a property monitoring system that monitors an area of a property, a first camera for observing the area of the property;
obtaining, from one or more sensors of an extended reality headset, positional data related to a position of at least a portion of a head of a user wearing the headset;
controlling movement of the first camera based on movement of the headset using the positional data generated by the one or more sensors of the headset;
providing, for presentation on a display of the headset, a first video feed including images captured by the first camera;
receiving, from the extended reality headset, directional input provided by the user;
based on the directional input, selecting, from among the plurality of cameras, a second camera;
controlling movement of the second camera with the movement of the headset by using the positional data generated by the one or more sensors of the headset; and
providing, for the presentation on the display of the headset, a second video feed including images captured by the second camera.

2. The system of claim 1 , wherein providing, for presentation on the display of the headset, the second video feed including the images captured by the second camera comprises switching from providing the first video feed to providing the second video feed.

3. The system of claim 2 , wherein switching from providing the first video feed to providing the second video feed simulates movement of the user from the area of the property to a different area of the property.

4. The system of claim 1 , wherein providing, for presentation on the display of the headset, the second video feed comprises:
configuring video output on the display into a split-screen format, wherein the split-screen format includes the first video feed on a first portion of the display and the second video feed on a second portion of the display.

5. The system of claim 1 , wherein the directional input comprises at least one of headset movement, tactile input, or a user selection of the second video feed received through a user interface of the headset.

6. The system of claim 1 , wherein the movement of the first camera comprises one or more of panning, tilting, or zooming of the first camera.

7. The system of claim 1 , wherein the operations comprise:
determining, based on the positional data generated by the one or more sensors, data representing a current positioning in a three-dimensional space of at least the portion of the head of the user wearing the headset,
wherein controlling the movement of the first camera based on the movement of the headset comprises providing the data representing the current positioning in the three-dimensional space of at least the portion of the head of the user wearing the headset to a device that is configured to control movement of the first camera based on the current positioning of at least the portion of the head of the user wearing the headset.

8. The system of claim 1 , wherein the one or more sensors include a gyroscope, an accelerometer, a magnetometer, a global positioning system, an altimeter, a sonar sensor, a laser sensor, or a motion sensor.

9. The system of claim 1 , wherein the extended reality headset comprises an integral camera that is configured to capture one or more images of eyes of the user wearing the extended reality headset.

10. The system of claim 9 , wherein the operations comprise:
adjusting a zoom-level of the first camera based on the one or more images of the eyes of the user that were captured by the integral camera.

11. The system of claim 9 , wherein the operations comprise:
determining, based on the one or more images of the eyes of the user that are captured by the integral camera, that the user is gazing at an object in the first video feed; and
in response to determining that the user is gazing at the object in the first video feed, providing instructions to a device that is configured to control movement of the first camera, wherein the instructions cause the first camera to lock-onto the object in the first video feed.

12. The system of claim 11 , wherein locking-onto the object includes the first camera continuously tracking the object.

13. The system of claim 1 , wherein the operations comprise:
receiving sensor data generated by one or more property monitoring sensors installed at the property, wherein the sensor data indicates an occurrence of an event in the area of the property.

14. The system of claim 1 , wherein controlling the movement of the first camera based on the movement of the headset comprises providing the positional data to a device that is configured to control movement of the first camera.

15. The system of claim 14 , wherein the device comprises one of the first camera, a monitoring system control unit, or a monitoring application server.

16. One or more non-transitory computer storage media encoded with instructions that, when executed by one or more computers, cause the one or more computers to perform operations comprising:
selecting, from among a plurality of cameras included in a property monitoring system that monitors an area of a property, a first camera for observing the area of the property;
obtaining, from one or more sensors of an extended reality headset, positional data related to a position of at least a portion of a head of a user wearing the headset;
controlling movement of the first camera based on movement of the headset using the positional data generated by the one or more sensors of the headset, the controlling comprising providing the positional data to a device that is configured to control movement of the first camera; and
providing, for presentation on a display of the headset, a first video feed including images captured by the first camera.

17. The computer storage media of claim 16 , the operations comprising:
receiving, from the extended reality headset, directional input provided by the user;
based on the directional input, selecting, from among the plurality of cameras, a second camera;
controlling movement of the second camera with movement of the headset by using the positional data generated by the one or more sensors of the headset; and
providing, for presentation on the display of the headset, a second video feed including images captured by the second camera.

18. The computer storage media of claim 17 , wherein providing, for presentation on the display of the headset, the second video feed including the images captured by the second camera comprises switching from providing the first video feed to providing the second video feed.

19. A method, comprising:
selecting, from among a plurality of cameras included in a property monitoring system that monitors an area of a property, a first camera for observing the area of the property;
obtaining, from one or more sensors of an extended reality headset, positional data related to a position of at least a portion of a head of a user wearing the headset;
controlling movement of the first camera based on movement of the headset using the positional data generated by the one or more sensors of the headset;
providing, for presentation on a display of the headset, a first video feed including images captured by the first came

Assignees

• Alarm Com Inc

Inventors

• Kerzner Daniel

Classifications

• G08B13/19682 Primary

  Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system · CPC title

• G02B27/0093

  with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking · CPC title

• G02B27/0101

  characterised by optical features (G02B27/0172 takes precedence) · CPC title

• G02B27/017

  Head mounted · CPC title

• G02B27/0179

  Display position adjusting means not related to the information to be displayed · CPC title