Dynamic video exclusion zones for privacy

Patent metadata

Field	Value
Publication number	US-12114101-B2
Application number	US-202217890644-A
Country	US
Kind code	B2
Filing date	Aug 18, 2022
Priority date	Jun 24, 2019
Publication date	Oct 8, 2024
Grant date	Oct 8, 2024

Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for preserving privacy in surveillance. The methods, systems, and apparatus include actions of determining a state of a monitoring system, determining an exclusion zone that is shown in a video, determining whether to obfuscate at least a portion of the video based on the exclusion zone and the state of the monitoring system, and obfuscating at least the portion of the video.

First claim

What is claimed is:

1. A computer-implemented method comprising:
determining, from a plurality of states at least some of which are associated with corresponding obfuscation criteria, a state of a monitoring system of a property;
determining, using one or more obfuscation criteria for the state of the monitoring system, whether to obfuscate at least a portion of an exclusion zone represented by one or more portions of sensor data captured by a sensor at the property;
in response to determining to obfuscate at least the portion of the exclusion zone represented by the one or more portions of the sensor data, obfuscating, using at least some of the one or more obfuscation criteria for the state, at least the portion of the exclusion zone represented by the one or more portions of the sensor data; and
storing data for at least the obfuscated portion of the exclusion zone represented by the one or more portions of the sensor data.

2. The method of claim 1 , wherein the sensor data comprises a video sequence with one or more frames captured by a camera at the property, the method comprising:
identifying the exclusion zone in the one or more frames of the video sequence using a map of the property.

3. The method of claim 2 , wherein identifying the exclusion zone in the one or more frames of the video sequence using the map of the property comprises:
matching the one or more frames of the video sequence to the map of the property.

4. The method of claim 1 , comprising:
accessing depth data for an area within a threshold distance of a physical region represented by the exclusion zone;
detecting, using the depth data, movement of an object into the physical region represented by the exclusion zone; and
obfuscating, in at least some of the sensor data, the representation of the object, wherein the one or more portions of the sensor data encode data of the object moving into the exclusion zone.

5. The method of claim 1 , comprising:
maintaining, as at least some of the one or more obfuscation criteria, providing exclusion zone rules that indicate areas, objects, or activities to be excluded; and
providing, to one or more sensors that have access to the property, data for the exclusion zone rules to cause the sensors to determine, using the exclusion zone rules, to skip capture of data representing the indicated areas, objects, or activities.

6. The method of claim 5 , comprising:
obtaining the sensor data captured by a visiting sensor with access to the property; and
providing a notification about the exclusion zone to a device using the sensor data captured by the visiting sensor.

7. The method of claim 1 , comprising:
providing, to a device, one or more first instructions to cause the device to present the obfuscated portion of the exclusion zone; and
providing, to the device, one or more second instructions to cause the device to present information overlaid in the sensor data indicating elements of the obfuscated portion of the exclusion zone.

8. The method of claim 1 , wherein:
the sensor data comprises a video sequence; and
obfuscating at least the portion of the exclusion zone comprises obfuscating, non-visual data stored in one or more frames of the video sequence.

9. The method of claim 1 , wherein determining whether to obfuscate at least the portion of the exclusion zone comprises:
receiving, from an exclusion zone definition database, an exclusion zone definition that specifies the exclusion zone; and
determining, based on the exclusion zone definition, that the one or more portions of the sensor data represent the exclusion zone and to obfuscate at least the portion of the exclusion zone.

10. The method of claim 9 , wherein the exclusion zone definition specifies that a particular room at the property is to be obfuscated when the monitoring system is in a particular state and not obfuscated when the monitoring system is not in the particular state.

11. The method of claim 10 , wherein the particular room comprises a bathroom and the particular state comprises unarmed.

12. The method of claim 9 , wherein the exclusion zone definition specifies that in a living room, sensor data for humans are always to be obfuscated, and when the state of the monitoring system is unarmed, an entirety of the living room is to be obfuscated.

13. The method of claim 9 , comprising:
determining that the exclusion zone definition specifies that only humans are to be obfuscated in the exclusion zone during a particular arming state, wherein:
obfuscating comprises obfuscating only humans in the exclusion zone during the particular arming state.

14. The method of claim 1 , wherein determining the state of the monitoring system comprises:
receiving, from a control unit of the monitoring system, an indication that the monitoring system is unarmed.

15. The method of claim 1 , wherein obfuscating at least the portion of the exclusion zone comprises:
adjusting, for a video sequence as the sensor data, pixels in one or more frames of the video sequence.

16. The method of claim 1 , wherein obfuscating at least the portion of the exclusion zone comprises:
adjusting, for a video sequence as the sensor data, pixels in one or more frames of the video sequence that correspond to a human in the exclusion zone.

17. The method of claim 1 , wherein obfuscating at least the portion of the exclusion zone comprises:
generating, for the sensor data, metadata that specifies which portions of the sensor data should be obscured for which types of user accounts users when the sensor data is presented.

18. The method of claim 1 , wherein: determining whether to obfuscate at least the portion of the exclusion zone comprises determining, using the one or more obfuscation criteria for the state of the monitoring system of the property, whether to obfuscate at least the portion of the exclusion zone represented by the one or more portions of the sensor data captured by a sensor at the property or to skip obfuscation of the portion of the exclusion zone.

19. A system comprising:
one or more computers and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more computers to perform operations comprising:
determining, from a plurality of states at least some of which are associated with corresponding obfuscation criteria, a state of a monitoring system of a property;
determining, using one or more obfuscation criteria for the state of the monitoring system, whether to obfuscate at least a portion of an exclusion zone represented by one or more portions of sensor data captured by a sensor at the property;
in response to determining to obfuscate at least the portion of the exclusion zone represented by the one or more portions of the sensor data, obfuscating, using at least some of the one or more obfuscation criteria for the state, at least the portion of the exclusion zone represented by the one or more portions of the sensor data; and
storing data for at least the obfuscated portion of the exclusion zone represented by the one or more portions of the sensor data.

20. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
determining, from a plurality of states at least some of which are associated with corresponding obfuscation criteria, a state of a monitoring system of a property;
dete

Assignees

• Alarm Com Inc

Inventors

• Trundle Stephen Scott
• Kerzner Daniel Todd
• Madden Donald Gerard
• Berg Benjamin Asher

Classifications

• H04N23/80

  Camera processing pipelines; Components thereof · CPC title

• H04N21/45455

  applied to a region of the image · CPC title

• H04N23/635

  Region indicators; Field of view indicators · CPC title

• H04N23/611

  where the recognised objects include parts of the human body · CPC title

• H04N23/661

  Transmitting camera control signals through networks, e.g. control via the Internet · CPC title