Video monitoring system with privacy features

Patent metadata

Field	Value
Publication number	US-11688257-B2
Application number	US-202117349590-A
Country	US
Kind code	B2
Filing date	Jun 16, 2021
Priority date	Sep 9, 2019
Publication date	Jun 27, 2023
Grant date	Jun 27, 2023

Abstract

A surveillance monitoring system may use a camera to detect any viewing faces visible within viewing sight of a monitor and determine whether the detected viewing faces belong to authorized individuals who are authorized to view video surveillance footage on the monitor or if any of the detected viewing faces belong to individuals who are not authorized to view video surveillance footage on the monitor. When the detected viewing faces belong only to authorized individuals, the surveillance monitoring system continues to display the video surveillance footage that includes identifiable faces without anonymizing the identifiable faces. When the detected viewing faces also include unauthorized individuals, the surveillance monitoring system may continue to display the video surveillance footage, but the surveillance monitoring system may automatically anonymize one or more of the identifiable faces seen in the video surveillance footage.

First claim

What is claimed is:

1. A method of displaying video surveillance footage on a display that can include footage of people, where the people include at least one protected group of people that are to remain anonymized when displaying the video surveillance footage to an operator and at least one unprotected group of people that are not to be anonymized when displaying the video surveillance footage to the operator, the method comprising:
analyzing the video surveillance footage to identify one or more people that belong to the at least one protected group and/or one or more people that belong to the at least one unprotected group; and
displaying the video surveillance footage on the display while anonymizing at least the faces of people within the at least one protected group of people and not anonymizing the faces of people within the at least one unprotected group of people.

2. The method of claim 1 , wherein analyzing the video surveillance footage comprises:
locating people in the video surveillance footage;
using facial recognition to identify one or more of the people locate in the video surveillance footage; and
determining which of the identified people belong to the at least one protected group and/or which of the identified people belong to the at least one unprotected group based at least in part on their identity.

3. The method of claim 1 , wherein analyzing the video surveillance footage comprises:
locating people in the video surveillance footage;
identifying one or more features of what at least some of the people located in the video surveillance footage are wearing; and
determining which of the people located in the video surveillance footage belong to the at least one protected group and/or which of the people located in the video surveillance footage belong to the at least one unprotected group based at least in part on the identified one or more features of what they are wearing.

4. The method of claim 3 , wherein the one or more features of what at least some of the people located in the video surveillance footage are wearing comprise one or more identifiable features of a uniform.

5. The method of claim 3 , wherein the one or more features of what at least some of the people located in the video surveillance footage are wearing comprise a badge.

6. The method of claim 1 , wherein analyzing the video surveillance footage comprises:
locating people in the video surveillance footage;
determining an identify of one or more of the people locate in the video surveillance footage;
determining a job category of at least some of the identified people; and
determining which of the identified people belong to the at least one protected group and/or which of the identified people belong to the at least one unprotected group based at least in part on their determined job category.

7. The method of claim 6 , wherein the job category comprises one or more of security, custodial and housekeeping.

8. The method of claim 1 , wherein analyzing the video surveillance footage comprises:
locating people in the video surveillance footage;
determining an identify of one or more of the people locate in the video surveillance footage;
determining a legal status of at least some of the identified people; and
determining which of the identified people belong to the at least one protected group and/or which of the identified people belong to the at least one unprotected group based at least in part on their determined legal status.

9. The method of claim 8 , wherein the legal status comprises one or more of being on a blacklist or being accused of a crime.

10. The method of claim 1 , further comprising determining whether an unauthorized person is in viewing sight of the display, and if so, anonymizing at least some of the faces of people within the at least one unprotected group of people.

11. A method of displaying video surveillance footage on a display that can include footage of objects, where the objects include at least one protected group of objects that are to remain anonymized when displaying the video surveillance footage to an operator and at least one unprotected group of objects that are not to be anonymized when displaying the video surveillance footage to the operator, the method comprising:
analyzing the video surveillance footage to identify one or more objects that belong to the at least one protected group and/or one or more objects that belong to the at least one unprotected group; and
displaying the video surveillance footage on the display while anonymizing at least part of the objects within the at least one protected group and not anonymizing the objects within the at least one unprotected group.

12. The method of claim 11 , wherein the objects include people.

13. The method of claim 12 , wherein displaying the video surveillance footage on the display comprises displaying the video surveillance footage on the display while anonymizing at least a face of the people within the at least one protected group and not anonymizing the faces of the people within the at least one unprotected group.

14. The method of claim 11 , wherein the objects include vehicles.

15. The method of claim 14 , wherein displaying the video surveillance footage on the display comprises displaying the video surveillance footage on the display while anonymizing at least a license plate of the vehicles within the at least one protected group and not anonymizing the license plate of the vehicles within the at least one unprotected group.

16. The method of claim 14 , wherein analyzing the video surveillance footage comprises:
locating vehicles in the video surveillance footage;
identifying one or more features of vehicles located in the video surveillance footage; and
determining which of the vehicles located in the video surveillance footage belong to the at least one protected group and/or which of the vehicles located in the video surveillance footage belong to the at least one unprotected group based at least in part on the identified one or features of the vehicles.

17. The method of claim 16 , wherein the one or more features may include one or more of a sticker that includes a recognizable indicia, an indicator displayed by a vehicle, and a license plate number of a license plate of the vehicle.

18. A non-transitory computer readable medium storing instructions, that when executed by one or more processors, causes the one or more processors to display video surveillance footage on a display that can include footage of objects, where the objects include at least one protected group of objects that are to remain anonymized when displaying the video surveillance footage to an operator and at least one unprotected group of objects that are not to be anonymized when displaying the video surveillance footage to the operator, and wherein the instructions cause the one or more processors to:
analyze the video surveillance footage to identify one or more objects that belong to the at least one protected group and/or one or more objects that belong to the at least one unprotected group; and
display the video surveillance footage on the display while anonymizing at least part of the objects within the at least one protected group and not anonymizing the objects within the at least one unprotected group.

19. The non-transitory computer readable medium of claim 18 , wherein the objects include people.

20. The non-transitory computer readable medium of claim 18 , wherein the objects include vehicles.

Assignees

• Honeywell Int Inc

Inventors

• Eswara Lalitha M
• Kattamuru Harika Sarvani
• Moosad Anagha
• Hanumegowda Bhavya
• Ganesan Balamurugan
• Kimber Jeremy
• Dhamija Vijay
• Shaik Ismaiel
• Jain Abhisekh

Classifications

• G08B13/19686 Primary

  Interfaces masking personal details for privacy, e.g. blurring faces, vehicle license plates · CPC title

• H04N7/183

  for receiving images from a single remote source · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• G06V40/161

  Detection; Localisation; Normalisation · CPC title

• G06V40/173

  face re-identification, e.g. recognising unknown faces across different face tracks · CPC title