Method, device and system for protecting privacy

Patent metadata

Field	Value
Publication number	US-12353593-B2
Application number	US-202117906939-A
Country	US
Kind code	B2
Filing date	May 25, 2021
Priority date	Jun 10, 2020
Publication date	Jul 8, 2025
Grant date	Jul 8, 2025

Abstract

The present disclosure provides a method, a device, and a system for protecting privacy. The method for protecting privacy includes: acquiring video information collected by a camera; performing video segmentation processing on the video information to obtain an original video frame; detecting whether the original video frame comprises privacy information; masking an area comprising the privacy information in the original video frame to generate a masked frame under a condition that the original video frame comprises the privacy information, and taking the masked frame as an output video frame; and taking the original video frame as the output video frame under a condition that the original video frame does not comprise the privacy information.

First claim

What is claimed is:

1. A method for protecting privacy executed by an edge device, comprising:
acquiring video information collected by a camera;
performing video segmentation processing on the video information to obtain an original video frame;
detecting whether the original video frame comprises privacy information;
masking an area comprising the privacy information in the original video frame to generate a masked frame under a condition that the original video frame comprises the privacy information, and taking the masked frame as an output video frame, wherein the masking the area comprising the privacy information in the original video frame comprises generating an image mask by using a pre-generated public key, and shielding the area comprising the privacy information in the original video frame by the image mask to generate the masked frame;
taking the original video frame as the output video frame under a condition that the original video frame does not comprise the privacy information;
extracting a certificate from an access request sent by a user terminal through a blockchain network, wherein the certificate is issued by the blockchain node to the user terminal after the user terminal passes authentication;
determining whether the user terminal has an access right according to the certificate;
providing the output video frame to the user terminal for playing under a condition that the user terminal is determined to have the access right according to the certificate;
detecting the number of generated masked frames in the process of providing the output video frame to the user terminal; and
interrupting a connection between the edge device and the blockchain network under a condition that the number of the generated masked frames is greater than a preset threshold.

2. The method according to claim 1 , further comprising:
detecting whether the masked frame comprises preset behavior information; and
sending the masked frame to a corresponding blockchain node under a condition that the masked frame comprises the preset behavior information, thereby the blockchain node storing the masked frame into a storage server.

3. The method according to claim 1 , further comprising:
removing the image mask of the masked frame in the output video frame by using the private key to obtain a video frame without the image mask under a condition that a private key provided by the user terminal is received, wherein the private key is obtained from a blockchain node by the user terminal;
sending the video frame without the image mask to the user terminal for playing.

4. The method according to claim 1 , further comprising:
interrupting the connection between the edge device and the blockchain network according to an instruction of interruption sent by the user terminal in the process of providing the output video frame to the user terminal.

5. An edge device for protecting privacy, comprising:
a memory configured to store instructions; and
a processor coupled to the memory, wherein based on the instructions stored in the memory, the processor is configured to:
acquire video information collected by a camera;
perform video segmentation processing on the video information to obtain an original video frame;
detect whether the original video frame comprises privacy information;
mask an area comprising the privacy information in the original video frame to generate a masked frame under a condition that the original video frame comprises the privacy information, and take the masked frame as an output video frame, wherein mask the area comprising the privacy information in the original video frame comprises generating an image mask by using a pre-generated public key, and shielding the area comprising the privacy information in the original video frame by the image mask to generate the masked frame;
take the original video frame as the output video frame under a condition that the original video frame does not comprise the privacy information;
extract a certificate from an access request sent by a user terminal through a blockchain network, wherein the certificate is issued by the blockchain node to the user terminal after the user terminal passes authentication;
determine whether the user terminal has an access right according to the certificate;
provide the output video frame to the user terminal for playing under a condition that the user terminal is determined to have the access right according to the certificate;
detect the number of generated masked frames in the process of providing the output video frame to the user terminal; and
interrupt a connection between the edge device and the blockchain network under a condition that the number of the generated masked frames is greater than a preset threshold.

6. A video processing device, comprising:
a camera configured to acquire video information; and
an edge device, comprising:
a memory configured to store instructions;
a processor coupled to the memory, wherein based on the instructions stored in the memory, the processor is configured to:
acquire video information collected by a camera;
perform video segmentation processing on the video information to obtain an original video frame;
detect whether the original video frame comprises privacy information;
mask an area comprising the privacy information in the original video frame to generate a masked frame under a condition that the original video frame comprises the privacy information, and take the masked frame as an output video frame, wherein mask the area comprising the privacy information in the original video frame comprises generating an image mask by using a pre-generated public key, and shielding the area comprising the privacy information in the original video frame by the image mask to generate the masked frame;
take the original video frame as the output video frame under a condition that the original video frame does not comprise the privacy information;
extract a certificate from an access request sent by a user terminal through a blockchain network, wherein the certificate is issued by the blockchain node to the user terminal after the user terminal passes authentication;
determine whether the user terminal has an access right according to the certificate;
provide the output video frame to the user terminal for playing under a condition that the user terminal is determined to have the access right according to the certificate;
detect the number of generated masked frames in the process of providing the output video frame to the user terminal; and
interrupt a connection between the edge device and the blockchain network under a condition that the number of the generated masked frames is greater than a preset threshold.

7. A system for protecting privacy, comprising:
the video processing device according to claim 6 ;
a blockchain node disposed in a blockchain network and configured to store a masked frame sent by the video processing device into a storage server, store access information and verification information of the masked frame and send the access information and the verification information of the masked frame to other blockchain nodes in the blockchain network;
the storage server configured to store the masked frame sent by the blockchain node.

8. The system according to claim 7 , wherein
the blockchain node is configured to authenticate the user terminal after receiving an access request sent by the user terminal, and issue a certificate to the user terminal after the authentication is passed, thereby the user terminal acquiring a specified masked frame in the storage server.

9. The system according to claim 8 , wherein
the storage server is configured to remove an ima

Assignees

• Beijing Wodong Tianjun Information Technology Co Ltd
• Beijing Jingdong Shangke Information Technology Co Ltd

Inventors

• Li Hongyu
• Shen Zuojun

Classifications

• H04L2209/04

  Masking or blinding · CPC title

• H04L9/50

  using hash chains, e.g. blockchains or hash trees · CPC title

• H04L9/0822

  using key encryption key · CPC title

• H04L9/3263

  involving certificates, e.g. public key certificate [PKC] or attribute certificate [AC]; Public key infrastructure [PKI] arrangements (network architectures or network communication protocols for supporting authentication of entities using certificates in a packet data network H04L63/0823) · CPC title

• G06F21/6245 Primary

  Protecting personal data, e.g. for financial or medical purposes · CPC title