Method, device, and storage medium for processing webcam data

Patent metadata

Field	Value
Publication number	US-10972703-B2
Application number	US-201916257245-A
Country	US
Kind code	B2
Filing date	Jan 25, 2019
Priority date	Jan 31, 2018
Publication date	Apr 6, 2021
Grant date	Apr 6, 2021

Abstract

Methods and systems for processing webcam data are disclosed. According to some disclosed embodiments, the method includes: determining data to be processed; sending a control request to a server to request a task initiation permission for a webcam cluster; in response to an authorization instruction of the server, determining property information of each webcam in the webcam cluster; segmenting the data based on the property information of each webcam, to generate a plurality of data segments; sending each of the plurality of data segments to a corresponding webcam in the webcam cluster for processing; receiving intermediate results generated by the webcam cluster on the basis of the plurality of data segments; and combining the intermediate results into a final result.

First claim

What is claimed is:

1. A webcam data processing method performed by a processor, the method comprising:
determining, at a webcam, data to be processed;
sending, at the webcam, a control request to a server to request a task initiation permission for a webcam cluster;
in response to an authorization instruction of the server, acquiring, at the webcam, property information of each webcam in the webcam cluster from the server;
segmenting, at the webcam, the data to be processed on the basis of the property information of each webcam, to generate a plurality of data segments;
sending, at the webcam, each of the plurality of data segments to a corresponding webcam in the webcam cluster for processing;
receiving, at the webcam, intermediate results generated by the webcam cluster on the basis of the plurality of data segments; and
combining, at the webcam, the intermediate results into a final result.

2. The data processing method of claim 1 , wherein the property information comprises available computational capacity and information interaction time delay.

3. The data processing method of claim 2 , wherein the segmenting the data to be processed on the basis of the property information of each webcam comprises:
computing a weight coefficient for each webcam on the basis of the property information of each webcam, the weight coefficient being proportional to the available computational capacity of each webcam and inversely proportional to the information interaction time delay of each webcam;
computing a computational load to be undertaken by each webcam on the basis of the weight coefficient of each webcam, the computational load being proportional to the available computational capacity of each webcam and inversely proportional to the information interaction time delay of each webcam; and
segmenting the data to be processed on the basis of the computational load to be undertaken by each webcam.

4. The data processing method of claim 1 , wherein the final result is a feature of a person and the method further comprises:
sending the final result to the server to determine the identity of the person by matching the final result against features of persons registered in a database.

5. The data processing method of claim 1 , wherein the sending each of the plurality of data segments to a corresponding webcam in the webcam cluster for processing comprises:
performing compression coding on each of the plurality of data segments to obtain a compressed data segment; and
sending the compressed data segment to the corresponding webcam.

6. The data processing method of claim 1 , wherein the sending each of the plurality of data segments to a corresponding webcam in the webcam cluster for processing comprises:
sending at least one computational module to the corresponding webcam, wherein the at least one computational module is utilized by the corresponding webcam to compute and determine the intermediate result.

7. The data processing method of claim 6 , wherein the sending the at least one computational module to the corresponding webcam comprises:
performing compression coding on the at least one computational module; and
after the compression coding is performed, sending the at least one computational module to the corresponding webcam.

8. The data processing method of claim 1 , wherein the method further comprises:
receiving a cluster update instruction sent by the server, the cluster update instruction including a cluster identification and one or more webcam identifications in the cluster identification;
establishing a peer-to-peer connection with webcams pointed to by the one or more webcam identifications in the cluster identification; and
feeding the cluster identification back to the server.

9. The data processing method of claim 1 , wherein the webcam cluster includes a first webcam and one or more other webcams, and the method further comprises:
periodically sending current webcam characteristic metrics of the first webcam to the one or more other webcams in the webcam cluster, the webcam characteristic metrics indicating at least one of a working state, a network connection speed, or a bandwidth of a webcam.

10. The data processing method of claim 9 , wherein the method further comprises:
periodically sending to the server the current webcam characteristic metrics of the first webcam and current webcam characteristic metrics of the one or more other webcams.

11. A webcam data processing device mounted on a webcam, wherein the device comprises:
a memory storing instructions; and
a processor configured to execute the instructions to:
determine data to be processed;
send a control request to a server to request a task initiation permission for a webcam cluster;
in response to an authorization instruction of the server, acquire a property information of each webcam in the webcam cluster from the server;
segment the data to be processed on the basis of the property information of each webcam, to generate a plurality of data segments;
send each of the plurality of data segments to a corresponding webcam in the webcam cluster for processing;
receive intermediate results generated by the webcam cluster on the basis of the plurality of data segments; and
combine the intermediate results of all the webcams into a final result.

12. The data processing device of claim 11 , wherein the property information comprises available computational capacity and information interaction time delay.

13. The data processing device of claim 12 , wherein the processor is further configured to execute the instructions to:
compute a weight coefficient for each webcam on the basis of the property information of each webcam, the weight coefficient being proportional to the available computational capacity of each webcam and inversely proportional to the information interaction time delay of each webcam;
compute a computational load to be undertaken by each webcam on the basis of the weight coefficient of each webcam, the computational load being proportional to the available computational capacity of each webcam and inversely proportional to the information interaction time delay of each webcam; and
segment the data to be processed on the basis of the computational load to be undertaken by each webcam.

14. The data processing device of claim 11 , wherein the final result is a feature of a person and the processor is further configured to execute the instructions to:
send the final result to the server to determine the identity of the person by matching the final result against features of persons registered in a database.

15. The data processing device of claim 14 , wherein the webcam cluster includes a first webcam and one or more other webcams, and the processor is further configured to execute the instructions to:
periodically send current webcam characteristic metrics of the first webcam to the one or more other webcams in the webcam cluster, the webcam characteristic metrics indicating at least one of a working state, a network connection speed, or a bandwidth of a webcam.

16. The data processing device of claim 11 , wherein the processor is further configured to execute the instructions to:
perform compression coding on each of the plurality of data segments to obtain a compressed data segment; and
send the compressed data segment to a corresponding webcam in the webcam cluster.

17. The data processing device of claim 11 , wherein in sending each of the plurality of data segments to a corresponding webcam in the webcam cluster, the processor is f

Assignees

• Shanghai Xiaoyi Tech Co Ltd

Inventors

• Yu Lichun
• Chen Zhiyong
• Huang Hua

Classifications

• G06V20/52 Primary

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• H04L67/60

  Scheduling or organising the servicing of application requests, e.g. requests for application data transmissions using the analysis and optimisation of the required network resources (admission control or resource allocation H04L47/70) · CPC title

• G06V40/173

  face re-identification, e.g. recognising unknown faces across different face tracks · CPC title

• G06V20/30

  in albums, collections or shared content, e.g. social network photos or video · CPC title

• G06V40/172

  Classification, e.g. identification · CPC title