Intelligent video processing apparatus

Patent metadata

Field	Value
Publication number	US-11869322-B2
Application number	US-202217689346-A
Country	US
Kind code	B2
Filing date	Mar 8, 2022
Priority date	Mar 27, 2018
Publication date	Jan 9, 2024
Grant date	Jan 9, 2024

Abstract

A camera includes an image processor configured to generate an image or a video data, an intelligent processor configured to perform intelligent analysis and to process on the image or the video data, and a communications interface configured to receive, from an external device, configuration information for the camera, where the configuration information extends a function of the camera.

First claim

What is claimed is:

1. A camera comprising:
an image obtaining system comprising a lens and a sensor, and configured to obtain an image or video data;
at least one type of embedded processor coupled to the image obtaining system and configured to perform intelligent analysis and processing on the image or the video data, wherein the at least one type of embedded processor comprises a central processing unit (CPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a field-programmable gate array (FPGA);
a communications interface coupled to the at least one type of embedded processor and configured to:
receive, from an external device, configuration information; and
send the configuration information to a target embedded processor of the at least one type of embedded processor according to a requirement of an application scenario, wherein the configuration information is configured to be modified according to the requirement, and wherein the configuration information extends a function of the camera and comprises at least one of:
a deep learning—based neural network model;
location topology information and control information for multi-camera cooperation;
a security control list; or
a control action indication; and

an extension interface configured to couple an extension device to the camera,
wherein the extension device is an intelligent processor that comprises an algorithm code according to the requirement of the application scenario,
wherein the at least one type of embedded processor coupled to the image obtaining system by the extension interface, and
wherein the extension interface comprises a a Universal Serial Bus (USB) interface or a thunderbolt interface.

2. The camera of claim 1 , wherein the communications interface is a wireless communications interface.

3. The camera of claim 1 , further comprising a security and management system coupled to the communications interface and configured to:
manage data and system security of the camera by setting a security control point in a data transmission path of the camera to perform authentication on transmitted data; and
store the security control list comprising a management list of the camera for external devices and comprising information about the external devices allowed to access system data of the camera.

4. The camera of claim 1 , wherein the extension interface is further configured to implement communication between the at least one type of embedded processor and the extension device.

5. The camera of claim 4 , wherein the camera is configured to:
authorize the extension device; and
use the extension device as a node to control another extension device.

6. The camera of claim 4 , further comprising a software system configured to install a software driver of the extension device to manage the extension device.

7. The camera of claim 4 , wherein the extension device is a communications interface, a storage device, or an intelligent processor.

8. The camera of claim 4 , wherein the extension interface is further configured to implement communication between the camera and the extension device using a Transmission Control Protocol (TCP)/Internet Protocol (IP) communication technology or a User Datagram Protocol (UDP) technology.

9. The camera of claim 4 , wherein the extension interface is further configured to implement communication between the camera and the extension device using a wireless communications technology, and wherein the wireless communications technology comprises a Wi-Fi technology, a ZIGBEE technology, or a BLUETOOTH technology.

10. A camera operating method applied to a camera comprising an image obtaining system, at least one type of embedded processor, and a communications interface, wherein the camera operating method comprises:
generating, by the image obtaining system, an image or video data;
performing, by the at least one type of embedded processor coupled to the image obtaining system, intelligent analysis and processing on the image or the video data, wherein the at least one type of embedded processor comprises a central processing unit (CPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or a field-programmable gate array (FPGA);
receiving, by the communications interface coupled to the at least one type of embedded processor, configuration information from an external device and sending the configuration information to a target embedded processor of the at least one type of embedded processor according to a requirement of an application scenario, wherein the configuration information is configured to be modified according to the requirement, and wherein the configuration information extends a function of the camera and comprises at least one of:
a deep learning—based neural network model;
location topology information and control information for multi-camera cooperation;
a security control list; or
a control action indication; and

coupling, by an extension interface comprised in the communications interface, an extension device to the camera,
wherein the extension device is an intelligent processor that comprises an algorithm code according to the requirement of the application scenario,
wherein the at least one type of embedded processor coupled to the image obtaining system by the extension interface, and
wherein the extension interface comprises a a Universal Serial Bus (USB) interface or a thunderbolt interface.

11. The camera operating method of claim 10 , wherein the communications interface is a wireless communications interface.

12. The camera operating method of claim 10 , wherein the communications interface is a fixed communications interface.

13. The camera operating method of claim 10 , further comprising:
managing, by a security and management system of the camera, data and system security of the camera by setting a security control point in a data transmission path of the camera to perform authentication on transmitted data; and
storing, by the security and management system, the security control list comprising a management list of the camera for external devices and comprising information about the external devices allowed to access system data of the camera.

14. The camera operating method of claim 10 , further comprising implementing, by the extension interface, communication between the camera and the extension device.

15. The camera operating method of claim 14 , further comprising constructing the extension device to be authorized by the camera.

16. The camera operating method of claim 14 , wherein the extension device is a communications interface, a storage device, or an intelligent processor.

17. The camera operating method of claim 14 , further comprising implementing, by the extension interface, communication between the camera and the extension device using a Transmission Control Protocol (TCP)/Internet Protocol (IP) communication technology.

18. A computer program product comprising computer-executable instructions that are stored on a non-transitory computer readable storage medium and that, when executed by a processor, cause a camera to:
generate, by an image obtaining system, an image or video data, wherein the camera comprises the image obtaining system, at least one type of embedded processor, and a communications interface;
perform, by the at least one type of embedded processor coupled to the image obtaining system, intelligent analysis and processing on the image or the video data, wherein the at least one type o

Assignees

• Huawei Tech Co Ltd

Inventors

• Zhou Yan
• Zhang Aijun

Classifications

• G06N3/0464

  Convolutional networks [CNN, ConvNet] · CPC title

• G08B13/1966 Primary

  Wireless systems, other than telephone systems, used to communicate with a camera · CPC title

• G06N3/08

  Learning methods · CPC title

• G08B13/19623

  Arrangements allowing camera linear motion, e.g. camera moving along a rail cable or track · CPC title

• G08B13/19656

  Network used to communicate with a camera, e.g. WAN, LAN, Internet · CPC title