Systems and methods for hybrid video encoding

Patent metadata

Field	Value
Publication number	US-10863185-B2
Application number	US-201816217224-A
Country	US
Kind code	B2
Filing date	Dec 12, 2018
Priority date	Mar 10, 2015
Publication date	Dec 8, 2020
Grant date	Dec 8, 2020

Abstract

Systems and methods are provided for hybrid video encoding. An example method includes: acquiring image information; extracting a background image based at least in part on the image information; detecting whether the background image is stable; and performing encoding switching between a background-based encoding method and a non-background encoding method based at least in part on the detection.

First claim

What is claimed is:

1. A processor-implemented method for hybrid video encoding, the method comprising:
acquiring, using one or more processors, frame information;
extracting, using the one or more processors, a background image based at least in part on the frame information;
detecting, using the one or more processors, whether the background image is stable; and
performing, using the one or more processors, encoding switching between a background-based encoding method and a non-background encoding method based at least in part on the detection,
wherein performing encoding switching between a background-based encoding method and a non-background encoding method based at least in part on the detection result further includes:
recording one or more bit rates within a first time period;
detecting whether a change of the bit rates between consecutive times exceeds a third threshold value;
in response to the change of the bit rates between consecutive times not exceeding the third threshold value, continuing recording the bit rates within the first time period;
in response to the change of the bit rates between consecutive times exceeding the third threshold value, detecting whether a duration time during which the change of the bit rates exceeds the third threshold value is longer than a fourth threshold value;
in response to the duration time during which the change of the bit rates exceeds the third threshold value being longer than the fourth threshold value, performing encoding switching based at least in part on a background model; and
in response to the second time period during which the change of the bit rates exceeds the third threshold value being not longer than the fourth threshold value, continuing recording the bit rates within the first time period.

2. A system for hybrid video encoding, the system includes one or more processors embedded in a digital camera, comprising:
a bit-rate-recording processor configured to generate real-time statistics of bit rates within a first time period;
a first bit-rate-detection processor configured to detect whether a change of the bit rates between consecutive times exceeds a first threshold value and, in response to the change of the bit rates between consecutive times exceeding the first threshold value, generate a first bit-rate-sudden-change signal;
a second bit-rate-detection processor configured to, in response to the first bit-rate-sudden-change signal, detect whether a duration time during which the change of the bit rates exceeds the first threshold value is longer than a second threshold value, and in response to the duration time during which the change of the bit rates exceeds the first threshold value being longer than the second threshold value, generate a second bit-rate-sudden-change signal;
an encoding switching processor configured to perform encoding switching between a background-based encoding method and a non-background encoding method, wherein the encoding switching processor switches to background-based encoding based at least in part on the second bit-rate-sudden-change signal; and
an encoder configured to perform encoding operations based at least in part on an encoding-switching command from the encoding switching processor.

3. The system of claim 2 , further comprising:
a background modeling processor configured to extract a background image based at least in part on frame information;
a background detection processor configured to detect whether the background image is stable;
wherein the background detection processor is further configured to:
in response to the background image being stable, send a stable-background signal to the encoding switching processor to switch to the background-based encoding method; and
in response to the background image being unstable, send an unstable-background signal to the encoding switching processor to switch to the non-background encoding method.

4. The system of claim 3 , wherein the background detection processor includes:
an image preprocessing processor configured to preprocess an original frame to obtain one or more preset image formats;
a foreground image extraction processor configured to perform background modeling to extract a foreground image that includes one or more moving objects from the frame; and
a background image extraction processor configured to extract a background image from the frame based at least in part on the foreground image.

5. The system of claim 3 , wherein the background detection processor further includes:
a first background detection unit configured to perform background detection based at least in part on one or more confidence degrees of a background image and one or more background frames;
a second background detection unit configured to perform background detection based at least in part on PTZ coordinates; or
a third background detection unit configured to perform background detection based at least in part on bit rates.

6. The system of claim 5 , wherein the first background detection unit includes:
a confidence-degree-calculation processor configured to calculate a confidence degree of a background image;
a confidence-degree-detection processor configured to detect whether the confidence degree is smaller than a predetermined threshold and generate a background-frame-detection command in response to the confidence degree being not smaller than the predetermined threshold; and
a background-frame-detection processor configured to, in response to the background-frame-detection command, detect whether a background frame exists.

7. The system of claim 6 , wherein the confidence-degree-detection processor is further configured to, in response to the confidence degree being smaller than the predetermined threshold value, generate an unstable-background signal to the encoding switching processor to switch to the non-background encoding method.

8. The system of claim 5 , wherein the second background detection unit includes:
a PTZ-coordinate-acquisition processor configured to acquire current PTZ coordinates of the digital camera; and
a PTZ-coordinate-detection processor configured to detect whether the PTZ coordinates change;
wherein the PTZ-coordinate-detection processor is further configured to:
in response to a change of the PTZ coordinates being detected, send an unstable-background signal to the encoding switching processor to switch to the non-background encoding method; and
in response to a change of the PTZ coordinates not being detected, send a stable-background signal to the encoding switching processor to switch to the background-based encoding method.

Assignees

• Hangzhou Hikvision Digital Tec

Inventors

• Tong Junyan
• Pu Shiliang
• Shen Linjie
• Ma Cheng
• Hu Zhigang
• Ren Ye
• Yu Hai

Classifications

• H04N19/115 Primary

  Selection of the code volume for a coding unit prior to coding · CPC title

• H04N19/103

  Selection of coding mode or of prediction mode · CPC title

• H04N19/167

  Position within a video image, e.g. region of interest [ROI] · CPC title

• H04N19/142

  Detection of scene cut or scene change · CPC title

• H04N19/176

  the region being a block, e.g. a macroblock · CPC title