Alert generation based on event detection in a video feed

Patent metadata

Field	Value
Publication number	US-12100213-B2
Application number	US-202117501126-A
Country	US
Kind code	B2
Filing date	Oct 14, 2021
Priority date	Oct 23, 2020
Publication date	Sep 24, 2024
Grant date	Sep 24, 2024

Abstract

Methods, systems and computer program products, for processing a stream of image frames captured by a camera system. A hardcoded alert image frame is generated in response to detecting an event. The hardcoded alert image frame includes motion deltas and/or color changes with respect to an event image frame. A stream of encoded image frames is generated, in which stream the hardcoded alert image frame is inserted in display order after the encoded event image frame.

First claim

The invention claimed is:

1. A method in a camera system for processing and transmitting a stream of image frames, comprising:
in response to detecting an event and by means of an image processing pipeline, IPP, generating a hardcoded alert image frame, wherein the hardcoded alert image frame includes motion deltas and/or color changes with respect to an event image frame of the stream of image frames, and wherein the hardcoded alert image frame is generated in software to produce a desired change in a video stream when displayed to an operator thereby alerting the operator of the event;
by means of an encoder, generating a stream of encoded image frames based on the stream of image frames, the stream of encoded image frames including an encoded event image frame; and inserting the hardcoded alert image frame generated by the IPP in the stream of encoded image frames in display order after the encoded event image frame, wherein the hardcoded alert image frame is an inter-image frame with reference to the encoded event image frame; and
transmitting the stream of encoded image frames from the camera system to a client for display thereon of a decoded version of the stream of encoded image frames.

2. The method of claim 1 , further comprising:
encoding the event image frame as a no-display image frame.

3. The method of claim 1 , wherein the event is either an event detected in an event image frame in a stream of image frames, or an external event.

4. The method of claim 1 , wherein the motion deltas include motion relative to the event image frame in a horizontal direction, in a vertical direction, and any combination thereof.

5. The method of claim 1 , wherein the motion deltas have a configurable size or a pre-defined size.

6. The method of claim 1 , wherein the motion deltas are applied only to a portion of the alert image frame.

7. The method of claim 1 , wherein the color changes include one or more of: a more colorful representation relative to the event image frame, a less colorful representation relative to the event image frame, and a changing color representation relative to the event image frame.

8. The method of claim 1 , wherein the color changes are applied only to a portion of the alert image frame.

9. The method of claim 2 , further comprising:
in response to an input from an operator, removing the no-display status of the event image frame and changing the status of the alert image frames to no-display, in order to enable the operator to view the event captured by the camera system ( 108 ).

10. The method of claim 1 , wherein the alert image frame is one of:
a forward predicted frame, P-frame, containing motion deltas relative to the event image frame and a bidirectional frame, B-frame, containing motion deltas relative to the event image frame.

11. The method of claim 1 , wherein the generating of the hardcoded alert image frame comprises:
generating the hardcoded alert image frame based on an alert image frame generated outside the camera system.

12. The method of claim 1 , wherein the event image frame is a reference frame for a Group of Pictures, GOP.

13. A camera system, comprising:
a lens and an image sensor configured to capture a stream of image frames;
an image processing pipeline, IPP, configured to:

in response to detecting an event, generate a hardcoded alert image frame, wherein the hardcoded alert image frame includes motion deltas and/or color changes with respect to an event image frame of the stream of image frames, and wherein the hardcoded alert image frame is generated in software to produce a desired change in a video stream when displayed to an operator thereby alerting the operator of the event; and
an encoder configured to:
generate a stream of encoded image frames based on the stream of image frames, the stream of encoded image frames including an encoded event image frame; and
insert the hardcoded alert image frame generated by the IPP in the stream of encoded image frames in display after the encoded event image frame, wherein the hardcoded alert image frame is an inter-image frame with reference to the encoded event image frame; and

wherein the camera system is configured to transmit the stream of encoded image frames from the camera system to a client for display thereon of a decoded version of the stream of encoded image frames.

14. A non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions being executable by a processor to perform a method comprising:
in response to detecting an event, generating a hardcoded alert image frame, wherein the hardcoded alert image frame includes motion deltas and/or color changes with respect to an event image frame of the stream of image frames, and wherein the hardcoded alert image frame is generated in software to produce a desired change in a video stream when displayed to an operator thereby alerting the operator of the event;
generating a stream of encoded image frames based on the stream of image frames, the stream of encoded image frames including an encoded event image frame; and
inserting the hardcoded alert image frame is inserted in the stream of encoded image frames in display order after the encoded event image frame, wherein the hardcoded alert image frame is an inter-image frame with reference to the encoded event image frame; and
transmitting the stream of encoded image frames to a client for display thereon of a decoded version of the encoded image frames.

15. The method of claim 1 , wherein the motion deltas and/or color changes are predetermined.

Assignees

• Axis Ab

Inventors

• Edpalm Viktor
• Yuan Song
• Saleem Adnan
• Such Rodrigo

Classifications

• H04N9/646

  for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters · CPC title

• H04N7/183 Primary

  for receiving images from a single remote source · CPC title

• G08B5/22

  using electric transmission; using electromagnetic transmission · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title

• H04N7/188

  Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position (signal generation from motion picture films H04N5/253) · CPC title