Timeline-video relationship processing for alert events

Patent metadata

Field	Value
Publication number	US-11238290-B2
Application number	US-201615335396-A
Country	US
Kind code	B2
Filing date	Oct 26, 2016
Priority date	Oct 26, 2016
Publication date	Feb 1, 2022
Grant date	Feb 1, 2022

Abstract

A method at a server system includes: receiving a video stream from a remote video camera, wherein the video stream comprises a plurality of video frames; selecting a plurality of non-contiguous frames from the video stream, the plurality of non-contiguous frames being associated with a predetermined time interval; encoding the plurality of non-contiguous frames as a compressed video segment associated with the time interval; receiving a request from an application running on a client device to review video from the remote video camera for the time interval; and in response to the request, transmitting the video segment to the client device for viewing in the application.

First claim

What is claimed is:

1. A method, comprising:
at a server system:
receiving a video stream from a remote video camera, wherein the video stream comprises a plurality of video frames;
processing, without user input, the video stream to identify a plurality of events;
in accordance with the processing, identifying one or more events of the plurality of events;
identifying a first time interval that includes at least a portion of an identified event and a second time interval that does not include any of the identified events;
selecting, without user input, a first portion and a second portion of the plurality of video frames from the video stream, the first portion of the plurality of video frames being associated with the first time interval and having a first predefined segment time length and the second portion of the plurality of video frames being associated with the second time interval and having a second predefined segment time length;
encoding, without user input, the first portion of the plurality of video frames as a first compressed video segment and the second portion of the plurality of video frames as a second compressed video segment;
storing the first compressed video segment and the second compressed video segment;
receiving a request from an application running on a client device to review video from the remote video camera for a predetermined time interval; and
in response to the request, transmitting, to the client device for decoding and displaying in the application, the stored first compressed video segment if the predetermined time interval includes some or all of the first time interval and the stored second compressed video segment if the predetermined time interval includes some or all of the second time interval.

2. The method of claim 1 , wherein the plurality of video frames are spaced evenly.

3. The method of claim 1 , wherein the plurality of video frames are variably spaced in time, with video frames in proximity to an identified event being spaced more closely than video frames not in proximity to an identified event.

4. The method of claim 1 , wherein the first time interval has a length equal to that of the second time interval.

5. The method of claim 1 , wherein:
the first portion of the plurality of video frames comprises a first number of video frames;
the second portion of the plurality of video frames comprises a second number of video frames; and
the second number of video frames is less than the first number of video frames.

6. The method of claim 1 , wherein:
the first portion of the plurality of video frames comprises a plurality of contiguous frames; and
the second portion of the plurality of video frames comprises a plurality of non-contiguous frames.

7. The method of claim 1 , further comprising receiving event information from one or more of:
the remote video camera; and
one or more smart devices; and
wherein identifying one or more events comprises identifying one or more events in accordance with the processing and the received event information.

8. A computer system, comprising:
one or more processors; and
memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:
receiving a video stream from a remote video camera, wherein the video stream comprises a plurality of video frames;
processing, without user input, the video stream to identify a plurality of events;
in accordance with the processing, identifying one or more events of the plurality of events;
identifying a first time interval that includes at least a portion of an identified event and a second time interval that does not include any of the identified events;
selecting, without user input, a first portion and a second portion of the plurality of video frames from the video stream, the first portion of the plurality of video frames being associated with the first time interval and having a first predefined segment time length and the second portion of the plurality of video frames being associated with the second time interval and having a second predefined segment time length;
encoding, without user input, the first portion of the plurality of video frames as a first compressed video segment and the second portion of the plurality of video frames as a second compressed video segment;
storing the first compressed video segment and the second compressed video segment;
receiving a request from an application running on a client device to review video from the remote video camera for a predetermined time interval; and
in response to the request, transmitting, to the client device for decoding and displaying in the application, the stored first compressed video segment if the determined time interval includes some or all of the first time interval and the stored second compressed video segment if the predetermined time interval includes some or all of the second time interval.

9. The system of claim 8 , wherein the predetermined time interval has a length of one hour.

10. The system of claim 8 , wherein the predetermined time interval has a length of twenty minutes.

11. The system of claim 8 , wherein the plurality of video frames are spaced evenly.

12. The system of claim 8 , wherein the plurality of video frames are variably spaced in time, with video frames in proximity to an identified event being spaced more closely than video frames not in proximity to an identified event.

13. The system of claim 8 , further comprising instructions for, prior to the encoding, receiving, from the remote video camera, event information generated by the remote video camera processing the video stream.

14. The system of claim 8 , further comprising instructions for, prior to the encoding, receiving event information from one or more smart devices.

15. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by a computer system with one or more processors, cause the computer system to perform operations comprising:
receiving a video stream from a remote video camera, wherein the video stream comprises a plurality of video frames;
processing, without user input, the video stream to identify a plurality of events;
in accordance with the processing, identifying one or more events of the plurality of events;
identifying a first time interval that includes at least a portion of an identified event and a second time interval that does not include any of the identified events;
selecting, without user input, a first portion and a second portion of the plurality of video frames from the video stream, the first portion of the plurality of video frames being associated with the first time interval and having a first predefined segment time length and the second portion of the plurality of video frames being associated with the second time interval and having a second predefined segment time length;
encoding, without user input, the first portion of the plurality of video frames as a first compressed video segment and the second portion of the plurality of video frames as a second compressed video segment;
storing the first compressed video segment and the second compressed video segment;
receiving a request from an application running on a client device to review video from the remote video camera for a predetermined time interval; and
in response to the request, transmitting, to the client device for decoding and displaying in the application, the stored first compressed video segment if the predetermined time interval i

Assignees

• Google Llc

Inventors

• Burns Christopher Charles
• Heitz Iii George Alban
• Stewart James Edward
• Hill Cameron
• Yang Seungho
• Venters Joe Delone
• Finlayson William Alex
• Hinz Carsten
• Psiaki Timothy Samuel
• Klee Nathan Scott
• Nelson Gregory Rourk
• Avery Kevin James
• Neal Lawrence W
• Davidsson Martin

Classifications

• G06V20/41

  Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items (segmenting video sequences G06V20/49) · CPC title

• G06V20/44

  Event detection · CPC title

• H04N7/185 Primary

  from a mobile camera, e.g. for remote control · CPC title

• G06V20/52 Primary

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• G06K9/00718

  Physics · mapped topic