Method and system for generating a smart time-lapse video clip

Patent metadata

Field	Value
Publication number	US-10977918-B2
Application number	US-201916252480-A
Country	US
Kind code	B2
Filing date	Jan 18, 2019
Priority date	Jul 7, 2014
Publication date	Apr 13, 2021
Grant date	Apr 13, 2021

Abstract

An electronic device with a display, processor(s), and memory displays a video monitoring user interface. The interface includes a video window displaying video feed from a camera located remotely from the device. A subset of the video includes a first motion event associated with an event category and a second motion event not associated with the event category. The device detects a user request for video playback. In response to the request, the device identifies a segment of the video for playback. The segment includes a first portion associated with the first motion event and a second portion associated with the second motion event. The device causes generation of a time-lapse video clip of the segment of the video for playback, including configuring the first portion to play at a different speed from the second portion. The device displays and plays the video clip of the segment.

First claim

What is claimed is:

1. A method performed at an electronic device having a display, one or more processors and memory storing instructions for execution by the one or more processors, the method comprising:
displaying a video monitoring user interface on the display, the video monitoring user interface including a video window displaying video of a scene captured by a camera located remotely from the electronic device, wherein a subset of the video includes a plurality of motion events including a first motion event associated with a first motion event category of a plurality of motion event categories and a second motion event not associated with the first motion event category, and wherein the first motion event corresponds to a first user-defined zone of interest within the scene and the second motion event corresponds to a second user-defined zone of interest within the scene, distinct from the first zone of interest;
detecting a user request for video playback of only the subset;
in response to the request:
identifying a first portion of the subset associated with the first motion event and a second portion of the subset associated with the second motion event;
causing generation of a time-lapse video clip of the subset of the video for playback, including configuring the first portion to play at a different speed from the second portion; and
displaying and playing in the video monitoring user interface the video clip of the subset of the video, including playing the first portion at a different speed from the second portion.

2. The method of claim 1 , wherein the video monitoring user interface further includes:
an event timeline including a plurality of time indicators each indicating a time in history; and
a plurality of event indicators each indicating a motion event.

3. The method of claim 2 , wherein:
the event timeline is displayed as a linear bar; and
the plurality of time indicators is arranged temporally along the linear bar.

4. The method of claim 3 , wherein the subset includes a start time and an end time, the start time being a time in history and the end time being a time in history more recent than the start time, and a subset of the plurality of time indicators is arranged between the start time and the end time.

5. The method of claim 4 , wherein the time-lapse video clip is a video clip of events that occurred between the start time and the end time.

6. The method of claim 4 , wherein detecting the user request for video playback comprises detecting a user input comprising a sliding, adjustable window overlaid on the event timeline that extends between the start time and the end time.

7. The method of claim 1 , further comprising displaying and playing concurrently with the video clip of the subset of the video a start time indicator and an end time indicator of the segment.

8. An electronic device, comprising:
a display;
one or more processors; and
memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:
displaying a video monitoring user interface on the display, the video monitoring user interface including a video window displaying video of a scene captured by a camera located remotely from the electronic device, wherein a subset of the video includes a plurality of motion events including a first motion event associated with a first motion event category of a plurality of motion event categories and a second motion event not associated with the first motion event category, and wherein the first motion event corresponds to a first user-defined zone of interest within the scene and the second motion event corresponds to a second user-defined zone of interest within the scene, distinct from the first zone of interest;
detecting a user request for video playback of only the subset;
in response to the request:
identifying a first portion of the subset associated with the first motion event and a second portion of the subset associated with the second motion event;
causing generation of a time-lapse video clip of the subset of the video for playback, including configuring the first portion to play at a different speed from the second portion; and
displaying and playing in the video monitoring user interface the video clip of the subset of the video, including playing the first portion at a different speed from the second portion.

9. The electronic device of claim 8 , further comprising instructions for: relaying the video from the camera to the electronic device via a remote server.

10. The electronic device of claim 8 , further comprising instructions for: receiving the video directly from the camera.

11. The electronic device of claim 8 , further comprising instructions for:
displaying in the video monitoring user interface a plurality of time indicators.

12. The electronic device of claim 11 , wherein at least one of the time indicators corresponds to an audio event previously detected by the camera.

13. The electronic device of claim 12 , wherein the instructions for displaying and playing the video clip in the video monitoring device the video clip of the subset of the video includes instructions for playing the audio event previously detected by the camera differently from the remainder of the subset.

14. The electronic device of claim 8 , wherein:
the electronic device is a mobile device;
the display is a touch-screen display; and
the instructions for detecting the user request for video playback of only the subset further comprises instructions for detecting a user tap of the touch-screen.

15. The electronic device of claim 8 , wherein the instructions for causing generation of the time-lapse video clip of the subset of the video for playback includes instructions for:
sending information indicative of the subset to a remote server; and
causing the remote server to generate the time-lapse video clip.

16. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by an electronic device with a display and one or more processors, cause the electronic device to perform operations comprising:
displaying a video monitoring user interface on the display, the video monitoring user interface including a video window displaying video of a scene captured by a camera located remotely from the electronic device, wherein a subset of the video includes a plurality of motion events including a first motion event associated with a first motion event category of a plurality of motion event categories and a second motion event not associated with the first motion event category, and wherein the first motion event corresponds to a first user-defined zone of interest within the scene and the second motion event corresponds to a second user-defined zone of interest within the scene, distinct from the first zone of interest;
detecting a user request for video playback of only the subset;
in response to the request:
identifying a first portion of the subset associated with the first motion event and a second portion of the subset associated with the second motion event;
causing generation of a time-lapse video clip of the subset of the video for playback, including configuring the first portion to play at a different speed from the second portion; and
displaying and playing in the video monitoring user interface the video clip of the subset of the video, including playing the first portion at a different speed from the second portion.

17. The non-transitory co

Assignees

• Google Llc

Inventors

• Laska Jason N
• Nelson Greg R
• Duffy Greg
• Mitsuji Hiro
• Neal Lawrence W
• Hill Cameron

Classifications

• H04L63/0428 Primary

  wherein the data content is protected, e.g. by encrypting or encapsulating the payload · CPC title

• G08B13/19604

  involving reference image or background adaptation with time to compensate for changing conditions, e.g. reference image update on detection of light level change · CPC title

• H04N23/651

  for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera · CPC title

• H04N23/65

  Control of camera operation in relation to power supply · CPC title

• H04N23/6815

  by distinguishing pan or tilt from motion · CPC title