Timeline-video relationship processing for alert events

Patent metadata

Field	Value
Publication number	US-11947780-B2
Application number	US-202318184088-A
Country	US
Kind code	B2
Filing date	Mar 15, 2023
Priority date	Oct 26, 2016
Publication date	Apr 2, 2024
Grant date	Apr 2, 2024

Abstract

A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.

First claim

What is claimed is:

1. A method comprising:
detecting one or more alert events associated with a video feed;
assigning one or more alert event indicators to at least portions of the video feed for each of the detected one or more alert events;
displaying, via a display of an electronic device, a user interface having a first region and a second region, the first region of the user interface comprising the video feed, the second region of the user interface comprising:
a timeline having time increment markers and at least one alert event indicator of the one or more alert event indicators, a size of a respective alert event indicator of the one or more alert event indicators based on a temporal length of a respective portion of the video feed to which the respective alert event indicator is assigned, and a spacing between the time increment markers based on a presence and the size of one or more alert event indicators; and
a time position marker that marks a time in the timeline to which the video feed corresponds;

transitioning (i) the timeline with respect to the time position marker or (ii) the time position marker with respect to the timeline; and
displaying, in response to the transitioning, one or more portions of the video feed in the second region of the user interface corresponding to the time in the timeline indicated by time position marker.

2. The method of claim 1 , wherein:
the timeline comprises a first time increment marker, a second time increment marker, and a third time increment marker; and
the timeline comprises a first alert event indicator of the one or more alert event indicators assigned to a first portion of the video feed.

3. The method of claim 2 , wherein:
the first alert event indicator is positioned between the first time increment marker and the second time increment marker; and
a spacing between the first time increment marker and the second time increment marker is greater than a spacing between the second time increment marker and the third time increment marker.

4. The method of claim 2 , wherein:
the first alert event indicator overlaps the second time increment marker such that the first alert event indicator is positioned between the first time increment marker and the third time increment marker; and
a spacing between the first time increment marker and the second time increment marker is equal to a spacing between the second time increment marker and the third time increment marker.

5. The method of claim 2 , wherein:
the timeline comprises a second alert event indicator of the one or more alert event indicators assigned to a second portion of the video feed, the second portion of the video feed being longer than the first portion of the video feed and the second alert event indicator being greater in size than the first alert event indicator;
the first alert event indicator is positioned between the first time increment marker and the second time increment marker;
the second alert event indicator is positioned between the second time increment marker and the third time increment marker; and
a spacing between the first time increment marker and the second time increment marker is less than a spacing between the second time increment marker and the third time increment marker.

6. The method of claim 5 , wherein:
the timelines comprises a fourth time increment marker;
a spacing between the third time increment marker and the fourth time increment marker is less than a spacing between the first time increment marker and the second time increment marker.

7. The method of claim 1 , wherein the transitioning is based on user input, the user input comprising a touch input sliding gesture or scrolling gesture.

8. The method of claim 1 , wherein:
wherein the alert events include alert events of one or more alert event types, the types including one or more of the group consisting of: motion events in a defined zone, motion events not in a defined zone, hazard events, sound events, thermostat events, and door events; and
the size of the respective alert event indicator of the one or more alert event indicators is further based on a type of alert event.

9. The method of claim 8 , wherein an alert event indicator for an alert event of a first type of the alert event types differs from an alert event indicator for an alert event of a second type of the alert event types in at least one visual characteristic.

10. The method of claim 8 , wherein:
alert event indicators for alert events of a first type of the alert event types are arranged along a first linear path, parallel to the timeline, in the second region;
alert event indicators for alert events of a second type of the alert event types are arranged along a second linear path, parallel to the first linear path and to the timeline, in the second region; and
the first linear path and the second linear path are parallel to each other and to the timeline.

11. An electronic device comprising:
a display;
one or more processors; and
memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:
detecting one or more alert events associated with a video feed;
assigning one or more alert event indicators to at least portions of the video feed for each of the detected one or more alert events;
displaying, via the display, a user interface having a first region and a second region, the first region of the user interface comprising the video feed, the second region of the user interface comprising:
a timeline having time increment markers and at least one alert event indicator of the one or more alert event indicators, a size of a respective alert event indicator of the one or more alert event indicators based on a temporal length of a respective portion of the video feed to which the respective alert event indicator is assigned, and a spacing between the time increment markers based on a presence and the size of one or more alert event indicators; and

a time position marker that marks a time in the timeline to which the video feed corresponds;
transitioning (i) the timeline with respect to the time position marker or (ii) the time position marker with respect to the timeline; and
displaying, in response to the transitioning, one or more portions of the video feed in the second region of the user interface corresponding to the time in the timeline indicated by time position marker.

12. The electronic device of claim 11 , wherein:
the timeline comprises a first time increment marker, a second time increment marker, and a third time increment marker; and
the timeline comprises a first alert event indicator of the one or more alert event indicators assigned to a first portion of the video feed.

13. The electronic device of claim 12 , wherein:
the first alert event indicator is positioned between the first time increment marker and the second time increment marker; and
a spacing between the first time increment marker and the second time increment marker is greater than a spacing between the second time increment marker and the third time increment marker.

14. The electronic device of claim 12 , wherein:
the first alert event indicator overlaps the second time increment marker such that the first alert event indicator is positioned between the first time increment marker and the third time increment marker; and
a spacing between the first time increment marker and the second time increment marker is equal to a spacing between the second time increment marker and the third time increment marker.

15. The electronic devic

Assignees

• Google Llc

Inventors

• Burns Christopher Charles
• Heitz Iii George Alban
• Stewart James Edward
• Hill Cameron
• Yang Seungho
• Venters Joe Delone
• Finlayson William Alex
• Hinz Carsten
• Psiaki Timothy Samuel
• Klee Nathan Scott
• Nelson Gregory Rourk
• Avery Kevin James
• Neal Lawrence W
• Davidsson Martin

Classifications

• G06F3/0482 Primary

  Interaction with lists of selectable items, e.g. menus · CPC title

• G06F3/04817

  using icons (graphical or visual programming using iconic symbols G06F8/34) · CPC title

• G06F16/739

  in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames · CPC title

• G11B27/3081

  used signal is a video-frame or a video-field (P.I.P) · CPC title

• H04L65/61

  for supporting one-way streaming services, e.g. Internet radio · CPC title