Timeline-video relationship presentation for alert events

Patent metadata

Field	Value
Publication number	US-11609684-B2
Application number	US-202117346622-A
Country	US
Kind code	B2
Filing date	Jun 14, 2021
Priority date	Oct 26, 2016
Publication date	Mar 21, 2023
Grant date	Mar 21, 2023

Abstract

A method at an electronic device with a display includes: displaying a user interface having a first region and a second region; receiving, and displaying in the first region of the user interface, a live video stream of a physical environment captured by a remote video camera; displaying, in the second region, a timeline corresponding to a timespan for a first portion of a duration during which the live video stream may have been recorded; in response to receiving a user interaction to move the timespan to a second portion of the duration, transitioning the displayed timeline to a new timeline that corresponds to the timespan for the second portion, and while transitioning, displaying, in the first region, a subset of video frames representing the first and/or second portion of the duration.

First claim

What is claimed is:

1. A method comprising:
displaying, via a display of an electronic device, a user interface having a first region and a second region;
obtaining a video stream having a plurality of video frames;
displaying, in response to obtaining, a first set of video frames in the first region of the user interface, the first set of video frames including at least one video frame from the plurality of video frames;
displaying, in the second region of the user interface:
a timeline; and
a position marker on the timeline;

transitioning the timeline with respect to the position marker; and
in response to transitioning the timeline, displaying, in the first region of the user interface, a second set of video frames corresponding to a location of the position marker on the timeline, the second set of video frames including at least one video frame from the plurality of video frames not included in the first set of video frames.

2. The method of claim 1 , further comprising:
receiving information indicating one or more alert events within a timespan; and
in accordance with the information indicating one or more alert events, displaying on the timeline an alert event indicator for each of the alert events within the timespan.

3. The method of claim 2 , wherein the alert events include alert events of one or more alert event types, the types including one or more of the group consisting of: motion events in a defined zone, motion events not in a defined zone, hazard events, sound events, thermostat events, and door events.

4. The method of claim 3 , wherein an alert event indicator for an alert event of a first type of the alert event types differs from an alert event indicator for an alert event of a second type of the alert event types in at least one visual characteristic.

5. The method of claim 4 , wherein the differing visual characteristic is color.

6. The method of claim 3 , wherein:
alert event indicators for alert events of a first type of the alert event types are arranged along a first linear path, parallel to the timeline, in the second region;
alert event indicators for alert events of a second type of the alert event types are arranged along a second linear path, parallel to the first linear path and to the timeline, in the second region; and
the first linear path and the second linear path are parallel to each other and to the timeline.

7. The method of claim 3 , further comprising:
displaying in the second region one or more event type icons, each event type icon associated with an alert event indicator and indicating an event type of an alert event to which the alert event indicator corresponds.

8. An electronic device comprising:
a display;
one or more processors; and
memory storing one or more programs to be executed by the one or more processors, the one or more programs comprising instructions for:
displaying, via the display of the electronic device, a user interface having a first region and a second region;
obtaining a video stream having a plurality of video frames;
displaying, in response to obtaining, a first set of video frame in the first region of the user interface, the first set of video frames including at least one video frame from the plurality of video frames;
displaying, in the second region of the user interface:
a timeline; and
a position marker on the timeline;

transitioning the timeline with respect to the position marker; and
in response to transitioning the timeline, displaying, in the first region of the user interface, a second set of video frames corresponding to a location of the position marker on the timeline, the second set of video frames including at least one video frame from the plurality of video frames not included in the first set of video frames.

9. The electronic device of claim 8 , further comprising instructions for:
receiving information indicating one or more alert events within a timespan; and
in accordance with the alert events information, displaying on the timeline an alert event indicator for each of the alert events within the timespan.

10. The electronic device of claim 9 , wherein:
the first set of video frames is associated with an alert event of the alert events;
the second set of video frames is not associated with an alert event;
the first set of video frames has a first frame rate; and
the second set of video frames has a second frame rate lower than the first frame rate.

11. The electronic device of claim 9 , wherein the alert event indicator for an alert event comprises a graphical object, the graphical object having a length parallel to the timeline, the length representing a duration of the alert event.

12. The electronic device of claim 9 , further comprising instructions for:
displaying a plurality of consecutive time increments, the plurality of consecutive time increments corresponding to a cumulative time duration and not associated with any alert event; and
while displaying the plurality of consecutive time increments, displaying in the second region a first affordance to collapse the plurality of consecutive time increments into a cumulative time increment in the timeline, the cumulative time increment corresponding to the cumulative time duration;
detecting a user interaction activating the first affordance; and
in response to detecting the user interaction activating the first affordance, replacing display of the plurality of consecutive time increments with display of the cumulative time increment.

13. The electronic device of claim 12 , further comprising instructions for:
while displaying the cumulative time increment, displaying in the second region a second affordance to expand the cumulative time increment into the plurality of consecutive time increments;
detecting a user interaction activating the second affordance; and
in response to detecting the user interaction activating the second affordance, replacing display of the cumulative time increment with display of the plurality of consecutive time increments.

14. The electronic device of claim 9 , further comprising instructions for:
displaying in the second region a thumbnail associated with a first alert event indicator of the alert event indicators;
wherein:
the thumbnail is displayed proximate to the first alert event indicator; and
the thumbnail comprises a frame from a recorded portion of the video stream proximate in time to an alert event to which the first alert event indicator corresponds.

15. The electronic device of claim 14 , further comprising instructions for:
displaying in the second region, for a predefined time increment unit on the timeline, up to a predefined number of thumbnails associated with respective alert event indicators.

16. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which, when executed by one or more processors, cause the one or more processors to perform operations comprising:
displaying, via a display associated with an electronic device, a user interface having a first region and a second region;
obtaining a video stream having a plurality of video frames;
displaying, in response to obtaining, a first set of video frames in the first region of the user interface, the first set of video frames including at least one video frame from the plurality of video frames;
displaying, in the second region of the user interface:
a timeline; and
a position marker on the timeline;

transitioning the timeline with respect to the position marker; and
in response to t

Assignees

• Google Llc

Inventors

• Burns Christopher Charles
• Heitz Iii George Alban
• Stewart James Edward
• Hill Cameron
• Yang Seungho
• Venters Joe Delone
• Finlayson William Alex
• Hinz Carsten
• Psiaki Timothy Samuel
• Klee Nathan Scott
• Nelson Gregory Rourk
• Avery Kevin James
• Neal Lawrence W
• Davidsson Martin

Classifications

• H04N21/2387

  Stream processing in response to a playback request from an end-user, e.g. for trick-play · CPC title

• H04N21/47217 Primary

  for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks (specific graphical features in visual interfaces H04N21/4312) · CPC title

• H04N21/4316

  for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window · CPC title

• H04N21/8456

  by decomposing the content in the time domain, e.g. in time segments · CPC title

• G05B15/02

  electric · CPC title