Techniques for identifying and indexing distinguishing features in a video feed

Patent metadata

Field	Value
Publication number	US-10963701-B2
Application number	US-201815889020-A
Country	US
Kind code	B2
Filing date	Feb 5, 2018
Priority date	Feb 23, 2015
Publication date	Mar 30, 2021
Grant date	Mar 30, 2021

Abstract

A method for security and/or automation systems is described. In one embodiment, the method may include receiving a plurality of video footage at a home automation system from at least one video monitor. The method may further include reviewing the plurality of video footage recorded over a predetermined period of time. The method may further include automatically identifying at least one distinguishing feature in the video footage over the predetermined period of time, and automatically indexing the video footage based, at least in part, on identifying the at least one distinguishing feature in the video footage.

First claim

What is claimed is:

1. A method for security and/or automation systems at a computing device, comprising:
receiving, at the computing device, a plurality of video footage at a premises and at least one user preference at the premises;
reviewing, by the computing device, the plurality of video footage recorded over a predetermined period of time, wherein the predetermined period of time is based at least in part on an activity of an occupant present in the plurality of video footage;
automatically detecting, by the computing device, a pattern in the received at least one user preference at the premises;
determining, by the computing device, a second user preference based at least in part on the detected pattern in the received at least one user preference;
automatically identifying, by the computing device, a first distinguishing feature in the video footage based at least in part on the received at least one user preference, the determined second user preference, and reviewing the plurality of video footage; and
automatically indexing, by the computing device, the video footage based at least in part on the first distinguishing feature, wherein the indexing comprises grouping a plurality of individual clips of the video footage that comprise the first distinguishing feature.

2. The method of claim 1 , further comprises:
automatically indexing, by the computing device, at least one extended clip of video footage based at least in part on the received at least one user preference, or the detected pattern, or a combination thereof.

3. The method of claim 1 , wherein receiving the plurality of video footage at the premises and the at least one user preference at the premises comprises:
receiving, at the computing device, the at least one user preference associated with one or more distinguishing features comprising at least the first distinguishing feature, the one or more distinguishing features to be identified in the video footage.

4. The method of claim 3 , wherein the received at least one user preference comprises one or more of an identified animate object, an audio feature, a visual feature, a time, a location, a detected increased occupancy, a detected motion, or an expression.

5. The method of claim 4 , wherein indexing the video footage comprises:
identifying, by the computing device, the plurality of individual clips of the video footage that comprise an identified common distinguishing feature corresponding to the first distinguishing feature.

6. The method of claim 1 , further comprises:
reviewing, by the computing device, the plurality of video footage recorded over the predetermined period of time based at least in part on the received at least one user preference.

7. The method of claim 1 , wherein receiving the at least one user preference comprises:
receiving, via one or more sensors coupled to the computing device, an auditory or a gestural command, or a combination thereof, from a user, wherein automatically indexing the video footage is based at least in part on the received auditory or gestural command from the user.

8. The method of claim 1 , further comprising:
monitoring, by the computing device, a currently recording video footage at the premises;
identifying, by the computing device, at least one emergency event in the currently recording video footage based at least in part on a facial recognition, a motion, a vibration, a vital sign, or a combination thereof; and
communicating an emergency alert to a third party.

9. The method of claim 1 , wherein the video footage is assembled into any of at least one thumbnail, clip, a condensed video clip, a single-cut video, a still photograph, or a combination thereof.

10. The method of claim 9 , further comprising:
displaying, at an interface of the computing device, the condensed video clip to a user of the premises; and
extending, by the computing device, the condensed video clip based at least in part on a selection received from the user.

11. An apparatus for security and/or automation systems, comprising:
a processor;
memory in electronic communication with the processor; and
instructions stored in the memory, the instructions being executable by the processor to:
receive a plurality of video footage at a premises and at least one user preference at the premises;
review the plurality of video footage recorded over a predetermined period of time, wherein the predetermined period of time is based at least in part on an activity of an occupant present in the plurality of video footage;
automatically detect a pattern in the received at least one user preference at the premises;
determine a second user preference based at least in part on the detected pattern in the received at least one user preference;
automatically identify a first at least one distinguishing feature in the video footage based at least in part on the received at least one user preference, the determined second user preference, and reviewing the plurality of video footage; and
automatically index the video footage based at least in part on the first distinguishing feature, wherein the indexing comprises grouping a plurality of individual clips of the video footage that comprise the first distinguishing feature.

12. The apparatus of claim 11 , wherein the processor is further configured to:
index at least one extended clip of video footage based at least in part on the received at least one user preference, or the detected pattern, or a combination thereof.

13. The apparatus of claim 11 , wherein the processor is further configured to:
receive the at least one user preference associated with one or more distinguishing features comprising at least the first distinguishing feature, the one or more distinguishing features to be identified in the video footage.

14. The apparatus of claim 13 , wherein the received at least one user preference comprises one or more of an identified animate object, an audio feature, a visual feature, a time, a location, a detected increased occupancy, a detected motion, or an expression.

15. A non-transitory computer-readable medium storing computer-executable code, the code executable by a processor to:
receive a plurality of video footage at a premises and at least one user preference at the premises;
review the plurality of video footage recorded over a predetermined period of time, wherein the predetermined period of time is based at least in part on an activity of an occupant present in the plurality of video footage;
automatically detect a pattern in the received at least one user preference at the premises;
determine a second user preference based at least in part on the detected pattern in the received at least one user preference;
automatically identify a first distinguishing feature in the video footage based at least in part on the received at least one user preference, the determined second user preference, and reviewing the plurality of video footage; and
automatically index the video footage based at least in part on the first distinguishing feature, wherein the indexing comprises grouping a plurality of individual clips of the video footage that comprise the first distinguishing feature.

Assignees

• Vivint Inc

Inventors

• Lin Rongbin Lanny
• Bunker Brandon
• Davis Aaron
• Liu Shiwei
• Mahar Matthew
• Eyring Matthew J
• Gordon-Carroll Clint
• Warren Jeremy B
• Nye James Ellis
• Lyman Jefferson

Classifications

• G06V20/47 Primary

  Detecting features for summarising video content · CPC title

• G11B27/031 Primary

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title

• G11B27/028

  with computer assistance · CPC title

• G11B27/30

  on the same track as the main recording · CPC title

• G06K9/00751 Primary

  Physics · mapped topic