Subsumption architecture for processing fragments of a video stream

Patent metadata

Field	Value
Publication number	US-10708635-B2
Application number	US-201715453722-A
Country	US
Kind code	B2
Filing date	Mar 8, 2017
Priority date	Mar 2, 2017
Publication date	Jul 7, 2020
Grant date	Jul 7, 2020

Abstract

The disclosure includes a system and method for distributing video segments of a video to one or more brokers based on topics and storing the video segments in a distributed commit log associated with the topics. A video processing application decomposes a video into fragments, groups the fragments into topics based on identifiers associated with the fragments, breaks the fragments into a sequence of segments, distributes the sequence of segments to one or more brokers based on the topics, and stores, by the one or more brokers, the sequence of segments associated with a topic in a distributed commit log while preserving a sequence order of the sequence of segments.

First claim

What is claimed is:

1. A computer-implemented method comprising:
decomposing a video into fragments;
breaking the fragments into a sequence of segments, each fragment being associated with a topic;
writing the sequence of segments in a plurality of commit logs that are part of a distributed commit log by appending the sequence of segments to an end of each partition of each commit log of the plurality of commit logs based on the topic to preserve a sequence order of the sequence of segments;
receiving first sensor data including positioning data;
receiving second sensor data including volume occupancy data;
filtering the first sensor data by using the second sensor data as a first control sequence to generate an output sequence;
reading the distributed commit log for the sequence of segments; and
using the output sequence as a second control sequence to filter the sequence of segments to identify a subset of the sequence of segments for provision.

2. The computer-implemented method of claim 1 , further comprising:
dividing the topic into a plurality of partitions; and
assigning the plurality of partitions of the topic to a plurality of commit logs.

3. The computer-implemented method of claim 1 , wherein the sensor is one of a Wi-Fi sensor, a Bluetooth sensor, a depth sensor, or a capture device.

4. The computer-implemented method of claim 1 , further comprising grouping the fragments into topics based on identifiers associated with the fragments, wherein writing the sequence of segments in the plurality of commit logs that are part of the distributed commit log is based on the topics.

5. The computer-implemented method of claim 4 , wherein grouping the fragments into the topics comprises grouping the fragments of the video from a capture device into a topic associated with the capture device.

6. The computer-implemented method of claim 4 , wherein grouping the fragments into the topics comprises assigning a single fragment representing the video to a singleton topic.

7. The computer-implemented method of claim 4 , wherein decomposing the video into fragments further comprises identifying a salient portion from the video and determining a subset of frames of the video including the salient portion as a fragment.

8. The computer-implemented method of claim 1 , further comprising:
receiving a query from a user;
responsive to the query, identifying and writing the segments into the distributed commit log.

9. A system comprising:
one or more processors; and
a memory, the memory storing instructions, which when executed cause the one or more processors to:
decompose a video into fragments;
break the fragments into a sequence of segments, each fragment being associated with a topic;
write the sequence of segments in a plurality of commit logs that are part of a distributed commit log by appending the sequence of segments to an end of each partition of each commit log of the plurality of commit logs based on the topic to preserve a sequence order of the sequence of segments;
receive first sensor data including positioning data;
receive second sensor data including and volume occupancy data;
filter the first sensor data by using the second sensor data as a first control sequence to generate an output sequence;
read the distributed commit log for the sequence of segments; and
use the output sequence as a second control sequence to filter the sequence of segments to identify a subset of the sequence of segments for provision.

10. The system of claim 9 , wherein the instructions further cause the one or more processors to:
divide the topic into a plurality of partitions; and
assign the plurality of partitions of the topic to a plurality of commit logs.

11. The system of claim 9 , wherein the sensor is one of a Wi-Fi sensor, a Bluetooth sensor, a depth sensor, or a capture device.

12. The system of claim 9 , wherein the instructions further cause the one or more processors to:
group the fragments into topics based on identifiers associated with the fragments; and
write the sequence of segments in the plurality of commit logs that are part of the distributed commit log based on the topics.

13. The system of claim 12 , wherein to group the fragments into the topics, the instructions cause the one or more processors to group the fragments of the video from a capture device into a topic associated with the capture device.

14. The system of claim 12 , wherein, to decompose the video into fragments, the instructions cause the one or more processors to:
identify a salient portion from the video; and
determine a subset of frames of the video including the salient portion as a fragment.

15. The system of claim 9 , wherein the instructions cause the one or more processors to:
receive a query from a user;
responsive to the query, identify and write the segments into the distributed commit log.

16. A computer program product comprising a non-transitory computer readable medium storing a computer readable program, wherein the computer readable program when executed causes a computer to:
decompose a video into fragments;
break the fragments into a sequence of segments, each fragment being associated with a topic;
write the sequence of segments in a plurality of commit logs that are part of a distributed commit log by appending the sequence of segments to an end of each partition of each commit log of the plurality of commit logs based on the topic to preserve a sequence order of the sequence of segments;
receive first sensor data including positioning data;
receive second sensor data including volume occupancy data;
filter the first sensor data by using the second sensor data as a first control sequence to generate an output sequence;
read the distributed commit log for the sequence of segments; and
use the output sequence as a second control sequence to filter the sequence of segments to identify a subset of the sequence of segments for provision.

17. The computer program product of claim 16 , wherein the computer readable program causes the computer to:
divide the topic into a plurality of partitions; and
assign the plurality of partitions of the topic to a plurality of commit logs.

18. The computer program product of claim 16 , wherein the sensor is one of a Wi-Fi sensor, a Bluetooth sensor, a depth sensor, or a capture device.

19. The computer program product of claim 16 , wherein the computer readable program causes the computer to:
group the fragments into topics based on identifiers associated with the fragments; and
write the sequence of segments in the distributed commit log based on the topics.

20. The computer program product of claim 19 , wherein to group the fragments into the topics, the computer readable program causes the computer to group the fragments of the video from a capture device into a topic associated with the capture device.

Assignees

• Gonzalez Banos Hector H
• Mcfarland Max
• Narasimha Ramya
• Ricoh Co Ltd

Inventors

• Gonzalez-Banos Hector H
• Mcfarland Max
• Narasimha Ramya

Classifications

• H04L65/762 Primary

  at the source  (reformatting of additional data in video distribution servers H04N21/2355) · CPC title

• G06V20/52

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title

• G06F16/785

  using colour or luminescence · CPC title

• G06F16/2379

  Updates performed during online database operations; commit processing · CPC title

• H04N21/2353

  specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata · CPC title