Adaptive video end-to-end network with local abstraction

Patent metadata

Field	Value
Publication number	US-2018063406-A1
Application number	US-201715673144-A
Country	US
Kind code	A1
Filing date	Aug 9, 2017
Priority date	Dec 24, 2014
Publication date	Mar 1, 2018
Grant date	—

Abstract

An adaptive video end-to-end network is described that uses local abstraction. One example includes an image sensor to generate a sequence of images, a processor coupled to the image sensor to analyze the sequence of images to detect an event, to select images related to the event and to generate metadata regarding the event, and a communications interface coupled to the processor to send the metadata information through a network connection to a central node.

First claim

1 - 19 . (canceled)

20 . An apparatus comprising:
an object detection device to detect an object in one particular a category in a video and to extract a frame portion including an object in the one category from a frame of the video; and a video encoder coupled to said object detection device to encode at least one frame portion with the extracted object and less than all of the frame, and to send out the encoded frame portion of the video frame depicting an object in said category to a vision-based analysis system, the encoded frame portion including less than all the data of the frame in the video, and the vision-based analysis system, when coupled to said video encoder, to receive the encoded portion and to perform vision-based analysis on the portion.

21 . The apparatus of claim 20 including a video imaging device that detects only one category of objects.

22 . The apparatus of claim 21 wherein said category is one of a license plate and a human face.

23 . The apparatus of claim 20 wherein said video encoder to perform spatial compression.

24 . The apparatus of claim 20 said video imaging device to send out data for one of detection, tracking and recognition.

25 . The apparatus of claim 20 including a server coupled to said video encoder to perform vision-based analysis.

26 . The apparatus of claim 20 including a video imaging device coupled to said object detection device.

27 . The apparatus of claim 26 wherein the vision-based analysis system is coupled to said video encoding.

28 . One or more non-transitory computer readable media storing instructions executed by a processor to perform a sequence comprising:
detecting an object in one particular a category in a video and to extract a frame portion including an object in the one category from a frame of the video; encoding at least one frame portion with the extracted object and less than all of the frame; and sending out the encoded frame portion of the video frame depicting an object in said category to a vision-based analysis system, the encoded frame portion including less than all the data of the frame in the video, and the vision-based analysis system, when coupled to said video encoder, to receive the encoded portion and to perform vision-based analysis on the portion.

29 . The media of claim 28 , further storing instructions to detect only one category of objects.

30 . The media of claim 29 , wherein said category is one of a license plate and a human face.

31 . The media of claim 28 , further storing instructions to perform spatial compression.

32 . The media of claim 28 , further storing instructions to send out data for one of detection, tracking and recognition.

33 . The media of claim 28 , further storing instructions to perform vision-based analysis.

34 . An apparatus comprising:
means for detecting an object in one particular a category in a video and to extract a frame portion including an object in the one category from a frame of the video; and means for encoding at least one frame portion with the extracted object and less than all of the frame, and sending out the encoded frame portion of the video frame depicting an object in said category to a vision-based analysis system, the encoded frame portion including less than all the data of the frame in the video, and the vision-based analysis system, when coupled to said video encoder, to receive the encoded portion and to perform vision-based analysis on the portion.

35 . The apparatus of claim 34 including a video imaging device that detects only one category of objects.

36 . The apparatus of claim 35 wherein said category is one of a license plate and a human face.

37 . The apparatus of claim 34 wherein said video encoder to perform spatial compression.

38 . The apparatus of claim 34 said video imaging device to send out data for one of detection, tracking and recognition.

39 . The apparatus of claim 34 including a server coupled to said video encoder to perform vision-based analysis.

40 . The apparatus of claim 34 including a video imaging device coupled to said object detection device.

41 . The apparatus of claim 34 wherein the vision-based analysis system is coupled to said video encoding.

42 . A system comprising:
a processor; and a storage storing instructions to be executed by the processor to perform a sequence comprising: detecting an object in one particular a category in a video; extracting a frame portion including an object in the one category from a frame of the video; encoding at least one frame portion with the extracted object and less than all of the frame; and sending out the encoded frame portion of the video frame depicting an object in said category to a vision-based analysis system, the encoded frame portion including less than all the data of the frame in the video, and the vision-based analysis system, when coupled to said video encoder, to receive the encoded portion and to perform vision-based analysis on the portion.

43 . The system of claim 42 including a video imaging device that detects only one category of objects.

44 . The system of claim 43 wherein said category is one of a license plate and a human face.

45 . The system of claim 42 wherein said video encoder to perform spatial compression.

46 . The system of claim 42 said video imaging device to send out data for one of detection, tracking and recognition.

47 . The system of claim 42 including a server coupled to said video encoder to perform vision-based analysis.

48 . The system of claim 42 including a video imaging device coupled to said object detection device.

49 . The system of claim 48 wherein the vision-based analysis system is coupled to said video encoding.

50 . A system comprising:
an apparatus including:
an object detection device to detect an object in one particular a category in a video and to extract a frame portion including an object in the one category from a frame of the video; and
a video encoder coupled to said object detection device to encode at least one frame portion with the extracted object and less than all of the frame, and to send out the encoded frame portion of the video frame depicting an object in said category to a vision-based analysis system, the encoded frame portion including less than all the data of the frame in the video, and the vision-based analysis system, when coupled to said video encoder, to receive the encoded portion and to perform vision-based analysis on the portion; and
a camera coupled to said apparatus.

51 . The system of claim 50 , said camera to detect only one category of objects.

52 . The system of claim 51 wherein said category is one of a license plate and a human face.

53 . The system of claim 50 wherein said video encoder to perform spatial compression.

54 . The system of claim 50 said camera to send out data for one of detection, tracking and recognition.

55 . The system of claim 50 including a server coupled to said video encoder to perform vision-based analysis.

56 . The system of claim 50 including a video imaging device coupled to said object detection device.

Assignees

• Intel Corp

Inventors

• Yang Shao Wen
• Chen Yen Kuang

Classifications

• H04N23/90

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N23/661 Primary

  Transmitting camera control signals through networks, e.g. control via the Internet · CPC title

• H04N23/61

  based on recognised objects · CPC title

• H04N7/181 Primary

  for receiving images from a plurality of remote sources · CPC title

• H04N5/23206 Primary

  Electricity · mapped topic