Selection and tracking of objects for display partitioning and clustering of video frames

Patent metadata

Field	Value
Publication number	US-9589595-B2
Application number	US-201414575945-A
Country	US
Kind code	B2
Filing date	Dec 18, 2014
Priority date	Dec 20, 2013
Publication date	Mar 7, 2017
Grant date	Mar 7, 2017

Abstract

A method includes selecting at least two objects within a primary video stream, generating a first video stream from the primary video stream that includes a first of the selected objects, and generating a second video stream from the primary video stream that includes a second of the selected objects. The primary video stream has a primary field of view, and the first and second video streams have respective first and second fields of view that are more narrow than the primary field of view. The first field of view includes a portion of the primary field of view that is not within the second field of view, and the second field of view includes a portion of the primary field of view that is not within the first field of view.

First claim

What is claimed is:

1. A method of video processing, the method comprising:
receiving a first selection of a first object represented within a primary video stream that has a primary field of view;
in response to receiving the first selection, generating, from the primary video stream, a first video stream including the first object and having a first field of view that is narrower than the primary field of view;
receiving a second selection of a second object represented within the primary video stream; and
in response to receiving the second selection, generating, from the primary video stream, a second video stream including the second object and having a second field of view that is narrower than the primary field of view,
wherein the first video stream is generated prior to receiving the second selection and video corresponding to the second video stream is displayed on a screen while video corresponding to the first video stream is displayed on the screen, and wherein the first field of view includes a portion of the primary field of view that is not within the second field of view and the second field of view includes a portion of the primary field of view that is not within the first field of view.

2. The method of video processing according to claim 1 , further comprising:
detecting, within at least one of a first plurality of frames of the primary video stream or a second plurality of frames of the first video stream, a movement of the first object; and
changing a direction of the first field of view in response to detecting the movement.

3. The method of video processing according to claim 2 , wherein changing the direction of the first field of view comprises changing the direction to follow the movement of the first object.

4. The method of video processing according to claim 1 , wherein generating the first video stream comprises generating each frame of the first video stream from a portion of at least one corresponding frame of the primary video stream.

5. The method of video processing according to claim 1 , wherein, for each frame of the first video stream, a first distance between a first coordinate position of a centroid of a first representation of the first object within the frame and a center coordinate of the frame is less than a second distance between a second coordinate position of a centroid of a second representation of the first object within a corresponding frame of the primary video stream and a center coordinate of the corresponding frame.

6. The method of video processing according to claim 1 , wherein generating the first video stream comprises normalizing a size of a representation of the first object within each of a first plurality of frames of the first video stream.

7. The method of video processing according to claim 1 , wherein generating the first video stream comprises normalizing at least one of brightness, contrast, or white balance within each of a first plurality of frames of the first video stream.

8. The method of video processing according to claim 1 , further comprising:
displaying, on the screen, the first video stream within a first window; and
displaying, on the screen, the second video stream within a second window.

9. The method of video processing according to claim 1 , further comprising displaying on the screen an indication of a geometric relationship between the first object and the second object.

10. The method of video processing according to claim 8 , further comprising:
determining that, in a first frame of the primary video stream, the first object is closer to a first frame edge of the first frame than the second object is to the first frame edge;
subsequent to determining that the first object is closer to the first frame edge, determining that, in a second frame of the primary video stream, the second object is closer to a second frame edge of the second frame than the first object is to the second frame edge, the second frame edge corresponding to the first frame edge; and
in response to determining that the second object is closer to the second frame edge, displaying the second video stream within the first window and displaying the first video stream within the second window.

11. The method of video processing according to claim 8 , further comprising:
subsequent to displaying the first video stream within the first window, determining that the second object overlaps the first object in at least one of a frame of the primary video stream, a frame of the first video stream, or a frame of the second video stream; and
in response to determining that the second object overlaps the first object, displaying the second video stream within the first window and displaying the first video stream within the second window.

12. The method of video processing according to claim 8 , further comprising:
generating, from the primary video stream, a display video stream having a secondary field of view that is narrower than the primary field of view;
displaying, within a third window of the screen, the display video stream; and
in response to detecting that at least one of the first object or the second object is near an edge of a frame of the display video stream, changing the display video stream to have a tertiary field of view, wherein the tertiary field of view has a wider angle than the secondary field of view.

13. The method of video processing according to claim 1 , wherein the first object is a robotic object, and wherein the method further comprises controlling a movement of the robotic object.

14. A non-transitory computer-readable medium storing instructions that when executed by a processor, cause the processor to:
receive a first selection of a first object represented within a primary video stream that has a primary field of view;
generate from the primary video stream, in response to receiving the first g selection, a first video stream including the first object and having a first field of view that is narrower than the primary field of view;
receive a second selection of a second object represented within the primary video stream; and
generate from the primary video stream, in response to receiving the second selection, a second video stream including the second object and having a second field of view that is narrower than the primary field of view,
wherein the first video stream is generated prior to receiving the second selection and video corresponding to the second video stream is displayed on a screen while video corresponding to the first video stream is displayed on the screen, and wherein the first field of view includes a portion of the primary field of view that is not within the second field of view and the second field of view includes a portion of the primary field of view that is not within the first field of view.

15. The non-transitory computer-readable medium according to claim 14 , the medium storing instructions that when executed by the processor, cause the processor to:
detect a movement of the first object based on at least one of a first plurality of frames of the primary video stream or a second plurality of frames of the first video stream; and
change a direction of the first field of view, in response to said detecting the movement of the first object, to follow the movement of the first object.

16. The non-transitory computer-readable medium according to claim 14 , wherein the instructions to generate the first video stream comprise instructions that, when executed by the processor, cause the processor to normalize a size of a representation of the first object within each

Assignees

• Qualcomm Inc

Inventors

• Gao Dashan
• Zhong Xin
• Kandhadai Ananthapadmanabhan Arasanipalai
• Beith Scott
• Laver Steven Douglas

Classifications

• G06F3/0484 Primary

  for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range · CPC title

• G11B27/031 Primary

  Electronic editing of digitised analogue information signals, e.g. audio or video signals · CPC title

• G08B13/19

  using infrared-radiation detection systems {(G08B13/194 takes precedence)} · CPC title

• H04N7/18

  Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast · CPC title

• G06T7/2053

  Physics · mapped topic