Distributed target tracking using self localizing smart camera networks

Patent metadata

Field	Value
Publication number	US-9449233-B2
Application number	US-201113309543-A
Country	US
Kind code	B2
Filing date	Dec 1, 2011
Priority date	Dec 1, 2010
Publication date	Sep 20, 2016
Grant date	Sep 20, 2016

Abstract

A plurality of camera devices are configured to localize one another based on visibility of each neighboring camera in an image plane. Each camera device captures images and identifies sightings of candidate targets. The camera device share information about sightings and triangulate positions of targets. Targets are matched to known tracks based on prior images, allowing targets to be tracked in a 3D environment.

First claim

What is claimed is:

1. A method of tracking one or more targets moving through an environment, comprising:
a first camera device capturing a first image of one or more targets as it moves through an image plane of the first camera device;
a second camera device receiving a second image of the one or more targets as it moves through an image plane of the second camera device;
extracting a first set of one or more target sightings in the first image and a second set of one or more target sightings in the second image, each target sighting of the first and second sets of one or more target sightings comprising:
a target bearing to a respective target;
a state vector for the respective target, the state vector comprising an indication of a position and a velocity of the respective target along a target track;
an indication of a time associated with the respective target; and
an indication of a unique identifier that identifies the respective target;
triangulating, based at least in part on target bearings of the first and second sets of one or more target sightings, to create a third set of target sightings;
matching at least a subset of the third set of target sightings to one or more target tracks maintained by the first camera device;
updating matched target tracks with at least said subset of the third set of target sightings and forming new target tracks for unmatched target tracks; and
communicating, by the first camera device to the second camera device, at least one updated track that was matched by the matching step and updated in the updating step.

2. The method of claim 1 , wherein the second image is received over a peer- to-peer wireless network.

3. The method of claim 1 , further comprising storing, based on the matching, information associated with at least one track in a database of the first camera device.

4. The method of claim 3 , further comprising the step of displaying the track information.

5. The method of claim 1 , further comprising deleting a first subset of one or more known tracks maintained by the first camera device if the first subset of known tracks fails to match any of third set of target sightings after a predetermined amount of time.

6. The method of claim 1 , wherein the matching further comprises choosing an oldest known track when more than one known track matches at least one target sighting.

7. The method of claim 1 , further comprising transmitting information about target tracks, by the first camera device, wherein an intended recipient of the transmitted information about target tracks comprises a neighboring camera device.

8. A device for tracking one or more targets through an environment comprising:
first and second camera devices;
a processor; and
memory coupled to the processor, the memory comprising executable instructions that when executed by the processor cause the processor to effectuate operations comprising:
capturing a first image of one or more targets as it moves through an image plane of the first camera device;
extracting a first set of one or more target sightings in the first image;
receiving a second image of the one or more targets as it moves through an image plane of the second camera device; and
extracting a second set of the one or more target sightings in the second image, wherein each target sighting of the first and second of target sightings comprises a target bearing to a respective target, a state vector for the respective target, the state vector comprising an indication of a position and a velocity of the respective target along a target track, an indication of a time associated with the respective target, and an indication of a unique identifier that identifies the respective target;
triangulating, based at least in part on target bearings of the first and second target sightings, to create a third set of target sightings;
matching at least a subset of the third set of target sightings to one or more target tracks maintained by the first camera device;
updating matched target tracks with at least said subset of the third set of target sightings and forming new target tracks for unmatched target tracks; and
communicating from the first camera device to the second camera device at least one updated track that was matched by the matching and updated by the updating.

9. The device of claim 8 , the operations further comprising:
exchanging information with the second camera device over a peer-to-peer wireless network.

10. The device of claim 8 , further comprising memory configured to store at least one updated track in a database of the first camera device based on the matching step.

11. The device of claim 8 , the operations further comprising:
deleting a first subset of one or more known tracks if the first subset of known tracks fails to match any of the third set of target sightings after a predetermined amount of time.

12. The device of claim 8 , the operations further comprising:
choosing an oldest known track when more than one known track matches at least one target sighting.

13. The device of claim 8 , the operations further comprising:
transmitting information about target tracks from the first camera device to a neighboring camera device.

14. The device of claim 13 , further comprising a display that displays the track information.

Assignees

• Taylor Camillo Jose
• Univ Pennsylvania

Inventors

• Taylor Camillo Jose

Classifications

• G06T7/0081

  Physics · mapped topic

• G06T2207/30241

  Trajectory · CPC title

• G06K9/00771 Primary

  Physics · mapped topic

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• G06T7/2093

  Physics · mapped topic