Pedestrian counting and detection at a traffic intersection based on location of vehicle zones

Patent metadata

Field	Value
Publication number	US-9449506-B1
Application number	US-201615150258-A
Country	US
Kind code	B1
Filing date	May 9, 2016
Priority date	May 9, 2016
Publication date	Sep 20, 2016
Grant date	Sep 20, 2016

Abstract

Pedestrian detection and counting for traffic intersection control analyzes characteristics of a field of view of a traffic detection zone to determine a location and size of a pedestrian area, and applies protocols for evaluating pixel content in the field of view to identify individual pedestrians. The location and size of a pedestrian area is determined based either on locations of vehicle and bicycle detection areas or on movement of various objects within the field of view. Automatic pedestrian speed calibration with a region of interest for pedestrian detection is accomplished using lane and other intersection markings in the field of view. Detection and counting further includes identifying a presence, volume, velocity and trajectory of pedestrians in the pedestrian area of the traffic detection zone.

First claim

The invention claimed is:

1. A method, comprising:
receiving input data representing a field of view of a traffic detection zone;
analyzing the input data within a computing environment in one or more data processing modules executed in conjunction with at least one specifically-configured processor, the one or more data processing modules configured to a) identify a region in the field of view of the traffic detection zone used by one or more pedestrians, and b) accurately count the one or more pedestrians in the traffic detection zone, by
1) determining a pedestrian zone in the field of view, by a) identifying a position of at least one vehicle detection zone in nearest proximity to a stop bar, each at least one vehicle detection zone having a height that extends to or near to the stop bar, and b) calculating a height of a pedestrian area in the field of view from the height of the at least one vehicle detection zone;
2) counting the one or more pedestrians in the pedestrian zone by, a) analyzing portions of the pedestrian zone in the field of view, b) computing features of current pixel content identified in the analyzed portions by identifying part-based features defining an individual pedestrian that include one or more of body structure combinations, body shape, body width or walking gestures, c) developing a model of a single walking pedestrian to separate each individual pedestrian in a group of moving pedestrians in the field of view, by computing pedestrian features using pixels defining a pedestrian contour, d) determining a matching confidence between an individual pedestrian and a group of moving pedestrians by calculating a mathematical similarity between the computed features of current pixel content and the model of the single walking pedestrian, and e) incrementing a pedestrian count where a high matching confidence indicates that an individual pedestrian has been identified; and

generating, as output data, the pedestrian count.

2. The method of claim 1 , wherein the determining a matching confidence between an individual pedestrian and a group of moving pedestrians further comprises identifying an individual pedestrian where a matching confidence is high, and analyzing a next portion of the field of view where a matching confidence is low.

3. The method of claim 1 , wherein the identifying part-based features defining an individual pedestrian further comprises one or more of determining a width and a height of one or more object parts, comparing body structure combinations with one or more predetermined templates, and applying one or more geometric constraints to separate the part-based features.

4. The method of claim 1 , wherein the determining a pedestrian zone in the traffic detection area further comprises extending a length of the pedestrian area to a leftmost edge of the field of view, and a rightmost edge of the field of view, and extending the height of the pedestrian area into a portion of the at least one vehicle detection zone.

5. The method of claim 1 , further comprising applying a vehicle detection status to adjust sensitivity for detecting the one or more pedestrians in the pedestrian zone, the vehicle detection status including one or more of vehicular speed and traffic detection zone saturation.

6. The method of claim 5 , further comprising dynamically changing a sensitivity for detecting the one or more pedestrians in the pedestrian zone by one or both of increasing a likelihood of a pedestrian crossing when a stopped vehicle is detected or no vehicle in present, and decreasing a likelihood of a pedestrian crossing while the vehicle traffic is free flowing.

7. The method of claim 1 , wherein the input data is captured by one or more sensors in or near a traffic intersection, the one or more sensors including at least one of video cameras, a radar system, and a magnetometer.

8. The method of claim 1 , further comprising identifying one or more pedestrian characteristics in the traffic detection zone, that at least include a pedestrian presence, a pedestrian volume, a pedestrian velocity, and a pedestrian trajectory.

9. The method of claim 1 , further comprising providing the output data to a traffic management tool configured to enable a user to select a size and location of one or more of the field of view, the vehicle detection zone, and the stop bar.

10. A method of pedestrian detection and counting for traffic intersection control, comprising:
defining a position and size of a pedestrian zone in a traffic detection zone from locations of at least one vehicle detection zone relative to a stop bar within a field of view of the traffic detection zone, by a) calculating a height of a pedestrian area for the field of view from a height of the at least one vehicle detection zone, each at least one vehicle detection zone having a height that extends to or near to the stop bar, b) extending a length of the pedestrian area to a leftmost edge of the field of view, and a rightmost edge of the field of view, and c) extending the height of the pedestrian area into a portion of the at least one vehicle detection zone; and
detecting one or more pedestrians in the pedestrian zone from similarities of a model of a single walking pedestrian with part-based object recognition of individual pedestrians, by a) computing features of current pixel content identified analyzing portions of the pedestrian zone in the field of view to define individual pedestrians from the part-based object recognition of one or more of body structure combinations, body shape, body width or walking gestures, c) computing pedestrian features using pixels defining a pedestrian contour to develop the model of the single walking pedestrian to separate each individual pedestrian from a group of moving pedestrians in the field of view, d) determining a matching confidence between an individual pedestrian and a group of moving pedestrians by calculating a mathematical similarity between the computed features of current pixel content and the model of the single walking pedestrian, and identifying an individual pedestrian where a matching confidence is high, and analyzing a next portion of the pedestrian zone in the field of view where a matching confidence is low.

11. The method of claim 10 , further comprising incrementing a pedestrian count where a high matching confidence indicates that an individual pedestrian has been identified.

12. The method of claim 11 , further comprising generating an output representing the pedestrian count to an external device or location for storage or use.

13. The method of claim 10 , further comprising providing the pedestrian count to a traffic management tool, wherein the traffic management tool is configured to enable a user to select a size and location of one or more of the field of view, the vehicle detection zone, and the stop bar.

14. The method of claim 10 , wherein the identifying part-based features defining an individual pedestrian further comprises one or more of determining a width and a height of one or more object parts, comparing body structure combinations with one or more predetermined templates, and applying one or more geometric constraints to separate the part-based features.

15. The method of claim 10 , further comprising applying a vehicle detection status to adjust sensitivity for detecting the one or more pedestrians in the pedestrian zone, the vehicle detection status including one or more of vehicular speed and traffic detection zone saturation.

16. The method of claim 15 , further comprising dynamically changing a sensitivity for detecting the one or more pede

Assignees

• Iteris Inc

Inventors

• Whiting Michael T
• Gao Yan
• Swaminathan Dilip
• Shivakumar Shashank Jayaram
• Hwang Robert J
• Kreter Todd W

Classifications

• G06V10/764

  using classification, e.g. of video objects · CPC title

• G06F18/2411

  based on the proximity to a decision surface, e.g. support vector machines · CPC title

• G06V10/25

  Determination of region of interest [ROI] or a volume of interest [VOI] · CPC title

• G06V10/50

  by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis · CPC title

• G06T2207/30196

  Human being; Person · CPC title