Method and device for recognizing non-motorized road users

Patent metadata

Field	Value
Publication number	US-2016012301-A1
Application number	US-201414766961-A
Country	US
Kind code	A1
Filing date	Apr 22, 2014
Priority date	Apr 22, 2013
Publication date	Jan 14, 2016
Grant date	—

Abstract

A method and apparatus for the automatic recognition of gestures or visual signals made by non-motorized road users (pedestrians, cyclists, traffic police, crossing guards, horse riders, etc.) in the vicinity of a motor vehicle. Images recorded by a digital camera on-board the motor vehicle are analyzed to determine whether a person is directing a traffic-related visual message at the driver of the motor vehicle. Indicators of whether the person's message is directed at the driver include the person's head orientation, body orientation, and visual direction. If the message is directed at the driver, the content of the message is determined and the driver is informed of the content.

First claim

1 - 9 . (canceled)

10 . A method of operating an image recognition system of a motor vehicle comprising:
analyzing images from a camera relative to a first criteria set to evaluate a probability that a person is directing a visual message at a driver of the vehicle; if the probability exceeds a threshold value, analyzing the images relative to a second criteria set to interpret a content of the message; and notifying the driver of the content.

11 . The method of claim 10 , wherein the first criteria set comprises at least one of a location of the person in a road environment, a viewing direction, a head orientation, and a body orientation.

12 . The method of claim 10 , wherein the second criteria set comprises at least one of an arm position of the person and equipment associated with the person.

13 . The method of claim 10 , wherein analysis of the image relative to at least one of the first and the second criteria sets comprises comparison of the image with pre-stored patterns.

14 . The method of claim 10 , further comprising:
activating a driver assistance system of the motor vehicle if the message matches a pre-stored traffic-related.

15 . The method of claim 14 , wherein the driver assistance system is activated only if a driver reaction appropriate to the message is not detected within a time limit after the driver is notified.

16 . The method of claim 10 , further comprising modifying a method used to interpret the content based upon an observed driver reaction to the message.

17 . A method of operating an image recognition system of a motor vehicle comprising:
analyzing images from a camera relative to a first criteria set to determine that a person is directing a visual message at a driver of the vehicle; only if the message is directed at the driver, analyzing the images relative to a second criteria set to interpret a content of the message; and notifying the driver of the content.

18 . The method of claim 17 , wherein the first criteria set comprises at least one of a location of the person in a road environment, a viewing direction, a head orientation, and a body orientation.

19 . The method of claim 17 , wherein the second criteria set comprises at least one of an arm position of the person and equipment associated with the person.

20 . The method of claim 17 , wherein analysis of the image relative to at least one of the first and the second criteria sets comprises comparison of the image with pre-stored patterns.

21 . The method of claim 17 , further comprising:
activating a driver assistance system of the motor vehicle if the message matches a pre-stored traffic-related.

22 . The method of claim 21 , wherein the driver assistance system is activated only if a driver reaction appropriate to the message is not detected within a time limit after the driver is notified.

23 . The method of claim 17 , further comprising modifying a method used to interpret the content based upon an observed driver reaction to the message.

24 . A method of operating an image recognition system of a motor vehicle comprising:
analyzing images from a camera relative to a first criteria set to determine that a person is directing a visual message at a driver of the vehicle; only if the message is directed at the driver, analyzing the images relative to a second criteria set to interpret a content of the message; notifying the driver of the content; and activating a driver assistance system of the motor vehicle if the message matches a pre-stored traffic-related and a driver reaction appropriate to the message is not detected within a time limit.

25 . The method of claim 24 , wherein the first criteria set comprises at least one of a location of the person in a road environment, a viewing direction, a head orientation, and a body orientation.

26 . The method of claim 25 , wherein the body orientation is evaluated by generating a vector perpendicular to a shoulder plane of the person, and determining whether the vector points toward the vehicle.

27 . The method of claim 24 , wherein the second criteria set comprises at least one of an arm position of the person and equipment associated with the person.

28 . The method of claim 24 , wherein the analysis of the image relative to at least one of the first and the second criteria sets comprises comparison of the image with pre-stored patterns.

29 . The method of claim 24 , further comprising modifying a method used to interpret the content based upon an observed driver reaction to the message.

Assignees

• Ford Global Tech Llc

Inventors

• Arndt Christoph
• Gussen Uwe
• Stefan Frederic
• Wegner Goetz-Philipp

Classifications

• G06F2218/12

  Classification; Matching · CPC title

• G06V40/107 Primary

  Static hand or arm · CPC title

• G06V20/58

  Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads · CPC title

• G06K9/4604

  Physics · mapped topic

• G06K9/00845

  Physics · mapped topic