System and method for warning a driver of pedestrians and other obstacles when turning

Patent metadata

Field	Value
Publication number	US-9514650-B2
Application number	US-201414173506-A
Country	US
Kind code	B2
Filing date	Feb 5, 2014
Priority date	Mar 13, 2013
Publication date	Dec 6, 2016
Grant date	Dec 6, 2016

Abstract

A system for warning of potential hazards when a vehicle is turning has a sensor coupled to the vehicle and configured to capture data of objects located around the vehicle. A control unit is coupled to the sensor for processing the data captured by the sensor to generate graphical representations of objects captured by the sensor, graphical representations of projected paths of moving objects captured; and a graphical representation of a projected turning path of the vehicle.

First claim

What is claimed is:

1. A system for warning of potential hazards when a vehicle is turning comprising:
a sensor coupled to the vehicle and configured to capture data of objects located around the vehicle;
monitoring sensors coupled to the vehicle to measure a speed and a turning angle of the vehicle; and
a control unit coupled to the sensor for processing the data captured by the sensor to:
generate graphical representations of objects captured by the sensor;
generate graphical representations of projected paths of moving objects captured by the sensors based on speeds and travel directions of the moving objects;
calculate a projected turning path of the vehicle based on the speed and the turning angle of the vehicle; and
generate a graphical representation of the projected turning path, wherein the graphical representation indicating the projected turning path of the vehicle is divided into a plurality of sections, each section having a respective indicator, wherein each indicator illustrates a probability of impact with the moving object in the respective section of the projected turning path.

2. The system of claim 1 , wherein each section is color coded to illustrate the probability of impact with the moving object in the respective section of the projected turning path.

3. The system of claim 1 , further comprising monitoring sensors coupled to the vehicle and the control unit for monitoring at least one of the turning angle or the speed of the vehicle.

4. The system of claim 1 , wherein the control unit generates the graphical representations of objects captured by the sensor, the graphical representations of projected paths of moving objects captured by the sensor, and the graphical representation of a projected turning path of the vehicle when the sensor indicates that the vehicle is turning.

5. The system of claim 1 , further comprising a Global Positioning Satellite (GPS) system coupled to the vehicle and the control unit.

6. The system of claim 5 , wherein the GPS system transfers imagery of a current location of the vehicle to the control unit, the control unit generating graphical representations of imagery transferred from the GPS of the current location.

7. The system of claim 1 , further comprising a display coupled to the control unit to show the graphical representations of objects captured by the sensor, the graphical representations of projected paths of moving objects captured by the sensor, and the graphical representation indicating the projected turning path of the vehicle.

8. The system of claim 1 , wherein the control unit comprises:
an image processing module coupled to the sensor to identify the objects detected by the sensors;
a path processing module to calculate the projected paths of moving objects detected by the sensor and the projected turning path of the vehicle; and
an Augmented Reality (AR) processing module to generate the graphical representations of the objects detected by the sensor, the graphical representations of the projected paths of the moving objects and the graphical representations indicating the projected turning path of the vehicle, wherein the projected turning path of the vehicle is dynamic and adjusts in size as the vehicle moves during the turn.

9. The system of claim 1 , wherein the graphical representations of the objects detected by the sensor are two dimensional.

10. The system of claim 1 , wherein the graphical representations of the objects detected by the sensor are three dimensional.

11. The system of claim 1 , wherein the graphical representations of the objects include a first sign associated with at least one of the objects detected by the sensor which is in a Field of View (FOV) of a driver of the vehicle.

12. The system of claim 11 , wherein the graphical representations of the objects include:
a second sign associated with at least one of the objects detected by the sensor which is outside of the FOV of the driver of the vehicle; and
a pointer sign associated with the second sign and positioned to indicate a location of the at least one of the objects detected by the sensor which is outside the FOV of the driver.

13. A system for warning of potential hazards when a vehicle is turning comprising:
image sensors coupled to the vehicle and configured to capture pedestrians located around the vehicle;
monitoring sensors coupled to the vehicle to measure speed and turning angle of the vehicle;
a control unit coupled to the image sensors and monitoring sensors for processing data from the image sensors and monitoring sensors and to:
generate graphical representations of pedestrians captured by the image sensors;
generate graphical representations of virtual crosswalks associated with pedestrians moving near the vehicle showing projected pathways of the pedestrians based on a speed and a travel direction of each of the pedestrians;
calculate a projected turning path of the vehicle based on a speed and turning angle of the vehicle; and
generate a graphical representation indicating the projected turning path of the vehicle, wherein the graphical representation indicating the projected turning path of the vehicle is divided into a plurality of sections, each section having a respective indicator, wherein each indicator illustrates a probability of impact with the moving object in the respective section of the projected turning path; and
a display to show the graphical representations of pedestrians captured by the sensor, the graphical representations of the virtual crosswalks associated with pedestrians moving near the vehicle; and the graphical representation indicating the projected turning path of the vehicle.

14. The system of claim 13 , further comprising a Global Positioning Satellite (GPS) system coupled to the vehicle and the control unit to transfer imagery of a current location of the vehicle to the control unit.

15. The system of claim 13 , wherein the control unit comprises:
an image processing module coupled to the image sensors;
a path processing module to calculate the virtual crosswalks and the projected turning path of the vehicle; and
an Augmented Reality (AR) processing module to generate the graphical representations of the pedestrians detected by the sensor, the graphical representations of the virtual crosswalks and the graphical representations indicating the projected turning path of the vehicle, wherein the projected turning path of the vehicle is dynamic and adjusts in size as the vehicle moves during the turn.

16. The system of claim 13 , wherein the control unit generates the graphical representations of pedestrians captured by the image sensors, the graphical representations of virtual crosswalks associated with pedestrians moving near the vehicle; and the graphical representations indicating the projected turning path of the vehicle when the monitoring sensors indicate that the vehicle is turning.

17. A system for warning of potential hazards when a vehicle is turning comprising:
image sensors coupled to the vehicle and configured to capture pedestrians located around the vehicle;
monitoring sensors coupled to the vehicle to measure a speed and a turning angle of the vehicle;
a control unit coupled to the image sensors and monitoring sensors for processing data from the image sensors and monitoring sensors, wherein the control unit is configured to:
generate graphical representations of pedestrians captured by the sensor;
generate graphical representations of virtual crosswalks associated with pedestrians moving near the vehicle showing projected pathways of

Assignees

• Honda Motor Co Ltd

Inventors

• Ng-Thow-Hing Victor
• Tran Cuong

Classifications

• G08G1/167

  Driving aids for lane monitoring, lane changing, e.g. blind spot detection · CPC title

• B60W2050/146

  Display means · CPC title

• B60W2554/00

  Input parameters relating to objects · CPC title

• B60W50/14

  Means for informing the driver, warning the driver or prompting a driver intervention · CPC title

• G08G1/166 Primary

  for active traffic, e.g. moving vehicles, pedestrians, bikes · CPC title