Trailer track estimation system and method by image recognition

Patent metadata

Field	Value
Publication number	US-9852346-B2
Application number	US-201414542270-A
Country	US
Kind code	B2
Filing date	Nov 14, 2014
Priority date	Oct 7, 2014
Publication date	Dec 26, 2017
Grant date	Dec 26, 2017

Abstract

The present invention provides a trailer track estimation system by image recognition including: an image photographing unit which photographs a trailer which is connected to a rear side of a vehicle; a control unit which estimates a connection angle of the trailer using an image photographed by the image photographing unit; and a display unit which displays a value estimated by the control unit on a screen.

First claim

What is claimed is:

1. A trailer track estimation system using image recognition, the system comprising:
an image photographing unit which photographs a trailer which is connected to a rear side of a vehicle;
a control unit which estimates a connection angle of the trailer using first and second images photographed by the image photographing unit; and
a display unit which displays the connection angle estimated by the control unit on a screen,
wherein the control unit is configured to estimate the connection angle of the trailer using a ratio between a first distance and a second distance, the first distance being a distance between two feature points on the first image when the trailer is aligned with the vehicle, the second distance being a distance between the two feature points on the second image when the trailer is misaligned with the vehicle, and
wherein the connection angle of the trailer is estimated such that the first distance is defined as Δx1 and the second distance is defined as Δx1′ and the estimated connection angle θ of the trailer is calculated according to the following equation:
cos θ=Δ x 1′/Δ x 1.

2. The system of claim 1 , wherein the image photographing unit is a rear view camera of the vehicle.

3. The system of claim 2 , wherein the rear view camera is a CCD camera or a CMOS camera.

4. The system of claim 1 , wherein the first distance is determined when the vehicle is stopped, and the second distance is determined when the vehicle is moving.

5. The system of claim 4 , wherein the two feature points are corners of a rectangle, and the first and second distances correspond a side of the rectangle.

6. The system of claim 5 , wherein the first and second distances are measured by calculating a number of pixels between the feature points photographed by the image photographing unit.

7. The system of claim 1 , wherein the display unit is a display of a navigation system which is mounted in the vehicle.

8. The system of claim 1 , wherein the connection angle is estimated by averaging a plurality of estimated angle values.

9. A trailer track estimation method by image recognition, the method comprising:
receiving basic data of a vehicle;
determining whether a gear of the vehicle is a reverse gear;
displaying images of the vehicle and the trailer on a display unit when the gear is a reverse gear; and
estimating, by the trailer track estimation system of claim 1 , the connection angle of the trailer from the image which is displayed on the display; and
displaying a track of the trailer on the display unit.

10. The method of claim 9 , wherein the receiving of basic data uses CAN communication.

11. The method of claim 9 , wherein the display unit is a head-up display.

12. The method of claim 9 , further comprising:
when the gear of the vehicle is not a reverse gear,
determining whether a speed of the vehicle exceeds a predetermined speed;
determining whether a rotational angle of the trailer exceeds a predetermined angle when the speed of the vehicle exceeds the predetermined speed; and
issuing a warning to a driver when the rotational angle of the trailer exceeds the predetermined angle.

13. The method of claim 12 , wherein the predetermined speed and the predetermined angle are defined as a speed and an angle at which danger to control stability is caused in accordance with a mechanical property of the vehicle.

14. The method of claim 12 , wherein the rotational angle of the trailer is used for a stability control system.

15. The method of claim 12 , wherein the issuing of a warning includes issuing a warning to a display unit which is mounted in the vehicle.

16. The method of claim 12 , wherein the issuing of a warning is issued using a system which is recognized by a driver, wherein the system includes at least one of audio, vibrator and light source in the vehicle.

17. A method for estimating an angle between a vehicle and a trailer attached to the vehicle, the method comprising:
capturing a first image of a front face of the trailer by a camera mounted on the vehicle when the trailer is aligned with the vehicle;
capturing a second image of the front face of the trailer by the camera when the trailer is misaligned with the vehicle;
transmitting the first and second images from the camera to a control unit coupled to the camera;
determining, by the control unit, a ratio between a first distance between two feature points of the front face of the trailer in the first image to a second distance between the two feature points in the second image;
estimating, by the control unit, the connection angle between the vehicle and the trailer based on the ratio; and
displaying the estimated connection angle on a display screen,
wherein the connection angle of the trailer is estimated such that the first distance is defined as Δx1 and the second distance is defined as Δx1′ and the estimated connection angle θ of the trailer is calculated according to the following equation:
cos θ=Δ x 1′/Δ x 1.

18. The method of claim 17 , wherein the first and second feature points are oriented in a first direction, the method further comprising:
determining, by the control unit, a ratio between a third distance between the first feature point and a third feature point in the first image and a fourth distance between the first feature point and a third feature point in the second image,
wherein an orientation of the first and second distances is orthogonal to an orientation of the third and fourth distances.

Assignees

• Hyundai Mobis Co Ltd

Inventors

• Min Jae Hong

Classifications

• B60R1/00

  Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles · CPC title

• B60D1/245 Primary

  for facilitating push back or parking of trailers · CPC title

• G06K9/00791 Primary

  Physics · mapped topic

• B60D1/62

  involving supply lines, electric circuits or the like · CPC title

• B62D13/06

  for backing a normally drawn trailer · CPC title