Trailer angle detection using rear backup camera

Patent metadata

Field	Value
Publication number	US-10532698-B2
Application number	US-201816033416-A
Country	US
Kind code	B2
Filing date	Jul 12, 2018
Priority date	Jul 14, 2017
Publication date	Jan 14, 2020
Grant date	Jan 14, 2020

Abstract

A method for determining trailer angle includes determining angles of a trailer hitch relative to a data recording device via an angle measuring device while the trailer hitch pivots about a hitch ball of the device. While the trailer hitch pivots about the hitch ball of the device, trailer hitch information is determined responsive to processing of captured image data and responsive to determined angles of the trailer hitch. After determining trailer hitch information, data representative of the determined information is provided to an electronic device, which is disposed at a vehicle having a rear backup camera that has a field of view that encompasses a hitch ball of the vehicle and at least a portion of a hitch of a trailer hitched to the vehicle. Using the provided data, and responsive to processing of captured image data, an angle of the trailer relative to the vehicle is determined.

First claim

The invention claimed is:

1. A method for determining trailer angle, said method comprising:
providing a data recording device;
wherein the data recording device has a camera disposed thereat;
wherein the camera has a field of view that encompasses a hitch ball of the data recording device;
wherein the data recording device comprises a processor operable to process image data captured by the camera;
hitching a trailer hitch at the hitch ball of the data recording device and pivoting the trailer hitch about the hitch ball of the data recording device;
capturing image data via the camera while the trailer hitch pivots about the hitch ball of the data recording device;
determining angles of the trailer hitch relative to the data recording device via an angle measuring device while the trailer hitch pivots about the hitch ball of the data recording device;
while the trailer hitch pivots about the hitch ball of the data recording device, determining trailer hitch information responsive to processing by the processor of image data captured by the camera and responsive to determined angles of the trailer hitch relative to the data recording device as determined by the angle measuring device;
after determining trailer hitch information, providing data representative of the determined trailer hitch information to an electronic device;
equipping a vehicle with the electronic device, wherein the equipped vehicle has a hitch ball at a rear portion of the equipped vehicle, and wherein the equipped vehicle is equipped with a rear backup camera;
hitching a hitch of a trailer to the hitch ball at the rear portion of the equipped vehicle;
wherein the rear backup camera has a field of view that encompasses the hitch ball at the rear portion of the equipped vehicle and at least a portion of the hitch of the trailer hitched to the hitch ball at the rear portion of the equipped vehicle;
capturing image data via the rear backup camera and processing, via a processor at the equipped vehicle, image data captured by the rear backup camera as the equipped vehicle and trailer move along a road;
using the data representative of the determined trailer hitch information that was provided to the electronic device, and responsive to processing by the processor of image data captured by the rear backup camera, determining an angle of the trailer relative to the equipped vehicle as the equipped vehicle and trailer move along the road;
wherein determining the angle of the trailer relative to the equipped vehicle comprises use of a neural network; and
wherein determining the angle of the trailer comprises use of a convolution neural network having a plurality of micro convolution neural networks, and wherein said method comprises detecting a type of the trailer using the micro convolution neural networks.

2. A method for determining trailer angle, said method comprising:
providing a data recording device;
wherein the data recording device has a camera disposed thereat;
wherein the camera has a field of view that encompasses a hitch ball of the data recording device;
wherein the data recording device comprises a processor operable to process image data captured by the camera;
hitching a trailer hitch at the hitch ball of the data recording device and pivoting the trailer hitch about the hitch ball of the data recording device;
capturing image data via the camera while the trailer hitch pivots about the hitch ball of the data recording device;
determining angles of the trailer hitch relative to the data recording device via an angle measuring device while the trailer hitch pivots about the hitch ball of the data recording device;
wherein the angle measuring device comprises an electromechanical device that is disposed at a hitch joint between the trailer hitch and the hitch ball of the data recording device;
while the trailer hitch pivots about the hitch ball of the data recording device, determining trailer hitch information responsive to processing by the processor of image data captured by the camera and responsive to determined angles of the trailer hitch relative to the data recording device as determined by the angle measuring device;
after determining trailer hitch information, providing data representative of the determined trailer hitch information to an electronic device;
equipping a vehicle with the electronic device, wherein the equipped vehicle has a hitch ball at a rear portion of the equipped vehicle, and wherein the equipped vehicle is equipped with a rear backup camera;
hitching a hitch of a trailer to the hitch ball at the rear portion of the equipped vehicle;
wherein the rear backup camera has a field of view that encompasses the hitch ball at the rear portion of the equipped vehicle and at least a portion of the hitch of the trailer hitched to the hitch ball at the rear portion of the equipped vehicle;
capturing image data via the rear backup camera and processing, via a processor at the equipped vehicle, image data captured by the rear backup camera as the equipped vehicle and trailer move along a road; and
using the data representative of the determined trailer hitch information that was provided to the electronic device, and responsive to processing by the processor of image data captured by the rear backup camera, determining an angle of the trailer relative to the equipped vehicle as the equipped vehicle and trailer move along the road.

3. The method of claim 2 , wherein determining the angle of the trailer relative to the equipped vehicle comprises use of a neural network.

4. The method of claim 3 , wherein the neural network receives image data captured by the rear backup camera and processes the received image data via at least one convolution layer, at least one activation layer and at least one fully connected layer.

5. The method of claim 2 , wherein the electronic device is part of the rear backup camera.

6. The method of claim 2 , comprising (a) pre-processing image data captured by the camera of the data recording device to transform the captured image data to be representative of a viewing angle above the hitch ball of the data recording device, and wherein pre-processed image data is input to the data recording device when determining trailer hitch information, and (b) pre-processing image data captured by the rear backup camera of the equipped vehicle to transform the captured image data to be representative of a viewing angle above the hitch ball of the equipped vehicle, and wherein pre-processed image data is input to the electronic device for processing with the data representative of the determined trailer hitch information that was provided to the electronic device.

7. The method of claim 2 , wherein determining trailer hitch information synchronizing determined angles of the trailer hitch relative to the data recording device with the image data captured by the camera.

8. The method of claim 2 , wherein determining trailer hitch information comprises correlating image data captured by the camera with determined angles of the trailer hitch as determined by the angle measuring device.

9. The method of claim 2 , wherein video images derived from image data captured by the rear backup camera are displayed at a display screen of the equipped vehicle for viewing by a driver of the equipped vehicle during a reversing maneuver of the equipped vehicle.

10. The method of claim 9 , wherein image data captured by the rear backup camera is processed to detect objects rearward of the equipped vehicle during the reversing maneuver of the equipped vehicle.

11. The method of claim 2 , wherein the rear backup camera comprises part of a multi-camera vision system of the equipped v

Assignees

• Magna Electronics Inc

Inventors

• Potnis Anuj S
• Koravadi Krishna

Classifications

• G06N3/045

  Combinations of networks · CPC title

• G06T2207/20084

  Artificial neural networks [ANN] · CPC title

• B60R2300/303

  using joined images, e.g. multiple camera images · CPC title

• G06N3/08

  Learning methods · CPC title

• B60D1/64

  Couplings or joints therefor · CPC title