Vehicle hitch ball detection system

Patent metadata

Field	Value
Publication number	US-10780752-B1
Application number	US-201916378912-A
Country	US
Kind code	B1
Filing date	Apr 9, 2019
Priority date	Apr 9, 2019
Publication date	Sep 22, 2020
Grant date	Sep 22, 2020

Abstract

A vehicle control system includes an imager mounted with and directed to a rear of the vehicle and outputting image data, a vehicle speed sensor mounted with the vehicle and outputting vehicle speed data, and an image processor receiving the image data and the vehicle speed data. The image processor is programmed to monitor a signal from the vehicle speed sensor and, when the signal from the vehicle speed sensor indicates a vehicle speed above a predetermined minimum speed, execute a feature extraction function to locate a hitch ball mounted to the vehicle in the image data.

First claim

What is claimed is:

1. A vehicle control system, comprising:
an imager mounted with and directed to a rear of a vehicle and outputting image data including a series of still image frames at sequential intervals;
a vehicle speed sensor mounted with the vehicle and outputting vehicle speed data; and
an image processor receiving the image data and the vehicle speed data and programmed to:
monitor a signal from the vehicle speed sensor; and
when the signal from the vehicle speed sensor indicates a vehicle speed above a predetermined minimum speed, execute a feature extraction function, including a continuous analysis of successive still images, to locate a hitch ball mounted to the vehicle in the image data.

2. The system of claim 1 , further including a vehicle switchgear configurable between a park mode and at least one driving mode, wherein:
the image processor receives a state indication from the switchgear and;
the image processor executes the feature extraction function to locate the hitch ball only when the switchgear state indication corresponds with the vehicle being shifted from the park mode into the at least one driving mode and the signal from the vehicle speed sensor indicates the signal above the predetermined minimum speed.

3. The system of claim 1 , wherein the image processor executes the feature extraction function to locate the hitch ball only when the signal from the vehicle speed sensor indicates the signal above the predetermined minimum speed and below a predetermined maximum speed.

4. The system of claim 1 , wherein:
the continuous analysis of successive still images includes deriving a preliminary hitch ball location for each of the successive still images; and
the feature extraction routine filters the preliminary hitch ball location for each of the successive still images to converge on a final hitch ball location.

5. The system of claim 4 , wherein:
the feature extraction routine converges on a final hitch ball location using an algorithmic confidence assessment based on the analysis of successive still images; and
the final hitch ball location is determined when the confidence assessment reaches a predetermined threshold.

6. The system of claim 4 , wherein the final hitch ball location includes one of a distance of a detected hitch ball from a rear of the vehicle or a null value when no hitch ball is located when the confidence assessment reaches a predetermined threshold.

7. The system of claim 1 , wherein:
the image processor executes the feature extraction function to locate the hitch ball mounted to the vehicle in the image data when the signal from the vehicle speed sensor indicates a vehicle speed above a predetermined minimum speed over a time interval until the hitch ball has been located; and
the image processor stops the feature extraction function when one of the hitch ball has been located or the signal from the vehicle speed sensor indicates that the vehicle speed has changed to below the predetermined minimum speed.

8. The system of claim 1 , wherein the image processor stores a location of the hitch ball in memory when the feature extraction function locates the hitch ball.

9. The system of claim 8 , wherein:
the image processor compares the location of the hitch ball to at least one previously stored hitch ball location prior to storing the location of the hitch ball in memory; and
only stores the location of the hitch ball in memory if the location of the hitch ball is different from the one or more previously stored hitch ball location.

10. The system of claim 8 , further including a vehicle steering system, wherein:
the image processor is included in a controller that:
derives position data for a coupler of a trailer using the image data;
derives a vehicle path to position the location of the hitch ball stored in memory in an aligned position with the coupler; and
outputs a steering control signal to the steering system to maintain the vehicle along the path.

11. The system of claim 8 , further including:
a vehicle steering system; and
an input including a rotating element;
wherein the image processor is included in a controller that:
uses an input from the rotating element to as a trailer backup control signal; and
controls the vehicle steering system to maintain the vehicle, when coupled with a trailer at the hitch ball location, on a backing path determined using the hitch ball location.

12. The system of claim 8 , further including a vehicle brake system, wherein:
the image processor is included in a controller that executes at least one automated reverse braking feature based on a position of the rear of the vehicle including the hitch ball location.

13. A vehicle, comprising:
a vehicle steering system;
an imager mounted with and directed to a rear of the vehicle and outputting image data including a series of still image frames at sequential intervals;
a vehicle speed sensor mounted with the vehicle and outputting vehicle speed data; and
a controller:
operating in a free driving mode including:
receiving the image data and the vehicle speed data;
monitoring a signal from the vehicle speed sensor; and
when the signal from the vehicle speed sensor indicates a vehicle speed above a predetermined minimum speed, executing a feature extraction function, including a continuous analysis of successive still images, to determine a location of a hitch ball mounted to the vehicle in the image data; and

operating in a hitch assist driving mode including outputting a steering control signal to the steering system in reversing of the vehicle to align the hitch ball location with a coupler of a trailer.

14. The vehicle of claim 13 , wherein in the hitch assist driving mode, the controller further:
derives position data for a coupler of a trailer using the image data;
derives a vehicle path to position the location of the hitch ball in an aligned position with the coupler; and
outputs the steering control signal to the steering system to maintain the vehicle along the path to align the hitch ball location with a coupler of a trailer.

15. The vehicle of claim 13 , further including an input having a rotating element;
wherein the controller further operates in a trailer backup assist mode including:
using an input from the rotating element to as a trailer backup control signal; and
controlling the vehicle steering system to maintain the vehicle, when coupled with a trailer at the hitch ball location, on a backing path determined using the hitch ball location.

16. The vehicle of claim 13 , further including a vehicle brake system;
wherein the controller further operates in an automated reverse braking mode including controlling the vehicle brake system based on a position of the rear of the vehicle including the hitch ball location.

17. The vehicle of claim 13 , further including a vehicle switchgear configurable between a park mode and at least one driving mode, wherein the controller:
receives a state indication from the switchgear and;
executes the feature extraction function to determine the hitch ball location only when the switchgear state indication corresponds with the vehicle being shifted from the park mode into the at least one driving mode and the signal from the vehicle speed sensor indicates the signal above the predetermined minimum speed.

18. The vehicle of claim 17 , wherein the controller executes the feature extraction function to locate the hitch ball only when the signal from the vehicle speed sensor indicates the signal above the

Assignees

• Ford Global Tech Llc

Inventors

• Niewiadomski Luke
• Nagraj Rao Nikhil
• Haubenstricker Rick
• Campbell Richard
• Bowers Mark
• Chen Lihui

Classifications

• B60D1/62

  involving supply lines, electric circuits or the like · CPC title

• B60W2710/20

  Steering systems · CPC title

• B60W2710/18

  Braking system · CPC title

• B60W2710/1005

  Transmission ratio engaged · CPC title

• B60W2710/06

  Combustion engines, Gas turbines · CPC title