Camera-based vehicle position determination with known target

Patent metadata

Field	Value
Publication number	US-10227017-B2
Application number	US-201615365410-A
Country	US
Kind code	B2
Filing date	Nov 30, 2016
Priority date	Nov 30, 2015
Publication date	Mar 12, 2019
Grant date	Mar 12, 2019

Abstract

A vehicle control system capable of moving a vehicle to a target location is disclosed. According to a preferred embodiment, a camera captures one or more images of a known object corresponding to the target location. An on-board computer having stored thereon information about the known object can process the one or more images to determine vehicle location with respect to the known object. The system can use the vehicle's determined location and a feedback controller to move the vehicle to the target location.

First claim

What is claimed is:

1. A vehicle control system, comprising:
a first camera included in a vehicle, the first camera configured to capture one or more images of an object having a first characteristic;
a computing system coupled to the first camera, the computing system comprising:
memory configured to store the first characteristic of the object, the first characteristic of the object stored on the memory prior to the capture of the one or more images of the object by the first camera; and
a processor configured to determine a location of the first camera with respect to the object based on the one or more images captured by the first camera and the first characteristic of the object stored in the memory, wherein the location of the first camera with respect to the object comprises one or more of a distance from the object, a horizontal offset with respect to the object, an angle relative to a normal axis of the object, and a height relative to the object, and wherein the distance from the object is determined at least by a size of the object in the one or more images and the first characteristic of the object; and

a controller configured to control movement of the vehicle based on the determined location.

2. The vehicle control system of claim 1 , wherein:
the memory is further configured to store a position and an orientation of the first camera with respect to the vehicle; and
the processor is further configured to determine a location of the vehicle with respect to the object based on the position and the orientation of the first camera with respect to the vehicle.

3. The vehicle control system of claim 1 , wherein one or more of horizontal offset with respect to the object and height relative to the object is determined at least by a position of the object within the one or more images and the first characteristic of the object.

4. The vehicle control system of claim 1 , wherein:
the object comprises a first half having a first visual characteristic and a second half having a second visual characteristic, different from the first visual characteristic, and
the angle of the first camera relative to the normal axis of the object is determined at least by a comparison between a size of the first half in the one or more images and a size of the second half in the one or more images.

5. The vehicle control system of claim 1 , wherein:
the memory is further configured to store a baseline image corresponding to a target location of the vehicle, and
the controller is configured to move the vehicle based at least on the baseline image and the one or more images captured by the first camera.

6. A vehicle control system, comprising:
a first camera included in a vehicle, the first camera configured to capture one or more images of an object having a first characteristic;
a second camera configured to capture one or more images of the object, wherein a combined field of view of the first and second cameras is greater than a field of view of the first camera;
a computing system coupled to the first camera, the computing system comprising:
memory configured to store the first characteristic of the object, the first characteristic of the object stored on the memory prior to the capture of the one or more images of the object by the first camera; and
a processor configured to determine a location of the first camera with respect to the object based on the one or more images captured by the first camera or the one or more images captured by the second camera and based on the first characteristic of the object stored in the memory, wherein at a first time, the processor is configured to determine a location of the vehicle with respect to the object based on the one or more images captured by the first camera, and at a second time, after the first time, when the object is no longer within the field of view of the first camera, the processor is configured to determine the location of the vehicle with respect to the object based on the one or more images captured by the second camera; and

a controller configured to control movement of the vehicle based on the determined location.

7. The vehicle control system of claim 1 , wherein:
the processor is further configured to determine a difference between a direction of movement of the vehicle and a center of a field of view of the first camera based on a position of minimum flow in the one or more images relative to a location of the object in the one or more images.

8. The vehicle control system of claim 1 , wherein determining the location of the first camera with respect to the object comprises determining an orientation of the first camera with respect to the object.

9. A method of controlling a vehicle, comprising:
storing a first characteristic of a first object in a memory of a computing system;
after storing the first characteristic of the first object in the memory, capturing one or more images of the object having the first characteristic with a first camera included in the vehicle;
determining a location of the first camera with respect to the object based on the one or more images captured by the first camera and the first characteristic of the object stored in the memory, wherein the location of the first camera with respect to the object comprises one or more of a distance from the object, a horizontal offset with respect to the object, an angle relative to a normal axis of the object, and a height relative to the object, and wherein one or more of horizontal offset with respect to the object and height relative to the object is determined at least by a position of the object within the one or more images and the first characteristic of the object; and
controlling movement of the vehicle based on the determined location.

10. The method of claim 9 , further comprising:
storing, in the memory, a position and an orientation of the first camera with respect to the vehicle; and
determining a location of the vehicle with respect to the object based on the position and the orientation of the first camera with respect to the vehicle.

11. The method of claim 9 , wherein the distance from the object is determined at least by a size of the object in the one or more images and the first characteristic of the object.

12. The method of claim 9 , wherein:
the object comprises a first half having a first visual characteristic and a second half having a second visual characteristic, different from the first visual characteristic, and
the angle of the first camera relative to the normal axis of the object is determined at least by a comparison between a size of the first half in the one or more images and a size of the second half in the one or more images.

13. The method of claim 9 , further comprising:
after storing the first characteristic of the first object in the memory, capturing one or more images of the object having the first characteristic with a second camera included in the vehicle, wherein a combined field of view of the first and second cameras is greater than a field of view of the first camera.

14. The method of claim 13 , wherein:
at a first time, the processor is configured to determine a location of the vehicle with respect to the object based on the one or more images captured by the first camera, and
at a second time, after the first time, when the object is no longer within the field of view of the first camera, the processor is configured to determine the location of the vehicle with respect to the object based on the one or more images captured by the second camera.

15. The method of claim 9 , further comprising:
determining a d

Assignees

• Faraday & Future Inc

Inventors

• Bae Hong S
• Theodosis Paul Alan

Classifications

• G06T2207/30252

  Vehicle exterior; Vicinity of vehicle · CPC title

• G06T2207/30204

  Marker · CPC title

• B60L11/1835 Primary

  Operations & Transport · mapped topic

• G05D1/0246

  using a video camera in combination with image processing means · CPC title

• Y02T10/7072

  Electromobility specific charging systems or methods for batteries, ultracapacitors, supercapacitors or double-layer capacitors · CPC title