Position estimation apparatus

Patent metadata

Field	Value
Publication number	US-12103586-B2
Application number	US-201917280830-A
Country	US
Kind code	B2
Filing date	Mar 13, 2019
Priority date	Sep 26, 2018
Publication date	Oct 1, 2024
Grant date	Oct 1, 2024

Abstract

A position estimation apparatus includes: an image information calculation unit that extracts each of image feature points from a plurality of images which are sequentially captured and associates the image feature points with each other between the plurality of images; a travel amount calculation unit that estimates the position of the mobile object; a three-dimensional image feature point calculation unit that estimates a three-dimensional position of the image feature point in a real space on the basis of a result of associating the image feature points with each other and the position of the mobile object; a position correction unit that corrects the three-dimensional position and the position of the mobile object so as to reduce a position error between a position of the three-dimensional position, when the three-dimensional position is reprojected onto any one of the plurality of images, in the relevant image and the image feature point; a route regeneration judgment unit that judges whether or not to regenerate the route on the basis of a result of comparison between the corrected position of the mobile object and the route.

First claim

The invention claimed is:

1. A position estimation apparatus for estimating a position of a mobile object moving along a preset route, the position estimation apparatus comprising:
an image information calculation unit configured to extract each of image feature points from a plurality of images which are sequentially captured from a specified spot by an image capturing unit mounted in the mobile object and associate the image feature points with each other between the plurality of images;
a travel amount calculation unit configured to estimate the position of the mobile object by calculating a travel amount of the mobile object from the specified spot on the basis of information about movements of the mobile object;
a three-dimensional image feature point calculation unit configured to estimate a three-dimensional position of the image feature point in a real space on the basis of a result of associating the image feature points with each other between the plurality of images and the position of the mobile object estimated by the travel amount calculation unit;
a position-in-route judgment unit configured to judge whether or not the position of the mobile object which is estimated by the travel amount calculation unit has reached a preset relay spot on the route, the preset relay spot is set on the preset route which is provided to the position estimation apparatus by an automatic parking system;
a position correction unit configured to calculate a position error between a position of the three-dimensional position estimated from an image captured by the image capturing unit, the position of the three-dimensional position being in the relevant image when the three-dimensional position is reprojected onto the relevant image, and the image feature point extracted from the relevant image when the position in-route judgement unit determines that the position of the mobile object has reached the preset relay spot, and correct the position and posture of the mobile object so as to reduce the position error; and
a route regeneration judgment unit configured to calculate differences between the position and posture of the mobile object corrected by the position correction unit and a position and posture of the mobile object which are preset with respect to the preset relay spot, and determine to regenerate the route if at least one of the calculated respective differences is equal to or larger than one of threshold values and determine not to regenerate the route if the calculated respective differences are not equal to or larger than the threshold values,
wherein the preset relay spot is a steering-wheel-turning spot for the mobile object to switch from a forward movement to a reverse movement or from the reverse movement to the forward movement on the route and the route is a parking route to a designated parking position.

2. The position estimation apparatus according to claim 1 , wherein the three-dimensional image feature point calculation unit judges reliability of the three-dimensional position on the basis of a position error between a position of the estimated three-dimensional position, when the estimated three-dimensional position is reprojected onto any one of the plurality of images, in the relevant image and the image feature point extracted from the relevant image; and
wherein the position correction unit calculates the position error by excluding the three-dimensional position which is determined by the three-dimensional image feature point calculation unit that the reliability is low.

3. The position estimation apparatus according to claim 1 , wherein when associating the image feature points with each other between the plurality of images, the image information calculation unit associates one image feature point in one of two images included in the plurality of images with a plurality of the image feature points in the other image.

4. The position estimation apparatus according to claim 1 , wherein the position correction unit corrects the three-dimensional position and the position of the mobile object by performing local bundle adjustment by fixing the position of the mobile object corresponding to a specified number of images from among the plurality of images.

5. The position estimation apparatus according to claim 1 , wherein regarding an image feature point associated with an image feature point for which the three-dimensional position has already been estimated, the three-dimensional image feature point calculation unit does not estimate the three-dimensional position, but sets the three-dimensional position, which has already been estimated, as a three-dimensional position for the above-mentioned image feature point.

6. The position estimation apparatus according to claim 1 , wherein the position estimation apparatus is coupled to the automatic parking system that generates the parking route and causes the mobile object to move autonomously to the parking position; and
wherein if the route regeneration judgment unit determines to regenerate the parking route, the route regeneration judgement unit issues an instruction to the automatic parking system to regenerate the parking route.

Assignees

• Faurecia Clarion Electronics Co Ltd

Inventors

• Sakai Takahiro
• Sakano Morihiko
• Fukuda Daisuke
• Murayama Junya

Classifications

• G06V20/586

  of parking space · CPC title

• G06V10/44

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title

• G06V10/462

  Salient features, e.g. scale invariant feature transforms [SIFT] · CPC title

• G06T2207/30232

  Surveillance · CPC title

• G06T2207/10016

  Video; Image sequence · CPC title