Pose determining

Patent metadata

Field	Value
Publication number	US-12387371-B2
Application number	US-202217705754-A
Country	US
Kind code	B2
Filing date	Mar 28, 2022
Priority date	Mar 29, 2021
Publication date	Aug 12, 2025
Grant date	Aug 12, 2025

Abstract

First, environment image data acquired by an unmanned driving device is obtained, and for each piece of reference image data matching the environment image data, a predicted pose of the unmanned driving device when acquiring the environment image data is determined according to an actual pose corresponding to the reference image data; and then pose deviation representation information of the reference image data is determined according to the predicted pose and actual poses corresponding to other pieces of reference image data. Finally, target image data is selected from the reference image data, and a pose of the unmanned driving device when acquiring the environment image data is determined.

First claim

What is claimed is:

1. A pose determining method, comprising:
obtaining environment image data acquired by an unmanned driving device;
determining, for each piece of reference image data matching the environment image data and according to an actual pose corresponding to the piece of reference image data, a pose of the unmanned driving device when acquiring the environment image data as a predicted pose of the unmanned driving device in the piece of reference image data;
determining pose deviation representation information of the piece of reference image data according to the predicted pose and actual poses corresponding to other pieces of reference image data, wherein the pose deviation representation information is used for representing degrees of deviation between poses of the unmanned driving device when acquiring the other pieces of reference image data and the actual poses corresponding to the other pieces of reference image data using the predicted pose of the unmanned driving device in the piece of reference image data as a condition; and
selecting target image data from respective pieces of reference image data according to the pose deviation representation information corresponding to the piece of reference image data, and determining, according to the target image data, a pose of the unmanned driving device when acquiring the environment image data.

2. The method according to claim 1 , wherein the determining, for each piece of reference image data matching the environment image data and according to the actual pose corresponding to the piece of reference image data, the pose of the unmanned driving device when acquiring the environment image data as the predicted pose of the unmanned driving device in the piece of reference image data comprises:
predicting, for each piece of reference image data matching the environment image data, a relative pose between the unmanned driving device when the environment image data is acquired and the unmanned driving device when the piece of reference image data is acquired; and
determining, according to the relative pose and the actual pose corresponding to the piece of reference image data, the predicted pose of the unmanned driving device when acquiring the environment image data.

3. The method according to claim 2 , wherein the predicting, for each piece of reference image data matching the environment image data, the relative pose between the unmanned driving device when the environment image data is acquired and the unmanned driving device when the piece of reference image data is acquired comprises:
inputting, for each piece of reference image data matching the environment image data, the environment image data and the piece of reference image data into a relative pose prediction model, and predicting the relative pose between the unmanned driving device when the environment image data is acquired and the unmanned driving device when the piece of reference image data is acquired.

4. The method according to claim 1 , wherein determining each piece of reference image data matching the environment image data comprises:
predicting, according to the environment image data, a basic pose of the unmanned driving device when acquiring the environment image data;
determining, from a database, candidate image data of which actual poses fall within a set range of the basic pose; and
determining, from the candidate image data, reference image data of which an image similarity with the environment image data is not less than a set first similarity.

5. The method according to claim 4 , wherein the predicting, according to the environment image data, the basic pose of the unmanned driving device when acquiring the environment image data comprises:
inputting the environment image data into a global pose prediction model, to predict the basic pose of the unmanned driving device when acquiring the environment image data.

6. The method according to claim 5 , wherein training the global pose prediction model comprises:
obtaining first historical environment image data acquired by a first specified device;
inputting, for each piece of first historical environment image data, the first historical environment image data into a to-be-trained global pose prediction model, to predict a pose of the first specified device when acquiring the first historical environment image data; and
training the global pose prediction model by using minimization of a deviation between the predicted pose and an actual pose of the first specified device when acquiring the first historical environment image data as an optimization target.

7. The method according to claim 1 , wherein the selecting target image data from the respective pieces of reference image data according to the pose deviation representation information corresponding to the piece of reference image data comprises:
determining, for each piece of reference image data and according to the pose deviation representation information corresponding to the piece of reference image data, a quantity of other pieces of reference image data meeting a preset condition in a case that the unmanned driving device determines the predicted pose according to the piece of reference image data, wherein the preset condition is that the degrees of deviation between the actual poses corresponding to the other pieces of reference image data and the poses of the unmanned driving device when acquiring the other pieces of reference image data are less than a set threshold; and
selecting the target image data from the respective pieces of reference image data according to the quantity.

8. The method according to claim 3 , wherein training the relative pose prediction model comprises:
obtaining second historical environment image data acquired by a second specified device;
determining, for each piece of second historical environment image data, associated historical environment image data of which a similarity with the second historical environment image data is not less than a set second similarity from other pieces of second historical environment image data;
determining an actual relative pose between the second specified device when the second historical environment image data is acquired and the second specified device when the associated historical environment image data is acquired;
inputting the second historical environment image data and the associated historical environment image data into a to-be-trained relative pose prediction model, to obtain a predicted relative pose between the second specified device when the second historical environment image data is acquired and the second specified device when the associated historical environment image data is acquired; and
training the relative pose prediction model by using minimization of a deviation between the predicted relative pose and the actual relative pose as an optimization target.

9. A non-transitory computer-readable storage medium storing a computer program, wherein the computer program, when being executed by a processor, implements the following steps:
obtaining environment image data acquired by an unmanned driving device;
determining, for each piece of reference image data matching the environment image data and according to an actual pose corresponding to the piece of reference image data, a pose of the unmanned driving device when acquiring the environment image data as a predicted pose of the unmanned driving device in the piece of reference image data;
determining pose deviation representation information of the piece of reference image data according to the predicted pose and actual poses corresponding to other pieces of reference image data, wherein the pose deviation representation informat

Assignees

• Beijing Sankuai Online Tech Co Ltd

Inventors

• Tian Mi
• Nie Qiong
• Shen Hao
• Xia Huaxia

Classifications

• G06T2207/30252

  Vehicle exterior; Vicinity of vehicle · CPC title

• G06T2207/30244

  Camera pose · CPC title

• G06F18/22

  Matching criteria, e.g. proximity measures · CPC title

• G06F16/583

  using metadata automatically derived from the content · CPC title

• G06T7/74 Primary

  involving reference images or patches · CPC title