Three-dimensional information processing method and three-dimensional information processing device

Patent metadata

Field	Value
Publication number	US-11410552-B2
Application number	US-201916283200-A
Country	US
Kind code	B2
Filing date	Feb 22, 2019
Priority date	Aug 26, 2016
Publication date	Aug 9, 2022
Grant date	Aug 9, 2022

Abstract

A three-dimensional information processing method includes: obtaining, via a communication channel, map data that includes first three-dimensional position information; generating second three-dimensional position information from information detected by a sensor; judging whether one of the first three-dimensional position information and the second three-dimensional position information is abnormal by performing, on one of the first three-dimensional position information and the second three-dimensional position information, a process of judging whether an abnormality is present; determining a coping operation to cope with the abnormality when one of the first three-dimensional position information and the second three-dimensional position information is judged to be abnormal; and executing a control that is required to perform the coping operation.

First claim

What is claimed is:

1. A three-dimensional information processing method, comprising:
obtaining, via a communication channel, map data that includes first three-dimensional position information;
generating second three-dimensional position information from information detected by a sensor;
judging whether the first three-dimensional position information has been obtained via the communication channel;
when the first three-dimensional position information is judged to have been obtained via the communication channel, estimating a location of a mobile object having the sensor using the first three-dimensional position information and the second three-dimensional position information; and
when the first three-dimensional position information is judged to not have been obtained via the communication channel, (i) obtaining, via the communication channel, third three-dimensional position information having a narrower range than a range of the first three-dimensional position information and (ii) estimating the location of the mobile object having the sensor using the second three-dimensional position information and the third three-dimensional position information.

2. The three-dimensional information processing method according to claim 1 ,
wherein the first three-dimensional position information includes a plurality of random access units, each of random access units being individually decodable, and each of the random access units including at least one subspace having three-dimensional coordinates information and serving as a unit in which the random access unit is encoded.

3. The three-dimensional information processing method according to claim 1 ,
wherein the first three-dimensional position information is data obtained by encoding keypoints, each of which has an amount of a three-dimensional feature greater than or equal to a predetermined threshold.

4. The three-dimensional information processing method according to claim 1 , further comprising:
judging whether data of the first three-dimensional position information is corrupted;
when the data of the first three-dimensional position information is judged to not be corrupted, estimating a location of a mobile object having the sensor using the first three-dimensional position information and the second three-dimensional position information; and
when the data of the first three-dimensional position information is judged to be corrupted, (i) identifying a corrupted portion of the data of the first three-dimensional position information, (ii) updating, via the communication channel, the first three-dimensional position information such that the data of the first three-dimensional position information does not include the identified corrupted portion, and (ii) estimating the location of the mobile object having the sensor using the updated first three-dimensional position information and the second three-dimensional position information.

5. The three-dimensional information processing method according to claim 1 , further comprising
judging whether a data accuracy of the second three-dimensional position information is higher than or equal to a reference value; and
when the data accuracy of the second three-dimensional position information is judged to be higher than or equal to the reference value, estimating a location of a mobile object having the sensor using the first three-dimensional position information and the second three-dimensional position information.

6. The three-dimensional information processing method according to claim 5 , further comprising
when the data accuracy of the second three-dimensional position information is not judged to be higher than or equal to the reference value, generating fourth three-dimensional position information from information detected by an alternative sensor different from the sensor and (ii) estimating the location of the mobile object having the sensor using the first three-dimensional position information and the fourth three-dimensional position information.

7. The three-dimensional information processing method according to claim 5 , further comprising:
performing automatic operation of the mobile object by use of the location having been estimated; and
when the data accuracy of the second three-dimensional position information is not judged to be higher than or equal to the reference value, switching a mode of the automatic operation to another.

8. The three-dimensional information processing method according to claim 5 , further comprising
when the data accuracy of the second three-dimensional position information is not judged to be higher than or equal to the reference value, calibrating an operation of the sensor.

9. A three-dimensional information processing method, comprising:
obtaining, via a communication channel, map data that includes first three-dimensional position information;
generating second three-dimensional position information from information detected by a sensor;
predicting whether the mobile object will enter an area in which the first three-dimensional position information is more difficult to obtain via the communication channel while the mobile object is in the area than while the mobile object is not in the area;
when it is predicted that the mobile object will not enter the area in which the first three-dimensional position information is more difficult to obtain via the communication channel while the mobile object is in the area than while the mobile object is not in the area, estimating a location of a mobile object having the sensor using the first three-dimensional position information and the second three-dimensional position information; and
when it is predicted that the mobile object will enter the area in which the first three-dimensional position information is more difficult to obtain via the communication channel while the mobile object is in the area than while the mobile object is not in the area, (i) obtaining, via the communication channel, third three-dimensional position information having a narrower range than a range of the first three-dimensional position information and (ii) estimating the location of the mobile object having the sensor using the second three-dimensional position information and the third three-dimensional position information.

10. A three-dimensional information processing method, comprising:
obtaining, via a communication channel, map data that includes first three-dimensional position information;
generating second three-dimensional position information from information detected by a sensor;
judging whether the first three-dimensional position information has been obtained via the communication channel;
when the first three-dimensional position information is judged to have been obtained via the communication channel, estimating a location of a mobile object having the sensor using the first three-dimensional position information and the second three-dimensional position information; and
when the first three-dimensional position information is judged to not have been obtained via the communication channel, (i) obtaining, via the communication channel, map data including two-dimensional position information and (ii) estimating the location of the mobile object having the sensor using the two-dimensional position information and the second three-dimensional position information.

11. The three-dimensional information processing method according to claim 10 , further comprising:
performing automatic operation of the mobile object by use of the location having been estimated; and
when the location of the mobile object is estimated using the two-dimensional position information and the second three-dime

Assignees

• Panasonic Ip Corp America

Inventors

• Toma Tadamasa
• Nishi Takahiro
• Sugio Toshiyasu
• Matsunobu Toru
• Yoshikawa Satoshi
• Koyama Tatsuya

Classifications

• G05D1/43

  Control of position or course in two dimensions [2D] · CPC title

• G08G1/0968 Primary

  Systems involving transmission of navigation instructions to the vehicle · CPC title

• G08G1/09 Primary

  Arrangements for giving variable traffic instructions ({railroad crossing signals B61L; reflectors E01F, G08B}; indicating arrangements for variable information by selection or combination of individual elements G09F9/00) · CPC title

• G01S17/931

  of land vehicles · CPC title

• G01S17/86

  Combinations of lidar systems with systems other than lidar, radar or sonar, e.g. with direction finders · CPC title