Sensor calibration and sensor calibration detection

Patent metadata

Field	Value
Publication number	US-11798191-B2
Application number	US-202016832094-A
Country	US
Kind code	B2
Filing date	Mar 27, 2020
Priority date	Mar 27, 2020
Publication date	Oct 24, 2023
Grant date	Oct 24, 2023

Abstract

A sensor calibrator comprising one or more processors configured to receive sensor data representing a calibration pattern detected by a sensor during a period of relative motion between the sensor and the calibration pattern in which the sensor or the calibration pattern move along a linear path of travel; determine a calibration adjustment from the plurality of images; and send a calibration instruction for calibration of the sensor according to the determined calibration adjustment. Alternatively, a sensor calibration detection device, comprising one or more processors, configured to receive first sensor data detected during movement of a first sensor along a route of travel; determine a difference between the first sensor data and stored second sensor data; and if the difference is outside of a predetermined range, switch from a first operational mode to a second operational mode.

First claim

What is claimed is:

1. A sensor calibrator comprising one or more processors configured to:
determine a calibration adjustment from sensor data representing a plurality of images of a calibration pattern detected by a sensor for a period of relative motion between the sensor and the calibration pattern in which the sensor or the calibration pattern move along a linear path of travel; and
generate a calibration instruction for calibration of the sensor based on the determined calibration adjustment;
wherein one or more of the plurality of images of the calibration pattern further comprise a symbol, in which is encoded a value representing a pose of the calibration pattern relative to the image sensor, and wherein the one or more processors are configured to determine the calibration adjustment from the plurality of images and the value.

2. The sensor calibrator of claim 1 , wherein the symbol includes at least one of a two-dimensional bar code, a three-dimensional bar code, or a Quick-Response-Code.

3. The sensor calibrator of claim 1 , wherein further encoded in the symbol is a value representing a linear direction of a roadway in a vicinity of the calibration pattern, and wherein the one or more processors are further configured to determine the calibration adjustment from the value representing the linear direction of the roadway.

4. The sensor calibrator of claim 1 , wherein the one or more processors are further configured to determine a pose of the calibration pattern relative to the sensor using at least one of the plurality of images of the calibration pattern, and to determine the calibration adjustment from at least one of the plurality of images of the calibration pattern and the determined pose.

5. The sensor calibrator of claim 1 , wherein the one or more processors are further configured to determine the pose of the calibration pattern relative to the sensor using at least one of the plurality of images of the calibration pattern and the symbol and to determine the calibration adjustment from the plurality of images of the calibration pattern and the determined pose.

6. The sensor calibrator of claim 5 , wherein determining the pose of the calibration pattern comprises determining an angle of an intersection between a normalized plane of the calibration pattern and an optical axis of the sensor; and wherein the one or more processors are further configured to determine the calibration adjustment from the angle of intersection.

7. The sensor calibrator of claim 1 , wherein the sensor moves along the path of travel and the calibration pattern is stationary.

8. The sensor calibrator of claim 1 , wherein the calibration pattern moves along the path of travel and the sensor is stationary.

9. One or more non-transitory computer readable media, comprising instructions which, if executed, cause one or more processors to:
determine a calibration adjustment sensor data representing a plurality of images of a calibration pattern taken during a period of relative motion between a sensor and the calibration pattern; and
generate a calibration instruction for calibration of the sensor according to the determined calibration adjustment;
wherein one or more of the plurality of images of the calibration pattern further comprise a symbol, in which is encoded a value representing a pose of the calibration pattern relative to the image sensor, and wherein the one or more processors are configured to determine the calibration adjustment from the plurality of images and the value.

10. A sensor calibration detection device, comprising:
one or more processors, configured to:
obtain first sensor data and an authentication symbol from a first sensor detected during movement of the first sensor along a route of travel;
verify the authenticity of the first sensor data using the authentication symbol;
determine a difference between the first sensor data and stored second sensor data; and
if the difference is outside of a predetermined range, switch the one or more processors from operating in a first operational mode to operating in a second operational mode.

11. The sensor calibration detection device of claim 10 , wherein determining a difference between the first sensor data and the second sensor data comprises determining a mean of the second sensor data and determining a difference between the first sensor data and the mean of the second sensor data.

12. The sensor calibration detection device of claim 10 , wherein the first operational mode comprises incorporating the first sensor data in the second sensor data.

13. The sensor calibration detection device of claim 10 , wherein the second operational mode comprises sending a signal representing a determination that the difference is outside of the predetermined range.

14. The sensor calibration detection device of claim 10 , wherein the one or more processors are further configured to determine a mean and variance of the second sensor data, and wherein determining the difference between the first sensor data and the second sensor data comprises determining a difference between the first sensor data and the mean and the variance of the second sensor data.

15. The sensor calibration detection device of claim 14 , wherein the second operational mode comprises the one or more processors determining an sensor calibration instruction as a difference between first sensor data and the mean and variance of the second sensor data; further comprising the one or more processors sending the instruction.

16. The sensor calibration detection device of claim 14 , wherein the second operational mode comprises the one or more processors determining an affine transformation of the first sensor data relative to a mean of the second sensor data, and sending an instruction to adjust a sensor corresponding to the first sensor data by the determined affine transformation.

17. The sensor calibration detection device of claim 10 , wherein the second sensor data is data that is detected for movement of one or more second sensors along the route of travel.

18. One or more non-transitory computer readable media, comprising instructions which, when executed, cause one or more processors to:
obtain first sensor data and an authentication symbol from a first sensor detected during movement of the first sensor along a route of travel;
verify the authenticity of the first sensor data using the authentication symbol;
determine a difference between the first sensor data and stored second sensor data; and
if the difference is outside of a predetermined range, switch the one or more processors from operating in a first operational mode to operating in a second operational mode.

19. The one or more non-transitory computer readable media of claim 18 , further comprising determining a mean and variance of the second sensor data, and wherein determining the difference between the first sensor data and the second sensor data comprises determining a difference between the first sensor data and the mean and the variance of the second sensor data.

20. A vehicle, comprising:
a sensor calibrator, the sensor calibrator comprising:
one or more processors configured to determine a calibration adjustment from sensor data representing a plurality of images of a calibration pattern detected by a sensor for a period of relative motion between the sensor and the calibration pattern in which the sensor moves along a linear path of travel; and
to generate a calibration instruction for calibration of the sensor according to the

Assignees

• Intel Corp

Inventors

• Alvarez Ignacio
• Buerkle Cornelius
• Fox Maik Sven
• Geissler Florian
• Graefe Ralf
• Guo Yiwen
• Hou Yuqing
• Oboril Fabian
• Pohl Daniel
• Unnervik Alexander Carl
• Wu Xiangbin

Classifications

• G06T7/80 Primary

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title

• G01S7/40

  Means for monitoring or calibrating · CPC title

• G01S7/4972 Primary

  Alignment of sensor · CPC title

• G01S13/865

  Combination of radar systems with lidar systems · CPC title

• G01S13/867

  Combination of radar systems with cameras · CPC title