Characterizing optical characteristics of optical elements

Patent metadata

Field	Value
Publication number	US-10715705-B2
Application number	US-201816005590-A
Country	US
Kind code	B2
Filing date	Jun 11, 2018
Priority date	Jun 11, 2018
Publication date	Jul 14, 2020
Grant date	Jul 14, 2020

Abstract

Systems, methods, and non-transitory computer readable media may be configured to characterize optical characteristics of optical elements. An optical element mount may be configured to carry an optical element. A calibration display may be configured to display a calibration object. The calibration object may include a known visual pattern. Multiple images of the calibration object may be obtained. The multiple images may be acquired using the optical element carried by the optical element mount. The multiple images may include different perspectives of the calibration object. Optical characteristics of the optical element may be characterized based on the known visual pattern and the different perspectives of the calibration object.

First claim

What is claimed is:

1. A system comprising:
an optical element mount configured to carry an optical element;
a calibration display configured to display a calibration object, the calibration object including a known visual pattern;
an image sensor mount configured to carry an image sensor;
one or more processors; and
a memory storing instructions that, when executed by the one or more processors, cause the system to perform:
obtaining images including different perspectives of the calibration object, the images being captured using the optical element carried by the optical element mount;
characterizing optical characteristics of the optical element based on the known visual pattern and the different perspectives of the calibration object; and
calibrating the image sensor to compensate the images, based on the optical characteristics of the optical element, for a distortion of light traveling through the optical element.

2. The system of claim 1 , wherein the optical element includes a lens, and the optical characteristics include a curvature of the lens and imperfections in the curvature of the lens.

3. The system of claim 1 , wherein at least one of the optical element mount and the image sensor mount is movable.

4. The system of claim 1 , wherein the images are captured based on a movement of the optical element mount with respect to the calibration object.

5. The system of claim 4 , wherein the images are captured based on:
a movement of the optical element mount into different poses;
a detection of whether the calibration object is visible to the image sensor at the different poses, based on recognition of the known visual pattern;
a detection of whether the optical element mount is stable at the different poses; and
an acquisition of the images, based on the calibration object being visible to the image sensor and the optical element being stable at the different poses.

6. The system of claim 5 , wherein the images are classified based on a similarity of the different poses.

7. The system of claim 1 , wherein the calibration display includes a light field display, and the images are acquired based on changes in angles or depths of the calibration object displayed by the light field display.

8. The system of claim 1 , wherein the characterized optical characteristics of the optical element comprise a portion of the optical element.

9. A method implemented by a computing system including one or more processors and storage media storing machine-readable instructions, wherein the method is performed using the one or more processors, the method comprising:
obtaining images including different perspectives of a calibration object displayed by a calibration display, the images being acquired using an optical element carried by an optical element mount, the calibration object including a known visual pattern;
characterizing optical characteristics of the optical element based on the known visual pattern and the different perspectives of the calibration object; and
calibrating an image sensor carried by an image sensor mount to compensate the images, based on the optical characteristics of the optical element, for a distortion of light traveling through the optical element.

10. The method of claim 9 , wherein the optical element includes a lens, and the optical characteristics include a curvature of the lens and imperfections in the curvature of the lens.

11. The method of claim 9 , wherein at least one of the optical element mount and the image sensor mount is movable.

12. The method of claim 9 , wherein the images are acquired based on a movement of the optical element mount with respect to the calibration object.

13. The method of claim 12 , wherein the images are acquired based on:
a movement of the optical element mount into different poses;
a detection of whether the calibration object is visible to the image sensor at the different poses, based on recognition of the known visual pattern;
a detection of whether the optical element mount is stable at the different poses; and
an acquisition of the images, based on the calibration object being visible to the image sensor and the optical element being stable at the different poses.

14. The method of claim 13 , wherein the images are classified based on a similarity of the different poses.

15. The method of claim 9 , wherein the calibration display includes a light field display, and the images are acquired based on changes in angles or depths of the calibration object displayed by the light field display.

16. The method of claim 9 , wherein the characterized optical characteristics of the optical element comprise a portion of the optical element.

17. A non-transitory computer readable medium comprising instructions that, when executed, cause one or more processors to perform:
obtaining images including different perspectives of a calibration object displayed by a calibration display, the images being acquired using an optical element carried by an optical element mount, the calibration object including a known visual pattern;
characterizing optical characteristics of the optical element based on the known visual pattern and the different perspectives of the calibration object; and
calibrating an image sensor carried by an image sensor mount to compensate the images, based on the optical characteristics of the optical element, for a distortion of light traveling through the optical element.

18. The non-transitory computer readable medium of claim 17 , wherein at least one of the optical element mount and the image sensor mount is movable.

19. The non-transitory computer readable medium of claim 17 , wherein the images are captured based on a movement of the optical element mount with respect to the calibration object.

20. The non-transitory computer readable medium of claim 19 , wherein the multiple images are captured based on:
a movement of the optical element mount into different poses;
a detection of whether the calibration object is visible to the image sensor at the different poses, based on recognition of the known visual pattern;
a detection of whether the optical element mount is stable at the different poses; and
an acquisition of the images, based on the calibration object being visible to the image sensor and the optical element being stable at the different poses.

Assignees

• Pony Ai Inc

Inventors

• Zhang Yubo
• Yu Xiang
• Lou tiancheng
• Peng Jun
• Chen Kai
• Liu Yiming
• Xiao Sinan
• Li Tianyi
• Zhong Yin
• Song Hao

Classifications

• H04N23/58

  Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors · CPC title

• H04N23/55 Primary

  Optical parts specially adapted for electronic image sensors; Mounting thereof · CPC title

• H04N23/63

  by using electronic viewfinders · CPC title

• H04N23/60

  Control of cameras or camera modules · CPC title

• G01M11/005 Primary

  Testing of reflective surfaces, e.g. mirrors · CPC title