Method and arrangement for multi-camera calibration

Patent metadata

Field	Value
Publication number	US-9303525-B2
Application number	US-201113582164-A
Country	US
Kind code	B2
Filing date	Mar 8, 2011
Priority date	Mar 26, 2010
Publication date	Apr 5, 2016
Grant date	Apr 5, 2016

Abstract

A method for determining calibration data for at least two cameras (camera 1 , camera 2 ) in a multi view position, includes a step of determining respective parameters ((h 1 00 , . . . , h 1 22 ), (h 2 00 , . . . , h 2 22 )) for identifying at least one respective homographic transformation on respective images (image 1 ,image 2 ) taken by said cameras of a same scene, by performing respective geometry analyses on said respective images (image 1 , image 2 ), a step of performing at least one respective combined homographic transformation/feature detection step on said respective images thereby obtaining respective sets (feature set 1 , feature set 2 ) of features on respective transformed images, such that said calibration data are obtained from matches (m l , . . . , m k ) determined between said respective sets of features.

First claim

The invention claimed is:

1. A method for determining calibration data for at least two cameras (camera 1 , camera 2 ) in a multi view position, said method including the steps of:
determining respective parameters ((h 1 00 . . . h 1 22 )), (h 2 00 , . . . h 2 22 )) for identifying at least one respective homographic transformation on respective images (image 1 ,image 2 ) taken by said cameras of a same scene, by performing respective geometry analyses on said respective images (image 1 , image 2 ); and
performing at least one respective homographic transformation on said respective images and a respective feature detection step on respective transformed images thereby obtaining respective sets (feature set 1 , feature set 2 ) of features on said respective transformed images, such that said calibration data are obtained from matches (ml,..,mk) determined between said respective sets of features.

2. A method according to claim 1 wherein said calibration data comprise information with respect to the relative position between said cameras.

3. A method according to claim 1 wherein said calibration data comprise information with respect to the relative viewing direction differences between said cameras.

4. A method according to claim 1 wherein said at least one respective homographic transformation further comprises an iterative process of pixel coordinates transformation of said respective image, followed by feature detection of the partially transformed image until all pixel coordinates of said respective image (imagel) are transformed.

5. A method according to claim 1 wherein said respective geometry analysis steps comprise determining line segments on said respective images.

6. A method according to claim 1 wherein said respective geometry analysis steps comprise determining curved segments on said respective image.

7. A method according to claim 1 wherein said respective geometry analysis steps comprise performing object recognition on said respective images.

8. A method according to claim 5 wherein said respective line segments are further used for determining a viewpoint angle difference between said at least two cameras.

9. A method according to claim 1 wherein said calibration data are further determined from said respective sets of features.

10. A method according to claim 1 wherein said calibration data are further determined from said parameters for identifying said respective homographic transformations.

11. A method according to claim 1 , wherein said calibration data further comprise internal camera parameters which values can be further optimized based on said matches.

12. A device for determining calibration data for at least two cameras (camera 1 , camera 2 ) in a multi view position, said device adapted to perform the steps of:
determining respective parameters ((h 1 00 . . . h 1 22 ), (h 2 00 , . . . h 2 22 )) for identifying at least one respective homographic transformation on respective images (image 1 ,image 2 ) taken by said cameras of a same scene, by performing respective geometry analyses on said respective images (image 1 , image 2 ) ; and
performing at least one respective homographic transformation on said respective images and a respective feature detection step on respective transformed images thereby obtaining respective sets (feature set 1 , feature set 2 ) of features on said respective transformed images, such that said calibration data are obtained from matches (ml,..,mk) determined between said respective sets of features.

13. A computer program product comprising a non-transitory computer usable medium having computer usable program code stored therein, said computer program product when executed performs the following process:
determining respective parameters ((h 1 00 . . . h 1 22 ) (h 2 00 , . . . h 2 22 )) for identifying at least one respective homographic transformation on respective images (image 1 ,image 2 ) taken by said cameras of a same scene, by performing respective geometry analyses on said respective images (image 1 , image 2 ) ; and
performing at least one respective homographic transformation on said respective images and a respective feature detection step on respective transformed images thereby obtaining respective sets (feature set 1 , feature set 2 ) of features on said respective transformed images, such that said calibration data are obtained from matches (ml, . . . ,mk) determined between said respective sets of features.

14. A device according to claim 12 wherein said calibration data comprise information with respect to the relative position between said cameras.

15. A device according to claim 12 wherein said calibration data comprise information with respect to the relative viewing direction differences between said cameras.

16. A device according to claim 12 wherein said at least one respective homographic transformation further comprises an iterative process of pixel coordinates transformation of said respective image, followed by feature detection of the partially transformed image until all pixel coordinates of said respective image (image 1 ) are transformed.

17. A device according to claim 12 wherein said respective geometry analysis steps comprise determining line segments on said respective images.

18. A device according to claim 12 wherein said respective geometry analysis steps comprise determining curved segments on said respective image.

19. A device according to claim 12 wherein said respective geometry analysis steps comprise performing object recognition on said respective images.

20. A device according to claim 12 wherein said calibration data are further determined from said parameters for identifying said respective homographic transformations.

Assignees

• Aerts Maarten
• Tytgat Donny
• Macq Jean-Francois
• Lievens Sammy
• Alcatel Lucent

Inventors

• Aerts Maarten
• Tytgat Donny
• Macq Jean-Francois
• Lievens Sammy

Classifications

• G06T2207/10012

  Stereo images · CPC title

• G01N21/15

  Preventing contamination of the components of the optical system or obstruction of the light path · CPC title

• G01N21/954

  Inspecting the inner surface of hollow bodies, e.g. bores · CPC title

• G06T7/002

  Physics · mapped topic

• F01D25/00

  Component parts, details, or accessories, not provided for in, or of interest apart from, other groups · CPC title