Information processing apparatus, method of controlling information processing apparatus, and storage medium

Patent metadata

Field	Value
Publication number	US-10171730-B2
Application number	US-201715415048-A
Country	US
Kind code	B2
Filing date	Jan 25, 2017
Priority date	Feb 15, 2016
Publication date	Jan 1, 2019
Grant date	Jan 1, 2019

Abstract

An apparatus comprises an unit configured to obtain captured images captured at a plurality of positions/orientations; an unit configured to generate a guidance instruction for causing a captured image corresponding to a position/orientation substantially the same as a captured image of a stipulated state to be obtained; an unit configured to output the guidance instruction; an unit configured to determine whether or not one captured image obtained after output of the guidance instruction was captured at a position/orientation substantially the same as the captured image of the stipulated state; and an unit configured to, if the one captured image is determined to be captured at the position/orientation, generate or update a three-dimensional map from three-dimensional coordinates of a feature included in a captured image based on the plurality of captured images including the one captured image.

First claim

What is claimed is:

1. An information processing apparatus, comprising:
one or more processors; and
a memory having stored thereon instructions which, when executed by the one or more processors, cause the information processing apparatus to:
obtain captured images that are captured by an image capturing unit at a plurality of positions and orientations;
generate a guidance instruction for causing a captured image corresponding to a position and orientation substantially the same as a captured image of a stipulated state to be obtained;
output the guidance instruction;
determine whether or not one captured image obtained after output of the guidance instruction was captured at a position and orientation substantially the same as the captured image of the stipulated state;
if the one captured image is determined to be captured at a position and orientation substantially the same as the captured image of the stipulated state, generate or update a three-dimensional map from three-dimensional coordinates of a feature included in a captured image based on the plurality of captured images including the one captured image that are captured at the plurality of positions and orientations; and
control to display the guidance instruction.

2. The information processing apparatus according to claim 1 , wherein the instructions, when executed by the one or more processors, further cause the information processing apparatus to generate, as the guidance instruction, an image that includes the captured image of the stipulated state.

3. The information processing apparatus according to claim 1 , wherein the instructions, when executed by the one or more processors, further cause the information processing apparatus to determine whether or not the one captured image was captured at a position and orientation substantially the same as the captured image of the stipulated state based on a similarity between the one captured image and the captured image of the stipulated state.

4. The information processing apparatus according to claim 1 , wherein the instructions, when executed by the one or more processors, further cause the information processing apparatus to determine whether or not the one captured image was captured at a position and orientation substantially the same as the captured image of the stipulated state based on a geometric transformation parameter between images obtained from a feature included in the one captured image and a feature included in the captured image of the stipulated state.

5. The information processing apparatus according to claim 1 , wherein the instructions, when executed by the one or more processors, further cause the information processing apparatus to store the captured image of the stipulated state.

6. The information processing apparatus according to claim 1 , wherein the instructions, when executed by the one or more processors, further cause the information processing apparatus to
obtain a position and orientation at which the captured image obtained is captured;
store a stipulated position and orientation corresponding to the stipulated state; and
generate a guidance instruction for causing a captured image corresponding to a position and orientation substantially the same as the stipulated position and orientation to be obtained.

7. The information processing apparatus according to claim 6 , wherein the instructions, when executed by the one or more processors, further cause the information processing apparatus to generate a guidance instruction including an overhead view of a measurement area including the stipulated position and orientation and a track of a plurality positions and orientations obtained.

8. The information processing apparatus according to claim 6 , wherein the instructions, when executed by the one or more processors, further cause the information processing apparatus to, based on the stipulated position and orientation and the position and orientation obtained, generate a guidance instruction including a guidance direction from a position and orientation obtained to the stipulated position and orientation.

9. The information processing apparatus according to claim 6 , wherein the instructions, when executed by the one or more processors, further cause the information processing apparatus to:
further store a track of a plurality of positions and orientations corresponding to the plurality of captured images obtained, and
based on the track of the positions and orientations, generate the guidance instruction such that the spatial range of the track of the positions and orientations expands with respect to a measurement area.

10. The information processing apparatus according to claim 6 , wherein the instructions, when executed by the one or more processors, further cause the information processing apparatus to, based on at least one of angles formed between each of orientation vectors, and respective Euclidean distances for each position between the stipulated position and orientation and the positions and orientations obtained, perform the determination of whether or not the one captured image was captured at a position and orientation substantially the same as the captured image of the stipulated state.

11. The information processing apparatus according to claim 1 , wherein the instructions, when executed by the one or more processors, further cause the information processing apparatus to further calculate an estimation accuracy of the three-dimensional map based on the estimation accuracy performs the determination of whether or not the one captured image was captured at a position and orientation substantially the same as the captured image of the stipulated state.

12. The information processing apparatus according to claim 1 , wherein the instructions, when executed by the one or more processors, further cause the information processing apparatus to determine completion of the generation of the three-dimensional map.

13. An information processing apparatus, comprising:
one or more processors;
a memory having stored thereon instructions which, when executed by the one or more processors, causes the information processing apparatus to:
obtain captured images that are captured by an image capturing unit at a plurality of positions and orientations;
generate, based on at least one captured image captured at the plurality of positions and orientations, a three-dimensional map from three-dimensional coordinates of a feature included in the captured image;
generate a guidance instruction for causing a captured image corresponding to a position and orientation substantially the same as a captured image of a stipulated state to be obtained;
output the guidance instruction;
determine whether or not one captured image obtained after output of the guidance instruction was captured at a position and orientation substantially the same as the captured image of the stipulated state;
if the one captured image is determined to be captured at a position and orientation substantially the same as the captured image of the stipulated state, modify the three-dimensional map; and
control to display the guidance instruction.

14. A method of controlling an information processing apparatus, comprising:
obtaining captured images that are captured by an image capturing unit at a plurality of positions and orientations;
generating a guidance instruction for causing a captured image corresponding to a position and orientation substantially the same as a captured image of a stipulated state to be obtained;
outputting the guidance instruction;
determining whether or not one captured image obtained afte

Assignees

• Canon Kk

Inventors

• Kobayashi Toshihiro
• Kotake Daisuke
• Suzuki Masahiro
• Fujiki Masakazu
• Katayama Akihiro

Classifications

• G06T7/579

  from motion · CPC title

• H04N23/64 Primary

  Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image · CPC title

• G01B11/002 Primary

  for measuring two or more coordinates · CPC title

• H04N5/23222 Primary

  Electricity · mapped topic