Information processing apparatus, information processing method, and recording medium

Patent metadata

Field	Value
Publication number	US-12597166-B2
Application number	US-202418891540-A
Country	US
Kind code	B2
Filing date	Sep 20, 2024
Priority date	Sep 22, 2023
Publication date	Apr 7, 2026
Grant date	Apr 7, 2026

Abstract

A high-precision positioning result in self-positioning is provided. An information processing apparatus acquires a first coordinate position inside an image of each light source included in an image captured with an imaging device among multiple light sources whose coordinate positions are known in a three-dimensional space to derive at least a coordinate position or an orientation of an own device in the three-dimensional space based on a coordinate position of the light source included in the image in the three-dimensional space and the first coordinate position. The apparatus estimates a height of the imaging device in the three-dimensional space to perform positioning processing using information on the estimated height of the imaging device, acquires a second coordinate position of the light source on the image corresponding to the positioning processing result, and corrects the height of the imaging device based on the first coordinate position and the second coordinate position.

First claim

What is claimed is:

1 . An information processing apparatus comprising
one or more processors configured to:
acquire a first coordinate position inside an image of at least one light source included in an image captured with an imaging device among a plurality of light sources whose coordinate positions in a three-dimensional space are known;
estimate a height of the imaging device in the three-dimensional space;
perform positioning processing to derive at least either of a coordinate position and an orientation of an own device in the three-dimensional space based on a coordinate position of the at least one light source included in the image in the three-dimensional space, the first coordinate position and the estimated height of the imaging device in the three-dimensional space;
acquire a second coordinate position of the light source on the image corresponding to a result of the positioning processing; and
correct the height of the imaging device based on the first coordinate position and the second coordinate position.

2 . The information processing apparatus according to claim 1 , wherein the one or more processors are configured to:
acquire, as the second coordinate position, a re-projected point obtained by re-projecting the at least one light source included in the image onto the image based on the result of the positioning processing; and correct the height of the imaging device based on the re-projected point and the first coordinate position of the at least one light source included in the image.

3 . The information processing apparatus according to claim 2 , wherein the one or more processors are configured to:
find a first elevation/depression angle as an elevation/depression angle from the imaging device to the at least one light source from the first coordinate position inside the image of the at least one light source included in the image; find a second elevation/depression angle as an elevation/depression angle from the imaging device to the re-projected point; find a distance in a horizontal direction between the at least one light source and the imaging device based on the coordinate position of the at least one light source included in the image in the three-dimensional space and a positioning result of the imaging device; calculate a correction value for the height of the imaging device based on the distance, the first elevation/depression angle, and the second elevation/depression angle; and correct the height of the imaging device based on the correction value.

4 . The information processing apparatus according to claim 1 , wherein the one or more processors are configured to use a unit vector of a three-dimensional direction vector using a focal point of the imaging device as a start point and the coordinate position of the at least one light source included in the image in the three-dimensional space as an end point to perform the positioning processing.

5 . The information processing apparatus according to claim 1 , wherein;
each of the plurality of light sources is configured to modulate light and transmit identification information on the light source concerned; and the one or more processors are configured to detect identification information and the first coordinate position of the at least one light source included in the image captured with the imaging device, and acquire the coordinate position of the at least one light source corresponding to the identification information in the three-dimensional space.

6 . The information processing apparatus according to claim 1 further comprising two or more imaging devices,
wherein the one or more processors are configured to derive at least either of the coordinate position and the orientation of the own device based on images captured with the two or more imaging devices.

7 . An information processing method comprising:
acquiring a first coordinate position inside an image of at least one light source included in an image captured with an imaging device among a plurality of light sources whose coordinate positions in a three-dimensional space are known; estimating a height of the imaging device in the three-dimensional space; performing positioning processing to derive at least either of a coordinate position and an orientation of an own device in the three-dimensional space based on a coordinate position of the at least one light source included in the image in the three-dimensional space, the first coordinate position and the estimated height of the imaging device in the three-dimensional space; acquiring a second coordinate position of the light source on the image corresponding to a positioning processing result; and correcting the height of the imaging device based on the first coordinate position and the second coordinate position.

8 . A non-transitory computer-readable recording medium storing a program causing a computer to at least perform:
acquire a first coordinate position inside an image of at least one light source included in an image captured with an imaging device among a plurality of light sources whose coordinate positions in a three-dimensional space are known; estimate a height of the imaging device in the three-dimensional space; perform the positioning processing to derive at least either of a coordinate position and an orientation of an own device in the three-dimensional space based on a coordinate position of the at least one light source included in the image in the three-dimensional space, the first coordinate position and the estimated height of the imaging device in the three-dimensional space; acquire a second coordinate position of the light source on the image corresponding to a result of the positioning processing; and correct the height of the imaging device based on the first coordinate position and the second coordinate position.

Assignees

• Casio Computer Co Ltd

Inventors

• Iizuka Nobuo
• Miyamoto Naotomo
• Kikuchi Masaaki
• Murakami Taichi

Classifications

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• G06T2207/30244

  Camera pose · CPC title

• G06T2207/30252

  Vehicle exterior; Vicinity of vehicle · CPC title

• G06T7/80 Primary

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title

• G06T7/73 Primary

  using feature-based methods · CPC title