Information processing device, information processing method, and program

Patent metadata

Field	Value
Publication number	US-2025166318-A1
Application number	US-202318841678-A
Country	US
Kind code	A1
Filing date	Mar 6, 2023
Priority date	Mar 24, 2022
Publication date	May 22, 2025
Grant date	—

Abstract

There is provided an information processing device, an information processing method, and a program for enabling imaging as intended by an instructing person. A display control unit is configured to cause a captured image captured by a camera in a first space in which an imaging target object exists to be displayed. A superimposition control unit is configured to cause, on the basis of an imaging position and an imaging angle, for the imaging target object, set in a second space that is being subjected to space sharing with the first space, an imaging instruction guide that guides imaging at the imaging angle to be superimposed and displayed as a virtual object, at a position, on the captured image, corresponding to the imaging position. The present disclosure can be applied to a three-dimensional space sharing system that synchronizes a VR space and a real space.

First claim

1 . An information processing device comprising:
a display control unit configured to cause a captured image captured by a camera in a first space in which an imaging target object exists to be displayed; and a superimposition control unit configured to cause, on a basis of an imaging position and an imaging angle, for the imaging target object, set in a second space that is being subjected to space sharing with the first space, an imaging instruction guide that guides imaging at the imaging angle to be superimposed and displayed as a virtual object, at a position, on the captured image, corresponding to the imaging position.

2 . The information processing device according to claim 1 , wherein
the imaging position and the imaging angle are set for a corresponding object corresponding to the imaging target object, the corresponding object being present in the second space.

3 . The information processing device according to claim 2 , wherein
the corresponding object comprises a virtual object on a virtual space.

4 . The information processing device according to claim 2 , wherein
the corresponding object comprises a real object existing at a location different from the first space.

5 . The information processing device according to claim 1 , wherein
the first space and the second space are subjected to three-dimensional space sharing using a virtual origin.

6 . The information processing device according to claim 1 , wherein
the imaging instruction guide comprises a three-dimensional representation image indicating at least the imaging angle from the imaging position.

7 . The information processing device according to claim 6 , wherein
the imaging instruction guide includes a stereoscopic image indicating the imaging angle and an imaging range from the imaging position, the stereoscopic image having a frustum shape with a lower base face facing in an imaging direction or a columnar shape with one of base faces facing in the imaging direction.

8 . The information processing device according to claim 6 , wherein
the imaging instruction guide includes a planar image indicating the imaging angle from the imaging position, the planar image having a plane facing in an imaging direction.

9 . The information processing device according to claim 6 , wherein
the superimposition control unit is configured to cause at least one of a size or a pose of the imaging instruction guide to change in accordance with a position and a pose of the camera.

10 . The information processing device according to claim 1 , wherein
in a case where a still image is imaged by the camera at a predetermined position in the first space, the superimposition control unit causes the still image to be superimposed and displayed as the virtual object, at a position, on the captured image, corresponding to the predetermined position.

11 . The information processing device according to claim 10 , wherein
the superimposition control unit is configured to cause either the imaging instruction guide or the still image to be hidden in accordance with a relative positional relationship between the imaging instruction guide and the still image.

12 . The information processing device according to claim 11 , wherein
the superimposition control unit is configured to determine which one of the imaging instruction guide and the still image is to be hidden in accordance with an evaluation value calculated on a basis of the relative positional relationship between the imaging instruction guide and the still image.

13 . The information processing device according to claim 11 , wherein
the superimposition control unit is configured to cause either the imaging instruction guide or the still image to be hidden in accordance with a user evaluation value in the second space with respect to the relative positional relationship between the imaging instruction guide and the still image.

14 . The information processing device according to claim 11 , wherein
in a case where a relative distance between the imaging instruction guide and the still image is shorter than a prescribed distance, the superimposition control unit causes one with an earlier generated time, out of the imaging instruction guide and the still image, to be hidden.

15 . The information processing device according to claim 1 , wherein
the superimposition control unit is configured to cause, together with a plurality of the imaging instruction guides, an arrow image indicating an imaging order at a plurality of the imaging positions corresponding to the plurality of the imaging instruction guides to be superimposed and displayed, as the virtual object, on the captured image.

16 . The information processing device according to claim 1 , further comprising:
a communication control unit configured to cause the imaging position and the imaging angle to be acquired via a network, the imaging position and the imaging angle being set in a device configured to provide the second space.

17 . The information processing device according to claim 16 , wherein
the communication control unit is configured to transmit, to the device via the network, a still image imaged by the camera at a predetermined position in the first space.

18 . The information processing device according to claim 17 , wherein
the still image is displayed as the virtual object, at a position that corresponds to the predetermined position, the position that corresponds to the predetermined position being in the second space provided by the device.

19 . An information processing method executed by an information processing device, the information processing method comprising:
displaying a captured image, the captured image being captured by a camera in a first space in which an imaging target object exists; and superimposing and displaying, as a virtual object, on a basis of an imaging position and an imaging angle, for the imaging target object, set in a second space that is being subjected to space sharing with the first space, an imaging instruction guide that guides imaging at the imaging angle, at a position, on the captured image, corresponding to the imaging position.

20 . A program that causes a computer to execute processing including:
displaying a captured image, the captured image being captured by a camera in a first space in which an imaging target object exists; and superimposing and displaying, as a virtual object, on a basis of an imaging position and an imaging angle, for the imaging target object, set in a second space that is being subjected to space sharing with the first space, an imaging instruction guide that guides imaging at the imaging angle, at a position, on the captured image, corresponding to the imaging position.

Assignees

• Sony Group Corp

Inventors

• Tajima Daisuke
• Ichikawa Miwa
• Ishii Tomohiro
• Yumiba Hiromu

Classifications

• G06T2207/20221

  Image fusion; Image merging · CPC title

• G06T5/50

  using two or more images, e.g. averaging or subtraction · CPC title

• G06F3/14

  Digital output to display device {; Cooperation and interconnection of the display device with other functional units} · CPC title

• H04N23/60

  Control of cameras or camera modules · CPC title

• H04N23/633

  for displaying additional information relating to control or operation of the camera · CPC title