Information processing device, information processing method, program, and display system

Patent metadata

Field	Value
Publication number	US-12470679-B2
Application number	US-202218272489-A
Country	US
Kind code	B2
Filing date	Jan 27, 2022
Priority date	Feb 25, 2021
Publication date	Nov 11, 2025
Grant date	Nov 11, 2025

Abstract

An information processing device according to the present technology includes a display control unit that controls a display of rotation center position information on a target space captured image that is an image in which a real space for which a free-viewpoint image is to be generated is captured, the rotation center position information indicating a position of viewpoint rotation center of the free-viewpoint image.

First claim

The invention claimed is:

1 . An information processing device comprising:
circuitry configured to
determine rotation center position information with respect to a plurality of images captured by a plurality of imaging devices, and
control display of the determined rotation center position information on a target space captured image captured by one of the plurality of imaging devices,
wherein the target space captured image is an image capturing a real space for which a free-viewpoint image is generated using the plurality of images, wherein the rotation center position information indicates a position of viewpoint rotation center of the free-viewpoint image generated from a start imaging device at a start viewpoint of the free-viewpoint image to an end imaging device at an end viewpoint of the free-viewpoint image, and wherein the circuitry is further configured to control display of an imaging device path indicated by imaging device path information from the start viewpoint to the end viewpoint, the imaging device path determining the rotation center position information.

2 . The information processing device according to claim 1 ,
wherein the rotation center position information includes information indicating a height of the viewpoint rotation center.

3 . The information processing device according to claim 1 ,
wherein the circuitry controls the display of the determined rotation center position information by displaying information indicating a specifiable range of the viewpoint rotation center on the target space captured image.

4 . The information processing device according to claim 3 ,
wherein the circuitry is further configured to receive an operation on the displayed rotation center position information, and wherein the circuitry receives only an operation to specify the position of the viewpoint rotation center within the specifiable range as a valid position specification operation.

5 . The information processing device according to claim 1 ,
wherein the circuitry controls a display of information indicating an image frame of the free-viewpoint image on the target space captured image.

6 . The information processing device according to claim 1 ,
wherein the target space captured image is a captured image from at least one of the start imaging device at the start viewpoint of the free-viewpoint image and the end imaging device at the end viewpoint of the free-viewpoint image.

7 . The information processing device according to claim 6 ,
wherein the start imaging device and the end imaging device are determined based on the imaging device path information.

8 . The information processing device according to claim 1 ,
wherein the circuitry determines the rotation center position information based on a result of image recognition processing on the target space captured image.

9 . The information processing device according to claim 5 ,
wherein the circuitry determines the image frame based on a result of image recognition processing on the target space captured image.

10 . The information processing device according to claim 6 ,
wherein the target space captured image includes the captured image from the start imaging device and the captured image from the end imaging device.

11 . The information processing device according to claim 1 ,
wherein the circuitry is further configured to
receive an operation on the displayed rotation center position information, and
generate the free-viewpoint image based on information on the viewpoint rotation center set based on the received operation.

12 . The information processing device according to claim 1 ,
wherein the circuitry controls the display of the determined rotation so that the rotation center position information is displayed in a display area for the information on the camera path.

13 . The information processing device according to claim 1 ,
wherein the circuitry is further configured to receive an operation on the information on imaging device path as an operation to adjust a shape of a viewpoint movement trajectory indicated by imaging device path information.

14 . The information processing device according to claim 1 ,
wherein the circuitry controls the determined rotation center position to be displayed immediately after the imaging device path information is specified.

15 . An information processing method comprising:
determining, by an information processing device, rotation center position information with respect to a plurality of images captured by a plurality of imaging devices; and controlling, by the information processing device, display of the determined rotation center position information on a target space captured image captured by one of the plurality of imaging devices, wherein the target space captured image is an image capturing a real space for which a free-viewpoint image is generated using the plurality of images, wherein the rotation center position information indicates a position of viewpoint rotation center of the free-viewpoint image generated from a start imaging device at a start viewpoint of the free-viewpoint image to an end imaging device at an end viewpoint of the free-viewpoint image, and wherein the method further comprises controlling display of an imaging device path indicated by imaging device path information from the start viewpoint to the end viewpoint, the imaging device path determining the rotation center position information.

16 . A non-transitory computer-readable storage medium having embodied thereon a program, which when executed by a computer device causes the computer device to implement a function of execute a method, the method comprising:
determining rotation center position information with respect to a plurality of images captured by a plurality of imaging devices; and controlling display of the determined rotation center position information on a target space captured image captured by one of the plurality of imaging devices, wherein the target space captured image is an image capturing a real space for which a free-viewpoint image is generated using the plurality of images, wherein the rotation center position information indicates a position of viewpoint rotation center of the free-viewpoint image generated from a start imaging device at a start viewpoint of the free-viewpoint image to an end imaging device at an end viewpoint of the free-viewpoint image, and wherein the method further comprises controlling display of an imaging device path indicated by imaging device path information from the start viewpoint to the end viewpoint, the imaging device path determining the rotation center position information.

17 . A display system comprising:
a display device configured to display an image; and circuitry configured to
determine rotation center position information with respect to a plurality of images captured by a plurality of imaging devices, and
control, in the display device, display of the determined rotation center position information on a target space captured image captured by one of the plurality of imaging devices,
wherein the target space captured image is an image capturing a real space for which a free-viewpoint image is generated using the plurality of images, wherein the rotation center position information indicates a position of viewpoint rotation center of the free-viewpoint image generated from a start imaging device at a start viewpoint of the free-viewpoint image to an end imaging device at an end viewpoint of the free-viewpoint image, and wh

Assignees

• Sony Group Corp

Inventors

• Ogura Sho
• Yoshioka Yoshihiro
• Yoshioka Keiichi
• Yoshikawa Jun

Classifications

• H04N13/398

  Synchronisation thereof; Control thereof · CPC title

• H04N13/282

  for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems · CPC title

• H04N13/349

  Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking (for viewing without the aid of special glasses using fly-eye lenses H04N13/307) · CPC title

• H04N7/181

  for receiving images from a plurality of remote sources · CPC title

• H04N5/222

  Studio circuitry; Studio devices; Studio equipment (cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00) · CPC title