Information processing device, control method of information processing device, and storage medium

Patent metadata

Field	Value
Publication number	US-2019068945-A1
Application number	US-201816113967-A
Country	US
Kind code	A1
Filing date	Aug 27, 2018
Priority date	Aug 30, 2017
Publication date	Feb 28, 2019
Grant date	—

Abstract

An information processing device decides a viewpoint position and generates a virtual viewpoint image based on the decided viewpoint position by using a plurality of images shot by a plurality of imaging apparatuses. The information processing device includes a determining unit configured to determine a scene related to the virtual viewpoint image to be generated, and a deciding unit configured to decide the viewpoint position related to the virtual viewpoint image in the scene determined by the determining unit, based on the scene determined by the determining unit.

First claim

What is claimed is:

1 . An information processing device that decides a viewpoint position and generates a virtual viewpoint image based on the decided viewpoint position by using a plurality of images shot by a plurality of imaging apparatuses, the information processing device comprising:
a determining unit configured to determine a scene related to the virtual viewpoint image to be generated; and a deciding unit configured to decide the viewpoint position related to the virtual viewpoint image in the scene determined by the determining unit, based on the scene determined by the determining unit.

2 . The information processing device according to claim 1 ,
wherein the deciding unit is configured to decide a viewpoint position, based on conditions for deciding the viewpoint position that are related to the scene determined by the determining unit.

3 . The information processing device according to claim 2 ,
wherein the deciding unit is configured to decide a viewpoint position satisfying conditions selected based on user operations out of a plurality of conditions related to the scene determined by the determining unit, as the viewpoint position related to the virtual viewpoint image to be generated.

4 . The information processing device according to claim 2 ,
wherein the deciding unit is configured to decide a line-of-sight direction relating to the virtual viewpoint image of the scene determined by the determining unit, based on conditions for deciding the viewpoint position that are related to the scene determined by the determining unit.

5 . The information processing device according to claim 1 ,
wherein the scene determined by the determining unit includes at least one of a goal scene, a shot scene, and a foul scene.

6 . The information processing device according to claim 1 ,
wherein the determining unit is configured to determine the scene based on user operations.

7 . The information processing device according to claim 1 ,
wherein at least one of shooting time relating to the virtual viewpoint image to be generated, a location shown in the virtual viewpoint image to be generated, and an incident shown in the virtual viewpoint image to be generated, is identified in the scene determined by the determining unit.

8 . An information processing device that decides a viewpoint position and generates a virtual viewpoint image based on the decided viewpoint position by using a plurality of images shot by a plurality of imaging apparatuses, the information processing device comprising:
a determining unit configured to determine conditions selected based on user operations, from a plurality of conditions for deciding a viewpoint position; and a deciding unit configured to decide the viewpoint position related to the virtual viewpoint image to be generated, based on the conditions determined by the determining unit.

9 . The information processing device according to claim 8 , further comprising:
a generating unit configured to generate the virtual viewpoint image in accordance with the viewpoint position related to the virtual viewpoint image decided by the deciding unit.

10 . The information processing device according to claim 9 , further comprising:
an output unit configured to output the virtual viewpoint image generated by the generating unit.

11 . The information processing device according to claim 8 ,
wherein the deciding unit is configured to decide a line-of-sight direction related to the virtual viewpoint image to be generated, based on the conditions determined by the determining unit.

12 . The information processing device according to claim 8 , further comprising:
an obtaining unit configured to obtain position information of a particular subject in the plurality of images, wherein the conditions are conditions based on position information of the particular subject obtained by the obtaining unit.

13 . The information processing device according to claim 8 ,
wherein the conditions are conditions for taking a line-of-sight of a person as the viewpoint and line-of-sight direction relating to the virtual viewpoint image.

14 . The information processing device according to claim 8 ,
wherein the conditions are conditions for rotating the viewpoint relating to the virtual viewpoint image, centered on a predetermined position.

15 . The information processing device according to claim 14 ,
wherein the predetermined position is the position of a predetermined person.

16 . A control method of an information processing device that decides a viewpoint position and generates a virtual viewpoint image based on the decided viewpoint position by using a plurality of images shot by a plurality of imaging apparatuses, the method comprising:
determining a scene related to the virtual viewpoint image to be generated; and deciding the viewpoint position related to the virtual viewpoint image in the determined scene, based on the determined scene.

17 . A control method of an information processing device that decides a viewpoint position and generates a virtual viewpoint image based on the decided viewpoint position by using a plurality of images shot by a plurality of imaging apparatuses, the method comprising:
determining conditions selected based on user operations, from a plurality of conditions for deciding a viewpoint position; and deciding the viewpoint position related to the virtual viewpoint image to be generated, based on the determined conditions.

18 . A computer-readable storage medium storing a program comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method according to claim 16 .

19 . A computer-readable storage medium storing a program comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method according to claim 17 .

Assignees

• Canon Kk

Inventors

• Maruyama Kazuna

Classifications

• G06K2009/00738

  Physics · mapped topic

• H04N13/117 Primary

  the virtual viewpoint locations being selected by the viewers or determined by viewer tracking · CPC title

• G06T15/20

  Perspective computation · CPC title

• G06K9/00724

  Physics · mapped topic

• G06V20/44

  Event detection · CPC title