Information processing apparatus, information processing method, and program

Patent metadata

Field	Value
Publication number	US-10652449-B2
Application number	US-201716081561-A
Country	US
Kind code	B2
Filing date	Mar 8, 2017
Priority date	Mar 8, 2016
Publication date	May 12, 2020
Grant date	May 12, 2020

Abstract

Position information about a subject is acquired, timing information indicating a passage of time is acquired, and on a basis of the timing information and the position information about the subject, camerawork control information controlling the camerawork of an image capture apparatus that captures the subject is generated. The present disclosure is applicable to a switcher apparatus that controls multiple robot cameras.

First claim

The invention claimed is:

1. An information processing apparatus, comprising:
processing circuitry configured to:
obtain a table set that includes timing information, position information indicating various possible positions of a subject for each timing designated in the timing information, and camerawork control information in association with one another;
identify a piece of the camerawork control information from the table set for a particular image capture apparatus, the piece of the camerawork control information being registered in the table set in association with a particular timing designated in the timing information that corresponds to a current time and a particular position for the particular timing indicated in the position information that corresponds to a current position of the subject; and
control the particular image capture apparatus to capture an image of the subject according to the identified piece of the camerawork control information.

2. The information processing apparatus according to claim 1 , wherein the processing circuitry is configured to:
obtain the table set from a plurality of table sets that each corresponds to a respective image capture apparatus of a plurality of image capture apparatuses; and
control camerawork of each image capture apparatus of the plurality of image capture apparatuses by using a corresponding table set of the plurality of table sets.

3. The information processing apparatus according to claim 1 , wherein the processing circuitry is configured to:
obtain the table set from a plurality of table sets that each corresponds to a respective composition setting of a plurality of composition settings for an image capture target.

4. The information processing apparatus according to claim 3 , wherein the processing circuitry is configured to:
select the table set from the plurality of table sets on a basis of condition information indicating a condition of the image capture target.

5. The information processing apparatus according to claim 4 , wherein
the condition information is stats information in a case in which the image capture target is a sports broadcast, and is a musical score in a case in which the image capture target is a live music performance.

6. The information processing apparatus according to claim 1 , wherein the processing circuitry is configured to:
in a case in which the particular position corresponding to the current position of the subject does not exist in the table set, generate the piece of the camerawork control information by interpolating pieces of the camerawork control information in the table set that are in association with possible positions for the particular timing indicated in the position information that are neighboring the current position of the subject.

7. The information processing apparatus according to claim 1 , wherein
the position information indicates the various possible positions in a three-dimensional space.

8. The information processing apparatus according to claim 1 , wherein
the piece of the camerawork control information includes information for controlling one or more of a pan, a tilt, and a zoom of the particular image capture apparatus.

9. The information processing apparatus according to claim 1 , wherein the processing circuitry is configured to:
in a case in which the subject is recognized from the image captured by the particular image capture apparatus, and a composition of the image with respect to the subject does not match an anticipated composition, adjust the identified piece of the control information such that an updated image captured by the particular image capture apparatus has an updated composition matching the anticipated composition.

10. An information processing method, comprising:
obtaining a table set that includes timing information, position information indicating various possible positions of a subject for each timing designated in the timing information, and camerawork control information in association with one another;
identifying a piece of the camerawork control information from the table set for a particular image capture apparatus, the piece of the camerawork control information being registered in the table set in association with a particular timing designated in the timing information that corresponds to a current time and a particular position for the particular timing indicated in the position information that corresponds to a current position of the subject; and
controlling the particular image capture apparatus to capture an image of the subject according to the identified piece of the camerawork control information.

11. A non-transitory computer-readable storage medium storing instructions which when executed by a computer causes the computer to perform:
obtaining a table set that includes timing information, position information indicating various possible positions of a subject for each timing designated in the timing information, and camerawork control information in association with one another;
identifying a piece of the camerawork control information from the table set for a particular image capture apparatus, the piece of the camerawork control information being registered in the table set in association with a particular timing designated in the timing information that corresponds to a current time and a particular position for the particular timing indicated in the position information that corresponds to a current position of the subject; and
controlling the particular image capture apparatus to capture an image of the subject according to the identified piece of the camerawork control information.

Assignees

• Sony Corp

Inventors

• Hattori Hironori
• Shinohe Yusuke
• Watanabe Takuya

Classifications

• G06T7/80

  Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration · CPC title

• H04N5/23206

  Electricity · mapped topic

• H04N5/23296

  Electricity · mapped topic

• H04N5/23299

  Electricity · mapped topic

• H04N5/232 Primary

  Electricity · mapped topic