Information processing system using captured image, information processing device, and information processing method

Patent metadata

Field	Value
Publication number	US-9357203-B2
Application number	US-201213714765-A
Country	US
Kind code	B2
Filing date	Dec 14, 2012
Priority date	Jul 2, 2010
Publication date	May 31, 2016
Grant date	May 31, 2016

Abstract

An input information acquisition unit of an information processing device acknowledges a user input. An imaging condition control unit initiates imaging using the imaging condition determined according to the user input or a result of analyzing a captured image. An imaging condition storage unit stores an imaging condition table that maps target functions to imaging conditions. First and second image analysis units and acquire images captured by first and second cameras and installed in the imaging device and perform necessary image analysis. An information integration unit integrates images captured by the pair of cameras and results of analysis. An image data generation unit generates data for an image output as a result of the process.

First claim

What is claimed is:

1. An information processing system adapted to generate output image data by capturing an image of a subject and successively acquiring data of the image, comprising:
first and second cameras configured to capture first and second images of the subject, respectively;
an image analysis unit configured to process the first image such that at least one region of interest of the subject found within the first image is identified;
a control unit configured to cause the first and second cameras to capture the first and second images of the subject using respective imaging parameters, and to cause the second camera to capture the second image of the subject such that the second image is limited to the at least one region of interest; and
an information integration unit configured to integrate the first and second images so as to generate the output image data by substituting image data of the first image corresponding to the at least one region of interest of the subject with image data of the second image, wherein:
the second image captured by the second camera is subject to an imaging condition defined to track a target within the subject,
the image analysis unit is configured to recognize motion by the target by: (i) tracking the target in the second image captured by the second camera, (ii) determining a pattern of the motion of the target in the second image, (iii) comparing the pattern of motion of the target with a plurality of predetermined patterns of motion, and (iv) selecting one or more of the predetermined patterns of motion based on the comparison, and
the information integration unit generates the output image data by processing the first image captured by the first camera and including the target in accordance with the selected one or more predetermined patterns.

2. The information processing system according to claim 1 ,
wherein the second camera captures the second image using an imaging condition defined to acquire positional information on a predetermined target on the subject, and
wherein the information integration unit generates the output image data by inducing, in the first image captured by the first camera, an image change dependent on the positional information of the predetermined target.

3. The information processing system according to claim 1 ,
wherein the second image captured by the second camera is subject to an imaging condition defined in accordance with a shape of a marker provided in a target on the subject,
wherein the image analysis unit is configured to recognize motion by the target by detecting the marker within the second image captured by the second camera, and
wherein the information integration unit generates the output image data by processing the first image captured by the first camera and including the target in accordance with a pattern of the motion of the target.

4. The information processing system according to claim 1 , wherein the second image captured by the second camera is subject to an exposure time shorter than an exposure time of the first camera used at the time of imaging.

5. The information processing system according to claim 1 , wherein the second image captured by the second camera is subject to a stop value smaller than a stop value of the first camera used at the time of imaging.

6. The information processing system according to claim 1 , wherein the second image captured by the second camera is subject to a frame rate higher than a frame rate of the first camera used at the time of imaging.

7. The information processing system according to claim 1 ,
wherein the second image captured by the second camera is subject to a frame rate lower than a frame rate of the first camera used at the time of imaging, and
wherein the image analysis unit is configured to refer to a displacement of a predetermined target in an image frame captured by the second camera and to a scan speed used at the time of capturing the image so as to acquire a change in target speed of the target and to thereby recognize motion by the target.

8. The information processing system according to claim 1 ,
wherein the image analysis unit is configured to detect a position of a predetermined target within the subject by analyzing image data obtained through imaging by the first camera,
wherein the second camera refers to positional information on the target and captures the second image of a region including the target at a narrow angle of view and a higher resolution than the first image captured by the first camera, and
wherein the information integration unit generates the output image data by synthesizing the second image captured by the second camera in the region including the target in the first image captured by the first camera.

9. An information processing device adapted to generate output image data by successively acquiring image data of a subject, comprising:
an image analysis unit configured to: (i) receive first and second images of the subject from first and second cameras, respectively, where first image is captured using a first frame rate, and the second image is captured using a second frame rate, higher than the first frame rate; and (ii) recognize motion of a target within the subject by: (a) tracking the target in the second image captured by the second camera, (b) determining a pattern of the motion of the target in the second image, (c) comparing the pattern of motion of the target with a plurality of predetermined patterns of motion, and (d) selecting one or more of the predetermined patterns of motion based on the comparison;
an imaging condition control unit configured to cause the first and second cameras to capture the first and second images of the subject using respective imaging parameters; and
an information integration unit configured to integrate the first and second images so as to generate output image data by adding animation image data to the first image, where the animation image data are specific to the recognized motion of the target within the subject.

10. An information processing method adapted to successively acquire image data of an image capturing a subject and to output associated output image data, comprising:
receiving first and second images of the subject from first and second cameras, respectively;
processing the first image such that at least one region of interest of the subject found within the first image is identified;
controlling the first and second cameras to capture the first and second images of the subject using respective imaging parameters, and causing the second camera to capture the second image of the subject such that the second image is limited to the at least one region of interest;
integrating the first and second images so as to generate the output image data by substituting image data of the first image corresponding to the at least one region of interest of the subject with image data of the second image; and
outputting the output image data to a display device, wherein:
the second image captured by the second camera is subject to an imaging condition defined to track a target within the subject,
the method further comprises recognizing motion by the target by: (i) tracking the target in the second image captured by the second camera, (ii) determining a pattern of the motion of the target in the second image, (iii) comparing the pattern of motion of the target with a plurality of predetermined patterns of motion, and (iv) selecting one or more of the predetermined patterns of motion based on the comparison, and
the step of integrating includes generating the output image data by processing the first image captured by the first camera and including the target in accordan

Assignees

• Sony Computer Entertainment Inc
• Sony Corp
• Sony Interactive Entertainment Inc

Inventors

• Ohba Akio
• Segawa Hiroyuki
• Inada Tetsugo

Classifications

• H04N23/635

  Region indicators; Field of view indicators · CPC title

• H04N23/73

  by influencing the exposure time · CPC title

• H04N23/661

  Transmitting camera control signals through networks, e.g. control via the Internet · CPC title

• G06V10/245

  by locating a pattern; Special marks for positioning · CPC title

• G06K9/3216

  Physics · mapped topic