Image pickup apparatus, information processing system, mat, and image generation method

Patent metadata

Field	Value
Publication number	US-10869010-B2
Application number	US-201916594982-A
Country	US
Kind code	B2
Filing date	Oct 7, 2019
Priority date	Feb 6, 2015
Publication date	Dec 15, 2020
Grant date	Dec 15, 2020

Abstract

A mat for an image pickup apparatus, where the image pickup apparatus operates to recognize a real object, the mat includes: a play field that defines a bottom region of a space in which the real object is placed; and a calibration chart located in the space and having a plurality of color regions in which respective luminances thereof differ from one another, where: the image pickup apparatus: (i) obtains data of a picked up image of the space in which the real object is located; and (ii) evaluates the picked up image and adjusts at least one of an image pickup condition in which the picked up image of the space is taken, and a processing condition in which the data are analyzed to recognize the real object, and at least one of the image pickup condition and the processing condition are adjusted based on color information in the data of the picked up image resulting from the plurality of color regions of the calibration chart.

First claim

The invention claimed is:

1. A mat for an image pickup apparatus, where the image pickup apparatus operates to recognize a real object, the mat comprising:
a play field that defines a bottom region of a space in which the real object is placed; and
a calibration chart located in the space and having a plurality of color regions in which respective luminances thereof differ from one another, wherein:
the image pickup apparatus: (i) obtains data of a picked up image of the space in which the real object is located; and (ii) evaluates the picked up image and adjusts at least one of an image pickup condition in which the picked up image of the space is taken, and a processing condition in which the data are analyzed to recognize the real object, and
the at least one of the image pickup condition and the processing condition are adjusted based on color information in the data of the picked up image resulting from the plurality of color regions of the calibration chart.

2. The mat according to claim 1 , wherein the calibration chart includes a color region having a luminance corresponding to a supposed color of the real object.

3. The mat according to claim 1 , wherein:
the mat includes a first mat that includes the play field and a second mat that includes the calibration chart, and
the second mat is placed and removably mounted on the first mat.

4. The mat according to claim 1 , wherein a luminance is evaluated of a picture of the plurality of color regions of the calibration chart and adjusts the processing condition so as to expand a difference between a plurality of luminances corresponding to the luminance of the color of the real object.

5. The mat according to claim 4 , wherein a luminance range is determined within which the difference is to be expanded based on a luminance distribution of the picture of the real object in the picked up image.

6. The mat according to claim 1 , wherein a color is evaluated of a picture of a given color region, among the plurality of color regions, having a same color as that of the real object in the calibration chart and adjusting the processing condition so as to expand a distance between a plurality of colors of different pictures in a color space.

7. The mat according to claim 1 , wherein processing condition is adjusted, by way of adjusting a correction rule upon gamma correction.

8. The mat according to claim 1 , wherein a gain value is adjusted of each color component such that a picture of a color region in the calibration chart, which has a color same as one of chromatic colors of the real object, has an achromatic color.

9. The mat according to claim 1 , wherein a luminance of a given color region is evaluated, among the plurality of color regions in the calibration chart, which has a given luminance, and adjusts the at least one of the image pickup condition and the processing condition in a direction in which the given luminance is adjusted to a target luminance determined in advance.

10. The mat according to claim 1 , wherein a white balance is adjusted to a picture of a color region of an achromatic color, among the plurality of color regions, in the calibration chart.

11. The mat according to claim 1 , wherein the data are obtained in parallel, the data being of the picked up image produced in accordance with the processing condition being adjusted, and another data of another picked up image produced in accordance with another processing condition that omits at least part of an adjustment.

12. The mat according to claim 1 , wherein the data are obtained in alternating fashion, the data being of a picked up image produced in accordance the processing condition being adjusted, and data of a picked up image produced in accordance with another processing condition that omits at least part of an adjustment.

Assignees

• Sony Interactive Entertainment Inc

Inventors

• Ogasawara Hidehiko
• Nagatsuka Norio
• Numaguchi Naoki
• Segawa Hiroyuki
• Ohba Akio

Classifications

• A63F13/25 Primary

  Output arrangements for video game devices · CPC title

• G06V10/56

  relating to colour · CPC title

• H04N9/77 Primary

  Circuits for processing the brightness signal and the chrominance signal relative to each other, e.g. adjusting the phase of the brightness signal relative to the colour signal, correcting differential gain or differential phase (circuits for matrixing H04N9/67) · CPC title

• H04N23/72

  Combination of two or more compensation controls · CPC title

• H04N23/70

  Circuitry for compensating brightness variation in the scene · CPC title