Image processing method and image processing system

Patent metadata

Field	Value
Publication number	US-10277832-B2
Application number	US-201615358297-A
Country	US
Kind code	B2
Filing date	Nov 22, 2016
Priority date	Jun 20, 2014
Publication date	Apr 30, 2019
Grant date	Apr 30, 2019

Abstract

An image processing method for processing a plurality of images is provided. The image processing method includes: acquiring a plurality of first images, each of the plurality of first images taken with each of a plurality of imaging devices; acquiring first imaging clock times, each of the first imaging clock times corresponding to each of the plurality of first images; selecting a plurality of second images from the plurality of first images; and generating an image set constructed with the plurality of second images. Each of second imaging clock times correspond to each of the plurality of second images. The second imaging clock times are (i) substantially matched with each other and (ii) included in the first imaging clock times.

First claim

What is claimed is:

1. An image processing method comprising:
acquiring, by a processor of an image processing system, a plurality of first images, each of the plurality of first images taken with each of a plurality of imaging devices, the plurality of imaging devices including a first imaging device and a second imaging device;
acquiring, by the processor, first imaging clock times, each of the first imaging clock times corresponding to each of the plurality of first images;
selecting, by the processor, a plurality of second images from the plurality of first images by comparing the first imaging clock times with each other, each of second imaging clock times corresponding to each of the plurality of second images, the second imaging clock times (i) being substantially matched with each other and (ii) included in the first imaging clock times;
generating, by the processor, an image set constructed with the plurality of second images;
determining, by the processor, that the first imaging device that captures a first image corresponding to a first clock time and the second imaging device that captures a second image corresponding to a second clock time are synchronous when an overlap exists between the first imaging clock time and the second imaging clock time;
calculating, by the processor, three-dimensional information indicating three-dimensional states of at least one of (i) a second plurality of imaging devices, each of the second plurality of imaging devices take each of the plurality of second images and (ii) subjects, each of subjects are imaged in each of the plurality of second images based on the plurality of second images included in the image set; and
outputting, by the processor, the calculated three-dimensional information,
wherein, in the selecting, (i) a specific image that is one of the plurality of first images, and (ii) at least one exposure overlapping image that is an image acquired by the imaging whose exposure overlaps imaging exposure of the specific image, are selected as the plurality of second images.

2. The image processing method according to claim 1 , wherein
the three-dimensional information indicates at least one of (i) positions and (ii) postures, each of the positions and each of the postures corresponding to each of the second plurality of imaging devices.

3. The image processing method according to claim 1 , wherein
the three-dimensional information indicates at least one of (i) positions and (ii) postures, each of the positions and each of the postures corresponding to each of the subjects which are imaged in each of the plurality of second images.

4. The image processing method according to claim 1 , wherein
in the acquiring of the first imaging clock times, the first imaging clock times are acquired, the first imaging clock times indicating with time accuracy higher than any other exposure time which are used in imaging of the plurality of first images.

5. The image processing method according to claim 1 , wherein
in the acquiring of the plurality of first images, a first plurality of image signals are acquired, the first plurality of image signals including the plurality of first images, each of the plurality of image signals corresponding to each of the plurality of imaging devices,
in the selecting, a second plurality of image signals are selected from the first plurality of image signals, the second plurality of image signals including the plurality of second images, the second imaging clock times are substantially matched with each other, and
in the generating, the image set constructed with the second plurality of image signals is generated.

6. The image processing method according to claim 5 , wherein
one of the first plurality of image signals is moving image data including a plurality of images and clock time information for acquiring the first imaging clock times, and
in acquiring of the first imaging clock times, the first imaging clock times by image signal basis based on the clock time information are acquired, each of the first imaging clock times corresponding to each of the plurality of first images.

7. The image processing method according to claim 5 , wherein
one of the plurality of image signals is image data including one of the plurality of first images and clock time information for acquiring one of the imaging clock times corresponding to the one of the plurality of first images, and
in acquiring of the first imaging clock times, one of the first imaging clock times by image signal basis based on the clock time information are acquired, the one of the first imaging clock time corresponding to the one of the plurality of first images.

8. The image processing method according to claim 1 , further comprising:
generating, by the processor, an image of an area, where a subject is estimated to be at a standstill at a clock time different from an imaging clock time of an original image as a still image in which the clock time is set to the imaging clock time, from the original image acquired by a processing target device that is one of the plurality of imaging devices, the still image regarded as acquired by the processing target device, wherein
in the selecting, the plurality of second images in which the second imaging clock times are substantially matched with each other are selected from the plurality of first images and the still image.

9. The image processing method according to claim 8 , wherein
in the generating of an image of an area,
the area in the original image is specified by comparing the original image with, at least one image (i) acquired with the processing target device and (ii) acquired in at least one of the clock times before and after the imaging clock time of the original image and generating the still image.

10. The image processing method according to claim 9 , wherein
in the generating of an image of an area,
the area is specified in each processing unit constituting the original image by judging whether the processing unit corresponds to the area, and
the processing unit is a block, an object block taken in the original image, or a sub-object indicated by dividing the object.

11. The image processing method according to claim 1 , further comprising
generating, by the processor, a temporal interpolated image in which a clock time different from an imaging clock time of each of a plurality of reference images is set to an imaging clock time as an image acquired from a processing target device, which is one of the plurality of imaging devices, by temporally interpolating the plurality of reference images that are a plurality of images acquired from the processing target device, wherein
in the selecting, a plurality of images in which imaging clock times are substantially matched with each other are selected from the plurality of first images and the generated temporal interpolated image.

12. The image processing method according to claim 11 , wherein
in the generating of the temporal interpolated image, the interpolated image is generated based on a uniform motion model.

13. The image processing method according to claim 11 , wherein
in the generating of the temporal interpolated image,
the temporal interpolation is performed in each processing unit constituting each of the plurality of reference images, and
the processing unit is a block, an object block taken in the original image, or a sub-object indicated by dividing the object.

14. An image processing system comprising:
a processor; and
a memory having a computer program stored thereon, the computer program causing, when the computer program is executed, th

Assignees

• Panasonic Ip Man Co Ltd

Inventors

• Matsunobu Toru
• Sugio Toshiyasu
• Shibahara Youji
• Maruyama Yuki

Classifications

• H04N23/90 Primary

  Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums · CPC title

• H04N13/296

  Synchronisation thereof; Control thereof · CPC title

• H04N2013/0096

  Synchronisation or controlling aspects · CPC title

• H04N13/243

  using three or more two-dimensional [2D] image sensors · CPC title

• H04N5/247 Primary

  Electricity · mapped topic