Image generating device, electronic device, image generating method and recording medium

Patent metadata

Field	Value
Publication number	US-2016188992-A1
Application number	US-201514979598-A
Country	US
Kind code	A1
Filing date	Dec 28, 2015
Priority date	Dec 26, 2014
Publication date	Jun 30, 2016
Grant date	—

Abstract

The present disclosure can obtain a high-quality composite image by determining a suitable boundary when input images are sequentially stitched together to generate the composite image. An image generating apparatus 1 generates a composite image by stitching sequentially input images together. A difference value calculating section 15 calculates difference values by using the pixel values of a reference image and the pixel values of a target image that partly overlap the reference image. The difference values represent the relative relationship between the reference image and the target image. A boundary determining section 16 determines a boundary for stitching the reference image and the target image together by using the difference values calculated by the difference value calculating section 15 . Then, an image compositing section 18 generates the composite image by stitching the reference image and the target image together based on the boundary determined by the boundary determining section 16.

First claim

What is claimed is:

1 . An image generating device that stitches sequentially input images together to generate a composite image, comprising:
a relative value calculating unit configured to calculate relative values from pixel values of a first input image and pixel values of a second input image that partly overlaps the first input image, in which the relative values represent relative relationship between the first input image and the second input image; a boundary determining unit configured to determine a boundary for stitching the first input image and the second input image together by using the relative values calculated by the relative value calculating unit; and an image compositing unit configured to stitch the first input image and the second input image together based on the boundary determined by the boundary determining unit so as to generate the composite image.

2 . The image generating device according to claim 1 ,
wherein the boundary determining unit determines the boundary by performing predetermined separation processing on a relative value image that is composed of the relative values calculated by the relative value calculating unit as pixel values, so as to separate the relative value image into a target subject area, which is an image area of a target subject, and a non-target subject area, which is the other image area in the relative value image.

3 . The image generating device according to claim 2 ,
wherein the boundary determining unit determines the boundary by performing pixel set search processing as the separation processing to search the relative value image for a pixel set that meets a predetermined separation condition of an evaluation value for separating the target subject area from the non-target subject area, in which the pixel set is composed of a series of pixels from a pixel at a starting point of the boundary to a pixel at an end point of the boundary, and the evaluation value is calculated based on relative values of the series of pixels.

4 . The image generating device according to claim 2 ,
wherein the boundary determining unit determines the boundary by performing the separation processing under a restraint condition that restricts the boundary from being formed on a predetermined boundary restraint area in the relative value image.

5 . The image generating device according to claim 4 , further comprising:
a pixel value correcting unit configured to change pixel values of pixels in the boundary restraint area in the relative value image to a predetermined pixel value based on the restraint condition, wherein the boundary determining unit determines the boundary by performing the separation processing on the relative value image with the corrected pixel value changed by the pixel value correcting unit.

6 . The image generating device according to claim 4 , further comprising:
a face detecting unit configured to detect a face from at least one of the first and second input images, wherein the boundary determining unit determines the boundary by performing the separation processing under the restraint condition in which an area in the relative value image that corresponds to the face detected by the face detecting unit is set as the boundary restraint area.

7 . The image generating device according to claim 4 ,
wherein the boundary determining unit comprises a boundary re-determining unit configured to re-determine the boundary under a restraint condition different from the original restraint condition, and the image compositing unit comprises an image re-compositing unit configured to stitch the first input image and the second input image together based on the boundary re-determined by the boundary re-determining unit, so as to regenerate the composite image.

8 . The image generating device according to claim 1 , further comprising:
an alignment unit configured to align the second input image and the first input image with each other based on correspondence between characteristic points in the first input image and characteristic points in the second input image, wherein the image compositing unit stitches the first input image and the second input image together based on an alignment result obtained by the alignment unit and the boundary determined by the boundary determining unit.

9 . An electronic device, comprising:
the image generating device according to claim 1 ; a display unit; and a display control unit configured to display the composite image generated by the image compositing unit on the display unit.

10 . The electronic device according to claim 9 ,
wherein the display control unit overlays the boundary determined by the boundary determining unit on the composite image.

11 . An electronic device, comprising:
the image generating device according to claim 4 ; an operating unit; a display unit; and a display control unit configured to display at least one of the first and second input images on the display unit, wherein the boundary determining unit determines the boundary under the restraint condition in which a specified area is specified in the input image displayed on the display unit according to a user operation on the operating unit, and an area in the relative value image that corresponds to the specified area is set as the boundary restraint area.

12 . An electronic device, comprising:
the image generating device according to claim 7 ; an operating unit; a display unit; and a display control unit configured to display the composite image generated by the image compositing unit on the display unit, wherein the display control unit overlays the boundary determined by the boundary determining unit on the composite image, when the specified area specified by the user operation on the operating unit includes the boundary, the boundary re-determining unit re-determines the boundary under the restraint condition in which an area in the relative value image that corresponds to the specified area is set as the boundary restraint area, and the display control unit displays the composite image regenerated by the image re-compositing unit on the display unit.

13 . The electronic device according to claim 10 ,
wherein the display control unit displays the boundary on the display unit in a manner distinguishable from the composite image.

14 . An electronic device, comprising:
the image generating device according to claim 1 ; a display unit; an imaging unit; a display control unit configured to display a standby imaging screen on the display unit, in which the standby imaging screen is a screen in a standby state for the imaging unit for photographing a subject; a face detecting unit configured to detect a face from an image shown in the standby imaging screen; and a notifying unit configured to give a predetermined caution when the face detected by the face detecting unit is included in a predetermined marginal area of the standby imaging screen, wherein the image generating device generates the composite image by using photographed images captured by the imaging unit as the first and second input images.

15 . The electronic device according to claim 14 ,
wherein the notifying unit gives as the caution any one of: (1) a notification that prompts the user to adjust a position of the electronic device or a position of the face so that the face is away from a margin of the screen, (2) a notification that prompts the user to move the face toward a center of the screen; and (3) a notification that prompts the user to take at least one image in which the face is not located

Assignees

• Morpho Inc

Inventors

• Hiraga Masaki
• HIRAI Shun
• Sawai shogo
• Ono Ryo

Classifications

• G06T3/4038 Primary

  Image mosaicing, e.g. composing plane images from plane sub-images · CPC title

• G06V10/44

  Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components · CPC title

• H04N5/265

  Mixing · CPC title

• G06T3/403

  Edge-driven scaling; Edge-based scaling · CPC title

• H04N5/2624 Primary

  for obtaining an image which is composed of whole input images, e.g. splitscreen · CPC title