Image-capturing apparatus, captured image processing system, and recording medium

Patent metadata

Field	Value
Publication number	US-9412015-B2
Application number	US-201314372628-A
Country	US
Kind code	B2
Filing date	Jan 11, 2013
Priority date	Jan 17, 2012
Publication date	Aug 9, 2016
Grant date	Aug 9, 2016

Abstract

A mobile terminal apparatus includes a geometrical arrangement detecting section ( 111 ) detecting groups of edge pixels arranged in a shape of a line segment in an image captured by an image-capturing apparatus; and a display processing section ( 112 ) causes a contour line representative of a contour of a rectangular captured object to be displayed on the captured image displayed on a display section so that the contour line is superimposed on the groups of edge pixels detected by the geometrical arrangement detecting section ( 111 ).

First claim

The invention claimed is:

1. An image-capturing apparatus, comprising:
a sensor capturing an image of an object which is rectangular;
a display displaying a captured image, which is an image captured by the sensor; and
a processor configured to:
determine, as an output target image, the captured image displayed on the display at a designated timing;
detect four groups of edge pixels arranged in a shape of a line segment on the image captured by the sensor; and

cause the display to display first missing information indicating that one corner of the object is outside an image area captured by the sensor, in a case where three of vertexes of a quadrangle surrounded by straight lines corresponding to respective four line segments represented by the detected four groups of edge pixels are within the captured image area and a remaining one of the vertexes of the quadrangle is outside the captured image area.

2. The image-capturing apparatus according to claim 1 , wherein assuming that said one of the vertexes of the quadrangle that is outside the captured image area is a first vertex, the processor causes the first missing information to be displayed in vicinity of the first vertex.

3. The image-capturing apparatus according to claim 1 , wherein assuming that (i) said one of the vertexes of the quadrangle that is outside the captured image area is a first vertex, (ii) two vertexes adjacent to the first vertex are a second vertex and a third vertex, (iii) a vertex that is diagonally opposite to the first vertex is a fourth vertex, (iv) an intersection of a line connecting the first vertex and the second vertex and a frame of the captured image area is a first intersection, and (v) an intersection of a line connecting the first vertex and the third vertex and the frame of the captured image area is a second intersection, the processor causes the first missing information to be displayed within a predetermined range from a line segment connecting the first intersection and the second intersection.

4. The image-capturing apparatus according to claim 1 , wherein:
the processor carries out a detection process of detecting groups of edge pixels arranged in the shape of a line segment with respect to the captured image by use of one detection method selected from a plurality of detection methods for detecting the groups of edge pixels arranged in the shape of a line segment;
in a case where the processor fails to detect the groups of edge pixels arranged in the shape of a line segment in the captured image to be processed, the processor carries out the detection process with respect to a next captured image to be processed by use of a detection method different from the detection method used for the captured image preceding the next captured image to be processed; and
in a case where the processor succeeds in detecting the groups of edge pixels arranged in the shape of a line segment in the captured image to be processed, the processor carries out the detection process with respect to a next captured image to be processed by use of an identical detection method to the detection method used for the captured image preceding the next captured image to be processed.

5. The image-capturing apparatus according to claim 1 , wherein the processor determines that it is the designated timing in a case where, for a predetermined period of time, (i) four groups of edge pixels are detected by the processor, (ii) all of four vertexes of a quadrangle surrounded by straight lines corresponding to respective four line segments represented by the four groups of edge pixels are within the captured image area, and (iii) an amount of variation of the vertexes is equal to or lower than a predetermined threshold value.

6. The image-capturing apparatus according to claim 1 , wherein the processor causes a contour line representative of a contour of the object to be displayed on the captured image displayed on the display in such a manner that the contour line is superimposed on the detected groups of edge pixels detected.

7. The image-capturing apparatus according to claim 6 , wherein the processor causes the contour line and the first missing information to be displayed in different colors from each other.

8. The image-capturing apparatus according to claim 6 , further comprising a switch switching on and off setting of a contour line display function of the processor.

9. The image-capturing apparatus according to claim 8 , wherein in a case where the contour line display function is set to be in an on-state by the switch, the processor causes the display to display an image obtained by geometrically correcting a region surrounded by the contour line out of the captured image to a predetermined rectangular shape.

10. An image-capturing apparatus, comprising:
a sensor capturing an image of an object which is rectangular;
a display displaying a captured image, which is an image captured by the sensor; and
a processor configured to:
determine, as an output target image, the captured image displayed on the display at a designated timing;
detect three groups of edge pixels arranged in a shape of a line segment on the image captured by sensor; and

causes the display to display second missing information indicating that one side of the object which is rectangular is outside an image area captured by the sensor, in a case where only two of intersections of straight lines corresponding to respective three line segments represented by the detected three groups of edge pixels are within the captured image area.

11. The image-capturing apparatus according to claim 10 , wherein assuming that (i) the straight lines corresponding to the respective three line segments represented by the detected three groups of edge pixels are a first straight line, a second straight line, and a third straight line, (ii) a first intersection of the first straight line and the second straight line and a second intersection of the second straight line and the third straight line are within the captured image area, (iii) one of intersections of the first straight line and a frame of the captured image area which one is farther from the first intersection is a third intersection, and (iv) one of intersections of the third straight line and the frame of the captured image area which one is farther from the second intersection is a fourth intersection, the processor causes the second missing information to be displayed within a predetermined range from a line segment connecting the third intersection and the fourth intersection.

12. The image-capturing apparatus according to claim 10 , wherein the processor:
(i) divides the captured image area into an upper half and a lower half, (ii) detects, as an upper side group of edge pixels, a group of edge pixels arranged in the shape of a line segment in the upper half in a direction that is within a predetermined angular range from a width direction of the captured image area, and (iii) detects, as a lower side group of edge pixels, a group of edge pixels arranged in the shape of a line segment in the lower half in a direction that is within a predetermined angular range from the width direction of the captured image area;
(i) divides the captured image area into a left half and a right half, (ii) detects, as a left side group of edge pixels, a group of edge pixels arranged in the shape of a line segment in the left half in a direction that is within a predetermined angular range from a height direction of the captured image area, and (iii) detects, as a right side group of edge pixels, a group of edge pixels arranged in the shape of a line segment in the right half in a direction that is within a prede

Assignees

• Sharp Kk
• Sharp Kk

Inventors

• Ishida Hiroshi

Classifications

• H04N5/142 Primary

  Edging; Contouring · CPC title

• H04N23/635 Primary

  Region indicators; Field of view indicators · CPC title

• H04N25/61

  the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4" · CPC title

• H04N23/667

  Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes · CPC title

• H04N23/632

  for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters · CPC title