Image processing apparatus, image processing method, and storage medium

Patent metadata

Field	Value
Publication number	US-9704246-B2
Application number	US-201615057478-A
Country	US
Kind code	B2
Filing date	Mar 1, 2016
Priority date	Sep 20, 2013
Publication date	Jul 11, 2017
Grant date	Jul 11, 2017

Abstract

An image processing apparatus, includes a processor configured to obtain a marker image including a first pixel area including a first image indicating a shape of an outer frame and a second pixel area and a second image arranged within the outer frame, extract an intersecting point of a first line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a predetermined direction and a second line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a direction perpendicular to the predetermined direction, a first apex indicating an apex of four corners of the outer frame, and a second apex included in the second image, and identify a display position using the intersecting point, the first apex, or the second apex.

First claim

What is claimed is:

1. An image processing apparatus, comprising:
a memory; and
a processor coupled to the memory and configured to:
obtain an image of a marker that includes a first pixel area and a second pixel area having mutually different color tones and is used to identify display information and a reference position for displaying the display information, the first pixel area including a first image indicating a shape of an outer frame of the first pixel area and a second image arranged within the outer frame,
extract, from the image of the marker, an intersecting point of a first line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a predetermined direction and a second line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a direction perpendicular to the predetermined direction, a first apex indicating an apex of four corners of the outer frame, and a second apex included in the second image, and
identify a position for displaying the display information while the intersecting point, the first apex, or the second apex is set as the reference position, wherein
the first line segment is identified by a first boundary obtained by being adjacent to the first pixel area and the second pixel area in a stated order towards the predetermined direction and a second boundary obtained by being adjacent to the second pixel area and the first pixel area in a stated order towards the predetermined direction, and
the second line segment is identified by a third boundary obtained by being adjacent to the first pixel area and the second pixel area in a stated order towards the direction perpendicular to the predetermined direction and a fourth boundary obtained by being adjacent to the second pixel area and the first pixel area in a stated order towards the direction perpendicular to the predetermined direction.

2. The image processing apparatus according to claim 1 , wherein
the first line segment is in parallel with the first boundary and the second boundary and is identified based on a midpoint of the first boundary and the second boundary, and
the second line segment is in parallel with the third boundary and the fourth boundary and is identified based on a midpoint of the third boundary and the fourth boundary.

3. The image processing apparatus according to claim 1 , wherein
the second image includes an image of a polygonal shape, and
the second apex includes an apex of the polygonal shape.

4. The image processing apparatus according to claim 1 , wherein the processor is configured to
identify the reference position based on descending priorities set with respect to the intersecting point, the first apex, and the second apex in a stated order.

5. The image processing apparatus according to claim 4 , wherein the priorities include weighting coefficients, and
the processor is configured to apply the weighting coefficients to the intersecting point, the first apexes, and the second apexes to calculate the reference position.

6. The image processing apparatus according to claim 4 , wherein the processor is configured to:
extract a long side formed by a plurality of second apexes included in the image of the polygonal shape and a short side shorter than the long side, and
set the priorities with respect to the plurality of second apexes based on a length of the short side.

7. The image processing apparatus according to claim 6 , wherein the processor is configured to:
set the priorities with respect to the plurality of second apexes in a manner that a higher priority is assigned as a length of the long side is longer in a case where two or more of the short sides having the same length are extracted.

8. The image processing apparatus according to claim 1 , wherein
the second image includes an image of one or more checkered shapes formed by part of the first pixel area and part of the second pixel area, and
the processor is configured to extract a center point of the one or more of the checkered shapes as the intersecting point.

9. The image processing apparatus according to claim 8 , wherein the processor is configured to:
extract edge sides of each of the one or more of the checkered shape, and
set the priorities with respect to the plurality of intersecting points extracted from the one or more checkered shapes in a manner that a higher priority is assigned as a length of the edge side is longer.

10. The image processing apparatus according to claim 1 , wherein the processor is configured to:
extract a marker ID from the marker,
generate a marker pattern corresponding to the marker ID, and
extract the intersecting point, the first apex, and the second apex by using the marker pattern.

11. An image processing method executed by a processor included in an image processing apparatus, the method comprising:
obtaining an image of a marker that includes a first pixel area and a second pixel area having mutually different color tones and is used to identify display information and a reference position for displaying the display information, the first pixel area including a first image indicating a shape of an outer frame of the first pixel area and a second image arranged within the outer frame;
extracting, from the image of the marker, an intersecting point of a first line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a predetermined direction and a second line segment in parallel with a boundary between the first pixel area and the second pixel area which are adjacent to each other along a direction perpendicular to the predetermined direction, a first apex indicating an apex of four corners of the outer frame, and a second apex included in the second image; and
identifying a position for displaying the display information while the intersecting point, the first apex, or the second apex is set as the reference position, wherein
the first line segment is identified by a first boundary obtained by being adjacent to the first pixel area and the second pixel area in a stated order towards the predetermined direction and a second boundary obtained by being adjacent to the second pixel area and the first pixel area in a stated order towards the predetermined direction, and
the second line segment is identified by a third boundary obtained by being adjacent to the first pixel area and the second pixel area in a stated order towards the direction perpendicular to the predetermined direction and a fourth boundary obtained by being adjacent to the second pixel area and the first pixel area in a stated order towards the direction perpendicular to the predetermined direction.

12. The image processing method according to claim 11 , wherein
the first line segment is in parallel with the first boundary and the second boundary and is identified based on a midpoint of the first boundary and the second boundary, and
the second line segment is in parallel with the third boundary and the fourth boundary and is identified based on a midpoint of the third boundary and the fourth boundary.

13. The image processing method according to claim 11 , wherein
the second image includes an image of a polygonal shape, and
the second apex includes an apex of the polygonal shape.

14. The image processing method according to claim 11 , wherein the method further comprising:
identifying the reference position based on descending priorities set with respect to the intersecting point, the first ap

Assignees

• Fujitsu Ltd

Inventors

• Yamaguchi Nobuyasu

Classifications

• G06V10/245

  by locating a pattern; Special marks for positioning · CPC title

• G06V10/24

  Aligning, centring, orientation detection or correction of the image · CPC title

• G06T2207/30204

  Marker · CPC title

• G06K2009/3225

  Physics · mapped topic

• G06T7/0044 Primary

  Physics · mapped topic