Display control method and display control apparatus

Patent metadata

Field	Value
Publication number	US-2018247430-A1
Application number	US-201815895807-A
Country	US
Kind code	A1
Filing date	Feb 13, 2018
Priority date	Feb 27, 2017
Publication date	Aug 30, 2018
Grant date	—

Abstract

A display control apparatus includes a memory, and a processor configured to obtain an image including an object, the image being captured by a camera, extract a group of edge lines from the image, determine a plurality of edge lines in accordance with a position of a reference object from among the group of edge lines when the reference object is detected in the image, execute an association process between each of the plurality of edge lines and each of a plurality of ridge lines included in a model corresponding to structure data of the object, the model being obtained from the memory, and superimpose the model on the image in a state in which positions of the plurality of ridge lines correspond to positions of the plurality of edge lines respectively.

First claim

What is claimed is:

1 . A display control apparatus comprising:
a memory; and a processor coupled to the memory and the processor configured to: obtain an image including an object, the image being captured by a camera; extract a group of edge lines from the image; determine a plurality of edge lines in accordance with a position of a reference object from among the group of edge lines when the reference object is detected in the image; execute an association process between each of the plurality of edge lines and each of a plurality of ridge lines included in a model corresponding to structure data of the object, the model being obtained from the memory; and superimpose the model on the image in a state in which positions of the plurality of ridge lines correspond to positions of the plurality of edge lines respectively.

2 . The display control apparatus according to claim 1 , wherein the association process includes specifying, from among ridge lines included in the model, the plurality of ridge lines having a positional relationship corresponding to a positional relationship of the plurality of edge lines.

3 . The display control apparatus according to claim 1 , wherein the reference object is disposed on the object.

4 . The display control apparatus according to claim 1 , wherein the plurality of edge lines are positioned in vicinity of the reference object in the image.

5 . The display control apparatus according to claim 4 , wherein the plurality of edge lines surround the reference object in the image.

6 . The display control apparatus according to claim 4 , wherein a first edge line included in the plurality of edge lines is not in contact with all other edge lines included in the plurality of edge lines.

7 . The display control apparatus according to claim 1 ,
wherein the model includes another reference object corresponding to the reference object, and the association process includes specifying first coordinate axes of the object on the basis of the reference object included in the image, specifying second coordinate axes of the model on the basis of the other reference object included in the model, and associating each of the plurality of edge lines with each of the plurality of ridge lines respectively on the basis of the first coordinate axes and second coordinate axes.

8 . A display control method executed by a computer, the method comprising:
obtaining an image including an object, the image being captured by a camera; extracting a group of edge lines from the image; determining a plurality of edge lines in accordance with a position of a reference object from among the group of edge lines when the reference object is detected in the image; executing an association process between each of the plurality of edge lines and each of a plurality of ridge lines included in a model corresponding to structure data of the object, the model being obtained from the memory; and superimposing the model on the image in a state in which positions of the plurality of ridge lines correspond to positions of the plurality of edge lines respectively.

9 . The display control method according to claim 8 , wherein the association process includes specifying, from among ridge lines included in the model, the plurality of ridge lines having a positional relationship corresponding to a positional relationship of the plurality of edge lines.

10 . The display control method according to claim 8 , wherein the reference object is disposed on the object.

11 . The display control method according to claim 8 , wherein the plurality of edge lines are positioned in vicinity of the reference object in the image.

12 . The display control method according to claim 11 , wherein the plurality of edge lines surround the reference object in the image.

13 . The display control method according to claim 11 , wherein a first edge line included in the plurality of edge lines is not in contact with all other edge lines included in the plurality of edge lines.

14 . The display control method according to claim 8 ,
wherein the model includes another reference object corresponding to the reference object, and the association process includes specifying first coordinate axes of the object on the basis of the reference object included in the image, specifying second coordinate axes of the model on the basis of the other reference object included in the model, and associating each of the plurality of edge lines with each of the plurality of ridge lines respectively on the basis of the first coordinate axes and second coordinate axes.

15 . A non-transitory computer-readable medium storing a display control program that causes a computer to execute a process comprising:
obtaining an image including an object, the image being captured by a camera; extracting a group of edge lines from the image; determining a plurality of edge lines in accordance with a position of a reference object from among the group of edge lines when the reference object is detected in the image; executing an association process between each of the plurality of edge lines and each of a plurality of ridge lines included in a model corresponding to structure data of the object, the model being obtained from the memory; and superimposing the model on the image in a state in which positions of the plurality of ridge lines correspond to positions of the plurality of edge lines respectively.

Assignees

• Fujitsu Ltd

Inventors

• Koga Susumu
• Kuwabara Hiroshi
• Yamaguchi Nobuyasu
• Yoshitake Toshiyuki
• Murase Taichi
• Aoyagi Tomohiro

Classifications

• G06T7/13

  Edge detection · CPC title

• G06T3/0068

  Physics · mapped topic

• G06T7/75 Primary

  involving models · CPC title

• G06T19/20

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06T2219/2004

  Aligning objects, relative positioning of parts · CPC title