Image processing apparatus, image processing method, and program

Patent metadata

Field	Value
Publication number	US-10281804-B2
Application number	US-201715621554-A
Country	US
Kind code	B2
Filing date	Jun 13, 2017
Priority date	Jun 15, 2016
Publication date	May 7, 2019
Grant date	May 7, 2019

Abstract

An image processing apparatus includes a three-dimensional space information storage unit, a projection unit, an operation acquisition unit, a reference guide rail decision unit, and a motion vector calculation unit. The projection unit projects and draws a cross-sectional plane onto a projection plane on the basis of information on a position of the cross-sectional plane stored by the three-dimensional space information storage unit. The reference guide rail decision unit decides a reference guide rail on the basis of information on a position of a slide operation acquired by the operation acquisition unit. The motion vector calculation unit calculates a two-dimensional motion vector parallel to the reference guide rail on the basis of a direction of the slide operation and an amount of movement, calculates a three-dimensional motion vector corresponding to the two-dimensional motion vector, and changes the position of the cross-sectional plane in accordance with the calculated three-dimensional motion vector.

First claim

What is claimed is:

1. An image processing apparatus comprising:
a three-dimensional space information storage unit configured to store a position of a cross-sectional plane in a three-dimensional space;
a guide rail information generation unit configured to generate guide rail information, which is information on one or more guide rails, which are straight lines, and to write the information in the three-dimensional space information storage unit on the basis of preset setting information and the information on the position of the cross-sectional plane;
a projection unit configured to project and draw the cross-sectional plane in the three-dimensional space onto a projection plane on the basis of information on the position of the cross-sectional plane stored in the three-dimensional space information storage unit, and to project a guide rail onto the projection plane on the basis of the guide rail information generated by the guide rail information generation unit;
an operation acquisition unit configured to detect a slide operation to cause a point on a screen on which the projection plane is drawn to slide, and to acquire information on a position on the screen at which the slide operation is performed;
a reference guide rail decision unit configured to refer to the three-dimensional space information storage unit and select and decide a reference guide rail among guide rails generated by the guide rail information generation unit on the basis of the information on the position of the slide operation acquired by the operation acquisition unit, wherein the decided reference guide rail exists near the position of the slide operation when a guide rail intersecting the cross-sectional plane in the three-dimensional space at a predetermined angle is projected onto the projection plane; and
a motion vector calculation unit configured to calculate a two-dimensional motion vector, which represents a movement on the screen and is parallel to the reference guide rail, on the basis of a direction of the slide operation and an amount of movement when the slide operation is performed, to calculate a three-dimensional motion vector representing a direction of movement and an amount of movement in the three-dimensional space corresponding to a two-dimensional motion vector existing on the projection plane, and to change the position of the cross-sectional plane in the three-dimensional space stored by the three-dimensional space information storage unit in accordance with the calculated three-dimensional motion vector.

2. The image processing apparatus according to claim 1 ,
wherein the reference guide rail decision unit obtains a guide rail passing through a point in the three-dimensional space corresponding to a position of a start point of the slide operation on the projection plane and intersecting the cross-sectional plane in the three-dimensional space at the predetermined angle at a time when the slide operation starts, and decides the guide rail as the reference guide rail.

3. The image processing apparatus according to claim 1 ,
wherein the projection unit projects and draws a guide rail existing in the three-dimensional space onto the projection plane.

4. The image processing apparatus according to claim 1 ,
wherein the motion vector calculation unit calculates the two-dimensional motion vector on the basis of a (0°≤α≤90°), which is a minimum angle at which the projection plane in the three-dimensional space and the reference guide rail intersect, so that a ratio of the two-dimensional motion vector to an amount of movement of the slide operation monotonically decreases with respect to a.

5. The image processing apparatus according to claim 1 ,
wherein the motion vector calculation unit does not perform a process of moving the cross-sectional plane when an angle formed by a direction of the slide operation and the reference guide rail is larger than a predetermined threshold value.

6. An image processing method comprising:
storing, in a three-dimensional space information storage unit, a position of a cross-sectional plane in a three-dimensional space;
generating guide rail information, which is information on one or more guide rails, which are straight lines, on the basis of preset setting information and the information on the position of the cross-sectional plane;
projecting and drawing the cross-sectional plane in the three-dimensional space onto a projection plane on the basis of information on the position of the cross-sectional plane stored in the three-dimensional space information storage unit;
projecting the one or more guide rails onto the projection plane on the basis of the generated guide rail information;
detecting a slide operation to cause a point to slide on a screen on which the projection plane is drawn, and acquiring information on a position on the screen at which the slide operation is performed;
deciding a reference guide rail among the generated guide rails existing near a position of the slide operation when a guide rail intersecting the cross-sectional plane in the three-dimensional space at a predetermined angle is projected onto the projection plane on the basis of the information on the position of the slide operation acquired, wherein the decided reference guide line exists near a position of the slide operation when a guide rail intersecting the cross-sectional plane in the three-dimensional space at a predetermined angle is projected onto the projection plane;
calculating a two-dimensional motion vector, which represents a movement on the screen and is parallel to the reference guide rail, on the basis of a direction of the slide operation and an amount of movement when the slide operation is performed;
calculating a three-dimensional motion vector representing a direction of movement and an amount of movement in the three-dimensional space corresponding to a two-dimensional motion vector existing on the projection plane; and
changing the position of the cross-sectional plane in the three-dimensional space stored by the three-dimensional space information storage unit in accordance with the calculated three-dimensional motion vector.

7. A non-transitory computer readable storage medium that stores a computer program, which causes, when executed by a computer, the computer to perform an image processing method comprising:
storing, in a three-dimensional space information storage unit, a position of a cross-sectional plane in a three-dimensional space;
generating guide rail information, which is information on one or more guide rails, which are straight lines, on the basis of preset setting information and the information on the position of the cross-sectional plane;
projecting and drawing the cross-sectional plane in the three-dimensional space onto a projection plane on the basis of information on the position of the cross-sectional plane stored in the three-dimensional space information storage unit;
projecting the one or more guide rails onto the projection plane on the basis of the generated guide rail information;
detecting a slide operation to cause a point to slide on a screen on which the projection plane is drawn, and acquiring information on a position on the screen at which the slide operation is performed;
deciding a reference guide rail among the generated guide rails existing near a position of the slide operation when a guide rail intersecting the cross-sectional plane in the three-dimensional space at a predetermined angle is projected onto the projection plane on the basis of the information on the position of the slide operation acquired, wherein the decided reference guide line is exists near a position of the slide operation when a guide rail intersecting the cross-sectional plane in the three-dimensional spa

Assignees

• Toshiba Kk

Inventors

• Yamahara Hiroyuki
• Sharma Ankit
• Girier Armand Simon Alymamy
• Yang Yeonsoo

Classifications

• G06T2200/04

  involving 3D image data · CPC title

• H04N9/3185 Primary

  Geometric adjustment, e.g. keystone or convergence (optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14) · CPC title

• G03B21/001 Primary

  Slide projectors · CPC title

• G06T19/003

  Navigation within 3D models or images · CPC title

• G03B21/145

  Housing details, e.g. position adjustments thereof · CPC title