Interactive mesh editing

Patent metadata

Field	Value
Publication number	US-10282917-B2
Application number	US-201615577355-A
Country	US
Kind code	B2
Filing date	Jun 29, 2016
Priority date	Jun 29, 2015
Publication date	May 7, 2019
Grant date	May 7, 2019

Abstract

A system and method are provided for interactive editing of a mesh which has been applied to a three-dimensional (3D) image to segment an anatomical structure shown therein. To facilitate the interactive editing of the applied mesh, a view of the 3D image is generated which shows a mesh part to be edited, with the view being established based on a local orientation of the mesh part. Advantageously, the view may be generated to be substantially orthogonally to the mesh part, or to a centerline of the anatomical structure which is determined as a function of the mesh part. Accordingly, an orthogonal view is established which facilitates the user in carrying out the editing action with respect to the mesh part. It is therefore not needed for the user to manually navigate through the 3D image to obtain a view which is suitable for mesh editing, which is typically time consuming.

First claim

The invention claimed is:

1. A system for interactive mesh editing, comprising:
an image data interface configured to access image data, the image data representing a three-dimensional image showing an anatomical structure;
a processor configured for:
obtaining mesh data, the mesh data defining a mesh which having been previously mapped to the three-dimensional image for segmenting the anatomical structure,
generating a view of the three-dimensional image and said mapped mesh, wherein said generating is based on one or more viewing parameters defining the view, and
generating view data representing the view for display on a display;
a user input interface for receiving user input data indicative of an editing action to be mapped to at least a part of the mesh shown in the view;
wherein the processor is configured for establishing the one or more viewing parameters based on a local orientation of the part of the mesh upon receiving the user input data indicative of the editing action,
wherein the part of the mesh comprises a set of mesh surface elements, and wherein the processor is configured for determining the local orientation of the part of the mesh by applying a statistical function to the normal vectors of the mesh surface elements from the set of mesh surface elements,
wherein the set of mesh surface elements is located within a radius of a reference mesh surface element,
wherein the processor is configured for determining a difference between a) a result of the statistical function applied to the normal vectors of the mesh surface elements, and b) the normal vector of the reference mesh surface element, for omitting using the result of the statistical function as said determined local orientation if the difference exceeds a first predetermined threshold.

2. The system according to claim 1 , wherein the processor is configured for establishing the one or more viewing parameters to define the view to intersect the three-dimensional image substantially orthogonally to the part of the mesh, thereby establishing an orthogonal view.

3. The system according to claim 2 , wherein the processor is configured for, from an initial view showing the part of the mesh, switching to the orthogonal view upon receiving the user input data indicative of the editing action.

4. The system according to claim 3 , wherein the processor is configured for effecting said switching if the initial view intersects the three-dimensional image parallel to the part of the mesh, or at an intersection angle below a predetermined angle.

5. The system according to claim 1 , wherein the statistical function is an average or a median.

6. The system according to claim 1 , wherein the processor is configured for, if the difference exceeds the first predetermined threshold:
determining a subset of the set of mesh surface elements, the subset comprising mesh surface elements of which the normal vector deviates less than a second predetermined threshold from the result of the statistical function; and
determining the local orientation of the part of the mesh by applying the statistical function to the normal vectors of the mesh surface elements from said subset.

7. The system according to claim 1 , wherein the processor is configured for establishing the one or more viewing parameters to define the view to intersect the three-dimensional image substantially orthogonally to a centerline of the anatomical structure which is determined as a function of the location of the part of the mesh.

8. Workstation comprising the system according to claim 1 .

9. Imaging apparatus comprising the system according to claim 1 .

10. Method for interactive mesh editing, comprising:
accessing image data, the image data representing a three-dimensional image showing an anatomical structure;
obtaining mesh data, the mesh data defining a mesh which having been previously mapped to the three-dimensional image for segmenting the anatomical structure;
receiving user input data indicative of an editing action to be applied to at least a part of the mesh shown in the view;
generating a view of the three-dimensional image and the mapped mesh, wherein said generating is based on one or more viewing parameters defining the view;
generating view data representing the view for display on a display; and
wherein the generating the view comprises establishing the one or more viewing parameters based on a local orientation of the part of the mesh upon receiving the user input data indicative of the editing action,
wherein the part of the mesh comprises a set of mesh surface elements, and wherein the processor is configured for determining the local orientation of the part of the mesh by applying a statistical function to the normal vectors of the mesh surface elements from the set of mesh surface elements,
wherein the set of mesh surface elements is located within a radius of a reference mesh surface element,
wherein the processor is configured for determining a difference between a) a result of the statistical function applied to the normal vectors of the mesh surface elements, and b) the normal vector of the reference mesh surface element, for omitting using the result of the statistical function as said determined local orientation if the difference exceeds a first predetermined threshold.

11. A non-transitory computer readable storage medium comprising a computer program product comprising instructions for causing a processor system to perform the method according to claim 10 .

Assignees

• Koninklijke Philips Nv

Inventors

• Stehle Thomas Heiko
• Wenzel Fabian
• Meyer Carsten
• Zagorchev Lyubomir Georgiev
• Bergtholdt Martin
• Peters Jochen

Classifications

• G06T15/20

  Perspective computation · CPC title

• G06T15/08

  Volume rendering · CPC title

• A61B6/466

  adapted to display 3D data · CPC title

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• G06T2219/008

  Cut plane or projection plane definition · CPC title