Interactive voxel manipulation in volumetric medical imaging for virtual motion, deformable tissue, and virtual radiological dissection

Patent metadata

Field	Value
Publication number	US-10878639-B2
Application number	US-201816195251-A
Country	US
Kind code	B2
Filing date	Nov 19, 2018
Priority date	Feb 9, 2018
Publication date	Dec 29, 2020
Grant date	Dec 29, 2020

Abstract

A simulation is performed by assigning tissue type properties to voxels of a medical image and manipulating the voxels based on the assigned tissue type properties and an input that prompts voxel manipulation. Voxels may also be created and eliminated in response to the input. Tissue type properties may include elasticity, ductility, hardness, density, and thermal conductivity. Manipulation may include changing at least one of voxel size, location, orientation, shape, color, grayscale, and tissue type property value. The input may include insertion of a virtual volume-subtending surgical or anatomic object. Simulations may include virtual motion, deformation of tissue, and radiological dissection for pre-operative planning.

First claim

What is claimed is:

1. A method comprising:
performing imaging of a tangible volume containing discrete structures to generate a three-dimensional dataset;
performing segmentation of the three-dimensional dataset to generate segmented structures which correspond to the discrete structures;
assigning properties to voxels of the three-dimensional dataset based on the segmented structures wherein the properties to voxels of the three-dimensional dataset are determined by the discrete structures;
presenting, at a first time step, the three-dimensional dataset to a user;
performing a deformation of the three-dimensional dataset based on the assigned properties to voxels wherein the deformation changes at least one of the group consisting of a size of the a segmented structure, a shape of the a segmented structure, a location of a segmented structure, and an orientation of a segmented structure to generate a modified three-dimensional dataset; and
presenting, at a second time step, the modified three-dimensional dataset to the user.

2. The method of claim 1 wherein assigning properties to the voxels of the medical image comprises assigning a value for at least one of: elasticity, ductility, and hardness.

3. The method of claim 1 wherein performing the deformation comprises representing virtual motion.

4. The method of claim 1 wherein performing the deformation comprises representing deformation of tissue.

5. The method of claim 1 wherein performing the deformation comprises representing a radiological dissection.

6. The method of claim 1 wherein performing the deformation comprises creating new voxels in response to an input.

7. The method of claim 6 wherein the input comprises inserting a virtual volume-subtending surgical object.

8. The method of claim 6 wherein the input comprises inserting a virtual volume-subtending anatomic object.

9. The method of claim 6 wherein creating new voxels comprises creating new fixed-type voxels that do not change unless acted upon by a user through an interface.

10. The method of claim 6 wherein creating new voxels comprises creating new invisible-type voxels.

11. The method of claim 6 wherein creating new voxels comprises creating new tissue-type voxels.

12. The method of claim 8 wherein creating new voxels comprises creating new dynamic-type voxels having at least one tissue type property that changes over time.

13. The method of claim 8 wherein creating new voxels comprises creating new mobile voxels that travel through a virtual vascular structure.

14. The method of claim 1 wherein deformation comprises eliminating selected voxels in response to an input.

15. The method of claim 14 comprising eliminating tissue type voxels to simulate ablation.

16. The method of claim 14 comprising inserting strategic elimination points that designate a direction in which voxels are eliminated in discrete steps.

17. The method of claim 14 comprising inserting strategic non-elimination points that designate voxels that are preserved from elimination.

18. The method of claim 1 comprising assignment of a strategic deformation feature that designates a maximum shift for at least one voxel.

19. An apparatus comprising:
an IO device; and
an image processor in communication with the IO device, the image processors comprising a program stored on computer-readable non-transitory media, the program comprising:
instructions that utilize a three-dimensional dataset wherein the three-dimensional dataset was generated based on an imaging examination of a tangible volume containing discrete structures;
instructions that perform segmentation of the three-dimensional dataset to generate segmented structures which correspond to the discrete structures;
instructions that assign properties to voxels of the three-dimensional dataset based on the segmented structures wherein the properties to voxels of the three-dimensional dataset are determined by the discrete structures;
instructions that present, at a first time step, the three-dimensional dataset to a user;
instructions that perform a deformation of the three-dimensional dataset based on the assigned properties to voxels wherein the deformation changes at least one of the group consisting of a size of the a segmented structure, a shape of the a segmented structure, a location of a segmented structure, and an orientation of a segmented structure to generate a modified three-dimensional dataset; and
instructions that present, at a second time step, the modified three-dimensional dataset to the user.

20. The apparatus of claim 19 wherein the instructions that assign properties to voxels assign a value for at least one of: elasticity, ductility, and hardness.

21. The apparatus of claim 19 wherein performing the deformation comprises representing virtual motion.

22. The apparatus of claim 19 wherein performing the deformation comprises representing deformation of tissue.

23. The apparatus of claim 19 wherein performing the deformation comprises representing a radiological dissection.

24. The apparatus of claim 19 wherein performing the deformation comprises creation of new voxels in response to an input.

25. The apparatus of claim 24 wherein the input comprises insertion of a virtual volume-subtending surgical object.

26. The apparatus of claim 24 wherein the input comprises insertion of a virtual volume-subtending anatomic object.

27. The apparatus of claim 24 wherein creation of new voxels comprises creation of new fixed-type voxels that do not change unless acted upon by a user through an interface.

28. The apparatus of claim 24 wherein creation of new voxels comprises creation of new invisible-type voxels.

29. The apparatus of claim 24 wherein creation of new voxels comprises creation of new tissue-type voxels.

30. The apparatus of claim 24 wherein creation of new voxels comprises creation of new dynamic-type voxels having at least one tissue type property that changes over time.

31. The apparatus of claim 24 wherein creation of new voxels comprises creation of new mobile voxels that travel through a virtual vascular structure.

32. The apparatus of claim 19 wherein the deformation comprises elimination of selected voxels in response to an input.

33. The apparatus of claim 32 wherein elimination of selected voxels comprises elimination of tissue type voxels to simulate ablation.

34. The apparatus of claim 32 comprising instructions that insert strategic elimination points that designate a direction in which voxels are eliminated in discrete steps.

35. The apparatus of claim 32 comprising instructions that insert strategic non-elimination points that designate voxels that are preserved from elimination.

36. The apparatus of claim 19 comprising a strategic deformation feature that designates a maximum shift for at least one voxel.

37. A computer-readable storage device comprising:
instructions which, when executed by a computer, cause the computer to carry out the steps of:
utilizing a three-dimensional dataset wherein the three-dimensional dataset was generated based on an imaging examination of a tangible volume containing discrete structures;
performing segmentation of the three

Assignees

• Douglas David Byron
• Douglas Robert E
• Douglas Kathleen M
• Wintermark Max

Inventors

• Douglas David Byron
• Douglas Robert E
• Douglas Kathleen M
• Wintermark Max

Classifications

• G06T19/20 Primary

  Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts · CPC title

• A61B34/10

  Computer-aided planning, simulation or modelling of surgical operations · CPC title

• G06T15/08

  Volume rendering · CPC title

• G06T2219/008

  Cut plane or projection plane definition · CPC title

• G06T2219/2012

  Colour editing, changing, or manipulating; Use of colour codes · CPC title