Bone fragment tracking

Patent metadata

Field	Value
Publication number	US-9715739-B2
Application number	US-201414503715-A
Country	US
Kind code	B2
Filing date	Oct 1, 2014
Priority date	Nov 7, 2013
Publication date	Jul 25, 2017
Grant date	Jul 25, 2017

Abstract

A method of determining bone fragment navigation may include receiving pre-operative 2D image data of a reference bone structure and a bone fragment. The reference bone structure may include a first set of fiducial markers provided thereon, and the bone fragment may include a second set of fiducial markers provided thereon. The method may further include performing a 2D-3D registration between the pre-operative 2D image data and a 3D model of the reference bone structure and the bone fragment, after manual repositioning of the bone fragment, receiving second 2D image data, performing 2D-2D registration of the first set of fiducial markers and the second set of fiducial markers between the pre-operative 2D image data and the second 2D image data, and determining 3D movement of the bone fragment based at least in part on the 2D-2D registration.

First claim

What is claimed is:

1. A method comprising:
receiving pre-operative two dimensional (2D) image data of a reference bone structure and a bone fragment, the reference bone structure including a first set of fiducial markers provided on the reference bone structure, and the bone fragment including a second set of fiducial markers provided on the bone fragment;
receiving 3D image data pre-operatively from a 3D imaging sensor;
generating a 3D model of the reference bone structure and the bone fragment based on the 3D image data;
performing a 2D-3D registration between the pre-operative 2D image data and the 3D model of the reference bone structure and the bone fragment;
after manual repositioning of the bone fragment, receiving second 2D image data;
performing 2D-2D registration of the first set of fiducial markers and the second set of fiducial markers between the pre-operative 2D image data and the second 2D image data, wherein the performing 2D-2D registration comprises identifying the first set of fiducial markers and the second set of fiducial markers in each of the pre-operative 2D image data and the second 2D image data to determine fiducial marker locations of each of the first set of fiducial markers and the second set of fiducial markers; and
determining 3D movement of the bone fragment based at least in part on the 2D-2D registration.

2. The method of claim 1 , wherein the pre-operative 2D image data and the second 2D image data comprises x-ray image data, and wherein the 3D image data comprises computed tomography (CT) scan data.

3. The method of claim 1 , wherein the second 2D image data is obtained intraoperatively or post-operatively.

4. The method of claim 1 , wherein the first set of fiducial markers each have at least one physical characteristic that is different than a corresponding physical characteristic of the second set of fiducial markers to facilitate identifying the first set of fiducial markers and the second set of fiducial markers, respectively.

5. The method of claim 1 , further comprising comparing determined 3D movement of the bone fragment to a biomechanical plan for positioning of the bone fragment.

6. The method of claim 1 , wherein the performing 2D-2D registration of the first set of fiducial markers and the second set of fiducial markers further comprises:
conducting dewarping of x-ray image distortion;
globally segmenting fiducial markers;
classifying fiducial markers to identify the first set of fiducial markers and the second set of fiducial markers, respectively; and
performing pose estimation based on fiducial marker locations.

7. The method of claim 1 , further comprising displaying an output indicative of the 3D movement of the bone fragment during an operation for repositioning of the bone fragment to facilitate further repositioning of the bone fragment.

8. The method of claim 1 , wherein a fluoroscopic tracker fiducial marker is further employed with respect to performing 2D-2D registration.

9. A bone fragment navigation system comprising:
a 2D imaging sensor configured to generate pre-operative two dimensional (2D) image data of a reference bone structure and a bone fragment, the reference bone structure including a first set of fiducial markers provided on the reference bone structure, and the bone fragment including a second set of fiducial markers provided on the bone fragment, the 2D imaging sensor being further configured to provide second 2D image data after manual repositioning of the bone fragment; and
an image analyzer in communication with the 2D imaging sensor during an operation, the image analyzer being configured to:
receive the pre-operative 2D image data;
receive 3D image data pre-operatively from a 3D imaging sensor;
generate a 3D model of the reference bone structure and the bone fragment based on the 3D image data;
perform a 2D-3D registration between the pre-operative 2D image data and the 3D model of the reference bone structure and the bone fragment;
after the manual repositioning of the bone fragment, receive the second 2D image data;
perform 2D-2D registration of the first set of fiducial markers and the second set of fiducial markers between the pre-operative 2D image data and the second 2D image data, wherein performing 2D-2D registration comprises identifying the first set of fiducial markers and the second set of fiducial markers in each of the pre-operative 2D image data and the second 2D image data to determine fiducial marker locations of each of the first set of fiducial markers and the second set of fiducial markers; and
determine 3D movement of the bone fragment based at least in part on the 2D-2D registration.

10. The bone fragment navigation system of claim 9 , wherein the 2D imaging sensor comprises an x-ray machine, and wherein the 3D image data comprises computed tomography (CT) scan data.

11. The bone fragment navigation system of claim 9 , wherein the second 2D image data is obtained intraoperatively or post-operatively.

12. The bone fragment navigation system of claim 9 , wherein the first set of fiducial markers each have at least one physical characteristic that is different than a corresponding physical characteristic of the second set of fiducial markers to facilitate identifying the first set of fiducial markers and the second set of fiducial markers, respectively.

13. The bone fragment navigation system of claim 9 , wherein the image analyzer is further configured to compare determined 3D movement of the bone fragment to a biomechanical plan for positioning of the bone fragment.

14. The bone fragment navigation system of claim 9 , wherein performing 2D-2D registration of the first set of fiducial markers and the second set of fiducial markers further comprises:
conducting dewarping of x-ray image distortion;
globally segmenting fiducial markers;
classifying fiducial markers to identify the first set of fiducial markers and the second set of fiducial markers, respectively; and
performing pose estimation based on fiducial marker locations.

15. The bone fragment navigation system of claim 9 , further comprising a user interface configured for displaying an output indicative of the 3D movement of the bone fragment during an operation for repositioning of the bone fragment to facilitate further repositioning of the bone fragment.

16. The bone fragment navigation system of claim 9 , wherein a fluoroscopic tracker fiducial marker is further employed with respect to performing 2D-2D registration.

Assignees

• Univ Johns Hopkins

Inventors

• Murphy Ryan J
• Armand Mehran
• Armiger Robert S
• Otake Yoshito
• Lepisto Jyri

Classifications

• G06T2207/30204

  Marker · CPC title

• G06T2207/30008

  Bone · CPC title

• G06T2207/20076

  Probabilistic image processing · CPC title

• G06T2207/10116

  X-ray image · CPC title

• G06T2207/10088

  Magnetic resonance imaging [MRI] · CPC title