Workflow of needle tip identification for biopsy documentation

Patent metadata

Field	Value
Publication number	US-11723632-B2
Application number	US-201615747161-A
Country	US
Kind code	B2
Filing date	Jul 18, 2016
Priority date	Jul 28, 2015
Publication date	Aug 15, 2023
Grant date	Aug 15, 2023

Abstract

An interventional instrument ( 16 ) is inserted into a patient ( 14 ) to perform an interventional medical procedure guided by a medical imaging device ( 10 ). A trigger control ( 26 ) is activated. An electronic data processing device ( 30 ) is programmed to operate the medical imaging device to: acquire and display video ( 50 ) of the interventional instrument ( 16 ) inserted into the patient; detect activation of the trigger control; in response to the detecting, process a video segment ( 54 ) of the acquired video to identify a trigger image ( 60 ) as a frame of the video segment capturing a medical intervention event performed by the interventional instrument and a location ( 62 ) of the medical intervention event in the identified trigger image; and display a still image of the identified trigger image with a superimposed marker ( 102 ) indicating the identified location of the medical intervention event.

First claim

The invention claimed is:

1. A device operable in conjunction with an interventional instrument inserted into a patient to perform an interventional medical procedure, the device comprising:
an ultrasound imaging device including a display component;
a trigger control that is activatable by a user to control triggering of guidance and location documentation operations for the interventional medical procedure, the trigger control comprising a button or a touch-sensitive key; and
a processor to operate the ultrasound imaging device to provide image guidance and location documentation for the interventional medical procedure by the guidance and location documentation operations including:
causing the ultrasound imaging device to acquire and display video of the interventional instrument inserted into the patient;
detecting activation of the trigger control;
in response to the detecting, processing a video segment of the acquired video to identify a trigger image as a frame of the video segment, the trigger image capturing a medical intervention event performed by the interventional instrument and a location of the medical intervention event, the processing comprising matching a linear interventional instrument pattern to a linear feature in each of plural frames of the video segment that each show the medical intervention event performed by the interventional instrument and the location and selecting one of the plural frames as the trigger image, the trigger image selected based on a pattern matching score; and
causing the ultrasound imaging device to display a still image of the trigger image with a superimposed marker indicating the identified location of the medical intervention event.

2. The device of claim 1 , wherein
the interventional instrument comprises a biopsy instrument and the medical intervention event comprises firing of a biopsy needle by the biopsy instrument to acquire a biopsy sample.

3. The device of claim 1 , wherein the guidance and location documentation operations further include:
receiving, via one or more user input devices of the ultrasound imaging device, an indication that the identified location of the medical intervention event is acceptable whereby the identified location of the medical intervention event is designated as the documented location of the medical intervention event in a reference frame of a medical imaging device.

4. The device of claim 3 , wherein the guidance and location documentation operations further include:
transforming the documented location of the medical intervention event in the reference frame of the medical imaging device to a documentation reference frame; and
recording the documented location of the medical intervention event in the documentation reference frame.

5. The device of claim 1 , wherein the still image display of the trigger image with the superimposed marker replaces the display of the video on the display component of the medical imaging device.

6. The device of claim 1 , wherein the guidance and location documentation operations further include:
selecting the video segment as a video segment consisting of a time interval or number of frames (Δt) starting at the detection of activation of the trigger control.

7. The device of claim 1 , wherein the guidance and location documentation operations further include:
receiving, via one or more user input devices of the ultrasound imaging device, an indication that the identified location of the medical intervention event is not acceptable, wherein the guidance and location documentation operations further include providing a user interface including a video segment browser, the user interface including a manual select, thereby enabling selection of the documented location of the medical intervention event in the reference frame of the medical imaging device.

8. The device of claim 7 , wherein the guidance and location documentation operations further include:
transforming the documented location of the medical intervention event in the reference frame of the medical imaging device to a documentation reference frame; and
recording the documented location of the medical intervention event in the documentation reference frame.

9. The device of claim 1 , wherein the processor includes an electronic data processing device.

10. The device of claim 1 , wherein the interventional instrument comprises a therapy delivery instrument and the medical intervention event comprises delivering therapy by a therapy delivery instrument.

11. A biopsy guidance and location documentation device comprising:
a trigger control comprising a button or a touch-sensitive key; and
an ultrasound imaging device including a display component and an electronic processor, the ultrasound imaging device configured to:
acquire and display video of human anatomy during a biopsy operation;
detect a biopsy trigger signal generated in response to a user pressing the trigger control;
process a video segment acquired in response to detection of the biopsy trigger signal to identify a trigger image as a frame of the video segment selected amongst plural frames of the video segment, the trigger image showing a fired biopsy needle tip and a location of the fired biopsy needle tip in the trigger image; and
display the trigger image as a still image with a superimposed marker indicating the location of the fired biopsy needle tip.

12. The biopsy guidance and location documentation device of claim 11 , wherein the ultrasound imaging device is further configured to:
receive user input via a user input component of the ultrasound imaging device that identifies a documented location of the fired biopsy needle tip as one of (i) the automatically identified location of the fired biopsy needle tip and (ii) a manually identified location of the fired biopsy needle tip in a manually identified trigger image comprising a frame of the video;
transform the documented location of the fired biopsy needle tip to a documentation reference frame; and
record the documented location of the medical intervention event in the documentation reference frame in a biopsy location documentation storage.

13. The biopsy guidance and location documentation device of claim 12 , wherein the documentation reference frame comprises a reference three-dimensional magnetic resonance image fused with the trigger image.

14. The biopsy guidance and location documentation device of claim 11 , wherein the ultrasound imaging device is configured to process the acquired video to automatically identify the trigger image by:
attempting to identify the fired biopsy needle tip in each frame of the video segment;
scoring at least each frame in which the fired biopsy needle tip is successfully identified using a reliability metric for the fired biopsy needle tip identification; and
identifying the trigger image as the highest-scoring frame.

15. The biopsy guidance and location documentation device of claim 14 , wherein attempting to identify the fired biopsy needle tip in each frame of the video segment comprises attempting to match a linear needle tip image pattern at a known biopsy needle tip angle or direction in each frame of the video segment.

16. The biopsy guidance and location documentation device of claim 11 , wherein the ultrasound imaging device is further configured to:
terminate the acquiring and displaying of video at a time interval or number of frames (Δt) after detecting activation of the biopsy trigger control; and
select a video segment of the video for processing including the video frames acquired during the time interval

Assignees

• Koninklijke Philips Nv

Inventors

• Yan Pingkun
• Kruecker Jochen
• Thompson Scott Frederic
• Lin Wei
• Coons Samuel

Classifications

• A61B10/0233 Primary

  Pointed or sharp biopsy instruments · CPC title

• A61B34/20

  Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis · CPC title

• A61B90/37

  Surgical systems with images on a monitor during operation · CPC title

• A61B2034/2065

  Tracking using image or pattern recognition · CPC title

• A61B2090/3782

  transmitter or receiver in catheter or minimal invasive instrument · CPC title