Systems and methods for intra-operative image acquisition and calibration

Patent metadata

Field	Value
Publication number	US-10610305-B2
Application number	US-201816227451-A
Country	US
Kind code	B2
Filing date	Dec 20, 2018
Priority date	May 22, 2016
Publication date	Apr 7, 2020
Grant date	Apr 7, 2020

Abstract

A system and method utilizing a camera device containing an inertial measuring unit or similar orientation mechanism to calibrate alignment of the camera device according to a primary image such as an image displayed on an imaging screen, and then utilizing this calibration data to guide the system or user in acquiring a spatially aligned digital image using the camera device. Steps include recording the spatial orientation of the camera in at least two spatial dimensions when aligned with the primary image and guiding the camera into relative alignment with the imaging screen when taking a picture.

First claim

What is claimed is:

1. A method for capturing a spatially aligned digital image of a primary image, comprising:
displaying the primary image on an image display medium;
selecting a digital camera;
aligning the digital camera with the image display medium;
determining and recording a spatial orientation of the digital camera relative to at least two axes when the digital camera is aligned with the image display medium;
moving the digital camera away from the image display medium until an acceptable field of view of the primary image is achieved;
confirming that the digital camera is acceptably aligned spatially with the image display medium by providing a perceptible guidance to a user via a user interface, wherein the perceptible guidance includes visually representing a real-time orientation of the digital camera relative to the at least two axes; and
obtaining the spatially aligned digital image, wherein the spatially aligned digital image comprises at least a portion of the primary image, the spatially aligned digital image being obtained after confirming that the digital camera is acceptably aligned spatially with the image display medium.

2. The method of claim 1 , wherein the image display medium is an electronic display screen, and aligning the digital camera with the image display medium includes placing the digital camera with the image display medium against the electronic display screen.

3. The method of claim 1 , wherein the spatial orientation of the digital camer is determined using an inertial measurement unit.

4. The method of claim 1 , wherein the digital camera is a portable computing device with the digital camera integrated therein.

5. A system capable of capturing a spatially aligned digital image of a primary image, the system comprising:
a digital camera;
an orientation mechanism capable of determining a spatial orientation of the digital camera relative to at least two axes;
a computing device in communication with the digital camera and the orientation mechanism, the computing device having a user interface wherein the computing device further comprises:
a device calibration module to guide a user to align the digital camera with the primary image;
a calibrated guidance module capable of interfacing with the orientation mechanism to determine and record the spatial orientation of the digital camera relative to the at least two axes, and communicating the spatial orientation to the computing device; and
an image acquisition module to guide the user to obtain a digital image of the primary image after confirming that the digital camera is acceptably aligned spatially with the primary image, wherein confirming that the digital camera is acceptably aligned spatially comprises generating and displaying to the user on the user interface, visual representations indicative of a real-time orientation of the digital camera relative to the at least two axes to achieve acceptable alignment.

6. The system of claim 5 , wherein the primary image is displayed on a primary display screen, and aligning the digital camera includes placing the digital camera against the primary display screen.

7. The system of claim 5 , wherein the spatial orientation of the digital camera is determined using an inertial measurement unit.

8. The system of claim 5 , wherein the computing device is a portable computing device with the digital camera and orientation mechanism integrated therewith.

9. A system capable of guiding a user to capture a spatially aligned digital image of a primary image, comprising:
a digital camera;
an orientation mechanism capable of determining the spatial orientation of the digital camera relative to at least two axes;
a computing device comprising a user interface and a processor in communication with the digital camera and the orientation mechanism, wherein the processor is configured to:
instruct the a user to align the digital camera with the primary image;
determine and record the spatial orientation of the digital camera relative to the at least two axes, and communicate the spatial orientation to the computing device; and
generate visual representations of a real-time orientation of the digital camera relative to the at least two axes
confirm to the user that the digital camera is acceptably aligned spatially with the primary image when the user is operating the digital camera.

10. The system of claim 9 , wherein the primary image is displayed on a primary display screen, and aligning the digital camera includes placing the digital camera against the primary display screen.

11. The system of claim 9 , wherein confirming to the user that the digital camera is acceptably aligned spatially includes providing perceptible guidance to the user via the user interface to achieve acceptable alignment.

12. The system of claim 9 , wherein spatial orientation is determined using an inertial measurement unit.

13. The system of claim 9 , wherein the computing device is a portable computing device and the digital camera and orientation mechanism are integrated with the computing device.

Assignees

• Depuy Synthes Products Inc

Inventors

• Wollowick Noah D
• Cooper Andrew J
• Albert Cameron

Classifications

• A61B6/487

  involving fluoroscopy · CPC title

• A61B6/505

  for diagnosis of bone · CPC title

• G06T7/70

  Determining position or orientation of objects or cameras (camera calibration G06T7/80) · CPC title

• A61B34/10 Primary

  Computer-aided planning, simulation or modelling of surgical operations · CPC title

• G09G5/363

  Graphics controllers · CPC title