Use of plenoptic otoscope data for aiding medical diagnosis

Patent metadata

Field	Value
Publication number	US-10327627-B2
Application number	US-201414318578-A
Country	US
Kind code	B2
Filing date	Jun 28, 2014
Priority date	Jan 18, 2013
Publication date	Jun 25, 2019
Grant date	Jun 25, 2019

Abstract

A plenoptic otoscope captures images used in making a medical diagnosis. For example, the plenoptic data can be processed to produce enhanced imagery of the ear interior, and this enhanced imagery can be used in making a medical diagnosis.

First claim

What is claimed is:

1. A method for making a medical diagnosis of an ear interior, comprising:
acquiring plenoptic data of a tympanic membrane, the plenoptic data comprising multiviews of the tympanic membrane captured from different viewing angles, the multiviews captured simultaneously by a plenoptic otoscope imaging the tympanic membrane; and
combining, by a computer system, the multiviews of the plenoptic data to produce enhanced imagery of the tympanic membrane, the enhanced imagery including at least one of a depth map of the tympanic membrane and a set of different spectral images of the tympanic membrane derived from the plenoptic data; and
displaying diagnostic data based on the enhanced imagery, the diagnostic data used in medical diagnosis of the ear interior.

2. The method of claim 1 further comprising:
processing, by the computer system, the diagnostic data to make the medical diagnosis.

3. The method of claim 1 wherein the diagnostic data includes the enhanced imagery.

4. The method of claim 1 wherein the enhanced imagery includes a depth map of the tympanic membrane.

5. The method of claim 4 wherein the depth map has sub-millimeter resolution.

6. The method of claim 4 wherein processing the plenoptic data to produce the depth map of the ear interior comprises:
processing the plenoptic data by transforming to a scale and depth space.

7. The method of claim 4 further comprising:
displaying, by the computer system, a visualization of the depth map of the tympanic membrane, the visualization used by a human in medical diagnosis of the ear interior.

8. The method of claim 1 wherein the diagnostic data includes three-dimensional information about the tympanic membrane, the three-dimensional information derived from the enhanced imagery.

9. The method of claim 8 wherein the three-dimensional information includes whether the tympanic member is bulging or retracting.

10. The method of claim 1 wherein the enhanced imagery includes different spectral images of the tympanic membrane.

11. The method of claim 10 wherein the spectral images include an amber or yellow image.

12. The method of claim 1 wherein the enhanced imagery includes images showing translucency of the tympanic membrane.

13. The method of claim 1 wherein the enhanced imagery is produced for a selected reference plane.

14. The method of claim 13 wherein the reference plane is selected based on features in the tympanic membrane.

15. The method of claim 1 wherein combining the multiviews of the plenoptic data reduces occlusions.

16. The method of claim 1 wherein the medical diagnosis is otitis media.

Assignees

• Berkner Kathrin
• Meng Lingfei
• Tosic Ivana
• Balram Nikhil
• Ricoh Co Ltd

Inventors

• Berkner Kathrin
• Meng Lingfei
• Tosic Ivana
• Balram Nikhil

Classifications

• A61B1/042

  characterised by a proximal camera, e.g. a CCD camera · CPC title

• A61B5/0075

  by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy (A61B5/0071 takes precedence) · CPC title

• A61B1/227 Primary

  for ears, i.e. otoscopes · CPC title

• A61B1/00186

  with imaging filters · CPC title

• A61B1/00009

  of image signals during a use of endoscope · CPC title