Image-based disease diagnostics using a mobile device

Patent metadata

Field	Value
Publication number	US-11954851-B2
Application number	US-202117364773-A
Country	US
Kind code	B2
Filing date	Jun 30, 2021
Priority date	Apr 6, 2017
Publication date	Apr 9, 2024
Grant date	Apr 9, 2024

Abstract

A diagnostic system performs disease diagnostic tests using at least an optical property modifying device and a mobile device. A user provides a biological sample from a patient to the optical property modifying device that reacts with a reagent in one or more reaction chambers of the device. The user captures one or more images of the one or more reaction chambers using an optical sensor of the mobile device. The diagnostic system can determine a quality level of the images based on factors such as skew, scale, focusing, shadowing, or white-balancing. Based on an analysis of the captured image, the diagnostic system can determine a test result of a disease diagnostic test for the patient. The diagnostic system may communicate the test result, as well as instructions for the disease diagnostic test, to the user via the mobile device.

First claim

What is claimed is:

1. A system comprising:
an optical property modifying device for image-based diagnostic tests, comprising: (i) a reaction chamber, configured to react a biological sample with an optical property modifying reagent, wherein a reaction modifies an optical property of the optical property modifying reagent, and (ii) an electronic display;
a diagnostic server; and
a mobile device comprising a non-transitory computer readable storage medium having instructions encoded thereon that, when executed by a processor of the mobile device, cause the processor to:
receive at least one image of the optical property modifying device captured by an optical sensor of the mobile device; and
provide a test result for the nucleic acid disease diagnostic test for display on an electronic display of the mobile device;

wherein the processor of the mobile device or the diagnostic server is configured to:
determine that the image of the set of one or more images shows a known geometric characteristic or a known color characteristic associated with the optical property modifying device; and
determine the test result for the diagnostic test based at least in part on the image.

2. The system of claim 1 , wherein the processor comprises a user interface comprising one or more alignment markers configured to overlay a field of view to assist a user of the mobile device in aligning the mobile device for capturing the image.

3. The system of claim 2 , wherein the one or more alignment markers are a semi-transparent graphic of the optical property modifying device; (ii) one or more markers that correspond to a graphic of an element of the optical property modifying device; or
(iii) a line that should be aligned with an edge of the optical property modifying device.

4. The system of claim 1 , wherein the processor of the mobile device or the diagnostic server is configured to determine the test result for the nucleic acid disease diagnostic test by classifying each pixel comprising a reaction chamber within the selected one or more images as falling within one of three color ranges such that: (1) if a plurality of pixels falls within the first color range, a negative diagnosis is determined; (2) if a plurality of pixels falls within the second color range, a positive diagnosis is determined; and (3) if a plurality of pixels falls within the third color range, an undetermined diagnosis is determined.

5. The system of claim 1 , wherein the non-transitory computer readable storage medium has further instructions that when executed by the processor cause the processor to:
receive a geographical location of the mobile device from a GPS processor of the mobile device; and
store the geographical location and a timestamp of the geographical location with the test result.

6. The system of claim 5 , wherein determining the test result is further based on at least one of the geographical location and the timestamp.

7. The system of claim 1 , wherein the non-transitory computer readable storage medium has further instructions that when executed by the processor cause the processor to utilize white balancing based on the known color of the optical property modifying device to determine lighting conditions of the image and adjust color of the image.

Assignees

• Pfizer

Inventors

• Dimov Ivan Krastev
• Myers Iii Frank B
• Waldeisen John Robert
• Mitra Debkishore

Classifications

• G06T7/0012 Primary

  Biomedical image inspection · CPC title

• A61B5/0059

  using light, e.g. diagnosis by transillumination, diascopy, fluorescence (photoacoustic A61B5/0093; optical measurement of heart rate A61B5/02416; optical measurement of blood flow A61B5/0261; optical measurement of analytes A61B5/1455) · CPC title

• A61B5/1032

  Determining colour of tissue for diagnostic purposes · CPC title

• A61B5/6898 Primary

  Portable consumer electronic devices, e.g. music players, telephones, tablet computers · CPC title

• A61B5/7282

  Event detection, e.g. detecting unique waveforms indicative of a medical condition (cough events A61B5/0823; seizures A61B5/4094; sleep apnoea A61B5/4818) · CPC title