Architecture and method for maximally stable extremal regions (MSERs)-based exudates detection in fundus images for diabetic retinopathy

Patent metadata

Field	Value
Publication number	US-10456027-B2
Application number	US-201715497302-A
Country	US
Kind code	B2
Filing date	Apr 26, 2017
Priority date	Apr 26, 2017
Publication date	Oct 29, 2019
Grant date	Oct 29, 2019

Abstract

Architecture and a method for maximally stable extremal regions (MSERs)-based detection of exudates in an ocular fundus is disclosed. The architecture includes a communication interface to receive pixels of an ocular fundus image. The architecture further includes processing circuitry that is coupled to the communication interface. The processing circuitry is configured to automatically provide labels for light image regions and dark image regions within the ocular fundus image for a given intensity threshold and find MSERs within the ocular fundus image based on the labels. The architecture also determines MSER regions based on the MSER criteria and then highlights the pixels of the ocular fundus image that are located within MSER regions to indicate the exudates in the ocular fundus. The architecture is further configured to determine MSER ellipses parameters based on MSER regions and MSER criteria and then highlight the locations of the exudates in the ocular fundus.

First claim

What is claimed is:

1. Architecture for maximally stable extremal regions (MSERs)-based detection of exudates in an ocular fundus comprising:
a communication interface configured to receive pixels of an ocular fundus image; and
processing circuitry having a memory coupled to the communication interface, wherein the processing circuitry is configured to automatically:
store the pixels of the ocular fundus image within the memory;
provide labels within the memory for light image regions and dark image regions within the ocular fundus image for a given intensity threshold;
find MSERs within the stored pixels of the ocular fundus image based upon the labels;
generate an MSER pixel list based on the MSERs and MSER criteria that include a minimum MSER size in pixels and a maximum MSER size in pixels based upon an eye diameter size in the stored pixels of the ocular fundus image and store the MSER pixel list within the memory; and
provide for display through the communication interface the pixels of the ocular fundus image that are located within the MSER pixel list to indicate the exudates in the ocular fundus.

2. The architecture of claim 1 wherein the processing circuitry is configured to substantially simultaneously provide the labels for the light image regions and the dark image regions within the ocular fundus image for the given intensity threshold.

3. The architecture of claim 1 wherein the processing circuitry is configured to provide the labels for the light image regions and the dark image regions within the ocular fundus image during a single processing pass for the given intensity threshold.

4. The architecture of claim 1 wherein the MSER criteria include a nested MSER tolerance value.

5. The architecture of claim 4 wherein the MSER criteria further include a minimum MSER area, a maximum MSER area, and an acceptable growth rate value for MSER areas.

6. The architecture of claim 1 wherein the processing circuitry is further configured to determine MSER ellipses parameters that include a center of gravity, a major axis length, a minor axis length, and an angle of the major axis length with respect to a horizontal axis.

7. The architecture of claim 1 wherein the processing circuitry includes MSER moments calculator hardware configured to calculate MSER moments.

8. The architecture of claim 7 wherein the processing circuitry further includes elliptical fit approximator hardware configured to receive the MSER moments from the MSER moments calculator hardware and fit an MSER ellipse to an extremal region based upon the MSER moments.

9. The architecture of claim 1 wherein the processing circuitry includes union-find hardware configured to provide the labels for the light image regions and the dark image regions within the ocular fundus image for the given intensity threshold t.

10. The architecture of claim 9 wherein the processing circuitry includes extremal region find hardware that is configured to receive the labels for the light image regions and the dark image regions and find extremal regions based upon the labels for the light image regions and the dark image regions.

11. The architecture of claim 10 wherein the extremal region find hardware is configured to find extremal regions using a mathematical relationship q(t)=|Q(t +Δ)\Q(t−Δ)|\|Q(t)| where each extremal region's cardinality,|Q(t)| is a function of the given intensity threshold t and an intensity threshold increment Δ.

12. The architecture of claim 1 wherein the processing circuitry includes MSER selector hardware configured to automatically select MSERs based on the MSER criteria.

13. Architecture for maximally stable extremal regions (MSERs)-based detection of exudates in an ocular fundus comprising:
a communication interface;
memory;
intensity image process hardware coupled to the memory and configured to receive a data stream through the communication interface of an ocular fundus image and store the pixels of the ocular fundus image within the memory and output labels to a first matrix within the memory for light image regions and dark image regions within the ocular fundus image for a given intensity threshold;
extremal regions find hardware configured to receive the labels for the ocular fundus image and find MSERs within the ocular fundus image;
MSER process hardware configured to receive MSER criteria that include a minimum MSER size in pixels and a maximum MSER size in pixels based upon an eye diameter size in pixels of the ocular fundus image and output through the communication interface a list of pixels for display based on the MSERs; and
display hardware coupled to the communication interface for displaying highlighted pixels from the list of pixels for display.

14. The architecture of claim 13 wherein the intensity image process hardware is configured to substantially simultaneously provide the labels for the light image regions and the dark image regions within the ocular fundus image for the given intensity threshold.

15. The architecture of claim 13 wherein the intensity image process hardware is configured to provide the labels for the light image regions and the dark image regions within the ocular fundus image during a single processing pass for the given intensity threshold.

16. The architecture of claim 13 wherein the MSER criteria include a nested MSER tolerance value.

17. The architecture of claim 16 wherein the MSER criteria further include a minimum MSER area value, a maximum MSER area value, and an acceptable growth rate value for MSER areas.

18. The architecture of claim 13 wherein the MSER process hardware is further configured to determine MSER ellipses parameters that include a center of gravity, a major axis length, a minor axis length, and an angle of the major axis length with respect to a horizontal axis.

19. The architecture of claim 13 wherein the extremal regions find hardware is configured to find extremal regions using a mathematical relationship q(t)=|Q(t +Δ) \Q(t −Δ)|\|Q(t)| where each extremal region's cardinality, |Q(t)| is a function of an intensity threshold t and an intensity threshold increment Δ.

20. The architecture of claim 13 wherein the intensity image process hardware includes union-find hardware configured to provide the labels for the light image regions and the dark image regions within the ocular fundus image for a given intensity threshold t.

21. The architecture of claim 20 wherein the intensity image process hardware further includes labeled region seeds updater/unifier hardware configured to prevent a seed that is a first pixel location within the ocular fundus image from being stored in a seed list if the seed is presently stored in the seed list.

22. The architecture of claim 21 further including region map updater hardware configured to store a value of Q(t +Δ), Q(t), and Q(t −Δ) for each seed, where t is the intensity threshold and Δ is an increment of the intensity threshold t.

23. The architecture of claim 13 wherein the intensity image process hardware, the extremal regions find hardware, and the MSER process hardware are fabricated on a single application-specific integrated circuit.

24. The architecture of claim 13 wherein the intensity image process hardware, the extremal regions find hardware, and the MSER process hardware are implemented on a single field-programmable gate array.

25. A method for maximally stable extremal regions (MSERs)-based detection

Assignees

• Univ Khalifa Science & Technology

Inventors

• Salahat Ehab Najeh
• Saleh Hani Hasan Mustafa
• Sluzek Andrzej Stefan
• Al-Qutayri Mahmoud
• Mohammad Baker
• Elnaggar Mohammed Ismail

Classifications

• G06T7/62

  of area, perimeter, diameter or volume · CPC title

• A61B3/12

  for looking at the eye fundus, e.g. ophthalmoscopes (A61B3/13 takes precedence) · CPC title

• G06T2207/30041

  Eye; Retina; Ophthalmic · CPC title

• A61B3/0025 Primary

  characterised by electronic signal processing, e.g. eye models · CPC title

• G06T7/60

  Analysis of geometric attributes · CPC title