Contextually adaptive digital pathology interface

Patent metadata

Field	Value
Publication number	US-11587667-B2
Application number	US-201917272125-A
Country	US
Kind code	B2
Filing date	Aug 26, 2019
Priority date	Aug 31, 2018
Publication date	Feb 21, 2023
Grant date	Feb 21, 2023

Abstract

A method, system, and computer program product for an image visualization system (120) that includes a contextually adaptive digital pathology interface. At least one image of a biological sample stained for the presence of one or more biomarkers is obtained (300). The image is displayed on a display screen at a first zoom level (310), in which a first subset of user selectable elements are contemporaneously displayed (320). As a result of user input, the image being is displayed at a second zoom level (330), in which a second subset of user selectable elements are contemporaneously displayed with the image (340). The one or more elements within the second subset of user selectable elements are disabled or hidden at the first zoom level, or one or more elements within the first subset of user selectable elements are disabled or hidden at the second zoom level.

First claim

The invention claimed is:

1. A computing device comprising a display screen, the computing device configured to:
access at least one image of a biological sample stained for presence of one or more biomarkers from one or more memories communicatively coupled to the computing device, wherein the biological sample comprises a plurality of cells;
display, on the display screen, the at least one image at a first magnification level, a menu bar, and a panel area;
determine a display resolution for resolving the plurality of cells or a number of cells of the plurality of cells within a predefined area at the first magnification level;
determine the display resolution or the number of cells does not exceed a predetermined threshold value;
in response to determining the display resolution or the number of cells does not exceed the predetermined threshold value, display a plurality of first tools in the menu bar, the plurality of first tools including tools for performing one or more first operations on the at least one image displayed at the first magnification level;
receive, in the panel area, a user input to change a zoom level of the at least one image;
in response to receiving the user input to change the zoom level of the at least one image, display, on the display screen, the at least one image at a second magnification level, different than the first magnification level, the menu bar, and the panel area;
determine the display resolution for resolving the plurality of cells or the number of cells of the plurality of cells within the predefined area at the second magnification level;
determine the display resolution or the number of cells exceeds the predetermined threshold value; and
in response to determining the display resolution or the number of cells exceeds the predetermined threshold value, display a plurality of second tools in the menu bar, the plurality of second tools including tools for performing one or more second operations, different than the one or more first operations, on the at least one image displayed at the second magnification level,
wherein (i) one or more tools of the plurality of first tools displayed when the at least one image is displayed at the first magnification level are disabled or hidden when the at least one image is displayed at the second magnification level, and (ii) one or more tools of the plurality of second tools displayed when the at least one image is displayed at the second magnification level are disabled or hidden when the at least one image is displayed at the first magnification level.

2. The computing device of claim 1 , wherein the second magnification level meets at least a predetermined magnification level.

3. The computing device of claim 1 , wherein the one or more tools of the plurality of second tools disabled or hidden when the at least one image is displayed at the first magnification level are contextually relevant at the second magnification level, but not contextually relevant at the first magnification level.

4. The computing device of claim 1 , wherein the one or more tools of the plurality of second tools comprises one or more image annotation tools.

5. The computing device of claim 4 , wherein the one or more image annotation tools comprises region of interest identification tools, measurement tools, indicia drawing tools, and region exclusion tools.

6. The computing device of claim 1 , wherein the one or more tools of the plurality of second tools comprises one or more image processing tools.

7. The computing device of claim 1 , wherein the second magnification level is greater than the first magnification level.

8. The computing device of claim 1 , wherein the panel area comprises one or more viewer panels, wherein at least one viewer panel of the one or more viewer panels is displayed when the at least one image is displayed at the second magnification level and is disabled or hidden when the at least one image is displayed at the first magnification level.

9. The computing device of claim 1 , wherein the first magnification level is an unmagnified zoom level.

10. The computing device of claim 9 , wherein the at least one image further comprises a portion comprising identifying indicia.

11. A computing device comprising a display screen, the computing device configured to:
access at least one image of a biological sample stained for presence of one or more biomarkers from one or more memories communicatively coupled to the computing device, wherein the biological sample comprises a plurality of cells;
display, on the display screen, the at least one image at a first magnification level, a menu bar, and a panel area;
determine a display resolution for resolving the plurality of cells or a number of cells of the plurality of cells within a predefined area at the first magnification level;
determine the display resolution or the number of cells does not exceed a predetermined threshold value;
in response to determining the display resolution or the number of cells does not exceed the predetermined threshold value, display:
a plurality of first tools in the menu bar, the plurality of first tools including tools for performing one or more first operations on the at least one image displayed at the first magnification level; and
a plurality of first panels in the panel area, the plurality of first panels including a zoom panel for magnifying the at least one image and a rotation panel for rotating the at least one image;

receive, in the zoom panel, a user input to change a zoom level of the at least one image;
in response to receiving the user input to change a zoom level of the at least one image, display, on the display screen, the at least one image at a second magnification level, different from the first magnification level, the menu bar, and the panel area;
determine the display resolution for resolving the plurality of cells or the number of cells of the plurality of cells within the predefined area at the second magnification level;
determine the display resolution or the number of cells exceeds the predetermined threshold value; and
in response to determining the display resolution or the number of cells does not exceed the predetermined threshold value, display:
a plurality of second tools in the menu bar, the plurality of second tools including tools for performing one or more second operations, different than the one or more first operations, on the at least one image displayed at the second magnification level; and
a plurality of second panels in the panel area, the plurality of second panels including the zoom panel and a slide panel for assigning a score,

wherein (i) one or more tools of the plurality of first tools displayed when the at least one image is displayed at the first magnification level are disabled or hidden when the at least one image is displayed at the second magnification level, and (ii) one or more tools of the plurality of second tools displayed when the at least one image is displayed at the second magnification level are disabled or hidden when the at least one image is displayed at the first magnification level.

12. The computing device of claim 11 , wherein at least one panel of the plurality of first panels is displayed when the at least one image is displayed at the first magnification level and is disabled or hidden when the at least one image is displayed at the second magnification level.

13. The computing device of claim 11 , wherein the one or more tools of the plurality of second tools comprises one or more image annotation tools, the one or more image annotation tools comprises region of interest identification tools, measur

Assignees

• Ventana Med Syst Inc

Inventors

• Ferreira Joao
• Kalogrides Alexander
• Troy Olivier
• Ulrich Eduardo Ferroao

Classifications

• G06F2203/04806

  Zoom, i.e. interaction techniques or interactors for controlling the zooming operation · CPC title

• G06F2203/04803

  Split screen, i.e. subdividing the display area or the window area into separate subareas · CPC title

• G06F3/04845

  for image manipulation, e.g. dragging, rotation, expansion or change of colour · CPC title

• G06F3/0482

  Interaction with lists of selectable items, e.g. menus · CPC title

• G16H30/20

  for handling medical images, e.g. DICOM, HL7 or PACS · CPC title