Mapping transfer function for automated biological sample processing system

Patent metadata

Field	Value
Publication number	US-9256935-B2
Application number	US-201314095347-A
Country	US
Kind code	B2
Filing date	Dec 3, 2013
Priority date	Dec 3, 2013
Publication date	Feb 9, 2016
Grant date	Feb 9, 2016

Abstract

A gripping element may be commanded to move to pre-determined robot-frame locations, and markings may be punched into a calibration sample capture substrate at each location. A calibration image may be obtained, and fiducial markings on the gripping element may be detected. A set of calibration regions of interest may be predicted, and the previously punched markings may be detected. A sampling system may then create a mapping transfer function between detected image locations and real-world locations resulting from the commanded locations of the gripping element when the markings were punched. An indication may subsequently be received that a biological sample capture substrate is ready to be processed. An image of the sample capture substrate may be obtained, and the fiducial markings may be detected. Based on those image locations and the mapping transfer function, biological sample portions may be automatically taken from the sample capture substrate.

First claim

The invention claimed is:

1. A method associated with an automated biological sample processing system having a gripping element to hold biological sample capture substrates, the method comprising:
receiving an indication that a biological sample capture substrate is ready to be processed;
obtaining an image of the sample capture substrate;
automatically detecting, within the image, a plurality of fiducial markings on the gripping element; and
based on image locations of the detected fiducial markings in the image and a mapping transfer function between detected image locations and real-world locations, arranging for biological sample portions to be automatically taken from the sample capture substrate by the sample processing system, further comprising, prior to said receiving
commanding the gripping element to move to a set of re-determined robot-frame locations, wherein a marking is punched into a calibration sample capture substrate at each location;
obtaining a calibration image of the calibration sample capture substrate;
automatically detecting, within the calibration image, the plurality of fiducial markings on the gripping element;
based on image locations of the detected fiducial markings in the calibration image, predicting a set of calibration regions of interest within the calibration image;
detecting the previously punched marking within each calibration region of interest; and
automatically creating, by the sampling system, the mapping transfer function between detected image locations and real-world locations resulting front the commanded locations of the gripping element when the markings were punched.

2. The method of claim 1 , wherein the sample capture substrate comprises a porous card.

3. The method of claim 1 , wherein an applied biological fluid to the biological sample capture substrate comprises at least one of (i) blood, (ii) saliva, (iii) plant material, (iv) insect material, (v) viral material, (vi) bacterial material, (vii) genetic material, (viii) food, and (ix) animal biological fluid.

4. The method of claim 1 , wherein said arranging comprises transmitting location information from a visualization subsystem to a robot controller associated with the gripping element.

5. The method of claim 4 , wherein the robot controller is to punch a plurality of sample portions from the capture substrate leaving holes in the sample capture substrate.

6. The method of claim 5 , wherein said arranging comprises:
based on the image locations of the detected fiducial markings in the image, predicting a plurality of sampling regions of interest within the image; and
detecting, within each sampling region of interest, a biological sampling area, wherein said plurality of sample portions are punched from within the biological sample areas.

7. The method of claim 1 , wherein at least one of said detections are performed outside of the visible spectrum.

8. The method of claim 1 , wherein the markings previously created on the calibration sample capture substrate comprise a matrix of punched holes.

9. A non-transitory, computer-readable medium storing instructions that, when executed by a computer processor, cause the computer processor to perform a method associated with an automated biological sample processing system having a gripping element to hold biological sample capture substrates, the method comprising:
receiving an indication that a biological fluid sample capture substrate is ready to be processed;
obtaining an image of the sample capture substrate;
automatically detecting, within the image, a plurality of fiducial markings on the gripping element; and
based on image locations of the detected fiducial markings in the image and a mapping transfer function between detected image locations and real-world locations, arranging for biological sample portions to be automatically taken from the sample capture substrate by the sample processing system, further comprising, prior to said receiving;
commanding the gripping element to move to a set of pre-determined robot-frame locations, wherein a marking is punched into a calibration sample capture substrate at each location;
obtaining a calibration image of the calibration sample capture substrate;
automatically detecting, within the calibration image, the plurality of fiducial markings on the gripping element;
based on image locations of the detected fiducial markings in the calibration image, predicting a set of calibration regions of interest within the calibration image;
detecting the previously punched marking within each calibration region of interest; and
automatically creating, by the sampling system, the mapping transfer function between detected image locations and real-world locations resulting from the commanded locations of the gripping element when the markings were punched.

10. The medium of claim 9 , wherein the sample capture substrate comprises a porous card and an applied biological fluid to the porous card comprises at least one of: (i) blood, (ii) saliva, (iii) plant material, (iv) insect material, (v) viral material, (vi) bacterial material, (vii) genetic material, (viii) food, and (ix) animal biological fluid.

11. The medium of claim 9 , wherein said arranging comprises transmitting location information from a visualization subsystem to a robot controller associated with the gripping element, and the robot contoller is to punch a plurality of sample portions in the sample capture substrate.

12. The medium of claim 11 , wherein said arranging comprises:
based on the image locations of the detected fiducial markings in the image, predicting a plurality of sampling regions of interest within the image; and
detecting, within each sampling region of interest, a biological sample area, wherein said plurality of sample portion are punched within the biological sample areas.

13. The medium of claim 9 , wherein the markings previously created on the calibration sample capture substrate comprise a matrix of punched holes.

14. An automated biological sample processing system, comprising:
a visualization subsystem having a camera to capture images;
a robot having a gripping element to hold biological sample capture substrates; and
a robot controller, coupled to the visualization subsystem and the robot; and

a computer system associated with at least one of the visualization subsystem and the robot controller to perform a method, the method comprising:
receiving an indication that a biological sample capture substrate is ready to be processed;
obtaining an image of the sample capture substrate;
automatically detecting, within the image, a plurality of fiducial markings on the gripping element; and
based on image locations of the detected fiducial markings in the image and a mapping transfer function between detected image locations and real-world locations, arranging for biological sample portions to be automatically taken from the sample capture substrate, wherein the method further comprises, prior to said receiving;
commanding the gripping element to move to a set of pre-determined robot-frame locations, wherein a marking is punched into a calibration sample capture substrate at each location;
obtaining a calibration image of the calibration sample capture substrate;
automatically detecting, within the calibration image, the plurality of fiducial markings on the gripping element;
based on image locations of the detected fiducial markings in the calibration image, predicting a set of calibration regions of interest within the calibration image;
detecting the previously punched marking within each calibration region

Assignees

• Gen Electric

Inventors

• Bonanni Pierino Gianni
• Griffin Weston B

Classifications

• G01N1/286 Primary

  involving mechanical work, e.g. chopping, disintegrating, compacting, homogenising (microtomes G01N1/06; pulverising in general B02C; mixing in general B01F) · CPC title

• G01N1/28

  Preparing specimens for investigation {including physical details of (bio-)chemical methods covered elsewhere, e.g. G01N33/50, C12Q}(mounting specimens on microscopic slides G02B21/34; means for supporting the objects or the materials to be analysed in electron microscopes H01J37/20 {; laboratory gas handling apparatus B01L5/00}) · CPC title

• G01N2035/0493

  Locating samples; identifying different tube sizes · CPC title

• G01N2001/288

  Filter punches · CPC title

• G01N2001/282

  with mapping; Identification of areas; Spatial correlated pattern · CPC title