Method and system of detecting foreign materials within an agricultural product stream

Patent metadata

Field	Value
Publication number	US-10527558-B2
Application number	US-201916266530-A
Country	US
Kind code	B2
Filing date	Feb 4, 2019
Priority date	Oct 10, 2016
Publication date	Jan 7, 2020
Grant date	Jan 7, 2020

Abstract

Methods and systems for detecting foreign material within a product stream in real-time, involve illuminating a portion of the agricultural product stream with light spanning a wavelength range including or within near-infrared and/or shortwave infrared wavelengths; scanning a line of the illuminated agricultural product stream to acquire a hyperspectral image of the line, the hyperspectral image of the line having a width of a single pixel; processing the hyperspectral image of the scanned line to obtain spectrum data for one or more pixels of the hyperspectral image of the scanned line; comparing the obtained spectrum data of the one or more pixels to predetermined spectrum data to determine whether the obtained spectrum data is indicative of foreign material within the scanned line of the agricultural product stream.

First claim

We claim:

1. A method of detecting foreign material within an agricultural product stream in real-time, the method comprising:
illuminating a portion of the agricultural product stream with light spanning a wavelength range including or within near-infrared and/or shortwave infrared wavelengths;
scanning a line of the illuminated agricultural product stream to acquire a hyperspectral image of the line, the hyperspectral image of the line having a width of a single pixel;
processing the hyperspectral image of the scanned line to obtain spectrum data for one or more pixels of the hyperspectral image of the scanned line; and
comparing the obtained spectrum data of the one or more pixels to predetermined spectrum data to determine whether the obtained spectrum data is indicative of foreign material within the scanned line of the agricultural product stream without constructing a hyperspectral image cube.

2. The method of claim 1 , wherein the scanned line of agricultural product stream is generally perpendicular to a direction in which the agricultural product stream is being moved.

3. The method of claim 1 , wherein the predetermined spectrum data is a calculated value based upon spectral data associated with tobacco, foam, cardboard, plastic, foil, lubricant, paper, a sub-combination thereof, or a combination thereof.

4. The method of claim 1 , further comprising a step of:
determining, based upon the comparing step, the location of foreign material in the product stream; or
determining, based upon the comparing step, that the scanned line of the agricultural product stream does not contain foreign material.

5. The method of claim 1 , wherein the processing step comprises calculating the Euclidean distance associated with one or more pixels of the hyperspectral image of the scanned line, wherein the Euclidean distance is calculated by the formula:

d
⁡

(

p
,
q

)

=

∑

i
=
1

n

⁢

⁢

(

q
i

-

p
i

)

2

,

wherein p=(p 1 , p 2 . . . , p n ) and q=(q 1 , q 2 . . . , q n ) and p and q are two points in Euclidean n-space.

6. The method of claim 1 , wherein the scanning step includes sensing a spectrum of light reflected, scattered, and/or emitted from the agricultural product stream with at least one sensor; wherein:
(a) the scanning is performed by a line-scan hyperspectral imaging device that includes the at least one sensor;
(b) the at least one sensor is an Indium Gallium Arsenide (InGaAs) sensor; and/or
(c) the at least one sensor is operable to sense light in a range of about 900 nm to 1700 nm or about 900 nm to 2500 nm.

7. The method of claim 1 , wherein:
(a) the scanning is performed by a line-scan hyperspectral imaging device wherein the hyperspectral imaging device operates in the range of about 900 nm to 1700 nm or about 900 nm to 2500 nm; and/or
(b) the illuminating is performed by a tungsten halogen light source.

8. The method of claim 1 , wherein the agricultural product stream is a continuously moving agricultural product stream and is conveyed on a conveyer belt operating at a speed of about 80-100 ft/min.

9. The method of claim 1 , wherein multiple lines of agricultural product stream are individually scanned consecutively, and the consecutively scanned lines are separately processed in-real time.

10. The method of claim 1 , wherein the processing step comprises:
calibrating the hyperspectral image of the scanned line by removing dark values of the hyperspectral image;
normalizing the hyperspectral image of the scanned line; and
smoothing the hyperspectral image of the scanned line to eliminate noise using median filtering.

11. The method of claim 1 , wherein the predetermined spectrum data is a threshold value associated with a single product material, a class of product materials, a single known foreign material, a class of known foreign materials, a sub-combination thereof, or a combination thereof.

12. The method of claim 1 further comprising:
generating an activation signal in response to determining that the scanned line of agricultural product stream comprises foreign material;
transmitting the activation signal to a removal system; and
removing the foreign material from the scanned line.

13. The method of claim 12 , wherein the foreign material is removed by a vacuum device and/or a forced fluid stream.

14. A system for detecting foreign material within an agricultural product stream in real-time, the system comprising:
an illumination device configured to illuminate a portion of the agricultural product stream at a wavelength range including or within near-infrared and/or shortwave infrared wavelengths;
a hyperspectral imaging device configured to scan a line of the illuminated agricultural product stream to acquire a hyperspectral image of the line, the hyperspectral image of the line having a width of a single pixel; and
a processor configured to:
process the hyperspectral image of the scanned line to obtain spectrum data for one or more pixels of the hyperspectral image of the scanned line, and
compare the obtained spectrum data of the one or more pixels to predetermined spectrum data to determine whether the obtained spectrum data is indicative of foreign material within the scanned line of the agricultural product stream without constructing a hyperspectral image cube.

15. The system of claim 14 , wherein the processor is further configured to:
determine, based upon the compared spectrum data, the location of foreign material in the product stream; or
determine, based upon the compared spectrum data, that the scanned line of the agricultural product stream does not contain foreign material.

16. A non-transitory computer readable medium having instructions stored thereon, the instructions being configured to cause a processor to execute the steps of the method of claim 1 .

17. A method of detecting foreign material within stationary agricultural product in real-time, the method comprising:
illuminating a portion of the stationary agricultural product with light spanning a wavelength range including or within near-infrared and/or shortwave infrared wavelengths;
moving a hyperspectral imaging device over a portion of the stationary agricultural product while simultaneously scanning a line of the illuminated stationary agricultural prod

Assignees

• Altria Client Services Llc

Inventors

• Sahu Amrita
• Dante Henry M
• Morris Jerry W

Classifications

• G01N21/3563

  for analysing solids; Preparation of samples therefor · CPC title

• G01N2201/127

  Calibration; base line adjustment; drift compensation · CPC title

• G01N2021/8592

  Grain or other flowing solid samples · CPC title

• G01N21/94 Primary

  Investigating contamination, e.g. dust (G01N21/85 takes precedence) · CPC title

• B07C2501/0081

  Sorting of food items · CPC title