Apparatus and method of recording a storage location by size for harvested tubers

Patent metadata

Field	Value
Publication number	US-2025022126-A1
Application number	US-202318524041-A
Country	US
Kind code	A1
Filing date	Nov 30, 2023
Priority date	Jul 13, 2023
Publication date	Jan 16, 2025
Grant date	—

Abstract

An apparatus and a method of determining a storage location by size for harvested tubers deposited by a bin piler are provided. The method may comprise: capturing one or more images of the harvested tubers; segmenting individual tuber depictions visible in the images; determining one or more shape characteristics for a plurality of the individual tuber depictions; identifying one or more unoccluded tuber depictions by determining that at least one of the individual tuber depictions is an unoccluded tuber depiction based on the shape characteristics of that individual tuber depiction; measuring a size of tubers corresponding to at least one of the unoccluded tuber depictions; attributing an average size to at least tubers corresponding to the occluded tuber depictions based on the measured size; determining the storage location of the harvested tubers based in part on bin piler location data; and recording in memory the storage location and average size.

First claim

We claim:

1 . A method of recording a storage location by size for harvested tubers deposited by a bin piler, the method comprising:
capturing, using a camera, one or more images of the harvested tubers moving on a conveyor towards the bin piler; segmenting, by a processor, individual tuber depictions visible in the one or more images; determining, by the processor, one or more shape characteristics for a plurality of the individual tuber depictions; identifying, by the processor, one or more unoccluded tuber depictions by determining that at least one of the individual tuber depictions is an unoccluded tuber depiction based on the one or more shape characteristics of that individual tuber depiction, the tuber depictions including occluded tuber depictions; measuring, by the processor, a size of tubers corresponding to at least one of the unoccluded tuber depictions; attributing, by the processor, an average size to at least tubers corresponding to the occluded tuber depictions based on the size of tubers corresponding to the at least one of the unoccluded tuber depictions; determining, by the processor, the storage location of the harvested tubers based at least in part on bin piler location data; and recording in memory the storage location of the harvested tubers and the average size.

2 . The method of claim 1 , wherein said segmenting includes deriving a binary mask for each individual tuber depiction using a Mask Region-based Convolutional Neural Network (R-CNN) model.

3 . The method of claim 2 , wherein said determining one or more shape characteristics includes at least one of: determining a color-based feature parameter, and an edge-based feature parameter for the binary mask.

4 . The method of claim 1 , wherein said identifying the one or more unoccluded tuber depictions includes binary classification of fully and partially visible tuber depictions using a random forest model.

5 . The method of claim 1 , wherein the size includes at least one of a volume, a projected area and a one-dimensional length.

6 . The method of claim 1 , wherein said measuring includes fitting an external contour of the at least one of the unoccluded tuber depictions with an ellipse and determining a major diameter and a minor diameter of the ellipse.

7 . The method of claim 1 , wherein said determining the storage location of the harvested tubers is further based on one or more movement characteristics of the conveyor.

8 . An apparatus for recording a storage location by size for harvested tubers, the apparatus comprising:
a bin piler configured to deposit the harvested tubers at the storage location; a conveyor configured to move the harvested tubers towards the bin piler; a camera configured to capture one or more images of the harvested tubers moving on the conveyor; a location system configured to generate bin piler location data indicating a location of the bin piler; and a control system having at least one processor and a memory, the at least one processor configured to collectively:
receive the one or more images from the camera;
segment individual tuber depictions visible in the one or more images;
determine one or more shape characteristics for a plurality of the individual tuber depictions;
identify one or more unoccluded tuber depictions by determining that at least one of the individual tuber depictions is an unoccluded tuber depiction based on the one or more shape characteristics of that individual tuber depiction, the tuber depictions including occluded tuber depictions;
measure a size of tubers corresponding to at least one of the unoccluded tuber depictions;
attribute an average size to at least tubers corresponding to the occluded tuber depictions based on the size of tubers corresponding to the at least one of the unoccluded tuber depictions;
determine the storage location of the harvested tubers based at least in part on the bin piler location data; and
record in the memory the storage location of the harvested tubers and the average size.

9 . The apparatus of claim 8 , wherein said segmenting comprises deriving a binary mask for each individual tuber depiction using a Mask Region-based Convolutional Neural Network (R-CNN) model.

10 . The apparatus of claim 9 , wherein said determining the one or more shape characteristics comprises determining at least one of: a color-based feature parameter, and an edge-based feature parameter for the binary mask.

11 . The apparatus of claim 8 , wherein said identifying the one or more unoccluded tuber depictions comprises binary classification of fully and partially visible tuber depictions using a random forest model.

12 . The apparatus of claim 8 , wherein the size includes at least one of a volume, a projected area, and a one-dimensional length.

13 . The apparatus of claim 8 , wherein said measuring comprises fitting an external contour of the at least one of the unoccluded tuber depictions with an ellipse and determining a major diameter and a minor diameter of the ellipse.

14 . The apparatus of claim 8 , wherein the location system comprises one or more sensors positioned on the bin piler or adjacent to the storage location, the one or more sensors configured to generate the bin piler location data.

15 . A non-transitory computer-readable medium comprising instructions executable by a processor, wherein the instructions when executed configure the processor to:
receive, from a camera, one or more images of harvested tubers moving on a conveyor towards a bin piler; segment individual tuber depictions visible in the one or more images; determine one or more shape characteristics for a plurality of the individual tuber depictions; identify one or more unoccluded tuber depictions by determining that at least one of the individual tuber depictions is an unoccluded tuber depiction based on the one or more shape characteristics of that individual tuber depiction, the tuber depictions including occluded tuber depictions; measure a size of tubers corresponding to at least one of the unoccluded tuber depictions; attribute an average size to at least tubers corresponding to the occluded tuber depictions based on the size of tubers corresponding to the at least one of the unoccluded tuber depictions; determine a storage location of the harvested tubers based at least in part on bin piler location data; and record in memory the storage location of the harvested tubers and the average size.

16 . The non-transitory computer-readable medium of claim 15 , wherein said segmenting comprises deriving a binary mask for each individual tuber depiction using a Mask Region-based Convolutional Neural Network (R-CNN) model.

17 . The non-transitory computer-readable medium of claim 16 , wherein said determining the one or more shape characteristics comprises determining at least one of:
a color-based feature parameter, and an edge-based feature parameter for the binary mask.

18 . The non-transitory computer-readable medium of claim 15 , wherein said identifying the one or more unoccluded tuber depictions comprises binary classification of fully and partially visible tuber depictions using a random forest model.

19 . The non-transitory computer-readable medium of claim 15 , wherein said determining the storage location of the harvested tubers is further based on one or more movement characteristics of the conveyor.

20 . The non-transitory computer-readable medium of claim 15 , wherein the instructions when executed further

Assignees

• Univ Dalhousie

Inventors

• Al-Mallahi Ahmad
• Emwinghare Ighodaro
• Campbell Colton

Classifications

• G06T2207/10016

  Video; Image sequence · CPC title

• G06T7/60

  Analysis of geometric attributes · CPC title

• G06T7/155

  involving morphological operators · CPC title

• G06V10/764

  using classification, e.g. of video objects · CPC title

• G06V20/52 Primary

  Surveillance or monitoring of activities, e.g. for recognising suspicious objects (recognising microscopic objects G06V20/69) · CPC title