Automated machine vision-based defect detection

Patent metadata

Field	Value
Publication number	US-12456185-B2
Application number	US-202318511909-A
Country	US
Kind code	B2
Filing date	Nov 16, 2023
Priority date	Dec 19, 2019
Publication date	Oct 28, 2025
Grant date	Oct 28, 2025

Abstract

Provided are various mechanisms and processes for automatic computer vision-based defect detection using a neural network. A system is configured for receiving historical datasets that include training images corresponding to one or more known defects. Each training image is converted into a corresponding matrix representation for training the neural network to adjust weighted parameters based on the known defects. Once sufficiently trained, a test image of an object that is not part of the historical dataset is obtained. Portions of the test image are extracted as input patches for input into the neural network as respective matrix representations. A probability score indicating the likelihood that the input patch includes a defect is automatically generated for each input patch using the weighted parameters. An overall defect score for the test image is then generated based on the probability scores to indicate the condition of the object.

First claim

What is claimed is:

1. A method comprising:
obtaining a test image of an object;
pre-processing the test image to generate a plurality of regions of the test image for subsequent processing steps;
segmenting portions of the test image into a plurality of patches for input into a neural network that was trained using a historical dataset that does not include the test image, each patch of the plurality of patches corresponding to a segmented portion of the test image;
determining whether each patch of the plurality of patches is within a region of the plurality of regions of the test image; and
inputting each patch of the plurality of patches that is determined to be within a region of the plurality of regions into the neural network as a respective matrix representation, while excluding patches of the plurality of patches that are determined to not be within the region of the plurality of regions from the neural network.

2. The method of claim 1 , wherein the neural network is embedded in a camera device.

3. The method of claim 1 , wherein patches in the plurality of patches are input into the neural network in parallel.

4. The method of claim 1 , wherein patches in the plurality of patches include overlapping portions of the test image.

5. The method of claim 1 , wherein patches in the plurality of patches are aligned such that each patch is immediately adjacent to one or more other patches of the plurality of patches.

6. The method of claim 1 , wherein the neural network is configured to accurately output a probability score for a defect in each patch input into the neural network using weighted parameters.

7. The method of claim 6 , further comprising generating a heat map of the patches based on the probability scores of the patches.

8. A system comprising:
a processor; and
memory, the memory storing instructions to execute a method, the method comprising:
obtaining a test image of an object;
pre-processing the test image to generate a plurality of regions of the test image for subsequent processing steps;
segmenting portions of the test image into a plurality of patches for input into a neural network that was trained using a historical dataset that does not include the test image, each patch of the plurality of patches corresponding to a segmented portion of the test image;
determining whether each patch of the plurality of patches is within a region of the plurality of regions of the test image; and
inputting each patch of the plurality of patches that is determined to be within a region of the plurality of regions into the neural network as a respective matrix representation, while excluding patches of the plurality of patches that are determined to not be within the region of the plurality of regions from the neural network.

9. The system of claim 8 , wherein the neural network is embedded in a camera device.

10. The system of claim 8 , wherein patches in the plurality of patches are input into the neural network in parallel.

11. The system of claim 8 , wherein patches in the plurality of patches include overlapping portions of the test image.

12. The system of claim 8 , wherein patches in the plurality of patches are aligned such that each patch is immediately adjacent to one or more other patches of the plurality of patches.

13. The system of claim 8 , wherein the neural network is configured to accurately output a probability score for a defect in each patch input into the neural network using weighted parameters.

14. The system of claim 13 , further comprising generating a heat map of the patches based on the probability scores of the patches.

15. A non-transitory computer readable medium storing instructions to cause a processor to execute a method, the method comprising:
obtaining a test image of an object;
pre-processing the test image to generate a plurality of regions of the test image for subsequent processing steps;
segmenting portions of the test image into a plurality of patches for input into a neural network that was trained using a historical dataset that does not include the test image, each patch of the plurality of patches corresponding to a segmented portion of the test image;
determining whether each patch of the plurality of patches is within a region of the plurality of regions of the test image; and
inputting each patch of the plurality of patches that is determined to be within a region of the plurality of regions into the neural network as a respective matrix representation, while excluding patches of the plurality of patches that are determined to not be within the region of the plurality of regions from the neural network.

16. The non-transitory computer readable medium of claim 15 , wherein the neural network is embedded in a camera device.

17. The non-transitory computer readable medium of claim 15 , wherein patches in the plurality of patches are input into the neural network in parallel.

18. The non-transitory computer readable medium of claim 15 , wherein patches in the plurality of patches include overlapping portions of the test image.

19. The non-transitory computer readable medium of claim 15 , wherein patches in the plurality of patches are aligned such that each patch is immediately adjacent to one or more other patches of the plurality of patches.

20. The non-transitory computer readable medium of claim 15 , wherein the neural network is configured to accurately output a probability score for a defect in each patch input into the neural network using weighted parameters.

Assignees

• Qeexo Co

Inventors

• Bhatt Rajen
• Mao Shitong
• Kandury Raviprakash
• Tai Michelle
• Newman Geoffrey

Classifications

• G06T2207/20076

  Probabilistic image processing · CPC title

• G06T2207/20084

  Artificial neural networks [ANN] · CPC title

• G06T2207/20081

  Training; Learning · CPC title

• G06T2207/30164

  Workpiece; Machine component · CPC title

• G06T7/11

  Region-based segmentation · CPC title