Method and device for detecting defect, storage medium and electronic device

Patent metadata

Field	Value
Publication number	US-12347085-B2
Application number	US-202117772562-A
Country	US
Kind code	B2
Filing date	May 21, 2021
Priority date	May 21, 2021
Publication date	Jul 1, 2025
Grant date	Jul 1, 2025

Abstract

Provided is a method and device for detecting defect, a computer readable storage medium and an electronic device, the method including: acquiring (S 310 ) a detection task, and acquiring various types of images corresponding to the detection task; acquiring (S 320 ) defect detection models trained by a same initial model corresponding to the types of the images respectively; and obtaining (S 330 ) defect detection results by performing defect detection on respective type of images using the defect detection model corresponding to the type of the images.

First claim

What is claimed is:

1. A method for detecting defect, comprising:
acquiring a detection task, and acquiring various types of images corresponding to the detection task captured by an optical device on a display substrate during a production process of the display substrate;
acquiring defect detection models trained by a same initial model corresponding to the types of the images respectively; and
obtaining defect detection results by performing defect detection on respective type of images using the defect detection model corresponding to the type of the images.

2. The method according to claim 1 , wherein the acquiring various types of images corresponding to the detection task comprises:
obtaining product information corresponding to the detection task; and
obtaining the various types of images according to the product information.

3. The method according to claim 2 , wherein the obtaining the various types of images according to the product information comprises:
obtaining the various types of images corresponding to a same product corresponding to the product information,
wherein the various types of images are obtained by taking pictures of the product using cameras with different configuration parameters, and
wherein the configuration parameters comprise one or more of resolution, color and zoom factor.

4. The method according to claim 3 , wherein the method further comprises:
determining a maximum number of channels in each of the various types of images; and
preprocessing the various types of images and setting a number of channels of each of various types of images to the maximum number of channels.

5. The method according to claim 4 , wherein the preprocessing the various types of images further comprises:
determining a resolution threshold according to the defect detection model; and
adjusting resolutions of the various types of images according to the resolution threshold.

6. The method according to claim 5 , further comprising:
providing a preprocessing parameter modification interface for the preprocessing, to allow a user to adjust parameter information of the preprocessing by the preprocessing parameter modification interface.

7. The method according to claim 3 , wherein the various types of images comprise one or more of an AOI color image, a TDI image, and a DM image of the product.

8. The method according to claim 3 , wherein the obtaining defect detection results by performing defect detection on respective type of images using the defect detection model corresponding to the type of the images comprises:
setting defect influence weights on the various types of images according to the configuration parameters;
obtaining reference defect detection results corresponding respectively to the various types of images by performing defect detection on the various types of images using the defect detection model corresponding to each type of the images; and
determining the defect detection results according to the defect influence weights and the reference defect detection results.

9. The method according to claim 2 , wherein the obtaining product information corresponding to the detection task comprises:
extracting a product information field in the detection task to obtain the product information.

10. The method according to claim 1 , wherein the defect detection results comprise image normal information or image defect information.

11. The method according to claim 1 , wherein the defect detection model comprises a feature extraction network and a defect identification network, and the obtaining defect detection results by performing defect detection on respective type of images using the defect detection model corresponding to the type of the images comprises:
obtaining feature images by performing feature extraction on the various types of images using the feature extraction network, and standardizing the feature images;
obtaining a defect category of each feature image by performing defect classifying according to standardized feature images using the defect identification network, and determining coordinates of each feature image; and
obtaining the defect detection result according to the defect category and the coordinates.

12. The method according to claim 11 , further comprising:
providing a standardizing parameter modification interface, to allow a user to adjust parameter information of the standardizing by the standardizing parameter modification interface.

13. The method according to claim 11 , wherein the obtaining the defect detection result according to the defect category and the coordinates comprises:
screening the feature images to obtain a target feature image, and determining the defect category and the coordinates of the target candidate feature image; and
obtaining the defect detection result according to a preset screening strategy and the defect category and the coordinates of the target candidate feature image.

14. The method according to claim 13 , wherein the screening the feature images to obtain the target feature image comprises:
calculating confidence level of each of the feature images, and
screening the feature images by using an NMS algorithm according to the confidence level to obtain the target feature image.

15. A non-transitory computer readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, a method for detecting defect is implemented, which comprises:
acquiring a detection task and acquiring various types of images corresponding to the detection task captured by an optical device on a display substrate during a production process of the display substrate;
acquiring defect detection models trained by a same initial model corresponding to the types of the images respectively; and
obtaining defect detection results by performing defect detection on respective type of images using the defect detection model corresponding to the type of the images.

16. An electrical device comprising:
a processor; and
a memory, configured to store one or more programs, and when the one or more programs are executed by a processor, causes the processor to:
acquire a detection task, and acquiring various types of images corresponding to the detection task captured by an optical device on a display substrate during a production process of the display substrate;
acquire defect detection models trained by a same initial model corresponding to the types of the images respectively, and
obtain defect detection results by performing defect detection on respective type of images using the defect detection model corresponding to the type of the images.

17. The electrical device according to claim 16 , wherein the processor is further caused to:
obtain product information corresponding to the detection task; and
obtain the various types of images according to the product information.

18. The electrical device according to claim 17 , wherein the processor is further caused to:
obtain the various types of images corresponding to a same product corresponding to the product information,
wherein the various types of images are obtained by taking pictures of the product using cameras with different configuration parameters, and
wherein the configuration parameters comprise one or more of resolution, color and zoom factor.

19. The electrical device according to claim 18 , wherein the processor is further caused to:
determine a maximum number of channels in each of the various types of images; and

Assignees

• Beijing Zhongxiangying Tech Co Ltd
• Boe Technology Group Co Ltd

Inventors

• Wang Yaoping
• Zhang Meijuan
• He Wangqiang
• Chai Dong
• Wang Hong

Classifications

• G06T2207/20092

  Interactive image processing based on input by user · CPC title

• G06T2207/20081

  Training; Learning · CPC title

• G06T2207/10024

  Color image · CPC title

• G06T2200/24

  involving graphical user interfaces [GUIs] · CPC title

• G06V10/764

  using classification, e.g. of video objects · CPC title