Review of Machine Vision Detection Methods for Texture Surface Defects
-
摘要: 纹理表面缺陷检测在机器视觉领域具有意义和挑战性,其历史可以追溯到20世纪中后期,近年来随着深度学习技术的蓬勃发展,纹理表面缺陷检测技术大幅飞跃。直至今日,关于纹理表面缺陷检测的调研和综述仍然很少。在此背景下,本文回顾2017年-2021年间200余篇纹理表面缺陷机器视觉检测论文,对纹理表面缺陷机器视觉检测研究进展进行了及时、全面的调查;分析了纹理表面缺陷检测的发展历史和最新研究进展,原则上将纹理表面缺陷机器视觉检测方法分为传统方法与深度学习方法,并对二者进行了深层次研究分析,特别是深度学习方法;对近期出现的几种纹理表面缺陷机器视觉检测方法主题进行总结的同时,也对这些主题的研究进展进行了综述。最后,对未来的研究趋势进行了展望,以期为后续研究提供指导和启示。Abstract: Texture surface defect detection is meaningful and challenging in the field of machine vision. The history of texture surface defect detection can be traced back to the middle to late 20th century. Moreover, in recent years, with the flourishing development of deep learning technology, texture surface defect detection technology had a big leap. However, so far, there are still few surveys and reviews of texture surface defect detection. Against such a background, we comprehensively reviewed more than 200 papers about texture surface defect detection with machine vision from 2017 to 2021 and made a timely and comprehensive investigation of its research progress. This paper reviews the development history and latest research progress of texture surface defect detection. In principle, the methods of texture surface defect detection by machine vision are divided into the traditional method and the deep learning method, which were studied and analyzed deeply, especially the deep learning method. The paper summarizes several methods of texture surface defect detection by machine vision that appeared recently and reviews the research progress of these methods. Finally, it introduced the future research trends to provide enlightenment for further studies.
-
Key words:
- texture /
- defect detecting /
- machine vision /
- machine learning /
- deep learning
-
表 1 分类结果混淆矩阵
Table 1. Confusion matrix for the classification results
真实情况 预测结果 正例 反例 正例 PT NF 反例 PF NT 方法 方法描述 F1指标/% RAccuracy% 方法分类 发表年份 Yu等[100] 基于两阶段全卷积FCN网络的表面缺陷检测方法 95.99 基于语义分割方法 2017 Wang等[76] 基于11层卷积神经网络的表面缺陷检测方法 99.80 基于传统CNN方法 2018 Zhou等[175] 基于双VGG16网络的表面缺陷检测方法 99.49 迁移学习方法 2019 Enshaei等[115] 使用粗略标记的弱监督U-net表面缺陷检测方法 79.33 99.16 弱监督学习方法 2020 Chen等[118] 基于注意力结构卷积神经网络的纹理表面缺陷检测方法 74.46 99.85 基于弱监督学习方法 2020 Zhang等[216] 基于弱监督学习的分类感知对象检测方法 65.8 87.60 基于知识蒸馏 2021 Tsai等[152] 基于改进的CAE模型的纹理表面缺陷检测方法 95.00 基于无缺陷样本训练方法 2021 方法 方法描述 RAccuracy% 方法分类 发表年份 Schlegl等[137] 基于GAN的缺陷检测方法AnoGAN 55 基于无缺陷样本
训练方法2017 Bergmann等[154] 基于结构相似性感知损失SSIM卷积自编码器AE网络的表面缺陷检测方法 63 基于无缺陷样本
训练方法2019 Venkataramanan等[156] 基于引导注意对抗变分自编码器GAVGA的缺陷检测方法(无监督) 78 基于无缺陷样本
训练方法2020 Wang等[150] 基于VQ-VAE的表面缺陷检测方法 85 基于无缺陷样本
训练方法2020 Tsai等[152] 基于改进CAE模型的纹理表面缺陷检测方法 91 基于无缺陷样本
训练方法2021 Tellaeche等[148] 基于卷积自编码器与OC-SVM的纹理表面缺陷检测方法 92 基于无缺陷样本
训练方法2021 表 4 纹理表面缺陷机器视觉检测方法优缺点比较
Table 4. Comparison of the pros and cons of machine vision detection methods for texture surface defects
分类 方法 优点 缺点 传统方法 图像结构方法 方法原理简单 多数方法泛化能力差,仅适用于某一种特定情况下的缺陷检测 频域分析方法 在空间域较难分离的特征在频域可分离性提升 频域分析方法对噪声敏感,多数情况下计算复杂,耗时较长 传统机器学习方法 缺陷检测效果优于其他传统方法;与深度学习方法相比,可解释性强 在实际使用过程中,超参数对检测效果影响巨大 深度学习方法 监督学习方法 具有较高的缺陷检测精度,是目前缺陷检测效果最好的方法 需要大量标注正确的训练样本 弱监督学习方法 基于存在标注问题样本进行训练,方法可达到较高精度 无过明显缺陷,属于监督学习与无监督学习方法的折中 无监督学习方法 模型训练简单,仅使用无标记样本训练,不需要标注 缺陷检测精度相对监督学习方法较低 迁移学习方法 使用其他领域数据训练模型,减少了对缺陷样本的需求 在不同预训练数据集下效果差异较大,存在负迁移、负适配问题 主动学习方法 可以在样本标注较少情况下进行训练 模型训练需要人工与机器迭代,虽然减少了标注样本数量,但标注代价并没有过多下降 -
[1] OJANSIVU V, HEIKKILÄ J. Blur insensitive texture classification using local phase quantization[C]//Proceedings of the 3rd International Conference on Image and Signal Processing. Cherbourg-Octeville: Springer, 2008: 236-243 [2] AKL A, YAACOUB C, DONIAS M, et al. A survey of exemplar-based texture synthesis methods[J]. Computer Vision and Image Understanding, 2018, 172: 12-24. doi: 10.1016/j.cviu.2018.04.001 [3] BORMANN R, ESSLINGER D, HUNDSDOERFER D, et al. Texture characterization with semantic attributes: database and algorithm[C]//Proceedings of the 47st International Symposium on Robotics. Munich, Germany: VDE, 2016: 1-8 [4] LIU L, FIEGUTH P. Texture classification from random features[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(3): 574-586. doi: 10.1109/TPAMI.2011.145 [5] XIE X H. A review of recent advances in surface defect detection using texture analysis techniques[J]. Electronic Letters on Computer Vision and Image Analysis, 2008, 7(3): 1-22. doi: 10.5565/rev/elcvia.268 [6] NGAN H Y T, PANG G K H, YUNG N H C. Automated fabric defect detection-a review[J]. Image and Vision Computing, 2011, 29(7): 442-458. doi: 10.1016/j.imavis.2011.02.002 [7] HSIEH Y A, TSAI Y J. Machine learning for crack detection: review and model performance comparison[J]. Journal of Computing in Civil Engineering, 2020, 34(5): 04020038. doi: 10.1061/(ASCE)CP.1943-5487.0000918 [8] MCCULLOCH W S, PITTS W. A logical calculus of the ideas immanent in nervous activity[J]. The Bulletin of Mathematical Biophysics, 1943, 5(4): 115-133. doi: 10.1007/BF02478259 [9] MOHAMED A R, DAHL G, HINTON G. Deep belief networks for phone recognition[C]//Proceedings of the NIPS Workshop on Deep Learning for Speech Recognition and Related Applications. Vancouver, Canada: NIPS, 2009: 39 [10] RUMELHART D E, HINTON G E, WILLIAMS R J. Learning representations by back-propagating errors[J]. Cognitive Modeling, 1988, 5(3): 1. [11] KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks[C]//Proceedings of the 25th International Conference on Neural Information Processing Systems. Lake Tahoe: Curran Associates Inc. , 2012: 1097-1105 [12] LIU Z F, LIU S L, LI C L, et al. Fabric defect detection based on multi-source feature fusion[J]. International Journal of Clothing Science and Technology, 2022, 34(2): 156-177. doi: 10.1108/IJCST-07-2020-0108 [13] HU H B, XU D J, ZHENG X P, et al. Pit defect detection on steel shell end face based on machine vision[C]//Proceedings of the 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC). Chongqing, China: IEEE, 2020: 898-902 [14] SAFAEI N, SMADI O, MASOUD A, et al. An automatic image processing algorithm based on crack pixel density for pavement crack detection and classification[J]. International Journal of Pavement Research and Technology, 2022, 15(1): 159-172. doi: 10.1007/s42947-021-00006-4 [15] WANG X M, ZHANG Z K. On-line defect detection and classification of latex gloves[J]. Journal of Physics:Conference Series, 2020, 1575: 012103. doi: 10.1088/1742-6596/1575/1/012103 [16] JIANG J, JIN Z L, WANG B H, et al. A Sobel operator combined with patch statistics Algorithm for fabric defect detection[J]. KSII Transactions on Internet and Information Systems, 2020, 14(2): 687-701. [17] KUMARI R M L N, BANDARA G A C T, DISSANAYAKE M B. Sylvester matrix-based similarity estimation method for automation of defect detection in textile fabrics[J]. Journal of Sensors, 2021, 2021: 6625421. [18] WINKLER J R, HALAWANI H. The Sylvester and bézout resultant matrices for blind image deconvolution[J]. Journal of Mathematical Imaging and Vision, 2018, 60(8): 1284-1305. doi: 10.1007/s10851-018-0812-2 [19] BEN GHARSALLAH M, BEN BRAIEK E. A visual attention system based anisotropic diffusion method for an effective textile defect detection[J]. The Journal of the Textile Institute, 2021, 112(12): 1925-1939. doi: 10.1080/00405000.2020.1850613 [20] SONG L W, LI R Z, CHEN S Q. Fabric defect detection based on membership degree of regions[J]. IEEE Access, 2020, 8: 48752-48760. doi: 10.1109/ACCESS.2020.2978900 [21] ZHANG J W, WANG H Y, TIAN Y, et al. An accurate fuzzy measure-based detection method for various types of defects on strip steel surfaces[J]. Computers in Industry, 2020, 122: 103231. doi: 10.1016/j.compind.2020.103231 [22] ZHANG H L, PENG L, YU S, et al. Detection of surface defects in ceramic tiles with complex texture[J]. IEEE Access, 2021, 9: 92788-927 97 [23] QIU Y H, TANG L X, LI B, et al. Uneven illumination surface defects inspection based on saliency detection and intrinsic image decomposition[J]. IEEE Access, 2020, 8: 190663-190676. doi: 10.1109/ACCESS.2020.3032108 [24] YOSINSKI J, CLUNE J, BENGIO Y, et al. How transferable are features in deep neural networks?[C]//Proceedings of the 27th International Conference on Neural Information Processing Systems. Montreal: MIT Press, 2014: 3320-3328 [25] XIE X H, MIRMEHDI M. TEXEMS: texture exemplars for defect detection on random textured surfaces[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2007, 29(8): 1454-1464. doi: 10.1109/TPAMI.2007.1038 [26] BÖTTGER T, ULRICH M. Real-time texture error detection on textured surfaces with compressed sensing[J]. Pattern Recognition and Image Analysis, 2016, 26(1): 88-94. doi: 10.1134/S1054661816010053 [27] JIA L, CHEN C, XU S K, et al. Fabric defect inspection based on lattice segmentation and template statistics[J]. Information Sciences, 2020, 512: 964-984. doi: 10.1016/j.ins.2019.10.032 [28] HARALICK R M, SHANMUGAM K, DINSTEIN I H. Textural features for image classification[J]. IEEE Transactions on Systems, Man, and Cybernetics, 1973, SMC-3(6): 610-621. doi: 10.1109/TSMC.1973.4309314 [29] LI F, YUAN L N, ZHANG K, et al. A defect detection method for unpatterned fabric based on multidirectional binary patterns and the gray-level co-occurrence matrix[J]. Textile Research Journal, 2020, 90(7-8): 776-796. doi: 10.1177/0040517519879904 [30] TIEMTUD K, SAPRASERT P, TORMO T, et al. Automatic defect detection for mango fruit using non-extensive entropy with gaussian gain[J]. Thai Journal of Mathematics, 2020, 1(1): 339-349. [31] SUSAN S, HANMANDLU M. A non-extensive entropy feature and its application to texture classification[J]. Neurocomputing, 2013, 120: 214-225. doi: 10.1016/j.neucom.2012.08.059 [32] SUN C J, WEE W G. Neighboring gray level dependence matrix for texture classification[J]. Computer Vision, Graphics, and Image Processing, 1983, 23(3): 341-352. doi: 10.1016/0734-189X(83)90032-4 [33] ZHOU P, ZHOU G B, LI Y M, et al. A hybrid data-driven method for wire rope surface defect detection[J]. IEEE Sensors Journal, 2020, 20(15): 8297-8306. doi: 10.1109/JSEN.2020.2970070 [34] GAO M X, WANG X, ZHU S L, et al. Detection and segmentation of cement concrete pavement pothole based on image processing technology[J]. Mathematical Problems in Engineering, 2020, 2020: 1360832. [35] JI X, Liang J Z, DI L, et al. Fabric defect fetection via weighted low-rank decomposition and Laplacian regularization[J]. Journal of Engineered Fibers and Fabrics, 2020, 15: 1-14 [36] SHI B S, LIANG J Z, DI L, et al. Fabric defect detection via low-rank decomposition with gradient information and structured graph algorithm[J]. Information Sciences, 2021, 546: 608-626. doi: 10.1016/j.ins.2020.08.100 [37] LIU G H, LI F. Fabric defect detection based on low-rank decomposition with structural constraints[J]. The Visual Computer, 2022, 38(2): 639-653. doi: 10.1007/s00371-020-02040-y [38] ZHOU S Y, WU S Q, CUI K T, et al. Double low-rank based matrix decomposition for surface defect segmentation of steel sheet[J]. ISIJ International, 2021, 61(7): 2111-2121. doi: 10.2355/isijinternational.ISIJINT-2021-024 [39] MO D M, WONG W K, LAI Z H, et al. Weighted double-low-rank decomposition with application to fabric defect detection[J]. IEEE Transactions on Automation Science and Engineering, 2021, 18(3): 1170-1190. doi: 10.1109/TASE.2020.2997718 [40] NGAN H Y T, PANG G K H, YUNG S P, et al. Defect detection on patterned jacquard fabric[C]//Proceedings of the 32nd Applied Imagery Pattern Recognition Workshop. Washington, DC, USA: IEEE, 2003: 163-168 [41] NGAN H Y T, PANG G K H. Novel method for patterned fabric inspection using Bollinger bands[J]. Optical Engineering, 2006, 45(8): 087202. doi: 10.1117/1.2345189 [42] NGAN H Y T, PANG G K H. Regularity analysis for patterned texture inspection[J]. IEEE Transactions on Automation Science and Engineering, 2009, 6(1): 131-144. doi: 10.1109/TASE.2008.917140 [43] Workgroup on Texture Analysis of DFG Tilda Textile Texture Database[DB/OL]. (2012-10-10) [2021-10-06] http://lmb.informatik.unifreiburg.de/research/dfg-texture/tilda [44] 江苏省无锡经济开发区(太湖新城), 阿里云计算有限公司. [制造无锡]雪浪制造AI挑战赛—视觉计算辅助良品检测[EB/OL]. [2021-10-06]. https://tianchi.aliyun.com/competition/entrance/231666/introductionTianchi Database Obtained From AI Challenge in Xuelang Manufacturing: Visual Computing Assisted Quality Inspection[DB/OL]. (2018-9-13) [2021-10-06] https://tianchi.aliyun.com/competition/entrance/231666/introduction [45] CIAMBERLINI C, FRANCINI F, LONGOBARDI G, et al. Weaving defect detection by Fourier imaging[C]//Proceedings of SPIE 2786, Vision Systems: Applications. Besancon: SPIE, 1996: 9-18 [46] WOOD E J. Applying Fourier and associated transforms to pattern characterization in textiles[J]. Textile Research Journal, 1990, 60(4): 212-220. doi: 10.1177/004051759006000404 [47] CHAN C H, PANG G K H. Fabric defect detection by Fourier analysis[J]. IEEE Transactions on Industry Applications, 2000, 36(5): 1267-1276. doi: 10.1109/28.871274 [48] DI L, LONG H B, LIANG J Z. Fabric defect detection based on illumination correction and visual salient features[J]. Sensors, 2020, 20(18): 5147. doi: 10.3390/s20185147 [49] YIN H, GONG Y H, QIU G P. Side window filtering[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach: IEEE, 2019: 8750-8758 [50] JING J F, WANG Z, RÄTSCH M, et al. Mobile-Unet: an efficient convolutional neural network for fabric defect detection[J]. Textile Research Journal, 2022, 92(1-2): 30-42. doi: 10.1177/0040517520928604 [51] LIU G H, ZHENG X T. Fabric defect detection based on information entropy and frequency domain saliency[J]. The Visual Computer, 2021, 37(3): 515-528. doi: 10.1007/s00371-020-01820-w [52] CHEN L, ZENG S, GAO Q S, et al. Adaptive Gabor filtering for fabric defect inspection[J]. Journal of Computers, 2020, 31(2): 45-55. [53] LI Y H, ZHOU X Y. Fabric defect detection with optimal Gabor wavelet based on radon[C]//Proceedings of the 2020 IEEE International Conference on Power, Intelligent Computing and Systems (ICPICS). Shenyang, China: IEEE, 2020: 788-793 [54] SULISTYANINGRUM D R, SETIYONO B, ANITA J N, et al. Measurement of crack damage dimensions on asphalt road using Gabor filter[J]. Journal of Physics:Conference Series, 2021, 1752: 012086. doi: 10.1088/1742-6596/1752/1/012086 [55] ZHANG J W, LI Y Y, LUO H C. Defect detection in textile fabrics with optimal Gabor filter and BRDPSO algorithm[J]. Journal of Physics:Conference Series, 2020, 1651: 012073. doi: 10.1088/1742-6596/1651/1/012073 [56] SUN J, FENG B, XU W B. Particle swarm optimization with particles having quantum behavior[C]//Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No. 04TH8753). Portland: IEEE, 2004: 325-331 [57] LIU F T, TING K M, ZHOU Z H. Isolation forest[C]//Proceedings of the 2008 Eighth IEEE International Conference on Data Mining. Pisa: IEEE, 2008: 413-422 [58] SONG G R, SONG K C, YAN Y H. Saliency detection for strip steel surface defects using multiple constraints and improved texture features[J]. Optics and Lasers in Engineering, 2020, 128: 106000. doi: 10.1016/j.optlaseng.2019.106000 [59] MENTOURI Z, MOUSSAOUI A, BOUDJEHEM D, et al. Steel strip surface defect identification using multiresolution binarized image features[J]. Journal of Failure Analysis and Prevention, 2020, 20(6): 1917-1927. doi: 10.1007/s11668-020-01012-7 [60] YUE H W, WANG H T, CHEN H Z, et al. Automatic detection of feather defects using Lie group and fuzzy Fisher criterion for shuttlecock production[J]. Mechanical Systems and Signal Processing, 2020, 141: 106690. doi: 10.1016/j.ymssp.2020.106690 [61] ESSA E, HOSSAIN M S, TOLBA A S, et al. Toward cognitive support for automated defect detection[J]. Neural Computing and Applications, 2020, 32(9): 4325-4333. doi: 10.1007/s00521-018-03969-x [62] CHEN T Q, GUESTRIN C. XGBoost: a scalable tree boosting system[C]//Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. San Francisco, USA: ACM, 2016: 785-794 [63] JAWAHAR M, ANBARASI L J, JASMINE S G, et al. A machine learning-based multi-feature extraction method for leather defect classification[M]//SMYS S, BALAS V E, KAMEL K A, et al. Inventive Computation and Information Technologies. Singapore: Springer, 2021: 189-202 [64] CHAUDHARI C V. Steel surface defect detection using Glcm, Gabor wavelet, hog, and random forest classifier[J]. Turkish Journal of Computer and Mathematics Education (TURCOMAT), 2021, 12(12): 263-273. [65] CHUN P J, IZUMI S, YAMANE T. Automatic detection method of cracks from concrete surface imagery using two-step light gradient boosting machine[J]. Computer-Aided Civil and Infrastructure Engineering, 2021, 36(1): 61-72. doi: 10.1111/mice.12564 [66] KE G L, MENG Q, FINLEY T, et al. LightGBM: a highly efficient gradient boosting decision tree[C]//Proceedings of the 31st International Conference on Neural Information Processing Systems. Long Beach: Curran Associates Inc. , 2017: 3149-3157 [67] JAWAHAR M, BABU N K C, VANI K, et al. Vision based inspection system for leather surface defect detection using fast convergence particle swarm optimization ensemble classifier approach[J]. Multimedia Tools and Applications, 2021, 80(3): 4203-4235. doi: 10.1007/s11042-020-09727-3 [68] 杨晔民, 张慧军, 张小龙. 随机森林的可解释性可视分析方法研究[J]. 计算机工程与应用, 2021, 57(6): 168-175. doi: 10.3778/j.issn.1002-8331.1911-0185YANG Y M, ZHANG H J, ZHANG X L. Research on interpretable visual analysis method of random forest[J]. Computer Engineering and Applications, 2021, 57(6): 168-175. (in Chinese) doi: 10.3778/j.issn.1002-8331.1911-0185 [69] TAN Z Y, JI Y, FEI Z W, et al. Image-based scratch detection by fuzzy clustering and morphological features[J]. Applied Sciences, 2020, 10(18): 6490. doi: 10.3390/app10186490 [70] PARK J K, KWON B K, PARK J H, et al. Machine learning-based imaging system for surface defect inspection[J]. International Journal of Precision Engineering and Manufacturing-Green Technology, 2016, 3(3): 303-310. doi: 10.1007/s40684-016-0039-x [71] ZHOU P, ZHOU G B, LI Y M, et al. Surface defect detection for wire ropes based on deep convolutional neural network[C]//Proceedings of the 2019 14th IEEE International Conference on Electronic Measurement & Instruments (ICEMI). Changsha: IEEE, 2019: 855-860 [72] HUANG X Y, LIU Z L, ZHANG X Y, et al. Surface damage detection for steel wire ropes using deep learning and computer vision techniques[J]. Measurement, 2020, 161: 107843. doi: 10.1016/j.measurement.2020.107843 [73] XIE L F, XIANG X, XU H N, et al. FFCNN: a deep neural network for surface defect detection of magnetic tile[J]. IEEE Transactions on Industrial Electronics, 2021, 68(4): 3506-3516. doi: 10.1109/TIE.2020.2982115 [74] KUMAR M P, ASHOK D. A multi-level colour thresholding based segmentation approach for improved identification of the defective region in leather surfaces[J]. Engineering Journal, 2020, 24(2): 101-108. doi: 10.4186/ej.2020.24.2.101 [75] CHA Y J, CHOI W, BÜYÜKÖZTÜRK O. Deep learning-based crack damage detection using convolutional neural networks[J]. Computer-Aided Civil and Infrastructure Engineering, 2017, 32(5): 361-378. doi: 10.1111/mice.12263 [76] WANG T, CHEN Y, QIAO M N, et al. A fast and robust convolutional neural network-based defect detection model in product quality control[J]. The International Journal of Advanced Manufacturing Technology, 2018, 94(9): 3465-3471. [77] Heidelberg Collaboratory for Image Processing. DAGM 2007 datasets[EB/OL]. [2021-10-06]. https://hci.iwr.uni-heidelberg.de/node/3616 [78] STAAR B, LÜTJEN M, FREITAG M. Anomaly detection with convolutional neural networks for industrial surface inspection[J]. Procedia CIRP, 2019, 79: 484-489. doi: 10.1016/j.procir.2019.02.123 [79] GARG M, DHIMAN G. Deep convolution neural network approach for defect inspection of textured surfaces[J]. Journal of the Institute of Electronics and Computer, 2020, 2(1): 28-38. doi: 10.33969/JIEC.2020.21003 [80] GIRSHICK R, DONAHUE J, DARRELL T, et al. Rich feature hierarchies for accurate object detection and semantic segmentation[C]//IEEE Conference on Computer Vision and Pattern Recognition. Columbus, USA: IEEE, 2014: 580-587 [81] REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: unified, real-time object detection[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas: IEEE, 2016: 779-788 [82] REDMON J, FARHADI A. Yolov3: an incremental improvement[EB/OL]. [2021-10-06]. https://pjreddie.com/media/files/papers/YOLOv3.pdf [83] REN S Q, HE K M, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[C]//Proceedings of the 28th International Conference on Neural Information Processing Systems. Montreal: MIT Press, 2015: 91-99 [84] ZHOU H, JANG B, CHEN Y X, et al. Exploring faster RCNN for fabric defect detection[C]//Proceedings of the 2020 Third International Conference on Artificial Intelligence for Industries (AI4I). Irvine: IEEE, 2020: 52-55 [85] DAI J F, QI H Z, XIONG Y W, et al. Deformable convolutional networks[C]//Proceedings of the IEEE International Conference on Computer Vision. Venice, Italy: IEEE, 2017: 764-773 [86] WEI B, HAO K R, TANG X S, et al. Fabric defect detection based on faster RCNN[C]//Proceedings of the International Conference on Artificial Intelligence on Textile and Apparel. Hong Kong, China: Springer, 2019: 45-51 [87] WEI B, HAO K R, GAO L, et al. Detecting textile micro-defects: a novel and efficient method based on visual gain mechanism[J]. Information Sciences, 2020, 541: 60-74. doi: 10.1016/j.ins.2020.06.035 [88] SU B Y, CHEN H Y, CHEN P, et al. Deep learning-based solar-cell manufacturing defect detection with complementary attention network[J]. IEEE Transactions on Industrial Informatics, 2021, 17(6): 4084-4095. doi: 10.1109/TII.2020.3008021 [89] Jing J F, Zhuo D, Zhang H H, et al. Fabric defect detection using the improved YOLOv3 model[J]. Journal of Engineered Fibers and Fabrics, 2020, 15: 1-10 [90] LI C C, CUI G H, ZHANG W W, et al. Defect detection in vehicle mirror nonplanar surfaces with multi-scale atrous single-shot detect mechanism[J]. AIP Advances, 2021, 11(7): 075202. doi: 10.1063/5.0053851 [91] JUN X, WANG J G, ZHOU J, et al. Fabric defect detection based on a deep convolutional neural network using a two-stage strategy[J]. Textile Research Journal, 2021, 91(1-2): 130-142. doi: 10.1177/0040517520935984 [92] WU X J, CAO K, GU X D. A surface defect detection based on convolutional neural network[C]//Proceedings of the 11th International Conference on Computer Vision Systems. Shenzhen: Springer, 2017: 185-194 [93] SZEGEDY C, LIU W, JIA Y Q, et al. Going deeper with convolutions[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Boston, USA: IEEE, 2015: 1-9 [94] LEI J, GAO X, FENG Z L, et al. Scale insensitive and focus driven mobile screen defect detection in industry[J]. Neurocomputing, 2018, 294: 72-81. doi: 10.1016/j.neucom.2018.03.013 [95] HE Y, SONG K C, MENG Q G, et al. An end-to-end steel surface defect detection approach via fusing multiple hierarchical features[J]. IEEE Transactions on Instrumentation and Measurement, 2020, 69(4): 1493-1504. doi: 10.1109/TIM.2019.2915404 [96] LONG J, SHELHAMER E, DARRELL T. Fully convolutional networks for semantic segmentation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Boston, USA: IEEE, 2015: 3431-3440 [97] WANG R, GUO Q, LU S M, et al. Tire defect detection using fully convolutional network[J]. IEEE Access, 2019, 7: 43502-43510. doi: 10.1109/ACCESS.2019.2908483 [98] WANG S, WU X, ZHANG Y H, et al. A neural network ensemble method for effective crack segmentation using fully convolutional networks and multi-scale structured forests[J]. Machine Vision and Applications, 2020, 31(7): 60. [99] ZHANG A, WANG K C P, LI B X, et al. Automated pixel-level pavement crack detection on 3D asphalt surfaces using a deep-learning network[J]. Computer-Aided Civil and Infrastructure Engineering, 2017, 32(10): 805-819. doi: 10.1111/mice.12297 [100] YU Z Y, WU X J, GU X D. Fully convolutional networks for surface defect inspection in industrial environment[C]//11th International Conference on Computer Vision Systems. Shenzhen: Springer, 2017: 417-426 [101] YANG X C, LI H, YU Y T, et al. Automatic pixel-level crack detection and measurement using fully convolutional network[J]. Computer-Aided Civil and Infrastructure Engineering, 2018, 33(12): 1090-1109. doi: 10.1111/mice.12412 [102] DUNG C V, ANH L D. Autonomous concrete crack detection using deep fully convolutional neural network[J]. Automation in Construction, 2019, 99: 52-58. doi: 10.1016/j.autcon.2018.11.028 [103] BADRINARAYANAN V, KENDALL A, CIPOLLA R. SegNet: a deep convolutional encoder-decoder architecture for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(12): 2481-2495. doi: 10.1109/TPAMI.2016.2644615 [104] ZOU Q, ZHANG Z, LI Q Q, et al. DeepCrack: learning hierarchical convolutional features for crack detection[J]. IEEE Transactions on Image Processing, 2019, 28(3): 1498-1512. doi: 10.1109/TIP.2018.2878966 [105] ZOU Q, CAO Y, LI Q Q, et al. CrackTree: automatic crack detection from pavement images[J]. Pattern Recognition Letters, 2012, 33(3): 227-238. doi: 10.1016/j.patrec.2011.11.004 [106] DONG Y N, WANG J, WANG Z F, et al. A deep-learning-based multiple defect detection method for tunnel lining damages[J]. IEEE Access, 2019, 7: 182643-182657. doi: 10.1109/ACCESS.2019.2931074 [107] REN Y P, HUANG J S, HONG Z Y, et al. Image-based concrete crack detection in tunnels using deep fully convolutional networks[J]. Construction and Building Materials, 2020, 234: 117367. doi: 10.1016/j.conbuildmat.2019.117367 [108] HUANG Y B, QIU C Y, YUAN K. Surface defect saliency of magnetic tile[J]. The Visual Computer, 2020, 36(1): 85-96. doi: 10.1007/s00371-018-1588-5 [109] RONNEBERGER O, FISCHER P, BROX T. U-Net: convolutional networks for biomedical image segmentation[C]//Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention. Munich: Springer, 2015: 234-241 [110] JIANG J B, CAO P, LU Z C, et al. Surface defect detection for mobile phone back glass based on symmetric convolutional neural network deep learning[J]. Applied Sciences, 2020, 10(10): 3621. doi: 10.3390/app10103621 [111] HAN H, GAO C Q, ZHAO Y, et al. Polycrystalline silicon wafer defect segmentation based on deep convolutional neural networks[J]. Pattern Recognition Letters, 2020, 130: 234-241. doi: 10.1016/j.patrec.2018.12.013 [112] LIU E Y, CHEN K P, XIANG Z Y, et al. Conductive particle detection via deep learning for ACF bonding in TFT-LCD manufacturing[J]. Journal of Intelligent Manufacturing, 2020, 31(4): 1037-1049. doi: 10.1007/s10845-019-01494-9 [113] ZHOU G H, SUN H Y. Defect detection method for steel based on semantic segmentation[C]//Proceedings of the 2020 IEEE 5th Information Technology and Mechatronics Engineering Conference (ITOEC). Chongqing: IEEE, 2020: 975-979 [114] SRIVASTAVA Y, MURALI V, DUBEY S R. PSNet: parametric sigmoid norm based CNN for face recognition[C]//Proceedings of the 2019 IEEE Conference on Information and Communication Technology. Allahabad, India: IEEE, 2019: 1-4 [115] ENSHAEI N, AHMAD S, NADERKHANI F. Automated detection of textured-surface defects using UNet-based semantic segmentation network[C]//Proceedings of the 2020 IEEE International Conference on Prognostics and Health Management (ICPHM). Detroit, USA: IEEE, 2020: 1-5 [116] RACKI D, TOMAZEVIC D, SKOCAJ D. A compact convolutional neural network for textured surface anomaly detection[C]//Proceedings of the 2018 IEEE Winter Conference on Applications of Computer Vision (WACV). Lake Tahoe, USA: IEEE, 2018: 1331-1339 [117] MARINO S, BEAUSEROY P, SMOLARZ A. Weakly-supervised learning approach for potato defects segmentation[J]. Engineering Applications of Artificial Intelligence, 2019, 85: 337-346. doi: 10.1016/j.engappai.2019.06.024 [118] CHEN H Y, HU Q D, ZHAI B S, et al. A robust weakly supervised learning of deep Conv-Nets for surface defect inspection[J]. Neural Computing and Applications, 2020, 32(15): 11229-11244. doi: 10.1007/s00521-020-04819-5 [119] WOO S, PARK J, LEE J Y, et al. CBAM: convolutional block attention module[C]//Proceedings of the 15th European Conference on Computer Vision (ECCV). Munich, Germany: Springer, 2018: 3-19 [120] XU L, LV S, DENG Y, et al. A weakly supervised surface defect detection based on convolutional neural network[J]. IEEE Access, 2020, 8: 42285-42296. doi: 10.1109/ACCESS.2020.2977821 [121] Visual Cognitive Systems Laboratory. KolektorSDD dataset[EB/OL]. [2021-10-06]. http://www.vicos.si/Downloads/KolektorSDD [122] GAO Y P, GAO L, LI X Y, et al. A semi-supervised convolutional neural network-based method for steel surface defect recognition[J]. Robotics and Computer-Integrated Manufacturing, 2020, 61: 101825. doi: 10.1016/j.rcim.2019.101825 [123] LEE D H. Pseudo-label: the simple and efficient semi-supervised learning method for deep neural networks[C]//Proceedings of the Workshop on Challenges in Representation Learning. Atlanta, GA, USA: JMLR. org, 2013: 896 [124] DI H, KE X, PENG Z, et al. Surface defect classification of steels with a new semi-supervised learning method[J]. Optics and Lasers in Engineering, 2019, 117: 40-48. doi: 10.1016/j.optlaseng.2019.01.011 [125] ODENA A. Semi-supervised learning with generative adversarial networks[EB/OL]. [2021-10-06]. https://arxiv.org/pdf/1606.01583.pdf%5D [126] NIU S L, LIN H, NIU T Z, et al. DefectGAN: weakly-supervised defect detection using generative adversarial network[C]//Proceedings of the 2019 IEEE 15th International Conference on Automation Science and Engineering (CASE). Vancouver: IEEE, 2019: 127-132 [127] GOODFELLOW I J, POUGET-ABADIE J, MIRZA M, et al. Generative adversarial nets[C]//Proceedings of the 27th International Conference on Neural Information Processing Systems. Montreal: MIT Press, 2014: 2672-2680 [128] LIU K, LI A M, WEN X, et al. Steel surface defect detection using GAN and one-class classifier[C]//Proceedings of the 2019 25th International Conference on Automation and Computing (ICAC). Lancaster: IEEE, 2019: 1-6 [129] WEI W, DENG D X, ZENG L, et al. Real-time implementation of fabric defect detection based on variational automatic encoder with structure similarity[J]. Journal of Real-Time Image Processing, 2021, 18(3): 807-823. doi: 10.1007/s11554-020-01023-5 [130] HU G H, HUANG J F, WANG Q H, et al. Unsupervised fabric defect detection based on a deep convolutional generative adversarial network[J]. Textile Research Journal, 2020, 90(3-4): 247-270. doi: 10.1177/0040517519862880 [131] ZHAI W, ZHU J, CAO Y, et al. A generative adversarial network based framework for unsupervised visual surface inspection[C]//Proceedings of the 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). Calgary, Canada: IEEE, 2018: 1283-1287 [132] ZHAO Z X, LI B, DONG R, et al. A surface defect detection method based on positive samples[C]//Proceedings of the 15th Pacific Rim International Conference on Artificial Intelligence. Nanjing: Springer, 2018: 473-481 [133] LAI Y T K, HU J S. A texture generation approach for detection of novel surface defects[C]//Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC). Miyazaki: IEEE, 2018: 4357-4362 [134] HASELMANN M, GRUBER D P, TABATABAI P. Anomaly detection using deep learning based image completion[C]//Proceedings of the 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA). Orlando, FL, USA: IEEE, 2018: 1237-1242 [135] WANG J C, YI G D, ZHANG S Y, et al. An unsupervised generative adversarial network-based method for defect inspection of texture surfaces[J]. Applied Sciences, 2021, 11(1): 283. [136] LIU W Q, LI R Z, ZHENG M, et al. Towards visually explaining variational autoencoders[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Seattle, USA: IEEE, 2020: 8639-8648 [137] SCHLEGL T, SEEBÖCK P, WALDSTEIN S M, et al. Unsupervised anomaly detection with generative adversarial networks to guide marker discovery[C]//Proceedings of the 25th International Conference on Information Processing in Medical Imaging. Boone: Springer, 2017: 146-157 [138] ARJOVSKY M, BOTTOU L. Towards principled me-thods for training generative adversarial networks[C]//Proceedings of the 5th International Conference on Learning Representations (ICLR). Toulon, France: OpenReview. net, 2017: 1-17 [139] AJOVSKY M, CHINTALA S, BOTTOU L. Wasserstein GAN[EB/OL]. [2021-10-06]. https://arxiv.org/abs/1701.07875 [140] SCHLEGL T, SEEBÖCK P, WALDSTEIN S M, et al. f-AnoGAN: fast unsupervised anomaly detection with generative adversarial networks[J]. Medical Image Analysis, 2019, 54: 30-44. doi: 10.1016/j.media.2019.01.010 [141] PATHAK D, KRÄHENBÜHL P, DONAHUE J, et al. Context encoders: feature learning by inpainting[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Las Vegas, USA: IEEE, 2016: 2536-2544 [142] AKCAY S, ATAPOUR-ABARGHOUEI A, BRECKON T P. GANomaly: semi-supervised anomaly detection via adversarial training[C]//Proceedings of the 14th Asian Conference on Computer Vision. Perth: Springer, 2019: 622-637 [143] LECUN Y, CORTES C, BURGES C J C. MNIST handwritten digit database[DB/OL]. [2021-10-06]. http://yann.lecun:com/exdb/mnist/ [144] KRIZHEVSKY A, HINTON G. Learning multiple layers of features from tiny images[R]. Toronto: University of Toronto, 2009 [145] AKCAY S, KUNDEGORSKI M E, WILLCOCKS C G, et al. Using deep convolutional neural network architectures for object classification and detection within X-ray baggage security imagery[J]. IEEE Transactions on Information Forensics and Security, 2018, 13(9): 2203-2215. doi: 10.1109/TIFS.2018.2812196 [146] MEI S, YANG H, YIN Z P. An unsupervised-learning-based approach for automated defect inspection on textured surfaces[J]. IEEE Transactions on Instrumentation and Measurement, 2018, 67(6): 1266-1277. doi: 10.1109/TIM.2018.2795178 [147] ZHANG H W, LIU S T, GE Z Q, et al. Yarn-dyed shirt cut pieces defect detection using attention vector quantized-variational autoencoder[C]//Proceedings of the 2021 IEEE 10th Data Driven Control and Learning Systems Conference (DDCLS). Suzhou, China: IEEE, 2021: 1356-1361 [148] IGLESIAS A T, ANAYA M Á C, MARTINSANZ G P, et al. On combining convolutional autoencoders and support vector machines for fault detection in industrial textures[J]. Sensors, 2021, 21(10): 3339. doi: 10.3390/s21103339 [149] YANG H, CHEN Y F, SONG K Y, et al. Multiscale feature-clustering-based fully convolutional autoencoder for fast accurate visual inspection of texture surface defects[J]. IEEE Transactions on Automation Science and Engineering, 2019, 16(3): 1450-1467. doi: 10.1109/TASE.2018.2886031 [150] WANG L, ZHANG D K, GUO J H, et al. Image anomaly detection using normal data only by latent space resampling[J]. Applied Sciences, 2020, 10(23): 8660. doi: 10.3390/app10238660 [151] BERGMANN P, FAUSER M, SATTLEGGER D, et al. MVTec AD-A comprehensive real-world dataset for unsupervised anomaly detection[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, USA: IEEE, 2019: 9584-9592 [152] TSAI D M, JEN P H. Autoencoder-based anomaly detection for surface defect inspection[J]. Advanced Engineering Informatics, 2021, 48: 101272. doi: 10.1016/j.aei.2021.101272 [153] Ruff L, Vandermeulen R A, Gornitz N, et al. Deep support vector data description for unsupervised and semi-supervised anomaly detection[C]//Proceedings of the ICML 2019 Workshop on Uncertainty and Robustness in Deep Learning, Long Beach CA USA: IEEE, 2019: 9-15 [154] BERGMANN P, LÖWE S, FAUSER M, et al. Improving unsupervised defect segmentation by applying structural similarity to autoencoders[C]//Proceedings of the 14th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications. Prague, Czech Republic: SciTePress, 2019: 372-380 [155] WANG Z, BOVIK A C, SHEIKH H R, et al. Image quality assessment: from error visibility to structural similarity[J]. IEEE Transactions on Image Processing, 2004, 13(4): 600-612. doi: 10.1109/TIP.2003.819861 [156] VENKATARAMANAN S, PENG K C, SINGH R V, et al. Attention guided anomaly localization in images[C]//Proceedings of the 16th European Conference on Computer Vision. Glasgow: Springer, 2020: 485-503 [157] YANG H, ZHOU Q Y, SONG K Y, et al. An anomaly feature-editing-based adversarial network for texture defect visual inspection[J]. IEEE Transactions on Industrial Informatics, 2021, 17(3): 2220-2230. doi: 10.1109/TII.2020.3015765 [158] HASELMANN M, GRUBER D. Supervised machine learning based surface inspection by synthetizing artificial defects[C]//Proceedings of the 2017 16th IEEE International Conference on Machine Learning and Applications (ICMLA). Cancun, Mexico: IEEE, 2017: 390-395 [159] LIU L Z, CAO D H, WU Y B, et al. Defective samples simulation through adversarial training for automatic surface inspection[J]. Neurocomputing, 2019, 360: 230-245. doi: 10.1016/j.neucom.2019.05.080 [160] HE Y, SONG K C, DONG H W, et al. Semi-supervised defect classification of steel surface based on multi-training and generative adversarial network[J]. Optics and Lasers in Engineering, 2019, 122: 294-302. doi: 10.1016/j.optlaseng.2019.06.020 [161] WU X J, QIU L T, GU X D, et al. Deep learning-based generic automatic surface defect inspection (ASDI) with pixelwise segmentation[J]. IEEE Transactions on Instrumentation and Measurement, 2021, 70: 5004010. [162] WEI T R, CAO D H, JIANG X R, et al. Defective samples simulation through neural style transfer for automatic surface defect segment[C]//Proceedings of the 2019 International Conference on Optical Instrument and Technology. Beijing, China: China Instrument and Control Society (CIS), 2019 [163] LI C S, HUANG Y J, LI H, et al. A weak supervision machine vision detection method based on artificial defect simulation[J]. Knowledge-Based Systems, 2020, 208: 106466. doi: 10.1016/j.knosys.2020.106466 [164] PRAPPACHER N, BULLMANN M, BOHN G, et al. Defect detection on rolling element surface scans using neural image segmentation[J]. Applied Sciences, 2020, 10(9): 3290. doi: 10.3390/app10093290 [165] WANG Z, JING J F. Pixel-wise fabric defect detection by CNNs without labeled training data[J]. IEEE Access, 2020, 8: 161317-161325. doi: 10.1109/ACCESS.2020.3021189 [166] WEI T R, CAO D H, ZHENG C Y, et al. A simulation-based few samples learning method for surface defect segmentation[J]. Neurocomputing, 2020, 412: 461-476. doi: 10.1016/j.neucom.2020.06.090 [167] TSAI D M, FAN S K S, CHOU Y H. Auto-annotated deep segmentation for surface defect detection[J]. IEEE Transactions on Instrumentation and Measurement, 2021, 70: 5011410. [168] ZHU J Y, PARK T, ISOLA P, et al. Unpaired image-to-image translation using cycle-consistent adversarial networks[C]//Proceedings of the IEEE International Conference on Computer Vision. Venice, Italy: IEEE, 2017: 2242-2251 [169] TANG R J, MAO K M. An improved GANs model for steel plate defect detection[J]. IOP Conference Series:Materials Science and Engineering, 2020, 790: 012110. doi: 10.1088/1757-899X/790/1/012110 [170] SAIZ F A, ALFARO G, BARANDIARAN I, et al. Generative adversarial networks to improve the robustness of visual defect segmentation by semantic networks in manufacturing components[J]. Applied Sciences, 2021, 11(14): 6368. doi: 10.3390/app11146368 [171] ZHAO S Y, LIU Z J, LIN J, et al. Differentiable augmentation for data-efficient GAN training[C]//Proceedings of the 34th International Conference on Neural Information Processing Systems. Vancouver: Curran Associates Inc. , 2020: 634 [172] CHEN L C, ZHU Y K, PAPANDREOU G, et al. Encoder-decoder with atrous separable convolution for semantic image segmentation[C]//Proceedings of the 15th European Conference on Computer Vision (ECCV). Munich, Germany: Springer, 2018: 833-851 [173] DENG J, DONG W, SOCHER R, et al. ImageNet: a large-scale hierarchical image database[C]//Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition. Miami, USA: IEEE, 2009: 248-255 [174] YU Y J, CAO H, YAN X Y, et al. Defect identification of wind turbine blades based on defect semantic features with transfer feature extractor[J]. Neurocomputing, 2020, 376: 1-9. doi: 10.1016/j.neucom.2019.09.071 [175] ZHOU F, LIU G H, XU F, et al. A generic automated surface defect detection based on a bilinear model[J]. Applied Sciences, 2019, 9(15): 3159. doi: 10.3390/app9153159 [176] RADFORD A, METZ L, CHINTALA S. Unsupervised representation learning with deep convolutional generative adversarial networks[DB/OL]. (2016-1-7) [2021-10-06]. https://arxiv.org/abs/1511.06434 [177] SONG K C, YAN Y H. Micro surface defect detection method for silicon steel strip based on saliency convex active contour model[J]. Mathematical Problems in Engineering, 2013, 2013: 429094. [178] LEI H W, WANG B, WU H H, et al. Defect detection for polymeric polarizer based on faster R-CNN[J]. Journal of Information Hiding and Multimedia Signal Processing, 2018, 9(6): 1414-1420. [179] LI S Y, ZHAO X F, ZHOU G Y. Automatic pixel-level multiple damage detection of concrete structure using fully convolutional network[J]. Computer-Aided Civil and Infrastructure Engineering, 2019, 34(7): 616-634. doi: 10.1111/mice.12433 [180] NEUHAUSER F M, BACHMANN G, HORA P. Surface defect classification and detection on extruded aluminum profiles using convolutional neural networks[J]. International Journal of Material Forming, 2020, 13(4): 591-603. doi: 10.1007/s12289-019-01496-1 [181] VOC 2007 Dataset[DB/OL]. (2007-10-10) [2021-10-06]. https:// pjreddie.com/projects/pascal-voc-dataset-mirror [182] WU J, LE J, XIAO Z T, et al. Automatic fabric defect detection using a wide-and-light network[J]. Applied Intelligence, 2021, 51(7): 4945-4961. doi: 10.1007/s10489-020-02084-6 [183] LIONG S T, GAN Y S, HUANG Y C, et al. Automatic defect segmentation on leather with deep learning[EB/OL]. [2021-10-06]. https://arxiv.org/pdf/1903.12139.pdf [184] HE K M, GKIOXARI G, DOLLÁR P, et al. Mask R-CNN[C]//Proceedings of the IEEE International Conference on Computer Vision. Venice, Italy: IEEE, 2017: 2980-2988 [185] LIN T Y, MAIRE M, BELONGIE S, et al. Microsoft COCO: common objects in context[C]//Proceedings of the 13th European Conference on Computer Vision. Zurich, Switzerland: Springer, 2014: 740-755 [186] BADMOS O, KOPP A, BERNTHALER T, et al. Image-based defect detection in lithium-ion battery electrode using convolutional neural networks[J]. Journal of Intelligent Manufacturing, 2020, 31(4): 885-897. doi: 10.1007/s10845-019-01484-x [187] DAMACHARLA P, RAO M V A, RINGENBERG J, et al. TLU-NET: a deep learning approach for automatic steel surface defect detection[C]//Proceedings of the 2021 International Conference on Applied Artificial Intelligence (ICAPAI). Halden: IEEE, 2021: 1-6 [188] ASLAM M, KHAN T M, NAQVI S S, et al. Ensemble convolutional neural networks with knowledge transfer for leather defect classification in industrial settings[J]. IEEE Access, 2020, 8: 198600-198614. doi: 10.1109/ACCESS.2020.3034731 [189] TAN M X, LE Q V. EfficientNet: rethinking model scaling for convolutional neural networks[C]//Proceedings of the 36th International Conference on Machine Learning. Long Beach, California, USA: PMLR, 2019: 6105-6114 [190] HUANG G, LIU Z, VAN DER MAATEN L, et al. Densely connected convolutional networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, USA: IEEE, 2017: 2261-2269 [191] TSCHANDL P, ROSENDAHL C, KITTLER H. The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions[J]. Scientific Data, 2018, 5: 180161. doi: 10.1038/sdata.2018.161 [192] MUNDT M, MAJUMDER S, MURALI S, et al. Meta-learning convolutional neural architectures for multi-target concrete defect classification with the concrete defect bridge IMage dataset[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Long Beach, USA: IEEE, 2019: 11188-11197 [193] PAN S J, YANG Q. A survey on transfer learning[J]. IEEE Transactions on Knowledge and Data Engineering, 2010, 22(10): 1345-1359. doi: 10.1109/TKDE.2009.191 [194] FENG C, LIU M Y, KAO C C. Deep active learning for civil infrastructure defect detection and classification[C]//ASCE International Workshop on Computing in Civil Engineering 2017. Seattle: American Society of Civil Engineers, 2017: 298-306 [195] LYU X M, DUAN F J, JIANG J J, et al. Deep active learning for surface defect detection[J]. Sensors, 2020, 20(6): 1650. doi: 10.3390/s20061650 [196] REDMON J, FARHADI A. YOLO9000: better, faster, stronger[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, USA: IEEE, 2017: 6517-6525 [197] IANDOLA F N, HAN S, MOSKEWICZ M W, et al. SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size[EB/OL]. [2021-10-06]. https://arxiv.org/abs/1602.07360 [198] HOWARD A G, ZHU M, CHEN b, et al. Mobilenets: efficient convolutional neural networks for mobile vision applications[DB/OL]. (2017-4-17) [2021-10-06]. https:// arxiv.org/abs/1704.04861 [199] ZHANG X Y, ZHOU X Y, LIN M X, et al. ShuffleNet: an extremely efficient convolutional neural network for mobile devices[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Salt Lake City, USA: IEEE, 2018: 6848-6856 [200] CHOLLET F. Xception: deep learning with depthwise separable convolutions[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Honolulu, USA: IEEE, 2017: 1800-1807 [201] CHOI W, CHA Y J. SDDNet: real-time crack segmentation[J]. IEEE Transactions on Industrial Electronics, 2020, 67(9): 8016-8025. doi: 10.1109/TIE.2019.2945265 [202] ZHOU T, ZHANG J B, SU H, et al. EDDs: a series of Efficient Defect Detectors for fabric quality inspection[J]. Measurement, 2021, 172: 108885. doi: 10.1016/j.measurement.2020.108885 [203] LIN Z S, YE H X, ZHAN B, et al. An efficient network for surface defect detection[J]. Applied Sciences, 2020, 10(17): 6085. doi: 10.3390/app10176085 [204] LI Y, XU J B. Electronic product surface defect detection based on a MSSD network[C]//Proceedings of the 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC). Chongqing, China: IEEE, 2020: 773-777 [205] SANDLER M, HOWARD A, ZHU M L, et al. MobileNetV2: inverted residuals and linear bottlenecks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Salt Lake City, USA: IEEE, 2018: 4510-4520 [206] WU Y, ZHANG X D, FANG F Z. Automatic fabric defect detection using cascaded mixed feature pyramid with guided localization[J]. Sensors, 2020, 20(3): 871. doi: 10.3390/s20030871 [207] TAN M X, LE Q V. MixConv: mixed depthwise convolutional kernels[C]//30th British Machine Vision Conference 2019. Cardiff: BMVA Press, 2019 [208] HUANG Y B, QIU C Y, WANG X N, et al. A compact convolutional neural network for surface defect inspection[J]. Sensors, 2020, 20(7): 1974. doi: 10.3390/s20071974 [209] ZHANG A, WANG K C P, FEI Y, et al. Automated pixel-level pavement crack detection on 3D asphalt surfaces with a recurrent neural network[J]. Computer-Aided Civil and Infrastructure Engineering, 2019, 34(3): 213-229. doi: 10.1111/mice.12409 [210] ZHAO Y D, HAO K R, HE H B, et al. A visual long-short-term memory based integrated CNN model for fabric defect image classification[J]. Neurocomputing, 2020, 380: 259-270. doi: 10.1016/j.neucom.2019.10.067 [211] SIMONYAN K, ZISSERMAN a. Very deep convolutional networks for large-scale image recognition[DB/OL]. (2015-4-10) [2021-10-06]. https://arxiv.org/abs/1409. 1556 [212] ZHU Z W, HAN G J, JIA G Y, et al. Modified DenseNet for automatic fabric defect detection with edge computing for minimizing latency[J]. IEEE Internet of Things Journal, 2020, 7(10): 9623-9636. doi: 10.1109/JIOT.2020.2983050 [213] CHEN F C, JAHANSHAHI M R. NB-CNN: deep learning-based crack detection using convolutional neural network and Naïve Bayes data fusion[J]. IEEE Transactions on Industrial Electronics, 2018, 65(5): 4392-4400. doi: 10.1109/TIE.2017.2764844 [214] XU X M, CHEN J X, ZHANG H D, et al. D4Net: de-deformation defect detection network for non-rigid products with large patterns[J]. Information Sciences, 2021, 547: 763-776. doi: 10.1016/j.ins.2020.05.050 [215] HINTON G, VINYALS O, DEAN J. Distilling the knowledge in a neural network[DB/OL]. (2015-3-9) [2021-10-06]. https:// arxiv.org/abs/1503.02531 [216] ZHANG J B, SU H, ZOU W, et al. CADN: a weakly supervised learning-based category-aware object detection network for surface defect detection[J]. Pattern Recognition, 2021, 109: 107571. doi: 10.1016/j.patcog.2020.107571 [217] CARION N, MASSA F, SYNNAEVE G, et al. End-to-end object detection with transformers[C]//Proceedings of the 16th European Conference on Computer Vision. Glasgow: Springer, 2020: 213-229