GUO Cong,TIAN Yujia,LI Yang,et al.Identification of Chinese Herb Pieces Based on YOLOv4[J].Chinese Journal of Experimental Traditional Medical Formulae,2023,29(14):133-140.
GUO Cong,TIAN Yujia,LI Yang,et al.Identification of Chinese Herb Pieces Based on YOLOv4[J].Chinese Journal of Experimental Traditional Medical Formulae,2023,29(14):133-140. DOI: 10.13422/j.cnki.syfjx.20230614.
Identification of Chinese Herb Pieces Based on YOLOv4
Chinese herbal piece is an important component of the traditional Chinese medicine (TCM) system, and identifying their quality and grading can promote the development and utilization of Chinese herbal pieces. Utilizing deep learning for intelligent identification of Chinese herbal pieces can save time, effort, and cost, while also reasonably avoiding the constraints of human subjectivity, providing a guarantee for efficient identification of Chinese herbal pieces. In this study, a dataset containing 108 kinds of Chinese herbal pieces (14 058 images) was constructed,the basic YOLOv4 algorithm was employed to identify the 108 kinds of Chinese herbal pieces of our database The mean average precision (mAP) of the developed basic YOLOv4 model reached 85.3%. In addition, the receptive field block was introduced into the neck network of YOLOv4 algorithm, and the improved YOLOv4 algorithm was used to identify Chinese herbal pieces. The mAPof the improved YOLOv4 model achieved 88.7%, the average precision of 80 kinds of decoction pieces exceeded 80%, the average precision of 48 kinds of decoction pieces exceeded 90%. These results indicate that adding the receptive field module can help to some extent in the identification of Chinese herbal medicine pieces with different sizes and small volumes. Finally, the average precision of each kind of Chinese herbal medicine piece by the improved YOLOv4 model was further analyzed. Through in-depth analysis of the original images of Chinese herbal medicine pieces with low prediction average precision, it was clarified that the quantity and quality of original images of Chinese herbal medicine pieces are key to performing intelligent object detection. The improved YOLOv4 model constructed in this study can be used for the rapid identification of Chinese herbal pieces, and also provide reference guidance for the manual authentication of Chinese herbal medicine decoction pieces.
BOCHKOVSKIY A , WANG C Y , LIAO M . YOLOv4: optimal speed and accuracy of object detection [EB/OL].( 2020-04-23 )[ 2023-02-06 ]. https://doi.org/10.48550/arXiv.2004.10934 https://doi.org/10.48550/arXiv.2004.10934 .
OpenCV , an open source computer vision and machine learning software library [EB/OL].( 2022-10-15 )[ 2023-02-06 ]. https://opencv.org/ https://opencv.org/ .
WANG CY , LIAO M , CHEN PY , et.al . CSPNet:A new backbone that can enhance learning capability of CNN [C]// Proceeding of 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) . Piscataway : IEEE , 2020 : 19854564 .
IOFFE S , SZEGEDY C . Batch normalization: Accelerating deep network training by reducing internal covariate shift [EB/OL].( 2022-10-15 )[ 2023-02-06 ]. https://doi.org/10.48550/arXiv.1502.03167 https://doi.org/10.48550/arXiv.1502.03167
HE K , ZHANG X , REN S , et al . Spatial pyramid pooling in deep convolutional networks for visual recognition [J]. IEEE Trans Pattern Anal Mach Intell , 2015 , 37 ( 9 ): 1904 - 1916 .
LIN T Y , DOLLÁR P , GIRSHICK R , et.al . Feature Pyramid Networks for Object Detection [C]// Proceeding of 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR) . Piscataway : IEEE , 2015 : 17355379 .
LIU S , QI L , QIN H F , et.al . Path aggregation network for instance segmentation [C]// Proceeding of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway : IEEE , 2018 : 18326168 .
LIU S , HUANG D , WANG Y H . Receptive field block net for accurate and fast object detection [C]// European Conference on Computer Vision , Munich , 2018 : 11215 .
Intelligent Identification of Fritillariae Cirrhosae Bulbus,Crataegi Fructus and Pinelliae RhizomaBased on Deep Learning Algorithms
Slicing Angle Recognition of Fritillariae Thunbergii Bulbus Based on Improved YOLOv7-tiny Algorithm
Image Recognition of Chinese Herbal Pieces Based on Color Matching Template
Assaying of Aristolochic Acid A in Chinese Herbal Pieces and the Traditional Chinese Medicine Particle
Dosages of Traditional Chinese Herbal Pieces in Internal Medicine Prescription in Guiyang City
Related Author
Chao-qun TAN
Yong-liang HUANG
Chun-jie WU
Hu CHEN
Chong WU
KAI Guoyin
LU Shengli
DU Weifeng
Related Institution
Key Laboratory of Visula Synthesis Graphics and Image Technology for National Defense, Sichuan University
Chengdu University of Traditional Chinese Medicine(TCM)
Affiliated Hospital of Chengdu University of TCM
School of Biological and Chemical Engineering,Zhejiang University of Science and Technology
School of Pharmacy,Zhejiang Provincial International Science&Technology Cooperation Base for Active Ingredients of Medicinal and Edible Plants and Health, Zhejiang Provincial Key Laboratory of Traditional Chinese Medicine for Chinese Resource Innovation and Transformation,Zhejiang Chinese Medical University