A review of Image Processing Technique for Monitoring The Growth and Health of Cows

Main Article Content

Zurnawita Zurnawita Cipto Prabowo Rahmadi Kurnia Ikhwana Elfitri

Abstract

In general, monitoring of animal growth and health is done directly by farmers (invasive measurement methods) which can cause cows to be injured or experience stress. To avoid this, several studies have been conducted on non-invasive methods using image processing technology. In this study, we systematically reviewed several works of literature to identify and synthesize published articles on image processing technology and image processing applications related to weight estimation and individual cattle identification. Analysis of image processing technologies used for weight estimation and individual cattle identification is the main objective of this article. Articles were searched through several databases and studies that met the inclusion criteria were analyzed and used in the review. The studies were divided into three main themes: image processing technologies, applications using image processing, and image processing research on cattle growth and health. It can be concluded that deep learning approaches are increasingly being studied, tested and considered as a viable and promising approach to monitor cattle weight and health in several aspects

Downloads

Download data is not yet available.

Article Details

How to Cite
Zurnawita, Z., Prabowo, C., Kurnia, R., & Elfitri, I. (2023, March 31). A review of Image Processing Technique for Monitoring The Growth and Health of Cows. JITCE (Journal of Information Technology and Computer Engineering), 7(01), 8-18. https://doi.org/https://doi.org/10.25077/jitce.7.01.8-18.2023
Section
Articles

References

[1] Directorate of Social Welfare Statistics, Consumption of Calorie and Protein of Indonesia and Province, September 2021. BPS-Statistics Indonesia, 2021.
[2] W. S. Kim, J. Ghassemi Nejad, D. Q. Peng, Y. H. Jo, J. Kim, and H. G. Lee, “Effects of different protein levels on growth performance and stress parameters in beef calves under heat stress,” Sci Rep, vol. 12, no. 1, Dec. 2022, doi: 10.1038/s41598-022-09982-4.
[3] D. Singh, R. Singh, A. Gehlot, S. V. Akram, N. Priyadarshi, and B. Twala, “An Imperative Role of Digitalization in Monitoring Cattle Health for Sustainability,” Electronics (Switzerland), vol. 11, no. 17. MDPI, Sep. 01, 2022. doi: 10.3390/electronics11172702.
[4] Y. Wu, H. Guo, Z. Li, Q. Ma, Y. Zhao, and A. Pezzuolo, “Body Condition Score for Dairy Cows Method Based on Vision Transformer,” in 2021 IEEE International Workshop on Metrology for Agriculture and Forestry, MetroAgriFor 2021 - Proceedings, 2021, pp. 37–41. doi: 10.1109/MetroAgriFor52389.2021.9628437.
[5] C. C. Mar, T. T. Zin, I. Kobayashi, and Y. Horii, “A Hybrid Approach: Image Processing Techniques and Deep Learning Method for Cow Detection and Tracking System,” in LifeTech 2022 - 2022 IEEE 4th Global Conference on Life Sciences and Technologies, 2022, pp. 566–567. doi: 10.1109/LifeTech53646.2022.9754915.
[6] Y. Qiao et al., “Intelligent perception for cattle monitoring: A review for cattle identification, body condition score evaluation, and weight estimation,” Computers and Electronics in Agriculture, vol. 185. Elsevier B.V., Jun. 01, 2021. doi: 10.1016/j.compag.2021.106143.
[7] Y. Wu, H. Guo, Z. Li, Q. Ma, Y. Zhao, and A. Pezzuolo, “Body Condition Score for Dairy Cows Method Based on Vision Transformer,” in 2021 IEEE International Workshop on Metrology for Agriculture and Forestry, MetroAgriFor 2021 - Proceedings, 2021, pp. 37–41. doi: 10.1109/MetroAgriFor52389.2021.9628437.
[8] R. Garcia, J. Aguilar, M. Toro, and M. Jimenez, “Weight-Identification Model of Cattle Using Machine-Learning Techniques for Anomaly Detection,” in 2021 IEEE Symposium Series on Computational Intelligence, SSCI 2021 - Proceedings, 2021. doi: 10.1109/SSCI50451.2021.9659840.
[9] L. Anifah and Haryanto, “Decision Support System Cattle Weight Prediction using Artificial Selected Weighting Method,” in Proceeding - 2020 3rd International Conference on Vocational Education and Electrical Engineering: Strengthening the framework of Society 5.0 through Innovations in Education, Electrical, Engineering and Informatics Engineering, ICVEE 2020, Oct. 2020. doi: 10.1109/ICVEE50212.2020.9243263.
[10] Mikel Gjergji et al., “Deep Learning Techniques for Beef Cattle BodyWeight Prediction,” in International Joint Conference on Neural Networks (IJCNN), 2020.
[11] Y. Wu, H. Guo, Z. Li, Q. Ma, Y. Zhao, and A. Pezzuolo, “Body Condition Score for Dairy Cows Method Based on Vision Transformer,” in 2021 IEEE International Workshop on Metrology for Agriculture and Forestry, MetroAgriFor 2021 - Proceedings, 2021, pp. 37–41. doi: 10.1109/MetroAgriFor52389.2021.9628437.
[12] T. T. Zin, “An Automatic Estimation of Dairy Cow Body Condition Score Using Analytic Geometric Image Features; An Automatic Estimation of Dairy Cow Body Condition Score Using Analytic Geometric Image Features,” 2018.
[13] K. K. Cevik, “Deep Learning Based Real-Time Body Condition Score Classification System,” IEEE Access, vol. 8, pp. 213950–213957, 2020, doi: 10.1109/ACCESS.2020.3040805.
[14] T. T. Z. Sosuke Imamura, Ikuo Kobayashi, and Yoichiro Horii, “Automatic Evaluation of Cow’s Body-Condition-Score Using 3D Camera,” in IEEE 6th Global Conference on Consumer Electronics (GCCE 2017), 2017.
[15] Z. Ren, F. Fang, N. Yan, and Y. Wu, “State of the Art in Defect Detection Based on Machine Vision,” International Journal of Precision Engineering and Manufacturing - Green Technology, vol. 9, no. 2. Korean Society for Precision Engineeing, pp. 661–691, Mar. 01, 2022. doi: 10.1007/s40684-021-00343-6.
[16] D. Shen, X. Jiang, and L. Teng, “A novel Gauss-Laplace operator based on multi-scale convolution for dance motion image enhancement,” ICST Transactions on Scalable Information Systems, p. 172439, Jul. 2018, doi: 10.4108/eai.17-12-2021.172439.
[17] Y. Qi et al., “A Comprehensive Overview of Image Enhancement Techniques,” Archives of Computational Methods in Engineering, vol. 29, no. 1. Springer Science and Business Media B.V., pp. 583–607, Jan. 01, 2022. doi: 10.1007/s11831-021-09587-6.
[18] J. Zhou, T. Yang, W. Chu, and W. Zhang, “Underwater image restoration via backscatter pixel prior and color compensation,” Eng Appl Artif Intell, vol. 111, May 2022, doi: 10.1016/j.engappai.2022.104785.
[19] R. Xiao, P. Polaczyk, and B. Huang, “Measuring moisture damage of asphalt mixtures: The development of a new modified boiling test based on color image processing,” Measurement (Lond), vol. 190, Feb. 2022, doi: 10.1016/j.measurement.2022.110699.
[20] V. Bhavana and H. K. Krishnappa, “Multi-modal image fusion using contourlet and wavelet transforms: a multi-resolution approach,” Indonesian Journal of Electrical Engineering and Computer Science, vol. 28, no. 2, pp. 762–768, Nov. 2022, doi: 10.11591/ijeecs.v28.i2.pp762-768.
[21] X. Liu, P. An, Y. Chen, and X. Huang, “An improved lossless image compression algorithm based on Huffman coding,” Multimed Tools Appl, vol. 81, pp. 4781–4795, 2022, doi: 10.1007/s11042-021-11017-5#citeas.
[22] J. D. Trivedi, S. D. Mandalapu, and D. H. Dave, “Vision-based real-time vehicle detection and vehicle speed measurement using morphology and binary logical operation,” J Ind Inf Integr, vol. 27, May 2022, doi: 10.1016/j.jii.2021.100280.
[23] S. Kadry, V. Rajinikanth, D. Taniar, R. Damaševičius, and X. P. B. Valencia, “Automated segmentation of leukocyte from hematological images—a study using various CNN schemes,” Journal of Supercomputing, vol. 78, no. 5, pp. 6974–6994, Apr. 2022, doi: 10.1007/s11227-021-04125-4.
[24] R. Mondal, S. Malakar, E. H. Barney Smith, and R. Sarkar, “Handwritten English word recognition using a deep learning based object detection architecture,” Multimed Tools Appl, vol. 81, no. 1, pp. 975–1000, Jan. 2022, doi: 10.1007/s11042-021-11425-7.
[25] H. Li, Z. Zhou, C. Li, and C. Y. Suen, “A near effective and efficient model in recognition,” Pattern Recognit, vol. 122, Feb. 2022, doi: 10.1016/j.patcog.2021.108173.
[26] L. Jiao, S. Zhang, L. Li, F. Liu, and W. Ma, “A modified convolutional neural network for face sketch synthesis,” Pattern Recognit, vol. 76, pp. 125–136, Apr. 2018, doi: 10.1016/j.patcog.2017.10.025.
[27] Zukisa Nante and Wang Zenghui, “Face Recognition Using Principal Component Analysis, K Means Clustering and,” International Journal of Electrical and Computer Engineering, vol. 16, no. 7, pp. 100–106, 2022.
[28] Y. Cui, Q. Liao, D. Hu, W. An, and L. Liu, “Coarse-to-fine pseudo supervision guided meta-task optimization for few-shot object classification,” Pattern Recognit, vol. 122, Feb. 2022, doi: 10.1016/j.patcog.2021.108296.
[29] T. Dai, Y. Feng, B. Chen, J. Lu, and S. T. Xia, “Deep image prior based defense against adversarial examples,” Pattern Recognit, vol. 122, Feb. 2022, doi: 10.1016/j.patcog.2021.108249.
[30] C. Fu, G. Wang, X. Wu, Q. Zhang, and R. He, “Deep momentum uncertainty hashing,” Pattern Recognit, vol. 122, Feb. 2022, doi: 10.1016/j.patcog.2021.108264.
[31] H. Alatrista-Salas, J. Milagros, A. Lopez, E. Leuman, F. Navarro, and M. Nunez-Del-Prado, “Phenotypic Evaluation of Brown Swiss Dairy Cattle Using Images Processing,” 2020.
[32] Y. R. Pandeya, B. Bhattarai, and J. Lee, “Visual object detector for cow sound event detection,” IEEE Access, vol. 8, pp. 162625–162633, 2020, doi: 10.1109/ACCESS.2020.3022058.
[33] D. Jarchi, J. Kaler, and S. Sanei, “Lameness Detection in Cows Using Hierarchical Deep Learning and Synchrosqueezed Wavelet Transform,” IEEE Sens J, vol. 21, no. 7, pp. 9349–9358, Apr. 2021, doi: 10.1109/JSEN.2021.3054718.
[34] A. Biglari and W. Tang, “A Vision-Based Cattle Recognition System using Tensor-Flow for Livestock Water Intake Monitoring,” IEEE Sens Lett, Nov. 2022, doi: 10.1109/LSENS.2022.3215699.
[35] S. Miao et al., “Balanced single-shot object detection using cross-context attention-guided network,” Pattern Recognit, vol. 122, Feb. 2022, doi: 10.1016/j.patcog.2021.108258.
[36] Y. Feng et al., “SocialCattle: IoT-Based Mastitis Detection and Control Through Social Cattle Behavior Sensing in Smart Farms,” IEEE Internet Things J, vol. 9, no. 12, pp. 10130–10138, Jun. 2022, doi: 10.1109/JIOT.2021.3122341.
[37] S. Ma et al., “Development of Noncontact Body Temperature Monitoring and Prediction System for Livestock Cattle,” IEEE Sens J, vol. 21, no. 7, pp. 9367–9376, Apr. 2021, doi: 10.1109/JSEN.2021.3056112.
[38] T. Li, B. Jiang, D. Wu, X. Yin, and H. Song, “Tracking multiple target cows’ ruminant mouth areas using optical flow and inter-frame difference methods,” IEEE Access, vol. 7, pp. 185520–185531, 2019, doi: 10.1109/ACCESS.2019.2961515.
[39] C. Prabowo et al., “The Implementation of IoT (Internet of Things) for Controlling Cow Health,” in IOP Conference Series: Materials Science and Engineering, May 2020, vol. 846, no. 1. doi: 10.1088/1757-899X/846/1/012011.
[40] M. A. Jaddoa, L. Gonzalez, H. Cuthbertson, and A. Al-Jumaily, “Multiview Eye Localisation to Measure Cattle Body Temperature Based on Automated Thermal Image Processing and Computer Vision,” Infrared Phys Technol, vol. 119, Dec. 2021, doi: 10.1016/j.infrared.2021.103932.
[41] Y. Uyeno, S. Shigemori, and T. Shimosato, “Effect of probiotics/prebiotics on cattle health and productivity,” Microbes Environ, vol. 30, no. 2, pp. 126–132, Jun. 2015, doi: 10.1264/jsme2.ME14176.
[42] A. Giri, V. K. Bharti, S. Kalia, A. Arora, S. S. Balaje, and O. P. Chaurasia, “A review on water quality and dairy cattle health: a special emphasis on high-altitude region,” Appl Water Sci, vol. 10, no. 3, Mar. 2020, doi: 10.1007/s13201-020-1160-0.
[43] Y. Qiao et al., “Intelligent perception-based cattle lameness detection and behaviour recognition: A review,” Animals, vol. 11, no. 11. MDPI, Nov. 01, 2021. doi: 10.3390/ani11113033.
[44] D. P. Campos et al., “Single-Channel sEMG Dictionary Learning Classification of Ingestive Behavior on Cows,” IEEE Sens J, vol. 20, no. 13, pp. 7199–7207, Jul. 2020, doi: 10.1109/JSEN.2020.2977768.
[45] A. Ruchay, K. Dorofeev, V. Kalschikov, V. Kolpakov, K. Dzhulamanov, and H. Guo, “Live weight prediction of cattle using deep image regression,” in 2021 IEEE International Workshop on Metrology for Agriculture and Forestry, MetroAgriFor 2021 - Proceedings, 2021, pp. 32–36. doi: 10.1109/MetroAgriFor52389.2021.9628547.
[46] C. Li et al., “Data Augmentation for Inertial Sensor Data in CNNs for Cattle Behavior Classification,” IEEE Sens Lett, vol. 5, no. 11, Nov. 2021, doi: 10.1109/LSENS.2021.3119056.
[47] W. Zhang, K. Yang, N. Yu, T. Cheng, and J. Liu, “Daily milk yield prediction of dairy cows based on the GA-LSTM algorithm,” in International Conference on Signal Processing Proceedings, ICSP, Dec. 2020, vol. 2020-December, pp. 664–668. doi: 10.1109/ICSP48669.2020.9320926.
[48] R. W. Bello, A. S. A. Mohamed, and A. Z. Talib, “Contour Extraction of Individual Cattle from an Image Using Enhanced Mask R-CNN Instance Segmentation Method,” IEEE Access, vol. 9, pp. 56984–57000, 2021, doi: 10.1109/ACCESS.2021.3072636.
[49] M. S. Mahmud, A. Zahid, A. K. Das, M. Muzammil, and M. U. Khan, “A systematic literature review on deep learning applications for precision cattle farming,” Computers and Electronics in Agriculture, vol. 187. Elsevier B.V., Aug. 01, 2021. doi: 10.1016/j.compag.2021.106313.
[50] Xiaoping Huang, “Cow tail detection method for body condition score using Faster R-CNN,” in IEEE International Conference on Unmanned Systems and Artificial Intelligence (ICUSAI)., 2019.
[51] Z. H. Pradana, B. Hidayat, and S. Darana, “Beef cattle weight determine by using digital image processing,” in ICCEREC 2016 - International Conference on Control, Electronics, Renewable Energy, and Communications 2016, Conference Proceedings, Jan. 2017, pp. 179–184. doi: 10.1109/ICCEREC.2016.7814955.
[52] K. K. Cevik, “Deep Learning Based Real-Time Body Condition Score Classification System,” IEEE Access, vol. 8, pp. 213950–213957, 2020, doi: 10.1109/ACCESS.2020.3040805.
[53] J. D. Ferguson, D. T. Galligan, and N. Thomsen, “Principal Descriptors of Body Condition Score in Holstein Cows,” J Dairy Sci, vol. 77, no. 9, pp. 2695–2703, 1994, doi: 10.3168/jds.S0022-0302(94)77212-X.
[54] Y. Qiao et al., “Intelligent perception for cattle monitoring: A review for cattle identification, body condition score evaluation, and weight estimation,” Computers and Electronics in Agriculture, vol. 185. Elsevier B.V., Jun. 01, 2021. doi: 10.1016/j.compag.2021.106143.
[55] G. Summerfield, H. Myburgh, A. de Freitas, G. I. Summerfield, and H. C. Myburgh, “A Review of Automated Cow Body Condition Scoring Approaches Using 3D Feature Extraction Improving hearing care access View project Hopfield MLSE equalizer View project A Review of Automated Cow Body Condition Scoring Approaches Using 3d Feature Extraction,” 2021, [Online]. Available: https://www.researchgate.net/publication/356716736
[56] T. KOJIMA et al., “Estimation of beef cow body condition score: a machine learning approach using three-dimensional image data and a simple approach with heart girth measurements,” Livest Sci, vol. 256, p. 104816, Feb. 2022, doi: 10.1016/J.LIVSCI.2021.104816.
[57] Wen-Yong Li, Yang Shen, Du-Jin Wang, Zhan-Kui Yang, and Xin-Ting Yang, “Automatic dairy cow body condition scoringusing depth images and 3D surface fitting,” in International Conference on Unmanned System and Artificial Intelligence (ICUSAI), 2019.
[58] C. Silva, D. Welfer, F. P. Gioda, and C. Dornelles, “Cattle brand recognition using convolutional neural network and support vector machines,” IEEE Latin America Transactions, vol. 15, no. 2, pp. 310–316, Feb. 2017, doi: 10.1109/TLA.2017.7854627.
[59] Xinru Li, “Cow Body Condition Score Estimation with Convolutional Neural Networks,” in IEEE 4th International Conference on Image, Vision and Computing, 2019.
[60] A. Du, H. Guo, J. Lu, Y. Su, A. Ruchay, and A. Pezzuolo, “Automatic heart girth measurement for cattle based on deep learning,” in 2021 IEEE International Workshop on Metrology for Agriculture and Forestry, MetroAgriFor 2021 - Proceedings, 2021, pp. 27–31. doi: 10.1109/MetroAgriFor52389.2021.9628696.
[61] M. H. Na, W. H. Cho, S. K. Kim, and I. S. Na, “Automatic Weight Prediction System for Korean Cattle Using Bayesian Ridge Algorithm on RGB-D Image,” Electronics (Switzerland), vol. 11, no. 10, May 2022, doi: 10.3390/electronics11101663.
[62] M. Nahangi, T. Czerniawski, C. T. Haas, and S. Walbridge, “Pipe radius estimation using Kinect range cameras,” Autom Constr, vol. 99, pp. 197–205, Mar. 2019, doi: 10.1016/J.AUTCON.2018.12.015.
[63] A. Ghosh and S. Barman, “Application of Euclidean distance measurement and principal component analysis for gene identification,” Gene, vol. 583, no. 2, pp. 112–120, Jun. 2016, doi: 10.1016/j.gene.2016.02.015.
[64] B. Ai and Q. Li, “SOLOv2-based multi-view contactless bovine body size measurement,” in Journal of Physics: Conference Series, 2022, vol. 2294, no. 1. doi: 10.1088/1742-6596/2294/1/012011.
[65] L. Anifah and Haryanto, “Decision Support System Cattle Weight Prediction using Artificial Selected Weighting Method,” in Proceeding - 2020 3rd International Conference on Vocational Education and Electrical Engineering: Strengthening the framework of Society 5.0 through Innovations in Education, Electrical, Engineering and Informatics Engineering, ICVEE 2020, Oct. 2020. doi: 10.1109/ICVEE50212.2020.9243263.
[66] Y. Kawagoe, T. T. Zin, and I. Kobayashi, “Individual Identification of Cow Using Image Processing Techniques,” in LifeTech 2022 - 2022 IEEE 4th Global Conference on Life Sciences and Technologies, 2022, pp. 570–571. doi: 10.1109/LifeTech53646.2022.9754899.
[67] B. Xu et al., “CattleFaceNet: A cattle face identification approach based on RetinaFace and ArcFace loss,” Comput Electron Agric, vol. 193, Feb. 2022, doi: 10.1016/j.compag.2021.106675.
[68] A. Pretto, G. Savio, F. Gottardo, F. Uccheddu, and G. Concheri, “A novel low-cost visual ear tag based identification system for precision beef cattle livestock farming,” Information Processing in Agriculture, Oct. 2022, doi: 10.1016/j.inpa.2022.10.003.
[69] A. Pretto, G. Savio, F. Gottardo, F. Uccheddu, and G. Concheri, “A novel low-cost visual ear tag based identification system for precision beef cattle livestock farming,” Information Processing in Agriculture, Oct. 2022, doi: 10.1016/j.inpa.2022.10.003.
[70] M. Ivašić-Kos, M. Krišto, and M. Pobar, “Human detection in thermal imaging using YOLO,” in ACM International Conference Proceeding Series, 2019, vol. Part F148262, pp. 20–24. doi: 10.1145/3323933.3324076.
[71] J. Deng, J. Guo, N. Xue, and S. Zafeiriou, “ArcFace: Additive Angular Margin Loss for Deep Face Recognition,” 2018, [Online]. Available: https://github.com/
[72] J. Deng, J. Guo, E. Ververas, I. Kotsia, and S. Zafeiriou, “RetinaFace: Single-shot Multi-level Face Localisation in the Wild,” 2020.
[73] Zheng Qin, Zhaoning Zhang, Xiaotao Chen, Changjian Wang, and Yuxing Peng, “FD-MOBILENET: IMPROVED MOBILENET WITH A FAST DOWNSAMPLING STRATEGY,” IEEE EXPLORER, 2018.
[74] M. Elkhayati, Y. Elkettani, and M. Mourchid, “Segmentation of Handwritten Arabic Graphemes Using a Directed Convolutional Neural Network and Mathematical Morphology Operations,” Pattern Recognit, vol. 122, Feb. 2022, doi: 10.1016/j.patcog.2021.108288.
[75] G. Summerfield, H. Myburgh, A. de Freitas, G. I. Summerfield, and H. C. Myburgh, “A Review of Automated Cow Body Condition Scoring Approaches Using 3D Feature Extraction Improving hearing care access View project Hopfield MLSE equalizer View project A Review of Automated Cow Body Condition Scoring Approaches Using 3d Feature Extraction.” [Online]. Available: https://www.researchgate.net/publication/356716736
[76] R. Garcia, J. Aguilar, M. Toro, and M. Jimenez, “Weight-Identification Model of Cattle Using Machine-Learning Techniques for Anomaly Detection,” in 2021 IEEE Symposium Series on Computational Intelligence, SSCI 2021 - Proceedings, 2021. doi: 10.1109/SSCI50451.2021.9659840.
[77] F. Tian, J. Wang, B. Xiong, L. Jiang, Z. Song, and F. Li, “Real-Time Behavioral Recognition in Dairy Cows Based on Geomagnetism and Acceleration Information,” IEEE Access, vol. 9, pp. 109497–109509, 2021, doi: 10.1109/ACCESS.2021.3099212.
[78] F. Bousefsaf, A. Pruski, and C. Maaoui, “3D convolutional neural networks for remote pulse rate measurement and mapping from facial video,” Applied Sciences (Switzerland), vol. 9, no. 20, Oct. 2019, doi: 10.3390/app9204364.
[79] S. Hizlisoy, S. Yildirim, and Z. Tufekci, “Music emotion recognition using convolutional long short term memory deep neural networks,” Engineering Science and Technology, an International Journal, vol. 24, no. 3, pp. 760–767, Jun. 2021, doi: 10.1016/j.jestch.2020.10.009.
[80] Y. Qiao, Y. Guo, K. Yu, and D. He, “C3D-ConvLSTM based cow behaviour classification using video data for precision livestock farming,” Comput Electron Agric, vol. 193, Feb. 2022, doi: 10.1016/j.compag.2021.106650.