O
Orclever
Back to Journal
Research Article Open AccessOrclever Native

EuroPallet Detection with RGB-D Camera Based on Deep Learning

Sedanur Kirci1✉,
Gokhan Atali2
1Kar Metal
2Sakarya University of Applied Sciences
Published:December 31, 2023
DOI: 10.56038/ejrnd.v3i4.341
Vol. 3, No. 4

Abstract

This study related to enhancing processes and production efficiency in industrial settings by opting for autonomous mobile robots dedicated to indoor transportation and logistics. The specific focus of this research is on employing deep learning for the detection of Euro pallet objects, enabling a mobile robot, specifically the Servant-T1500 model by Kar Metal company with natural navigation capabilities, to autonomously dock and handle palletized loads with precision.

To accomplish this, an original dataset was curated using an RGB-D camera, and data augmentation techniques were applied to expand this dataset. Subsequently, a deep learning model was trained on this data to detect Euro pallets in images it had not encountered during training. The transfer learning method was applied using the YOLOv5 model on the dataset. The successful outcome of this process demonstrates the autonomous robot's capability to accurately recognize Euro pallet objects even under changing lighting conditions. This achievement marks a significant step toward optimizing industrial processes and improving production efficiency through the integration of autonomous mobile robots in logistics and transportation tasks.

Keywords
Pallet DetectionDeep LearningIndustrial ApplicationAutonomous Mobile Robot

References

  1. 1.Czimmermann, T., Ciuti, G., Milazzo, M., Chiurazzi, M., Roccella, S., Oddo, C. M., & Dario, P. (2020, 3 6). Visual-Based Defect Detection and Classification Approaches for Industrial Applications—A SURVEY. Sensors.
  2. 2.Deng, H., Cheng, Y., Feng, Y., & Xiang, J. (2021, 09 18). Industrial Laser Welding Defect Detection and Image Defect Recognition Based on Deep Learning Model Developed. Symmetry.
  3. 3.Shahmoradi, J., Talebi, E., Roghanchi, P., & Hassanalian, M. (2020, 07 15). A Comprehensive Review of Applications of Drone Technology in the Mining Industry. Drones.
  4. 4.Bach, S.-H., Khoi, P.-B., & Yi, S.-Y. (2023). Application of QR Code for Localization and Navigation of Indoor Mobile Robot. IEEE, (s. 28354-28390).
  5. 5.Guo, S., Fang, T.-T., Song, T., Xi, F.-F., & Wei, B.-G. (2018, 02 28). Tracking and localization for omni-directional mobile industrial robot using reflectors. Adv. Manuf.
  6. 6.Bosnak, M., & Skrjanc, I. (2021). Obstacle Avoidance for Line-Following AGV with Local Maps. International Symposium on Applied Computational Intelligence and Informatic SACI 2021, (s. 193-198). Timişoara.
  7. 7.Jia, F., Tao, Z., & Wang, F. (2021). Pallet Detection Based on Halcon and Alex:Net Network for Autonomous Forklifts. International Conference on Internet, Education and Information Technology, (s. 86-89).
  8. 8.Kurnianto, H., & Rusmin, P. H. (2022). Task Allocation and Path Planning Method For Multi-Autonomous Forklift Navigation. International Seminar on Research of Information Technology and Intelligent Systems (ISRITI), (s. 631-636).
  9. 9.Manurung, P., Rusmin, P. H., & Yusuf, R. (2022). Custom Pallet Detection Using YOLOv5 Deep Learning Architecture. International Symposium on Electronics and Smart Devices (ISESD).
  10. 10.Rahman, M., Kanchi, M., Pasha, M., & Yadla, B. (2021). Design and Development of Autonomous Warehouse Management Robot with Intelligent Software Framework. International Conference on Mobile Networks and Wireless Communications.
  11. 11.Syu, J.-L., Li, H.-T., Chiang, J.-S., Hsia, C.-H., Wu, P.-H., Hsieh, C.-F., & Li, S.-A. (2016, 11 2). A computer vision assisted system for autonomous forklift vehicles in real factory environment. Multimated Tools Appl.
  12. 12.Li, T., Huang, B., & Huang, M. (2018). Application of convolution neural network object detection algorithm in logistics warehouse. International Symposium on Test Automation and Instrumentation. The Journal of Engineering.
  13. 13.Shao, Y., Fan, Z., Zhu, B., Zhou, M., Chen, Z., & Lu, J. (2022, 11 9). A Novel Pallet Detection Method for Automated Guided Vehicles Based on Point Cloud Data. sensors.
  14. 14.Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You Only Look Once: Unified, Real-Time Object Detection. Conference on Computer Vision and Pattern Recognition (CVPR). Las Vegas, NV, USA.
  15. 15.Ultralytics. (2021). YOLOv5: A state-of-the-art real-time object detection system. https://docs.ultralytics.com.Link
Download PDF
Cite This Article
Kirci, S., Atali, G. (2023). EuroPallet Detection with RGB-D Camera Based on Deep Learning. *The European Journal of Research and Development*, 3(4), 55-65. https://doi.org/10.56038/ejrnd.v3i4.341

Bibliographic Info

JournalThe European Journal of Research and Development
Volume3
Issue4
Pages55–65
PublishedDecember 31, 2023
eISSN2822-2296