Towards Industry 4.0: Color-Based Object Sorting Using a Robot Arm and Real-Time Object Detection
Ong ZeChern
Department of Electrical and Robotics, School of Engineering, Monash University Malaysia, Subang Jaya, Selangor, Malaysia
DOI: https://doi.org/10.59429/ima.v1i1.125
Keywords: Industry 4.0, Color-based sorting, Robotic arm, Real-time object detection, Convolutional neural network (CNN), Internet of things (IoT).
Abstract
With the introduction of Industry 4.0, automation and robotics have made great strides, enabling enterprises to improve their manufacturing processes for increased productivity and efficiency. This project introduces a novel method for implementing Industry 4.0 concepts through color-based object sorting employing a robot arm with real-time object identification capabilities. Creating a reliable and effective system that can automatically categorize items based on their color properties is the main goal of this project. To enable seamless object recognition and manipulation in real time, the suggested system integrates robotic manipulation with computer vision algorithms. The system makes use of a convolutional neural network (CNN) for precise object detection, using recent advancements in deep learning and image processing, allowing the robot arm to interact with a variety of items effectively. The training phase and the sorting phase are the two key phases of the approach. The CNN model is trained on a sizable dataset of labeled objects during the training phase to recognize various colors and forms. In order for the robotic arm to recognize things as they go along the conveyor belt and sort them into predetermined bins according to their respective colors, the trained model must be integrated with the robotic arm during the sorting phase. Several experiments are carried out with various lighting setups and object arrangements to evaluate the performance of the suggested system. The outcomes show how well the system performs in terms of exact object detection and reliable sorting. The system's capacity to effectively handle a variety of objects and adapt to changing environmental conditions further emphasizes its suitability for use in actual industrial scenarios. This project has important ramifications for the manufacturing sector, enabling improved automation capabilities and cost-efficiency. An important step towards implementing Industry 4.0 principles is the seamless integration of color-based object sorting and real-time object detection using a robotic arm. This will allow industries to optimize their production processes, minimize human intervention, and increase overall productivity. Further developments in robotics and computer vision are anticipated to push the limits of automation and open the door for more advanced and intelligent industrial systems as technology develops.
References
T. Harris and C. Pollette, “How robots work,” HowStuffWorks Science, 11-Jan-2022. Available:
https://science.howstuffworks.com/robot2.htm#:~:text=The%20computer%20controls%20the%20robot,sa
me%20movement%20over%20and%20over.
2. The robot chefs that can cook your Christmas dinner, BBC News, 2022. [Online].
3. Top Industries Using Robots, #HowToRobot, 2022. Available: https://www.howtorobot.com/expertinsight/top-industries-using-robots.
4. S. Fu and P. C. Bhavsar, Robotic Arm Control Based on Internet of Things, 2019 IEEE Long Island Systems,
Applications and Technology Conference (LISAT), 2019, pp. 1-6, doi: 10.1109/LISAT.2019.8817333.
5. IOT based Robotic Arm Project using NodeMCU, Iotdesignpro.com, 2022. Available:
https://iotdesignpro.com/projects/iot-based-robotic-arm-using-esp8266.
6. Controlling Robotic Arms - IAA - Industrial Automation, IAA - Industrial Automation, 2022. Available:
https://www.iaasiaonline.com/controlling-robotic-arms-2/.
7. H. I. Lin and Y. H. Lin, A novel teaching system for industrial robots, Sensors (Basel), vol. 14, no. 4, pp.
6012-31, Mar 27 2014, doi: 10.3390/s140406012.
Industrial Management Advances (2023) Volume 1 Issue 1 14 / 14
8. Software Pendant, Yaskawa.eu.com, 2022. Available:
https://www.yaskawa.eu.com/products/software/productdetail/product/software-pendant_1673.
9. Y. Jan, S. Hassan, P. Sanghun, and Y. Jungwon, Smartphone Based Control Architecture of Teaching
Pendant for Industrial Manipulators, presented at the 2013 4th International Conference on Intelligent
Systems, Modelling and Simulation, 2013.
10. P. Sethi and S. R. Sarangi, Internet of Things: Architectures, Protocols, and Applications, Journal of
Electrical and Computer Engineering, vol. 2017, pp. 1-25, 2017, doi: 10.1155/2017/9324035.
11. X. -Q. Li, X. Ding, Y. Zhang, Z. -P. Sun and H. -W. Zhao, IoT Family Robot Based on Raspberry Pi, 2016
International Conference on Information System and Artificial Intelligence (ISAI), 2016, pp. 622-625, doi:
10.1109/ISAI.2016.0137.
12. R. K. Jain, B. J. Saikia, N. P. Rai and P. P. Ray, Development of Web-based Application for Mobile Robot
using IOT Platform, 2020 11th International Conference on Computing, Communication and Networking
Technologies (ICCCNT), 2020, pp. 1-6, doi: 10.1109/ICCCNT49239.2020.9225467.
13. I. Qadri, A. Muneer and S. Fati, Automatic robotic scanning and inspection mechanism for mines using
IoT., IOP Conference Series: Materials Science and Engineering, vol. 1045, no. 1, p. 012001, 2021.
14. Ge Creative. How To Make Robot Arm Nodemcu Esp8266 (Access Point) IOT Project, YouTube, Aug. 30,
2020 [Video file]. Available: https://youtu.be/r7712qCkngs
15. IoT Design. IoT based Robotic Arm using NodeMCU ESP8266, YouTube, Sep. 20, 2019 [Video file].
Available: https://youtu.be/ZG2Ek-Z5i1Q
16. How To Mechatronics. DIY Arduino Robot Arm with Smartphone Control, YouTube, Sep. 11, 2018 [Video
file]. Available: https://youtu.be/_B3gWd3A_SI
17. hash include electronics. Robot Arm using ESP32 and Smartphone | Complete Robot Arm assembly,
YouTube, Jan. 26, 202 [Video file]. Available: https://youtu.be/cVSvg6VQhGU
18. Getting Started with the ESP32 - Using the Arduino IDE, DroneBot Workshop, 2022. [Online]. Available:
https://dronebotworkshop.com/esp32-intro/.
19. Author links open overlay panelDavid G. Shatwell a b et al., Real-time ore sorting using color and texture
analysis, International Journal of Mining Science and Technology,
https://www.sciencedirect.com/science/article/pii/S2095268623000502
20. We make affordable robots for all.,https://store-ufactory-cc.myshopify.com/products/xarm-cameramodule-2020
21. J. Nelson, How to label images for Computer Vision Models, Roboflow Blog,
https://blog.roboflow.com/tips-for-how-to-label-images/
22. Tensorflow, Models/tf2_detection_zoo.MD at master · Tensorflow/models, GitHub,
https://github.com/tensorflow/models/blob/master/research/object_detection/g3doc/tf2_detection_zoo. md
23. T. H. Team, Try hivemq, MQTT Quality of Service (QoS) 0,1, & 2 – MQTT Essentials: Part 6.