This content is not included in your SAE MOBILUS subscription, or you are not logged in.
Intelligent Real Time Inspection of Rivet Quality Supported by Human-Robot-Collaboration
ISSN: 0148-7191, e-ISSN: 2688-3627
Published September 16, 2019 by SAE International in United States
This content contains downloadable datasetsAnnotation ability available
Event: AeroTech Europe
Aircraft production is facing various technical challenges, such as large product dimensions, complex joining processes and the organization of assembly tasks. Meeting the requirements that come with large dimensions, low tolerances and small batch sizes, in combination with complex joining processes, automation and labor-intensive inspection task, is often difficult to achieve in an economically viable way.
ZeMA believes that a semi-automated approach is the most effective for optimizing aircraft section assembly. An effective optimization of aircraft production can be achieved with a semi-automated riveting process for solid rivets using Human-Robot-Collaboration in combination with an intuitive Human-Machine-Interaction operating concept.
While using dynamic task sharing between human and robot based on their skills, and considering ergonomics, the determined ideal solution involves placing a robot inside the section barrel. The robot’s workspace is expanded by mounting it on top of a lifting unit so that it can properly position the anvil. In the meantime, the human performs the more complex tasks of inserting the solid rivets and operating the riveting hammer from the outside of the section barrel.
By implementing a modular control system for configuration and operation of the assembly station with a variety of interaction possibilities, human and robot can perform the collaborative riveting process effectively. Additionally, due to high forces and vibrations, which are applied by the riveting hammer, a process specific tool has been developed to prevent damage to the robot system. By equipping the tool with sensors, such as a force torque and laser line sensor, it can not only monitor the riveting process in real time, but also perform inspection tasks using artificial intelligence algorithm. The sensor data will be passed through a trained machine learning model classifying whether the scanned part is of good or bad quality. With a limited amount of data, the “online” rivet classification using sensor data reaches a classification precision of 86%, whereas the rivet classification based on pictures reaches a precision of 97%. The result of the quality inspection will be sent to the employee using Mixed Reality glasses. This will allow the operator to react appropriately and carry out necessary maintenance.
The results are part of the project "Modularity, Safety, Usability, Efficiency by Human-Robot-Collaboration - FourByThree" (no 637095), funded by European Union's Horizon 2020 research and innovation program at ZeMA and will present semi-automation shown in the HRC riveting process. Furthermore the research is funded by the Interreg V A Großregion within Robotix-Academy project (no 002-4-09-001). The rivet quality inspection using artificial intelligence has been supported by PIKON Deutschland AG.
CitationMueller, R., Vette, M., Masiak, T., Duppe, B. et al., "Intelligent Real Time Inspection of Rivet Quality Supported by Human-Robot-Collaboration," SAE Technical Paper 2019-01-1886, 2019, https://doi.org/10.4271/2019-01-1886.
Data Sets - Support Documents
|[Unnamed Dataset 1]|
- AIRBUS , “Installation of Solid Aluminum Rivets,” Process Specification, 80-T-34-5814, Augsburg, 2008.
- Reithmaier, L. and Sterkenburg, R. , Standard Aircraft Handbook for Mechanics and Technicians, Seventh Edition (McGraw-Hill Education, 2013), 978-0-07-182679.
- Yin, S. et al. , “Data-Based Techniques Focused on Modern Industry: An Overview,” IEEE Transactions on Industrial Electronics 62(1):657-667, 2015.
- Russell, S.J. and Norvig, P. , Artificial Intelligence: A Modern Approach (Malaysia: Pearson Education Limited, 2016).
- Müller, R., Vette, M., Geenen, A., and Masiak, T. , “Improving Working Conditions in Aircraft Productions using Human-Robot-Collaboration in a Collaborative Riveting Process,” SAE Technical Paper 2017-01-2096, 2017, doi:10.4271/2017-01-2096.
- AIRBUS , S.A.S., Toulouse, www.airbus.com.
- Premium Aerotec GmbH , Augsburg, www.premium-aerotec.com.
- Krizhevsky, A., Sutskever, I., and Hinton, G.E. , “Imagenet Classification with Deep Convolutional Neural Networks,” Advances in Neural Information Processing Systems 1097-1105, 2012.
- Deng, J., Dong, W., Socher, R., Li, L.-J. et al. , “Imagenet: A Large-Scale Hierarchical Image Database,” Proc. CVPR, 2009.
- LeCun, Y., Haffner, P., Bottou, L., and Bengio, Y. , “Object Recognition with Gradient-Based Learning,” Shape, Contour and Grouping in Computer Vision, (Berlin, Heidelberg: Springer, 1999), 319-345.
- Friedman, J. , “Greedy Function Approximation: A Gradientboosting Machine,” Annals of Statistics 29(5):1189-1232, 2001.
- Hwang, R.C. et al. , “An Intelligent Quality Inspection Sytem for the Riveting Process,” International Journal of Engineering Innovations and Research 3.1 12, 2014.
- Zhang, Z., Jiang, J., Liu, X., Lau, R., Wang, H., and Zhang, R. , “A Real Time Hybrid Pattern Matching Scheme for Stock Time Series,” in Proceedings of the Twenty-First Australasian Conference on Database Technologies - Volume 104, ADC.
- Chen, T. and Guestrin, C. , “Xgboost: A Scalable Tree Boosting System,” in Proceedings of the 22nd acm Sigkdd International Conference on Knowledge Discovery and Data Mining, ACM, 2016.
- Shengliangpu, Use Evolutionary Algorithms Instead of Gridsearch in Scikit-Learn, https://github.com/shengliangpu/sklearn-deap, 2018.