This content is not included in
your SAE MOBILUS subscription, or you are not logged in.
Modeling and Learning of Object Placing Tasks from Human Demonstrations in Smart Manufacturing
Technical Paper
2019-01-0700
ISSN: 0148-7191, e-ISSN: 2688-3627
Annotation ability available
Sector:
Language:
English
Abstract
In this paper, we present a framework for the robot to learn how to place objects to a workpiece by learning from humans in smart manufacturing. In the proposed framework, the rational scene dictionary (RSD) corresponding to the keyframes of task (KFT) are used to identify the general object-action-location relationships. The Generalized Voronoi Diagrams (GVD) based contour is used to determine the relative position and orientation between the object and the corresponding workpiece at the final state. In the learning phase, we keep tracking the image segments in the human demonstration. For the moment when a spatial relation of some segments are changed in a discontinuous way, the state changes are recorded by the RSD. KFT is abstracted after traversing and searching in RSD, while the relative position and orientation of the object and the corresponding mount are presented by GVD-based contours for the keyframes. When the object or the relative position and orientation between the object and the workpiece are changed, the GVD, as well as the shape of contours extracted from the GVD, are also different. The Fourier Descriptor (FD) is applied to describe these differences on the shape of contours in the GVD. The proposed framework is validated through experimental results.
Recommended Content
Technical Paper | Development of Hermes IMI High Temperature Flexible Insulation |
Technical Paper | Digital Laser Vision in the Aerospace Industry |
Journal Article | Requirement Analysis and Development using MATLAB Models |
Authors
Citation
Chen, Y., Wang, W., Zhang, Z., Krovi, V. et al., "Modeling and Learning of Object Placing Tasks from Human Demonstrations in Smart Manufacturing," SAE Technical Paper 2019-01-0700, 2019, https://doi.org/10.4271/2019-01-0700.Also In
References
- Ferreira , M. , Costa , P. , Rocha , L. , and Moreira , A.P. Stereo-Based Real-Time 6-DoF Work Tool Tracking for Robot Programing by Demonstration Int. J. Adv. Manuf. Technol. 85 1-4 57 69 2016
- Argall , B.D. , Chernova , S. , Veloso , M. , and Browning , B. A Survey of Robot Learning from Demonstration Rob. Auton. Syst. 57 5 469 483 2009
- Wang , W. , Li , R. , Diekel , Z.M. , Chen , Y. et al. Controlling Object Hand-Over in Human-Robot Collaboration Via Natural Wearable Sensing IEEE Trans. Human-Machine Syst. 2018
- Chen , Y. et al. A Smart Companion Robot for Heavy Payload Transport and Manipulation in Automotive Assembly IEEE Robot. Autom. Mag. 2018
- Jiang , L. , Wang , W. , Chen , Y. , and Jia , Y. Personalize Vision-Based Human Following for Mobile Robots by Learning from Human-Driven Demonstrations 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN) 2018 726 731
- Wang , W. , Li , R. , Diekel , Z.M. , and Jia , Y. Robot Action Planning by Online Optimization in Human-Robot Collaborative Tasks Int. J. Intell. Robot. Appl. 2 2 161 179 2018
- Wang , W. , Li , R. , Chen , Y. , Diekel , Z.M. , and Jia , Y. Facilitating Human-Robot Collaborative Tasks by Teaching-Learning-Collaboration from Human Demonstrations IEEE Trans. Autom. Sci. Eng. 99 1 14 2018
- Forbes , M. , Rao , R.P.N. , Zettlemoyer , L. , and Cakmak , M. Robot Programming by Demonstration with Situated Spatial Language understanding 2015 IEEE Int. Conf. Robot. Autom 2015 2014 2020
- Aksoy , E.E. , Abramov , A. , Dörr , J. , Ning , K. et al. Learning the Semantics of Object - Action 30 10 1229 1249 2011
- Rozo , L. , Calinon , S. , Caldwell , D. , Jimenez , P. , Torras , C. , and Jiménez , P. Learning Collaborative Impedance-Based Robot Behaviors AAAI Conference on Artificial Intelligence 2013 1422 1428
- Rozo , L. , Jiménez , P. , and Torras , C. Force-Based Robot Learning of Pouring Skills Using Parametric Hidden Markov Models 9th Int. Work. Robot Motion Control. RoMoCo 2013 - Work. Proc 2013 227 232
- Huckaby , J. and Christensen , H. A Taxonomic Framework for Task Modeling and Knowledge Transfer in Manufacturing Robotics Work. Twenty-Sixth AAAI … 2012 94 101
- Goto , H. , Miura , J. , and Sugiyama , J. Human-Robot Collaborative Assembly by On-Line Human Action Recognition Based on an FSM Task Model Int. Conf. Human-Robot Interact. - Work. Collab. Manip 2013 1 6
- Wang , Y. , Xiong , R. , Shen , L. , Sun , K. , Zhang , J. , and Qi , L. Towards Learning from Demonstration System for Parts Assembly: A Graph Based Representation for Knowledge 4th Annu. IEEE Int. Conf. Cyber Technol. Autom. Control Intell. Syst. IEEE-CYBER 2014 2014 174 179
- On , T. , Avid , R. , and Vol , A. Motion Planning in a Plane Using Generalized oroncpi Diagrams 5 2 143 150 1989
- Haralick , R.M. , Sternberg , S.R. , and Zhuang , X. Image Analysis Using Mathematical Morphology IEEE Trans. Pattern Anal. Mach. Intell. 4 532 550 1987
- Salembier , P. and Serra , J.C. Morphological Multiscale Image Segmentation Visual Communications and Image Processing ’92 1992 1818 620 632
- Salembier , P. Morphological Multiscale Segmentation for Image Coding Signal Processing 38 3 359 386 1994
- Zhang , D. and Lu , G. A Comparison of Shape Retrieval Using Fourier Descriptors and Short-Time Fourier Descriptors 1 4
- Zahn , C.T. and Roskies , R.Z. Fourier Descriptors ror Plane Closed Curves c 3 1972
- Huttenlocher , D.P. , Klanderman , G.A. , and Rucklidge , W.J. Comparing Images Using the Hausdorff Distance 15 9 850 863 1993
- Barraquand , J. and Latombe , J.-C. Robot Motion Planning: A Distributed Representation Approach Int. J. Rob. Res. 10 6 628 649 1991