A Manual Assembly Virtual Training System with Automatically Generated Augmented Feedback: Using the Comparison of Digitized Operator’s Skill
Author
Singhaphandu R., Pannakkong W., Huynh V., Boonkwan P.
Affiliations
School of Knowledge Science, Japan Advanced Institute of Science and Technology, Ishikawa, Japan; School of Manufacturing Systems and Mechanical Engineering, Sirindhorn International Institute of Technology, Thammasat University, Pathum Thani, Thailand; National Electronics and Computer Technology Center, Pathum Thani, Thailand
Source Title
IEEE Access
ISSN
21693536
Year
2024
Page
1
Open Access
All Open Access, Gold
Publisher
Institute of Electrical and Electronics Engineers Inc.
DOI
10.1109/ACCESS.2024.3436910
Abstract
In general, an experienced operator or expert must deliver face-to-face industrial manual assembly (I-MA) training. There is a limited number and availability of expert trainers, making training less accessible to trainees. Industrial virtual training systems (I-VTS) from research communities and commercial systems are focused on providing task demonstrations with rich multimedia immersive content. These systems can significantly lessen the reliance on the expert, but they still require an expert to observe and provide feedback. This study presents the "EXpert Independent Manual AsseMbly Virtual Trainer" (EXAMINER), addressing these limitations by integrating vision-based digitization of I-MA skills, comparison of digitized operators, and providing augmented feedback assessing the training outcomes automatically. This approach enhances trainee access to training without expert dependency. The study discusses the rationale and implementation process for the EXAMINER framework and a simulated case study evaluating the EXAMINER framework’s ability to digitize and provide appropriate extrinsic augmented terminal feedback based on participant performance, marking a significant advancement in industrial training technology. Authors
