Towards augmented reality manuals for industry 4.0: A methodology

Published on Apr 1, 2019in Robotics and Computer-integrated Manufacturing4.392
· DOI :10.1016/j.rcim.2018.10.001
Michele Gattullo8
Estimated H-index: 8
(IPN: Instituto Politécnico Nacional),
Giulia Wally Scurati3
Estimated H-index: 3
(Polytechnic University of Milan)
+ 3 AuthorsMonica Bordegoni18
Estimated H-index: 18
(Polytechnic University of Milan)
Abstract Augmented Reality (AR), is one of the most promising technology for technical manuals in the context of Industry 4.0. However, the implementation of AR documentation in industry is still challenging because specific standards and guidelines are missing. In this work, we propose a novel methodology for the conversion of existing “traditional” documentation, and for the authoring of new manuals in AR in compliance to Industry 4.0 principles. The methodology is based on the optimization of text usage with the ASD Simplified Technical English, the conversion of text instructions into 2D graphic symbols, and the structuring of the content through the combination of Darwin Information Typing Architecture (DITA) and Information Mapping (IM). We tested the proposed approach with a case study of a maintenance manual of hydraulic breakers. We validated it with a user test collecting subjective feedbacks of 22 users. The results of this experiment confirm that the manual obtained using our methodology is clearer than other templates.
  • References (37)
  • Citations (10)
📖 Papers frequently viewed together
10 Citations
3 Authors (Tsutomu Yamada, ..., H. Yajima)
3 Citations
1 Author (Sebastjan Meža)
78% of Scinapse members use related papers. After signing in, all features are FREE.
#1Margherita Peruzzini (University of Modena and Reggio Emilia)H-Index: 11
#2Marcello Pellicciari (University of Modena and Reggio Emilia)H-Index: 14
Last. Michele Gadaleta (University of Modena and Reggio Emilia)H-Index: 4
view all 3 authors...
Abstract Manufacturing ergonomics refers to the application of ergonomic principles and human factors analysis to the design of manufacturing tasks with the final aim to optimize the workers’ wellbeing and guarantee the expected process performance. Traditional design approaches are based on the observation of individual workers performing their jobs, the detection of unnatural postures (e.g., bending, twisting, overextending, rotating), and the definition of late corrective actions according to...
5 CitationsSource
#1Giulia Wally Scurati (Polytechnic University of Milan)H-Index: 3
#2Michele Gattullo (IPN: Instituto Politécnico Nacional)H-Index: 8
Last. Antonio Emmanuele Uva (IPN: Instituto Politécnico Nacional)H-Index: 14
view all 6 authors...
Abstract The evolution of technical documentation in the age of Industry 4.0 is going towards the use of visual manuals, in particular exploiting Augmented Reality (AR) technology. Traditional manuals are rich of text instructions that in AR applications are not advisable. In fact text occludes the real scene behind and it is an issue for the translation. For this reason, we propose to create and adopt a controlled and exhaustive vocabulary of graphical symbols, to be used in AR to represent mai...
14 CitationsSource
#1Elias Matsas (NTUA: National Technical University of Athens)H-Index: 5
#2George-Christopher Vosniakos (NTUA: National Technical University of Athens)H-Index: 17
Last. Dimitris BatrasH-Index: 1
view all 3 authors...
Abstract Human-Robot Interaction (HRI) has emerged in recent years as a need for common collaborative execution of manufacturing tasks. This work examines two types of techniques of safe collaboration that do not interrupt the flow of collaboration as far as possible, namely proactive and adaptive. The former are materialised using audio and visual cognitive aids, which the user receives as dynamic stimuli in real time during collaboration, and are aimed at information enrichment of the latter. ...
20 CitationsSource
#1Riccardo Palmarini (Cranfield University)H-Index: 2
#2John Ahmet Erkoyuncu (Cranfield University)H-Index: 12
Last. Hosein TorabmostaediH-Index: 1
view all 4 authors...
Abstract Augmented Reality (AR) technologies for supporting maintenance operations have been an academic research topic for around 50 years now. In the last decade, major progresses have been made and the AR technology is getting closer to being implemented in industry. In this paper, the advantages and disadvantages of AR have been explored and quantified in terms of Key Performance Indicators (KPI) for industrial maintenance. Unfortunately, some technical issues still prevent AR from being sui...
62 CitationsSource
#1Iñigo Fernández del Amo (Cranfield University)H-Index: 2
#2John Ahmet Erkoyuncu (Cranfield University)H-Index: 12
Last. Stephen WildingH-Index: 2
view all 4 authors...
Abstract Augmented Reality (AR) visualization capabilities can impact on maintenance. From enhancing performance to retrieving feedback, AR can close the information loop between maintenance information systems and the operations supported. Though, the design of AR applications is not aligned with current information systems, which prevents maintenance information to be used and improved properly. In this paper, industrial collaboration contributed to determine a framework for AR integration in ...
7 CitationsSource
#1Henrik Eschen (TUHH: Hamburg University of Technology)H-Index: 1
#2Tobias Kötter (TUHH: Hamburg University of Technology)H-Index: 1
Last. Thorsten Schüppstuhl (TUHH: Hamburg University of Technology)H-Index: 1
view all 5 authors...
Abstract Maturity of augmented and virtual reality devices has considerably grown recently. As processes in the aviation industry are error prone and time consuming, efforts are made to implement these technologies to support human workers during inspection and maintenance. Nevertheless, varying process and device characteristics impede the selection of a suitable technology. A concept is presented to evaluate the potential of inspection and maintenance processes in the aviation industry regardi...
6 CitationsSource
Augmented reality (AR) is a key technology for the development of smart manufacturing. One of the main advantages of AR is that it can help workers to accomplish several tasks, making it possible the shift from mass production to mass customization. However, it is still not clear how these promises can be fulfilled in an industrial scenario. In particular, the question about which display solutions fit better the industrial constraints remains open. Based on the literature overview, laboratory e...
26 CitationsSource
#1John Ahmet Erkoyuncu (Cranfield University)H-Index: 12
#2Iñigo Fernández del Amo (Cranfield University)H-Index: 2
Last. Gino Dini (UniPi: University of Pisa)H-Index: 23
view all 5 authors...
Efficiency of industrial maintenance operation is significantly dependent on the skill and practice of the technicians involved. This paper demonstrates a novel approach to improve the maintenance efficiency through adaptive operational support using a context aware Augmented Reality (AR) technique that adapts with available data and the skill level of the technicians and without the need for prior working knowledge of AR. The AR system can be dynamically adapted by non-programmer maintenance te...
16 CitationsSource
#1Riccardo Masoni (Polytechnic University of Milan)H-Index: 1
#2Francesco Ferrise (Polytechnic University of Milan)H-Index: 12
Last. Michele Di Donato (Amec Foster Wheeler)H-Index: 3
view all 8 authors...
Abstract Due to the Industry 4.0 initiative, Augmented Reality (AR) has started to be considered one of the most interesting technologies companies should invest in, especially to improve their maintenance services. Several technological limitations have prevented AR to become an effective industrial tool in the past. Now some of them have been overcome, some others not yet by off-the-shelf technologies. In this paper, we present a solution for remote maintenance based on off-the-shelf mobile an...
22 CitationsSource
#1Xiangyu Wang (NUS: National University of Singapore)H-Index: 34
#2Soh-Khim Ong (NUS: National University of Singapore)H-Index: 35
Last. A. Y. C. Nee (NUS: National University of Singapore)H-Index: 14
view all 3 authors...
Assembly motion simulation is crucial during conceptual product design to identify potential assembly issues and enhance assembly efficiency. This paper presents a novel assembly simulation system incorporating real-virtual components interaction in an augmented-reality based environment. With this system, users can manipulate and assemble virtual components to real components during assembly simulation using natural gestures through an enhanced bare-hand interface. Accurate and realistic moveme...
23 CitationsSource
Cited By10
#1Fatima Gillani (LUMS: Lahore University of Management Sciences)
#2Kamran Ali Chatha (Abu Dhabi University)H-Index: 1
Last. Sami Farooq (AAU: Aalborg University)H-Index: 8
view all 4 authors...
Abstract The use of digital manufacturing technologies (DMTs) is changing the face of the manufacturing landscape and enhancing the competitiveness of firms. However, its implementation is still a relatively unexplored phenomenon and demands attention. The purpose of this study is to determine the role played by technological context, organizational context, and environmental context of firms in the implementation of the DMTs. A hypothesized model is proposed and tested using survey-based data f...
Abstract Augmented reality (AR) is a key technology anchored towards realizing Industry 4.0 smart manufacturing aims. In manufacturing inspection, AR has previously been employed to support operators in assessing thickness of manufactured parts, ship building, aircraft subassemblies and printed circuit board assemblies (PCBAs) with or without external markers in standalone head-mounted (HMD) or handheld systems. These AR systems often use optical see-through (OST) or video see-through (VST) tech...
#1Junhao Geng (NPU: Northwestern Polytechnical University)
#2Xinyu Song (NPU: Northwestern Polytechnical University)
Last. Yongsheng Ma (U of A: University of Alberta)H-Index: 20
view all 7 authors...
Abstract One of the barriers that prevent augmented reality (AR) from being widely adopted in diverse and complex industrial operations is the lack of adaptive and scalable AR work instruction (ARWI). This paper suggests a systematic method to solve the problem. The proposed method presents an adaptive representation structure that expresses and controls those interrelated aspects of ARWI adaptiveness: authoring, environment, guiding and process control. The proposed method also provides a detai...
#1Kyeong-Beom Park (Chonnam National University)H-Index: 1
#2Min-seok Kim (Chonnam National University)H-Index: 20
Last. Jae Yeol Lee (Chonnam National University)H-Index: 30
view all 4 authors...
Abstract Wearable augmented reality (AR) smart glasses have been utilized in various applications such as training, maintenance, and collaboration. However, most previous research on wearable AR technology did not effectively supported situation-aware task assistance because of AR marker-based static visualization and registration. In this study, a smart and user-centric task assistance method is proposed, which combines deep learning-based object detection and instance segmentation with wearabl...
1 CitationsSource
#1Katherine A.J. van Lopik (Lboro: Loughborough University)H-Index: 1
#2Murray A. Sinclair (Lboro: Loughborough University)H-Index: 15
Last. Andrew A. West (Lboro: Loughborough University)H-Index: 17
view all 5 authors...
Abstract Augmented reality (AR) has been proposed as a disruptive and enabling technology within the Industry 4.0 manufacturing paradigm. The complexity of the AR content creation process results in an inability for Small Enterprise (SE) to create bespoke, flexible AR training support “in-house” and is a potential barrier to industrial adoption of AR. Presently, AR content creation requires a range of specialist knowledge (e.g. 3D modelling, interface design, programming and spatial tracking) an...
#1Amit Kumar (University Institute of Engineering and Technology, Panjab University)
#2Archana Mantri (University Institute of Engineering and Technology, Panjab University)H-Index: 3
Last. Rubina Dutta (University Institute of Engineering and Technology, Panjab University)
view all 3 authors...
#1Ocident Bongomin (Moi University)H-Index: 1
#2Gilbert Gilibrays Ocen (Busitema University)
Last. Timothy Omara (Moi University)H-Index: 2
view all 5 authors...
The 21st century has witnessed precipitous changes spanning from the way of life to the technologies that emerged. We have entered a nascent paradigm shift (industry 4.0) where science fictions have become science facts, and technology fusion is the main driver. Thus, ensuring that any advancement in technology reach and benefit all is the ideal opportunity for everyone. In this study, disruptive technologies of industry 4.0 were explored and quantified in terms of the number of their appearance...
3 CitationsSource
#1Soh-Khim Ong (NUS: National University of Singapore)H-Index: 35
#2A. W. W. Yew (NUS: National University of Singapore)H-Index: 3
Last. A. Y. C. Nee (NUS: National University of Singapore)H-Index: 14
view all 4 authors...
Abstract Robots are important in high-mix low-volume manufacturing because of their versatility and repeatability in performing manufacturing tasks. However, robots have not been widely used due to cumbersome programming effort and lack of operator skill. One significant factor prohibiting the widespread application of robots by small and medium enterprises (SMEs) is the high cost and necessary skill of programming and re-programming robots to perform diverse tasks. This paper discusses an Augme...
2 CitationsSource