An Approach for Construction of Augmented Reality Systems using Natural Markers and Mobile Sensors in Industrial Fields

Authors

  • Daniel Lima Gomes Jr Federal Institute of Maranhí£o http://orcid.org/0000-0001-8415-3917
  • Paulo Roberto Jansen dos Reis Federal University of Maranhí£o
  • Anselmo Cardoso de Paiva Federal University of Maranhí£o
  • Aristófanes Corríªa Silva Federal University of Maranhí£o
  • Geraldo Braz Jr Federal University of Maranhí£o
  • Marcelo Gattass Tecgraf Institute / PUC-Rio
  • Antí´nio Sérgio de Araújo

Keywords:

Augmented Reality, Data Visualization, Natural Markers

Abstract

This paper presents a methodology for the development of augmented reality (AR) visualization applications in industrial scenarios. The proposal presents the use of georreferenced natural markers detected in real time, which enables the construction of AR systems. This use of augmented visualization allows the creation of tools that can aid on-site maintenance activities for operators. AR use makes possible including information about the equipment during a specific procedure. In this work, the detection of natural markers in the scene are based on Haar-like features associated with equipment geolocalization. This approach enable the detection of equipment in multiple user’s viewpoints in the industrial scenario and makes it possible the inclusion of real information about those equipment in real time as AR annotations. In this way, beyond a methodology approach, this paper presents a new way for Power System information visualization in the field that can be used in both for training and for control operations.

Author Biographies

Daniel Lima Gomes Jr, Federal Institute of Maranhí£o

Received his M.Sc. in Electrical Engineering (2010) from Federal University of Maranhí£o (UFMA). Now he is PhD student of informatics at UFMA, Brazil.Since 2010 he is a professor of Federal Technology Institute of Maranhí£o (IFMA), Brazil. His current research interests include Image Processing, Virtual and Augmented Reality and Computer Vision

Paulo Roberto Jansen dos Reis, Federal University of Maranhí£o

Received a M.Sc. degree in Computer Science (2014) by the
Federal University of Maranhao (UFMA). Currently he is a researcher of Applied Computing Center (NCA) and his research interests are Virtual and Augmented Reality with emphasis on collaborative industrial applications.

Anselmo Cardoso de Paiva, Federal University of Maranhí£o

Received a PhD degree in Informatics from Pontiphical Catholic
University of Rio de Janeiro - Brazil in 2001. He is founder member of the Applied Computer Center at Federal University of Maranhao (UFMA), where he is currently a Professor. His research interests include GIS, analysis and processing of medical images, Virtual and Augmented Reality.

Aristófanes Corríªa Silva, Federal University of Maranhí£o

Received a PhD degree in Informatics from Pontiphical Catholic
University of Rio de Janeiro - Brazil in 2004. Currently he is a Professor at the Federal University of Maranhí£o (UFMA), Brazil. He teaches image processing, pattern recognition and programming language. His research interests include image processing, image understanding, medical image processing, machine vision, artificial intelligence, pattern recognition and, machine learning.

Geraldo Braz Jr, Federal University of Maranhí£o

Received PhD degree in Electrical Engineering (2014) from Federal
University of Maranhao (UFMA), Brazil. Currently he is professor at the Federal University of Maranhao. He teaches Computer Vision, programming language, Software Engineering. His research interests include Computer Vision, Image Processing, Machine Learning and Augmented Reality.

Marcelo Gattass, Tecgraf Institute / PUC-Rio

Director of the Tecgraf Institute at Pontifical Catholic University of Rio
de Janeiro (Brazil) since 1987. He received his PhD degree in Computer Graphics & Civil Engineering (1982) from Cornell University, USA. His research interests include Augmented Reality and Scientific Visualization.

Antí´nio Sérgio de Araújo

Supervisor of the Regional Operation Center from East System in Hydroeletric Company of Sao Francisco (CHESF) in Recife, Brazil. He received his bachelor degree in Organizational Psicology at UNICAP (1993). Post-graduate in SRH at FAFIRE (1990),
Eletrotechnical Univerisity Extension at UFPE (2000), Specialization in Operation Security Analysis in Power Systems at Fundaçí£o COGE (2004) and Eletric Systems Automation at FUPAI (2006).

References

Antonijevic M.; Sucic S.; Keserica H. (2016); Augmented Reality for Substation Automation by Utilizing IEC 61850 Communication, 39th International Convention on Information and Communication Technology, Electronics and Microelectronics - Distributed Computing, Visualization and Biomedical Engineering, Opatija, Croatia, 2016.

Aukstakalnis S.; Blatner D. (1992); Silicon Mirage - The Art and Science of Virtual Reality, Peachpit Press, ISBN: 978-0938151821, 317, 1992.

Azuma R.T. (1997); A Survey of Augmented Reality, Presence: Teleoperators and Virtual Environments, 355-385, 1997. https://doi.org/10.1162/pres.1997.6.4.355

Bay H.; Ess A.; Tuytelaars T.; Gool L. V. (2008); Speeded-up Robust Features (SURF), Computer Vision and Image Understanding, 110(3), 346-359, 2008. https://doi.org/10.1016/j.cviu.2007.09.014

CEPEL (2004); Open Energy Management System (Sistema Aberto de Gerenciamento de Energia), [Online] Avaiable: http://sage.cepel.br

Côté S.; Barnard J.; Snyder R. (2013); Offline Spatial Panoramic Video Augmentation for Visual Communication in the AEC Industry, 13th International Conference on Construction Applications of Virtual Reality (CONVR 2013), 82-89, 2013.

Dai J.; Zhang L. (2011); Registered Localization Method-Based on OpenCV for Augmented Reality, International Conference of Soft Computing and Pattern Recognition (SoCPaR), 492-495, 2011. https://doi.org/10.1109/socpar.2011.6089144

Farag H. E. Z.; El-Saadany E.F. (2012); A Novel Cooperative Protocol for Distributed Voltage Control in Active Distribution Systems, IEEE Transactions on Power Systems, 1645-1656, 2012.

Google (2016); Google Cardboard, [Online] Available at http://googlecardboard.com.br

GPS (2014); GPS Accuracy, Official U.S. Government information about the Global Positioning System, [Online] Available: http://www.gps.gov/systems/gps/performance/accuracy/

Jian Y.; Xin W.; Xue Z.; Zhenyou D. (2015); Cloud Computing and Visual Attention Based Object Detection for Power Substation Surveillance Robots, IEEE 28th Canadian Conference on Electrical and Computer Engineering, 337-342, 2015.

Kim J.; Jun H. (2011); Implementation of Image Processing and Augmented Reality Programs for Smart Mobile Device, The 6th International Forum on Strategic Technology, 1070- 1073, 2011.

Li Z.; Wang J.; Sun H.; Guo Q. (2015); Transmission Contingency Analysis Based on Integrated Transmission and Distribution Power Flow in Smart Grid, IEEE Transactions on Power Systems, 3356-3367, 2015.

Liang M.; Min H.; Luo R.; Zhu J. (2015); Simultaneous Recognition and Modeling for Learning 3-D Object Models From Everyday Scenes, IEEE Transactions on Cybernetics, 45(10), 2237-2248, 2015. https://doi.org/10.1109/TCYB.2014.2368127

Lienhart, R.; Maydt, J. (2002); An Extended Set of Haar-like Features for Rapid Object Detection, IEEE International Conference on Image Processing (ICIP), 900-903, 2002.

Lin H.; Sambamoorthy S.; Shukla S.; Thorp, J.; Mili L. (2011); Power System and Communication Network Co-Simulation for Smart Grid Applications, Innovative Smart Grid Technologies (ISGT), 1-6, 2011.

Lowe D.G. (2004); Distinctive Image Features from Scale-Invariant Keypoints, International Journal of Computer Vision, 60(2), 91-110, 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94

Mahadev P. M.; Christie R. D. (1993); Envisioning Power System Data: Concepts and a Prototype System State Rep-resentation, IEEE Transactions on Power Systems, 8(3), 1084-1090, 1993. https://doi.org/10.1109/59.260890

Mahadev P. M.; Christie R. D. (1994); Envisioning power system data: vulnerability and severity representations for static security assessment, IEEE Transactions on Power Systems, 9(4), 1915-1920, 1994. https://doi.org/10.1109/59.331450

Mikkelsen C.; Johansson J.; Cooper M. (2012); Visualization of Power System Data on Situation Overview Displays, 16th International Conference on Information Visualisation, 188-197, 2012.

Milgram P.; Kishino F. (1994); A Taxonomy of Mixed Reality Visual Displays, IEICE Trans. Information and Systems, 1321-1329, 1994.

Nigam S.; Deb K.; Khare A. (2013); Moment Invariants based Object Recognition for Different Pose and Appearances in Real Scenes, International Conference on Informatics, Electronics & Vision (ICIEV), ISBN: 978-1-4799-0397-9, 1-5, 2013.

Overbye T. J.; Weber J. D. (2000); New Methods for the Visualization of Electric Power System Information, IEEE Symposium on Information Visualization, ISSN: 1522-404X, 1-9, 2000.

Overbye T. J.; Weber J. D. (2000); Visualization of power system data, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences, 1-7, 2000.

Pribeanu C. (2012); Specification and Validation of a Formative Index to Evaluate the Ergonomic Quality of an AR-based Educational Platform, International Journal of Computers Communications & Control, 7(4), 721-732, 2012. https://doi.org/10.15837/ijccc.2012.4.1370

Prochazk D.; Stencl M.; Popelka O.; Stastny J. (2011); Mobile Augmented Reality Applications, Proceedings of Mendel 2011: 17th International Conference on Soft Computing, 469-476, 2011.

Ribeiro T. R.; Reis P. R. J.; Braz Jr., G.; Paiva A. C.; Silva A. C.; Maia I. M. O.; Araújo A. S. (2014); Agito: Virtual reality environment for power systems substations operators training, International Conference on Augmented and Virtual Reality (AVR), 113-123, 2014.

Rublee E.; Rabaud, V.; Konolige K.; Bradski, G. (2011); ORB: an efficient alternative to SIFT or SURF, IEEE International Conference on Computer Vision, 2564-2571, 2011.

Schwegmann C.P.; Kleynhans W.; Salmon B.P. (2014); Ship detection in South African oceans using SAR, CFAR, and a Haar-like feature classifier, Geoscience and Remote Sensing Symposium (IGARSS), 557-570, 2014.

Szeliski R. (2011); Computer Vision: Algorithms and Applications, Springer-Verlag London, ISBN: 978-1-84882-935-0, 812, 2011.

Vargas H.; Farias G.; Sanchez J.; Dormido S.; Esquembre F. (2013); Using Augmented Reality in Remote Laboratories, International Journal of Computers Communications & Control, 8(4), 622-634, 2013. https://doi.org/10.15837/ijccc.2013.4.42

Viola P.; Jones M. J. (2001); Rapid Object Detection using a Boosted Cascade of Simple Features, Computer Vision and Pattern Recognition (CVPR), 511-518, 2001.

Weber J. D.; Overbye T. J. (2000); Voltage Contours for Power System Visualization, IEEE Transactions on Power Systems, 15(1), 404-409, 2000. https://doi.org/10.1109/59.852151

Published

2017-06-29

Issue

Vol. 12 No. 4 (2017): International Journal of Computers Communications & Control (August)

Section

Articles

License

ONLINE OPEN ACCES: Acces to full text of each article and each issue are allowed for free in respect of Attribution-NonCommercial 4.0 International (CC BY-NC 4.0.

You are free to:

-Share: copy and redistribute the material in any medium or format;

-Adapt: remix, transform, and build upon the material.

The licensor cannot revoke these freedoms as long as you follow the license terms.

 

DISCLAIMER: The author(s) of each article appearing in International Journal of Computers Communications & Control is/are solely responsible for the content thereof; the publication of an article shall not constitute or be deemed to constitute any representation by the Editors or Agora University Press that the data presented therein are original, correct or sufficient to support the conclusions reached or that the experiment design or methodology is adequate.

Most read articles by the same author(s)

Obs.: This plugin requires at least one statistics/report plugin to be enabled. If your statistics plugins provide more than one metric then please also select a main metric on the admin's site settings page and/or on the journal manager's settings pages.