Abstract

Head Mounted Displays such as Google Glass and the META have the potential to spur consumer-oriented Optical See-Through Augmented Reality applications. A correct spatial registration of those displays relative to a user’s eye(s) is an essential problem for any HMD-based AR application. We provide an overview of established and novel approaches for the calibration of those displays including hands on experience in which participants will calibrate such head mounted displays.

The following list provides a tentative list of topics covered during the tutorial.

Part 1: Introduction to OST calibration

• Why OST Calibration is important?
• Differences to Camera Calibration
  • Introduce camera calibration
  • Why is OST calibration hard?
    • The user in the loop - pointing accuracy
    • Slipping, the need for recalibration
• Principal aspects of OST-HMD calibration
  • overview of data collection
  • confirmation methods
  • optimization
  • mono vs stereo
• Details of OST calibration
• Data collection methods: 
  SPAAM, Multi Point collection, stereo methods
• Confirmation methods
• Optimization approaches
• Evaluation: perceptual measures vs. analytic measures
• State of the art: Semi-, fully automatic calibration methodses

Part 2: Hands-on calibration

• SPAAM-based calibration of Epson Moverio / Google Glass with inside-out marker tracker 

Schedule

14:00 Welcome and introduction

Theory
14:15 Introduction to OST Calibration
15:00 coffee break
15:15 Details of OST Calibration
16:15 coffee break

Practice
16:30 Hands on session: calibration of OST HMDs
17:30 Discussion: experiences, feedback
17:50 wrap-up, mailing list
18:00 end of tutorial

Intended Audience

Who should attend: Researchers and engineers in the AR/VR field, who wish to (1) develop AR applications with their OST-HMDs, and/or (2) get an overview of and hands-on experience with calibration methods for OST-HMDs.

Level of expertise: All levels. Basic knowledge about computer vision with linear algebra will be introduced through the introductory part.

Instructor Background

Jens Grubert is a university assistant at Graz University of Technology. He received his Bakkalaureus (2008) and Dipl.-Ing. with distinction (2009) at Otto-von-Guericke University Magdeburg, Germany. As a research manager at Fraunhofer Institute for Factory Operation and Automation IFF, Germany, he implemented various calibration methods for industrial optical see-through head mounted displays and conducted long-term evaluations of those systems until August 2010. He has been involved in several industrial projects such as AVILUS and AVILUSPlus as well as EU FP7 projects such as EXPERIMEDIA and MAGELLAN. He is author of more than 20 peer reviewed publications and published a book about AR development for Android. His current research interests include mobile interfaces for situated media and user evaluations for consumer oriented Augmented Reality interfaces in public spaces.

Yuta Itoh is a research assistant at TU Munich. He holds B.Eng. (2008) and M.Eng. (2011) degrees in computer science from Tokyo Tech, where he studied machine learning. He spent two years as a researcher at Multimedia Lab. in Toshiba Corp. (2011-2013). His current research topic aims at developing OST-HMD system for maintenance assistance. As an outcome of the research, he recently published a paper about OST-HMD calibration technique. His research is a part of EU FP7 project EDUSAFE. He is a student member of IEEE.

Further Information

http://stctutorial.icg.tugraz.at/