iLRN2021 7th International Conference of the Immersive Learning Research Network

Posters

Integrated Reading Assistance in an Immersive Environment
Kojiro Yano
Osaka Institute of Technology, Japan

Relationship between Perceptions and Experiences on the Performance of Students in a Serious Game
Chioma Udeozor
Newcastle University, United Kingdom
Watch the presentation video

Virtual Learning for Virtual Times across the SUNY System
Roberta Sullivan(1), Alyssa Indelicato(2), Eileen O'Connor(3), Nicole Simon(5), Cynthia Tysick(6)
1: University at Buffalo, United States of America; 2: SUNY Upstate Medical University, United States of America; 3: Empire State College, United States of America; 5: Nassau Community College, United States of America; 6: University at Buffalo, United States of America
Watch the presentation video

Developing a Portfolio of Tools for Teaching Digital Logic
Harry Keith Edwards
University of Hawaii at Hilo, United States of America
Watch the presentation video

Game Design Informed by Learning Progressions for Science Practices
Shari Metcalf(1), Amanda Sommi(1), Sima Haddadin(1), Jennifer Scianna(2), David Gagnon(2)
1: Harvard University; 2: University of Wisconsin

Design and Evaluation of Mixed Reality Based Cybersecurity Curriculum for Middle School Students
Yan-Ming Chiou, Chrystalla Mouza, Teomara Rutherford, Chien-Chung Shen
University of Delaware, United States of America

Plant Cell Biology Education Using Advanced 3D Technologies for K-12 Students
Sayuri Tanabashi
The University of Tokyo, Japan

Virtual Geoscience Field Trip for Improved Physical Accessibility and Spatio-Temporal Reasoning
Matthew Donnelly(1), Adaobi Nebuwa(2), Jaclyn Baughman(1), Stacy Doore(2)
1: Bowdoin College, United States of America; 2: Colby College, United States of America
Watch the presentation video

Design Method of a Real-time Monitoring System for ICT Evaluation Process in Education Based on CesiumJS 3D Visualization
Chen Wu(1), Meng Chen(1), Di Wu(1), Jiman Ma(1), Jian Xu(1), Binbin Ma(2)
1: Central China Normal University, China, People's Republic of China; 2: South-Central University for Nationalities, China, People's Republic of China
Watch the presentation video

Language, Culture, and Heritage: The VR experience The Book of Distance and teaching the Family Folklore Project
Charles Willam MacQuarrie, Rachel Rebecca Tatro-Duarte
California State University Bakersfield, United States of America

Specific Heat of Water Experiment: Augmented Reality Chemistry Lab
Ryan Wirjadi, Alex Vuong, Frank Liu, Robert LiKamWa
Arizona State University, United States of America
Watch the presentation video

Building WaterWays: Investigating AR for Environmental Education
Corinne Brenner, Jessica Ochoa Hendrix, Mande Holford
Killer Snails, United States of America

Watershed Explorers: Designing a Virtual Reality Game to Promote Local Watershed Literacy
Robson Araujo-Junior(1), Alec Bodzin(1), Thomas Hammond(1), David Anastasio(1), Beigie Lam(1), Jeremy Mack(1), Daphne Mayer(2), Robert Neitz(3), Kathryn Semmens(4), Chad Schwartz(5), Jason Slipp(1)
1: Lehigh University, United States of America; 2: Delaware & Lehigh National Heritage Corridor National Canal Museum, United States of America; 3: Jacobsburg Environmental Education Center, United States of America; 4: Nurture Nature Center, United States of America; 5: Lehigh Gap Nature Center, United States of America
Watch the presentation video

Improve Spatial Learning by Chunking Navigation Instructions in Mixed Reality
Bing Liu(1), Zhicheng Zhan(2)
1: Technical University of Munich, Germany; 2: Ghent University, Belgium

Mathstation: A Grade School Math Supplement Serious Game
Jonathan Borowski, David Plecher
TU Munich, Germany

AR-supported Collaborative Game for Understanding Complex Systems
Man Su
Arizona State University, United States of America

Presentations

Virtual Reality Applications For The Treatment Of Anxiety And Psychiatric Disorders
Saeed Safikhani, Johanna Pirker, Selina Wriessnegger
TU Graz, Austria
​Watch the presentation video​​​

Virtual Reality (VR) environments are computer-generated mediums that try to provide the user a sense of presence. The use of VR term in science has a long history, but an increasing number of commercial cost-effective VR devices are creating new possibilities and applications for it. Regardless of entertainment, as the most widespread market for VR, the application of VR in medicine is attracting great attention in the scientific field. VR can be used as a tool for public healthcare, as a teaching environment for medical students or to improve the skills of experts, together with a well-accepted method for physical rehabilitation and mental therapies. The focus of this review paper is on the use of VR for psychiatric and anxiety disorders. Several empirical studies show the effectiveness of VR in improving the conditions of patients in a manner comparable to traditional methods and with long-lasting effects in their daily lives. However, a small number of case studies or the lack of a detailed comparison between VR and conventional methods is the shortcoming of current studies. In this paper, we review different VR applications focusing on the identification of the technologies used, the evaluation methods applied, and the results of the studies.

Presentations

Modeling Teacher Use of Virtual Reality Simulations in Nursing Education Using Epistemic Network Analysis
Mamta Shah(1), Amanda L Siebert-Evenstone(2), Brendan R Eagan(2), Roxanne Holthaus(1)
1: Elsevier; 2: University of Wisconsin-Madison
​Watch the presentation video​​​

Simulations are widely adopted in undergraduate nursing education because they offer low-risk, experiential ways to expose pre-licensure students to clinical environments, and to situate the development of requisite knowledge and skills for patient care. Virtual reality (VR) simulations present novel opportunities for clinical education; as such, research in this area is burgeoning around questions related to perception, adoption, and outcomes. In this paper, we demonstrate the application of epistemic network analysis, a quantitative ethnography technique, to model how one nursing educator facilitated clinical judgment and nurtured quality and safety education for nurses’ competencies through the use of Simulation Learning System with Virtual Reality (SLS with VR). We modeled the discourse obtained from three simulation sessions in October and November 2020, all involving a fundamental scenario requiring second-year nursing students to practice basic assessment and care management. Our work aims to advance research in medical and health education, particularly nursing education, using immersive learning environments by way of applying theory-backed learning analytic techniques.


CureQuest: A Digital Game for New Drug Discovery
Ben Chang, Shawn Lawson, Kathleen Ruiz, Mei Si
Rensselaer Polytechnic Institute, United States of America
Watch the presentation video

CureQuest is an educational adventure game about Clinical Translational Therapeutics, the process of discovery and development of new medical treatments, drugs, devices, and therapies. The game is being developed through a collaboration between faculty and students from a game design program and those from a medical school, with the goal of raising awareness and improving collaboration in the "bench to bedside" process. CureQuest aims to address this gap, first with medical students and ultimately for a general audience, with a game that instills wonder and inspires players with the challenges of drug discovery. In addition to the impact of the game when completed, the development process itself presents a novel case study in integrating the interdisciplinary fields of game development and “team science”. We present the current version of the game in development; the unique design challenges presented by the project; and the evolution of our collaborative process.

Presentations
 
Place-Based Learning through a Proxy – Variations in the Perceived Benefits of a Virtual Tour
Jan Oliver Wallgrün(1), Eric Knapp(2), Alan Taylor(3), Alexander Klippel(3), Jiayan Zhao(3), Pejman Sajjadi(3)
1: Independent Researcher; 2: US Forest Service; 3: Penn State University
​Watch the presentation video​​​

Place-based and fieldwork learning play a key role in higher education in environmental sciences and other geo-spatial disciplines. We report on a study in which we evaluated a web-based virtual tour application for teaching natural resource management in fire-prone western forests in two undergraduate classes. The virtual tour uses 360°-image-based virtual scenes and pre-recorded audio commentary by a domain expert to lead participants through the Stanislaus-Tuolumne Experimental Forest where forest treatments were implemented to reduce fire hazard. We present results from assessing students’ overall perception of the virtual tour, their views towards its application in undergraduate education, and their feedback for improving the design of future virtual tours. Furthermore, we discuss the collected data from the perspective of gender differences and differences in familiarity with the topic of the tour.
 
 
Spatial Learning with Extended Reality - A Review of User Studies
Bing Liu(1), Linfang Ding(2), Liqiu Meng(1)
1: Chair of Cartography, Technical University of Munich, Germany; 2: KRDB Research Centre, Free University of Bozen-Bolzano, Italy
​Watch the presentation video​​​

Spatial learning is a process of acquiring spatial knowledge and the foundation of our daily interactions with the living environment. Extended reality (XR) has been widely used in spatial learning research for decades with two representative types - Virtual reality (VR) and Augmented reality (AR). VR is often used to understand spatial learning behavior and spatial cognition process, and AR has great potential to assist spatial learning in real world. This short paper reviews the studies on the deployment of VR and AR to evaluate or assist spatial learning. We summarize the devices, technologies and analysis methods used, and identify factors that need to be considered in experimental design. Our work serves as a reference for new researchers who intend to design further user studies on spatial learning with VR and AR technologies.

MADLearn: An Evidence-based Affordance Framework to Assessing Learning Apps
Christothea Herodotou
The Open University UK, United Kingdom
 
Existing recommendations about how to select or design mobile applications (apps) for learning have been heavily relied on customer and teacher reviews, designer descriptions, and educational theories. There is a lack of evaluation frameworks that are informed by research evidence of how different children interact and use apps. The first version of an evidence-based framework, coined as MAD learn, is presented detailing affordances that hinder or help children’s learning, as emerged from relevant studies. To encourage further studies in the field, not only by researchers but also designers and practitioners, a methodological approach to iteratively assess the affordances of mobile apps is also introduced. This is based on (a) visualising the learning design and learning components of a given app and (b) analysing the screen and audio recordings of children’s interactions with apps. The proposed approach has been tested with 17 children 5-6 years old who interacted with a maths app. The analysis captured patterns of actual usage, including time spent on different activities, completion rates, communication instances, and number and type of mistakes. Insights revealed that certain design affordances, including instructions, feedback, and help-on-demand, were differently perceived by children, in some cases helping learning while, in others, hindering it.
 

Presentations
 
Supporting Teachers' SRL Beliefs and Practices with Immersive Learning Environments: Evidence from a Unique Simulations-Based Program
Orna Heaysman, Bracha Kramarski
Bar Ilan University, Israel
Watch the presentation video
 
Empirical evidence indicates that, as a result of teachers' belief systems and the absence of an SRL development for teaching practice, teachers are challenged by the adoption of SRL in learning and teaching. This study explored a support program for SRL through quasi-experimental design to encourage aspects of SRL (planning, monitoring, evaluation) stimulated in a unique immersive simulation learning environment. Participants were 72 primary school teachers assigned to experimental or control groups. Results show that the teachers from the experimental group have shifted their beliefs towards autonomous learning and used more SRL in lesson planning and teaching reflections
 
 
Exploring the Real-Time Touchless Hand Interaction and Intelligent Agents in Augmented Reality Learning Applications
Muhammad Zahid Iqbal(1), Eleni Mangina(2), ‪Abraham G. Campbell(3)
1: School of Computer Science, University College Dublin, Ireland; 2: School of Computer Science, University College Dublin, Ireland; 3: School of Computer Science, University College Dublin, Ireland
​Watch the presentation video​​​

During the last decade, there has been a surge in research studies exploring the adoption of Augmented Reality (AR) in educational settings. Within these multiple research studies, AR's capability to extend the teaching and learning environment with augmented 3D learning objects with enhanced interactive capabilities have been demonstrated. This new technology has not been widely adopted in the mainstream but with the recent unprecedented circumstances of COVID-19, there has been an increasing societal willingness to adopt these technologies. AR has been a desirable technology due to its inherent touchless nature which facilitates social distancing at this time but AR applications crucially offer so much more. They can provide interactive functionality through augmentation of the teaching and learning environment within an immersive user experience including 3D interactions with learning objects, gestures, hand interaction, tangible and multi-modal interaction.
This paper presents the results of a review of touchless interaction studies in educational applications and proposes the implementation of real-time touchless hand interaction within kinesthetic learning and utilization of machine learning agents. The architecture of two AR applications with real-time hand interaction and machine learning agents are demonstrated within this paper enabling engaged kinesthetic learning as an alternative learning interface.

Visualizing The Collaborative Problem Solving Process In An Immersive Cross Platform Game
Meredith Thompson, Cigdem Uz Bilgin, Rik Eberhart, Lucy Cho, Melat Anteneh, Eric Klopfer
MIT, United States of America
​Watch the presentation video​​​

This study explores how players engage in problem solving during a cross-platform collaborative game. Players took on one of two roles: an Explorer in virtual reality head mounted display and a Navigator using a tablet. Videos of 40 minute game play sessions for 8 pairs of players were transcribed and examined for patterns of game play based on stages of collaborative problem solving (CPS) developed by Fiore et al (2017). Players’ discussion during gameplay was analyzed and visualized through Epistemic Network Analysis. Results suggested that players engaged in two way communication using biology terms throughout the game, and that communication styles were linked to roles. After initial orientation, players moved through multiple cycles of cluefinding and discussion that followed similar patterns even in groups with different knowledge levels. These results suggest that collaborative problem solving can be initiated through roles in a serious game and documented through participants’ conversation during a serious game. Future research will focus on whether the game can be used to learn, practice, and improve players’ CPS skills

Pluriversal Design Transitions for Higher Education Motivated by COVID-19
Lupita Guillen Mandujano(1), Erdas Kuruc(2), Jun-Li Lu(3), Paola Sanoni(4), Xanat Vargas Meza(3)
1: Universidad Autonoma Metropolitana, Campus Xochimilco, Mexico; 2: Eastern Mediterranean University, Cyprus; 3: University of Tsukuba, Japan; 4: Kyoto University, Japan
 
This panel seeks to overview how immersive learning technologies can be used for Higher Education (HE) in several non-westernized contexts amid the COVID-19 pandemic. Through the outline of pluriversal design combined with design transitions, we aim to explore how a world containing many coexisting worlds can resurge from the present educational challenges and become a fairer, sustainable place for everyone.

Synapse VR: Catalyzing Collaboration through Immersive Learning
Cat Flynn, Seth Corrigan, Faby Gagne
Watch the presentation video

Please pardon our dust as we replaced this one Sched session with 29 individual sessions.  Please visit the booths in the Expo Hall!

Presentations

Pandemic pirouettes: AR Ballet Exploring Data Ethics for the Computing Classroom
Genevieve Smith-Nunes(1), Alex Shaw(2)
1: University of Cambridge, United Kingdom; 2: Glaston Bridge Software
Watch the presentation video

This Doctoral Colloquium paper explores the pivot from in-person to virtual and digital means in developing an Augment Reality (AR) classical ballet experience due to Covid-19. This work-in-progress explores novel teaching and learning approaches to the computing concepts of data transmission, signal processing, and therefore necessarily data ethics through classical ballet and bio-metric data the body and brain waves as data artefacts, the data ethics implications of bio-metrics. Innovative approaches to subject knowledge, programming competency, and probing engender thinking of the field of computing if any. This study uses the emergent methodology of AgileDBR, a hybrid of design-based research (DBR) and Agile developed as part of author one's Ph.D.

Designing VR Environments For Distance Learning
Richard Ngu Leubou(1,2), Benoit Crespin(1), Marc Trestini(2)
1: XLIM UMR CNRS 7252, University of Limoges, France; 2: LISEC UR 2310, University of Strasbourg, France
Watch the presentation video

Virtual reality takes learner participation to a higher level of interaction, offering a real experience and a new way to acquire real-world in a distance learning device. Designing VR environments for distance learning leads to an examination of the technical and methodological choices to ensure a useful, usable and efficient tool. Our work is based on the design approaches and recommendations from existing works related to VR and/or distance learning, in order to formalize the design of collaborative VR environments specifically dedicated to distance learning.

A Qualitative Study to Explore the Use of Augmented Reality as Performance Support in Industries
Yao Huang
Florida State University, United States of America
Watch the presentation video

When augmented reality (AR) technology is used in the learning and development field, it is often viewed from a training perspective. Human Performance Technology (HPT) professionals start to explore the potential of adopting AR on mobile devices as a performance support tool to help field workers across industries. This paper captures the adoption of how mobile AR is used in organizations to address performance issues. The study will use the Critical Incident Technique (CIT) to interview ten organizations. The purpose is to uncover the critical events on why mobile AR is considered an appropriate intervention, what benefits and challenges the organizations encounter, what processes are followed when designing and implementing mobile AR, and what types and functions of mobile AR are used to assist job performance.

Immersive Media in Remote Schooling: “I was surprised at how engaged I was”
Eileen McGivney
Harvard University, United States of America
Watch the presentation video

With protracted school closures forcing young people to learn remotely, schools are in urgent need of innovative approaches that can keep students engaged in their education and support their learning. Immersive technologies like virtual reality (VR) and 360-degree videos have been shown to increase motivation to learn and student focus, but little is known about their effectiveness in a remote schooling model. This paper reports preliminary results of a mixed methods case study using 360-videos and Google Cardboard viewers in remote high school engineering classes. The students’ surveys and interviews indicate they find online learning difficult, but that 360-videos are more engaging than other instructional media and may be particularly useful for facilitating observational learning.

VeRdict: Imbuing VR Language Learning Applications with Dictionary Functionality
Louis Lecailliez, Noel H. Vincent
Kyoto University, Japan
Watch the presentation video

As VR hardware becomes increasingly performant and accessible, interest has grown among researchers regarding how to leverage its immersive qualities in an educational context. Immersion, however, often comes at the expense of multitasking functionality and use of supplementary learning resources. This presents an issue for language learners, who upon encountering an unfamiliar word in VR, may have to remove their goggles or switch applications to consult a dictionary. Thus, in order to make dictionary use more immersive and convenient for learners, we present VeRdict, a dictionary extension for VR learning applications that enables dictionary searches from directly within an application using motion controls. Its client-server architecture allows for the delivery of lexicographic content augmented with optional 3D object data, which can be used to display dictionary entries and accompanying 3D visuals. The dictionary can be used to perform manual vocabulary searches using a virtual keyboard, or be used through labels applied to elements within the virtual scene. Additionally, 3D objects loaded from the dictionary server can be used as virtual `props'—unlocking new gesture-based communicative possibilities.

Presentations

Great Paintings in Fully Immersive Virtual Reality
Hubert Cecotti
California State University, Fresno, United States of America
Watch the presentation video

Large collections of paintings have been digitized by museums (e.g. The Metropolitan Museum of Art, New-York, USA) and companies such as Google. These resources can be provided to a wide audience through virtual reality as an instructional means to fully convey the size and the magnificence of these paintings. Accessing these resources in an immersive virtual environment can be beneficial to all the students who live far away from museums. In addition, making these resources available to a wide audience answers a current need related to the closure of many museums, because of the Covid-19 pandemic. This paper provides a description of a fully immersive virtual reality museum where paintings can be accessed in two modes: individually (one painting per room), or in galleries (multiple paintings in a room) that are generated procedurally. More importantly, the proposed application provides a means for museums and art instructors to insert their own collections of paintings. Such an approach aims at improving the transition of high resolution images of paintings into art galleries in virtual reality. The application has been deployed on the Steam platform, is available for free, and has been evaluated by users, suggesting a high interest for such an application.


Alternative Design For An Interactive Exhibit Learning In Museums: How Does User Experience Differ Across Different Technologies-VR, Tangible, And Gesture
Pornphan Phichai(1), Julie Williamson(2), Matthew Barr(3)
1: School of Computing Science, University of Glasgow, United Kingdom; 2: School of Computing Science, University of Glasgow, United Kingdom; 3: School of Computing Science, University of Glasgow, United Kingdom
Watch the presentation video

This paper investigates three types of user interfaces: VR, Gesture-based interface, and Tangible-based interface. We examine how user experience differs across different technology and what are the factors that make the experience difference. To find the answer we conduct an empirical study, in which we create three different interactive exhibits that apply these technologies to deliver the same scientific content about biotoxin in nature. The study uses a mixed-method, qualitative and quantitative, and measures two factors. First, user experience is measured by six dimensions of user experience: attractiveness, perspicuity, efficiency, dependability, simulation, and novelty. Second, attention holding power is measured by playing time. The study uses the semi-structured interview to emphasize the issue and learning media of each interface. Thirty-one subjects joined the study. The statistical results shows that there are significantly different user experiences when using a different type of interface. There are difference across five user experience dimensions, only novelty is relatively unchanged. Difference are primarily between VR and Gesture, and Tangible and Gesture. There is no significant difference in holding power between the three types of interface. The statistical analysis of result and interview feedback from participants suggest six aspects to focus on when choosing an alternative interface to create a new interactive exhibit: the novelty, user-friendly, precision of the input device, task and device design, multimodal of feedback, and quality of text in VR.


Communal Spaces As Ludic Resources Of Learning With Augmented Reality And Board Games
Kenneth Y. T. Lim(1), Yuk Yi Wong(2), Ahmed Hazyl Hilmy(1)
1: National Institute of Education, Singapore; 2: St Joseph's Institution, Singapore
Watch the presentation video

This paper describes a learning activity using Augmented Reality (AR) which seeks to take advantage of the potential for learning about history and culture through exploration. This is represented by a garden in a university campus that affords visitors a scaffolded experience comprising a game-driven narrative in which visitors to the garden may assume the roles of different protagonists. In addition, we also sought to design a paper-based board-game for visitors who are not yet able to visit the garden in person. Both aspects of the learning activity – namely, the game-driven narratives in the actual garden as well as in the board-game equivalent – were piloted in December 2020. The study suggests that a combination of Augmented Reality, storyline and role-play could increase the probability of encounters with spontaneous elements in learners’ local environments that encourage learning.

​​​​Presentations

Comparison of Direct and Vicarious VR Learning Experience: A Perspective from Accessibility and Equity
Gege Li, Heng Luo, Shaopeng Hou, Min Zhu
Central China Normal University, China, People's Republic of
​Watch the presentation video​​​

A common challenge for adopting virtual reality (VR) in education is that limited VR devices are often shared among a large group of students. Consequently, there are two types of VR learners: Performers who acquire virtual learning experience through direct engagement in VR and observers who acquire such experience vicariously through observation. To explore the influence of learner type on VR learning, this study conducted a quasi-experiment with 53 elementary school students to examine the difference in VR learning experiences between the performers and the observers. The study results supported the observed VR learning experience as an adequate alternative to direct VR engagement as the observers demonstrated overall comparable learning patterns in reflection, emotion, engagement, and social interaction during the post-VR debriefing, except for the behaviors of recall and interpretation. The research findings can shed light on the issues of accessibility and equity in VR-based instruction and inform the design and implementation of large-scale VR educational programs.

Student Engagement with Reduced Bias in a Virtual Classroom Environment
Ray Freiwirth1, Esther Brandon
1; The Commons XR, United States of America; 2: Brandeis University, United States of America
Watch the presentation video

To Transcend is critical, but the path must contain a mechanism to both combat dis-engagement and bias in a classroom environment. Why bias and engagement issues as one; because one can create an issue with the other. Not all engagement issues are bias related, but many are. And not all bias issues may create dis-engagement, but certainly there are many studies that seem to point that it can. Why not use tools in the classroom that can improve engagement and reduce both explicit and implicit bias? Virtual reality is one such tool if used correctly. Join us to explore the possibilities of a classroom environment that might help out the next generation of students to transcend the norms of today!

Presentations

Look at It This Way: A Comparison of Metaphors for Directing the User's Gaze in eXtended Reality Training Systems
Filippo Gabriele Pratticò, Federico De Lorenzis, Fabrizio Lamberti
Politecnico di Torino, Italy
​Watch the presentation video​​​

Interest is raising around extended reality training systems (XRTSs), which started to be considered as a credible option to train companies' workforce. Even though there is a growing body of literature on best practices and techniques to be adopted for teaching individuals how to perform a variety of operations (e.g., for assembly and maintenance procedures), there are also training situations which have gone mostly unexplored yet. In this paper, we propose and evaluate three different metaphors to face the key challenges associated with training procedures involving parallax-dependent tasks, i.e., tasks in which the instructor needs to make the trainee reach a target observation point and guide his/her attention towards a given point of interest at the same time. Effects observed through a user study that was run in a testbed environment indicated that metaphors based on 3D avatars and frustum visualization can provide important advantages over video-based techniques.


Asymmetrical Game Design Approaches Solve Didactic Problems in VR Engineer Trainings
Ulrike Meyer(1), Jonathan Becker(1), Thomas Müller(2), André Jeworutzki(1), Susanne Draheim(1), Kai von Luck(1)
1: University of Applied Sciences Hamburg, Germany; 2: EnBW
​Watch the presentation video​​​

The use of VR in training groups for wind turbine engineers can cause didactic and practical problems. Integrating the whole group into the lesson and retaining attention and motivation while only one or two trainees wear a VR head mounted display (HMD) can be challenging for the trainer. Whereas VR HMDs isolate the users, engineering on wind turbines is a group effort. The problem is exacerbated when trainees need to use remote access to participate in the lesson, as can be the case under pandemic restrictions. We propose to use methods from asymmetrical game design and constructivist didactics to integrate participants without VR headsets into VR trainings for engineers.


Immersive Virtual Soft Skills Learning and Training of Employees: A Scoping Review
Tone Lise Dahl
SINTEF AS, Norway
​Watch the presentation video​​​

Soft skills training is considered important for employees to be successful at work. Several companies are offering immersive virtual soft skills training with head-mounted displays. The main contribution of this paper is to provide an overview of the research literature within the field of using immersive virtual soft skills learning and training of employees. The results of this preliminary scoping review show that there is a lack of research literature and empirical studies within this topic.

Presentations

VERITAS: Mind-mapping in Virtual Reality
Robert Sims, Abhijit Karnik
Lancaster University, United Kingdom
Watch the presentation video 

Inquiry based learning is a modern and innovative learning strategy that aims to stimulate students’ interest in a topic and target Bloom’s higher order cognitive process. Reflective tasks, such as mind mapping, support inquiry-based learning. Virtual Reality (VR) presents novel opportunities to help scaffold reflective tasks in inquiry-based learning by supporting use of the 3D space which is not available via existing 2D mind mapping applications. In this paper we present VERITAS, a VR application for mind-mapping based reflective tasks operating on the low-cost Oculus Go device. We discuss the interaction design for the mind-mapping task and evaluate the system from a usability perspective. Our results show that novice participants are able to learn how to use the interactions quickly and utilize them effectively to build mind-maps in 3D. VERITAS establishes the usability of VR and essential interactions to successfully perform abstract and complex reflective tasks like mind-mapping.


Space, a Central Frontier – The Role of Spatial Abilities When Learning the Structure of 3D AR Objects
Jule Marleen Krüger, Daniel Bodemer
University of Duisburg-Essen, Germany
Watch the presentation video

Learning about three-dimensional (3D) objects is the focus of many augmented reality (AR) applications. Although this underlines the importance of spatiality in AR experiences, learners’ spatial abilities should be considered in this context. While spatial abilities may compensate for the lack of spatial information in 2D representations (ability-as-compensator hypothesis), they may also be necessary for learning with 3D representations in the first place (ability-as-enhancer hypothesis). In the current study, we examine the role 3D spatial visualization abilities and 2D spatial memory abilities may play when learning with 3D AR objects. Both variables were measured in an exploratory pilot study in which N = 33 participants learned about the spatial structure of the modules of the International Space Station (ISS) with either an AR or a non-AR mobile application. We found that spatial abilities indeed had moderating effects on achievement in the learning task and knowledge test, although the results are inconclusive concerning an ability-as-enhancer or compensator hypothesis. We discuss the results and conclude that it is necessary that researchers take a closer look at the role of learners’ spatial abilities when learning with 3D representations in AR. With additional insights, practitioners can then make informed decisions on using AR applications.


ELLE-ments of Learning: A Framework for Analyzing Multimodal Technical Communication Strategies in an Educational VR Game
Emily Kuzneski Johnson
University of Central Florida, United States of America
Watch the presentation video

This paper provides a brief overview of technical communication following Peirce’s [2] firstness (aesthetics), secondness (action promotion), and thirdness (explicit explanation), and identifies each of these categories in an educational language learning virtual reality (VR) game created at a university, ELLE-ments of Learning. The framework described here can help game researchers better understand, evaluate, and discuss the ways in which games communicate with players and can also be used by game designers and developers to ensure their games convey important and complicated information to players effectively in each of Peirce’s three categories.

Presentations

Logibot: Promoting Engagement through Visual Programming in Virtual Reality
Robert Matthew Sims, Nathan Rutherford, Prashanthy Sukumaran, Nikola Yotov, Thomas Smith
Lancaster University, United Kingdom
​Watch the presentation video​​​

In this study we assess the effects of teaching fundamental programming concepts through a virtual reality (VR) visual block-based programming application and its impact on engagement. As a comparison study, participants played an existing desktop-based game (Lightbot) and the developed VR game (Logibot) covering similar gameplay mechanics and block-based programming. Initial results indicate that traditional desktop applications are currently more engaging than VR for teaching programming. We thus identify the need for careful design of interaction methods to support ease of use and reward factors to promote engagement in VR-based learning applications beyond the initial wow-factor.


Influence of HMD Type and Spatial Ability on Experiences and Learning in Place-based Education
Pejman Sajjadi, Jiayan Zhao, Jan Oliver Wallgrun, Peter La Femina, Alexander Klippel
The Pennsylvania State University, United States of America
Watch the presentation video

With the emergence of different types of Head-Mounted Displays (HMDs), researchers and educators must make informed decisions on what HMDs best support their needs. When performing experiments with relatively large populations, these decisions are largely affected by the sensing-scaling tradeoff between high-end tethered HMDs and lower-end standalone systems. Higher sensing affords a richer experience, but it is also associated with higher costs in terms of the HMD itself and the need for VR-ready computers. These limitations often impede instructors from using high-end HMDs in an efficient way with larger populations. We report on the results of a study in the context of place-based immersive VR (iVR) Geoscience education that compares the experiences and learning of 45 students after going through an immersive virtual field trip, using either a lower-sensing but scalable Oculus Quest or a higher-sensing but tethered HTC Vive Pro. Our results indicate that students who used the Quest reported significantly higher levels of satisfaction but also more simulator sickness (although still a very low number on average) compared to those who used an HTC Vive Pro. Our findings suggest that with content design considerations, standalone HMDs can be a viable replacement for high-end systems in large-scale studies. Furthermore, our results also suggest that in the context of place-based iVR education, the spatial abilities of students (i.e., sense-of-direction) can be a determining factor in their experiences and learning, and therefore an important topic of study for designing effective place-based iVR experiences.

Presentations

Failure and Success in Using Mozilla Hubs for Online Teaching in a Movie Production Course
Thommy Eriksson
Chalmers University of Technology, Sweden
Watch the presentation video

In the autumn 2020 the course Digital Movie Making was given in a fully online mode, due to the restrictions and lockdowns related to the covid-19 pandemic. With the intention of avoiding Zoom fatigue and provide a more creative and engaging online teaching environment, the social VR platform Mozilla Hubs was chosen for all the lectures, seminars and supervision. The two main reasons for choosing Mozilla Hubs were the openness of the platform, providing wide opportunities for creating and setting up your own virtual space, as well as the option to access the platform via a web browser. However, Mozilla Hubs have a number of usability and technical flaws, making it clumsy to use, and the initial course introduction and guest lecture suffered severe technical issues when all 25 students attended simultaneously. A decision was made to only use Mozilla Hubs for supervision, and this meetings with few students turned out successful. Based on the observations from these learning activities, a number of advantages and disadvantages with VR in general and Mozilla Hubs specifically is presented and discussed.


The Effect of Spatial Design on User Memory Performance Using the Method of Loci in Virtual Reality
Pierre-François Gerard, Frederic Fol Leymarie, William Latham
Goldsmiths, United Kingdom
Watch the presentation video

Based on the Method of Loci, the following experiment compares the effect of two different virtual environments on participants' memory performance. The primary task consists of remembering a sequence of random playing cards. Each virtual environment is based on a different architectural style with a different layout. One is inspired by a Palladian style architecture, and the other by a Modern curved architecture.


Attention management in a 'Smart' Classroom
Maria Erofeeva, Nils Oliver Klowait
Moscow School of Social and Economic Sciences, Russian Presidential Academy of National Economy and Public Administration, Russian Federation
Watch the presentation video

Today, technologies like interactive whiteboards, augmented and virtual reality serve as instructional aids to facilitate interactive learning. The aim of this paper is to study how the use of such technologies impacts the dynamics of classroom attention management. Employing a multimodal conversation-analytic framework, we analyze videorecordings of the first encounters with interactive whiteboards, augmented reality and virtual reality across twelve in-person classroom lessons set in four Russian secondary schools. This paper highlights how the teacher, faced with a breakdown of regular channels for managing attention (such as mutually-orientable gaze), uses their voice and body to facilitate the temporal coordination of student contributions, maintain focus on a given classroom activity, and visibly monitor classroom dynamics. The findings suggest means to alleviate tensions between new and old teaching methods, and provide further evidence on the need for a granular vocabulary for the analysis of body-orientation in a classroom context.

Presentations
 
Implementing Decentralized Virtual Time in P2P Collaborative Learning Environment for Web XR
Nikolai Suslov
Krestianstvo.org, Russian Federation
Watch the presentation video

Virtual worlds and Web XR technologies offer to both programmers and domain experts nearly unlimited capabilities for creating novel computer-based simulated environments just in a web browser. Virtual time is becoming the new crucial concept of collaborative, immersive virtual learning environments (VLE). This paper explores the Croquet software architecture, which is known for its radical synchronization system with the notion of virtual time. It is ideal for developing collaborative serverless apps, but a tiny stateless server named reflector, on which Croquet heavily relies on still prevents doing that today. This paper presents the research, that transforms reflector into a peer-to-peer application Luminary, by implementing decentralized virtual time. The case study describes the prototype of a collaborative Rubik's Cube simulator, backed by three robots for kids. Finally showing how learners can easily experiment with augmenting physical reality, by creating fully synchronized, collaborative robots, operating in a P2P network.
 
 
METAL: Explorations into sharing 3D Educational content across Augmented Reality Headsets and Light Field Displays
Mengya Zheng, Xingyu Pan, Xuanhui Xu, Abraham Campbell
University College Dublin, Ireland
​Watch the presentation video​​​

Augmented Reality and Virtual Reality become increasingly popular in scientific visualization especially for education where they can support collaborative scientific visualization experiences in the classroom. However, the inherent limitations of head-mounted AR and VR tools are stemming the popularization of these existing content-sharing tools. Instead of sharing 3D educational content between AR/VR headsets, this paper proposes a novel prototype Mixed rEaliTy shAring pLatform (METAL) to allow for 3D educational content to be shared between a Microsoft HoloLens 2 and multiple Looking Glass displays which are a type of Light Field (Multi-view Autostereoscopic) display. This platform allows one teacher to use a HoloLens to manipulate and share different 3D contents with multiple student groups via the network, thus each student group can observe the synchronized 3D educational content with autostereoscopic experiences. Therefore, this proposed prototype enables a low-cost one-to-multiple 3D content sharing experience that allows intuitive 3D model interaction and seamless communication between the students and the teacher.
 
 
Design and Development of AR Applications in Online Higher Education A User-Centred Design Approach
Mitch Peters, Laura Calvet Liñan, Antoni Marín Amatller, Laura Porta Simó, Pierre Bourdin Kreitz
Open University of Catalonia, Spain
​Watch the presentation video​​​

The exploration of augmented reality’s (AR) potential in higher education teaching and learning demonstrates an impressive scope of critical inquiry. Online higher education (OHE) represents a transformation in learning practices and educational paradigms on a global scale, with a significant opportunity for the application of AR through e-learning. The overarching goal of the current study is to understand how the presence of AR applications in an OHE multimedia program impacts student learning. The study aims to design and develop a user-centered, AR prototype application that could be used to enhance student learning in STEM education. Implementing a user-centred approach ensures that learners are taken into account from the beginning of the design process and throughout the iterative design lifecycle. The current paper presents the results from the first phase of a multi-stage research project. First, conceptually designed personas, scenario reviews, and user journey mappings were developed based on identified learner needs and AR system requirements previously identified. The results show the design decisions made while revising AR scenarios from the learner’s perspective and exploring design requirements to ensure the feasibility of the AR application. An implication of our study is to demonstrate the value of a range of evaluation techniques presented here using a user-centred design approach, which can be used to design and develop future AR and Xtended reality technologies in educational scenarios.

Presentations

Measuring and Comparing QoE and Simulator Sickness of Hybrid VR Applications under increased network load
Ioannis Doumanis(1), Daphne Economou(2), Lemonia Argyriou(3)
1: University of Central Lanchashire; 2: University of Westminster; 3: National Center for Scientific Research Demokritos
Watch the presentation video

The elements of presence and interaction have been connected with high quality learning in online learning environments. This can be achieved by offering learning environments and material that can engage the learner throughout the learning experience, allow them to connect with the content, find relevance, construct meaning and critical thinking. Hybrid VR applications offer great potential in engaging learners in environments that accurately capture the world allowing them to make personal connections and find relevance, which coupled with branching narrative, Computer Generated Imagery (CGI) and interactivity can lead to highly engaging learning experiences. Hybrid VR applications though are bandwidth demanding that can impact the learning experience. This paper presents a study comparing the Quality of Experience (QoE) of a hybrid VR application streamed over the standard internet and POINT network under increased network load. The paper presents the project motivations, it described a pilot study and its output and it closes with conclusions about the effect of the QoE and presence in learning and future directions.

Student Engagement with Reduced Bias in a Virtual Classroom Environment
Esther Brandon(1), Raphael Freiwirth(2,3)
1: Brandeis University, United States of America; 2: Miramar College, United States of America; 3: The Commons XR, United States of America
 
To Transcend is critical, but the path must contain a mechanism to both combat dis-engagement and bias in a classroom environment. Why bias and engagement issues as one, because one can create an issue with the other. Not all engagement issues are bias-related, but many are. And not all bias issues may create dis-engagement, but certainly, there are many studies that seem to point that it can. Why not use tools in the classroom that can improve engagement and reduce both explicit and implicit bias? Virtual reality is one such tool if used correctly. Join us to explore the possibilities of a classroom environment that might help out the next generation of students to transcend the norms of today!
 

Presentations

Getting there? Together. Cultural Framing of Augmented and Virtual Reality for Art Education
Regina Maria Bäck(1), Rainer Wenrich(1), Birgit Dorner(2)
1: Katholische Universität Eichstätt-Ingolstadt; 2: Katholische Stiftungshochschule München
Watch the presentation video

Informal learning contexts of creating and exploring artefacts through Augmented Reality (AR) and Virtual Reality (VR) are increasingly common. Nevertheless, insights on art educators` perspectives on potential for conceptualization and classroom implementation are scarce. In this study, both art educators a artists share their perspectives on a variety of AR/VR applications, from creating in multiplayer mode to exploring artefacts and loci in SocialVR.
Overall, twenty art educators were exploring a selection of AR/VR applications. The data was collected during online workshops with art teachers coming from diverse backgrounds (elementary and secondary school, special education). Interviews were conducted with six media artists, including pioneers of AR/VR art. Grounded Theory Methodology, specifically Situational Analysis as well as Visual Grounded Theory Methodology was applied. Results highlight media cultural perspectives in proximity and distance to AR/VR related "worlds", by classifying different journeys from first encounter to conceptualization and implementation.


Mobile Augmented Reality Applications in Teaching: A Proposed Technology Acceptance Model
George Koutromanos(1), Tassos A. Mikropoulos(2)
1: National and Kapodistrian University of Athens, Greece; 2: University of Ioannina, Greece
​Watch the presentation video​​​

This study proposed MARAM, a mobile augmented reality acceptance model that determines the factors that affect teachers’ intention to use AR applications in their teaching. MARAM extends TAM by adding the variables of perceived relative advantage, perceived enjoyment, facilitating conditions, and mobile self – efficacy. MARAM was tested in a pilot empirical study with 127 teachers who used educational mobile AR applications and developed their own ones. The results of regression analysis showed that MARAM can predict a satisfactory percentage of the variance in teachers’ intention, attitude, perceived usefulness and perceived ease of use. Attitude, perceived usefulness, and facilitating conditions affected intention. Both perceived usefulness and perceived enjoyment affected attitude. Furthermore, perceived relative advantage and perceived enjoyment affected perceived usefulness. In addition, mobile self-efficacy and facilitating conditions affected perceived ease of use. However, perceived ease of use did not have any effect on attitude and perceived usefulness. MARAM could serve as the basis for future studies on teachers’ acceptance of mobile AR applications and be expanded through the addition of other variables.

Authoring Tools for XR Applications in Education
Stefano Masneri(1), Ana Dominguez(1), Eleni Mangina(2)
1: Vicomtech, Spain; 2: University College Dublin, Ireland
 
In the last few years there has been a steady release of XR-based tools to enhance the learning experience. Until now the focus of researchers has been on the creation of content, but there is currently a lack of tools facilitating the creation of XR experiences for education. The objective of this workshop is to present the work fulfilled in the H2020 ARETE project and to stimulate the discussion around what has been done and what is still left to do to enable researchers and enterprises to easily create XR experiences.