
Investigation of how VR/XR impact people’s cognition, sensory perception and movement choices
Dr Becca Weber, Senior Lecturer, Dance Studies Programme; Assoc Prof Danielle Lottridge, School of Computer Science;
Dr Mike Laverick, Senior Solutions Specialist, Centre for eResearch

Background
There are decades of work investigating how to support users in inhabiting avatars’ bodies in immersive experiences. However, we are still learning about how Virtual Reality (VR) can support people in more deeply inhabiting their own bodies. Over the course of five action research workshops, we explored the design space for how VR can support feeling embodied and generating movement within a dance context. We explored design factors and participants’ experiences within: games intended to stimulate physical movement, single player and multiplayer 3D painting, 360 live video, and custom real-time audio and visual feedback based on motion capture. We found that participants spontaneously explored collaboration including synchronous, asynchronous, remote and collocated. Where there were mismatches between visual and kinesthetic perceptions, participants explored how to recalibrate, alternate between, and integrate perceptions. Participants were compelled to explore their control of real-time effects, which led to rich movement generation as we iterated through the effects’ parameters. We present a design space that encapsulates the insights of our action research, with axes for control, collaboration, auditory and visual feedback. We discuss implications for the support of immersive embodiment in dance.
Outcome


Involvement of the Centre for eResearch
See more case study projects

Our Voices: using innovative techniques to collect, analyse and amplify the lived experiences of young people in Aotearoa

Painting the brain: multiplexed tissue labelling of human brain tissue to facilitate discoveries in neuroanatomy

Detecting anomalous matches in professional sports: a novel approach using advanced anomaly detection techniques

Benefits of linking routine medical records to the GUiNZ longitudinal birth cohort: Childhood injury predictors

Using a virtual machine-based machine learning algorithm to obtain comprehensive behavioural information in an in vivo Alzheimer’s disease model

Mapping livability: the “15-minute city” concept for car-dependent districts in Auckland, New Zealand

Travelling Heads – Measuring Reproducibility and Repeatability of Magnetic Resonance Imaging in Dementia

Novel Subject-Specific Method of Visualising Group Differences from Multiple DTI Metrics without Averaging

Re-assess urban spaces under COVID-19 impact: sensing Auckland social ‘hotspots’ with mobile location data

Aotearoa New Zealand’s changing coastline – Resilience to Nature’s Challenges (National Science Challenge)

Proteins under a computational microscope: designing in-silico strategies to understand and develop molecular functionalities in Life Sciences and Engineering

Coastal image classification and nalysis based on convolutional neural betworks and pattern recognition

Determinants of translation efficiency in the evolutionarily-divergent protist Trichomonas vaginalis

Development of an online Community Engagement Platform (CEP) to facilitate out-facing collaborative research

Measuring impact of entrepreneurship activities on students’ mindset, capabilities and entrepreneurial intentions

Using Zebra Finch data and deep learning classification to identify individual bird calls from audio recordings

Automated measurement of intracranial cerebrospinal fluid volume and outcome after endovascular thrombectomy for ischemic stroke

Using simple models to explore complex dynamics: A case study of macomona liliana (wedge-shell) and nutrient variations

Fully coupled thermo-hydro-mechanical modelling of permeability enhancement by the finite element method

Modelling dual reflux pressure swing adsorption (DR-PSA) units for gas separation in natural gas processing

Molecular phylogenetics uses genetic data to reconstruct the evolutionary history of individuals, populations or species

Wandering around the molecular landscape: embracing virtual reality as a research showcasing outreach and teaching tool
