MODELING AND AUTHORING OF XR APPLICATIONS

Master Thesis in Human-Computer Interaction & Design
Politecnico di Milano
October 7th, 2021

Image

XRM Model

Conceptual Model

The XRM Model is a theoretical approach oriented towards the conceptualisation of XR experiences, developed from a comparative study of existing models in the literature. The XRM Conceptual Model stems from the need to provide a tool capable of covering most of all the technologies included in the Virtual Continuum. We found the design features of XR that are fundamental to the development of XR applications and that can be modelled by structural, behavioural and interaction properties.

What I did

  • Literature Review
  • Concept Design with Miro
  • Conceptual Modeling
  • Protyping with iPad
  • Visual Design with Sketch

Visit XRM Repo


ART Editor

Authoring tool

The ART Framework is a project funded by EIT Digital in collaboration with Politecnico di Milano, Fifthingenium S.r.l.s., Technische Universit├Ąt Berlin and TIM that aims at creating an Extended Reality as a Service (XRaaS) platform to enhance tourism in places with a high historical, cultural and artistic value. The system architecture of the ART XRaaS is composed by different modules, each reflecting a phase of the creation process of an XR experience. The ART Editor is ART Framework's module involved in the interaction authoring phase. It is based on the XRM conceptual-model and it allows to design the model of XR experiences. Furthermore, the model was validated in a usability test with users based on the ISO 9241-11 standard.

Technological choices:

  • WebApp written in HTML, CSS and JavaScript
  • GoJS framework allows to build interactive diagrams
  • Exportable JSON configuration file

Visit ART Editor

XRM Model Definition Process

Image

Phase 1: Identification in literature of XR main components and gestures.

Image

Phase 2: Overview of XR main components and gestures.

Image

Phase 3: Refined overview of XR main components and gestures.

Image

The aim of the XRM Model is to create a means to enable high-level development of XR applications, in order to involve also non-experts in the domain.

Image

The XRM Conceptual Model is divided into three parts: Structural Model, Behaviourl Model and Interaction Model.

ART Editor Definition Process

Image

ART Phase 1: Table of the possible combinations of Objects, Actions and Effects.

Image

ART Phase 2: Diagram of the possible combinations of Objects, Actions and Effects.

Image

ART Phase 3: Low level and High level Design of Objects, Actions and Effects.

Image

ART Phase 4: Testing of the ART Editor throug a real case study, NURE (1).

Image

ART Phase 4: Testing of the ART Editor throug a real case study, NURE (2).

Case Study

Image

NURE Case Study: A Mixed Reality Musealization project of an archaeological area

Image

NURE Case Study: A Mixed Reality Musealization project of an archaeological area

Image

NURE Case Study: A Mixed Reality Musealization project of an archaeological area

Image

NURE Case Study: A Mixed Reality Musealization project of an archaeological area

Image

NURE Case Study: A Mixed Reality Musealization project of an archaeological area

Image

NURE Case Study: A Mixed Reality Musealization project of an archaeological area

Image

NURE Case Study: A Mixed Reality Musealization project of an archaeological area

Image

NURE Case Study: A Mixed Reality Musealization project of an archaeological area

Image

NURE Case Study: A Mixed Reality Musealization project of an archaeological area

Usability Evaluation

Image

Usability Evaluation: Quantitative Metrics.

Image

Usability Evaluation: Procedure.

Image

Usability Evaluation: Results.

Image

Usability Evaluation: Effectivness.

Image

Usability Evaluation: Efficiency.

Image

Usability Evaluation: Performance Effectivness/Efficiency.