TOP
Search the Dagstuhl Website
Looking for information on the websites of the individual seminars? - Then please:
Not found what you are looking for? - Some of our services have separate websites, each with its own search option. Please check the following list:
Schloss Dagstuhl - LZI - Logo
Schloss Dagstuhl Services
Seminars
Within this website:
External resources:
  • DOOR (for registering your stay at Dagstuhl)
  • DOSA (for proposing future Dagstuhl Seminars or Dagstuhl Perspectives Workshops)
Publishing
Within this website:
External resources:
dblp
Within this website:
External resources:
  • the dblp Computer Science Bibliography


Dagstuhl Seminar 23482

Social XR: The Future of Communication and Collaboration

( Nov 26 – Dec 01, 2023 )

(Click in the middle of the image to enlarge)

Permalink
Please use the following short url to reference this page: https://www.dagstuhl.de/23482

Organizers

Contact

Shared Documents



Schedule

Summary

This Dagstuhl Seminar focused on Social XR and the future of communication and collaboration, with a particular interest on:

  • Capturing and modelling of humans, ensuring realistic representation of the users and thus allowing for realistic and immersive experiences;
  • Digital proxemics and social metrics, that help and enrich communication and collaboration between the participants;
  • Instrumentation and evaluation, focusing on the possibility of evaluating and monitoring the experience of the users;
  • Principles of Social XR, for making sure that the right values and principles are followed;
  • Exploration of design approaches for Social XR, that support communication and connection by enabling and strategically heightening social signalling and dynamics.

To start the seminar, each participant presented relevant social XR research through rapid talks (see Section 2 and Figure 2 of the full report), which were then used to finalize the topics to discuss on the remaining days of the seminar. We settled on three topics that participants in small groups would focus on, led by members of the organizing committee with a provocation at the start of each day:
TUESDAY: Social XR Design Approaches, Ethics, and Values led by Katherine Isbister and Alexandra Kitson,
WEDNESDAY: Capturing and Modeling Social XR led by Mark Billinghurst and Mar Gonzalez-Franco,
THURSDAY: Proxemics, Metrics, Instrumentation, and Evaluation of Social XR led by Pablo Cesar and Julie Williamson,
THURSDAY: Grand Challenges of Social XR led by the organizers.

As a major result of the seminar, we identified the following grand challenges:

  1. Subjectivity of scientific evaluation of empathy
  2. Ethical concerns of sharing physiological data and social XR relationships
  3. Ethics of the growing digital divide
  4. Blending realities, beyond visual and audio
  5. Semantic understanding of the physical and social context
  6. Social stitching to create a cohesive scene or world
  7. Preserving privacy given the increasing fidelity of capture devices
  8. Tension between transparency and social superpowers
  9. Devising a shared platform that facilitates collaborative recording, replaying, and immersive experiences
  10. New metrics and questionnaires for social XR

In addition to the rapid talks and topic discussions, participants shared demos of their work on Tuesday:

Social activities in the music room, cellar, games room, and sauna led to some discussions around capturing and modelling leading into Wednesday's session (see this social media post for some examples) as well as an impromptu research study on cross-reality asymmetrical co-located social games by playing two games: DAVIGO and Acron.

Results of the brainstorming session on Day 1. Results of the brainstorming session on Day 1. Results of the brainstorming session on Day 1. Participants enjoy social events around Dagstuhl.
Figure 1 Participants enjoy social events around Dagstuhl.

In terms of outputs and future collaborations, we plan to share our findings in an opinion article or forum. We have analyzed, written, and submitted the results of the impromptu research study in the cellar and games room to a top-tier conference in our field. Additionally, we have discussed a potential book on social XR with the seminar participants based on the topics of this seminar. We plan to hold follow-up events and workshops at relevant conferences to further explore the grand challenges that we identified through this seminar.

Copyright Mark Billinghurst, Pablo Cesar, Mar Gonzalez-Franco, Katherine Isbister, and Julie Williamson

Motivation

We are rapidly moving towards a hybrid world where communication and collaboration occur in reality, virtuality, and everywhere in-between. But, are current technologies ready for such a shift? Available solutions for telepresence create exhaustion and fatigue because we lose key social signals when interacting remotely, for example there is a loss of mobility, limited capability for gesture, and inability to establish eye contact. This Dagstuhl Seminar aims to lay the foundations for a new paradigm for immersive communication and collaboration. Social Extended Reality (XR) systems promise to overcome the limitations of current real-time teleconferencing systems, enabling a better sense of immersion, enhancing the sense of presence, and fostering more successful interpersonal interactions. The possibility for familiar, meaningful, and strategically heightened social interaction in XR has positioned immersive technology as the future of real-time communication and collaboration.

XR is currently at a critical moment, with major corporations putting stakes in the ground for what our shared workplace future will be, and young people increasingly exploring creative new forms of casual interaction in rapidly growing XR platforms such as VR Chat, Ready Player Me, Spatial, and others, and also with technologies traditionally not thought of as XR, such as the Avatars already available to millions of users in tools like Microsoft Teams. It is timely to bring together participants with both industry and academic expertise to discuss the future of communication and collaboration at this inflection point.

The goal of this Dagstuhl Seminar is to explore social XR as the future of communication and collaboration. We aim to gather academics and practitioners from different disciplines in order to adequately address the open challenges of immersive interaction, including the ethical, legal, and societal aspects of this possible future. This seminar focuses on Social XR and the future of communication and collaboration, with a particular interest on:

  • Capturing and modelling of humans, ensuring realistic representation of the users and thus allowing for realistic and immersive experiences;
  • Digital proxemics and social metrics, that help and enrich communication and collaboration between the participants;
  • Instrumentation and evaluation, focusing on the possibility of evaluating and monitoring the experience of the users;
  • Principles of Social XR, for making sure that the right values and principles are followed;
  • Exploration of design approaches for Social XR that support communication and connection by enabling and strategically heightening social signalling and dynamics.
Copyright Mark Billinghurst, Pablo Cesar, Mar Gonzalez-Franco, Katherine Isbister, and Julie Williamson

Participants

Classification
  • Human-Computer Interaction

Keywords
  • Immersive Technology
  • Social Extended Reality
  • 3D Capture and Modelling
  • Multisensory Experiences
  • Digital Proxemics