2nd FAMILY LABORATORY – Experimental Session with Sensors and VR Glasses

2nd FAMILY LABORATORY – Experimental Session with Sensors and VR Glasses

2nd Family laboratory

By Lara Matos, CPL

21 March 2026, Leiria

16:00 – 17:30 CET

This second Family Laboratory marked a further stage in the experimental integration of physiological sensors and XR glasses within a laboratory-based setting aligned with the Concerts for Babies approach.

Building on the first session, this laboratory focused on observing babies’ responses to the sensors, as well as testing the relationship between the physiological data collected and its real-time visualisation through XR glasses used by the artistic team.

The session aimed to explore how these technological elements may support artistic creation, while preserving the relational, sensory and musical qualities that characterise this artistic format.

Objectives

  • To test the integration of physiological sensors and XR glasses within an experimental laboratory-based musical context
  • To observe babies’ comfort and acceptance of the devices
  • To explore the usability and artistic relevance of real-time data visualisation
  • To analyse the relationship between physiological data and artistic decision-making
  • To identify technical, aesthetic and relational constraints
  • To collect feedback from artists through both a structured questionnaire and a collective reflection moment at the end of the session
  • To inform the next stages of development
  •  

Participants

The session involved babies, families, artists and technical support.

Families and Babies

  • Nine babies accompanied by their families

Artistic Team

  • Cristiana Francisco
  • Isabel Catarino
  • Inesa Markava
  • Pedro Santos

Technical Support

  • Gil Jerónimo – responsible for technological setup, monitoring and audiovisual recording

Process Support

  • Lara Matos – Social Psychologist, responsible for mediation with families, sensor procedures and consent

Materials and Logistics

Materials

  • Physiological sensors placed on babies’ ankles
  • Infant socks used to secure the sensors
  • Computer for data reception
  • Oscilloscope projection displaying real-time signals
  • XR glasses used by artists
  • Hygiene and disinfection kits for sensor handling

Logistics

  • Dedicated space for sensor placement
  • Rotational use of sensors among babies, ensuring that all babies experienced the devices
  • Use of XR glasses by all artists during the session
  • Fixed positioning of babies with sensors (due to absence of GPS tracking)
  • Simultaneous use of two sensors
  • Structured session with predefined moments of sensor rotation

Methodological Approach

The session followed an exploratory, practice-based approach within a controlled laboratory context.

Sensor placement was conducted relationally, with the active involvement of parents, ensuring a non-invasive and respectful process. Care was taken to preserve the natural dynamics of interaction between babies, families and artists.

All babies had the opportunity to experience the sensors, and all artists engaged directly with the XR glasses during the session.

The session was fully recorded (audio and video) to enable further analysis, particularly the relationship between physiological data and observable behaviours.

Session Structured

Arrival and Welcome

Families were welcomed informally, maintaining the usual ritual of reception.

Sensor Introduction

Sensors were introduced gradually, with parental participation.

Musical Session

The session unfolded with alternating moments of musical interaction and sensor rotation.

XR Interaction

Artists used XR glasses to access visualisations derived from the sensors.

Real-Time Projection

Physiological signals were displayed simultaneously through an oscilloscope.

Closing Moment

A brief moment of sharing with families took place, allowing for informal feedback, questions and reflections about the experience. Parents expressed appreciation for the project and curiosity about the technology.

 

This was followed by a shared informal moment (refreshments), which enabled closer interaction between the team and the families. This space also allowed for conversations, clarification of the process and completion of consent procedures. The welcoming and closing rituals, as well as this informal gathering, remain an important part of the relational dimension of the project.

A final reflection meeting was also conducted with the artistic team.

Reflections and discussion

Families remained engaged, interested and participative throughout the session, and the relational quality of the experience was preserved. The process of introducing and rotating sensors continued to be well accepted, supported by a careful and respectful approach.

However, this second laboratory made more visible a set of constraints.

The physical characteristics of the sensors raised important considerations. Their size, rigidity and aesthetic presence appeared, in some cases, not fully aligned with the delicacy of the context. One baby refused to wear the sensor, while two others showed signs of hesitation or discomfort, including an initial reaction of apprehension towards the device.

From a technical perspective, a significant delay was observed between data collection and its visualisation, both in the oscilloscope and in the XR glasses. This latency limited the possibility of real-time interaction and reduced the potential usefulness of the data for artistic purposes.

The use of XR glasses revealed several usability challenges. The devices did not always remain stable during performance, particularly when both hands were required, and demanded frequent interaction with menus, interrupting the flow of the performance. The visual outputs were often subtle and difficult to interpret, offering limited variation and making it challenging for artists to translate the information into creative action.

The current system of visualisation, with fixed-position elements, also constrained movement. Artists were required to maintain specific positions to access the information, which reduced their ability to move

freely and to remain fully connected with the babies and families. This created a tension between attending to the technological input and sustaining the relational and artistic engagement that is central to the experience.

Overall, there was a shared perception among artists that, in its current state, the technology provides limited support for creative decision-making. In some moments, it was experienced as constraining rather than enabling, particularly due to the lack of real-time responsiveness and the reduced expressiveness of the visual outputs.

Considering the stage of development of the project, these observations raise relevant questions regarding the alignment between technological evolution and artistic needs, pointing to areas that may benefit from further development.

Next Steps

  • Improve real-time data transmission and reduce latency
  • Explore possibilities for reducing the size and improving the comfort and aesthetic integration of the sensors, in order to better align with the context of use
  • Improve the ergonomics and stability of XR glasses
  • Enhance the clarity and expressiveness of visual outputs
  • Develop more flexible and dynamic visual systems
  • Improve interaction design to better support artistic flow
  • Continue iterative testing in small-scale laboratory contexts

Conclusions

This second Family Laboratory provided an important opportunity to deepen the experimental work, confirming the potential of this approach while also highlighting key challenges in the integration of technology within an artistic and relational context.

While the engagement of families and the overall experience remained strong, the technological components revealed limitations in usability, responsiveness and artistic relevance.

Addressing these aspects will be essential to ensure that the technology can meaningfully support the creative process and the integrity of the experience.

Social media

Other news items

Subscribe to our newsletter

Newsletter / Subscription ( Popup )

Your information will be used to send you the AMPLIFY project Newsletter, managed by the AMPLIFY consortium. Please tick the box to confirm that you understand and would like to receive the newsletter.

You can unsubscribe at any time by clicking the link in the footer of our emails. By subscribing, you acknowledge that your information will be transferred to Mailchimp for processing. Learn about Mailchimp’s legal policies.