3rd and 4th Family Laboratories – Sensors and XR Glasses
Introduction
The 3rd and 4th Family Laboratories marked a further stage in the experimental development of Pilot 2, continuing the integration of physiological sensors and XR glasses within a laboratory-based setting aligned with the Concerts for Babies approach.
These sessions built on the previous laboratories, while introducing technological upgrades, the XR Score Viewer application and the abstract mapping visualisation system. The aim was to explore how physiological data collected from babies, and in one session also from baby-parent pairs, may be represented visually and interpreted artistically in real time.
The laboratories also allowed artists to become more familiar with the updated XR environment, including different visualisation modes, menu navigation and the ways in which physiological data may contribute to future artistic interpretation and to the ongoing development of the baby composer concept.
Throughout the process, the Human-Centred Approach continued to guide the work, ensuring that technological experimentation remained grounded in the experience of babies, families and artists, and supported processes of co-design and co-creation.

Objectives
- To continue testing the integration of physiological sensors and XR glasses within an experimental concert-laboratory context
- Toobservebabies’ comfort and acceptance of the sensors in a more developed technological setting
- To explore the usability and artistic relevance of the XR Score Viewer application
- To introduce and test updated abstract mapping visualisations
- To analyse how physiological data may be translated into visual information and artistic interpretation
- To compare data collection from babies only with data collection from baby-parent pairs
- To collect feedback from families and artists through questionnaires and reflection moments
- To continue the processes of co-design, co-creationand iterative technological development within the project
- To inform the next stages of development of the baby composer concept

Location
Musicalmente
Rua da Saudade, 20
2410-241 Pousos – Leiria, Portugal
13 June 2026
Artistic preparation session: 14:30 – 16:00 CET
3rd Family Laboratory: 16:30 – 17:15 CET
4th Family Laboratory: 17:30 – 18:15 CET
Artists’ reflection session: 18:30 – 19:30 CET
Participants
The sessions involved 45 participants, including babies, family members, artists and members of the Pilot 2 team.
Families and Babies
- 14 babies
- 20family members, including parents and siblings
Artistic Team
- Paulo Lameiro –ArtisticDirector
- IsabelCatarino
- Bruno Homem
- CristianaLameiro
- InesaMarkava
- DavidRamy
- PedroSantos
Production and Technical Support
- Gil – production and logistical support
Process Support
- Lara Matos –Social Psychologist and Human-Centred Approach Facilitator
- Isabel Lucena –AMPLIFY ConsortiumRepresentative

Materials and Logistics
- Physiological sensors
- Sensor sleeves developed to accommodate and visually integrate the sensors
- XR glasses used by artists
- XR Score Viewer application
- Updated physiological data visualisation system
- Abstract mapping visualisation guide
- Oscilloscope visualisation
- Cameras and audiovisual recording equipment
- Hygiene and disinfection materials for sensor handling
- Integrated informed consent form
- Evaluation questionnaires for families and artists
-
Dedicated time for artists to test the updated XR system before the arrival of families
-
Gradual placement of sensors with parental participation
-
Use of sensors by all babies and childrenparticipatingin the sessions
-
Use of XR glasses and XR Score Viewer by artists
-
In the 3rd Laboratory, data were collected from babies only
-
In the 4th Laboratory, data were collected from baby-parent pairs
-
Maintenance of welcoming and closing rituals, including a shared refreshments moment
-
Final reflection session with the artistic tea
Methodological approach
The sessions followed an exploratory, practice-based approach within a concert-laboratory context.
The methodology combined technological testing, artistic experimentation and observation of the lived experience of babies, families and artists. Sensor placement continued to be conducted relationally, with the active involvement of parents and attention to comfort, trust and the natural rhythm of the session.
A significant development in these laboratories was the introduction of sensor sleeves. These sleeves helped to make the sensors less visible, more comfortable and more aesthetically integrated into the babies’ bodies and clothing. This represented an important step in reducing the perception of the sensors as external technological objects and supporting their more natural integration into the experience.
The Human-Centred Approach remained central throughout the process. Families and artists were not treated only as users of the technology, but as active contributors to the ongoing development of the system. Their feedback, questions and reactions continued to inform the adaptation of the technological tools and the artistic process.
All participating families and artists signed the integrated informed consent forms. In addition, evaluation questionnaires developed within the project were shared with families and artists to gather feedback regarding the development, usability and integration of the technological solutions explored during the laboratories.

Session
Before the arrival of families, artists participated in a dedicated preparation session focused on the updated XR glasses environment and the XR Score Viewer application.
This session allowed artists, including those who had not previously used the XR glasses, to explore the visual information displayed through the glasses, understand the menu system, explore the updated visual representations of physiological data and become familiar with the abstract mapping visualisation.
The preparation moment was also important for clarifying what type of data could be visualised and how these visualisations might support artistic interpretation during the laboratories.
Arrival and Welcome
Families were welcomed informally, maintaining the usual ritual of reception.
The shared and welcoming atmosphere helped create a calm environment before the beginning of the laboratories and supported the relational dimension of the project.
Sensor Introduction
Sensors were introduced gradually, with the active participation of parents.
The use of sensor sleeves contributed to a more subtle and comfortable integration of the sensors. This made the process of placing, removing, rotating and disinfecting the sensors easier and less visually intrusive.
3rd Family Laboratory
The 3rd Laboratory focused on collecting physiological data from babies and young children.
The session unfolded in a concert-laboratory format, combining musical interaction, movement, observation and technological experimentation. Artists used the XR glasses and the XR Score Viewer application to access visualisations associated with the collected data.
4th Family Laboratory
The 4th Laboratory followed a similar structure but introduced a different methodological element: the collection of data from baby-parent pairs.
This allowed the team to begin exploring the possibility of observing relational or shared responses during the musical experience, opening new questions regarding the connection between babies, adults and the artistic environment.
Closing Moment with Families
At the end of each session, families were invited to share their impressions, questions and reflections. The guiding question invited families to express what remained with them from the experience and what questions or curiosities they were taking away.
Families showed particular interest in understanding the final aim of AMPLIFY, the role of the sensors and the way in which collected data may contribute to the future development of baby composer scores.
Shared Informal Moment
A shared refreshments moment was maintained as part of the relational structure of the laboratories.
This moment continued to provide opportunities for informal conversation, clarification of questions and closer interaction between families, artists and the Pilot 2 team.
Artists’ Reflection Session
Following the two family laboratories, a collective reflection session was held with the artists.
This moment focused on the experience of using the XR glasses, the XR Score Viewer application, the updated visualisation systems and the perceived relationship between physiological data and artistic practice.

Reflections and Discussion
Families remained calm, interested and participative throughout the laboratories. The atmosphere was described as relaxed and trusting, with no evident constraint regarding the presence of cameras, sensors or other technological elements.
Compared with previous sessions, technology appeared to be increasingly integrated into the overall experience. Sensors, cameras and XR visualisations seemed less disruptive and more naturally embedded within the artistic and relational environment.
The introduction of sensor sleeves represented an important improvement. Beyond practical advantages related to placement, removal and hygiene, the sleeves contributed to making the sensors more discreet, aesthetically softer and more compatible with the delicate context of work with babies and families.
Parents remained curious about the broader objectives of the project. Their questions focused mainly on where AMPLIFY aims to arrive, what the physiological data may reveal and how these data may contribute to the future development of baby composer scores.
The technological upgrades introduced in these laboratories represented a relevant progression. In addition to the oscilloscope visualisation, artists were able to explore abstract mapping as a new layer of representation. This created a broader chain between data collection and artistic interpretation:
Physiological data → Visual representations → XR visualisation → Artistic interpretation → Future development of baby composer scores.
The abstract mapping guide helped clarify how different indicators may be translated into visual elements. Form, pulse, colour, intensity of movement, solidity and coherence were associated with different physiological or affective dimensions, offering artists a more structured way of interpreting the visual outputs.
At the same time, the sessions highlighted that the interpretation of data remains a complex process. Concepts such as engagement require further clarification, particularly in relation to how physiological indicators are selected, represented and understood within an artistic context.
The use of XR glasses continued to raise usability considerations. Artists noted that correct positioning remains important for visual clarity and comfort. The need to exchange glasses between users may affect adjustment and stability, and two artists reported temporary eye discomfort after removing the glasses.
The menu system and tactile interaction also remain demanding during real-time performance. Artists expressed the need to simplify pathways to the visual information, limiting what is shown to what is most relevant for artistic decision-making.
However, there was a shared perception that the system has evolved. The visualisation is becoming easier to understand, the positioning of visual representations in virtual space has become more functional, and the updated software generated enthusiasm among artists.
The artists also reflected on future equipment developments. The possible introduction of transparent XR glasses was seen as a potentially important improvement, as it could support a more natural integration of the technology into the performance environment and a stronger aesthetic alignment with the artistic context.
The discussion also opened space for reflection on the potential of the “baby choreographer” concept. Although movement is already present in Pilot 2 through the embodied interpretation carried out by the dancer, artists recognised that many of the readings generated from the collected data may also support choreographic processes and movement-based creation.
Another important point was the recognition of the need for dedicated technical support during future sessions. As the system becomes more complex, having a person focused specifically on technological operation, monitoring and correction may allow artists to remain more available for the performative and relational dimensions of the experience.
The artists also highlighted the importance of continuing to build technological literacy within the team. Understanding the system more deeply may help artists to update, interpret and correct sensory information during the creative process.
Overall, these laboratories were perceived as a significant step forward in terms of technological richness, artistic thinking and shared understanding of the project. AMPLIFY continues to emerge as a research process in continuous development, where families, babies, artists, technology and community participation evolve together.

Next Steps
- Continue testing the technological ecosystem developed within Pilot2, including sensors, XR glasses, XR Score Viewer, LightInstruments and costumes.
- Continue optimising technological systems through iterative testing with families and artists.
- Further refine the integration of technological elements within the artistic and relational experience.
- Improve the usability and functionality of XR visualisation systems and interaction processes.
- Continue exploring the relationship between physiological data, visualrepresentationsand artistic interpretation.
- Continue collecting feedback from families and artists through observation,questionnairesand reflection sessions.
- Support the ongoing development of the baby composer concept through co-design and co-creation processes.
- Continue small-scale laboratory testing to inform future developments of Pilot 2.
Conclusion
The 3rd and 4th Family Laboratories represented an important progression in the development of Pilot 2.
These sessions consolidated the work with physiological sensors while introducing more developed visualisation tools through the XR glasses, the XR Score Viewer application and the abstract mapping system.
The increasing integration of technology into the artistic and relational environment suggests that the project is moving towards a more mature and subtle technological presence. The use of sensor sleeves, the improvement of visualisation systems and the growing familiarity of artists with the XR environment all contributed to this evolution.
At the same time, the laboratories made visible important questions that remain open, particularly regarding usability, real-time interaction, data interpretation and the relationship between physiological information and artistic decision-making.
The engagement of families, the curiosity of parents and the reflective involvement of artists continue to provide valuable guidance for the development of the project. These laboratories therefore mark an important step in the ongoing construction of a process where technology does not replace the artistic and relational experience, but gradually becomes a tool to support new forms of creation inspired by babies’ presence, responses and participation.




