NewMedia Centre Stories

Sarah – AI driven MetaHuman

Introducing Sarah, the remarkable AI-driven MetaHuman born from the innovative fusion of diverse projects and cutting-edge AI experimentation. Conceptualised within the dynamic confines of the XR Zone, Sarah represents a groundbreaking leap in technology-human interaction. Her genesis was marked by the challenge of infusing her with unparalleled realism and interactivity, leveraging state-of-the-art tools such as realistic avatar and OpenAI’s large language models (LLMs). The goal was to capture and articulate her voice, bridging it with lifelike conversation while ensuring swift responsiveness – where speed emerged as the ultimate frontier.

But Sarah’s development extended far beyond mere functionality. Every aspect of her physicality was crafted – from her animated lips to her expressive gaze and nuanced gestures – all aimed at fostering authentic engagement. The culmination of this effort saw Sarah take centre stage, showcased across screens in four distinct iterations, captivating audiences and inspiring her development team. Her debut marked a milestone as she volunteered her talents at XR events, effortlessly hosting and engaging attendees. Her success paved the way for a variety of different opportunities, including hosting the opening of the Faculty of Mechanical Engineering, where her presence commanded recognition.

“As we continue to refine and expand Sarah’s capabilities, we invite inquiries and collaborations”

Subsequent engagements saw Sarah evolve further, adapting her appearance to suit diverse contexts while retaining her core essence of interactivity. From serving as a gracious host at Philosophy event at Theatre De Veste Delft to exploring novel avenues of engagement, Sarah’s potential knows no bounds. 

As we continue to refine and expand Sarah’s capabilities, we invite inquiries and collaborations, eager to explore new horizons alongside our exceptional AI-driven MetaHuman host. Join us as we embark on this journey of innovation and discovery with Sarah leading the way.

Initiator: XR Zone / Arno Freeke
Developer: Huu Dat Nguyen
Coordinator: Roland van Roijen

Read more stories:

Teacher – Classroom Simulator using AI

In collaboration with Hogeschool Fontys, TU Delft, and XR Zone, we developed an AI-driven Teacher Classroom Simulator for didactics courses. The project explores how VR can enhance teacher training by offering immersive classroom experiences with real-time feedback. Virtual students simulate authentic behaviour, helping educators refine their skills. By prioritising practical applications, the platform aims to make innovative, immersive education accessible and adaptable to diverse teaching contexts.

Read More »
VR robot

Supermarket Robot: Designing Socially Embedded Service Robots in Virtual Reality

What happens when a robot helps you shop? This question shaped a groundbreaking project led by Dr. Marco Rozendaal, where VR simulations in a supermarket explored how people and robots interact in public spaces. By blending design, theatre, and puppeteering, the research revealed how robots can earn trust and acceptance—not through perfect programming, but by designing behaviors that feel meaningful and socially appropriate.

Read More »

Collegerama: The Go-To platform for students at TU Delft

Collegerama is TU Delft’s essential platform for recorded lectures, offering students flexible, high-quality access to course content. With synchronized video, slides, and audio captured across 20 lecture halls and mobile setups, it supports learning at any pace and helps with exam preparation. Students can watch lectures from any faculty, expanding their learning opportunities. With new tracking cameras and AI-powered captions, Collegerama continues to evolve, making education more accessible and effective.

Read More »