Search
Close this search box.
Categories
3D Animation AR / VR / XR Story

Teacher – Classroom Simulator using AI

Teacher – Classroom Simulator using AI

In collaboration with Hogeschool Fontys, SEC from TU Delft, and XR Zone, we embarked on creating an AI-driven Teacher Classroom Simulator for didactics courses. Our aim was to explore the potential of VR in teaching and provide educators with a virtual training ground. Lecturers applying VR capabilities to implement innovative didactic methodologies for teaching students. Additionally, XR Zone offers an alternative pedagogical solution, leveraging cutting-edge technology to facilitate knowledge transfer within the classroom.

Their didactic approach prioritises practical applications, applying VR to enhance learning experiences.

 

The project grew from a shared passion for improving teaching through VR. Initially, we focused on education and AI.

The Educational Environment provides immersive classroom experiences with helpful feedback. We tested text prompts and verbal cues to help teachers, using VR to make learning more engaging.

On the AI side, virtual students act like real ones, evaluating teaching skills with voice and behaviour tracking. Two years of development, with a year of refining, taught us a lot from trials with new teachers. Our goal is to make our platform accessible for others and adaptable to different teaching situations to provide immersive education.

Initiator: Dr.ir. Margreet Docter 

Researchers: Tamara De Vries, Alfin Thomas
Developer: Huu Dat Nguyen

Categories
3D Animation AR / VR / XR Story Video

Sarah – AI driven MetaHuman

Introducing Sarah, the remarkable AI-driven MetaHuman born from the innovative fusion of diverse projects and cutting-edge AI experimentation. Conceptualised within the dynamic confines of the XR Zone, Sarah represents a groundbreaking leap in technology-human interaction. Her genesis was marked by the challenge of infusing her with unparalleled realism and interactivity, leveraging state-of-the-art tools such as realistic avatar and OpenAI’s large language models (LLMs). The goal was to capture and articulate her voice, bridging it with lifelike conversation while ensuring swift responsiveness – where speed emerged as the ultimate frontier.

But Sarah’s development extended far beyond mere functionality. Every aspect of her physicality was crafted – from her animated lips to her expressive gaze and nuanced gestures – all aimed at fostering authentic engagement. The culmination of this effort saw Sarah take centre stage, showcased across screens in four distinct iterations, captivating audiences and inspiring her development team. Her debut marked a milestone as she volunteered her talents at XR events, effortlessly hosting and engaging attendees. Her success paved the way for a variety of different opportunities, including hosting the opening of the Faculty of Mechanical Engineering, where her presence commanded recognition.

Subsequent engagements saw Sarah evolve further, adapting her appearance to suit diverse contexts while retaining her core essence of interactivity. From serving as a gracious host at Philosophy event at Theatre De Veste Delft to exploring novel avenues of engagement, Sarah’s potential knows no bounds. 

As we continue to refine and expand Sarah’s capabilities, we invite inquiries and collaborations, eager to explore new horizons alongside our exceptional AI-driven MetaHuman host. Join us as we embark on this journey of innovation and discovery with Sarah leading the way.

Initiator: NMC Media Lab

Developer: Huu Dat Nguyen

Categories
3D Story

3D Scanner

3D Scanner

In the Media Lab we are  setting up a 3D scanner service, currently we are testing and investigating how to implement this service. This includes best practices, optimization and a solution to export and or publish your model in format or formats suitable for several applications.

A handheld 3D scanner is a device that uses lasers and cameras to capture the shape and texture of an object, and then creates a 3D digital model of it. These scanners have become increasingly popular in recent years due to their ability to quickly and easily capture detailed 3D data of a wide range of objects, from small figurines to large industrial parts. Handheld 3D scanners are used in a variety of industries, including manufacturing, engineering, and design. They can also be used for artists who want to create digital models of their creations.

Handheld 3D scanners have a wide range of applications, such as:

  • Reverse engineering
  • Quality control and inspection
  • Rapid prototyping
  • Archiving historical artifacts
  • Cultural heritage and conservation
  • Artistic creation
  • Education

The Scanner available is the Creaform Go Scan.

This is a fast user-friendly handheld 3D scanner that works with lights and cameras. Ideally, it is used for objects as small as approximately 5 cm, up to objects measuring roughly 2 meters, Because it has a cord which is little over 2 meters long. 

3D scanners are used in a variety of industries, including manufacturing, engineering, and design.

Having the scanner is the easy part, but creating instructions to make it user friendly is a challenge that requires a lot work. several sessions have been done with test users and after a few paper versions the first instruction video is being created for new run.

After the scanning a huge amount of data is created and Sharif is finalizing an Application build to do an automated optimization where the model can be converted to more usable formats like glTF and FBX accompanied with PBR materials.

If you have questions, ideas or suggestions do not hesitate to contact us.

Initiator: Vincent Cellucci
Coordinator: Roland van Roijen
Developer: Sharif Bayoumy
Use Case Research: Geertje van Achterberg