XRHQ
Spain
Education

IE University Uses VR for Remote Robotics Experiments

IE University's PUPPET research project connects an immersive virtual laboratory to a physical robot for remote experiments.

#DigitalTwin
Added on

Worked on this project?

Get credited on this page

A woman wearing a white VR headset holds two controllers beside a TIAGo robot grasping an orange object.
A VR user guides TIAGo as it grasps an object in IE University's PUPPET project.

Sign in to view 7 more media items

IE University is using virtual reality to connect researchers to a physical robot through PUPPET, a research project at its CyPhy Life AI and Robotics Lab in Madrid. The project provides an immersive virtual laboratory for remote experimentation, with the aim of widening access to laboratory hardware.

Researcher Mahika Vats describes the link between the virtual laboratory and physical hardware as a way to test ideas under real-world conditions, including slipping grippers, changing lighting and sensor errors.

Connecting the virtual laboratory to the robot

The project brings together several components:

  • Unity was used to build the virtual version of the laboratory.
  • TIAGo, a robot from PAL Robotics, served as the physical robotic platform.
  • ROS connected the VR environment, the robot and the tools used to monitor and record experiments.
  • MoveIt supported robot motion planning.
  • OptiTrack was used to track movement during development of the teleoperation system.

Vats describes coordinating the virtual environment, network delays and the robot's physical movements as a central challenge in building a stable system for data collection.

Quotes

“Remote experimentation is a game-changer because it allows science without a lab. Today, many experiments require expensive laboratories and specialised equipment. If you are not in the right university or country, it is difficult to participate. PUPPET allows students and researchers in different parts of the world to test ideas and collect reliable data without needing physical access to the space”

“Computer simulations are useful for testing algorithms, but they operate in ideal conditions. In the real world, robot grippers slip, lighting changes, and sensors misread distances. By creating a digital twin of the lab and linking it directly to physical hardware, PUPPET lets researchers run reliable experiments that account for real-world friction and delays”

“The hardest part is managing multiple layers of technology that constantly affect one another. On a project like this, you have to think like a designer, a software developer, and a data analyst on the same day. A small change in the virtual space alters how the user moves. A slight network delay affects the robot's physical movement, and that changes the quality of the data collected. The real challenge is making all these separate parts work together as one stable system.”

Project Summary

This information is available to registered members of XRHQ. Sign up for free below.

Experience

Available to XRHQ members

Hardware

Available to XRHQ members

Software

Available to XRHQ members

Sources

Available to XRHQ members

Know more about this project? Help us fill in any missing details.

Edit this project →

Worked on this project?

Get credited on this page

This write-up is free to reuse with credit — CC BY 4.0.