Virtual Reality as Safe Training for High-Risk Situations
Training specialists in the disposal of unexploded ordnance (EOD) is a long-term and demanding process that currently relies on a combination of theory and limited practical training. Real-world scenarios, however, are logistically and safety-wise challenging—and often cannot be repeated with sufficient variability.
This is where virtual reality comes into play. Researchers from the Faculty of Electrical Engineering (FEL) at the Czech Technical University (ČVUT), in collaboration with the Czech Army’s engineering corps, are creating an environment in which specialists can train entire decision-making processes—from the first contact with a suspicious object to the design of a safe procedure for its disposal.
Unlike conventional simulations, the project does not focus on the “mechanics of the operation,” but on the correct assessment of the situation. The key is identifying the type of munition, assessing the risks, and choosing the correct procedure.
“It’s not about learning a single specific operation, but understanding the entire process—how to identify the munition, how to approach it safely, and how to make decisions in a given situation,” explains Prof. Jiří Žára, head of the Department of Computer Graphics and Interaction, who leads the EOD project.
The virtual scenarios are not static. Researchers are working with procedural environment generation, which makes situations change and become unpredictable. “We want the training to be based not merely on memorizing a scenario, but on the user actually having to think and react to new conditions, much like in a real-world deployment,” adds Dr. David Sedláček, who heads the Virtual and Augmented Reality Laboratory.
The system also includes simulations of real-world tools—such as metal detectors or spectrometers—that enable the “discovery” and identification of explosives. User behavior analysis also plays a significant role: the system tracks movement within the scene and evaluates whether safety procedures were followed.
Training in the use of munitions disposal robots is also a key component of the project. “Specialized EOD robots are expensive, and in practice, there are usually only a limited number of them available. The virtual environment allows us to train in their operation on a larger scale,” says Prof. Žára.
“Modern technologies are fundamentally transforming not only the battlefield itself but also the way soldiers are trained. Virtual reality allows us to effectively simulate situations whose training would be very time-consuming and costly in a real-world environment. In the field of EOD, I see its great benefit particularly in training decision-making processes—that is, in how to correctly identify munitions, choose a safe procedure, and minimize risks.
At the same time, it opens the door to broader applications, such as in conjunction with 3D modeling, which can significantly facilitate training and understanding of how different types of munitions function,” says Lieutenant Colonel Ing. Martin Turek, Chief of the Technical and Information Support Center of the 15th Engineer Battalion of the Czech Army.
Holographic Command Center: A Three-Dimensional Overview of the Situation
The second project, known as HOLO-Swarm, focuses on real-time operations management and decision-making. It is being developed in collaboration with the Multi-Robotic Systems (MRS) Group led by Prof. Martin Saska, which has long been developing autonomous drones and robotic systems at the Department of Cybernetics at the Faculty of Electrical Engineering (FEL) of the Czech Technical University (ČVUT).
Today’s systems for monitoring situations in the field are often based on two-dimensional maps, which have their limitations when working with large amounts of data. Augmented reality may be the solution. Researchers at the Faculty of Electrical Engineering (FEL) at CTU are therefore developing a system that allows the entire “battlefield” to be displayed as an interactive 3D model directly in the space in front of the user.
“Traditional maps are flat, and working with them is limited. We want to give the user a spatial view of the situation and the ability to interact with it,” explains Dr. David Sedláček.
The user wears see-through AR glasses and sees a three-dimensional terrain model in front of them, onto which real-time data is projected. The system displays the movement of units—such as swarms of drones—their planned routes, and their current status. “The user can choose which data to monitor—from basic telemetry to a detailed 3D reconstruction of the surroundings. The goal is to provide the best possible overview of what is happening on the ground,” says Sedláček.
The system also allows for active intervention in operations. A commander can assign new targets, adjust trajectories, or replan a mission and observe how the changes play out. Another major advantage is data sharing among multiple users. “The same virtual space can be shared by multiple people—whether they are in one location or at different posts. Everyone sees the same situation and can address it together,” adds Sedláček.
QuaternAR, a company operating in the defense technology sector, is also involved in the implementation of the HOLO-Swarm project. Its software is used in military environments, including by the Czech Army, as well as in the United States and Israel.
“Semi-autonomous robotic systems will form the backbone of defense in the future, especially in situations where a potential adversary has significantly greater human resources. Augmented reality enables a better understanding of the situation on the battlefield and allows the operator to be more deeply immersed in controlling these systems,” says Jan Hovora, director of QuaternAR.
From Defense to Critical Infrastructure
Although both projects are being developed as part of defense research (the PRODEF program), their applications are significantly broader.
“These technologies aren’t just for the military. We also see their use in integrated emergency response systems or in the protection of critical infrastructure, where it’s necessary to quickly assess the situation and make decisions,” says Prof. Jiří Žára.
Both projects are currently in the prototype phase. Researchers are now testing the first versions of the systems and verifying their practical applicability. “We are just getting started and are still verifying how well these approaches will work in real-world deployment. Testing with users and further development will be key,” concludes Dr. David Sedláček.
