Ing. Vít Krátký

This paper surveys recent progress and discusses future opportunities for Simultaneous Localization And Mapping (SLAM) in extreme underground environments. SLAM in subterranean environments, from tunnels, caves, and man-made underground structures on Earth, to lava tubes on Mars, is a key enabler for a range of applications, such as planetary exploration, search and rescue, disaster response, and automated mining, among others. SLAM in underground environments has recently received substantial attention, thanks to the DARPA Subterranean (SubT) Challenge , a global robotics competition aimed at assessing and pushing the state of the art in autonomous robotic exploration and mapping in complex underground environments. This paper reports on the state of the art in underground SLAM by discussing different SLAM strategies and results across six teams that participated in the three-year-long SubT competition. In particular, the paper has four main goals. First, we review the algorithms, architectures, and systems adopted by the teams; particular emphasis is put on LIDAR-centric SLAM solutions (the go-to approach for virtually all teams in the competition), heterogeneous multi-robot operation (including both aerial and ground robots), and real-world underground operation (from the presence of obscurants to the need to handle tight computational constraints). We do not shy away from discussing the “dirty details” behind the different SLAM systems, which are often omitted from technical papers. Second, we discuss the maturity of the field by highlighting what is possible with the current SLAM systems and what we believe is within reach with some good systems engineering. Third, we outline what we believe are fundamental open problems, that are likely to require further research to break through. Finally, we provide a list of open-source SLAM implementations and datasets that have been produced during the SubT challenge and related efforts, and constitute a useful resource for researchers and practitioners.

Within the field of multi-robot systems, developing systems that rely only on onboard sensing without the use of external infrastructure (e.g. GNSS) has many potential applications. However, relying only on visual-based modalities for localization presents challenges in terms of accuracy and reliability. We introduce a decentralized multi-robot lateral velocity estimation method for Unmanned Aerial Vehicles (UAVs) to improve onboard measurements in case GNSS infrastructure is not available. This method relies on sharing the onboard measurements of neighbors, as well as the estimation of the relative motion of a focal UAV within the swarm, based on observation of coworking robots. The proposed velocity estimation method does not rely on centralized communication to achieve high reliability and scalability within the swarm system. The performance of the state estimation approach has been verified in simulations and real-world experiments. The results have shown that a swarm of UAVs using the proposed velocity estimator can stabilize individual robots when their primary onboard localization source is not reliable enough.

This paper presents a family of autonomous Unmanned Aerial Vehicles (UAVs) platforms designed for a diverse range of indoor and outdoor applications. The proposed UAV design is highly modular in terms of used actuators, sensor configurations, and even UAV frames. This allows to achieve, with minimal effort, a proper experimental setup for single, as well as, multi-robot scenarios. Presented platforms are intended to facilitate the transition from simulations, and simplified laboratory experiments, into the deployment of aerial robots into uncertain and hard-to-model real-world conditions. We present mechanical designs, electric configurations, and dynamic models of the UAVs, followed by numerous recommendations and technical details required for building such a fully autonomous UAV system for experimental verification of scientific achievements. To show strength and high variability of the proposed system, we present results of tens of completely different real-robot experiments in various environments using distinct actuator and sensory configurations.

In this paper, we propose a solution to the non-Euclidean variant of the Traveling Salesman Problem with Neighborhoods on a Sphere (TSPNS). The introduced problem formulation is motivated by practical scenarios of employing unmanned aerial vehicles in the Reflectance Transformation Imaging (RTI). In the RTI, a vehicle is requested to visit a set of sites at a constant distance from the object of interest and cast light from different directions to model the object from the images captured from another fixed location. Even though the problem can be formulated as an instance of the regular traveling salesman problem, we report a significant reduction of the solution cost by exploiting a non-zero tolerance on the light direction and defining the sites as regions on a sphere. The continuous neighborhoods of the TSPNS can be sampled into discrete sets, and the problem can be transformed into the generalized traveling salesman problem. However, finding high-quality solutions requires dense sampling, which increases the computational requirements. Therefore, we propose a practical heuristic solution based on the unsupervised learning of the Growing Self-Organizing Array (GSOA) that quickly finds an initial solution with the competitive quality to the sampling-based method. Furthermore, we propose a fast post-processing optimization to improve the initial solutions of both solvers. Based on the reported results, the proposed GSOA-based solver provides solutions of a similar quality to the transformation approach while it is about two orders of magnitude less computationally demanding.

This paper introduces an autonomous system employing multirotor unmanned aerial vehicles for fast 3D exploration and inspection of vast, unknown, dynamic, and complex environments containing large open spaces as well as narrow passages. The system exploits the advantage of small-size aerial vehicles capable of carrying all necessary sensors and computational power while providing full autonomy and mobility in constrained unknown environments. Particular emphasis is put on the robustness of the algorithms with respect to challenging real-world conditions and the real-time performance of all algorithms that enable fast reactions to changes in environment and thus also provide effective use of limited flight time. The system presented here was employed as a part of a heterogeneous ground and aerial system in the modeled Search & Rescue scenario in an unfinished nuclear power plant during the Urban Circuit of the Subterranean Challenge (SubT Challenge) organized by the Defense Advanced Research Projects Agency. The main goal of this simulated disastrous scenario is to autonomously explore and precisely localize specified objects in a completely unknown environment and to report their position before the end of the mission. The proposed system was part of the multirobot team that finished in third place overall and in first place among the self-funded teams. The proposed unmanned aerial vehicle system outperformed all aerial systems participating in the SubT Challenge with respect to versatility, and it was also the self-deployable autonomous aerial system that explored the largest part of the environment.

This letter describes a method for autonomous aerial cinematography with distributed lighting by a team of unmanned aerial vehicles (UAVs). Although camera-carrying multi-rotor helicopters have become commonplace in cinematography, their usage is limited to scenarios with sufficient natural light or of lighting provided by static artificial lights. We propose to use a formation of unmanned aerial vehicles as a tool for filming a target under illumination from various directions, which is one of the fundamental techniques of traditional cinematography. We decompose the multi-UAV trajectory optimization problem to tackle non-linear cinematographic aspects and obstacle avoidance at separate stages, which allows us to re-plan in real time and react to changes in dynamic environments. The performance of our method has been evaluated in realistic simulation scenarios and field experiments, where we show how it increases the quality of the shots and that it is capable of planning safe trajectories even in cluttered environments.

This letter presents a self-contained system for the robust utilization of aerial robots in the autonomous exploration of cave environments to help human explorers, first responders, and speleologists. The proposed system is generally applicable to an arbitrary exploration task within an unknown and unstructured subterranean environment and interconnects crucial robotic subsystems to provide full autonomy of the robots. Such subsystems primarily include mapping, path and trajectory planning, localization, control, and decision making. Due to the diversity, complexity, and structural uncertainty of natural cave environments, the proposed system allows for the possible use of any arbitrary exploration strategy for a single robot, as well as for a cooperating team. A multi-robot cooperation strategy that maximizes the limited flight time of each aerial robot is proposed for exploration and search & rescue scenarios where the homing of all deployed robots back to an initial location is not required. The entire system is validated in a comprehensive experimental analysis comprising of hours of flight time in a real-world cave environment, as well as by hundreds of hours within a state-of-the-art virtual testbed that was developed for the DARPA Subterranean Challenge robotic competition. Among others, experimental results include multiple real-world exploration flights traveling over 470 m on a single battery in a demanding unknown cave environment.

The use of robotic systems, especially multi-rotor aerial vehicles, in the documentation of historical buildings and cultural heritage monuments has become common in recent years. However, the teleoperated robotic systems have significant limitations encouraging the ongoing development of autonomous unmanned aerial vehicles (UAVs). The autonomous robotic platforms provide a more accurate and safe measurement in distant and difficult to access areas than their teleoperated counterpart. Through the use of autonomous aerial robotic systems, access to such places by humans and building of external infrastructures like scaffolding for documentation purposes is no longer necessary. In this work, we aim to present a novel autonomous unmanned aerial vehicle designed for the documentation of hardly attainable areas of historical buildings. The prototype of this robot was tested in several historical monuments comprising scanned objects located in dark and hardly accessible areas in the upper parts of tall naves. This manuscript presents the results from two specific places: the Church of St. Anne and St. Jacob the Great in Stará Voda, and St. Maurice Church in Olomouc, both in the Czech Republic. Finally, we also compare the three-dimensional map obtained with the measurements made by the 3D laser scanner carried onboard UAV against the ones performed by a 3D terrestrial laser scanner.

A Reflectance Transformation Imaging technique (RTI) realized by multi-rotor Unmanned Aerial Vehicles (UAVs) with a focus on deployment in difficult to access buildings is presented in this letter. RTI is a computational photographic method that captures a surface shape and color of a subject and enables its interactive re-lighting from any direction in a software viewer, revealing details that are not visible with the naked eye. The input of RTI is a set of images captured by a static camera, each one under illumination from a different known direction. We present an innovative approach applying two multi-rotor UAVs to perform this scanning procedure in locations that are hardly accessible or even inaccessible for people. The proposed system is designed for its safe deployment within real-world scenarios in historical buildings with priceless historical value.

This letter presents a self-contained system for robust deployment of autonomous aerial vehicles in environments without access to global navigation systems and with limited lighting conditions. The proposed system, application-tailored for documentation in dark areas of large historical monuments, uses a unique and reliable aerial platform with a multi-modal lightweight sensory setup to acquire data in human-restricted areas with adverse lighting conditions, especially in areas that are high above the ground. The introduced localization method relies on an easy-to-obtain 3-D point cloud of a historical building, while it copes with a lack of visible light by fusing active laser-based sensors. The approach does not rely on any external localization, or on a preset motion-capture system. This enables fast deployment in the interiors of investigated structures while being computationally undemanding enough to process data online, onboard an MAV equipped with ordinary processing resources. The reliability of the system is analyzed, is quantitatively evaluated on a set of aerial trajectories performed inside a real-world church, and is deployed onto the aerial platform in the position control feedback loop to demonstrate the reliability of the system in the safety-critical application of historical monuments documentation.

This paper presents a novel approach for control and motion planning of formations of multiple unmanned micro aerial vehicles(multi-rotor helicopters, in the literature also often called unmanned aerial vehicles—UAVs or unmanned aerial system—UAS) in cluttered GPS-denied on straitened environments. The proposed method enables us to autonomously design complexmaneuvers of a compact Micro Aerial Vehicles (MAV) team in a virtual-leader-follower scheme. The results of the motionplanning approach and the required stability of the formation are achieved by migrating the virtual leader along with the hullsurrounding the formation. This enables us to suddenly change the formation motion in all directions, independently from thecurrent orientation of the formation, and therefore to fully exploit the maneuverability of small multi-rotor helicopters. Theproposed method was verified and its performance has been statistically evaluated in numerous simulations and experimentswith a fleet of MAVs.

A system designed for a unique multi-robot application of closely flying formations of Unmanned Aerial Vehicles (UAVs) in indoor areas is described in this paper. The proposed solution is aimed as a tool for historians and restorers working in large historical buildings such as churches to provide an access to areas that are difficult to reach by humans. In these objects, it is impossible to keep a large scaffolding for a long time due to regular services, which is necessary for studying a long-term influence of restorations works, and some parts of the churches were even not reached by people for decades and need to be inspected. To provide the same documentation and inspection techniques that are used by the experts in lower easily accessible parts of the buildings, we employ a formation of autonomous UAVs, where one of the robots is equipped by a visual sensor and the others by source of light, which provides the required flexibility for control of lightening. The described system in its full complexity has been implemented with achieved robustness and reliability required by deployment in real missions. The technology demonstration has been provided with real UAVs in historical objects to help restorers and conservationists with achieved valuable results used in plans of restoration works. In these missions, UAVs were autonomously hovering at designated locations to be able to demonstrate usefulness of such robotic lightening approach.

A model predictive control and motion planning algorithm designed for autonomous documentation of large historical buildings by a formation of unmanned Aerial Vehicles (UAVs) is proposed in this paper. In the proposed approach, a self-stabilized formation of multi-rotor helicopters is employed for filming in dark conditions, where one of the UAVs carries the camera and the neighboring UAVs a source of light. This setup is inspired by two techniques often used by historians and restorers. The first one so-called Three point lighting approach [1,4], is a filming technique in which 1-3 sources of light are used in different locations relatively to the camera optical axis. The method enables to create the illusion of a three-dimensional subject in a two-dimensional image and to illuminate the subject being shot (such as sculptures in historical buildings) while controlling the shading and shadows produced by lighting. This is essential for the presentation of historical monuments in interiors to the broad public, as it removes the boring flatness from images and videos, and it adds value to the analysis of gathered results by historians. The second technique frequently used by restorers employs a strong side light for illumination of flat objects, such as walls with parget and mosaics. In this method, the strong light needs to be placed as close as possible to the scanned plain, which makes shadows in the image in a case of a roughness of the surface. Restorers and conservationists can detect from such illuminated pictures if a tile in the mosaic is not fixed properly or if a painting is affected by a humidity indicated by buckling of the wall surface.