Collecting critically endangered cliff plants using a drone-based sampling manipulator
Cliffs present a unique flora that has been little studied until now mainly because of the inherent difficulties to access this unique environment, as shown in Fig. 2. The techniques currently used to access plants on steep slopes and cliffs (e.g., abseiling, helicopter) are generally dangerous, costly and time consuming. Using a small aerial manipulator to sample plants on the cliffs can represent many advantages, including safety and portability, as well as the capability of reaching otherwise inaccessible locations easily, quickly and at low cost.Figure 2Examples of the cliff habitats of some critically endangered species on the Kauaʻi Island along with the count of known individuals as of February 2022.Full size imageHowever, several technical challenges make it difficult to develop suitable aerial manipulators for this task. Indeed, the sampling of plants on cliffs necessarily leads to significant collision risks, as well as contact forces and moments during sampling that can destabilize the drone. The samples collected would also need to be accessed from the side of the aerial platform22. Any weight (e.g., sampling tool, collected samples) located horizontally away from the center of mass of the drone creates large additional demands on the propulsion system of most drones. To collect specific plant parts in windy conditions (e.g., scion, flowers, seeds, etc.), precise and fast motion is required even in degraded Global Navigation Satellite System (GNSS) coverage near the cliffs. The great diversity of plant species and morphology found on cliffs, as well as the variety of targeted sections of plant, also represent a major design challenge. Finally, to maximize the adoption of this tool, it is also desirable that scientists with minimal training could use this platform. The next sections describe how these challenges were addressed through the development of the Mamba.Suspended sampling platformThere are a multitude of configurations that could have been explored to sample plants on cliffs. Some drones have manipulators rigidly attached to their structure20,23. However, these manipulators tend to have a limited reach to keep the center of mass within the propeller footprint and to minimize the inertia of the system. This could result in a high collision risk with the propellers in the uneven terrain found on cliffs. The contact forces created during the sampling operation also generate destabilizing moments through manipulators rigidly attached to the drone. To address these challenges, concepts involving a compliant manipulator operated from specialized drones were also explored10. Alternatively, some aerial manipulators were also passively suspended under the drone through a long rod21,24. This keeps the drone above potential obstacles within the environment, significantly reducing the operator’s mental demand and stress while also reducing the disturbances transmitted to the drone to a downward force aligned with the rod and yaw torque. To maintain these advantages while providing better precision, some projects have developed cable suspended platforms equipped with thrusters25,26. As these platforms do not have to counter gravity, the thrusters can be positioned to fight external disturbances more efficiently (e.g., wind, contact forces, drone movements). Existing systems however only stabilize the suspended platform close to its equilibrium point.The chosen concept for the Mamba, illustrated at Fig. 3, consists of a suspended platform that can stabilize itself far from its natural equilibrium to provide a large workspace. The lifting drone in this system stays safely away and above from steep cliff faces, while supporting the platform and providing rough positioning in space through better GNSS coverage. The platform is suspended 10 m below the lifting drone using four attachment points to prevent pitch and roll motions. The cable also acts as a low pass filter, isolating the platform from the fast drone movements required to fight wind disturbances. The suspended platform design can then focus on fast and precise positioning, while also being tolerant to contacts during sampling. To do so, four pairs of bidirectional actuators are used to control the motion in the plane of the pendulum (i.e., x and y translation, as well as yaw). Two pairs of actuators are installed in the x-direction to provide sufficient force to reach plants as far as 4 m from the equilibrium position. This corresponds to roughly 3.3 m from the tip of the lifting drone’s propellers.Figure 3(a) General concept of the Mamba and lifting drone during transit and sampling on cliffs. (b) Side view of the Mamba showing the components and cable installations. (c) Top view showing the antagonist thrusters configuration. (d) Close-up of the sampling tool and 2 degrees of freedom (DOF) wrist specifically designed to sample small fragile plants.Full size imageSince the Mamba is self-powered and has its own communication system, the lifting drone function is simply to lift the platform and hold it in place. This made it possible to select amongst the many commercially available products to accelerate the development of the Mamba. The DJI M300 was chosen as it comes equipped with a 360° optical obstacle avoidance vision system, an IP45 rating, and a flight time of 20 min with the Mamba attached (3.3 kg). It also advertised a four constellation GNSS receiver for better coverage around buildings, structures, and cliffs.Precise control in windsWinds under 20 km/h represent a gentle breeze on the Beaufort scale. At this level, the wind only moves the leaves, and not the branches, which allows for ideal sampling conditions. According to historical weather data from 2020, daily maximum winds are less than 20 km/h for 40 to 70% of the year, depending on the exact location on Kauaʻi Island (i.e., Lihuʻe International airport, as reported by the National Oceanic and Atmospheric Administration, and the Makaha Ridge Weather Station, as reported in the MesoWest database). This also implies that Kauaʻi experiences stronger winds on certain days which would make precise sampling difficult. Wind conditions are also more challenging near cliff faces, with increased turbulence and vertical airflow along the cliff.To allow operations on most days, while providing precise positioning and fast rejection of wind disturbances, the actuators of the Mamba are oriented in the horizontal plane. This allows the actuator forces to directly affect the motion of the suspended platform. Each actuator of the Mamba consists of a pair of brushless DC motors and 23 cm propellers capable of producing 7 N of force. The motors are installed in opposite directions, are always idling at their minimum rotation speed, and are commanded to only create force in their preferred direction. This antagonistic configuration avoids the low-velocity dead zone of a brushless motor during thrust reversal. This makes it possible to quickly revert the direction of the thrust and nearly triples the bandwidth of the actuators to approximately 2.5 Hz27. This configuration, however, comes at the expense of added mass and components.The Mamba is equipped with a flight controller that includes a control system, and a state estimator. To avoid degraded GNSS coverage issues, the state estimator only uses data from a high accuracy inertial measurement unit (IMU) to estimate the attitude of the platform. This provides the relative position of the platform with respect to the drone and is sufficient for teleoperation. Three separated proportional-derivative controllers are used for each of the DOF controlled by the actuators. This control system also provides attitude-hold assistance (i.e., pitch and roll, which correspond to x and y displacements, as well as yaw). This implies that if the user does not send any commands, the suspended platform maintains its current state.Figure 4 illustrates the stabilization accuracy of the Mamba when moving along a representative trajectory when suspended indoors from a 5.7 m cable (limited by ceiling height). This experiment confirmed that the sampling tool can maintain a position at a horizontal reach of 2.25 m with a precision of about 5 cm for 30 s. As the horizontal reach and precision are limited by the cable angular displacements (e.g., component of weight acting on the pendulum, IMU angular resolution), the resulting workspace when operating with a 10 m long cable would reach a radius of 4 m with a positioning accuracy of about 9 cm. To account for potential external disturbances like wind, the sampling tool was designed with an opening of 15 cm. This creates some margin for the pilot to align the target with the sampling mechanism. Field trials detailed below demonstrated that the Mamba actuators and controller could maintain a sufficiently stable position to sample plants in winds During the sampling phase, wind speed averaged 15.7 km/h with a standard deviation of 6.8 km/h, while wind gusts reached an average of 20.1 km/h with a standard deviation of 6.5 km/h. The maximum average wind speed recorded during sampling was 28 km/h with gusts up to 37 km/h. This represents a lower bound of the system performance, as no failure resulted from the wind conditions experienced during the trials. The a ttached Supplementary Video also demonstrates the stability of the system.Figure 4Representative motion of the sampling tool within its workspace based only on feedback from a high accuracy IMU and recorded using a motion capture system. The natural equilibrium point is at (0,0). The experiment starts with a 90° rotation around the z axis, followed by a forward movement along the x-axis of the Mamba and a lateral movement along its y-axis. The system then maintains this position for 30 s without any user inputs. Produced in MATLAB R2021a.Full size imageTeleoperated sampling of cliffs habitatsPlants growing on Kauaʻi cliffs exhibit a wide morphological variety. For this project, targets ranged from small herbaceous plants such as Euphorbia eleanoriae (plants More