A team of European researchers has established a new principle that explains how flying insects determine the direction of gravity, without using accelerometers. These results are an important step towards the creation of tiny autonomous drones.
For proper operation, drones usually use accelerometers to determine the direction of gravity. In a new study published in Nature on 19 October 2022, a team of scientists from Delft University of Technology, the CNRS and Aix-Marseille University has shown that drones can estimate the direction of gravity by combining visual detection of movement with a model of how they move. These results may explain how flying insects determine the direction of gravity and are a major step toward the creation of tiny autonomous drones.
While drones typically use accelerometers to estimate the direction of gravity, the way flying insects achieve this has been shrouded in mystery until now, as they have no specific sense of acceleration. In this study, a European team of scientists1 led by the Delft University of Technology in the Netherlands and involving a CNRS researcher has shown that drones can assess gravity using visual motion detection and motion modelling together.
To develop this new principle, scientists have investigated optical flow, that is, how an individual perceives movement relative to their environment. It is the visual movement that sweeps across our retina when we move. For example, when we are on a train, trees next to the tracks pass by faster than distant mountains. The optical flow alone is not enough for an insect to be able to know the direction of gravity.
However, the research team discovered that it was possible for them to find this direction by combining this optical flow with a modelling of their movement, i.e. a prediction of how they will move. The conclusions of the article show that with this principle it was possible to find the direction of gravity in almost all situations, except in a few rare and specific cases such as when the subject was completely immobile.
During such perfect stationary flights, the impossibility of finding the direction of gravity will destabilize the drone for a moment and therefore put it in motion. This means the drone will regain the direction of gravity at the next instant. So these movements generate slight oscillations, reminiscent of insect flight.
Using this new principle in robotics could meet a major challenge that nature has also faced: How to obtain a fully autonomous system while limiting payload. Future drone prototypes would be lightened by not needing accelerometers, which is very promising for the smallest models of the size of an insect.
Though this theory may explain how flying insects determine gravity, we still need confirmation that they actually use this mechanism. Specific new biological experiments are needed to prove the existence of these neural processes that are difficult to observe in flight. This publication shows how the synergy between robotics and biology can lead to technological advances and new biological research avenues.
Accommodating unobservability to control flight attitude with optic flow. G.C.H.E. de Croon, J.J.G. Dupeyroux, C. De Wagter, A. Chatterjee, D.A. Olejnik, F. Ruffier. Nature, 19 October 2022. DOI:10.1038/s41586-022-05182-2
Photo: Flapping-wing robot controlling its attitude using this new principle. It is equipped with an artificial compound eye inspired by insects, which can perceive optical flow at a high frequency. © Christophe De Wagter/TU Delft