Talk
The ants walk: finding geodesics in graphs using reinforcement learning
Talk by Dr. Cécile Mailler
Speaker invited by: Prof. Dr. Jean Bertoin
Date: 27.10.21 Time: 17.15 - 18.15 Room: ETH HG G 19.1
How does a colony of ants find the shortest path between its nest and a source of food without any means of communication other than the pheromones each ant leave behind itself? In this joint work with Daniel Kious (Bath) and Bruno Schapira (Marseille), we introduce a new probabilistic model for this phenomenon. In this model, the nest and the source of food are two marked nodes in a finite graph. Ants perform successive random walks from the nest to the food, and the distribution of the n-th walk depends on the trajectories of the (n-1) previous walks through some linear reinforcement mechanism. Using stochastic approximation methods, couplings with Pólya urns, and the electric conductances method for random walks on graphs (which I will explain on some simple examples), we prove that, depending on the exact reinforcement rule, the ants may or may not always find the shortest path(s) between their nest and the source food.