Bollettino di Geofisica Teorica e Applicata
OGS Website
About the Journal
Statistiche Web
Contacts
To Authors
On-line Submission
Subscriptions
Forthcoming
On-line First
The Historical First Issue
Issues

2023 Vol. 64
1

2022 Vol. 63
1 / 2 / 3 / 4

2021 Vol. 62
1 / 2 / 3 / 4 / Suppl. 1 / Suppl. 2 / Suppl. 3

2020 Vol. 61
1 / 2 / 3 / 4 / Suppl. 1

2019 Vol. 60
1 / 2 / 3 / 4 / Suppl. 1 / Suppl. 2 / Suppl. 3

2018 Vol. 59
1 / 2 / 3 / 4 / Suppl. 1

2017 Vol. 58
1 / 2 / 3 / 4

2016 Vol. 57
1 / 2 / 3 / 4 / Suppl. 1

2015 Vol. 56
1 / 2 / 3 / 4

2014 Vol. 55
1 / 2 / 3 / 4

2013 Vol. 54
1 / 2 / 3 / 4 / Suppl. 1 / Suppl. 2

2012 Vol. 53
1 / 2 / 3 / 4

2011 Vol. 52
1 / 2 / 3 / 4 / Suppl. 1

2010 Vol. 51
1 / 2-3 / 4 / Suppl. 1

2009 Vol. 50
1 / 2 / 3 / 4

2008 Vol. 49
1 / 2 / 3-4 / Suppl. 1

2007 Vol. 48
1 / 2 / 3 / 4

2006 Vol. 47
1-2 / 3 / 4

2005 Vol. 46
1 / 2-3 / 4

2004 Vol. 45
1-2 / 3 / 4 / Suppl. 1 / Suppl. 2

2003 Vol. 44
1 / 2 / 3-4

2002 Vol. 43
1-2 / 3-4

2001 Vol. 42
1-2 / 3-4

2000 Vol. 41
1 / 2 / 3-4

1999 Vol. 40
1 / 2 / 3-4

1998 Vol. 39
1 / 2 / 3 / 4

1997 Vol. 38
1-2 / 3-4

1995 Vol. 37
145 / 146 / 147 / 148 / Suppl. 1

1994 Vol. 36
141-144 / Suppl. 1

1993 Vol. 35
137-138 / 139 / 140

1992 Vol. 34
133 / 134-135 / 136

1991 Vol. 33
129 / 130-131 / 132

 
 

Vol. 64, n.1, March 2023
pp. 45-60

Inversion of geophysical data supported by Reinforcement Learning

P. Dell'Aversana

Received: 6 September 2022; accepted: 8 November 2022; published online: 7 December 2022

Abstract

Local optimisation algorithms allow exploring a given region of the search space and getting close to, or finding exactly, the extrema of the function in that region (local optima). However, we are more frequently interested in finding global optima of a given objective function. For this purpose, there are many global, or quasi-global, exploration strategies that allow performing an expanded exploration of the model space. Unfortunately, their effectiveness is counterbalanced by their slow convergence towards the solution and, consequently, by long or prohibitive computation times. In order to improve their effectiveness, it is possible to combine global optimisation techniques with local search methods. Based on such hybrid approach, in this paper, we introduce a novel geophysical inversion strategy aimed at optimising the exploration of the model space with the support of Reinforcement Learning (RL) techniques. These include a suite of Machine Learning methods concerned with how intelligent agents ought to take actions by interacting with their environment with the objective to maximise the notion of Cumulative Reward (CR). Following the Bellman equation, this is given by the contribution of a Short-Term and a Long-Term reward, balanced by a trade-off term called discount factor. Adopting these RL concepts, our goal is to teach an artificial agent to search for the global optimum of the cost function, limiting the risk of being trapped in local optima. This can be done by relating the CR to various indicators of the inversion performance, including the trend of the objective function over a limited number of iterations. Using multiple inversion tests on synthetic as well as real geo-electric data, we verified that our approach fits the purpose of expanding the exploration of the model space, finding optimal solutions (global optima) even in complex 3D inversion scenarios.



Download PDF complete



back to table of contents