Reducing Frequency Bias of Fourier Neural Operators in 3D Seismic Wavefield Simulations Through Multi-Stage Training

Abstract: The recent development of Neural Operator (NeurOp) learning for solutions to the elastic wave equation shows promising results and provides the basis for fast large-scale simulations for different seismological applications. In this paper, we use the Fourier Neural Operator (FNO) model to directly solve the 3D Helmholtz wave equation for fast seismic ground motion simulations on different frequencies, and show the frequency bias of the FNO model, i.e. it learns the lower frequencies better comparing to the higher frequencies. To reduce the frequency bias, we adopt the multi-stage FNO training, i.e., after training a 1st stage FNO model for estimating the ground motion, we use a second FNO model as the 2nd stage to learn from the residual, which greatly reduced the errors on the higher frequencies. By adopting this multi-stage training, the FNO models show reduced biases on higher frequencies, which enhanced the overall results of the ground motion simulations. Thus the multi-stage training FNO improves the accuracy and realism of the ground motion simulations.