Banner Banner

Crash Testing Machine Learning Force Fields for Molecules, Materials, and Interfaces: Molecular Dynamics in the TEA Challenge 2023

Igor Poltavsky
Mirela Puleva
Anton Charkin-Gorbulin
Gregory Cordeiro Fonseca
Ilyes Batatia
Nicholas J. Browning
Stefan Chmiela
Mengnan Cui
J. Thorben Frank
Stefan Heinen
Bing Huang
Silvan Käser
Adil Kabylda
Danish Khan
Carolin Müller
Alastair J. A. Price
Kai Riedmiller
Kai Töpfer
Tsz Wai Ko
Markus Meuwly
Matthias Rupp
Gabor Csanyi
O. Anatole von Lilienfeld
Johannes T. Margraf
Klaus-Robert Müller
Alexandre Tkatchenko

September 27, 2024

We present the second part of the rigorous evaluation of state-of-the-art machine learning force fields (MLFFs) within the TEA Challenge 2023. This study provides an in-depth analysis of the performance of MACE, SO3krates, sGDML, SOAP/GAP, and FCHL19* in modeling molecules, molecule-surface interfaces, and periodic materials. We compare observables obtained from molecular dynamics (MD) simulations using different MLFFs under identical conditions. Where applicable, density-functional theory (DFT) or experiment serves as a reference to reliably assess the performance of the machine learning models. In the absence of DFT benchmarks, we conduct a comparative analysis based on results from various MLFF architectures. Our findings indicate that at the current stage of MLFF development, the choice of the ML model is becoming less critical, as the resulting simulations are largely independent of the MLFF architecture. Instead, emphasis should be placed on developing complete, reliable, and representative training datasets. Nonetheless, long-range noncovalent interactions remain challenging for all MLFF models, necessitating special caution in simulations of physical systems where such interactions are prominent, such as molecule-surface interfaces. The findings presented here reflect the state of MLFF models as of October 2023.