Baseline Results for Selected Nonlinear System Identification Benchmarks
Abstract: Nonlinear system identification remains an important open challenge across research and academia. Large numbers of novel approaches are seen published each year, each presenting improvements or extensions to existing methods. It is natural, therefore, to consider how one might choose between these competing models. Benchmark datasets provide one clear way to approach this question. However, to make meaningful inference based on benchmark performance it is important to understand how well a new method performs comparatively to results available with well-established methods. This paper presents a set of ten baseline techniques and their relative performances on five popular benchmarks. The aim of this contribution is to stimulate thought and discussion regarding objective comparison of identification methodologies.
- Akaike, H. (1998). Information theory and an extension of the maximum likelihood principle. In Selected papers of Hirotugu Akaike, 199–213. Springer.
- Nonlinear state-space identification using deep encoder networks. In Learning for dynamics and control, 241–250.
- Continuous-time identification of dynamic state-space models by deep subspace encoding. In The Eleventh International Conference on Learning Representations.
- Billings, S.A. (2013). Nonlinear System Identification: NARMAX Methods in the Time, Frequency, and Spatio-Temporal Domains. Wiley.
- Empirical evaluation of gated recurrent neural networks on sequence modeling. In NIPS 2014 Workshop on Deep Learning, December 2014.
- Linear approximations of nonlinear FIR systems for separable input processes. Automatica, 41(3), 459–473.
- Continuous-time system identification with neural networks: Model structures and fitting criteria. Eur. J. of Control, 59, 69–81.
- dynonet: A neural network architecture for learning dynamical systems. International Journal of Adaptive Control and Signal Processing, 35(4), 612–626.
- Long short-term memory. Neural computation, 9(8), 1735–1780.
- Data set and reference models of EMPS. In 2019 Workshop on Nonlinear System Identification Benchmarks.
- Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980.
- Ljung, L. (1999). System Identification: Theory for the User (second edition). Prentice Hall, Upper Saddle River, New Jersey.
- Murphy, K.P. (2022). Probabilistic Machine Learning: An introduction. MIT Press.
- Identification of a wiener–hammerstein system using the polynomial nonlinear state space approach. Control Engineering Practice, 20(11), 1133–1139.
- Identification of nonlinear systems using polynomial nonlinear state space models. Automatica, 46(4), 647–656.
- On the difficulty of training recurrent neural networks. In International conference on machine learning, 1310–1318.
- System Identification: A Frequency Domain Approach. Wiley-IEEE Press, Hoboken, New Jersey, 2nd edition.
- Gaussian processes for machine learning.
- An unstructured flexible nonlinear model for the cascaded water-tanks benchmark. IFAC-PapersOnLine, 50(1), 452–457.
- Wiener-Hammerstein benchmark. In 15th IFAC Symposium on System Identification, 1–4.
- Nonlinear system identification: A user-oriented road map. IEEE Control Systems Magazine, 39(6), 28–99.
- Cascaded tanks benchmark combining soft and hard nonlinearities. Technical report, 4TU.ResearchData Dataset.
- Three benchmarks addressing open challenges in nonlinear system identification. In 20th World Congress of the International Federation of Automatic Control, 448–453.
- Bidirectional recurrent neural networks. IEEE transactions on Signal Processing, 45(11), 2673–2681.
- Three free data sets for development and benchmarking in nonlinear system identification. In 2013 European Control Conference (ECC), 2933–2938.
- Coupled electric drives data set and reference models. Technical report, Dep. of Information Technology, Uppsala University.
- On evolutionary system identification with applications to nonlinear benchmarks. Mechanical Systems and Signal Processing, 112, 194–232.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.