Papers
Topics
Authors
Recent
Search
2000 character limit reached

SambaMixer: State of Health Prediction of Li-ion Batteries using Mamba State Space Models

Published 31 Oct 2024 in cs.LG | (2411.00233v1)

Abstract: The state of health (SOH) of a Li-ion battery is a critical parameter that determines the remaining capacity and the remaining lifetime of the battery. In this paper, we propose SambaMixer a novel structured state space model (SSM) for predicting the state of health of Li-ion batteries. The proposed SSM is based on the MambaMixer architecture, which is designed to handle multi-variate time signals. We evaluate our model on the NASA battery discharge dataset and show that our model outperforms the state-of-the-art on this dataset. We further introduce a novel anchor-based resampling method which ensures time signals are of the expected length while also serving as augmentation technique. Finally, we condition prediction on the sample time and the cycle time difference using positional encodings to improve the performance of our model and to learn recuperation effects. Our results proof that our model is able to predict the SOH of Li-ion batteries with high accuracy and robustness.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (75)
  1. The Hidden Attention of Mamba Models, 3 2024. URL http://arxiv.org/abs/2403.01590. arXiv:2403.01590 [cs].
  2. MambaMixer: Efficient Selective State Space Models with Dual Token and Channel Selection, 3 2024. URL http://arxiv.org/abs/2403.19888. arXiv:2403.19888 [cs].
  3. Video Mamba Suite: State Space Model as a Versatile Alternative for Video Understanding, 3 2024a. URL http://arxiv.org/abs/2403.09626. arXiv:2403.09626.
  4. A self-attention knowledge domain adaptation network for commercial lithium-ion batteries state-of-health estimation under shallow cycles. Journal of Energy Storage, 86, 5 2024b. ISSN 2352152X.
  5. Li-ion batteries parameter estimation with tiny neural networks embedded on intelligent iot microcontrollers. IEEE Access, 8:122135–122146, 2020. ISSN 21693536. doi: 10.1109/ACCESS.2020.3007046.
  6. [Mamba-2] Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality, 5 2024. URL http://arxiv.org/abs/2405.21060. arXiv:2405.21060 [cs].
  7. A Comprehensive Review of Lithium-Ion Batteries Modeling, and State of Health and Remaining Useful Lifetime Prediction. IEEE Access, 10:119040–119070, 2022. ISSN 2169-3536. doi: 10.1109/ACCESS.2022.3221137. URL https://ieeexplore.ieee.org/document/9944663/?arnumber=9944663. Conference Name: IEEE Access.
  8. Audio Mamba: Bidirectional State Space Model for Audio Representation Learning, 6 2024. URL http://arxiv.org/abs/2406.03344. arXiv:2406.03344 [cs, eess].
  9. Gpt4battery: An llm-driven framework for adaptive state of health estimation of raw li-ion batteries. 1 2024. URL http://arxiv.org/abs/2402.00068.
  10. Ann Fernholm. The Nobel Prize in Chemistry 2019. The Royal Swedish Academy of Sciences, 2019. URL https://www.nobelprize.org/prizes/chemistry/2019/popular-information/.
  11. In-operando high-speed tomography of lithium-ion batteries during thermal runaway. Nature Communications, 6, 4 2015. ISSN 20411723. doi: 10.1038/ncomms7924.
  12. [H3] Hungry Hungry Hippos: Towards Language Modeling with State Space Models, 4 2023. URL http://arxiv.org/abs/2212.14052. arXiv:2212.14052 [cs].
  13. Lithium-ion battery aging mechanisms and life model under different charging stresses. Journal of Power Sources, 356:103–114, 2017. ISSN 03787753. doi: 10.1016/j.jpowsour.2017.04.084.
  14. Hybrid random forest regression and artificial neural networks for modelling and monitoring the state of health of li-ion battery. J. Electrical Systems, 20:2231–2243, 7 2024. ISSN 11125209.
  15. Li-ion battery capacity prediction using improved temporal fusion transformer model. Energy, 296, 6 2024. ISSN 18736785.
  16. Mamba: Linear-Time Sequence Modeling with Selective State Spaces, 5 2024. URL http://arxiv.org/abs/2312.00752. arXiv:2312.00752 [cs].
  17. HiPPO: Recurrent Memory with Optimal Polynomial Projections, 10 2020. URL http://arxiv.org/abs/2008.07669. arXiv:2008.07669 [cs, stat].
  18. [LSSL] Combining Recurrent, Convolutional, and Continuous-time Models with Linear State-Space Layers, 10 2021. URL http://arxiv.org/abs/2110.13985. arXiv:2110.13985 [cs].
  19. [S4] Efficiently Modeling Long Sequences with Structured State Spaces, 8 2022a. URL http://arxiv.org/abs/2111.00396. arXiv:2111.00396 [cs].
  20. [S4D] On the Parameterization and Initialization of Diagonal State Space Models, 8 2022b. URL http://arxiv.org/abs/2206.11893. arXiv:2206.11893 [cs].
  21. How to Train Your HiPPO: State Space Models with Generalized Orthogonal Basis Projections, 8 2022c. URL http://arxiv.org/abs/2206.12037. arXiv:2206.12037 [cs].
  22. [DSS] Diagonal State Spaces are as Effective as Structured State Spaces, 5 2022. URL http://arxiv.org/abs/2203.14343. arXiv:2203.14343 [cs].
  23. Prognostics of lithium-ion batteries based on Dempster–Shafer theory and the Bayesian Monte Carlo method. Journal of Power Sources, 196(23):10314–10321, 12 2011a. ISSN 0378-7753. doi: 10.1016/j.jpowsour.2011.08.040. URL https://www.sciencedirect.com/science/article/pii/S0378775311015400.
  24. Structural and thermal stabilities of layered li(ni1/3co 1/3mn1/3)o2 materials in 18650 high power batteries. Journal of Power Sources, 196:10322–10327, 12 2011b. ISSN 03787753. doi: 10.1016/j.jpowsour.2011.08.042.
  25. Battery health state prediction based on singular spectrum analysis and transformer network. Electronics (Switzerland), 13, 7 2024. ISSN 20799292.
  26. Densely connected convolutional networks, 2018. URL https://arxiv.org/abs/1608.06993.
  27. A comprehensive review of lithium-ion batteries used in hybrid and electric vehicles at cold temperatures. Applied Energy, 164:99–114, 2 2016. ISSN 03062619. doi: 10.1016/j.apenergy.2015.11.034.
  28. Quantifying the influence of the crowded cytoplasm on small molecule diffusion. Journal of Physical Chemistry B, 120:8696–8706, 8 2016. ISSN 15205207. doi: 10.1021/acs.jpcb.6b03887.
  29. On the computational complexity of self-attention, 2022. URL https://arxiv.org/abs/2209.04881.
  30. Fractalnet: Ultra-deep neural networks without residuals. CoRR, abs/1605.07648, 2016. URL http://arxiv.org/abs/1605.07648.
  31. VideoMamba: State Space Model for Efficient Video Understanding, 3 2024. URL http://arxiv.org/abs/2403.06977. arXiv:2403.06977 [cs].
  32. 30 Years of Lithium‐Ion Batteries. Advanced Materials, 30(33):1800561, 8 2018. ISSN 0935-9648, 1521-4095. doi: 10.1002/adma.201800561. URL https://onlinelibrary.wiley.com/doi/10.1002/adma.201800561.
  33. State of health estimation for li-ion battery via partial incremental capacity analysis based on support vector regression. Energy, 203, 2020. ISSN 03605442. doi: 10.1016/j.energy.2020.117852.
  34. Data-driven health estimation and lifetime prediction of lithium-ion batteries: A review. Renewable and Sustainable Energy Reviews, 113, 10 2019. ISSN 18790690. doi: 10.1016/j.rser.2019.109254.
  35. Jamba: A Hybrid Transformer-Mamba Language Model, 3 2024. URL http://arxiv.org/abs/2403.19887. arXiv:2403.19887 [cs] version: 1.
  36. Audio Mamba: Pretrained Audio State Space Model For Audio Tagging, 5 2024. URL http://arxiv.org/abs/2405.13636. arXiv:2405.13636 [cs, eess].
  37. A comparative study of equivalent circuit models and enhanced equivalent circuit models of lithium-ion batteries with different model structures. In 2014 IEEE Conference and Expo Transportation Electrification Asia-Pacific (ITEC Asia-Pacific), pages 1–6, 8 2014. doi: 10.1109/ITEC-AP.2014.6940946. URL https://ieeexplore.ieee.org/document/6940946/metrics#metrics.
  38. Review on degradation mechanism and health state estimation methods of lithium-ion batteries, 8 2023. ISSN 25890379.
  39. VMamba: Visual State Space Model, 5 2024. URL http://arxiv.org/abs/2401.10166. arXiv:2401.10166 [cs].
  40. Decoupled weight decay regularization. CoRR, abs/1711.05101, 2017. URL http://arxiv.org/abs/1711.05101.
  41. Deep learning to estimate lithium-ion battery state of health without additional degradation experiments. Nature Communications, 14(1):2760, 5 2023. ISSN 2041-1723. doi: 10.1038/s41467-023-38458-w. URL https://www.nature.com/articles/s41467-023-38458-w.
  42. Lithium-ion battery state of health estimation using a hybrid model based on a convolutional neural network and bidirectional gated recurrent unit. Engineering Applications of Artificial Intelligence, 127:107199, 1 2024. ISSN 0952-1976. doi: 10.1016/j.engappai.2023.107199. URL https://www.sciencedirect.com/science/article/pii/S0952197623013830.
  43. Paulius et.al. Micikevicius. Mixed precision training, 2018. URL https://arxiv.org/abs/1710.03740.
  44. Transformer-based online battery state of health estimation from electric vehicle driving data. 1 2024. doi: 10.46855/energy-proceedings-11038.
  45. S4ND: Modeling Images and Videos as Multidimensional Signals Using State Spaces, 10 2022. URL http://arxiv.org/abs/2210.06583. arXiv:2210.06583 [cs, eess].
  46. Overcharge-induced capacity fading analysis for large format lithium-ion batteries with liyni1/3co1/3mn1/3o2 + liymn2o4 composite cathode. Journal of Power Sources, 279:626–635, 4 2015. ISSN 03787753. doi: 10.1016/j.jpowsour.2015.01.051.
  47. Training tips for the transformer model. The Prague Bulletin of Mathematical Linguistics, 110(1):43–70, 4 2018. ISSN 1804-0462. doi: 10.2478/pralin-2018-0002. URL http://dx.doi.org/10.2478/pralin-2018-0002.
  48. A data-driven auto-cnn-lstm prediction model for lithium-ion battery remaining useful life. IEEE Transactions on Industrial Informatics, 17:3478–3487, 5 2021. ISSN 19410050. doi: 10.1109/TII.2020.3008223.
  49. A review of machine learning state-of-charge and state-of-health estimation algorithms for lithium-ion batteries. Energy Reports, 9:2993–3021, 12 2023. ISSN 23524847. doi: 10.1016/j.egyr.2023.01.108.
  50. B. Saha and K. Goebel. Battery data set. NASA Ames Prognostics Data Repository, NASA Ames Research Center, Moffett Field, CA, 2007. URL https://phm-datasets.s3.amazonaws.com/NASA/5.+Battery+Data+Set.zip.
  51. Data-driven prediction of battery cycle life before capacity degradation. Nature Energy, 4(5):383–391, 5 2019. ISSN 2058-7546. doi: 10.1038/s41560-019-0356-8. URL https://doi.org/10.1038/s41560-019-0356-8.
  52. Accurate state of health estimation for lithium-ion batteries under random charging scenarios. Energy, 279, 9 2023. ISSN 03605442. doi: 10.1016/j.energy.2023.128092.
  53. Zhuangwei Shi. MambaStock: Selective state space model for stock prediction, 2 2024. URL http://arxiv.org/abs/2402.18959. arXiv:2402.18959 [cs, q-fin].
  54. [S5] Simplified State Space Layers for Sequence Modeling, 3 2023. URL http://arxiv.org/abs/2208.04933. arXiv:2208.04933 [cs].
  55. Transfer learning with long short-term memory network for state-of-health prediction of lithium-ion batteries. IEEE Transactions on Industrial Electronics, 67:8723–8731, 10 2020. ISSN 15579948. doi: 10.1109/TIE.2019.2946551.
  56. A review of the state of health for lithium-ion batteries: Research status and suggestions. Journal of Cleaner Production, 261, 7 2020. ISSN 09596526. doi: 10.1016/j.jclepro.2020.120813.
  57. Early prediction of remaining useful life for lithium-ion batteries based on a hybrid machine learning method. Journal of Cleaner Production, 317, 10 2021. ISSN 09596526. doi: 10.1016/j.jclepro.2021.128265.
  58. Attention Is All You Need, 6 2017. URL http://arxiv.org/abs/1706.03762. arXiv:1706.03762 [cs] version: 1.
  59. Ageing mechanisms in lithium-ion batteries. Journal of Power Sources, 147:269–281, 9 2005. ISSN 03787753. doi: 10.1016/j.jpowsour.2005.01.006.
  60. Temperature dependent ageing mechanisms in lithium-ion batteries - a post-mortem study. Journal of Power Sources, 262:129–135, 9 2014. ISSN 03787753. doi: 10.1016/j.jpowsour.2014.03.112.
  61. Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation, 4 2024. URL http://arxiv.org/abs/2404.04256. arXiv:2404.04256 [cs].
  62. Mechanistic understanding of the electrochemo-dependent mechanical behaviors of battery anodes. Journal of Power Sources, 510, 10 2021. ISSN 03787753. doi: 10.1016/j.jpowsour.2021.230428.
  63. Thermal runaway caused fire and explosion of lithium ion battery. Journal of Power Sources, 208:210–224, 6 2012. ISSN 03787753. doi: 10.1016/j.jpowsour.2012.02.038.
  64. State of health estimation of lithium-ion batteries using autoencoders and ensemble learning. Journal of Energy Storage, 55, 11 2022. ISSN 2352152X. doi: 10.1016/j.est.2022.105708.
  65. Review of the design of current collectors for improving the battery performance in lithium-ion and post-lithium-ion batteries. Electrochem, 1:124–159, 6 2020. ISSN 26733293. doi: 10.3390/electrochem1020011.
  66. Unbalanced discharging and aging due to temperature differences among the cells in a lithium-ion battery pack with parallel combination. Journal of Power Sources, 306:733–741, 2 2016. ISSN 03787753. doi: 10.1016/j.jpowsour.2015.12.079.
  67. Robust state of health estimation of lithium-ion batteries using convolutional neural network and random forest. 10 2020. doi: 10.48550/arxiv.2010.10452. URL http://arxiv.org/abs/2010.10452.
  68. Modeling of lithium plating induced aging of lithium-ion batteries: Transition from linear to nonlinear aging. Journal of Power Sources, 360:28–40, 2017. ISSN 03787753. doi: 10.1016/j.jpowsour.2017.05.110.
  69. State of health estimation of lithium-ion battery based on cnn–wnn–wlstm. Complex and Intelligent Systems, 10:2919–2936, 4 2024. ISSN 21986053. doi: 10.1007/s40747-023-01300-3.
  70. Research on aging mechanism and state of health prediction in lithium batteries, 11 2023. ISSN 2352152X.
  71. Motion Mamba: Efficient and Long Sequence Motion Generation, 8 2024. URL http://arxiv.org/abs/2403.07487. arXiv:2403.07487 [cs].
  72. Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model, 2 2024a. URL http://arxiv.org/abs/2401.09417. arXiv:2401.09417 [cs].
  73. Sparse self-attentive transformer with multiscale feature fusion on long-term soh forecasting. IEEE Transactions on Power Electronics, 8 2024b. ISSN 19410107.
  74. Attention-based cnn-bilstm for soh and rul estimation of lithium-ion batteries. Journal of Algorithms and Computational Technology, 16, 2022. ISSN 17483026. doi: 10.1177/17483026221130598.
  75. Wang Zichen and Du Changqing. A comprehensive review on thermal management systems for power lithium-ion batteries. Renewable and Sustainable Energy Reviews, 139, 4 2021. ISSN 18790690. doi: 10.1016/j.rser.2020.110685.

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

Sign Up for Free