Papers
Topics
Authors
Recent
Search
2000 character limit reached

A Short Survey of Human Mobility Prediction in Epidemic Modeling from Transformers to LLMs

Published 25 Apr 2024 in cs.LG and cs.CL | (2404.16921v1)

Abstract: This paper provides a comprehensive survey of recent advancements in leveraging machine learning techniques, particularly Transformer models, for predicting human mobility patterns during epidemics. Understanding how people move during epidemics is essential for modeling the spread of diseases and devising effective response strategies. Forecasting population movement is crucial for informing epidemiological models and facilitating effective response planning in public health emergencies. Predicting mobility patterns can enable authorities to better anticipate the geographical and temporal spread of diseases, allocate resources more efficiently, and implement targeted interventions. We review a range of approaches utilizing both pretrained LLMs like BERT and LLMs tailored specifically for mobility prediction tasks. These models have demonstrated significant potential in capturing complex spatio-temporal dependencies and contextual patterns in textual data.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (54)
  1. Covid-19 patterns in araraquara, brazil: A multimodal analysis. International Journal of Environmental Research and Public Health, 20(6):4740.
  2. Predicting infectiousness for proactive contact tracing. arXiv preprint arXiv:2010.12536.
  3. Modeling approaches for early warning and monitoring of pandemic situations as well as decision support. Frontiers in public health, 10:994949.
  4. Mobcovid: Confirmed cases dynamics driven time series prediction of crowd in urban hotspot. IEEE Transactions on Neural Networks and Learning Systems.
  5. Crowdflowtransformer: Capturing spatio-temporal dependence for forecasting human mobility. In 2023 IEEE International Conference on Pervasive Computing and Communications Workshops and other Affiliated Events (PerCom Workshops), pages 496–501. IEEE.
  6. Tracebert—a feasibility study on reconstructing spatial–temporal gaps from incomplete motion trajectories via bert training process on discrete location sequences. Sensors.
  7. Into the unobservables: A multi-range encoder-decoder framework for covid-19 prediction. In Proc. of the 30th ACM International Conference on Information & Knowledge Management, pages 292–301.
  8. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805.
  9. Approaches for forecasting of socioeconomic impacts to the spread of covid-19 with territorial differences of russian regions. In E3S Web of Conferences, volume 301, page 02002. EDP Sciences.
  10. Analyzing social-geographic human mobility patterns using large-scale social media data. ISPRS International Journal of Geo-Information, 9(2):125.
  11. Mobilitygpt: Enhanced human mobility modeling with a gpt model. arXiv.org.
  12. How do you go where? improving next location prediction by learning travel mode information using transformers. In Proceedings of the 30th International Conference on Advances in Geographic Information Systems, pages 1–10.
  13. Human mobility modeling at metropolitan scales. In Proc. of the 10th international conference on Mobile systems, applications, and services, pages 239–252.
  14. Health-llm: Large language models for health prediction via wearable sensor data. arXiv preprint arXiv:2401.06866.
  15. Modeling and generating human mobility trajectories using transformer with day encoding. In Proc. of the 1st International Workshop on the Human Mobility Prediction Challenge, pages 7–10.
  16. Examining the limits of predictability of human mobility. Entropy, 21(4):432.
  17. Fine-tuning bidirectional encoder representations from transformers (bert)–based models on large-scale electronic health record notes: an empirical study. JMIR medical informatics, 7(3):e14830.
  18. Long-term prediction for temporal propagation of seasonal influenza using transformer-based model. Journal of biomedical informatics, 122:103894.
  19. Integrating transformer and gcn for covid-19 forecasting. Sustainability.
  20. Exploring large language models for human mobility prediction under public events. arXiv preprint arXiv:2311.17351.
  21. A survey on deep learning for human mobility. ACM Computing Surveys (CSUR), 55(1):1–44.
  22. Human trajectory completion with transformers. In ICC 2022-IEEE International Conference on Communications, pages 3346–3351.
  23. Hierarchical spatio-temporal graph neural networks for pandemic forecasting. In Proc. of the 31st ACM CIKM, pages 1481–1490.
  24. Dengue fever: From extreme climates to outbreak prediction. In 2022 IEEE ICDM, pages 1083–1088. IEEE.
  25. Mpstan: Metapopulation-based spatio-temporal attention network for epidemic forecasting. arXiv preprint arXiv:2306.12436.
  26. Predicting human behavior with transformer considering the mutual relationship between categories and regions. Conference on Multimedia Information Processing and Retrieval.
  27. Machine learning on the covid-19 pandemic, human mobility and air quality: A review. IEEE Access, 9:72420–72450.
  28. Transcode: Uncovering covid-19 transmission patterns via deep learning. Infectious Diseases of Poverty, 12(1):1–20.
  29. Beyond imitation: Generating human mobility from context-aware reasoning with large language models. arXiv preprint arXiv:2402.09836.
  30. Forecasting covid-19 dynamics: Clustering, generalized spatiotemporal attention, and impacts of mobility and geographic proximity. In 2023 IEEE ICDE, pages 2892–2904. IEEE.
  31. An ontology-based approach to knowledge-assisted integration and visualization of urban mobility data. Expert Systems with Applications, 150:113260.
  32. A. V. Solatorio. 2023. Geoformer: Predicting human mobility using generative pre-trained transformer (gpt). HuMob-Challenge@SIGSPATIAL.
  33. Synergizing spatial optimization with large language models for open-domain urban itinerary planning. arXiv preprint arXiv:2402.07204.
  34. Trafformer: A transformer model for predicting long-term traffic. arXiv.org.
  35. Human mobility prediction challenge: Next location prediction using spatiotemporal bert. In Proc. of the 1st International Workshop on the Human Mobility Prediction Challenge, pages 1–6.
  36. Wifimod: Transformer-based indoor human mobility modeling using passive sensing. The Compass.
  37. Redesigning electronic health record systems to support developing countries. In Proc. of the 2023 7th International Conference on Medical and Health Informatics, pages 216–221.
  38. Attention is all you need. Advances in neural information processing systems, 30.
  39. Self-attention based encoder-decoder for multistep human density prediction. Journal of urban mobility, 2:100022.
  40. User re-identification via human mobility trajectories with siamese transformer networks. Applied intelligence (Boston).
  41. Pategail: a privacy-preserving mobility trajectory generator with imitation learning. In Proc. of the AAAI Conference on Artificial Intelligence, volume 37, pages 14539–14547.
  42. Large language models as urban residents: An llm agent framework for personal mobility generation. arXiv preprint arXiv:2402.14744.
  43. W. Wang and T. Osaragi. 2024. Learning daily human mobility with a transformer-based model. ISPRS International Journal of Geo-Information, 13(2):35.
  44. Where would i go next? large language models as human mobility predictors. arXiv preprint arXiv:2308.15197.
  45. Chatgpt: promise and challenges for deployment in low-and middle-income countries. The Lancet Regional Health–Western Pacific, 41.
  46. Cola: Cross-city mobility transformer for human trajectory simulation. arXiv preprint arXiv:2403.01801.
  47. Multisize patched spatial-temporal transformer network for short-and long-term crowd flow prediction. IEEE Transactions on Intelligent Transportation Systems, 23(11):21548–21568.
  48. Simulating continuous-time human mobility trajectories. In Proc. 9th Int. Conf. Learn. Represent, pages 1–9.
  49. Multimodal learning with transformers: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence.
  50. Mobtcast: Leveraging auxiliary trajectory forecasting for human mobility prediction. Advances in Neural Information Processing Systems, 34:30380–30391.
  51. Translating human mobility forecasting through natural language generation. In Proc. of the Fifteenth ACM International Conference on Web Search and Data Mining, pages 1224–1233.
  52. Leveraging language foundation models for human mobility forecasting. In Proc. of the 30th International Conference on Advances in Geographic Information Systems, pages 1–9.
  53. Harnessing the power of llms in practice: A survey on chatgpt and beyond. ACM Transactions on Knowledge Discovery from Data.
  54. Large language models for spatial trajectory patterns mining. arXiv.org.
Citations (1)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Sign Up to Summarize

Paper to Video (Beta)

No one has generated a video about this paper yet.

Sign Up to Generate All Videos Subscribe on YouTube

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Generate Now

Collections

Sign up for free to add this paper to one or more collections.

Sign Up

Tweets

Sign up for free to view the 1 tweet with 0 likes about this paper.

Sign Up for Free