Papers
Topics
Authors
Recent
Search
2000 character limit reached

Artful Path to Healing: Using Machine Learning for Visual Art Recommendation to Prevent and Reduce Post-Intensive Care

Published 23 Feb 2024 in cs.IR and cs.HC | (2402.15643v1)

Abstract: Staying in the intensive care unit (ICU) is often traumatic, leading to post-intensive care syndrome (PICS), which encompasses physical, psychological, and cognitive impairments. Currently, there are limited interventions available for PICS. Studies indicate that exposure to visual art may help address the psychological aspects of PICS and be more effective if it is personalized. We develop Machine Learning-based Visual Art Recommendation Systems (VA RecSys) to enable personalized therapeutic visual art experiences for post-ICU patients. We investigate four state-of-the-art VA RecSys engines, evaluating the relevance of their recommendations for therapeutic purposes compared to expert-curated recommendations. We conduct an expert pilot test and a large-scale user study (n=150) to assess the appropriateness and effectiveness of these recommendations. Our results suggest all recommendations enhance temporal affective states. Visual and multimodal VA RecSys engines compare favourably with expert-curated recommendations, indicating their potential to support the delivery of personalized art therapy for PICS prevention and treatment.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (93)
  1. Jon G Allen. 2008. Coping with trauma: Hope through understanding. American Psychiatric Pub.
  2. J Appleton. 1975. The Experience of Landscape John Wiley. New York (1975).
  3. Art therapy improved depression and influenced fatigue levels in cancer patients on chemotherapy. Psycho-Oncology: Journal of the Psychological, Social and Behavioral Dimensions of Cancer 16, 11 (2007), 980–984.
  4. A survey of feature extraction in dermoscopy image analysis of skin cancer. IEEE journal of biomedical and health informatics 23, 3 (2018), 1096–1109.
  5. Representation learning: A review and new perspectives. IEEE transactions on pattern analysis and machine intelligence 35, 8 (2013), 1798–1828.
  6. Improving the patient experience by implementing an ICU diary for those at risk of post-intensive care syndrome. Journal of patient experience 4, 1 (2017), 4–9.
  7. Latent dirichlet allocation. Journal of machine Learning research 3, Jan (2003), 993–1022.
  8. Virginia Braun and Victoria Clarke. 2006. Using thematic analysis in psychology. Qualitative research in psychology 3, 2 (2006), 77–101.
  9. Density-based clustering based on hierarchical density estimates. In Pacific-Asia conference on knowledge discovery and data mining. Springer, 160–172.
  10. The relationship between nursing workload, quality of care, and nursing payment in intensive care units. The Journal of Nursing Research 27, 1 (2019), 1.
  11. Unimodal and Multimodal Representation Training for Relation Extraction. In Irish Conference on Artificial Intelligence and Cognitive Science. Springer, 450–461.
  12. The PRaCTICaL study of nurse led, intensive care follow-up programmes for improving long term outcomes from critical illness: a pragmatic randomised controlled trial. Bmj 339 (2009).
  13. Tessa Dalley. 2008. Art as therapy: An introduction to the use of art as a therapeutic technique. Routledge.
  14. In-hospital acute stress symptoms are associated with impairment in cognition 1 year after intensive care unit admission. Annals of the American Thoracic Society 10, 5 (2013), 450–457.
  15. Louis Deladiennee and Yannick Naudet. 2017. A graph-based semantic recommender system for a reflective and personalised museum visit: Extended abstract. In 2017 12th International Workshop on Semantic and Social Media Adaptation and Personalization (SMAP). 88–89. https://doi.org/10.1109/SMAP.2017.8022674
  16. Impact of earplugs and eye mask on sleep in critically ill patients: a prospective randomized study. Critical Care 21, 1 (2017), 1–9.
  17. Mood measurement with Pick-A-Mood: review of current methods and design of a pictorial self-report scale. Journal of Design Research 14, 3 (2016), 241–279.
  18. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).
  19. Quality of life in adult survivors of critical illness: a systematic review of the literature. Intensive care medicine 31 (2005), 611–620.
  20. The patient experience of intensive care: a meta-synthesis of Nordic studies. International Journal of Nursing Studies 52, 8 (2015), 1354–1361.
  21. Abigail R Esman. 2012. The World’s Strongest Economy? The Global Art Market.
  22. John H Falk. 2016. Identity and the museum visitor experience. Routledge.
  23. An overview of art therapy interventions for cancer patients and the results of research. Complementary therapies in medicine 18, 3-4 (2010), 160–170.
  24. An exploration of social and economic outcome and associated health-related quality of life after critical illness in general intensive care unit survivors: a 12-month follow-up study. Critical care 17, 3 (2013), 1–12.
  25. Maarten Grootendorst. 2022. BERTopic: Neural topic modeling with a class-based TF-IDF procedure. arXiv preprint arXiv:2203.05794 (2022).
  26. D Kirk Hamilton and Mardelle McCuskey Shepley. 2010. Design for critical care: An evidence-based approach. Routledge.
  27. Kathy Hathorn and Upali Nanda. 2008. A guide to evidence-based art. The Center for Health Design 1 (2008), 1–23.
  28. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770–778.
  29. Vista: a visually, socially, and temporally-aware model for artistic recommendation. In Proceedings of the 10th ACM Conference on Recommender Systems. 309–316.
  30. Lessons learned: Evaluating the Whitney’s multimedia guide. línea).¡ http://mw2013. museumsandtheweb. com/paper/lessons-learned-evaluating-the-whitneys-multimedia-guide/¿, acceso 25 (2013).
  31. Exploring the Experience of Traveling to Familiar Places in VR: An Empirical Study Using Google Earth VR. International Journal of Human–Computer Interaction (2022), 1–23.
  32. ResNet-50 vs VGG-19 vs training from scratch: a comparative analysis of the segmentation and classification of Pneumonia from chest X-ray images. Global Transitions Proceedings 2, 2 (2021), 375–381.
  33. Post-intensive care syndrome: its pathophysiology, prevention, and future directions. Acute medicine & surgery 6, 3 (2019), 233–246.
  34. Latent Dirichlet Allocation (LDA) and Topic modeling: models, applications, a survey. Multimedia Tools and Applications 78, 11 (2019), 15169–15211.
  35. Impact of follow-up consultations for ICU survivors on post-ICU syndrome: a systematic review and meta-analysis. Intensive care medicine 41 (2015), 763–775.
  36. Overview and strategy analysis of technology-based nonpharmacological interventions for in-hospital delirium prevention and reduction: systematic scoping review. Journal of medical internet research 23, 8 (2021), e26079.
  37. From a Morning Forest to a Sunset Beach: Understanding Visual Experiences and the Roles of Personal Characteristics for Designing Relaxing Digital Nature. International Journal of Human–Computer Interaction (2023), 241–279.
  38. COVID-19: What do we need to know about ICU delirium during the SARS-CoV-2 pandemic? Anaesthesiology intensive therapy 52, 2 (2020), 132–138.
  39. Imagenet classification with deep convolutional neural networks. Commun. ACM 60, 6 (2017), 84–90.
  40. Graph-based Recommendation in the Museum. In DMRS. Citeseer, 46–48.
  41. Effects of music intervention on state anxiety and physiological indices in patients undergoing mechanical ventilation in the intensive care unit: a randomized controlled trial. Biological research for nursing 19, 2 (2017), 137–144.
  42. Bin Li and Dimas Lima. 2021. Facial expression recognition via ResNet-50. International Journal of Cognitive Computing in Engineering 2 (2021), 57–64.
  43. Blip: Bootstrapping language-image pre-training for unified vision-language understanding and generation. arXiv preprint arXiv:2201.12086 (2022).
  44. Align before fuse: Vision and language representation learning with momentum distillation. Advances in neural information processing systems 34 (2021), 9694–9705.
  45. Game-based digital interventions for depression therapy: a systematic review and meta-analysis. Cyberpsychology, Behavior, and Social Networking 17, 8 (2014), 519–527.
  46. The efficacy of earplugs as a sleep hygiene strategy for reducing delirium in the ICU: a systematic review and meta-analysis. Critical care medicine 44, 5 (2016), 992–999.
  47. A 4-item measure of depression and anxiety: validation and standardization of the Patient Health Questionnaire-4 (PHQ-4) in the general population. Journal of affective disorders 122, 1-2 (2010), 86–95.
  48. Stephen Madigan. 2011. Narrative therapy. American Psychological Association.
  49. Creation of interactive virtual environments for exposure therapy through game-level editors: Comparison and tests on presence and anxiety. International Journal of Human-Computer Interaction 29, 12 (2013), 827–837.
  50. Umap: Uniform manifold approximation and projection for dimension reduction. arXiv preprint arXiv:1802.03426 (2018).
  51. CuratorNet: Visually-aware Recommendation of Art Images. (2020).
  52. Exploring Content-based Artwork Recommendation with Metadata and Visual Features. arXiv preprint arXiv:1706.05786 (2017).
  53. Content-based artwork recommendation: integrating painting metadata with neural and manually-engineered visual features. User Modeling and User-Adapted Interaction 29, 2 (2019), 251–290.
  54. Undertaking an art survey to compare patient versus student art preferences. Environment and Behavior 40, 2 (2008), 269–301.
  55. Improving long-term outcomes after discharge from intensive care unit: report from a stakeholders’ conference. Critical care medicine 40, 2 (2012), 502–509.
  56. Physical and cognitive performance of patients with acute lung injury 1 year after initial trophic versus full enteral feeding. EDEN trial follow-up. American journal of respiratory and critical care medicine 188, 5 (2013), 567–576.
  57. Using nature-based soundscapes to support task performance and mood. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 2802–2809.
  58. Loc Nguyen and Ali A Amer. 2019. Advanced cosine measures for collaborative filtering. Adapt Personalization (ADP) 1 (2019), 21–41.
  59. Visual exploration mediates the influence of personal traits on responses to artworks in an art gallery setting. Psychology of Aesthetics, Creativity, and the Arts (2023).
  60. Long-term cognitive impairment after critical illness. New England Journal of Medicine 369, 14 (2013), 1306–1316.
  61. Workforce, workload, and burnout among intensivists and advanced practice providers: a narrative review. Critical care medicine 47, 4 (2019), 550–557.
  62. Virtual reality as a clinical tool for pain management. Current pain and headache reports 22 (2018), 1–6.
  63. A user-centric evaluation framework for recommender systems. In Proceedings of the fifth ACM conference on Recommender systems. 157–164.
  64. Caring for critically ill patients with the ABCDEF bundle: results of the ICU liberation collaborative in over 15,000 adults. Critical care medicine 47, 1 (2019), 3.
  65. Dhanesh Ramachandram and Graham W. Taylor. 2017. Deep Multimodal Learning: A Survey on Recent Advances and Trends. IEEE Signal Process. Mag. 34, 6 (2017), 96–108.
  66. Post Intensive Care Syndrome (PICS): an overview of the definition, etiology, risk factors, and possible counseling and treatment strategies. Expert Review of Neurotherapeutics 21, 10 (2021), 1159–1177.
  67. Post-intensive care syndrome: an overview. Journal of translational internal medicine 5, 2 (2017), 90–92.
  68. Nils Reimers and Iryna Gurevych. 2019. Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks. CoRR abs/1908.10084 (2019). arXiv:1908.10084 http://arxiv.org/abs/1908.10084
  69. The effectiveness of art therapy in the treatment of traumatized adults: A systematic review on art therapy and trauma. Trauma, violence, & abuse 16, 2 (2015), 220–228.
  70. Rate and risk factors for rehospitalisation in sepsis survivors: systematic review and meta-analysis. Intensive care medicine 46 (2020), 619–636.
  71. Bach to the basics: implementation and impact of a postoperative, inpatient personalized music program for older adults. Journal of perianesthesia nursing 34, 2 (2019), 347–353.
  72. Karen Simonyan and Andrew Zisserman. 2014. Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014).
  73. Art therapy for combat-related PTSD: Recommendations for research and practice. Art Therapy 23, 4 (2006), 157–164.
  74. Going deeper with convolutions. In Proceedings of the IEEE conference on computer vision and pattern recognition. 1–9.
  75. AmbientEcho: exploring interactive media experiences in the context of residential dementia care. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. 1495–1508.
  76. Roger Ulrich and Laura Gilpin. 2003a. Healing Arts: Nutrition for the Soul. John Wiley & Sons. 117–146 pages.
  77. R Ulrich and L Gilpin. 2003b. HealingArts-NutritionforTheSoul. Charmel, PM, Frampton, SB, Gilpin, L (2003), 89–104.
  78. Roger S Ulrich. 1984. View through a window may influence recovery from surgery. science 224, 4647 (1984), 420–421.
  79. Effects of exposure to nature and abstract pictures on patients recovering from heart surgery. Psychophysiology 30, 7 (1993).
  80. Dutch ICU survivors have more consultations with general practitioners before and after ICU admission compared to a matched control group from the general population. PLoS One 14, 5 (2019), e0217225.
  81. Effect of nocturnal sound reduction on the incidence of delirium in intensive care unit patients: an interrupted time series analysis. Intensive and Critical Care Nursing 41 (2017), 18–25.
  82. L.J.P. van der Maaten and G.E. Hinton. 2008. Visualizing Data Using t-SNE. J. Mach. Learn. Res. (2008), 2579–2605.
  83. Virtual reality relaxation for patients with a psychiatric disorder: crossover randomized controlled trial. Journal of medical Internet research 23, 1 (2021), e17233.
  84. The CrossCult Knowledge Base: A Co-inhabitant of Cultural Heritage Ontology and Vocabulary Classification. In New Trends in Databases and Information Systems, Mārīte Kirikova, Kjetil Nørvåg, George A. Papadopoulos, Johann Gamper, Robert Wrembel, Jérôme Darmont, and Stefano Rizzi (Eds.). Springer International Publishing, Cham, 353–362.
  85. Using simulated family presence to decrease agitation in older hospitalized delirious patients: A randomized controlled trial. International journal of nursing studies 77 (2018), 154–161.
  86. Development and validation of brief measures of positive and negative affect: the PANAS scales. Journal of personality and social psychology 54, 6 (1988), 1063.
  87. Edward O Wilson. 1986. Biophilia. Harvard university press.
  88. PaintKG: the painting knowledge graph using bilstm-crf. In 2020 International Conference on Information Science and Education (ICISE-IE). IEEE, 412–417.
  89. Personalised visual art recommendation by learning latent semantic representations. In 2020 15th International Workshop on Semantic and Social Media Adaptation and Personalization (SMA. IEEE, 1–6.
  90. Bereket A. Yilma and Luis A. Leiva. 2023a. The Elements of Visual Art Recommendation: Learning Latent Semantic Representations of Paintings. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI ’23), April 23–28, 2023, Hamburg, Germany. ACM Press. https://doi.org/10.1145/3544548.3581477
  91. Bereket A. Yilma and Luis A. Leiva. 2023b. Together Yet Apart: Multimodal Representation Learning for Personalised Visual Art Recommendation. In Proceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization (Limassol, Cyprus) (UMAP ’23). Association for Computing Machinery, New York, NY, USA, 204–214. https://doi.org/10.1145/3565472.3592964
  92. Personalisation in Cyber-Physical-Social Systems: A Multi-Stakeholder Aware Recommendation and Guidance. In Proceedings of the 29th ACM Conference on User Modeling, Adaptation and Personalization (Utrecht, Netherlands) (UMAP ’21). Association for Computing Machinery, New York, NY, USA, 251–255. https://doi.org/10.1145/3450613.3456847
  93. An overview on data representation learning: From traditional feature learning to recent deep learning. The Journal of Finance and Data Science 2, 4 (2016), 265–278.
Citations (2)
View on Semantic Scholar

Summary

No one has generated a summary of this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Summarize

Paper to Video (Beta)

Whiteboard

No one has generated a whiteboard explanation for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Sign Up to Generate

Open Problems

We haven't generated a list of open problems mentioned in this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Continue Learning

We haven't generated follow-up questions for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Generate Now

Collections

Sign up for free to add this paper to one or more collections.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up

Tweets

Sign up for free to view the 3 tweets with 15 likes about this paper.

User Circle Single Streamline Icon: https://streamlinehq.com Sign Up for Free