Multimodality Usage in Clinical Communication
People communicate in many different ways. We study and develop new multimodal models of communication to improve medical information-sharing for patients and families.
Harnessing AI for patient-facing communication research, we developed a prototype capable of generating real-time transcribed reports of family meetings for patients, their caregivers, and other clinicians
We partner with creative arts therapists to develop collaborative clinical protocols integrating art and music therapy for patients with serious illness
Research Highlights
- Kwok IB, Murdaugh K, Shalev D, Boot W, Reid C, Adelman R. “New Frontiers in Artificial Intelligence: A Multimodal Communication Model.” Annual Assembly of Hospice and Palliative Care, February 2025. (Accepted)
- Kwok IB, Murdaugh K, Shalev D, Boot W, Reid C, Lachs M, Adelman R. “A New AI-Powered Transcription Tool for Multimodal Communication in Family Meetings.” 9th Annual Weill Department of Medicine Research Retreat, November 2024.
- Glinzak L, Palmer M, Portz JD, Dixon-Anderson A, Campbell D, Youngwerth J, Kwok I. Art Therapy and Narrative Therapy Interventions for Pain Management: A Case Study with a Post-Quadruple Amputation Oncology Patient. J Palliat Med. 2024 Oct 29. doi: 10.1089/jpm.2024.0280.
- Srolovitz M, Kwok IB. “Clinical Applications of Hospice Music Therapy: Case Study Exploration (FR202B).” Annual Assembly of Hospice and Palliative Care, March 2023.
- Glinzak L, Yazdian S, Kwok I, Youngwerth J. Integrating Art Therapy into Palliative Care: Man's Identity Exploration in Tattoo Preservation. J Pain Symptom Manage. 2023 Mar;65(3):e241-e244. doi: 10.1016/j.jpainsymman.2022.10.005.
- Kwok I, Keyssar JR, Spitzer L, Kojimoto G, Hauser J, Ritchie CS, Rabow M. Poetry as a Healing Modality in Medicine: Current State and Common Structures for Implementation and Research. J Pain Symptom Manage. 2022 Aug;64(2):e91-e100. doi: 10.1016/j.jpainsymman.2022.04.170.
- Srolovitz M et al. Top Ten Tips Palliative Care Clinicians Should Know About Music Therapy and Art Therapy. J Palliat Med. 2022 Jan;25(1):135-144. doi: 10.1089/jpm.2021.0481.
