Scoping review on the application of multimodal data in the nursing field

doi:10.3761/j.issn.0254-1769.2026.07.019

Abstract

Abstract:

Objective To conduct a scoping review on the application of multimodal data in nursing，aiming to provide evidence-informed insights for future research and clinical practice. Methods A systematic literature search was conducted in 7 databases，including：CNKI，Wanfang Database，VIP Database，CMB，PubMed，Embase，Web of Science. Following the scoping review methodology，the retrieval period was from database inception to April 2025. The included studies were screened based on predefined eligibility criteria，and thematic analysis was performed on the selected literature. Results A total of 19 articles were included. The multimodal data encompassed 7 categories，namely objective physiological monitoring data，behavioral characteristic data，clinical diagnosis and treatment data，patient-reported outcomes，multimedia data，environmental data，and nursing management data. These data were primarily collected through various sensors，information systems，and audio/video recording devices. In the nursing field，multimodal data are mainly applied in nursing assessment，remote monitoring，home care，nursing quality management，care process optimization，nursing education，and health promotion. Conclusion The use of multimodal data contributes to enhancing the comprehensiveness of nursing assessments and the accuracy of care decisions. However，research in this area remains in its early stages. Future efforts should focus on strengthening interdisciplinary collaboration，improving standards and specifications for data fusion technologies，optimizing data quality，and conducting multicenter studies to promote the standardization and advancement of its application.

Key words: Multimodal Data, Big Data, Scoping Review, Nursing Care

摘要：

目的对多模态数据在护理领域中应用的研究进行范围综述，为未来研究与实践的开展提供参考。方法遵循范围综述方法学，系统检索中国知网、万方数据库、维普数据库、中国生物医学文献服务系统、PubMed、Embase、Web of Science中的相关文献，检索时限为建库至2025年4月，对纳入文献进行归纳分析。结果共纳入19篇文献。其中，多模态数据包括客观生理监测数据、行为特征数据、临床诊疗数据、主观报告结局、多媒体数据、环境数据、护理管理数据7个类别，主要通过各类传感器、信息系统、音视频录制设备等进行采集。在护理领域中，多模态数据主要用于护理评估、远程监护、居家护理、护理质量管理、护理流程优化、护理教育及健康促进等方面。结论使用多模态数据有助于增强护理评估的系统性与护理决策的准确性，但相关研究仍处于起步阶段，未来需加强跨学科协作、完善数据融合技术的标准规范，优化数据质量，并开展多中心研究，以推动其向规范化方向发展。

关键词: 多模态数据, 大数据, 范围综述, 护理

HE Jingting, YING Yanping, LU Qiufang, ZHAO Huihan, LIU Liying, MA Hanzhang, ZHANG Cheng. Scoping review on the application of multimodal data in the nursing field[J]. Chinese Journal of Nursing, 2026, 61(7): 1002-1008.

贺敬婷, 应燕萍, 陆秋芳, 赵慧函, 刘丽颖, 马含章, 张程. 多模态数据在护理领域中应用的范围综述[J]. 中华护理杂志, 2026, 61(7): 1002-1008.

Figures/Tables 2

References 29

[1]	徐莉, 葛晶, 于鹏, 等. 中国老年人慢性病及共病模式变化研究:基于中国健康与养老追踪调查数据[J]. 中国全科医学, 2024, 27(11):1296-1302. DOI
	Xu L, Ge J, Yu P, et al. Research on the changes of chronic diseases and comorbidity patterns among Chinese older adults:based on data from the China health and retirement longitudi-nal study[J]. Chin Gen Prac, 2024, 27(11):1296-1302.
[2]	鲍向英, 冯佳, 赵华, 等. 泛血管疾病患者融合病房多学科协作护理管理模式的构建与实践[J]. 中华护理杂志, 2024, 59(13):1548-1555. DOI URL
	Bao XY, Feng J, Zhao H, et al. Construction and practice of a multidisciplinary collaborative nursing management model for patients with panvascular diseases in integrated wards[J]. Chin J Nurs, 2024, 59(13):1548-1555.
[3]	Er AG, Ding DY, Er B, et al. Multimodal data fusion using sparse canonical correlation analysis and cooperative learning:a COVID-19 cohort study[J]. NPJ Digit Med, 2024, 7(1):117. DOI
[4]	蔡正洲. 基于多模态MRI图像的听神经鞘瘤分割算法设计与实现[D]. 杭州: 浙江工业大学, 2023.
	Cai ZZ. Design and implementation of segmentation algorithm for acoustic neuroma based on multimodal MRI images[D]. Hangzhou: Zhejiang University of Technology, 2023.
[5]	Keyl J, Keyl P, Montavon G, et al. Decoding pan-cancer treat-ment outcomes using multimodal real-world data and explaina-ble artificial intelligence[J]. Nat Cancer, 2025, 6(2):307-322. DOI
[6]	Liang HY, Tsui BY, Ni H, et al. Evaluation and accurate dia-gnoses of pediatric diseases using artificial intelligence[J]. Nat Med, 2019, 25(3):433-438. DOI
[7]	Kale M, Wankhede N, Pawar R, et al. AI-driven innovations in Alzheimer’s disease:integrating early diagnosis,personalized treatment,and prognostic modelling[J]. Ageing Res Rev, 2024, 101:102497. DOI URL
[8]	仇如霞, 顾艳荭. 范围综述报告规范(PRISMA-ScR)的解读[J]. 中国循证医学杂志, 2022, 22(6):722-730.
	Qiu RX, Gu YH. Interpretation of the PRISMA-ScR guideline for scoping reviews[J]. Chin J Evid-Based Med, 2022, 22(6):722-730.
[9]	陈兰珍, 陈阿真, 黄观妹, 等. 多模态数据融合指标管理的信息系统在医院护理管理中的应用研究[J]. 黑龙江中医药, 2022, 51(5):150-152.
	Chen LZ, Chen AZ, Huang GM, et al. Application of an infor-mation system for multimodal data fusion index management in hospital nursing management[J]. Heilongjiang J Tradit Chin Med, 2022, 51(5):150-152.
[10]	戴雅琴, 邵婷, 姚利锋, 等. 基于患者画像脊髓损伤康复护理平台的构建与应用研究[J]. 中华护理杂志, 2024, 59(22):2693-2699. DOI URL
	Dai YQ, Shao T, Yao LF, et al. Construction and application of a rehabilitation nursing platform for spinal cord injury based on patient portraits[J]. Chin J Nurs, 2024, 59(22):2693-2699.
[11]	付琴, 张秀敏, 侯铭, 等. 智能化体感运动在老年慢性阻塞性肺疾病患者居家肺康复中的效果评价[J]. 中华护理杂志, 2025, 60(5):517-524. DOI URL
	Fu Q, Zhang XM, Hou M, et al. Effect of intelligent somato-sensory exercise on home-based pulmonary rehabilitation in elderly patients with chronic obstructive pulmonary disease[J]. Chin J Nurs, 2025, 60(5):517-524.
[12]	傅思嘉. 多模态交互干预型颈椎护理仪设计[D]. 秦皇岛: 燕山大学, 2021.
	Fu SJ. Design of a multimodal interactive intervention cervi-cal nursing device[D]. Qinhuangdao: Yanshan University, 2021.
[13]	高浩. 基于多模态数据融合的ICU患者风险预测方法研究[D]. 郑州: 郑州大学, 2023.
	Gao H. Research on risk prediction method for ICU patients based on multimodal data fusion[D]. Zhengzhou: Zhengzhou Uni-versity, 2023.
[14]	郭文强, 赵艳, 徐紫薇, 等. 基于多模态的贝叶斯网络疼痛识别方法[J]. 科学技术与工程, 2022, 22(28):12505-12511.
	Guo WQ, Zhao Y, Xu ZW, et al. Multimodal-based Bayesian network pain recognition method[J]. Sci Technol Eng, 2022, 22(28):12505-12511.
[15]	李龙倜, 周庆焕, 陈新, 等. 多模态视角下虚拟现实技术在骨科护理临床实践教学中的应用[J]. 卫生职业教育, 2023, 41(24):92-95.
	Li LT, Zhou QH, Chen X, et al. Application of virtual reality technology in orthopedic nursing clinical practice teaching from a multimodal perspective[J]. Health Vocat Educ, 2023, 41 (24):92-95.
[16]	刘才伟. 辅具物联技术研究与系统开发及其在智能护理模式中的应用[D]. 济南: 齐鲁工业大学, 2022.
	Liu CW. Research and system development of assistive device IoT technology and its application in intelligent nursing mode[D]. Jinan: Qilu University of Technology, 2022.
[17]	刘鸿. 护理服务机器人生理参数健康监视系统开发[D]. 南昌: 南昌大学, 2020.
	Liu H. Development of a physiological parameter health moni-toring system for nursing service robots[D]. Nanchang: Nan-chang University, 2020.
[18]	刘嘉望. 基于多种模态特征的新生儿疼痛识别[D]. 广州: 华南理工大学, 2023.
	Liu JW. Neonatal pain recognition based on multimodal features[D]. Guangzhou: South China University of Technology, 2023.
[19]	刘晓军. 基于数据融合的智能护理床排便监测方法研究[D]. 太原: 太原理工大学, 2019.
	Liu XJ. Research on defecation monitoring method for smart nursing beds based on data fusion[D]. Taiyuan: Taiyuan Univer-sity of Technology, 2019.
[20]	王丹丹, 袁晓红, 董伦, 等. 多模态监测在重型颅脑损伤患者术后护理中的应用研究[J]. 现代医学, 2020, 48(10):1346-1350.
	Wang DD, Yuan XH, Dong L, et al. Application of multimodal monitoring in postoperative nursing of patients with severe traumatic brain injury[J]. Mod Med, 2020, 48(10):1346-1350.
[21]	张公永. 多传感器信息融合的便携式智能监护终端研究[D]. 成都: 西华大学, 2009.
	Zhang GY. Research on portable intelligent monitoring termi-nal based on multi-sensor information fusion[D]. Chengdu: Xi-hua University, 2009.
[22]	周启豪, 刘迪莘. 基于多模态数据融合的智能家用病床设计研究[J]. 装饰, 2024(10):142-144.
	Zhou QH, Liu DX. Design of intelligent home nursing bed based on multimodal data fusion[J]. Art Des, 2024(10):142-144.
[23]	周滢. 老年轻度认知障碍患者情绪问题多模态特征融合分类模型的构建与评价研究[D]. 北京: 北京协和医学院, 2022.
	Zhou Y. Construction and evaluation of a multimodal feature fusion classification model for emotional problems in elderly patients with mild cognitive impairment[D]. Beijing: Chinese Peking Union Medical College, 2022.
[24]	Bakken S, Arcia A, Koleck T, et al. Informatics and data scien-ce for the precision in symptom self-management center[J]. Stud Health Technol Inform, 2019, 264:1827-1828.
[25]	Chang MC, Yu T, Luo JJ, et al. Multimodal sensor system for pressure ulcer wound assessment and care[J]. IEEE Trans Ind Inform, 2018, 14(3):1186-1196. DOI URL
[26]	Hewner S, Sullivan SS, Yu G. Reducing emergency room visits and in-hospitalizations by implementing best practice for transitional care using innovative technology and big data[J]. Worldviews Evid Based Nurs, 2018, 15(3):170-177. DOI URL
[27]	Kang RR, Kim YG, Hong M, et al. AI-based personalized real-time risk prediction for behavioral management in psychiatric wards using multimodal data[J]. Int J Med Inform, 2025, 198:105870. DOI URL
[28]	Zhou HY, Yu YZ, Wang CD, et al. A transformer-based repre-sentation-learning model with unified processing of multimo-dal input for clinical diagnostics[J]. Nat Biomed Eng, 2023, 7(6):743-755. DOI
[29]	徐春健, 蔡婷婷, 谢逸菲, 等. 机器学习模型在安宁疗护中应用的范围综述[J]. 中华护理杂志, 2025, 60(12):1524-1531. DOI URL
	Xu CJ, Cai TT, Xie YF, et al. A Scoping review of the application of machine learning models in palliative care[J]. Chin J Nurs, 2025, 60(12):1524-1531.