多模态融合技术在老年人心理症状管理中应用的范围综述

doi:10.3761/j.issn.0254-1769.2026.17.005

中华护理杂志 ›› 2026, Vol. 61 ›› Issue (17): 2338-2344.DOI: 10.3761/j.issn.0254-1769.2026.17.005

• 老年人健康管理与促进专题 • 上一篇下一篇

多模态融合技术在老年人心理症状管理中应用的范围综述

贾思培¹(), 罗雅婷², 汪婧颖², 高辰², 汪晏如², 张秋香¹, 王莎¹, 李丽君³, 谢建飞¹^,^*()

¹ 中南大学湘雅三医院护理部长沙市 410013
² 中南大学湘雅护理学院长沙市 410013
³ 莫纳什大学心理科学学院澳大利亚墨尔本 3800

收稿日期:2026-04-29 出版日期:2026-09-10 发布日期:2026-09-03
*通讯作者: 谢建飞，E-mail：xiejianfei@csu.edu.cn
作者简介:贾思培：女，本科（博士在读），护士，E-mail：jasper030521@csu.edu.cn
第一联系人：作者贡献声明
贾思培：选题设计、文献检索、数据整理与分析、论文撰写与修改；罗雅婷、汪婧颖：选题设计、研究指导；高辰、汪晏如：文献检索、数据整理与分析；张秋香、王莎、李丽君：研究指导、论文审阅与修改；谢建飞：选题设计、研究指导、经费支持、论文审阅与修改
基金资助:
湖南省重点研发计划(2025JK136)

Application of multimodal fusion technology in the management of geriatric psychological symptoms：a scoping review

JIA Sipei¹(), LUO Yating², WANG Jingying², GAO Chen², WANG Yanru², ZHANG Qiuxiang¹, WANG Sha¹, LI Lijun³, XIE Jianfei¹^,^*()

¹ Nursing Department， the Third Xiangya Hospital，Central South University， Changsha 410013， China
² Xiangya Nursing School， Central South University， Changsha 410013， China
³ School of Psychological Sciences， Monash University， Melbourne 3800， Australia

Received:2026-04-29 Online:2026-09-10 Published:2026-09-03
* Corresponding author: XIE Jianfei，E-mail：xiejianfei@csu.edu.cn
Funding program:
Key Research and Development Program in Hunan Province(2025JK2136)

摘要/Abstract

摘要：

目的对多模态融合技术在老年人心理症状管理中应用的研究进行范围综述，以期为该技术在老年心理护理领域的实践提供参考。方法依据范围综述方法框架，系统检索PubMed、Web of Science、IEEE Xplore、PsycINFO、Scopus、中国知网、万方数据库、维普数据库、中国生物医学文献数据库，检索时限为建库至2026年5月30日，对纳入文献进行数据提取和汇总分析。结果共纳入23篇文献，发表时间为2017—2026年，来源于中国、韩国、美国等多个国家。数据类型涵盖行为数据、生理信号、语音语义数据、环境情境数据、自报告数据、人口学资料及健康相关数据。采集设备主要包括可穿戴设备、环境情境传感器及语音采集设备等。抑郁症状和孤独感是最常见的研究结局，焦虑、淡漠等心理症状关注较少。应用环节以心理症状评估为主，部分研究拓展至动态监测和心理干预。融合策略正从特征层拼接向注意力机制等深层交互方向演进。结论多模态融合技术在老年人心理症状评估中展现出良好的应用潜力，但现有研究多为小样本探索性研究，心理症状覆盖范围有限。未来应扩大评估维度、完善隐私与伦理治理，并推动相关技术向护理实践转化。

关键词: 多模态融合, 老年人, 心理症状, 老年护理, 范围综述

Abstract:

Objective To conduct a scoping review of the application of multimodal fusion technology in the management of psychological symptoms among older adults，so as to provide evidence for the application of this technology in gerontological psychological nursing. Methods Based on the methodological framework of a scoping review，systematic literature searches were performed across PubMed，Web of Science，IEEE Xplore，PsycINFO，Scopus，China National Knowledge Infrastructure，Wanfang Database，VIP Database，and SinoMed. The search period spanned from the inception of each database to May 30，2026. Data extraction and narrative synthesis were carried out for the included studies. Results A total of 23 studies published between 2017 and 2026 were included，originating from China，South Korea，the United States，and other countries. The data types covered behavioral data，physiological signals，speech and language data，environmental context data，selfreported data，demographic information，and healthrelated data. Primary collection devices included wearable devices，ambient sensors，and audio capture devices. Depressive symptoms and loneliness were the most frequently studied outcomes，while less attention was paid to psychological symptoms such as anxiety and apathy. The main application domain was psychological symptom assessment，with some studies extending to dynamic monitoring and psychological intervention. Fusion strategies were evolving from feature level concatenation toward deeper interactive approaches such as attention mechanisms. Conclusion Multimodal fusion technology shows potential for assessing psychological symptoms in older adults. However，most existing studies are small sample exploratory studies with limited coverage of psychological symptoms. Future efforts should expand assessment dimensions，strengthen privacy and ethical governance，and promote the translation of relevant technologies into nursing practice.

Key words: Multimodal Fusion, Aged, Psychological Symptoms, Geriatric Nursing, Scoping Review

贾思培, 罗雅婷, 汪婧颖, 高辰, 汪晏如, 张秋香, 王莎, 李丽君, 谢建飞. 多模态融合技术在老年人心理症状管理中应用的范围综述[J]. 中华护理杂志, 2026, 61(17): 2338-2344.

JIA Sipei, LUO Yating, WANG Jingying, GAO Chen, WANG Yanru, ZHANG Qiuxiang, WANG Sha, LI Lijun, XIE Jianfei. Application of multimodal fusion technology in the management of geriatric psychological symptoms：a scoping review[J]. Chinese Journal of Nursing, 2026, 61(17): 2338-2344.

图/表 1

参考文献 34

[1]	国家统计局. 中华人民共和国2025年国民经济和社会发展统计公报[EB/OL]. (2026-02-28)[2026-04-20]. https://www.stats.gov.cn/sj/zxfbhjd/202602/t20260228_1962662.html.
	National Bureau of Statistics of China. Statistical Communiqué of the People’s Republic of China on the 2025 National Economic and Social Development[EB/OL]. (2026-02-28)[2026-04-20]. https://www.stats.gov.cn/sj/zxfbhjd/202602/t20260228_1962662.html.
[2]	钟懿珠, 高静, 柏丁兮, 等. 中国养老机构老年人抑郁症状检出率的meta分析[J]. 中国心理卫生杂志, 2020, 34(12):1006-1015.
	Zhong YZ, Gao J, Bai DX, et al. A meta-analysis of detection rate of depressive symptoms among the elderly in pension institutions in China[J]. Chin Ment Health J, 2020, 34(12):1006-1015.
[3]	Xie Q, Xu YM, Zhong BL. Anxiety symptoms in older Chinese adults in primary care settings:prevalence and correlates[J]. Front Public Health, 2022, 10:1009226. DOI URL
[4]	de Oliveira PBF, Dornelles TM, Gosmann NP, et al. Efficacy of telemedicine interventions for depression and anxiety in older people:a systematic review and meta-analysis[J]. Int J Geriat Psychiatry, 2023, 38(5):e5920. DOI URL
[5]	胡慧秀, 孙超, 赵雅洁, 等. 社区轻度认知障碍老年人短期内认知功能下降与生活行为的相关性研究及护理启示[J]. 中华护理杂志, 2024, 59(21):2571-2578. DOI
	Hu HX, Sun C, ZHAO YJ, et al. The impact of life behaviors on the rapid cognitive decline in the short term among community-dwelling elderly with mild cognitive impairment[J]. Chin J Nurs, 2024, 59(21):2571-2578. DOI
[6]	Chung MK, Lim HS, Lee SY, et al. Using digital phenotyping for depression screening in community-dwelling older adults:Bayesian multilevel hurdle model machine learning approach[J]. Jmir Ai, 2026, 5:e69494. DOI URL
[7]	Hangloo S, Arora B. Multimodal fusion techniques:review,data representation,information fusion,and application areas[J]. Neurocomputing, 2025, 649:130827. DOI URL
[8]	杜赛丽, 徐燕, 黄莺, 等. 多模态数据融合技术在临床护理中的应用进展[J]. 军事护理, 2025, 42(8):94-97.
	Du SL, Xu Y, Huang Y, et al. Advances in the application of multimodal data fusion technologies in clinical nursing[J]. Mil Nurs, 2025, 42(8):94-97.
[9]	Lee EE, Torous J, De Choudhury M, et al. Artificial intelligence for mental health care:clinical applications,barriers,facilitators,and artificial wisdom[J]. Biol Psychiatry Cogn Neurosci Neuroimaging, 2021, 6(9):856-864.
[10]	MoČnik G, Rehberger A, Smogavc Ž, et al. Multimodal observable cues in mood,anxiety,and borderline personality disorders:a review of reviews to inform explainable AI in mental health[J]. Front Artif Intell, 2025, 8:1696448. DOI URL
[11]	Aggarwal K, Jany Shabu SL, Humza Farooq Siddiqui M, et al. A novel framework for entertainment robots in personalized elderly care using adaptive emotional resonance technologies[J]. Entertain Comput, 2025, 52:100796. DOI URL
[12]	Ai YG, Zhang YJ, Wang J, et al. Optimizing the interaction of service robots in elderly care institutions using multi-modal emotion recognition system based on transfer learning[J]. Discov Artif Intell, 2025, 5(1):49. DOI
[13]	Dennis M, Prabhu D, Baker S, et al. Analysis of in-home movement patterns for depression assessment in older adults:a feasibility study[M]// Health innovation community:it starts with us. Netherlands: IOS Press, 2024.
[14]	Ji XY, Yuh A, Erdélyi V, et al. Exploring effective sensing indicators of loneliness for elderly community in US and Japan[C]// Extended Abstracts of the CHI Conference on Human Factors in Computing Systems. Honolulu HI USA. ACM, 2024:1-9.
[15]	Ji XY, Yuh A, Erdélyi V, et al. SMILE:sensor data-driven detection and counterfactual pattern analysis for loneliness in older adults[J]. ACM Trans Comput Healthcare, 2026, 7(2):1-30.
[16]	Kang BD, Park MK, Kim JI, et al. Exploring factors related to social isolation among older adults in the predementia stage using ecological momentary assessments and actigraphy:machine learning approach[J]. J Med Internet Res, 2025, 27:e69379. DOI URL
[17]	Lee TR, Kim GH, Choi MT. Geriatric depression and anxiety screening via deep learning using activity tracking and sleep data[J]. Int J Geriat Psychiatry, 2024, 39(2):e6071. DOI URL
[18]	Nejadshamsi S, Karami V, Ghourchian N, et al. Development and feasibility study of HOPE model for prediction of depression among older adults using Wi-Fi-based motion sensor data:machine learning study[J]. JMIR Aging, 2025, 8:e67715. DOI URL
[19]	Rykov YG, Ng KP, Patterson MD, et al. Predicting the severity of mood and neuropsychiatric symptoms from digital biomarkers using wearable physiological data and deep learning[J]. Com-put Biol Med, 2024, 180:108959.
[20]	Valero-Ramon Z, Ibanez-Sanchez G, Martinez-Millana A, et al. Personalised risk modelling for older adult cancer survivors:combining wearable data and self-reported measures to address time-varying risks[J]. Sensors, 2025, 25(7):2097. DOI URL
[21]	Wang YR, Jiang YH. Design and implementation of the cognitive evaluation function of an AI-enabled companion robot:taking the ROBIN robot as an example[C]// 2025 6th International Conference on Big Data,Artificial Intelligence and Internet of Things Engineering(ICBAIE). October 17-19,2025,Shanghai,China. IEEE, 2026:500-503.
[22]	Zhao YL, Zhang HW, Li J, et al. Multimodal depression assessment framework integrating personality and gait for older adults with medical conditions[J]. IEEE Trans Affect Comput, 2025, 16(3):2048-2061. DOI URL
[23]	周滢. 老年轻度认知障碍患者情绪问题多模态特征融合分类模型的构建与评价研究[D]. 北京: 北京协和医学院, 2022.
	Zhou Y. Construction and evaluation of multimodal feature fusion classification models for emotional problems in older adults with mild cognitive impairment[D]. Beijing: Peking Union Medical College, 2022.
[24]	Abdollahi H, Mahoor MH, Zandie R, et al. Artificial emotional intelligence in socially assistive robots for older adults:a pilot study[J]. IEEE Trans Affect Comput, 2023, 14(3):2020-2032. DOI URL
[25]	Bautista-Salinas D, González JR, Méndez I, et al. Monitoring and prediction of mood in elderly people during daily life activities[C]// 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society(EMBC). July 23-27,2019,Berlin,Germany. IEEE, 2019:6930-6934.
[26]	Kargar BAH, Mahoor MH. A pilot study on the eBear socially assistive robot:implication for interacting with elderly people with moderate depression[C]// 2017 IEEE-RAS 17th International Conference on Humanoid Robotics(Humanoids). November 15-17,2017,Birmingham, UK. IEEE, 2018:756-762.
[27]	Kim H, Lee S, Lee S, et al. Depression prediction by using ecological momentary assessment,actiwatch data,and machine learning:observational study on older adults living alone[J]. JMIR Mhealth Uhealth, 2019, 7(10):e14149. DOI URL
[28]	Gutierrez Maestro E, De Almeida TR, Schaffernicht E, et al. Wearable-based intelligent emotion monitoring in older adults during daily life activities[J]. Appl Sci, 2023, 13(9):5637. DOI URL
[29]	Prenkaj B, Aragona D, Flaborea A, et al. A self-supervised algorithm to detect signs of social isolation in the elderly from daily activity sequences[J]. Artif Intell Med, 2023, 135:102454. DOI URL
[30]	Schütz N, Botros A, Ben Hassen S, et al. A sensor-driven visit detection system in older adults’ homes:towards digital late-life depression marker extraction[J]. IEEE J Biomed Health Inform, 2022, 26(4):1560-1569. DOI URL
[31]	Seok JW, Kwon YJ, Lee H. Feasibility and efficacy of TouchCare system using application for older adults living alone:a pilot pre-experimental study[J]. BMC Geriatr, 2022, 22(1):799. DOI
[32]	Sharma G, Joshi J, Zeghari R, et al. Audio-visual weakly supervised approach for apathy detection in the elderly[C]// 2020 International Joint Conference on Neural Networks(IJCNN). July 19-24,2020,Glasgow, UK. IEEE, 2020:1-7.
[33]	沈志莹, 李成媛, 王莎, 等. 可穿戴式柔性设备在护理安全管理中的应用进展[J]. 中华护理杂志, 2025, 60(17):2073-2078. DOI
	Shen ZY, Li CY, Wang S, et al. Research progress of wearable flexible devices in nursing safety management[J]. Chin J Nurs, 2025, 60(17):2073-2078. DOI
[34]	代咏航, 邱小芩, 陈思帆, 等. 可穿戴运动传感设备在衰弱老年人运动康复中应用的范围综述[J]. 中华护理杂志, 2026, 61(10):1427-1434. DOI
	Dai YH, Qiu XQ, Chen SF, et al. Wearable motion sensing devices for exercise rehabilitation in frail older adults:a scoping review[J]. Chin J Nurs, 2026, 61(10):1427-1434.

多模态融合技术在老年人心理症状管理中应用的范围综述

Application of multimodal fusion technology in the management of geriatric psychological symptoms：a scoping review

RichHTML

PDF

可视化

摘要/Abstract

引用本文

使用本文

图/表 1

参考文献 34

相关文章 15

编辑推荐

Metrics

[1]	陈晨, 顾肖, 郭凡, 王敏, 倪兴梅, 黄琴, 程念开. 3种衰弱评估工具对急诊老年创伤患者不良结局的预测价值[J]. 中华护理杂志, 2026, 61(9): 1200-1207.
[2]	杨明霞, 安冉, 臧金凤, 李春梅. 老年慢性病共病患者及照护者老老照护能力与自我忽视的相关性分析[J]. 中华护理杂志, 2026, 61(9): 1230-1236.
[3]	韩媛媛, 石玉竹, 尚文涵, 么莉. 870所三级甲等医院老年住院患者跌倒伤害发生现状与影响因素分析[J]. 中华护理杂志, 2026, 61(9): 1245-1252.
[4]	李琰, 许翠萍. 聊天机器人在降低老年人社会疏离感中的应用进展及护理启示[J]. 中华护理杂志, 2026, 61(9): 1291-1296.
[5]	李英, 闵玉娣, 罗葳, 高轩, 赵晟楠. 老年牙列缺损患者结构化健康教育方案的构建及应用研究[J]. 中华护理杂志, 2026, 61(8): 1043-1050.
[6]	李珊, 邵梦琪, 邱晨, 苏清清, 高远. 4 907例老年髋部骨折患者术后并发症发生现状及影响因素研究[J]. 中华护理杂志, 2026, 61(8): 1059-1065.
[7]	李秋桦, 傅桂芬, 蒋建华, 尹丹, 左静, 刘艳群. 可穿戴设备在炎症性肠病患者动态监测与管理中应用的范围综述[J]. 中华护理杂志, 2026, 61(8): 1132-1140.
[8]	王秀丽, 代春豪, 许梓婷, 李昊远, 冷敏敏, 张海博, 李晴, 杨丽娟. 运动干预在老年肌少性肥胖患者中应用的范围综述[J]. 中华护理杂志, 2026, 61(7): 995-1001.
[9]	贺敬婷, 应燕萍, 陆秋芳, 赵慧函, 刘丽颖, 马含章, 张程. 多模态数据在护理领域中应用的范围综述[J]. 中华护理杂志, 2026, 61(7): 1002-1008.
[10]	张莹, 杜若飞, 杨惠敏, 徐晓霞, 李黎明, 杜亚婷. 初诊血液肿瘤老年患者的衰弱现状及影响因素研究[J]. 中华护理杂志, 2026, 61(6): 749-756.
[11]	覃文婷, 杨连招, 龙秀红, 陈玲, 高慧, 桑树林. 老年HIV感染者心理社会适应的潜在剖面分析及影响因素研究[J]. 中华护理杂志, 2026, 61(6): 797-805.
[12]	韩朝颖, 赵雅宁, 刘瑶, 李雪梅, 常学优, 李建民. 社区慢性病老年人内在能力与社会衰弱的相关性研究[J]. 中华护理杂志, 2026, 61(6): 829-835.
[13]	武玲, 吴波, 陈红, 古晨茜, 刘洋, 张春谨, 陈梦琪, 章青. 基于机器学习算法的成人术中低体温预测模型的范围综述[J]. 中华护理杂志, 2026, 61(6): 844-851.
[14]	郭晓贝, 王颖, 郭月, 崔梦影, 鲁志卉, 黄子菁. 方步运动在老年人运动认知风险综合征预防中的应用进展[J]. 中华护理杂志, 2026, 61(6): 852-857.
[15]	陈静, 王君君, 魏晓琼, 何欢, 孙秋怡, 唐莹, 韩莹, 何华云. 运动干预在幼年特发性关节炎患儿中应用的范围综述[J]. 中华护理杂志, 2026, 61(6): 858-864.