面向电商短视频高转化率的多模态情感识别框架研究

欧 阳瑀, 冯 佳艺, 郭 开攀, 焦 武成, 郭 文斌
江西科技师范大学

摘要


电商短视频转化效果受情绪节奏与多模态信息协同影响。针对传统情感分析难以识别商业情绪的问题，本
文提出面向高转化短视频的多模态情感识别框架，融合文本、视觉与音频特征，并引入开放词表与可解释推理机制。
基于30条样本验证发现，高转化视频转化阶段紧迫感占比达53.3%，与高转化显著正相关（r=0.596）。研究表明，高
转化内容通常遵循“痛点唤醒—信任构建—行动刺激”的情绪路径，可为内容优化提供参考。

关键词


多模态情感识别；电商短视频；开放词表；可解释人工智能；内容分析

全文:

PDF


参考


[1]中国互联网络信息中心（CNNIC）.《中国互联

网络发展状况统计报告》[R]，2025.

[2]Baltrušaitis T, Ahuja C, Morency L P. Multimodal

Machine Learning: A Survey and Taxonomy[J]. IEEE

Transactions on Pattern Analysis and Machine Intelligence,

2019, 41(2): 423-443.

[3]Poria S, Cambria E, Bajpai R, Hussain A. A Review

of Affective Computing: From Unimodal Analysis to

Multimodal Fusion[J]. Information Fusion, 2017, 37: 98-125.

[4]Tsai Y H H, Bai S, Liang P P, Kolter J Z, Morency L

P, Salakhutdinov R. Multimodal Transformer for Unaligned

Multimodal Language Sequences[C]//Proceedings of the

57th Annual Meeting of the Association for Computational

Linguistics. 2019: 6558-6569.

[5]Zadeh A, Chen M, Poria S, Cambria E, Morency

L P. Tensor Fusion Network for Multimodal Sentiment

Analysis[C]//Proceedings of the 2017 Conference on

Empirical Methods in Natural Language Processing. 2017:

1103-1114.

[6]Lian Z, Sun H, Sun L, et al. Open-vocabulary

Multimodal Emotion Recognition: Dataset, Metric and

Benchmark[EB/OL]. OpenReview, 2024.

[7]Lian Z, Sun H, Sun L, et al. Explainable Multimodal

Emotion Recognition[EB/OL]. arXiv:2306.15401, 2023.

[8]Ribeiro M T, Singh S, Guestrin C. Why Should I

Trust You? Explaining the Predictions of Any Classifier[C]//

Proceedings of the 22nd ACM SIGKDD International

Conference on Knowledge Discovery and Data Mining. 2016:

1135-1144.




DOI: http://dx.doi.org/10.12361/2661-3654-08-04-160479

Refbacks

  • 当前没有refback。