Task processing, automatic question answering and multimedia data recognition model training method
CN117150338BActive Publication Date: 2026-08-28ALIBABA (CHINA) CO LTD
Patent Information
- Application Number
- CN202310935405.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-07-27
- Publication Date
- 2026-08-28
- Estimated Expiration
- 2043-07-27
AI Technical Summary
Technical Problem
然而，上述方案依赖于调用外部软件接口，效果受限于外部软件的能力，并且，各任务通过独立的外部模型实现，无法处理复杂的多媒体理解任务，因此，亟需一种普适性高的通用多媒体数据处理的方案
Benefits of technology
[0040]本说明书一个实施例提供的任务处理方法，获取目标多媒体数据和针对目标多媒体数据的任务处理数据；将目标多媒体数据输入多媒体数据识别模型，获得目标多媒体数据对应的多媒体特征，其中，多媒体数据识别模型基于多组样本多媒体文本对和样本多媒体文本对对应的样本任务训练得到，样本多媒体文本对包括样本多媒体数据和样本多媒体数据对应的样本文本数据；将多媒体特征和任务处理数据输入用于自然语言处理的神经网络模型，获得任务处理数据对应的处理结果。通过利用多组样本多媒体文本对和其对应的样本任务训练得到了可以进行复杂多媒体理解的多媒体数据识别模型，从而将多媒体数据识别模型和用于自然语言处理的神经网络模型相结合，实现对复杂多媒体任务的处理，提高了多媒体任务处理的普适性。
✦ Generated by Eureka AI based on patent content.
Smart Images
Figure CN117150338B_ABST
Abstract
The embodiment of the present specification provides a task processing, automatic question answering and multimedia data recognition model training method, wherein the task processing method comprises: obtaining target multimedia data and task processing data corresponding to the target multimedia data; inputting the target multimedia data into a multimedia data recognition model to obtain multimedia features corresponding to the target multimedia data, wherein the multimedia data recognition model is trained based on a plurality of sample multimedia text pairs and sample tasks corresponding to the sample multimedia text pairs, and the sample multimedia text pair comprises sample multimedia data and sample text data corresponding to the sample multimedia data; inputting the multimedia features and the task processing data into a neural network model for natural language processing to obtain a processing result corresponding to the task processing data. By combining the multimedia data recognition model and the neural network model for natural language processing, the processing of complex multimedia tasks is realized, and the universality of multimedia task processing is improved.
Need to check novelty before this filing date? Find Prior Art
Citation Information
Patent Citations
Question answering system and method, electronic equipment and storage medium
CN114911910A