Unlock instant, AI-driven research and patent intelligence for your innovation.

Model data processing method and device, electronic equipment and computer readable medium

A processing method and technology of model data, applied in the computer field, can solve problems such as the combination of single-modal language models without multi-modal data sets, and achieve the effect of improving model data processing capabilities and accurate single-modal results

Pending Publication Date: 2021-12-21
BEIJING WODONG TIANJUN INFORMATION TECH CO LTD +1
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This is because with the widespread use of smart phones, customers are more willing to take a picture and send it to customer service. A picture is worth a thousand words, and the problem is described in more detail through pictures. However, in the prior art, there is no combination of multimodal data sets and Example of combining pretrained unimodal language models

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Model data processing method and device, electronic equipment and computer readable medium
  • Model data processing method and device, electronic equipment and computer readable medium
  • Model data processing method and device, electronic equipment and computer readable medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] The present disclosure will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain related inventions, rather than to limit the invention. It should also be noted that, for the convenience of description, only the parts related to the related invention are shown in the drawings.

[0032] It should be noted that, in the case of no conflict, the embodiments in the present disclosure and the features in the embodiments can be combined with each other. The present disclosure will be described in detail below with reference to the accompanying drawings and embodiments.

[0033] figure 1 An exemplary system architecture 100 is shown to which the model data processing methods of the present disclosure may be applied.

[0034] Such as figure 1 As shown, the system architecture 100 may include terminal devices 101 , 102 , 103 , a network ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a model data processing method and device, and relates to the technical field of artificial intelligence. One specific embodiment of the method comprises the following steps: obtaining data of at least two different modalities in a data set to be processed; carrying out feature extraction on the data of at least two different modes, and then splicing and / or superposing to obtain a feature sequence; performing model mapping processing on the feature sequence to obtain multi-modal input data matched with the autoregression model; and inputting the multi-modal input data into the autoregression model to obtain a single-modal result output by the autoregression model. According to the embodiment, the richness of the information amount of the model input data is improved.

Description

technical field [0001] The present disclosure relates to the field of computer technology, specifically to the field of artificial intelligence technology, and in particular to a model data processing method, device, electronic equipment, computer readable medium, and computer program product. Background technique [0002] Most of the existing dialogue system datasets are unimodal datasets, and the corresponding dialogue generation system research is limited by the limitations of the datasets, and the models studied are also unimodal. But in actual application scenarios, the questions asked by customers in the dialogue system are often multi-modal, such as text information + picture information. This is because with the widespread use of smart phones, customers are more willing to take a picture and send it to customer service. A picture is worth a thousand words, and the problem is described in more detail through pictures. However, in the prior art, there is no combination...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/45G06F40/284
CPCG06F16/45G06F40/284G06F40/30G06V20/70G06V10/40G06V10/806G06F40/40G06V10/7715
Inventor 赵楠吴友政
Owner BEIJING WODONG TIANJUN INFORMATION TECH CO LTD