Evaluation model construction method, model generation information evaluation method and device

Abstract

The embodiment of the invention relates to a construction method of an evaluation model and an evaluation method and device of model generation information, and the construction method comprises the steps: obtaining a plurality of multimedia samples generated by a target generation model for a prompt information sample, and obtaining evaluation result labels corresponding to the plurality of multimedia samples under a plurality of preset evaluation dimensions; performing fusion processing on the prompt information sample and the target multimedia sample through an information processing network to obtain multiple pieces of sample fusion information; based on the multiple pieces of sample fusion information, network evaluation results corresponding to the multiple multimedia samples under multiple evaluation dimensions are generated through multiple evaluation networks to be trained; training a plurality of evaluation networks based on the evaluation result labels and the network evaluation results corresponding to the plurality of multimedia samples under the plurality of evaluation dimensions; and constructing an evaluation model based on the information processing network and the trained evaluation networks. According to the embodiment of the invention, the reliability of evaluating the model generation information is effectively guaranteed.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a method for constructing an evaluation model, and a method and device for evaluating model generation information. Background Art

[0002] With the popularity of generative models, generative models are used in various fields such as gaming and academia to conveniently and quickly generate the required multimedia information. For example, image generation models can be used to generate realistic virtual images, and text generation models can be used to generate text containing the required content. The reliability of the multimedia information generated by the generative model will directly affect the user experience. Therefore, it is necessary to evaluate the multimedia information generated by the generative model so as to optimize and adjust the generative model based on the evaluation results, so as to enable the generative model to generate more reliable multimedia information to meet user needs. However, the related art has a poor evaluation method for multimedia information generated by the generative model. Summary of the invention

[0003] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides a method for constructing an evaluation model, and a method and device for evaluating model generation information.

[0004] In a first aspect, an embodiment of the present disclosure provides a method for constructing an evaluation model, comprising: obtaining multiple multimedia samples generated by a target generation model for a prompt information sample, and obtaining evaluation result labels corresponding to the multiple multimedia samples under multiple preset evaluation dimensions; wherein the multiple multimedia samples are all presented in the form of targets; fusing the prompt information samples with target multimedia samples in the multiple multimedia samples corresponding to the prompt information samples under each of the evaluation dimensions through a preset information processing network to obtain multiple sample fusion information; based on the multiple sample fusion information, generating network evaluation results corresponding to the multiple multimedia samples under the multiple evaluation dimensions through multiple evaluation networks to be trained; wherein the multiple evaluation networks correspond one-to-one to the multiple evaluation dimensions; based on the evaluation result labels and network evaluation results corresponding to the multiple multimedia samples under the multiple evaluation dimensions, training the multiple evaluation networks; and constructing an evaluation model based on the information processing network and the trained multiple evaluation networks.

[0005] In a second aspect, an embodiment of the present disclosure provides an evaluation method for model-generated information, comprising: obtaining target multimedia information generated by a target generation model for target prompt information; based on the target prompt information, using a pre-constructed evaluation model to generate network evaluation results corresponding to the target multimedia information under multiple preset evaluation dimensions; wherein the evaluation model is constructed using the evaluation model construction method described in the first aspect.

[0006] In a third aspect, an embodiment of the present disclosure further provides a device for constructing an evaluation model, comprising: a sample acquisition module, used to obtain multiple multimedia samples generated by a target generation model for a prompt information sample, and to obtain evaluation result labels corresponding to the multiple multimedia samples under multiple preset evaluation dimensions; wherein the multiple multimedia samples are all presented in the form of targets; a fusion module, used to fuse the prompt information sample with the target multimedia samples in the multiple multimedia samples corresponding to the prompt information sample under each of the evaluation dimensions through a preset information processing network to obtain multiple sample fusion information; a network evaluation module, used to generate network evaluation results corresponding to the multiple multimedia samples under the multiple evaluation dimensions through multiple evaluation networks to be trained based on the multiple sample fusion information; wherein the multiple evaluation networks correspond one-to-one to the multiple evaluation dimensions; a network training module, used to train the multiple evaluation networks based on the evaluation result labels and network evaluation results corresponding to the multiple multimedia samples under the multiple evaluation dimensions; and a model construction module, used to construct an evaluation model based on the information processing network and the multiple evaluation networks after training.

[0007] In a fourth aspect, an embodiment of the present disclosure further provides an evaluation device for model output information, comprising: a generation information acquisition module, used to obtain target multimedia information generated by a target generation model for target prompt information; a multi-dimensional evaluation module, used to generate, based on the target prompt information, network evaluation results corresponding to the target multimedia information under multiple preset evaluation dimensions using a pre-constructed evaluation model; wherein the evaluation model is constructed using the evaluation model construction method described in the first aspect.

[0008] In a fifth aspect, an embodiment of the present disclosure further provides an electronic device, comprising: a processor; a memory for storing executable instructions of the processor; the processor is used to read the executable instructions from the memory and execute the instructions to implement a method for constructing an evaluation model or a method for evaluating model output information as provided in an embodiment of the present disclosure.

[0009] In a sixth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium, wherein the storage medium stores a computer program, and the computer program is used to execute a method for constructing an evaluation model or a method for evaluating model output information as provided in an embodiment of the present disclosure.

[0010] In a seventh aspect, an embodiment of the present disclosure further provides a computer program product, including a computer program, which, when executed by a processor, implements the method for constructing an evaluation model or the method for evaluating model output information provided in an embodiment of the present disclosure.

[0011] The above technical solution provided by the embodiment of the present disclosure can preset multiple evaluation dimensions, and use the preset information processing network and the trained evaluation network corresponding to the multiple evaluation dimensions to construct an evaluation model. In the above solution, the evaluation network can be trained according to the evaluation result labels and network evaluation results corresponding to the multiple multimedia samples generated by the target generation model for the prompt information sample under multiple evaluation dimensions, so it can effectively ensure that the trained multiple evaluation networks can generate more accurate evaluation results, and the obtained network evaluation results are also multi-dimensional, that is, the final evaluation model can provide more accurate evaluation results for the multimedia information generated by the target generation model under multiple evaluation dimensions, effectively ensuring the reliability of the evaluation of the model generation information.

[0012] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0014] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0015] Figure 1 A schematic diagram of a flow chart of a method for constructing an evaluation model provided in an embodiment of the present disclosure;

[0016] Figure 2 A schematic diagram of the structure of an evaluation model provided in an embodiment of the present disclosure;

[0017] Figure 3 A schematic diagram of the structure of an evaluation model provided in an embodiment of the present disclosure;

[0018] Figure 4 A schematic diagram of constructing an evaluation model provided in an embodiment of the present disclosure;

[0019] Figure 5 A schematic diagram of constructing an evaluation model provided in an embodiment of the present disclosure;

[0020] Figure 6 A schematic diagram of a flow chart of a method for evaluating model generation information provided by an embodiment of the present disclosure;

[0021] Figure 7 A schematic diagram of the structure of a device for constructing an evaluation model provided in an embodiment of the present disclosure;

[0022] Figure 8 A schematic diagram of the structure of a device for evaluating model output information provided by an embodiment of the present disclosure;

[0023] Fig. 9 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0024] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0025] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0026] Figure 1 The present invention provides a flow chart of a method for constructing an evaluation model, which can be executed by a device for constructing an evaluation model, wherein the device can be implemented by software and / or hardware and can generally be integrated in an electronic device. Figure 1 As shown, the method mainly includes the following steps S102 to S110:

[0027] Step S102, obtaining multiple multimedia samples generated by the target generation model for the prompt information sample, and obtaining evaluation result labels corresponding to the multiple multimedia samples under multiple preset evaluation dimensions. The number of the multiple multimedia samples can be two or more, and the number of the multiple evaluation dimensions can be two or more, which can be flexibly set according to needs.

[0028] In the disclosed embodiment, the multimedia information generated by the target generation model for the prompt information sample is referred to as a multimedia sample. The disclosed embodiment does not limit the form of the multimedia information that can be generated by the target generation model. Any generation model can be used as a target generation model. For a certain target generation model, the multiple multimedia samples generated for the prompt information sample are all presented in a target form. Exemplarily, the target form includes a text form, an image form, an audio form or a video form, that is, the multiple multimedia samples can all be texts, or all be images, or all be audio, etc. In other words, the target generation model can be a text generation model, an image generation model, an audio generation model or a video generation model, and the target generation model can be flexibly set according to the needs.

[0029] In practical applications, the prompt information sample can be input into the target generation model so that the target generation model generates a multimedia sample corresponding to the prompt information sample. The embodiment of the present disclosure does not limit the form and content of the prompt information sample. The prompt information sample is used to indicate the relevant prompt information of the multimedia information that the target generation model needs to generate. The more detailed and specific the information described by the prompt information sample is, the more the multimedia information generated by the target generation model can meet the needs. The method for the target generation model to generate corresponding multimedia information for the prompt information can refer to the relevant technology and will not be repeated here. In the embodiment of the present disclosure, the target generation model can be controlled to generate multiple different multimedia samples by adjusting the parameters of the target generation model or inputting noise.

[0030] In the disclosed embodiment, in order to be able to more reliably and comprehensively evaluate the multimedia information of the target generation model, multiple evaluation dimensions can be set, that is, to measure the quality of the multimedia information from multiple angles, or to evaluate the various attributes of the multimedia information separately. The evaluation dimensions corresponding to multimedia information in different forms may be different. For example, if the multimedia information is in text form, the corresponding multiple evaluation dimensions may be fluency dimension, logic dimension, content matching dimension, etc.; if the multimedia information is in image form, the corresponding multiple evaluation dimensions may be clarity dimension, aesthetic dimension, image-text matching dimension, exposure dimension, texture dimension, etc.; if the multimedia information is in audio form, the corresponding multiple evaluation dimensions may be sound quality dimension, content matching dimension, fluency dimension, etc.; if the multimedia information is in video form, the corresponding multiple evaluation dimensions may be picture dimension, content matching dimension, fluency dimension, etc. It should be noted that the above are all exemplary descriptions. In actual applications, the corresponding multiple evaluation dimensions can be determined flexibly according to the form of multimedia information that can be generated by the target generation model, and no limitation is made here.

[0031] The embodiment of the present disclosure can obtain evaluation result labels corresponding to multiple multimedia samples under multiple preset evaluation dimensions, and the evaluation result labels are used to characterize the more accurate results corresponding to multiple multimedia samples under multiple preset evaluation dimensions, such as results that are more in line with human feelings. Exemplarily, the evaluation result labels can be determined based on the evaluation of multiple multimedia samples by users or professional evaluators under multiple preset evaluation dimensions. At this time, the evaluation result labels are obtained based on the manual evaluation results. The evaluation result labels are used to reflect human feedback on multiple multimedia samples. In addition, the evaluation result labels can also be obtained based on a trained neural network model, which is not limited here. In practical applications, for each evaluation dimension, the form of the evaluation result labels corresponding to multiple multimedia samples in the evaluation dimension can be represented by a label evaluation score or a label evaluation level, or by a ranking representation of the label evaluation of multiple multimedia samples from best to worst. It is also possible to select only the multimedia samples with the best performance and the multimedia samples with the worst performance under the evaluation dimension. The above is only an example, and the expression form of the evaluation result label can be set according to the needs, which is not limited here. The disclosed embodiment obtains evaluation result labels corresponding to multiple multimedia samples under each evaluation dimension, and presents multiple multimedia samples to evaluators such as annotators or users, so that the evaluators can evaluate different multimedia samples by comparison, and the obtained evaluation result labels are more objective. In addition, the disclosed embodiment can also more comprehensively and reliably present human perception feedback on multiple multimedia samples from different angles by obtaining the evaluation result labels corresponding to multiple multimedia samples under multiple evaluation dimensions, and the obtained evaluation result labels are also more precise and accurate.

[0032] Step S104, through a preset information processing network, the prompt information sample is respectively fused with the target multimedia sample in the multiple multimedia samples corresponding to the prompt information sample under each evaluation dimension to obtain multiple sample fusion information. That is, the number of sample fusion information is the same as the number of multimedia samples, the sample fusion information corresponds to the target multimedia sample one by one, and each sample fusion information fuses the features of the prompt information sample and the features of the target multimedia sample corresponding to the sample fusion information.

[0033] The embodiments of the present disclosure do not limit the method of determining the target multimedia sample among the multiple multimedia samples corresponding to the prompt information sample under each evaluation dimension. For example, a multimedia sample that meets preset conditions can be used as the target multimedia sample. By way of example, for each evaluation dimension, the positive sample and / or the negative sample corresponding to the prompt information sample among the multiple multimedia samples is used as the target multimedia sample, wherein the positive and negative samples can be determined based on the evaluation result label. Under each evaluation dimension, the number of positive samples and the number of negative samples corresponding to the prompt information sample can also be flexibly set, and are not limited here. Taking the evaluation dimension as the clarity dimension and the multimedia sample as an example, the first N clearest images and the first M blurriest images among the multiple images generated by the target generation model for the prompt information sample can be used as the target multimedia samples, respectively.

[0034] Exemplarily, the information processing network can be directly implemented using a pre-trained feature processing network, which can extract the first feature of the prompt information sample and the second feature of each target multimedia sample respectively, and then fuse the first feature with each second feature respectively to obtain multiple sample fusion information. The sample fusion information can be presented in the form of a feature vector.

[0035] Step S106, based on the fusion information of multiple samples, generate network evaluation results corresponding to multiple multimedia samples under multiple evaluation dimensions through multiple evaluation networks to be trained; wherein different evaluation networks correspond to different evaluation dimensions, multiple evaluation networks correspond one-to-one to multiple evaluation dimensions, and the number of evaluation networks is the same as the number of evaluation dimensions.

[0036] Exemplarily, for each sample fusion information, the sample fusion information is input into multiple evaluation networks respectively, so that each evaluation network generates a network evaluation result corresponding to the sample fusion information, and the network evaluation result is regarded as the network evaluation result of the evaluation network for the multimedia sample corresponding to the sample fusion information. Similarly, the network evaluation result can be represented by a network evaluation score or a network evaluation grade, or by ranking the network evaluations of multiple multimedia samples from best to worst, or only the multimedia samples with the best performance and the worst performance under the evaluation dimension corresponding to the evaluation network can be selected. The above is only an example, and the expression form of the network evaluation result can be set according to the needs, and it is not limited here.

[0037] To facilitate application, in some specific implementation examples, each evaluation network can generate an evaluation result of the corresponding multimedia sample under the evaluation dimension corresponding to the evaluation network for each sample fusion information. The evaluation result can be represented by a score or grade, that is, each evaluation network can clearly and unambiguously output the network evaluation result of each multimedia sample, thereby demonstrating the performance of each multimedia sample under the evaluation dimension corresponding to the evaluation network.

[0038] In practical applications, for each evaluation network, each sample fusion information in multiple sample fusion information can be input into the evaluation network respectively. The evaluation network can extract the features corresponding to the prompt sample information and the features corresponding to the multimedia sample from the sample fusion information. Therefore, with the assistance of the features corresponding to the prompt sample information, the quality of the multimedia sample under the evaluation dimension corresponding to the evaluation network can be better evaluated, and the corresponding network evaluation results can be presented in preset forms such as scores.

[0039] Step S108 , training multiple evaluation networks based on the evaluation result labels and network evaluation results corresponding to multiple multimedia samples under multiple evaluation dimensions.

[0040] Exemplarily, for each evaluation dimension, based on the evaluation result labels corresponding to the multiple multimedia samples under the evaluation dimension and the network evaluation results, the evaluation network corresponding to the evaluation dimension is trained. That is, for different evaluation networks, separate training is adopted. It can be understood that the aforementioned information processing network can be a trained network, that is, it can effectively and reliably obtain the fusion information samples corresponding to the prompt information samples and each multimedia sample. On this basis, the parameters of the aforementioned information processing network can be fixed, and the parameters of each evaluation network can be directly adjusted based on the network evaluation results corresponding to the multiple multimedia samples output by each evaluation network and the pre-acquired evaluation result labels, so as to optimize each evaluation network so that the network evaluation results output by each evaluation network can be more accurate. For example, when the evaluation result labels are obtained based on manual evaluation results, the network evaluation results obtained by the above method can be closer to human feedback, that is, it helps users to think that the network evaluation results are more accurate and more in line with user perception. The training processes between different evaluation networks can not affect each other. The above method is not only more efficient in training, but also can better ensure that each evaluation network can accurately output the evaluation results of the corresponding evaluation dimension without being interfered by the performance of multimedia samples under other evaluation dimensions.

[0041] Step S110, constructing an evaluation model based on the information processing network and the trained multiple evaluation networks.

[0042] In some embodiments, the information processing network and the trained multiple evaluation networks together constitute an evaluation model, which is used to evaluate the received multimedia information generated by the target generation model based on multiple evaluation dimensions, and output network evaluation results corresponding to the multiple evaluation dimensions. That is, using this evaluation model, the model generation information can be evaluated from multiple levels at the same time. This method is simpler and can perform a comprehensive multi-dimensional evaluation of the model generation information at one time.

[0043] In other embodiments, the information processing network and each evaluation network after training are constructed into evaluation models respectively, and multiple evaluation models are obtained. For example, if there are N evaluation networks in total, N evaluation models can be constructed, and each evaluation model is used to evaluate the multimedia information generated by the received target generation model based on the evaluation dimension corresponding to the evaluation network in the evaluation model, and output the network evaluation result corresponding to the evaluation dimension. This method is more flexible, and users can select the evaluation model corresponding to the required evaluation dimension according to their needs to evaluate the model generation information.

[0044] In summary, the method for constructing the above-mentioned evaluation model provided by the embodiment of the present disclosure can train the evaluation network according to the evaluation result labels and network evaluation results corresponding to the multiple multimedia samples generated by the target generation model for the prompt information sample under multiple evaluation dimensions. Therefore, it can effectively ensure that the multiple evaluation networks after training can generate relatively accurate evaluation results, and the obtained network evaluation results are also multi-dimensional, that is, the final evaluation model can provide relatively accurate evaluation results for the multimedia information generated by the target generation model under multiple evaluation dimensions, which fully guarantees the reliability of the evaluation of the model generated information.

[0045] In order to ensure the reliability of the fused information, the disclosed embodiment further provides an implementation example of an information processing network, wherein the information processing network includes a feature coding layer and a feature fusion layer; the disclosed embodiment does not limit the specific structure of the feature coding layer and the feature fusion layer. On this basis, the prompt information sample is fused with each multimedia sample through the preset information processing network, including the following steps a and b:

[0046] Step a: obtaining, through a feature coding layer, first features of the prompt information sample and second features of a target multimedia sample among a plurality of multimedia samples corresponding to the prompt information sample under each evaluation dimension.

[0047] Step b: The first feature is fused with each second feature through a feature fusion layer. For example, for each second feature, the feature fusion layer can perform a dot product operation on the first feature and the second feature, thereby aggregating and interacting the prompt information with the multimedia information to obtain the required sample fusion information.

[0048] Considering that the presentation forms of the prompt information and the multimedia information may be the same or different, in order to facilitate feature extraction, based on the different presentation forms of the prompt information sample and the multimedia sample, such as the presentation form of the prompt information sample is in text form, and the presentation form of the multimedia information is in image form, the feature coding layer may include a first encoder and a second encoder; the first encoder and the second encoder are used to process information in different presentation forms. Among them, the first encoder is used to obtain the first feature, and the second encoder is used to obtain the second feature. In other words, the first encoder is used to process information in the first presentation form, such as for feature extraction of text; the second encoder is used to process information in the second presentation form, such as for processing images. The above is only an example. Specifically, the corresponding encoder can be set based on the form of the prompt information and the form of the multimedia information, so that the prompt information and the multimedia information can be encoded more reliably, and effective features can be extracted.

[0049] The embodiments of the present disclosure do not limit the structure of the evaluation network. The structures of multiple evaluation networks may be the same or different. For example, multiple evaluation networks may all be implemented using a multilayer perceptron (MLP).

[0050] Based on the foregoing, the present disclosure further describes the training method of the evaluation network as follows.

[0051] In order to train the evaluation network efficiently and reliably, in some specific implementation examples, the evaluation result labels corresponding to multiple multimedia samples under each evaluation dimension are used to indicate the first sample and the second sample corresponding to the multiple multimedia samples under the evaluation dimension; wherein the first sample corresponding to each evaluation dimension is the target multimedia sample represented as the best among the multiple multimedia samples by the evaluation result label information under the evaluation dimension; the second sample corresponding to each evaluation dimension is the target multimedia sample represented as the worst among the multiple multimedia samples by the evaluation result label information under the evaluation dimension. That is, based on the evaluation result labels, the best samples and the worst samples corresponding to multiple multimedia samples under each evaluation dimension can be obtained. The above method can effectively ensure the accuracy of the evaluation result labels. Specifically, the embodiment of the present disclosure fully considers that there may be similar samples in the multiple multimedia samples generated by the target generation model. It is usually difficult for humans to accurately distinguish which of these similar samples are better, so it is not convenient to give evaluation results for each multimedia sample separately. In other words, even if the evaluation results are given separately for each multimedia sample, it may not be objective and accurate. However, humans can usually intuitively select the best and the worst samples under a certain evaluation dimension from multiple multimedia samples by comparison, such as, under the clarity dimension, humans can easily select one of the clearest images and one of the most blurred images from 10 images, but it is difficult to clearly distinguish and compare the pros and cons of each clarity for multiple images with average clarity in the middle, and give accurate evaluation results. Therefore, the best and worst samples selected by manual evaluation in the embodiment of the present disclosure are relatively reliable and more efficient and quick. In summary, the evaluation result labels corresponding to the multiple multimedia samples obtained in each evaluation dimension in the embodiment of the present disclosure are used to indicate the best sample and the worst sample corresponding to the multiple multimedia samples under the evaluation dimension, thereby fully ensuring the accuracy of the obtained evaluation result labels.

[0052] In order to enable the evaluation network to output corresponding evaluation results for each multimedia sample in a targeted manner, in some specific implementation examples, the network evaluation results corresponding to multiple multimedia samples under each evaluation dimension are used to indicate the network evaluation score corresponding to each target multimedia sample under the evaluation dimension. Different from the above-mentioned evaluation result labels, the embodiment of the present disclosure enables the evaluation network to output corresponding network evaluation scores for each target multimedia sample under each evaluation dimension, thereby accurately measuring the performance of each target multimedia sample under each evaluation dimension through the score, so that in subsequent applications, the evaluation network provided by the embodiment of the present disclosure can also output corresponding scores for separate multimedia information (such as an image) generated by the target generation model.

[0053] In order to be able to more conveniently train the evaluation network with the help of the evaluation result label, the method provided by the embodiment of the present disclosure also includes: for each evaluation dimension, setting the label evaluation score of the first sample corresponding to the evaluation dimension to a preset maximum value, and setting the label evaluation score of the second sample corresponding to the evaluation dimension to a preset minimum value; wherein the network evaluation score is not higher than the preset maximum value, and the network evaluation score is not lower than the preset minimum value. Exemplarily, the preset maximum value is 1, and the preset minimum value is 0, so the network evaluation score output by any evaluation network for any multimedia information to be evaluated is within the interval range [0,1]. It can be understood that in the label evaluation, only the first sample (optimal sample) and the second sample (worst sample) corresponding to multiple multimedia samples under each evaluation dimension are obtained by comparison, wherein the first sample and the second sample are both target multimedia samples, and the evaluation network can output the corresponding network evaluation score for each target multimedia sample under each evaluation dimension. In order to be able to train the evaluation network based on the evaluation result label and the network evaluation result, the first sample and the second sample can be given the highest score and the lowest score respectively, so as to perform loss calculation with the network evaluation score later.

[0054] On the basis of the above, for each evaluation dimension, based on the evaluation result labels and network evaluation results corresponding to multiple multimedia samples under the evaluation dimension, the specific implementation method of training the evaluation network corresponding to the evaluation dimension can be: based on the difference between the label evaluation score of the first sample corresponding to the evaluation dimension and the network evaluation score of the first sample corresponding to the evaluation dimension, and based on the difference between the label evaluation score of the second sample corresponding to the evaluation dimension and the network evaluation score of the second sample corresponding to the evaluation dimension, the evaluation network corresponding to the evaluation dimension is trained. Exemplarily, the above difference can be determined based on the cross entropy loss, and the evaluation network is trained with the goal of narrowing the above difference, so as to enable the evaluation network to generate a network evaluation result consistent with the label evaluation.

[0055] In order to facilitate the understanding of the evaluation model finally obtained by the embodiment of the present disclosure, the embodiment of the present disclosure first provides the following Figure 2 The structural diagram of an evaluation model is shown in Figure 2 The evaluation model shown in FIG directly includes an information processing network and multiple evaluation networks (evaluation network 1 to evaluation network N). The multiple evaluation networks can be regarded as different branch networks of the evaluation model, and different evaluation networks do not affect each other. Figure 3The schematic diagram of the structure of an evaluation model shown in FIG. 1 illustrates N evaluation models, each of which includes an information processing network and an evaluation network. The evaluation networks and corresponding evaluation dimensions corresponding to the N evaluation models are different, but the information processing networks in the N evaluation models can be the same. In practical applications, the above method can be flexibly selected to construct the evaluation model according to needs.

[0056] exist Figure 2 On the basis of Figure 4 The structural diagram of an evaluation model is shown in Figure 4 It is further illustrated in FIG. 5 that the information processing network includes a feature coding layer and a feature fusion layer. The feature coding layer and the feature fusion layer can refer to the above-mentioned related content and will not be described in detail here. Figure 3 The information processing network in can also further include a feature encoding layer and a feature fusion layer. For details, please refer to Figure 4 The information processing network implementation in is not further illustrated here.

[0057] In some specific implementation examples, taking the prompt information sample as text and the multimedia information as an image as an example, Figure 4 Based on this, we further give Figure 5 The schematic diagram of the construction of an evaluation model shown in FIG. 1 is a diagram of the construction of an evaluation model, in which multiple evaluation dimensions are clarity dimension, aesthetic dimension and image-text matching dimension as examples, and the evaluation network is evaluated in the form of scoring. Figure 5 In order to facilitate understanding, the data layer for providing data, the feature processing layer for information processing based on data (corresponding to the aforementioned information processing network), and the scoring layer for scoring and evaluating data (corresponding to the aforementioned evaluation network) are graphically illustrated. Among them, the feature processing layer and the scoring layer can be used as the main network layers of the evaluation model. Figure 5 In the article, taking the example that each evaluation network is an MLP network, the clarity MLP network, aesthetics MLP network and image-text matching MLP network are illustrated in the scoring layer (corresponding to the aforementioned evaluation network), and the network evaluation results such as clarity score, aesthetics score, image-text matching score, etc. can be output respectively.

[0058] The following Figure 5 Specific explanation:

[0059] exist Figure 5In FIG. 1 , it is shown that the data layer is a clarity training sample, an aesthetic training sample, and an image-text matching training sample as input to the evaluation model to be constructed, so that a clarity MLP network, an aesthetic MLP network, and an image-text matching MLP network that can output accurate scores can be trained based on the above training samples. Taking the clarity training sample as an example, it includes an information prompt sample and multiple images (for example, 4 images) output by the target generation model based on the information prompt sample (such as a prompt text), and the clarity training sample is annotated with an evaluation result label, specifically, an image with the best clarity and an image with the worst clarity among the 4 images. The clarity training samples are input to the feature processing layer, and the text encoder (corresponding to the aforementioned first encoder) encodes the prompt text in the clarity training samples, and the image encoder (corresponding to the aforementioned second encoder) encodes the target images in the clarity training samples (such as the clearest image and the most blurred image corresponding to the prompt text), and the encoded image features and the encoded text features are fused through the multimodal interaction layer (corresponding to the aforementioned feature fusion layer) to obtain multiple fusion features, each of which is used to characterize the multimodal fusion information of an image and the prompt text; then the multiple fusion features are output to the clarity MLP network, so that the clarity MLP network can score the clarity of the target image in the clarity training samples according to the fusion features, and adjust the parameters of the clarity MLP network based on the clarity scoring results and the evaluation result labels. The remaining dimensions are similar and will not be repeated here.

[0060] It should be noted that Figure 5 This is only an example. In actual applications, the evaluation dimensions can be flexibly changed or expanded according to the form of multimedia information and actual scenarios, and are not limited here.

[0061] In summary, the evaluation model provided by the embodiments of the present disclosure can provide relatively accurate evaluation results for the multimedia information generated by the target generation model under multiple evaluation dimensions, that is, provide fine-grained evaluation results. The embodiments of the present disclosure do not limit the application scenarios of the evaluation model, such as using the evaluation model to evaluate the multimedia information output by the target generation model, thereby optimizing the target generation model based on the evaluation results; for example, the multimedia information output by multiple generation models can be compared, thereby comparing the performance of different generation models under multiple evaluation dimensions or obtaining the advantages of different generation models.

[0062] Based on the above, the embodiment of the present disclosure further provides a method for evaluating model generation information. For example, see Figure 6The flowchart of a method for evaluating model generation information provided by an embodiment of the present disclosure is shown in FIG. 1 , which can be executed by a device for evaluating model generation information, wherein the device can be implemented by software and / or hardware and can generally be integrated in an electronic device. Figure 6 As shown, the method mainly includes the following steps S602 to S604:

[0063] Step S602, obtaining target multimedia information generated by the target generation model for the target prompt information. The number of target multimedia information can be only one, and is not limited to multiple. For example, if the target generation model is an image generation model, the target multimedia information can be only one image.

[0064] Step S604, based on the target prompt information, a pre-constructed evaluation model is used to generate network evaluation results corresponding to the target multimedia information under multiple preset evaluation dimensions; wherein the evaluation model is constructed using the aforementioned evaluation model construction method.

[0065] In the above manner, the evaluation model can provide relatively accurate evaluation results for the target multimedia information generated by the target generation model under multiple evaluation dimensions, thereby fully ensuring the reliability of the evaluation of the model-generated information.

[0066] Exemplarily, the above step S604 may be performed with reference to the following steps 1 and 2:

[0067] Step 1: The target prompt information and the target multimedia information are fused through the information processing network in the pre-constructed evaluation model to obtain the target fused information. The structure of the information processing network can refer to the above-mentioned related content, and the specific processing method of the target prompt information and the target multimedia information is consistent with the above-mentioned processing method of the prompt information sample and the multimedia sample, which will not be repeated here.

[0068] Step 2: Based on the target fusion information, multiple evaluation networks in the evaluation model generate network evaluation results corresponding to the target multimedia information under multiple preset evaluation dimensions. The specific implementation method can refer to the above-mentioned related content and will not be repeated here.

[0069] In practical applications, the method provided by the embodiment of the present disclosure also includes: obtaining the weight corresponding to each evaluation dimension; generating a comprehensive evaluation result corresponding to the target multimedia information based on the weight corresponding to each evaluation dimension and the network evaluation result corresponding to the target multimedia information under each evaluation dimension.

[0070] That is, the embodiments of the present disclosure can further integrate the network evaluation results under multiple evaluation dimensions to obtain a comprehensive evaluation result, such as integrating the network evaluation scores corresponding to multiple evaluation dimensions to obtain a comprehensive score corresponding to the target multimedia information. The comprehensive score can better present the comprehensive performance of the target multimedia information under multiple dimensions.

[0071] In summary, the above method provided by the embodiment of the present disclosure can provide evaluation results close to human feedback for the multimedia information generated by the target generation model under multiple evaluation dimensions, and can further perform a comprehensive evaluation of the model generation information based on the network evaluation results of multiple dimensions, thereby fully ensuring the reliability of the evaluation of the model generation information.

[0072] Corresponding to the aforementioned method for constructing an evaluation model, the present disclosure provides a device for constructing an evaluation model. Figure 7 This is a schematic diagram of a structure of a device for constructing an evaluation model provided by an embodiment of the present disclosure. The device can be implemented by software and / or hardware and can generally be integrated in an electronic device, such as Figure 7 As shown, the construction device of the evaluation model includes:

[0073] The sample acquisition module 702 is used to acquire multiple multimedia samples generated by the target generation model for the prompt information sample, and acquire evaluation result labels corresponding to the multiple multimedia samples under multiple preset evaluation dimensions; wherein the multiple multimedia samples are all presented in the form of targets;

[0074] A fusion module 704 is used to fuse the prompt information sample with the target multimedia sample in the multiple multimedia samples corresponding to the prompt information sample in each evaluation dimension through a preset information processing network to obtain multiple sample fusion information;

[0075] A network evaluation module 706 is used to generate network evaluation results corresponding to multiple multimedia samples under multiple evaluation dimensions through multiple evaluation networks to be trained based on multiple sample fusion information; wherein different evaluation networks correspond to different evaluation dimensions;

[0076] A network training module 708 is used to train multiple evaluation networks based on evaluation result labels and network evaluation results corresponding to multiple multimedia samples under multiple evaluation dimensions;

[0077] The model building module 710 is used to build an evaluation model based on the feature processing network and the trained multiple evaluation networks.

[0078] In the above-mentioned device, the evaluation network can be trained according to the evaluation result labels and network evaluation results corresponding to multiple multimedia samples generated by the target generation model for the prompt information sample under multiple evaluation dimensions. Therefore, it can be effectively guaranteed that the multiple evaluation networks after training can generate relatively accurate evaluation results, and the obtained network evaluation results are also multi-dimensional, that is, the final evaluation model can provide relatively accurate evaluation results for the multimedia information generated by the target generation model under multiple evaluation dimensions, which fully guarantees the reliability of the evaluation of the model-generated information.

[0079] In some implementations, the network training module 708 is specifically used to: for each evaluation dimension, based on the evaluation result labels corresponding to the multiple multimedia samples under the evaluation dimension and the network evaluation results, train the evaluation network corresponding to the evaluation dimension.

[0080] In some embodiments, the evaluation result labels corresponding to the multiple multimedia samples under each evaluation dimension are used to indicate the first sample and the second sample corresponding to the multiple multimedia samples under the evaluation dimension; wherein the first sample corresponding to each of the evaluation dimensions is the target multimedia sample represented as the best by the evaluation result label information under the evaluation dimension among the multiple multimedia samples; and the second sample corresponding to each of the evaluation dimensions is the multimedia sample represented as the worst by the evaluation result label information under the evaluation dimension among the multiple multimedia samples.

[0081] In some implementations, the network evaluation results corresponding to the multiple multimedia samples under each evaluation dimension are used to indicate the network evaluation score corresponding to each of the target multimedia samples under the evaluation dimension.

[0082] In some embodiments, the device also includes a setting module, which is used to set the label evaluation score of the first sample corresponding to the evaluation dimension to a preset maximum value, and set the label evaluation score of the second sample corresponding to the evaluation dimension to a preset minimum value for each evaluation dimension; wherein the network evaluation score is not higher than the preset maximum value, and the network evaluation score is not lower than the preset minimum value; on this basis, the network training module 708 is specifically used to: train the evaluation network corresponding to the evaluation dimension based on the difference between the label evaluation score of the first sample corresponding to the evaluation dimension and the network evaluation score of the first sample corresponding to the evaluation dimension, and based on the difference between the label evaluation score of the second sample corresponding to the evaluation dimension and the network evaluation score of the second sample corresponding to the evaluation dimension.

[0083] In some embodiments, the information processing network includes a feature coding layer and a feature fusion layer; the fusion module 704 is specifically used to: obtain the first feature of the prompt information sample and the second feature of the target multimedia information in the multiple multimedia samples corresponding to the prompt information sample under each of the evaluation dimensions through the feature coding layer; and fuse the first feature with each of the second features through the feature fusion layer.

[0084] In some embodiments, the presentation form of the prompt information sample is different from the presentation form of the multimedia information, and the feature encoding layer includes a first encoder and a second encoder; wherein the first encoder is used to obtain the first feature, and the second encoder is used to obtain the second feature.

[0085] In some implementations, the target form includes a text form, an image form, an audio form, or a video form.

[0086] The evaluation model construction device provided in the embodiments of the present disclosure can execute the evaluation model construction method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0087] Corresponding to the aforementioned method for evaluating model output information, the present disclosure provides a device for evaluating model output information. Figure 8 This is a schematic diagram of a structure of a device for evaluating model output information provided by an embodiment of the present disclosure. The device can be implemented by software and / or hardware and can generally be integrated in an electronic device, such as Figure 8 As shown, the evaluation device of the model output information includes:

[0088] A generated information acquisition module 802 is used to acquire target multimedia information generated by a target generation model for target prompt information;

[0089] The multi-dimensional evaluation module 804 is used to generate network evaluation results corresponding to the target multimedia information under multiple preset evaluation dimensions based on the target prompt information using a pre-built evaluation model; wherein the evaluation model is constructed using an evaluation model construction method.

[0090] In the above device, the evaluation model can provide evaluation results close to human feedback for the target multimedia information generated by the target generation model under multiple evaluation dimensions, fully ensuring the reliability of the evaluation of the model-generated information.

[0091] In some embodiments, the multi-dimensional evaluation module 804 is specifically used to: fuse the target prompt information with the target multimedia information through an information processing network in a pre-constructed evaluation model to obtain target fusion information; based on the target fusion information, generate network evaluation results corresponding to the target multimedia information under multiple preset evaluation dimensions through multiple evaluation networks in the evaluation model.

[0092] In some embodiments, the device also includes a comprehensive evaluation module for obtaining the weight corresponding to each of the evaluation dimensions; based on the weight corresponding to each of the evaluation dimensions and the network evaluation results corresponding to the target multimedia information under each of the evaluation dimensions, a comprehensive evaluation result corresponding to the target multimedia information is generated.

[0093] The evaluation device for model output information provided in the embodiments of the present disclosure can execute the evaluation method for model output information provided in any embodiment of the present disclosure, and has functional modules and beneficial effects corresponding to the execution method.

[0094] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the above-described device embodiment can refer to the corresponding process in the method embodiment, and will not be repeated here.

[0095] An embodiment of the present disclosure provides an electronic device, which includes: a storage device on which a computer program is stored; and a processing device for executing the computer program in the storage device to implement the steps of any method in the present disclosure.

[0096] Reference below Fig. 9 , which shows a schematic diagram of the structure of an electronic device 900 suitable for implementing the embodiment of the present disclosure. The terminal device in the embodiment of the present disclosure may include but is not limited to mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle terminals (such as vehicle navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig. 9 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0097] like Fig. 9As shown, the electronic device 900 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 901, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 902 or a program loaded from a storage device 908 into a random access memory (RAM) 903. In the RAM 903, various programs and data required for the operation of the electronic device 900 are also stored. The processing device 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0098] Typically, the following devices may be connected to the I / O interface 905: an input device 906 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 907 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 908 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 909. The communication device 909 may allow the electronic device 900 to communicate with other devices wirelessly or by wire to exchange data. Although Fig. 9 The electronic device 900 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead.

[0099] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device 909, or installed from a storage device 908, or installed from a ROM 902. When the computer program is executed by the processing device 901, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0100] In addition to the above-mentioned methods and devices, the embodiments of the present disclosure may also be a computer program product, which includes computer program instructions, which, when executed by a processor, cause the processor to perform the image processing method provided by the embodiments of the present disclosure. The computer program product may be written in any combination of one or more programming languages ​​to write program codes for performing the operations of the embodiments of the present disclosure, the programming languages ​​including object-oriented programming languages ​​such as Java, C++, etc., and also conventional procedural programming languages ​​such as "C" language or similar programming languages. The program code may be executed entirely on a user computing device, partially on a user device, as an independent software package, partially on a user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0101] In addition, the embodiments of the present disclosure may also be a computer-readable storage medium on which computer program instructions are stored. When the computer program instructions are executed by a processor, the processor executes the method provided by the embodiments of the present disclosure.

[0102] The computer readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can include, for example, but is not limited to, a system, device or device of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0103] The embodiments of the present disclosure also provide a computer program product, including a computer program / instruction, which implements the method in the embodiments of the present disclosure when executed by a processor.

[0104] It is understandable that before using the technical solutions disclosed in the various embodiments of the present disclosure, the types, scope of use, usage scenarios, etc. of the personal information involved in the present disclosure should be informed to the user and the user's authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations.

[0105] For example, in response to receiving an active request from a user, a prompt message is sent to the user to clearly prompt the user that the operation requested to be performed will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, application, server, or storage medium that performs the operation of the technical solution of the present disclosure according to the prompt message.

[0106] As an optional but non-limiting implementation, in response to receiving an active request from the user, the prompt information may be sent to the user in the form of a pop-up window, in which the prompt information may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0107] It is understandable that the above notification and the process of obtaining user authorization are merely illustrative and do not constitute a limitation on the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure.

[0108] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0109] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for constructing an evaluation model, characterized in that: include: Acquire multiple multimedia samples generated by the target generation model for the prompt information sample, and acquire evaluation result labels corresponding to the multiple multimedia samples under multiple preset evaluation dimensions; wherein the multiple multimedia samples are all presented in the form of targets; The prompt information sample is respectively fused with the target multimedia sample in the multiple multimedia samples corresponding to the prompt information sample under each of the evaluation dimensions through a preset information processing network to obtain multiple sample fusion information; Based on the plurality of sample fusion information, generating network evaluation results corresponding to the plurality of multimedia samples under the plurality of evaluation dimensions respectively through the plurality of evaluation networks to be trained; wherein the plurality of evaluation networks correspond one to one to the plurality of evaluation dimensions; Based on the evaluation result labels and network evaluation results respectively corresponding to the multiple multimedia samples under the multiple evaluation dimensions, the multiple evaluation networks are trained; An evaluation model is constructed based on the information processing network and the multiple evaluation networks after training.

2. The method according to claim 1, characterized in that The training of the multiple evaluation networks based on the evaluation result labels and network evaluation results respectively corresponding to the multiple multimedia samples under the multiple evaluation dimensions includes: For each evaluation dimension, based on the evaluation result labels corresponding to the multiple multimedia samples under the evaluation dimension and the network evaluation results, the evaluation network corresponding to the evaluation dimension is trained.

3. The method according to claim 2, characterized in that The evaluation result labels corresponding to the multiple multimedia samples under each evaluation dimension are used to indicate the first sample and the second sample corresponding to the multiple multimedia samples under the evaluation dimension; Among them, the first sample corresponding to each of the evaluation dimensions is the target multimedia sample whose evaluation result label information under the evaluation dimension is represented as the best among the multiple multimedia samples; the second sample corresponding to each of the evaluation dimensions is the target multimedia sample whose evaluation result label information under the evaluation dimension is represented as the worst among the multiple multimedia samples.

4. The method according to claim 3, characterized in that The network evaluation results corresponding to the multiple multimedia samples under each evaluation dimension are used to indicate the network evaluation score corresponding to each of the target multimedia samples under the evaluation dimension.

5. The method according to claim 4, characterized in that The method further comprises: For each of the evaluation dimensions, the label evaluation score of the first sample corresponding to the evaluation dimension is set to a preset maximum value, and the label evaluation score of the second sample corresponding to the evaluation dimension is set to a preset minimum value; wherein the network evaluation score is not higher than the preset maximum value, and the network evaluation score is not lower than the preset minimum value; The training of the evaluation network corresponding to the evaluation dimension based on the evaluation result labels corresponding to the plurality of multimedia samples under the evaluation dimension and the network evaluation results includes: Based on the difference between the label evaluation score of the first sample corresponding to the evaluation dimension and the network evaluation score of the first sample corresponding to the evaluation dimension, and based on the difference between the label evaluation score of the second sample corresponding to the evaluation dimension and the network evaluation score of the second sample corresponding to the evaluation dimension, the evaluation network corresponding to the evaluation dimension is trained.

6. The method according to claim 1, characterized in that The information processing network includes a feature encoding layer and a feature fusion layer; the preset information processing network is used to fuse the prompt information sample with the target multimedia sample in the multiple multimedia samples corresponding to the prompt information sample under each evaluation dimension, including: Obtaining, through the feature coding layer, respectively the first feature of the prompt information sample and the second feature of the target multimedia sample among the multiple multimedia samples corresponding to the prompt information sample under each of the evaluation dimensions; The first feature is fused with each of the second features respectively through the feature fusion layer.

7. The method according to claim 6, characterized in that The presentation form of the prompt information sample is different from that of the multimedia sample, and the feature coding layer includes a first encoder and a second encoder; wherein the first encoder is used to obtain the first feature, and the second encoder is used to obtain the second feature.

8. The method according to claim 1, characterized in that The target form includes a text form, an image form, an audio form or a video form.

9. A method for evaluating model generation information, characterized in that: include: Obtain target multimedia information generated by the target generation model according to the target prompt information; Based on the target prompt information, a pre-constructed evaluation model is used to generate network evaluation results corresponding to the target multimedia information under multiple preset evaluation dimensions; wherein the evaluation model is constructed using the evaluation model construction method described in any one of claims 1 to 8.

10. The method according to claim 9, characterized in that The method of using a pre-built evaluation model based on the target prompt information to generate network evaluation results corresponding to the target multimedia information under multiple preset evaluation dimensions includes: The target prompt information is fused with the target multimedia information through an information processing network in a pre-constructed evaluation model to obtain target fusion information; Based on the target fusion information, network evaluation results corresponding to the target multimedia information under multiple preset evaluation dimensions are generated through multiple evaluation networks in the evaluation model.

11. The method according to claim 9, characterized in that The method further comprises: Obtaining the weight corresponding to each evaluation dimension; Based on the weight corresponding to each of the evaluation dimensions and the network evaluation result corresponding to the target multimedia information under each of the evaluation dimensions, a comprehensive evaluation result corresponding to the target multimedia information is generated.

12. A device for constructing an evaluation model, characterized in that: include: A sample acquisition module, used to acquire multiple multimedia samples generated by the target generation model for the prompt information sample, and to acquire evaluation result labels corresponding to the multiple multimedia samples under multiple preset evaluation dimensions; wherein the multiple multimedia samples are all presented in the form of targets; a fusion module, configured to fuse the prompt information sample with a target multimedia sample in the multiple multimedia samples corresponding to the prompt information sample under each of the evaluation dimensions through a preset information processing network to obtain multiple sample fusion information; A network evaluation module, configured to generate network evaluation results corresponding to the plurality of multimedia samples under the plurality of evaluation dimensions respectively through the plurality of evaluation networks to be trained based on the plurality of sample fusion information; wherein the plurality of evaluation networks correspond to the plurality of evaluation dimensions one by one; A network training module, configured to train the multiple evaluation networks based on the evaluation result labels and network evaluation results respectively corresponding to the multiple multimedia samples under the multiple evaluation dimensions; The model building module is used to build an evaluation model based on the information processing network and the multiple evaluation networks after training.

13. A device for evaluating model output information, characterized in that: include: A generated information acquisition module is used to acquire target multimedia information generated by a target generation model for target prompt information; A multi-dimensional evaluation module is used to generate network evaluation results corresponding to the target multimedia information under multiple preset evaluation dimensions based on the target prompt information using a pre-constructed evaluation model; wherein the evaluation model is constructed using the evaluation model construction method described in any one of claims 1 to 8.

14. An electronic device, characterized in that: The electronic device comprises: a storage device having a computer program stored thereon; A processing device is used to execute the computer program in the storage device to implement the method for constructing an evaluation model as described in any one of claims 1 to 8 or the method for evaluating model output information as described in any one of claims 9 to 11.

15. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and the computer program is used to execute the method for constructing an evaluation model according to any one of claims 1 to 8 or the method for evaluating model output information according to any one of claims 9 to 11.

Images