Answer matching method and system of artificial intelligence large model

By extracting the characteristics and difficulty evaluation of user problems, intelligently matching and switching artificial intelligence models, the answers to inexplicably professional and accurate questions in the existing technology are solved, and the quality of answers and user experience are improved.

CN119311843AActive Publication Date: 2025-01-14BEIJING YIZHUANG TECHNOLOGY INNOVATION CO LTD

Patent Information

Application Number
CN202411834720.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-13
Publication Date
2025-01-14
Estimated Expiration
2044-12-13

AI Technical Summary

Technical Problem

There are differences in the continuous dialogue processing capabilities and the quality of question answering, making it difficult to accurately measure the matching degree, and lack of switching strategies, resulting in the inadequate professional and accurate answers.

Method used

By obtaining user question text, performing natural language processing to extract features, building problem feature sets, and using difficulty evaluation models and big model matching formulas, intelligently match and switch artificial intelligence big models to achieve optimal answers.

Benefits of technology

It improves the professionalism and accuracy of question answering, solves the problems of insufficient continuous question processing capabilities of a single large model and no switching strategy for large models, and enhances the comprehensiveness and user experience of the answers.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119311843A_ABST
    Figure CN119311843A_ABST
Patent Text Reader

Abstract

The invention relates to the field of artificial intelligence, in particular to an answer matching method and system for an artificial intelligence large model, and the method comprises the steps: obtaining a question text of the nth question asked by a user, carrying out the feature extraction of the question text through a natural language processing technology, and constructing a question feature set; inputting the question feature set into a difficulty evaluation model, and outputting a difficulty score of the question text; based on the difficulty score of the question text, performing matching degree calculation on all the artificial intelligence large models in the large model library by adopting a large model matching degree formula to obtain the matching degree of each artificial intelligence large model; and analyzing the matching degree of each artificial intelligence large model according to a preset large model matching strategy to obtain a selection scheme. By adopting the method, the matching degree between the question and various large models can be accurately and quantitatively measured, so that the professionalism and accuracy of question answering are improved; and meanwhile, the continuous dialogue processing capability of the large model can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of artificial intelligence, and in particular to a solution matching method and system for a large artificial intelligence model. Background Art

[0002] At present, AI big models (hereinafter referred to as big models) such as open source free big models, GPT, Wenxin Yiyan, iFlytek Spark, etc. have shown great potential in technical knowledge answers, innovation hot spot direction guidance, industrial policy analysis, etc. However, different big models have different capabilities for continuous dialogue processing and the quality of answering questions. The reasons for the differences among AI big models are, on the one hand, different training data, on the other hand, different optimization methods, and possibly the difference between general big models and professional technical big models.

[0003] Therefore, matching the best big model to answer the questions asked by users is of great significance to improving the quality of answering questions. In addition, when matching big models to user questions, it is also necessary to consider the problem that some open source big models are free while some big models need to be charged according to tokens. Appropriately matching open source free big models and paid big models to answer user questions can help reduce economic costs.

[0004] However, the existing large models generally have problems such as difficulty in accurately and quantitatively measuring the matching degree between problems and various large models, insufficient processing capability of a single large model for continuous questioning, and lack of switching strategies for large models.

[0005] To this end, the present invention provides a solution matching method and system for an artificial intelligence large model. Summary of the invention

[0006] Based on this, it is necessary to provide an artificial intelligence large model solution matching method and system to address the above technical issues.

[0007] According to a first aspect of the present invention, a method for matching answers to artificial intelligence big models is provided, comprising: S1, obtaining a question text asked by a user for the nth time, performing feature extraction processing on the question text using natural language processing technology, and constructing a question feature set, where n is an integer greater than 0; S2, inputting the question feature set into a difficulty assessment model, and outputting a difficulty score of the question text, wherein the difficulty assessment model is generated after training based on a quantified historical question feature set; S3, based on the difficulty score of the question text, calculating the matching degree of all artificial intelligence big models in a big model library using a big model matching degree formula, and obtaining the matching degree of each artificial intelligence big model; S4, analyzing the matching degree of each artificial intelligence big model according to a preset big model matching strategy, and obtaining a selection scheme, wherein the selection scheme is to select a single artificial intelligence big model or select multiple artificial intelligence big models; wherein, when a single artificial intelligence big model is selected, the selected single artificial intelligence big model is used as the optimal matching result of the answer; when multiple artificial intelligence big models are selected, the selected multiple artificial intelligence big models are used as the optimal matching result of the answer.

[0008] In some optional implementations of some embodiments, the step S1 specifically includes: S101, obtaining the question text asked by the user, performing word segmentation processing on the question text based on the word segmentation model and performing part-of-speech tagging on each of the question participles, to obtain multiple question participles and part-of-speech tagging information corresponding to the question participles; S102, performing entity recognition on the question participles using a neural network model according to the part-of-speech tagging information corresponding to the question participles, and determining the entity of at least one key technology; S103, performing semantic analysis processing on the entity of at least one key technology based on the semantic analysis model, and determining the technical field information to which the entity of the key technology belongs; S104, constructing a question feature set based on the key technology entity and the technical field information to which it belongs.

[0009] In some optional implementations of some embodiments, the step S1 also includes: S105, quantifying the entities of the key technologies contained in the problem feature set and the corresponding technical field information to obtain technical depth information and technical concept breadth information, wherein the technical depth information is determined by the hierarchical relationship of the entities of multiple key technologies, and the technical concept breadth is determined by counting the number of corresponding technical field information.

[0010] In some optional implementations of some embodiments, in step S3, the calculation formula of the large model matching algorithm is as follows: ; Where: represents the matching degree of the jth artificial intelligence large model in the large model library, D represents the difficulty score of the first question text, represents the difficulty processing capability score of the jth artificial intelligence large model in the large model library, and is the known difficulty processing ability scoring data, and | | represents the absolute value.

[0011] In some optional implementations of some embodiments, the preset big model matching strategy in step S4 includes: selecting a single artificial intelligence big model with the best matching degree; and selecting multiple artificial intelligence big models with the same or similar matching degrees ranked in front, and the similar matching degree means that the difference in matching degrees is less than or equal to a preset interval; the step S4 specifically includes: sorting the matching degrees of the artificial intelligence big models from high to low; if the matching degree of the first-ranked artificial intelligence big model is significantly greater than that of the second-ranked artificial intelligence big model, the first-ranked artificial intelligence big model is used as the selection scheme, wherein the matching degree is significantly greater than that means that the difference in matching degrees is greater than the preset interval; if the matching degrees of the multiple artificial intelligence big models ranked in front are the same or similar, the multiple artificial intelligence big models ranked in front are used as the selection scheme.

[0012] In some optional implementations of some embodiments, the method also includes: when the single artificial intelligence big model is the optimal matching result for answering the question text, the answer of the single artificial intelligence big model to the question text is used as the answer result of the question text; when the multiple artificial intelligence big models are the optimal matching results for answering the question text, the pre-answer result of each artificial intelligence big model in the multiple artificial intelligence big models is obtained, and the answer fusion mechanism is used to fuse all the pre-answer results to obtain the answer result of the question text.

[0013] In some optional implementations of some embodiments, the answer fusion mechanism includes the following steps: obtaining the preliminary answer results of each artificial intelligence large model, and preprocessing the preliminary answer results to obtain feature information of the preliminary answer results; extracting key information from the feature information of the preliminary answer results; analyzing the commonalities and differences of the key information, and generating the answer results of the question text using natural language processing technology.

[0014] In some optional implementations of some embodiments, the method also includes: obtaining the question text asked by the user for the n+1th time in real time; judging whether there is a correlation between the question text asked for the n+1th time and the question text asked for the nth time based on the keyword library judgment strategy; if there is a correlation, taking the selection plan in the question text asked for the nth time as the optimal matching result of the answer; if there is no correlation, dynamically adjusting the selection plan according to the difficulty score of the question text asked for the n+1th time, wherein the dynamic adjustment of the selection plan is reflected in the dynamic switching of a single artificial intelligence large model, the increase or decrease in the number of multiple artificial intelligence large models, and the replacement between a single artificial intelligence large model and multiple artificial intelligence large models.

[0015] In some optional implementations of some embodiments, before executing the dynamic adjustment selection plan and outputting the solution result, the method also includes: obtaining the artificial intelligence big model selected in the dynamic adjustment selection plan, and taking the previous n-th question text as an input item, and the output item is the background content of the n+1-th question text; taking the background content as an intervention item of the solution result, and using the selected artificial intelligence big model to answer the n+1-th question text to obtain the solution result.

[0016] In some optional implementations of some embodiments, the method further includes: automatically matching human characters for interaction according to the optimal matching result.

[0017] According to a second aspect of the present invention, there is provided an artificial intelligence big model question-answer matching system, which is applied to the answer matching method of the artificial intelligence big model, and includes: a question processing module, which is used to obtain the question text asked by the user for the nth time, use natural language processing technology to perform feature extraction processing on the question text, and construct a question feature set, where n is an integer greater than 0; a question difficulty score calculation module, which is used to input the question feature set into a difficulty assessment model, and output the difficulty score of the question text, wherein the difficulty assessment model is generated after training based on the quantified historical question feature set; a model matching degree calculation module, which is used to calculate the matching degree of all artificial intelligence big models in the big model library based on the difficulty score of the question text using a big model matching degree formula, and obtain the matching degree of each artificial intelligence big model; a matching result output module, which is used to analyze the matching degree of each artificial intelligence big model according to a preset big model matching strategy, and obtain a selection scheme, wherein the selection scheme is to select a single artificial intelligence big model or select multiple artificial intelligence big models, wherein when a single artificial intelligence big model is selected, the selected single artificial intelligence big model is used as the optimal matching result of the answer; when multiple artificial intelligence big models are selected, the selected multiple artificial intelligence big models are used as the optimal matching results of the answer.

[0018] The advantages and beneficial effects of the present invention are as follows: the answer matching method and system of the artificial intelligence big model provided by the present invention can perform feature extraction processing on the question text asked by the user for the nth time, extract the entity of the key technology and the information of the technical field to which it belongs, and then construct a question feature set, and use the difficulty assessment model to evaluate and analyze the question feature set to obtain the difficulty score of the corresponding question text, and by calculating the matching degree of the artificial intelligence big model, it is convenient to compare the difficulty processing capability of the question text asked for the nth time with the difficulty processing capability of each artificial intelligence big model in the big model library, and at the same time, by adopting the big model matching strategy, a single artificial intelligence big model or multiple artificial intelligence big models are selected in a targeted and intelligent manner as the optimal matching result of the question text for answering, thereby improving the professionalism and accuracy of answering questions; in addition, by obtaining the question text asked by the user for the n+1th time in real time, according to whether there is a correlation between the question text asked for the n+1th time and the question text asked for the nth time and the difficulty score of the question text asked for the n+1th time, the artificial intelligence big model involved in the answer can be adjusted in a targeted and dynamic manner, so as to solve the problem that the single big model in the prior art has insufficient processing capability for continuous questions and the big model has no switching strategy. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 This is an exemplary data sending and receiving scenario diagram to which the present application can be applied.

[0020] Figure 2 It is a flowchart of an embodiment of the solution matching method of the artificial intelligence big model according to the present application.

[0021] Figure 3 It is a flowchart of another embodiment of the solution matching method of the artificial intelligence big model according to the present application.

[0022] Figure 4 It is a flowchart of another embodiment of the solution matching method of the artificial intelligence big model according to the present application.

[0023] Figure 5 It is a structural diagram of an embodiment of a solution matching system of an artificial intelligence large model according to the present application. DETAILED DESCRIPTION

[0024] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below through specific implementation methods in conjunction with the accompanying drawings. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0025] Although the big model has shown great potential in answering technical knowledge, guiding innovation hot spots, and analyzing industrial policies, different data training or differences in post-optimization methods will affect the big model's ability to handle continuous dialogue and the quality of answering questions. Therefore, matching the best big model to obtain high-quality answers based on the content of the user's questions is of great significance to the user's experience. At present, when users use big models to ask questions, they usually answer them for a single model. Therefore, there are generally problems such as the poor match between the content of the question and the content of the big model's answer and insufficient ability to handle continuous questions. Although some big model platforms support multiple artificial intelligence big models to answer together, they also determine the artificial intelligence big model that answers based on the user's subjective choice or a fixed order.

[0026] Based on the above problems, this application proposes an answer matching method of an artificial intelligence big model. This method can intelligently select the most matching big model according to the relevant features of the question content, and identify the subtle differences in the relevant features of each question content in continuous questioning. By dynamically switching between multiple big models, the big model used to answer the question each time is the most preferred big model, thereby improving the accuracy of the answer and enhancing the user experience.

[0027] Figure 1 The diagram schematically shows a data transmission and reception scenario diagram between a terminal device and a server when a user uses a large model on a terminal device according to an embodiment of the present disclosure.

[0028] like Figure 1 As shown, the network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc.

[0029] Users can use terminal devices 101, 102, 103 to interact with server 105 through network 104 to receive or send messages, etc. Terminal devices 101, 102, 103 can be installed with various communication client applications, such as web browser applications, search applications, etc. (only examples).

[0030] The terminal devices 101, 102, 103 may be various electronic devices with display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, and desktop computers. The server 105 may be a server that provides various services, such as a background management server (only as an example) that provides support for the large model website browsed by the user using the terminal devices 101, 102, 103. The background management server may analyze and process the received data such as the user's question request, and feed back the processing results (such as obtaining the most matching large model according to the user's question, or generating relevant information or data of the user's first question or subsequent questions, etc.) to the terminal devices 101, 102, 103.

[0031] It should be noted that the solution matching method of the artificial intelligence large model provided in the embodiment of the present disclosure can generally be executed by the server 105. Accordingly, the solution matching system of the artificial intelligence large model provided in the embodiment of the present disclosure can generally be set in the server 105. The solution matching method of the artificial intelligence large model provided in the embodiment of the present disclosure can also be performed by a server or server cluster that is different from the server 105 and can communicate with the terminal devices 101, 102, 103 and / or the server 105. Correspondingly, the solution matching system of the artificial intelligence large model provided in the embodiment of the present disclosure can also be set in a server or server cluster that is different from the server 105 and can communicate with the terminal devices 101, 102, 103 and / or the server 105.

[0032] It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0033] The following will be based on Figure 1 The scene described by Figure 2 The solution matching method of the artificial intelligence big model of the disclosed embodiment is described in detail.

[0034] like Figure 2 As shown, a flow chart of an embodiment of the method for matching the solution of the artificial intelligence big model according to the present application is shown. The method for matching the solution of the artificial intelligence big model includes the following steps.

[0035] S1. Obtain the question text asked by the user for the nth time, use natural language processing technology to extract features from the question text, and construct a question feature set, where n is an integer greater than 0.

[0036] In this step, in response to the user's question, the question text of the user's question is obtained after the user inputs the question. The question can be the nth question input by the user in this round of questioning, or all consecutive questions from the first input to the nth input in this round of questioning. Feature extraction processing is performed on the question text to construct the question feature set.

[0037] It should be noted that the present application does not limit the input method, which may be voice input, mechanical keyboard input, action input, etc. For non-text direct input methods, further recognition needs to be added. For example, when the user uses voice input, after obtaining the user's voice, the voice question is directly translated into text form through voice recognition technology, and the text is used as the question text for the next step of feature extraction; for another example, when the user uses action input, after obtaining the user's action, the user's action is recognized by the action recognition model, and then translated into text form, and the text is used as the question text for the next step of feature extraction. It can be understood that users can input questions through a variety of input methods, which can not only provide convenience for users, but also expand the group of people who use this method, for example, people with disabilities can also use it.

[0038] S2. Input the question feature set into a difficulty assessment model and output a difficulty score of the question text, wherein the difficulty assessment model is generated after training based on the quantized historical question feature set.

[0039] The difficulty assessment model is trained using the quantified historical question feature set, and the difficulty score of the corresponding question text is output. The difficulty score can be used as a reference for matching the big model, and a better big model is matched based on the difficulty score to answer the question.

[0040] S3. Based on the difficulty score of the question text, the big model matching formula is used to calculate the matching degree of all artificial intelligence big models in the big model library to obtain the matching degree of each artificial intelligence big model.

[0041] According to one embodiment of the present application, the artificial intelligence large model matching formula is as follows: ; Where: represents the matching degree of the jth artificial intelligence large model in the large model library, D represents the difficulty score of the question text, represents the difficulty processing capability score of the jth artificial intelligence large model in the large model library and is the known difficulty processing ability scoring data, and | | represents the absolute value.

[0042] Substitute the difficulty score in the second step into the above formula to obtain the matching degree of each artificial intelligence large model in the large model library. According to this formula, it can be concluded that The result must be greater than 0 and less than 1, that is, the matching degree of the artificial intelligence model is between 0 and 1. It can be understood that the closer the matching value is to 1, the closer the difficulty score of the question text is to the difficulty processing capability of the artificial intelligence model.

[0043] According to an embodiment of the present application, the numerical range of the difficulty score of the question text is 0 to 1. The higher the difficulty score, the more complex the question, and the lower the difficulty score, the simpler the question. Correspondingly, the difficulty processing ability score of the artificial intelligence large model is also between 0 and 1. The higher the difficulty processing ability score, the stronger its ability to handle problems.

[0044] S4. Analyze the matching degree of each artificial intelligence big model according to the preset big model matching strategy to obtain a selection scheme, which is to select a single artificial intelligence big model or multiple artificial intelligence big models. According to one embodiment of the present application, when a single artificial intelligence big model is selected, the selected single artificial intelligence big model is used as the optimal matching result of the solution; when multiple artificial intelligence big models are selected, the selected multiple artificial intelligence big models are used as the optimal matching results of the solution.

[0045] That is to say, the AI ​​big model that answers the question asked by the user for the nth time may be one or more, which depends on the preset big model matching strategy and the matching degree of each AI big model. Further, after the selection scheme is obtained, the selected AI big model is used to answer the question asked by the user for the nth time. The preset of the big model matching strategy may include the following contents.

[0046] According to one embodiment of the present application, the large model matching strategy preset in step S4 includes: selecting a single artificial intelligence large model with the best matching degree; and selecting multiple artificial intelligence large models with the same or similar matching degrees that are ranked first, and similar matching degrees means that the difference in matching degrees is less than or equal to a preset interval.

[0047] Therefore, further, step S4 specifically includes: sorting the matching degrees of the artificial intelligence large models from high to low; if the matching degree of the artificial intelligence large model ranked first is significantly greater than that of the artificial intelligence large model ranked second, the artificial intelligence large model ranked first is selected as the selection scheme, wherein the matching degree is significantly greater means that the difference in matching degrees is greater than a preset interval; if the matching degrees of multiple artificial intelligence large models ranked first are the same or similar, the multiple artificial intelligence large models ranked first are selected as the selection scheme.

[0048] According to one embodiment of the present application, for example, the large model library contains three artificial intelligence large models. After the matching degree of each artificial intelligence large model is calculated, the matching degrees obtained are 0.9, 0.85, and 0.98, respectively. The matching degrees of each artificial intelligence large model are sorted from high to low. If the preset interval is 0.05, the difference in matching degree between the first-ranked artificial intelligence large model and the first-ranked artificial intelligence large model is 0.08 (that is, 0.98-0.9=0.08), that is, the difference in matching degree between the two is greater than the preset interval, then only the first-ranked artificial intelligence large model (that is, the matching degree is 0.98) is selected as the selection scheme.

[0049] For another example, suppose the large model library contains three artificial intelligence large models. After calculating the matching degree of each artificial intelligence large model, the matching degrees obtained are 0.96, 0.95, and 0.93, respectively. The matching degrees of each artificial intelligence large model are sorted from high to low. If the preset interval is 0.05, the difference between the first-ranked artificial intelligence large model and the other two artificial intelligence large models is within 0.05 (that is, 0.96-0.95=0.01, 0.96-0.93=0.03), it can be said that the matching degrees of these three artificial intelligence large models are similar, and these three artificial intelligence large models are selected as the selection scheme.

[0050] For another example, suppose that the large model library contains three artificial intelligence large models. After calculating the matching degree of each artificial intelligence large model, the matching degrees obtained are 0.96, 0.95, and 0.8 respectively. The matching degrees of each artificial intelligence large model are sorted from high to low. If the preset interval is 0.05, the difference between the first-ranked artificial intelligence large model and the other two artificial intelligence large models is 0.01 and 0.16 respectively (that is, 0.96-0.95=0.01, 0.96-0.8=0.16), which means that the matching degree of the first-ranked artificial intelligence large model is similar to that of the artificial intelligence large model with a matching degree of 0.95, but the matching degree gap with the artificial intelligence large model with a matching degree of 0.8 is significant. Therefore, the artificial intelligence large model ranked first and with a matching degree of 0.95 is selected as the selection plan.

[0051] According to the artificial intelligence big model matching method of the present application, by extracting problem features and analyzing the difficulty of the problem, and then calculating the matching degree between the problem and the big model, the accuracy and efficiency of the artificial intelligence big model's answer can be improved. At the same time, by selecting solutions, this method also provides multiple artificial intelligence big models to answer problems, which can enhance the comprehensiveness and accuracy of the answers.

[0052] Figure 3 It is a flowchart for constructing a question feature set through question text.

[0053] like Figure 3As shown, in some optional implementations of the present application, in the step S1, the question text asked by the user for the nth time is obtained, natural language processing technology is used to perform feature extraction processing on the question text, and a question feature set is constructed, including steps S101-S104.

[0054] S101, obtaining a question text asked by a user, performing word segmentation processing on the question text based on a word segmentation model and performing part-of-speech tagging on each of the question participles, to obtain a plurality of question participles and part-of-speech tagging information corresponding to the question participles.

[0055] According to one embodiment of the present application, in this step, the word segmentation model that can be used is a word segmentation model based on deep learning, including but not limited to a BERT model or an LSTM model, which performs word segmentation processing on the user's question text and performs part-of-speech tagging on each question segmentation to distinguish parts of speech such as nouns and verbs, thereby laying the foundation for subsequent entity recognition.

[0056] S102: Perform entity recognition on the question segmentation using a neural network model according to part-of-speech tagging information corresponding to the question segmentation, and determine an entity of at least one key technology.

[0057] According to one embodiment of the present application, in this step, entity recognition is performed on question segmentations based on the question segmentations and the corresponding part-of-speech tagging information by utilizing a neural network model, so as to identify key technical entity recognition contained in the question text, for example, the key technical entity is an algorithm name, equipment model, etc.

[0058] The above neural network model uses a bidirectional long short-term memory conditional random field model (BiLSTM-CRF). The BiLSTM-CRF model is pre-trained with a training set that has labeled input word segments and their context features. Entity features are extracted for each question word, which include the word itself, context words, part-of-speech tags, position features, etc. The i-th question word of the input is represented as , whose eigenvector is expressed as ; The feature vector is composed of the word vector of the word segmentation itself, the word vector of the context word, the part-of-speech vector, and the position feature sub-feature vector; the vector of the entity feature of the question word segmentation Input BiLSTM layer to form question segmentation Contextual representation of In the BiLSTM layer, the context representation of each time step is obtained by concatenating the outputs of the forward and backward LSTMs: this context representation is provided to the CRF layer; the CRF layer receives the output from the BiLSTM and considers the label sequence Under the constraint of , the Viterbi algorithm is used to decode and find the most likely label sequence as output. This label sequence is the labeling result of the question segmentation. The probability of the label sequence is expressed as:

[0059] ;in, is the characteristic function, is the set of all possible label sequences; the most likely label sequence is expressed as: The constraints of the label sequence can be implemented by using a BIO annotation protocol, where B represents the beginning of a technical term, I represents internal, and O represents a non-technical term. According to the annotation results, words marked with B (beginning) are extracted, and words marked with I (internal) that are continuous with them are collected to form a complete key technical term.

[0060] S103, performing semantic analysis on the entity of the at least one key technology based on the semantic analysis model to determine the technical field information to which the entity of the key technology belongs. According to one embodiment of the present application, in this step, the identified key technology noun is matched with a predefined technical field dictionary to identify the technical field information to which the question text belongs.

[0061] S104. Construct a problem feature set based on the entities of key technologies and the information of the technical fields to which they belong.

[0062] According to one embodiment of the present application, it is assumed that the question raised by the user is: "How to implement a deep learning-based image recognition system to detect multi-category targets in real time?" The operating system of the present method receives the user's question, first splits the question into multiple question participles, and performs part-of-speech tagging on each question participle, that is, splits the above question into: "how", "implementation", "based on", "deep learning", "image recognition system", "to", "multi-category targets", "of", "real-time", "detection" and other question participles, and performs part-of-speech tagging on each question participle, that is, marking "how" as a pronoun, marking "implementation" as a verb, marking "based on" as a preposition, and marking "deep learning" as a verb. " is marked as an adjective, "image recognition system" is marked as a noun, "to" is marked as a preposition, "multi-category target" is marked as a noun, "of" is marked as a particle, "real-time" is marked as an adverb, and "detection" is marked as a verb. Secondly, nouns and adjectives before nouns are identified, and key technical entity recognition results such as "deep learning", "image recognition system" and "multi-category target" are identified. The key technical entity recognition results are analyzed again to determine the technical field involved in the problem. According to the above key technical entity recognition results, the above key technical nouns are matched with the predefined technical field dictionary, and the technical field to which the problem belongs is determined to be the field of computer vision technology.

[0063] Through the above steps, we can accurately understand the user's problem and evaluate the technical field to which the problem belongs, so as to provide a basis for subsequent evaluation of the problem difficulty and selection of an appropriate large model.

[0064] Furthermore, step S1 may also include step S105, quantifying the entities of the key technologies contained in the problem feature set and the information of the technical fields to which they belong, to obtain technical depth information and technical concept breadth information. According to an embodiment of the present application, the technical depth information is determined by the hierarchical relationship of the entities of multiple key technologies, and the technical concept breadth is determined by counting the number of pieces of information of the technical fields to which they belong.

[0065] That is to say, the extracted entities of key technologies and the information of the technical fields to which they belong are quantified. The results of quantification can be reflected in two aspects: technical depth and conceptual breadth. The technical depth can be assessed by the hierarchical relationship of the entities of multiple key technologies, and the conceptual breadth can be measured by counting the number of information in the technical fields to which they belong, thereby obtaining technical depth information and technical concept breadth information respectively.

[0066] Specifically, the prompt word engineering can be used to obtain quantitative technology depth information and technology concept breadth information by using a large model for quantitative evaluation of problem feature sets and using the entities of key technologies and the corresponding technical field information contained in the problem feature sets.

[0067] Further, step S2 includes steps S201-S202.

[0068] S201, inputting the problem feature set containing the quantitative technical depth information and technical concept breadth information into the difficulty assessment model. The difficulty assessment model is a large model that is pre-trained and fine-tuned using the quantified historical problem feature set.

[0069] S202, using the prompt word engineering, so that the difficulty assessment model outputs the difficulty score of the question text according to the quantitative technical depth information and technical concept breadth information in the input question feature set; wherein the prompt words contained in the prompt word engineering define the value range of the difficulty score of the output question text, and define the rules for determining the difficulty score according to the quantitative technical depth information and technical concept breadth information.

[0070] Figure 4 is a flow chart of another embodiment of the solution matching method of the artificial intelligence large model according to the present application; Figure 4 As shown, in some optional implementations of the embodiments of the present application, after step S4, the following steps may also be performed.

[0071] S6. When a single artificial intelligence big model is the optimal matching result for answering the question text, the answer of the single artificial intelligence big model to the question text is used as the answer result of the question text; when multiple artificial intelligence big models are the optimal matching results for answering the question text, the pre-answer results of each artificial intelligence big model in the multiple artificial intelligence big models are obtained, and the answer fusion mechanism is used to fuse all the pre-answer results to obtain the answer result of the question text.

[0072] For example, if the artificial intelligence big model with a matching degree of 0.98 is selected as the selection scheme, the artificial intelligence big model is used to answer the question text to obtain the answer to the question text; for another example, if three artificial intelligence big models with matching degrees of 0.96, 0.95, and 0.93 are selected as the selection schemes, the three artificial intelligence big models are used to answer the question text respectively to obtain three preliminary answer results, and based on the answer fusion mechanism, the three preliminary answer results are fused to finally obtain the answer to the question text.

[0073] For the case where multiple large models are selected, the present application designs a solution fusion mechanism. According to an embodiment of the present application, the solution fusion mechanism in step S6 may include the following steps.

[0074] The pre-answer results of each artificial intelligence large model are obtained, and the pre-answer results are pre-processed to obtain feature information of the pre-answer results; key information in the feature information of the pre-answer results is extracted; the key information is analyzed for commonalities and differences, and the answer result of the question text is generated using natural language processing technology.

[0075] It is understandable that after extracting and comparing key information, the common points of the artificial intelligence models that answer the questions can be used as the core content of the answer, and the differences can be further evaluated. The reliability and innovation of the differences can be evaluated by algorithms, and the differences with better evaluations can be integrated into the core content using natural language processing technology to obtain a complete answer, that is, the answer to the question text. It should be noted that for the evaluation of the differences, when the evaluation results are all good, the answer results can be supplemented by the "or" method; and when the evaluation results are far apart, the answer results are supplemented by the better evaluation results.

[0076] For example, take the user question "How to optimize the convergence speed of the deep learning network?" as an example. The two artificial intelligence large models with matching degrees of 0.96 and 0.95 selected in step S4 are selected as the selection scheme, and then step S6 is executed. After obtaining the preliminary answer results of the two artificial intelligence models, the two preliminary answer results are preprocessed to obtain the characteristic information of the preliminary answer results. The characteristic information includes "by adjusting the learning rate and using a more efficient optimization algorithm and introducing a regularization term, to obtain...", "by adjusting the learning rate, using a more efficient optimization algorithm and batch normalization, to obtain..." and extracting information from the characteristic information to obtain key information associated with the question text. The key information includes "introducing a regularization term", "using batch normalization", "adjusting the learning rate", and "using a more efficient optimization algorithm". By analyzing the commonalities and differences of the key information, it is found that the two artificial intelligence models mentioned "adjusting the learning rate" and "using a more efficient optimization algorithm". Therefore, these two key information are taken as commonalities. As for the differences, one of the artificial intelligence models mentioned "introducing a regularization term" and the other mentioned "using batch normalization". After analyzing and evaluating the differences, it is found that both differences are reliable and innovative. Therefore, after combining with natural language processing technology, a supplementary result of "or" is generated. The final answer to the generated question text at least includes the following content: "In order to optimize the convergence speed of the deep learning network, it is recommended to adjust the learning rate, use a more efficient optimization algorithm, and consider introducing regularization terms or using batch normalization."

[0077] According to an embodiment of the present application, the matching solution of the present application is not only applicable to the matching process of one question, but also applicable to the matching in multiple rounds of questions, that is, the scenario of continuous questioning.

[0078] In view of the possible changes in the difficulty of questions in the continuous questioning embodiment, the present application also provides a dynamic switching mechanism, which dynamically adjusts the large model involved in answering based on the difficulty of the continuous questions monitored in real time, and can be specifically achieved in the following way.

[0079] S7. Obtain the question text asked by the user for the n+1th time in real time; based on the keyword library judgment strategy, determine whether there is any correlation between the question text asked for the n+1th time and the question text asked for the nth time; if there is any correlation, use the selection plan in the question text asked for the nth time as the optimal matching result of the answer; if there is no correlation, dynamically adjust the selection plan according to the difficulty score of the question text asked for the n+1th time.

[0080] It can be understood that n+1 represents the next question based on n, that is, when n is 1, that is, the user's question is the first question. After steps S1-S6 complete the answer to the first question, if it is detected that the user continues to ask the second question, step S7 can be further executed. There may be a difference in difficulty between the first question and the second question, so it is necessary to adjust the artificial intelligence model for answering the question, and use the adjusted artificial intelligence model to answer the user's second question. Furthermore, after detecting that the user asks the third question, step S7 is continued, that is, the difficulty of each question is obtained in real time in the continuous question-answering session, and the artificial intelligence model involved in the answer is automatically and dynamically adjusted based on the previous question.

[0081] Since each AI big model can answer different technical points to different degrees, the correlation can determine whether the questions asked by the user multiple times are continuous questions with little difference in difficulty. For continuous questions, the question is likely to be a further extension of the technical point of the previous question, so you can choose to continue to use the AI ​​big model to answer it, and you can omit the process of repeatedly executing operations S1-S4, saving computing space and improving computing speed.

[0082] Furthermore, the dynamic adjustment and selection scheme is reflected in the dynamic switching of a single artificial intelligence large model, the increase or decrease in the number of multiple artificial intelligence large models, and the replacement between a single artificial intelligence large model and multiple artificial intelligence large models.

[0083] According to one embodiment of the present application, in order to improve the accuracy of answering users' continuous questions, before executing the dynamic adjustment selection scheme and outputting the answer result, the matching method also includes: obtaining the artificial intelligence big model selected in the dynamic adjustment selection scheme, and taking the previous n-th question text as an input item, and the output item is the background content of the n+1-th question text; taking the background content as an intervention item of the answer result, and using the selected artificial intelligence big model to answer the n+1-th question text to obtain the answer result.

[0084] In this embodiment, because of the lack of relevance to the previous question, it is necessary to readjust the artificial intelligence model for answering questions. However, if the dynamically adjusted new large model is used directly to answer questions, there may be a gap, that is, the answers to the current round of questions are separated from the basis of the answers to the previous rounds, making the results of the answers incoherent, difficult to understand or deviated, and even some content contradictory. In order to prevent the above problems, all questions before this round of questions are input into the dynamically adjusted new large model, that is, the text of the previous n questions is used as the background content of the text of the n+1th question, and the answer to the n+1th question is based on the previous n times.

[0085] According to one embodiment of the present application, the keyword library judgment strategy involved in the present application specifically includes: constructing a keyword library based on preset keywords, obtaining the question text asked by the user for the n+1th time, using natural language processing technology, and splitting the question text asked for the n+1th time according to sentence granularity according to the comma symbol to obtain a number of split sentences, and traversing the keyword library to obtain the result of whether the split sentences hit the keywords. If the result is that the split sentences hit the keywords, it is determined that there is a correlation between the question text asked for the n+1th time and the question text asked for the nth time. If the result is that the split sentences do not hit the keywords, it is determined that there is no correlation between the question text asked for the n+1th time and the question text asked for the nth time.

[0086] According to one embodiment of the present application, for example, the text of the question asked by the user for the nth time is: "What is reinforcement learning". After the system answers the nth question, the user continues to ask questions, and the text of the question asked for the n+1th time is: "In combination with the above problems, how to balance exploration and utilization". Based on the keyword library judgment strategy, the question text asked for the n+1th time is split according to the comma symbol to obtain multiple split sentences, such as: "In combination with the above problems" and "How to balance exploration and utilization". The keyword library is traversed. If the keyword library contains the keyword "in combination with the above problems", the result of the split sentence hitting the keyword is obtained, that is, it is determined that there is a correlation between the question text asked for the n+1th time and the question text asked for the nth time.

[0087] In order to improve the user experience of interactive answers, this application can also automatically match characters for interaction from the user's perspective based on the optimal matching results. Each artificial intelligence big model has a science and technology innovation assistant role with unique personality and visual image. Each role has a specific knowledge field, professional background and language style according to the characteristics of its corresponding big model.

[0088] In Example 1, when a user asks a question for the first time, the question is easy to answer based on the difficulty assessment and is a common question in this field. Therefore, the artificial intelligence model that answers this question is given an assistant a role through the display interface, and the user can conduct a human-computer dialogue with assistant a through the display interface.

[0089] Example 2 is a continuation of Example 1. After answering the current question, the user continues to ask questions. Assuming that when it is determined that the user's subsequent question is still in this field, the optimal matching result changes and requires dynamic adjustment of the artificial intelligence big model involved in the answer. At this time, the assistant role needs to change according to the dynamic adjustment of the artificial intelligence big model involved in the answer, such as becoming assistant b.

[0090] Example 3 is a continuation of Example 1. After the current question is answered, the user continues to ask questions. Suppose that when it is determined that the user's subsequent question is still in this field but the difficulty of the question increases, the optimal matching result changes and it is necessary to dynamically adjust the artificial intelligence big model involved in the answer. At this time, the assistant role needs to change according to the dynamic adjustment of the artificial intelligence big model involved in the answer, such as becoming expert a.

[0091] It can be understood from the above embodiments 1-3 that the results of the dynamic conversion of the artificial intelligence big model will correspond to different roles. When the difficulty of answering questions by two artificial intelligence big models is similar, they can be divided into assistants a and assistants b at the same level due to the changes in the big models. When the difficulty of answering questions by two artificial intelligence big models is quite different, more professional expert a can be included. By giving the artificial intelligence big model an anthropomorphic identity and using the above anthropomorphic interaction design, users can not only get professional answers, but also enjoy a more humane and personalized service experience.

[0092] It should be understood that, although the steps in the flowchart of the accompanying drawings are displayed in sequence as indicated by the arrows, these steps are not necessarily executed in sequence in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order restriction on the execution of these steps, and they can be executed in other orders. Moreover, at least a part of the steps in the flowchart of the accompanying drawings may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily executed at the same time, but can be executed at different times, and their execution order is not necessarily sequential, but can be executed in turn or alternately with other steps or at least a part of the sub-steps or stages of other steps.

[0093] Further references Figure 5 , as a response to the above Figure 2 The present application provides an embodiment of a system for matching the solution of an artificial intelligence large model. Figure 2 Corresponding to the method embodiment shown, the system can be specifically applied to various electronic devices.

[0094] like Figure 5 As shown, the answer matching system 300 of the artificial intelligence large model described in this embodiment includes: a question processing module 301, a question difficulty score calculation module 302, a model matching degree calculation module 303 and a matching result output module 304.

[0095] The question processing module 301 is used to obtain the question text asked by the user for the nth time, perform feature extraction processing on the question text using natural language processing technology, and construct a question feature set, where n is an integer greater than 0.

[0096] The question difficulty score calculation module 302 is used to input the question feature set into the difficulty assessment model and output the difficulty score of the question text, wherein the difficulty assessment model is generated after training based on the quantized historical question feature set.

[0097] The model matching degree calculation module 303 is used to calculate the matching degree of all artificial intelligence big models in the big model library based on the difficulty score of the question text using the big model matching degree formula to obtain the matching degree of each artificial intelligence big model.

[0098] The matching result output module 304 is used to analyze the matching degree of each artificial intelligence big model according to the preset big model matching strategy to obtain a selection scheme, wherein the selection scheme is to select a single artificial intelligence big model or to select multiple artificial intelligence big models. When a single artificial intelligence big model is selected, the selected single artificial intelligence big model is used as the optimal matching result of the solution; when multiple artificial intelligence big models are selected, the selected multiple artificial intelligence big models are used as the optimal matching results of the solution.

[0099] According to the matching system of the present application, the matching method of the artificial intelligence big model of the present application can be applied to perform feature extraction processing on the question text asked by the user for the nth time, extract the entity of the key technology and the information of the technical field to which it belongs, and then construct a question feature set, and use the difficulty assessment model to evaluate and analyze the question feature set to obtain the difficulty score of the corresponding question text. By calculating the matching degree of the artificial intelligence big model, it is convenient to compare the question text asked for the nth time with the difficulty processing capabilities of each artificial intelligence big model in the big model library; at the same time, by adopting the big model matching strategy, a single artificial intelligence big model or multiple artificial intelligence big models are selected in a targeted and intelligent manner as the optimal matching result of the question text for answering, thereby improving the professionalism and accuracy of answering questions; in addition, by obtaining the question text asked by the user for the n+1th time in real time, according to whether there is a correlation between the question text asked for the n+1th time and the question text asked for the nth time and the difficulty score of the question text asked for the n+1th time, the artificial intelligence big model involved in the answer can be adjusted in a targeted and dynamic manner, so as to solve the problem of insufficient processing capability of a single big model for continuous questions and no switching strategy for the big model in the prior art.

[0100] According to an embodiment of the present disclosure, any multiple modules of the question processing module 301, the question difficulty score calculation module 302, the model matching degree calculation module 303 and the matching result output module 304 can be combined in one module for implementation, or any one of the modules can be split into multiple modules. Alternatively, at least part of the functions of one or more of these modules can be combined with at least part of the functions of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the question processing module 301, the question difficulty score calculation module 302, the model matching degree calculation module 303 and the matching result output module 304 can be at least partially implemented as a hardware circuit, such as a field programmable gate array (FPGA), a programmable logic array (PLA), a system on a chip, a system on a substrate, a system on a package, an application specific integrated circuit (ASIC), or can be implemented by hardware or firmware such as any other reasonable way of integrating or packaging the circuit, or implemented in any one of the three implementation methods of software, hardware and firmware or in a suitable combination of any of them. Alternatively, at least one of the question processing module 301, the question difficulty score calculation module 302, the model matching degree calculation module 303 and the matching result output module 304 can be at least partially implemented as a computer program module, and when the computer program module is executed, the corresponding function can be executed.

[0101] The electronic device according to an embodiment of the present application includes a processor, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) or a program loaded from a storage portion into a random access memory (RAM). The processor may include, for example, a general-purpose microprocessor (e.g., a CPU), an instruction set processor and / or a related chipset and / or a dedicated microprocessor (e.g., an application-specific integrated circuit (ASIC)), etc. The processor may also include an onboard memory for caching purposes. The processor may include a single processing unit or multiple processing units for performing different actions of the method flow according to an embodiment of the present application.

[0102] In the RAM, various programs and data required for the operation of the electronic device are stored. The processor, ROM, and RAM are connected to each other through a bus. The processor performs various operations of the method flow according to the embodiment of the present application by executing the program in the ROM and / or RAM. It should be noted that the program can also be stored in one or more memories other than ROM and RAM. The processor can also perform various operations of the method flow according to the embodiment of the present application by executing the program stored in the one or more memories.

[0103] According to an embodiment of the present application, the electronic device may further include an input / output (I / O) interface, which is also connected to the bus. The electronic device may also include one or more of the following components connected to the I / O interface: an input part including a keyboard, a mouse, etc.; an output part including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage part including a hard disk, etc.; and a communication part including a network interface card such as a LAN card, a modem, etc. The communication part performs communication processing via a network such as the Internet. The drive is also connected to the I / O interface as needed. Removable media, such as magnetic disks, optical disks, magneto-optical disks, semiconductor memories, etc., are installed on the drive as needed so that the computer program read therefrom is installed into the storage part as needed.

[0104] The present application also provides a computer-readable storage medium, which may be included in the device / apparatus / system described in the above embodiments; or may exist independently without being assembled into the device / apparatus / system. The above computer-readable storage medium carries one or more programs, and when the above one or more programs are executed, the method according to the embodiment of the present application is implemented.

[0105] According to an embodiment of the present application, a computer-readable storage medium may be a non-volatile computer-readable storage medium, for example, it may include but is not limited to: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, an apparatus or a device. For example, according to an embodiment of the present application, a computer-readable storage medium may include the ROM and / or RAM described above and / or one or more memories other than ROM and RAM.

[0106] The embodiment of the present application also includes a computer program product, which includes a computer program, and the computer program contains program code for executing the method shown in the flowchart. When the computer program product is run in a computer system, the program code is used to enable the computer system to implement the item recommendation method provided in the embodiment of the present application.

[0107] When the computer program is executed by the processor, the above functions defined in the system / device of the embodiment of the present application are performed. According to the embodiment of the present application, the system, device, module, unit, etc. described above can be implemented by a computer program module.

[0108] In one embodiment, the computer program may rely on a tangible storage medium such as an optical storage device, a magnetic storage device, etc. In another embodiment, the computer program may also be transmitted and distributed in the form of a signal on a network medium, and downloaded and installed through a communication part, and / or installed from a removable medium. The program code contained in the computer program may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0109] In such an embodiment, the computer program can be downloaded and installed from the network through the communication part, and / or installed from a removable medium. When the computer program is executed by the processor, the above-mentioned functions defined in the system of the embodiment of the present application are executed. According to the embodiment of the present application, the system, equipment, device, module, unit, etc. described above can be implemented by a computer program module.

[0110] According to an embodiment of the present application, the program code for executing the computer program provided by the embodiment of the present disclosure can be written in any combination of one or more programming languages. Specifically, these computing programs can be implemented using high-level process and / or object-oriented programming languages, and / or assembly / machine languages. Programming languages ​​include, but are not limited to, Java, C++, python, "C" language or similar programming languages. The program code can be executed entirely on the user computing device, partially on the user device, partially on the remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device can be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computing device (e.g., using an Internet service provider to connect through the Internet).

[0111] Obviously, the embodiments described above are only some embodiments of the present application, rather than all embodiments. The preferred embodiments of the present application are given in the accompanying drawings, but they do not limit the patent scope of the present application. The present application can be implemented in many different forms. On the contrary, the purpose of providing these embodiments is to make the understanding of the disclosure of the present application more thorough and comprehensive. Although the present application is described in detail with reference to the aforementioned embodiments, for those skilled in the art, it is still possible to modify the technical solutions recorded in the aforementioned specific implementation methods, or to perform equivalent replacement of some of the technical features therein. Any equivalent structure made using the contents of the specification and drawings of this application, directly or indirectly used in other related technical fields, is similarly within the scope of patent protection of this application.

Claims

1. The solution matching method of the artificial intelligence large model is characterized by: include: S1. Obtain the question text asked by the user for the nth time, use natural language processing technology to extract features from the question text, and construct a question feature set, where n is an integer greater than 0; S2, inputting the question feature set into a difficulty assessment model, and outputting a difficulty score of the question text, wherein the difficulty assessment model is generated after training based on the quantized historical question feature set; S3. Based on the difficulty score of the question text, the matching degree of all artificial intelligence big models in the big model library is calculated using the big model matching degree formula to obtain the matching degree of each artificial intelligence big model; S4. Analyze the matching degree of each artificial intelligence big model according to the preset big model matching strategy to obtain a selection scheme, wherein the selection scheme is to select a single artificial intelligence big model or multiple artificial intelligence big models; Among them, when a single artificial intelligence big model is selected, the selected single artificial intelligence big model will be used as the optimal matching result of the solution; when multiple artificial intelligence big models are selected, the multiple artificial intelligence big models will be selected as the optimal matching results of the solution.

2. The method for matching the solution of the artificial intelligence large model according to claim 1, characterized in that: The step S1 specifically includes: S101, obtaining a question text asked by a user, performing word segmentation processing on the question text based on a word segmentation model and performing part-of-speech tagging on each question participle, to obtain multiple question participles and part-of-speech tagging information corresponding to the question participles; S102, performing entity recognition on the problem segmentation using a neural network model according to part-of-speech tagging information corresponding to the problem segmentation, and determining an entity of at least one key technology; S103, performing semantic analysis processing on the entity of the at least one key technology based on the semantic analysis model to determine the technical field information to which the entity of the key technology belongs; S104. Construct a problem feature set based on the entities of key technologies and the information of the technical fields to which they belong.

3. The method for matching the solution of the artificial intelligence large model according to claim 2, characterized in that: The step S1 further comprises: S105. Quantify the entities of the key technologies contained in the problem feature set and the information on the technical fields to which they belong, to obtain technical depth information and technical concept breadth information, wherein the technical depth information is determined by the hierarchical relationship of the entities of multiple key technologies, and the technical concept breadth is determined by counting the number of pieces of information on the technical fields to which they belong.

4. The method for matching the solution of the artificial intelligence large model according to claim 1, characterized in that: In step S3, the large model matching degree formula is as follows: Where: represents the matching degree of the jth artificial intelligence large model in the large model library, D represents the difficulty score of the question text, represents the difficulty processing capability score of the jth artificial intelligence large model in the large model library and is the known difficulty processing ability scoring data, and | | represents the absolute value.

5. The method for matching the solution of the artificial intelligence large model according to claim 4 is characterized in that: The preset large model matching strategy in step S4 includes: Selecting a single AI model with the best match; and Selecting multiple artificial intelligence large models with the same or similar matching degree that are ranked first, wherein the similar matching degree means that the difference in matching degree is less than or equal to a preset interval; The step S4 specifically includes: Sort the matching degree of the AI ​​big models from high to low; If the matching degree of the first-ranked artificial intelligence large model is significantly greater than that of the second-ranked artificial intelligence large model, the first-ranked artificial intelligence large model will be used as the selection plan, wherein the matching degree is significantly greater means that the difference in matching degrees is greater than a preset interval; if the matching degrees of multiple artificial intelligence large models ranked first are the same or similar, the multiple artificial intelligence large models ranked first will be used as the selection plan.

6. The method for matching the answer of the artificial intelligence big model according to any one of claims 1 to 5, characterized in that: The method further comprises: When the single artificial intelligence big model is used as the optimal matching result for answering the question text, the answer of the single artificial intelligence big model to the question text is used as the answer result of the question text; When the multiple artificial intelligence big models are used as the optimal matching results for answering the question text, the preliminary answer results of each artificial intelligence big model in the multiple artificial intelligence big models are obtained, and the answer fusion mechanism is used to fuse all the preliminary answer results to obtain the answer result of the question text.

7. The method for matching the solution of the artificial intelligence large model according to claim 6, characterized in that: The solution fusion mechanism comprises the following steps: Obtaining the pre-answer results of each artificial intelligence large model, and pre-processing the pre-answer results to obtain feature information of the pre-answer results; Extracting key information from the feature information of the preliminary answer result; The commonalities and differences of the key information are analyzed, and the answer to the question text is generated using natural language processing technology.

8. The method for matching the solution of the artificial intelligence large model according to claim 6, characterized in that: The method further comprises: Get the text of the question asked by the user for the n+1th time in real time; Based on the keyword library judgment strategy, it is judged whether there is relevance between the question text asked for the n+1th time and the question text asked for the nth time. If there is relevance, the selection scheme in the question text asked for the nth time is taken as the optimal matching result of the answer. If there is no relevance, the selection scheme is dynamically adjusted according to the difficulty score of the question text asked for the n+1th time. Among them, the dynamic adjustment and selection scheme is reflected in the dynamic switching of a single artificial intelligence large model, the increase or decrease in the number of multiple artificial intelligence large models, and the replacement between a single artificial intelligence large model and multiple artificial intelligence large models.

9. The method for matching the solution of the artificial intelligence large model according to claim 8, characterized in that: Before executing the dynamic adjustment selection scheme and outputting the solution result, the method further includes: Obtain the artificial intelligence large model selected in the dynamic adjustment selection scheme, and use the previous n-th question text as an input item, and the output item is the background content of the n+1-th question text; The background content is used as an intervention item of the solution result, and the selected artificial intelligence large model is used to solve the n+1th question text to obtain the solution result.

10. The method for matching the solution of the artificial intelligence large model according to claim 1, characterized in that: The method further comprises: automatically matching the characters for interaction according to the optimal matching result.

11. An artificial intelligence large model solution matching system, applied to an artificial intelligence large model solution matching method as claimed in any one of claims 1 to 10, characterized in that: include: The question processing module is used to obtain the question text asked by the user for the nth time, perform feature extraction processing on the question text using natural language processing technology, and construct a question feature set, where n is an integer greater than 0; A question difficulty score calculation module, used to input the question feature set into a difficulty assessment model and output a difficulty score of the question text, wherein the difficulty assessment model is generated after training based on the quantified historical question feature set; The model matching degree calculation module is used to score the difficulty of the question text, and uses the large model matching degree formula to calculate the matching degree of all artificial intelligence large models in the large model library to obtain the matching degree of each artificial intelligence large model; The matching result output module is used to analyze the matching degree of each artificial intelligence big model according to the preset big model matching strategy to obtain a selection plan, wherein the selection plan is to select a single artificial intelligence big model or select multiple artificial intelligence big models. When a single artificial intelligence big model is selected, the selected single artificial intelligence big model is used as the optimal matching result of the solution; when multiple artificial intelligence big models are selected, the selected multiple artificial intelligence big models are used as the optimal matching results of the solution.

Citation Information

Patent Citations

  • Multi-engine intelligent question answering system for multi-type knowledge base

    CN115238101A

  • Intelligent question and answer processing method and device based on artificial intelligence, equipment and medium

    CN116910199A

  • Language processing question answering system and method based on AIGC large model

    CN118093834A

  • Question answering method and device, equipment and medium

    CN118193699A

  • Intelligent question and answer method and device, computer equipment and readable storage medium

    CN118733744A

Cited By

  • Intelligent question answering system based on large-scale pre-training model and optimization method thereof

    CN120296129A

  • Multi-model cooperative service method and device, equipment and storage medium

    CN120297428A

  • Multi-model collaborative service method, device, equipment and storage medium

    CN120297428B

  • AI large model security evaluation method and device, electronic equipment and program product

    CN120832676A