Information processing method and information processing device
By obtaining the object's self-evaluation index data and the change results of the questionnaire in the interactive dialogue service scenario of human-computer interactive products, and generating questionnaire results, it solves the problem that it is difficult for the existing technology to accurately evaluate user experience, and achieves a more accurate effect of obtaining the user's true feelings and expectations.
Patent Information
- Application Number
- CN202111333479.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-11-11
- Publication Date
- 2025-03-25
- Estimated Expiration
- 2041-11-11
AI Technical Summary
The prior art is difficult to accurately evaluate the user experience of human-computer interaction products, mainly because the evaluation indicators are based on the system performance and it is difficult to obtain the user's true feelings and expectations.
In the scenario where the object triggers an interactive dialogue service, the questionnaire results are generated by obtaining the self-evaluation index data feedback from the object for the self-evaluation part of the questionnaire, and combining the changes of the measurement problem part of the questionnaire under the influence of the self-evaluation index data to evaluate the interactive experience of the object selecting an interactive dialogue service.
This method not only reflects the subjective feelings of interaction between the object and the interactive dialogue service, but also presents the impact results of the measurement problem part under the self-evaluation indicator data, which can more accurately obtain the user's true feelings and expectations and improve the accuracy of user experience evaluation.
Smart Images

Figure CN114154808B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to but is not limited to the field of information technology, and in particular to an information processing method and an information processing device. Background Art
[0002] User experience is the subjective psychological feeling that users develop in the process of using products, systems, and services. For human-computer interaction products, a good user experience (UX) is the key to success. Therefore, how to correctly evaluate user experience is crucial for human-computer interaction products, and it directly drives the design and improvement decisions of a human-computer interaction product. At present, the evaluation indicators used by human-computer interaction products are based on the perspective of system performance, and it is difficult to understand the real feelings and expectations of users. Summary of the invention
[0003] The embodiments of the present application are intended to provide an information processing method and an information processing device.
[0004] The technical solution of this application is implemented as follows:
[0005] An information processing method, the method comprising:
[0006] In a scenario where an object triggers an interactive dialogue service, obtaining self-assessment indicator data fed back by the object with respect to a self-assessment part of a questionnaire;
[0007] Obtaining the change results of the measurement question part of the questionnaire under the influence of the self-assessment indicator data;
[0008] If the subject ends the interactive dialogue service, a questionnaire result of the questionnaire is generated based on the self-assessment indicator data and the change result; wherein the questionnaire result is used to evaluate the interactive experience of the subject in selecting the interactive dialogue service.
[0009] An information processing device, comprising:
[0010] An acquisition module, used to obtain the self-assessment index data fed back by the subject for the self-assessment part of the questionnaire in a scenario where the subject triggers an interactive dialogue service;
[0011] The obtaining module is used to obtain the change result of the measurement question part of the questionnaire under the influence of the self-assessment indicator data;
[0012] A processing module is used to generate a questionnaire result of the questionnaire based on the self-assessment indicator data and the change result if the object ends the interactive dialogue service; wherein the questionnaire result is used to evaluate the interactive experience of the object selecting the interactive dialogue service.
[0013] An electronic device, comprising: a processor, a memory and a communication bus;
[0014] The communication bus is used to realize the communication connection between the processor and the memory;
[0015] The processor is used to execute the information processing program stored in the memory to implement the steps of the above-mentioned information processing method.
[0016] A computer storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the above-mentioned information processing method.
[0017] The information processing method and information processing device provided by the embodiments of the present application obtain, in a scenario where an object triggers an interactive dialogue service, self-assessment indicator data fed back by the object for the self-assessment part of a questionnaire; obtain the change results of the measurement question part of the questionnaire under the influence of the self-assessment indicator data; if the object ends the interactive dialogue service, generate the questionnaire results of the questionnaire based on the self-assessment indicator data and the change results; wherein the questionnaire results are used to evaluate the interactive experience of the object selecting the interactive dialogue service; that is, the questionnaire results not only reflect the subjective feelings of the object's interaction with the interactive dialogue service, but also present the influence results of the measurement question part under the self-assessment indicator data. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] Figure 1 A flowchart of an optional information processing method provided for an embodiment of the present application;
[0019] Figure 2 A flowchart of an optional information processing method provided for an embodiment of the present application;
[0020] Figure 3 A schematic diagram of an interactive interface provided in an embodiment of the present application;
[0021] Figure 4 A flowchart of an optional information processing method provided for an embodiment of the present application;
[0022] Figure 5 A schematic diagram of the structure of an information processing device provided in an embodiment of the present application;
[0023] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0024] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application.
[0025] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein are only for the purpose of describing the embodiments of this application and are not intended to limit this application.
[0026] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations.
[0027] The embodiment of the present application provides an information processing method, which can be applied to electronic devices. Figure 1 As shown, the method comprises the following steps:
[0028] Step 101: In a scenario where an object triggers an interactive dialogue service, obtain self-assessment indicator data fed back by the object regarding a self-assessment part in a questionnaire.
[0029] In the embodiment of the present application, the interactive dialogue service is a service that can simulate human dialogue or chat. The service fields involved in the interactive dialogue service include but are not limited to the product sales field, the medical field, and the education field. The self-assessment indicator data characterizes the subjective feelings of the object's interaction with the interactive dialogue service. The interactive dialogue service includes but is not limited to the dialogue service (Dialog Service) provided by the application. Exemplarily, in the scenario where the object triggers the interactive dialogue service, the application pops up a dialogue window. Of course, the interactive dialogue service can also include other services, such as those provided by a chatbot. A chatbot (Chatter bot) is a computer program that communicates via dialogue or text, and can be equipped with a natural language processing system.
[0030] A questionnaire is also called a survey form or an inquiry form. It is a printed document that systematically records the survey content in the form of questions. The questionnaire in this application at least includes a self-assessment part, a measurement question part, and a subject feature collection part.
[0031] Step 102: Obtain the change results of the measurement question part of the questionnaire under the influence of the self-assessment indicator data.
[0032] In the embodiment of the present application, the self-assessment index data can have an impact on the measurement question part of the questionnaire, including but not limited to the impact on the measurement questions presented in the measurement question part and the impact on the answer data fed back by the subjects to the measurement questions in the measurement question part.
[0033] Step 103: If the subject ends the interactive dialogue service, a questionnaire result of the questionnaire is generated based on the self-assessment indicator data and the change result.
[0034] Among them, the questionnaire results are used to evaluate the interactive experience of the subjects in selecting interactive dialogue services.
[0035] In an embodiment of the present application, when the subject ends the interactive dialogue service, the questionnaire results of the questionnaire are generated based on the self-assessment indicator data and the change results. The generated questionnaire results not only reflect the subjective feelings of the subject's interaction with the interactive dialogue service, but also present the impact results of the measurement problem part under the self-assessment indicator data, so as to obtain the subject's true feelings and expectations when using the questionnaire results to evaluate the interactive experience of the subject's selection of the interactive dialogue service.
[0036] The information processing method provided by the embodiment of the present application obtains self-assessment index data of the object for the self-assessment part in the questionnaire in the scenario where the object triggers the interactive dialogue service; obtains the change result of the measurement question part of the questionnaire under the influence of the self-assessment index data; if the object ends the interactive dialogue service, generates the questionnaire result of the questionnaire based on the self-assessment index data and the change result; wherein the questionnaire result is used to evaluate the interactive experience of the object selecting the interactive dialogue service; that is, the present application combines the influence of the self-assessment index data on the measurement question part of the questionnaire, i.e. the change result, and the self-assessment index data to generate the questionnaire result, so that the questionnaire result not only reflects the subjective feeling of the interaction between the object and the interactive dialogue service, but also presents the influence result of the measurement question part under the self-assessment index data, so as to obtain the real feeling and expectation of the object when the questionnaire result is used to evaluate the interactive experience of the object selecting the interactive dialogue service.
[0037] In other embodiments of the present application, in step 103, if the object ends the interactive dialogue service, before generating the questionnaire results of the questionnaire based on the self-assessment indicator data and the change results, the following steps can also be performed: obtaining the object feature information of the object collecting partial feedback on the object features in the questionnaire.
[0038] Here, the object characteristic information includes but is not limited to the object's personal information, and the object's personal information includes name, age, gender, height, weight, and contact information.
[0039] Further, if the subject ends the interactive dialogue service, step 103 generates the questionnaire results of the questionnaire based on the self-assessment index data and the change result, which can be achieved by the following steps: if the subject ends the interactive dialogue service, the questionnaire results are generated based on the self-assessment index data, the change result and the subject characteristic information. In this way, the generated questionnaire results are file results with specific identifiers, and the specific identifiers include the above-mentioned personal information, which is used to distinguish the questionnaire results of different subjects.
[0040] The embodiment of the present application provides an information processing method, which can be applied to electronic devices. Figure 2 As shown, the method comprises the following steps:
[0041] Step 201: In a scenario where an object triggers an interactive dialogue service, obtain self-assessment indicator data fed back by the object regarding a self-assessment part in a questionnaire.
[0042] In the embodiment of the present application, the factors represented by the self-assessment indicator data include, but are not limited to, the subject's expected acceptability, task efficiency, system errors, ease of use, naturalness, and personality of the interactive dialogue service.
[0043] Below, the self-assessment index data characterizing the subject's expected acceptability of the interactive dialogue service is used as an example for explanation. In the embodiment of the present application, step 201 obtains the self-assessment index data of the subject's feedback on the self-assessment part of the questionnaire in the scenario where the subject triggers the interactive dialogue service. It can be achieved by the following steps: in the scenario where the subject triggers the interactive dialogue service, obtain the efficacy expectation index data of the subject's self-efficacy when the subject selects the interactive dialogue service; obtain the subject's behavior result expectation index data associated with the efficacy expectation index data; wherein the self-assessment index data includes the efficacy expectation index data and the behavior result expectation index data. Here, the efficacy expectation index data is used to indicate the subject's satisfaction with the interactive dialogue service; the behavior result expectation index data is used to indicate the behavior selected by the subject for the current interactive dialogue service at the current satisfaction level, such as selecting a competing product, upgrading the current interactive dialogue service, not taking the interaction seriously, and stopping the interaction.
[0044] Exemplarily, in some embodiments, based on the subject's expected acceptability of the interactive dialogue service, four self-efficiency (SE) indicators are formulated, and the self-assessment indicator data corresponding to each indicator is different. Here, the acceptability represented by the four indicators is explained, wherein SE1 represents that if the current interactive dialogue service does not satisfy me, I tend to choose a competitor; SE2 represents that if there is a richer or better experience, I tend to upgrade the current interactive dialogue service; SE3 represents that the subject believes that the interaction with the interactive dialogue service is not worth taking seriously, because communicating with it seems to have no value; SE4 represents that the subject has stopped interacting with the interactive dialogue service because the subject believes that the interactive dialogue service cannot understand him or provide help anyway.
[0045] Step 202: In a scenario where an object triggers an interactive dialogue service, obtain a measurement question output by the interactive dialogue service that is set under the influence of the self-assessment indicator data on the setting rule of the question.
[0046] The measurement question includes at least one question related to the conversation topic in the scenario.
[0047] In the embodiment of the present application, a questionnaire survey is conducted on different subjects, and the electronic device analyzes a large amount of experimental data after the survey, and it is concluded that subjects with high self-efficacy believe that they are unique and believe that they will be valued and respected by others. In the scenario of interactive dialogue service, if a subject with high self-efficacy feels that the chatbot interaction is not rich or satisfactory enough, the subject is more likely to stop interacting or switch to a competitor's product.
[0048] In some embodiments, when the self-assessment index data fed back by the subject for the self-assessment part is obtained, the interactive dialogue service outputs the measurement questions matching the self-assessment index data, where the measurement questions output are the measurement questions set under the influence of the self-assessment index data on the setting rules of the questions. The setting rules include but are not limited to the professional level of the question, the keywords of the question, and the length of the description of the question. In other words, the self-assessment index data affects the title of the measurement question of the measurement question part.
[0049] For example, the larger the self-assessment index data, the more professional the title of the measurement problem is and the more concise the description of the problem is; the smaller the self-assessment index data, the less professional the title of the measurement problem is and the more detailed and clear the description of the problem is; when the self-assessment index data is different, the keywords of the corresponding measurement problems are not exactly the same.
[0050] Step 203: If the subject ends the interactive dialogue service, a questionnaire result of the questionnaire is generated based on the self-assessment indicator data and the change result.
[0051] Among them, the change results include measurement questions, and the questionnaire results are used to evaluate the interactive experience of the subjects in selecting the interactive dialogue service.
[0052] In the embodiment of the present application, when the subject ends the interactive dialogue service, the questionnaire results of the questionnaire are generated based on the self-assessment index data and the measurement questions set under the influence of the self-assessment index data on the setting rules of the questions. That is to say, when the self-assessment index data affects the title of the measurement question of the measurement question part, when the subject ends the interactive dialogue service, the questionnaire results of the questionnaire are generated based on the self-assessment index data and the answer data obtained by the subject answering the measurement questions set for himself. It can be seen that the questionnaire results not only reflect the subjective feelings of the interaction between the subject and the interactive dialogue service, but also present the influence results of the title of the measurement question under the self-assessment index data, so as to obtain the real feelings and expectations of the subject when the questionnaire results are used to evaluate the interactive experience of the subject selecting the interactive dialogue service.
[0053] Further, in the scenario of outputting the measurement question, the interactive dialogue service also outputs interactive prediction information for the output measurement question. In other embodiments of the present application, in step 202, in the scenario of the object triggering the interactive dialogue service, after obtaining the measurement question output by the interactive dialogue service and set under the influence of the self-assessment indicator data on the setting rule of the question, the following step may also be performed: obtaining the interactive prediction information fed back by the interactive dialogue service for the measurement question.
[0054] The interaction prediction information includes at least the time and implementation steps required to implement the solution, and the solution includes the solution fed back by the interactive service after the subject raises an interaction question during the interactive dialogue.
[0055] That is to say, in the scenario of interactive service output measurement problems, the interactive service also presents the time and implementation steps required to solve the solutions to the interactive problems raised by the objects with the above-mentioned self-assessment indicator data during the interactive communication process.
[0056] For example, see Figure 3As shown, after the object raises an interactive question during the interactive dialogue, the interactive service combines the measurement problem provided for the object and / or the answer data fed back by the object for the measurement problem, and outputs a solution for the interactive problem raised by the object. In the interactive interface 31, the object outputs the interactive problem as: My mobile phone cannot be turned on. The interactive service outputs a solution in the interactive interface 31, such as the solution presented in the answer area 32. At the same time, the interactive service combines the measurement problem output for the object, and feeds back the interactive prediction information for the process of the current interactive dialogue, such as outputting the interactive prediction information in the prediction box 33, that is, solving the interactive problem of my mobile phone cannot be turned on raised by the object, and the interactive service combines the measurement problem matched for the object, and predicts that the troubleshooting steps are 10-15 steps. According to the level of the object, it takes 5-10 minutes to complete this step, and the average time is 7.5 minutes. Here, the level of the object is generated based on the self-assessment indicator data and / or the answer data fed back by the object for the measurement problem. In addition, some selection controls are also presented on the interactive interface 31, for example, selection controls for answers, including yes, I see; no, I don’t see. Selection controls for the current interaction, including exit troubleshooting.
[0057] Further, step 203, if the object ends the interactive dialogue service, generates the questionnaire results of the questionnaire based on the self-assessment indicator data and the change results, which can be achieved by the following steps: if the object ends the interactive dialogue service, generates the questionnaire results based on the self-assessment indicator data, the interaction prediction information and the change results.
[0058] Here, when the object ends the interactive dialogue service, the questionnaire results are generated based on the self-assessment indicator data, interaction prediction information and change results. This can comprehensively consider the subjective feelings of the object's interaction with the interactive dialogue service, the object's answer data to personalized measurement questions, and the interactive service's judgment on the object such as interaction prediction information, and generate questionnaire results that combine subjective predictions with actual assessments.
[0059] The embodiment of the present application provides an information processing method, which can be applied to electronic devices. Figure 4 As shown, the method comprises the following steps:
[0060] Step 401: In a scenario where an object triggers an interactive dialogue service, self-assessment indicator data fed back by the object with respect to a self-assessment part in a questionnaire is obtained.
[0061] In the embodiment of the present application, the factors represented by the self-assessment indicator data include, but are not limited to, the subject's expected acceptability, task efficiency, system errors, ease of use, naturalness, and personality of the interactive dialogue service.
[0062] Below, still taking the self-assessment index data representing the subject's expected acceptability for the interactive dialogue service as an example, in the embodiment of the present application, step 401 obtains the self-assessment index data of the subject's feedback on the self-assessment part in the questionnaire in the scenario where the subject triggers the interactive dialogue service, which can be achieved by the following steps: in the scenario where the subject triggers the interactive dialogue service, obtain the efficacy expectation index data of the subject's self-efficacy when the subject selects the interactive dialogue service; obtain the subject's behavior result expectation index data associated with the efficacy expectation index data; wherein the self-assessment index data includes efficacy expectation index data and behavior result expectation index data. Here, the self-assessment index data includes SE1, SE2, SE3 and SE4.
[0063] Step 402: In a scenario where the object triggers an interactive dialogue service, obtain answer data of the object's measurement question feedback for the measurement question part.
[0064] The measurement question includes at least one question related to the conversation topic in the scenario.
[0065] Step 403: Determine the confidence of the answer data under the influence of the self-assessment indicator data.
[0066] Among them, the changed results include confidence and answer data.
[0067] In the embodiment of the present application, a questionnaire survey is conducted on different subjects, and the electronic device analyzes a large amount of experimental data after the survey, and it is concluded that subjects with high self-efficacy believe that they are unique and believe that they will be valued and respected by others. In the scenario of interactive dialogue service, if a subject with high self-efficacy feels that the chatbot interaction is not rich or satisfactory enough, the subject is more likely to stop interacting or switch to a competitor's product.
[0068] In some embodiments, when the self-assessment indicator data fed back by the subject for the self-assessment part is obtained, in the scenario where the subject triggers the interactive dialogue service, the answer data fed back by the subject for the measurement question part is obtained, and the confidence of the answer data under the influence of the self-assessment indicator data is determined, where the confidence characterizes the authenticity of the score corresponding to the answer data. It should be noted that the present application provides quantitative answer data for the measurement question, such as a specific score. When the subject selects multiple measurement options contained in a measurement question, the answer data obtained is a score.
[0069] Exemplarily, the larger the self-assessment index data is, the higher the authenticity of the score corresponding to the answer data is; the smaller the self-assessment index data is, the lower the authenticity of the score corresponding to the answer data is.
[0070] Step 404: If the subject ends the interactive dialogue service, a questionnaire result of the questionnaire is generated based on the self-assessment indicator data and the change result.
[0071] Among them, the questionnaire results are used to evaluate the interactive experience of the subjects in selecting interactive dialogue services.
[0072] In the embodiment of the present application, when the subject ends the interactive dialogue service, the questionnaire results of the questionnaire are generated based on the self-assessment index data, the answer data, i.e., the score, and the authenticity of the score corresponding to the score. That is, when the self-assessment index data affects the title of the measurement question in the measurement question part, when the subject ends the interactive dialogue service, the questionnaire results of the questionnaire are generated based on the self-assessment index data and the subject's score and the reliability of the score. It can be seen that the questionnaire results not only reflect the subjective feelings of the subject's interaction with the interactive dialogue service, but also reflect the results of the score under the influence of the self-assessment index data, so as to obtain the subject's true feelings and expectations when the questionnaire results are used to evaluate the interactive experience of the subject's selection of the interactive dialogue service.
[0073] In other embodiments of the present application, in the scenario of outputting measurement questions, the interactive dialogue service also outputs interactive prediction information for the output measurement questions. In step 402, in the scenario of the object triggering the interactive dialogue service, after obtaining the answer data of the measurement question feedback of the object for the measurement question part, the following steps may also be performed:
[0074] Obtain interactive prediction information for interactive dialogue service feedback on measurement questions.
[0075] The interaction prediction information includes at least the time and implementation steps required to implement the solution, and the solution includes the solution fed back by the interactive service after the subject raises an interaction question during the interactive dialogue.
[0076] That is to say, in the scenario of interactive service output measurement problem, the interactive service also presents the time and implementation steps required to solve the interactive problem for the object with the above self-assessment indicator data during the interactive communication process. Figure 3 to understand how interactive services interact with objects to solve interaction problems raised by objects.
[0077] Further, step 404, if the object ends the interactive dialogue service, generates the questionnaire results of the questionnaire based on the self-assessment indicator data and the change results, which can be achieved by the following steps: if the object ends the interactive dialogue service, generates the questionnaire results based on the self-assessment indicator data, the interaction prediction information and the change results.
[0078] Here, when the object ends the interactive dialogue service, the questionnaire results are generated based on the self-assessment indicator data, interaction prediction information and change results. This can comprehensively consider the subjective feelings of the object's interaction with the interactive dialogue service, the score and the authenticity of the score given by the interactive service to the object's answers to measurement questions, and the interactive service's judgment of the object such as interaction prediction information, to generate a questionnaire result that combines subjective prediction with actual assessment.
[0079] In other embodiments of the present application, step 102 obtains the measurement question part of the questionnaire, and the change results under the influence of the self-assessment indicator data include: first, in the scenario where the object triggers the interactive dialogue service, obtain the measurement questions set by the interactive dialogue service output under the influence of the self-assessment indicator data on the setting rules of the questions; wherein the measurement questions include at least one question related to the dialogue topic in the scenario. Secondly, in the scenario where the object triggers the interactive dialogue service, obtain the answer data of the object for the personalized measurement questions; determine the confidence of the answer data under the influence of the self-assessment indicator data; wherein the change results include the measurement questions, confidence and answer data. Practical applications have shown that after the introduction of self-assessment indicator data, the performance of the user experience evaluation system has been significantly improved.
[0080] In other embodiments of the present application, based on the description of the aforementioned steps 202 and 402, the measurement questions in the measurement question part include at least one question related to the conversation topic in the scenario; it should be noted that the measurement of each question in the at least one question depends on the performance expectation indicator data and the behavior result expectation indicator data.
[0081] Here, the interactive service sets each measurement question in combination with the self-assessment index data. For example, measurement questions are set in combination with SE1, SE2, SE3 and SE4 to measure the degree of satisfaction of the subject's sense of self-efficacy when selecting the interactive service. Moreover, in the process of setting measurement questions, the evaluation index of system performance can also be combined with the above SE1, SE2, SE3 and SE4. The evaluation index of system performance includes but is not limited to the degree of understanding of the subject interaction judged by the system, the task completion rate, the system error rate, and the page click-through rate conversion rate.
[0082] In other embodiments of the present application, in some scenarios involving the updating of questions, the process of obtaining the answer data of the measurement question feedback of the object for the measurement question part in step 402 can be implemented by the following steps:
[0083] Step 11: Obtain partial answer data fed back by the subject for some questions in any measurement interval of the measurement problem.
[0084] Step 12: Based on partial answer data, determine whether some questions meet the update conditions.
[0085] In the embodiment of the present application, Step 12 determines that some questions meet the update conditions based on the partial answer data, which can be achieved in the following two ways:
[0086] Method 1: obtaining a reference object different from the object associated with the self-assessment indicator data, and reference answer data for some questions; if the partial answer data and the reference answer data do not meet the answer condition, determining that some questions meet the update condition.
[0087] In an embodiment of the present application, in a scenario where an object triggers an interactive dialogue service, answer data fed back by the object for the measurement question part of the measurement question is obtained, and reference answer data fed back by a reference object different from the object and associated with the self-assessment indicator data for the above-mentioned partial question is obtained. If the similarity between the partial answer data and the reference answer data is less than the similarity threshold, it is determined that the partial answer data and the reference answer data do not meet the answer condition, triggering an update of the partial question.
[0088] Method 2: If the data corresponding to the mutually exclusive questions in the partial answer data do not satisfy the mutually exclusive condition, and / or the data corresponding to the approximate questions do not satisfy the approximate condition, it is determined that the partial questions satisfy the update condition.
[0089] Here, the answer data of mutually exclusive questions should be mutually exclusive answers, for example, question 1 and question 2 are mutually exclusive questions, if the answer to question 1 is yes, then the answer to question 2 is no. The answer data of similar questions should be similar answers, for example, question 3 and question 4 are similar questions, if the answer to question 3 is yes, then the answer to question 4 is yes.
[0090] Step 13: Update some questions and obtain the answer data of the subjects for the updated questions.
[0091] Among them, the answer data fed back for the measurement questions include the answer data fed back for the updated partial questions. In the embodiment of the present application, when the self-assessment index data of the object is obtained, a reference object different from the object associated with the self-assessment index data is obtained, and reference answer data for partial questions are fed back; if the partial answer data of the object for some questions and the reference answer data do not meet the answer conditions, the interactive service conducts a secondary questionnaire for the object, such as updating some questions and re-evaluating to obtain new answer data. In this way, it is possible to avoid the inaccurate impact of some questions in the questionnaire on the overall evaluation.
[0092] In other embodiments of the present application, in some scenarios involving the updating of questions, the reliability and validity of the questionnaire data can also be tested, and the questionnaire data can be used to calculate the sampling suitability test (Kaiser-Meyer-Olkin, KMO) value, Cronbach's coefficient (Cronbach's alpha), Bartlett's sphericity test P, factor loading, and cumulative explained variance to test the quality of the questionnaire, and then the questionnaire can be revised based on the test results.
[0093] For example, using the Cronbach coefficient as an example, when the α value exceeds 0.5, it is considered medium, when it exceeds 0.8, it is considered high, and when it exceeds 0.9, it is considered very high. Based on the scoring results of each item, the user's acceptance of human-computer interaction is comprehensively evaluated, the noise is filtered out, and the questionnaire is corrected.
[0094] The embodiment of the present application provides an information processing device, which can be applied to Figure 1 , 2 In an information processing method provided in the embodiment corresponding to 4, referring to Figure 5 As shown, the information processing device 5 includes:
[0095] An acquisition module 501 is used to obtain the self-assessment index data fed back by the subject regarding the self-assessment part of the questionnaire in a scenario where the subject triggers the interactive dialogue service;
[0096] An obtaining module 501 is used to obtain the change results of the measurement question part of the questionnaire under the influence of the self-assessment indicator data;
[0097] Processing module 502 is used to generate questionnaire results of the questionnaire based on the self-assessment indicator data and the change result if the subject ends the interactive dialogue service; wherein the questionnaire results are used to evaluate the interactive experience of the subject in selecting the interactive dialogue service.
[0098] In other embodiments of the present application, an acquisition module 501 is used to obtain, in a scenario where an object triggers an interactive dialogue service, a measurement problem output by the interactive dialogue service, which is set under the influence of self-assessment indicator data on the setting rules of the problem; wherein the measurement problem includes at least one problem involved in the dialogue topic under the scenario, and the change result includes the measurement problem.
[0099] In other embodiments of the present application, an acquisition module 501 is used to obtain answer data of the object's measurement question feedback for the measurement question part in a scenario where the object triggers an interactive dialogue service; wherein the measurement question includes at least one question related to the dialogue topic in the scenario; a processing module 502 is used to determine the confidence of the answer data under the influence of self-assessment indicator data; wherein the change result includes the confidence and the answer data.
[0100] In other embodiments of the present application, an acquisition module 501 is used to obtain interaction prediction information fed back by an interactive dialogue service for measurement problems; wherein the interaction prediction information includes at least the duration and implementation steps required to implement a solution, and the solution includes a solution fed back by the interactive service after the object raises an interaction problem during the interactive dialogue; a processing module 502 is used to generate questionnaire results based on self-assessment indicator data, interaction prediction information and change results if the object ends the interactive dialogue service.
[0101] In other embodiments of the present application, the acquisition module 501 is used to obtain the performance expectation index data of the object's self-efficacy when the object selects the interactive dialogue service in a scenario where the object triggers the interactive dialogue service; obtain the object's behavior result expectation index data associated with the performance expectation index data; wherein the self-assessment index data includes the performance expectation index data and the behavior result expectation index data.
[0102] In other embodiments of the present application, the measurement questions in the measurement question part include at least one question related to the conversation topic in the scenario; the measurement of each question in the at least one question depends on the performance expectation indicator data and the behavior result expectation indicator data.
[0103] In other embodiments of the present application, an acquisition module 501 is used to obtain partial answer data fed back by the object for some questions under any measurement interval of the measurement problem; a processing module 502 is used to determine, based on the partial answer data, that some questions satisfy update conditions; update some questions, and obtain answer data fed back by the object for some updated questions; wherein the answer data fed back for the measurement problem includes the answer data fed back for some updated questions.
[0104] In other embodiments of the present application, an acquisition module 501 is used to obtain a reference object different from the object associated with the self-assessment indicator data, and reference answer data for feedback on some questions; a processing module 502 is used to determine that some questions meet update conditions if the answer conditions are not met between the partial answer data and the reference answer data.
[0105] In other embodiments of the present application, the processing module 502 is used to determine that some questions meet the update condition if the data corresponding to the mutually exclusive questions in the partial answer data do not meet the mutual exclusion condition, and / or the data corresponding to the approximate questions do not meet the approximate condition.
[0106] In other embodiments of the present application, the acquisition module 501 is used to obtain the object feature information of the object for the object feature collection part of the feedback in the questionnaire; the processing module 502 is used to generate the questionnaire results based on the self-assessment indicator data, the change results and the object feature information if the object ends the interactive dialogue service.
[0107] The information processing device provided by the embodiment of the present application obtains the self-assessment index data of the object for the self-assessment part in the questionnaire in the scenario where the object triggers the interactive dialogue service; obtains the change result of the measurement question part of the questionnaire under the influence of the self-assessment index data; if the object ends the interactive dialogue service, generates the questionnaire result of the questionnaire based on the self-assessment index data and the change result; wherein the questionnaire result is used to evaluate the interactive experience of the object selecting the interactive dialogue service; that is, the present application combines the influence of the self-assessment index data on the measurement question part of the questionnaire, i.e. the change result, and the self-assessment index data to generate the questionnaire result, so that the questionnaire result not only reflects the subjective feeling of the object's interaction with the interactive dialogue service, but also presents the influence result of the measurement question part under the self-assessment index data, so as to obtain the object's real feelings and expectations when using the questionnaire result to evaluate the interactive experience of the object selecting the interactive dialogue service.
[0108] The embodiment of the present application provides an electronic device, which can be applied to Figure 1 , 2 In an information processing method provided in the embodiment corresponding to 4, referring to Figure 6 As shown, the electronic device 6 includes: a processor 601, a memory 602 and a communication bus 603, wherein:
[0109] The communication bus 603 is used to implement the communication connection between the processor 601 and the memory 602 .
[0110] The processor 601 is used to execute the information processing program stored in the memory 602 to implement the following steps:
[0111] In a scenario where the subject triggers the interactive dialogue service, obtaining the self-assessment indicator data fed back by the subject regarding the self-assessment part of the questionnaire;
[0112] Obtain the change results of the measurement questions of the questionnaire under the influence of the self-assessment indicator data;
[0113] If the subject ends the interactive dialogue service, a questionnaire result of the questionnaire is generated based on the self-assessment indicator data and the change result; wherein the questionnaire result is used to evaluate the interactive experience of the subject in selecting the interactive dialogue service.
[0114] In other embodiments of the present application, the processor 601 is used to execute the information processing program stored in the memory 602 to implement the following steps:
[0115] In a scenario where an object triggers an interactive dialogue service, a measurement problem set under the influence of self-assessment indicator data on the setting rules of the problem is obtained as output by the interactive dialogue service; wherein the measurement problem includes at least one problem involved in the dialogue topic in the scenario, and the change result includes the measurement problem.
[0116] In other embodiments of the present application, the processor 601 is used to execute the information processing program stored in the memory 602 to implement the following steps:
[0117] In a scenario where an object triggers an interactive dialogue service, obtaining answer data of the object's feedback on a measurement question part; wherein the measurement question includes at least one question involved in a dialogue topic in the scenario;
[0118] Determine the confidence of the answer data under the influence of the self-assessment indicator data; wherein the change result includes the confidence and the answer data.
[0119] In other embodiments of the present application, the processor 601 is used to execute the information processing program stored in the memory 602 to implement the following steps:
[0120] Obtaining interactive prediction information for the measurement problem fed back by the interactive dialogue service; wherein the interactive prediction information at least includes the time and implementation steps required to implement the solution, and the solution includes the solution fed back by the interactive service after the subject raises the interactive problem during the interactive dialogue;
[0121] If the subject ends the interactive dialogue service, the questionnaire results are generated based on the self-assessment indicator data, the interactive prediction information and the change results.
[0122] In other embodiments of the present application, the processor 601 is used to execute the information processing program stored in the memory 602 to implement the following steps:
[0123] In a scenario where the subject triggers the interactive dialogue service, obtaining efficacy expectation indicator data of the subject's self-efficacy when the subject selects the interactive dialogue service;
[0124] Obtaining the behavior result expected index data of the object associated with the performance expected index data; wherein the self-assessment index data includes the performance expected index data and the behavior result expected index data.
[0125] In other embodiments of the present application, the measurement questions in the measurement question part include at least one question related to the conversation topic in the scenario; the measurement of each question in the at least one question depends on the performance expectation indicator data and the behavior result expectation indicator data.
[0126] In other embodiments of the present application, the processor 601 is used to execute the information processing program stored in the memory 602 to implement the following steps:
[0127] Obtaining partial answer data of the subject for some questions in any measurement interval of the measurement problem;
[0128] Based on partial answer data, it is determined that some questions meet the update conditions;
[0129] Some questions are updated, and answer data fed back by the subjects for the updated some questions are obtained; wherein the answer data fed back for the measurement questions include the answer data fed back for the updated some questions.
[0130] In other embodiments of the present application, the processor 601 is used to execute the information processing program stored in the memory 602 to implement the following steps:
[0131] Obtain reference objects different from the object associated with the self-assessment indicator data, and reference answer data for some of the questions; if the partial answer data and the reference answer data do not meet the answer condition, determine that some of the questions meet the update condition; or,
[0132] If the data corresponding to the mutually exclusive questions in the partial answer data do not satisfy the mutually exclusive condition, and / or the data corresponding to the approximate questions do not satisfy the approximate condition, it is determined that the partial questions satisfy the update condition.
[0133] In other embodiments of the present application, the processor 601 is used to execute the information processing program stored in the memory 602 to implement the following steps:
[0134] Obtaining object characteristic information of collecting partial feedback from the object characteristics in the questionnaire;
[0135] If the subject ends the interactive dialogue service, a questionnaire result is generated based on the self-assessment indicator data, the change result and the subject characteristic information.
[0136] As an example, a processor can be an integrated circuit chip with signal processing capabilities, such as a general-purpose processor, a digital signal processor (DSP), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc., where a general-purpose processor can be a microprocessor or any conventional processor, etc.
[0137] The embodiment of the present application provides a computer-readable storage medium, which stores one or more programs, and the one or more programs can be executed by one or more processors to implement the following. Figure 1 , 2The implementation process of the information processing method provided in the embodiment corresponding to 4 will not be repeated here.
[0138] The computer-readable storage medium provided in the embodiment of the present application obtains self-assessment indicator data fed back by the object for the self-assessment part in the questionnaire in the scenario where the object triggers the interactive dialogue service; obtains the change result of the measurement question part of the questionnaire under the influence of the self-assessment indicator data; if the object ends the interactive dialogue service, generates the questionnaire result of the questionnaire based on the self-assessment indicator data and the change result; wherein the questionnaire result is used to evaluate the interactive experience of the object selecting the interactive dialogue service; that is, the present application combines the influence of the self-assessment indicator data on the measurement question part of the questionnaire, i.e. the change result, and the self-assessment indicator data to generate the questionnaire result, so that the questionnaire result not only reflects the subjective feeling of the interaction between the object and the interactive dialogue service, but also presents the influence result of the measurement question part under the self-assessment indicator data, so as to obtain the real feeling and expectation of the object when using the questionnaire result to evaluate the interactive experience of the object selecting the interactive dialogue service.
[0139] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of hardware embodiments, software embodiments, or embodiments in combination with software and hardware. Moreover, the present application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage and optical storage, etc.) that contain computer-usable program code.
[0140] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0141] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1A function specified in one or more boxes.
[0142] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0143] The above description is only a preferred embodiment of the present application and is not intended to limit the protection scope of the present application.
Claims
1. An information processing method, the method comprising: In a scenario where an object triggers an interactive dialogue service, obtaining self-assessment indicator data fed back by the object with respect to a self-assessment part of a questionnaire; The self-assessment index data includes performance expectation index data and behavior result expectation index data; Obtaining the change results of the measurement question part of the questionnaire under the influence of the self-assessment indicator data; If the subject ends the interactive dialogue service, a questionnaire result of the questionnaire is generated based on the self-assessment indicator data and the change result; wherein the questionnaire result is used to evaluate the interactive experience of the subject in selecting the interactive dialogue service.
2. According to the method of claim 1, the step of obtaining the change results of the measurement question part of the questionnaire under the influence of the self-assessment indicator data comprises: In the scenario where the object triggers the interactive dialogue service, a measurement problem output by the interactive dialogue service is obtained, which is set under the influence of the self-assessment indicator data on the setting rules of the problem; wherein the measurement problem includes at least one problem involved in the dialogue topic under the scenario, and the change result includes the measurement problem.
3. The method according to claim 1, wherein the step of obtaining the measurement question portion of the questionnaire and the result of the change under the influence of the self-assessment indicator data comprises: In a scenario where the object triggers the interactive dialogue service, obtaining answer data of the object's feedback on the measurement question part; wherein the measurement question includes at least one question involved in the dialogue topic in the scenario; Determine the confidence of the answer data under the influence of the self-assessment index data; wherein the change result includes the confidence and the answer data.
4. The method according to claim 2 or 3, wherein after obtaining the measurement question part of the questionnaire and changing the result under the influence of the self-assessment indicator data, the method further comprises: Obtaining interaction prediction information fed back by the interactive dialogue service for the measurement problem; wherein the interaction prediction information includes at least one of the duration and implementation steps required to implement a solution, and the solution includes the solution fed back by the interactive service after the object raises an interaction problem during the interactive dialogue.
5. The method according to claim 1, wherein in a scenario where the subject triggers an interactive dialogue service, obtaining the self-assessment indicator data fed back by the subject regarding the self-assessment part of the questionnaire comprises: In a scenario where the subject triggers the interactive dialogue service, obtaining efficacy expectation index data of the subject's sense of self-efficacy when the subject selects the interactive dialogue service; Obtaining the behavior result expected index data of the object associated with the performance expected index data.
6. According to the method of claim 5, the measurement questions of the measurement question part include at least one question related to the conversation topic in the scenario; the measurement of each question in the at least one question depends on the performance expectation indicator data and the behavior result expectation indicator data.
7. The method according to claim 3, wherein obtaining the answer data of the measurement question feedback of the subject for the measurement question part comprises: Obtaining partial answer data fed back by the subject in response to partial questions in any measurement interval of the measurement problem; Based on the partial answer data, determining that the partial questions meet an update condition; The partial questions are updated, and answer data fed back by the subject for the updated partial questions are obtained; wherein the answer data fed back for the measurement questions include the answer data fed back for the updated partial questions.
8. The method according to claim 7, wherein determining that the part of the question satisfies an update condition based on the part of the answer data comprises: Obtain reference answer data of a reference object different from the object and associated with the self-assessment indicator data and fed back with respect to the partial questions; If the partial answer data and the reference answer data do not satisfy the answer condition, determining that the partial question satisfies the update condition; or, If the data corresponding to the mutually exclusive questions in the partial answer data do not satisfy the mutually exclusive condition, and / or the data corresponding to the approximate questions do not satisfy the approximate condition, it is determined that the partial questions satisfy the update condition.
9. The method according to claim 1, further comprising: Obtaining object characteristic information of a portion of feedback collected by the subject with respect to the object characteristic in the questionnaire; Correspondingly, if the subject ends the interactive dialogue service, generating the questionnaire results of the questionnaire based on the self-assessment indicator data and the change result includes: If the subject ends the interactive dialogue service, the questionnaire result is generated based on the self-assessment index data, the change result and the subject characteristic information.
10. An information processing device, comprising: An acquisition module, used to obtain self-assessment index data fed back by the subject for the self-assessment part of the questionnaire in a scenario where the subject triggers an interactive dialogue service; the self-assessment index data includes performance expectation index data and behavior result expectation index data; The obtaining module is used to obtain the change result of the measurement question part of the questionnaire under the influence of the self-assessment indicator data; A processing module is used to generate a questionnaire result of the questionnaire based on the self-assessment indicator data and the change result if the object ends the interactive dialogue service; wherein the questionnaire result is used to evaluate the interactive experience of the object selecting the interactive dialogue service.
Citation Information
Patent Citations
Man-machine chat experience evaluation system
CN111985751A
Automatic question answering method and device for human-computer interaction and intelligent equipment
CN113220848A