Product testing method, device and equipment, storage medium and program product
Through a multi-agent testing system based on large-model technology, the problems of low automation and insufficient flexibility in the existing technology are solved, efficient and accurate product testing is achieved, and system stability and user demand processing capabilities are enhanced.
Patent Information
- Application Number
- CN202411026363.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-29
- Publication Date
- 2024-11-12
AI Technical Summary
The existing product testing methods are low in automation and cannot effectively handle user testing needs, resulting in low testing efficiency, lack of natural language understanding and intelligent decision-making support, insufficient customization and flexibility, difficulty in adapting to changing testing needs, and lack of reliable Process inspection and error correction mechanism.
Adopt a multi-agent testing system based on large-model technology to express testing requirements through natural language dialogue, process multi-modal content, provide a multi-agent collaboration framework and error feedback mechanism, and increase the degree of test automation, especially in demand acquisition, material review, In terms of tool debugging and report writing, reduce human workload and improve testing efficiency and accuracy.
It realizes a full-cycle automatic intelligent testing process, reduces manual investment, improves testing efficiency and accuracy, can accurately grasp user testing needs, enhance system stability and customization capabilities, and reduces the risk of omissions in key information and unstable output of models.
Smart Images

Figure CN118941242A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent testing, and in particular to a product testing method, device, equipment, storage medium and program product. Background Art
[0002] Testing work plays an important role in the product development stage, the pre-launch acceptance stage, and after the product is put on the market. It is a key means to ensure the normal function and stable performance of the product. In the long run, comprehensive and detailed testing work requires a lot of manpower and material resources. In order to improve testing efficiency and reduce testing costs, test automation and intelligent technology are particularly important. However, the automation level of product testing methods in related technologies is not high, and they cannot handle the user's testing needs well, resulting in low product testing efficiency. Summary of the invention
[0003] To solve the above technical problems, the embodiments of the present invention provide a product testing method, device, equipment, storage medium and program product.
[0004] The product testing method provided in the embodiment of the present application includes:
[0005] Based on the product information and the test instructions, determine a test task including a plurality of subtasks;
[0006] Execute the test task including the multiple subtasks to obtain the execution result of each subtask;
[0007] Integrate the execution results of each subtask to obtain the final execution result;
[0008] Determine whether the final execution result meets the first preset goal, and if the final execution result meets the first preset goal, send the final execution result to the user.
[0009] The product testing device provided in the embodiment of the present application includes:
[0010] A determination unit, configured to determine a test task including a plurality of subtasks based on product information and a test instruction;
[0011] A processing unit, configured to execute the test task including the plurality of subtasks, obtain the execution result of each subtask; and integrate the execution result of each subtask to obtain a final execution result;
[0012] The judging unit is used to judge whether the final execution result meets the first preset target, and if the final execution result meets the first preset target, send the final execution result to the user.
[0013] The processing device provided in the embodiment of the present application includes: a processor and a memory, the memory is used to store a computer program, and the processor is used to call and run the computer program stored in the memory to execute any one of the above-mentioned product testing methods.
[0014] The computer-readable storage medium provided in the embodiment of the present application is used to store a computer program, and the computer program enables a computer to execute any one of the above-mentioned product testing methods.
[0015] The computer program product provided in the embodiments of the present application includes computer program instructions, which enable a computer to execute any one of the above-mentioned product testing methods.
[0016] In the technical solution of the embodiment of the present application, based on product information and test instructions, a test task including multiple subtasks is determined, the test task including multiple subtasks is executed, the execution result of each subtask is obtained, the execution result of each subtask is integrated, the final execution result is obtained, and it is determined whether the final execution result meets the first preset goal. If the final execution result meets the first preset goal, the final execution result is sent to the user. In this way, by carrying out a full-cycle automatic and intelligent test process, not only can the manual input be reduced, and the test work can be promoted efficiently and accurately, but also the user's test needs can be accurately grasped according to the product information and test instructions, thereby improving the product's test efficiency. BRIEF DESCRIPTION OF THE DRAWINGS
[0017] Figure 1 It is a flowchart of a product testing method provided in an embodiment of the present application;
[0018] Figure 2 It is a structural diagram of a multi-agent testing system provided in an embodiment of the present application;
[0019] Figure 3 It is a structural schematic diagram of a product testing device provided in an embodiment of the present application;
[0020] Figure 4 It is a schematic diagram of the structure of the processing device provided in the embodiment of the present application. DETAILED DESCRIPTION
[0021] The following will describe the technical solutions in the embodiments of the present application in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0022] To facilitate understanding of the technical solutions of the embodiments of the present application, the relevant technologies of the embodiments of the present application are described below. The following related technologies can be arbitrarily combined with the technical solutions of the embodiments of the present application as optional solutions, and they all belong to the protection scope of the embodiments of the present application.
[0023] Testing work plays an important role in the product development stage, the pre-launch acceptance stage, and after the product is put on the market. It is a key means to ensure the normal function and stable performance of the product. However, in the long run, the implementation of comprehensive and detailed testing work requires a lot of manpower and material resources. In order to improve testing efficiency and reduce costs, test automation and intelligent technology are particularly important.
[0024] For software and hardware applications (mobile applications, desktop applications, network applications, etc.) that rely on computers and other electronic devices, the product testing solutions provided by relevant technologies mainly include the following:
[0025] (1) Only through software engineering technology can limited links in the testing process be automated, such as completing the automation of one or more links such as test process management, test case generation, test execution and process recording, and milestone document management.
[0026] (2) Through the use of dedicated artificial intelligence technology to assist software products, a certain degree of automation and intelligence can be achieved. For example, natural language processing technology, deep learning technology, etc. can be used to achieve single tasks such as text extraction and generation, and decision support, helping testers to complete test plan formulation, test tool adaptation, test execution, and test report writing.
[0027] (3) Use general big models and other artificial intelligence technologies to assist software products and achieve deeper test automation and intelligence. For example, through functions such as semantic understanding, code defect diagnosis, and performance evaluation, dynamic management and optimization of the test process can be achieved, and multiple intelligent tasks such as dynamic adjustment of test plans, prediction of potential risks, and real-time monitoring and feedback can be completed.
[0028] However, the above product testing solution still has the following shortcomings and deficiencies:
[0029] (1) The interactivity between users and the system is limited. It is usually a one-way information filling rather than a two-way dialogue. It usually does not support free dialogue in natural language, lacks natural language understanding and intelligent decision support, and has poor automatic text extraction and generation capabilities.
[0030] (2) Insufficient customization and flexibility make it difficult for existing systems to adapt to changing testing requirements. For example, the material submission interface is usually a static page designed in advance by the developer, and if there are customized requirements for testing, it needs to be manually modified. For material quality inspection, users need to define rules, which is only suitable for quality review of fixed material content. For test plans, the automatic generation function is limited and requires manual intervention to write, which makes it difficult to support a wide variety of test tasks. For test tool debugging, the supported tool types are single and the level of automation is low. For test reports, their generation is usually based on relatively fixed templates, and users need to manually aggregate data to generate report content.
[0031] (3) When the input data length is too long, key information is omitted, resulting in poor results.
[0032] (4) There is a lack of reliable process inspection and error correction mechanisms. The output of large models is uncertain and prone to hallucinations. Once similar problems occur, it will be difficult to continue normal application, and a single large model is difficult to complete self-inspection.
[0033] To solve the above technical problems, this application proposes a multi-agent testing system based on large model technology, which can reduce manual workload and improve testing efficiency by increasing the system's degree of automation, especially in requirements acquisition, material review, tool debugging, and report writing. It can also understand test requirements expressed in natural language conversations, process document information involving multimodal content, and better process and analyze long text data without additional processing, reducing the omission of key information. At the same time, it provides a multi-agent collaboration framework and error feedback mechanism, which can reduce the situation where the system cannot be applied normally due to unstable model output, thereby ensuring the continuous and stable operation of the system.
[0034] To facilitate understanding of the technical solutions of the embodiments of the present application, the technical solutions of the present application are described in detail below through specific embodiments. The above related technologies can be combined arbitrarily with the technical solutions of the embodiments of the present application as optional solutions, and they all belong to the protection scope of the embodiments of the present application. The embodiments of the present application include at least part of the following contents.
[0035] The present application embodiment provides a product testing method, which can be applied to any electronic intelligent device deployed with a computer program. Figure 1 is a flow chart of a product testing method provided in an embodiment of the present application, such as Figure 1 As shown, the method comprises the following steps:
[0036] Step 101: Based on product information and test instructions, determine a test task including multiple subtasks.
[0037] In an embodiment of the present application, the smart device that deploys the product testing method can first complete the collection and acquisition of test instructions through conversational interactions with various types of users such as test managers and test participants, and interact with users in a visual manner to enable users to upload product-related information. Then, based on the acquired product information and test instructions, the test instructions are pre-processed to determine a test task including multiple subtasks.
[0038] Based on this, in some implementations, before determining a test task including a plurality of subtasks based on the product information and the test instruction, the following steps are specifically included:
[0039] Acquire the test instruction through dialogue interaction with the user;
[0040] The product information is obtained through visual interaction with the user.
[0041] Here, the smart device first starts, enters the state of interaction with the user, and loads the necessary voice recognition, natural language processing and machine learning models, etc., and then guides the user to enter the test requirement input stage through the user interface or voice prompts. In this stage, the user can express his or her own test requirements through natural language dialogue. The user inputs the test requirements through voice, and the voice recognition system of the smart device converts it into text, and sends the converted text to the natural language processing system for analysis. Among them, natural language processing is responsible for word segmentation, part-of-speech tagging, syntactic analysis, etc. of the text, identifying and understanding the user's test intention, that is, which functions of the product the user wants to test. This usually involves matching the questions raised by the user with the standard questions in the knowledge base. Then, the smart device generates specific test instructions based on the recognized user intention. In this way, the smart device can understand the test requirements expressed in the natural language dialogue and automatically extract the test instructions in the natural language dialogue, thereby having a higher level of automation.
[0042] It should be noted that after obtaining the test instructions and product information, the smart device will store the interaction records with the user in the database.
[0043] Based on this, in some implementations, determining a test task including multiple subtasks based on product information and test instructions may specifically include:
[0044] Based on the product information, the test instructions are preprocessed to obtain the test target;
[0045] Task planning is performed on the test target to obtain a test task including multiple subtasks.
[0046] Here, after obtaining product information and test instructions, the smart device can perform preprocessing related to key information positioning and instruction compression on the test instructions based on the product information to obtain the test target, and then based on the test target, perform task decomposition, key test point setting and task allocation-related task planning to obtain a test task including multiple subtasks.
[0047] It should be noted that after obtaining a test task including multiple subtasks, the smart device will store the relevant content of the test task in the database.
[0048] Based on this, in some implementations, preprocessing the test instruction based on the product information to obtain the test target may specifically include:
[0049] Based on the product information, semantically segment the test instruction to obtain functional content and non-functional content;
[0050] Converting the functional content into an embedding vector and compressing the embedding vector to obtain a first target content;
[0051] Extracting key information from the non-functional content to obtain second target content;
[0052] The test target is determined based on the first target content and the second target content.
[0053] Here, after obtaining product information and test instructions, the smart device can perform semantic segmentation on the test instructions based on the content included in the product information to obtain functional content with clear test targets and non-functional content with unclear test targets. For the functional content with clear test targets, it is converted into an embedding vector and compressed to a fixed number of bits to obtain the first target content. For the non-functional content with unclear test targets, the key feature words with high information content are located based on the corpus of the test field, and the key feature words are extracted to obtain the second target content. Then, based on the first target content and the second target content, the test target is determined. In this way, by processing document information with multimodal content and processing and analyzing long text data, the omission of key information can be reduced, and the ability to process complex data can be improved, thereby improving the efficiency and accuracy of product testing.
[0054] Here, embedding is a technique for converting high-dimensional data (such as text or images) into a lower-dimensional vector representation, which captures the key features of the data and makes it more efficient when processing and analyzing data. The specific steps of converting the functional content with clear test objectives into an embedding vector and compressing it to a fixed number of bits include:
[0055] (1) Text preprocessing
[0056] The functional content is split into a sequence of words or characters, and each word or character in the sequence is then mapped to an index value in the vocabulary.
[0057] (2) Generate embedding vector
[0058] Use pre-trained embedding models, such as Word Vector (Word2Vec), Global Vectors for Word Representation (GloVe), Bidirectional Encoder Representations from Transformers (BERT), etc., or a custom embedding layer to convert the index value into a low-dimensional continuous vector representation.
[0059] (3) Embedding vector compression
[0060] Compressing the embedding vector to a fixed number of bits usually involves vector dimensionality reduction techniques, which can be achieved through different methods, including:
[0061] Principal Component Analysis (PCA): selects the principal components containing the maximum variance of the original vector and projects the embedding vector onto these principal components to achieve dimensionality reduction.
[0062] Quantization method: Use a predefined codebook to map the embedding vector to the closest vector.
[0063] Hash method: Convert the embedding vector into a hash value, and the number of bits of the hash value is a fixed number.
[0064] Here, the calculation formula for locating key feature words with high information content in non-functional content is:
[0065]
[0066] Among them, w i represents each word in the non-functional content, N represents the total number of words in the non-functional content, and freq() represents a function that calculates the number of times each word appears in the non-functional content. represents the probability of each word appearing in non-functional content, H(w i ) represents the information entropy (amount of information) of each word in the non-functional content.
[0067] Based on this, in some implementations, task planning is performed on the test target to obtain a test task including multiple subtasks, which may specifically include:
[0068] Decomposing the test target into tasks to obtain the multiple subtasks;
[0069] Based on the influence degree of each subtask in the multiple subtasks on the test target, key test points are set for each subtask to obtain a test task including the multiple subtasks.
[0070] Here, after determining the test objectives, the test objectives can be decomposed according to the test contents of each stage included in the test objectives, using task decomposition methods such as top-down decomposition, bottom-up decomposition, (Work Breakdown Structure, WBS) method or function-based decomposition method, and the test objectives can be decomposed into multiple subtasks to ensure that each subtask has a clear test objective and responsibility. Then analyze the impact of each subtask on the test objectives, which usually requires considering the importance of the subtask, such as the scope of impact when failure and the correlation with other subtasks. After determining the impact of each subtask on the test objectives, set key test points in each subtask according to the actual situation. These test points should be the key steps or conditions that can verify whether the subtask can achieve the expected effect. After setting the key test points, all subtasks and their key test points are integrated into a test task including multiple subtasks, wherein the test task can clearly display the test objectives, test contents, test methods, test environment and time arrangement of each subtask.
[0071] Step 102: Execute a test task including multiple subtasks, and obtain the execution result of each subtask.
[0072] In an embodiment of the present application, after obtaining a test task including multiple subtasks, the smart device executes the test task including multiple subtasks. During the test, the smart device continuously monitors the execution process of each subtask, and adjusts the test strategy in time according to the actual situation, so as to obtain the execution result of each subtask.
[0073] Based on this, in some implementations, the multiple subtasks specifically include at least one of the following:
[0074] Conducting quality checks on the product information;
[0075] Write test plans related to the product information;
[0076] Configure test tools and write test scripts;
[0077] Calling the test tool to execute the test process, and notifying the user when the test reaches a key test point;
[0078] After executing the test process, a test report is generated.
[0079] Here, the smart device executes corresponding steps in sequence according to the execution order of each subtask in the multiple subtasks, specifically including:
[0080] (1) Perform quality checks on product information uploaded by users (such as product description materials and test lists) to compare whether the submitted product information meets the submission standards. For product information that does not meet the submission standards, the smart device will provide timely feedback to the user to ensure the accuracy and completeness of the product information.
[0081] (2) Automatically generate corresponding test plans based on product information and test objectives.
[0082] (3) Configure and manage test tools, adjust test tools according to product specifics (such as API address, software installation package, etc.), and write test scripts.
[0083] (4) Call the configured test tool to execute the test. During the execution process, the test progress is displayed to the user through a visual interface, and the user is notified in time when the execution reaches the key test point.
[0084] (5) After executing the test process, generate a test report based on the test process.
[0085] In this way, by carrying out a fully automated testing process and increasing the degree of test automation, especially in terms of demand acquisition, material review, tool debugging, and report writing, the manual workload can be greatly reduced and the efficiency of product testing can be improved.
[0086] Here, the test report includes test objectives, test scope, test methods, test results, problem analysis, improvement suggestions, etc. After generating the test report, the smart device will promptly feedback the test report to the user so that the user can understand the test status of the product and give feedback on it. At the same time, the smart device will iterate and improve the product testing process based on the feedback content of the test report, including adjusting the test method, adding or modifying test cases, optimizing the test environment, etc., so as to improve the efficiency and accuracy of product testing and enhance the user experience.
[0087] It should be noted that after executing a test task including multiple subtasks, the smart device will store the execution process and execution results of the test task in a database.
[0088] Based on this, in some implementations, during the execution of a test task including a plurality of subtasks, the following steps are specifically included:
[0089] For each subtask, determine whether the execution result of the subtask meets the second preset goal during the execution of the subtask. If the execution result of the subtask does not meet the second preset goal, make corresponding adjustments to the subtask and the next subtask after the subtask.
[0090] Here, during the execution of each subtask, the smart device will continuously monitor the execution status and results of each subtask, and determine whether the execution results of each subtask meet the second preset goal. When it is determined that the execution results of a subtask do not meet the second preset goal, the test strategy of the subtask and the next subtask after the subtask will be adjusted in time, such as re-evaluating the impact of the subtask on the test goal to adjust the key test points in the subtask, or adjust the test method in the subtask as a whole. In this way, by providing an error feedback mechanism, it is possible to reduce the situation where the test process cannot be carried out normally due to unstable output, and ensure that the test continues to run stably.
[0091] Here, the second preset target can be set according to the actual situation of the test product and is not limited here.
[0092] Step 103: Integrate the execution results of each subtask to obtain the final execution result.
[0093] In the embodiment of the present application, after ensuring that each subtask is executed and the execution result of each subtask is obtained, the intelligent device first verifies the execution result of each subtask to ensure its accuracy and completeness, and cleans up invalid or redundant test results in the execution result, such as deleting duplicate test results or processing failed test results. Secondly, according to the test objectives, the execution results of each subtask are classified and summarized, such as by functional module, test case, test stage, etc., and then the classified and summarized execution results of each subtask are integrated to form a unified final execution result, which includes the test results of the corresponding steps of each subtask stage. Among them, the final execution result can clearly display the execution results of each subtask through visualization tools such as tables, icons, and lists.
[0094] Step 104: Determine whether the final execution result meets the first preset target. If the final execution result meets the first preset target, send the final execution result to the user.
[0095] In an embodiment of the present application, after obtaining the final execution result, the smart device first analyzes the final execution result to obtain analysis results such as the success rate, failure rate or number of error types of the final execution result, and then determines whether the final execution result meets the first preset goal based on the analysis results. If the final execution result meets the first preset goal, the final execution result is organized into natural language, files, etc. and fed back to the user.
[0096] Here, the first preset target can be set according to the actual situation of the test product and is not limited here.
[0097] In the technical solution of the embodiment of the present application, based on product information and test instructions, a test task including multiple subtasks is determined, the test task including multiple subtasks is executed, the execution result of each subtask is obtained, the execution result of each subtask is integrated, the final execution result is obtained, and it is determined whether the final execution result meets the first preset goal. If the final execution result meets the first preset goal, the final execution result is sent to the user. In this way, by carrying out a full-cycle automatic and intelligent test process, not only can the manual input be reduced, and the test work can be promoted efficiently and accurately, but also the user's test needs can be accurately grasped according to the product information and test instructions, thereby improving the product's test efficiency.
[0098] like Figure 2 The figure shows a schematic diagram of the structure of a multi-agent testing system provided in an embodiment of the present application. The system is divided into seven modules, specifically including:
[0099] Interaction Module
[0100] Various types of users, such as test managers and test participants, interact with the system in a conversational manner through the interactive user interface, so that the system obtains the user's test requirements (test instructions). Users upload product-related information through the interactive user interface, so that the system obtains the product information uploaded by users. At the same time, users can select functional components and configure evaluation processes through the interactive user interface.
[0101] Instruction preprocessing module
[0102] The test instructions are preprocessed, mainly including key information positioning and instruction compression. The test instructions are semantically segmented to obtain functional content with clear test objectives and non-functional content with unclear test objectives. For the functional content with clear test objectives, it is converted into an embedding vector and compressed to a fixed number of bits. For the non-functional content with unclear test objectives, the key feature words with high information content are located according to the corpus of the test field, and the key information is extracted and supplemented by the decision-making agent module to finally obtain the test objectives.
[0103] Decision-making Agent Module
[0104] The decision-making agent module mainly includes the following two functions:
[0105] (1) According to the test objectives, test task planning is carried out for the test objectives, including task decomposition, key test point setting, and specific task allocation for each module, and a test task including multiple subtasks is obtained.
[0106] (2) Check and determine whether the execution process of the business intelligence module, key node results, etc. meet the expected goals. If the expected goals are not achieved or errors occur, dynamically adjust the test tasks.
[0107] Business Intelligence Module
[0108] According to the test task including multiple subtasks obtained in the decision agent module, the corresponding steps are automatically executed, including:
[0109] (1) Conduct material review and quality inspection: For product description materials and test lists uploaded by users, we compare them with the submission standards and provide feedback. If the content does not meet the standards, we will promptly provide feedback to the user to ensure the completeness and accuracy of the materials.
[0110] (2) Automatic text generation: Automatically write test plans and generate test reports based on test requirements and product information.
[0111] (3) Test tool configuration and management: Configure test tools and write test scripts based on the specific conditions of the test product (such as API address, software installation package, etc.).
[0112] (4) Test execution and monitoring: Call the test tool to execute the test, display the test progress to the user through a visual interface during the execution process, and notify the user in a timely manner at key test points.
[0113] Among them, the relevant capabilities of the business decision-making module include:
[0114] (1) Code generation capability: Generate front-end pages for material submission, test process monitoring, etc., generate or debug test scripts / tools, configure stress testing tools, etc.
[0115] (2) Information processing capability: Process files involving multimodal content (such as images, recordings, and text) and extract required information.
[0116] (3) Multimodal generation capability: Generate corresponding text and image content according to needs.
[0117] (4) Tool usage ability: involves calling test tools to execute tests, calling notification tools (such as SMS, email, etc.) to initiate notifications, calling screen recording software to record the test process, etc.
[0118] Tool Collection Module
[0119] The tool collection module includes third-party tools required for testing work, including programming tools, browser tools, notification tools (email, SMS sending, etc.), which are called by the business intelligence module to perform related operations.
[0120] Database Module
[0121] The database module is used to record content related to the test task, retain the context conversation history, system decision-making and execution process, store user-uploaded and system-generated files, etc.
[0122] Results Integration Module
[0123] The integrated business module integrates the execution results of each subtask to obtain the final execution result, and submits it to the decision-making intelligent agent module to check whether it meets the expected goals. The final execution results that meet the expected goals are organized into natural language form and file form, and are prepared to be fed back to the user.
[0124] The multi-agent testing system provided in the embodiment of the present application manages the full-process testing of software and hardware applications for computers and other electronic equipment. The system can interact with users in natural language dialogues, and perform intelligent process guidance, material inspection, solution customization, tool debugging, test execution, process recording and test report generation, thereby providing a multi-agent collaboration framework and error feedback mechanism that can greatly improve the efficiency and quality of testing.
[0125] The present application also provides a product testing device. Figure 3 is a schematic diagram of the structure of a product testing device provided in an embodiment of the present application, such as Figure 3 As shown, the device comprises:
[0126] The determining unit 301 is used to determine a test task including multiple subtasks based on product information and test instructions.
[0127] The processing unit 302 is used to execute a test task including multiple subtasks, obtain the execution result of each subtask, and integrate the execution result of each subtask to obtain a final execution result.
[0128] The judging unit 303 is used to judge whether the final execution result meets the first preset target, and if the final execution result meets the first preset target, the final execution result is sent to the user.
[0129] In some embodiments, the device further comprises:
[0130] The acquisition unit is used to acquire test instructions through dialogue interaction with the user; and acquire product information through visual interaction with the user.
[0131] In some implementations, the determination unit 301 is specifically configured to pre-process the test instruction based on the product information to obtain a test target; and perform task planning on the test target to obtain a test task including a plurality of subtasks.
[0132] In some embodiments, the determination unit 301 is further specifically used to perform semantic segmentation on the test instructions based on the product information to obtain functional content and non-functional content; convert the functional content into an embedded vector and compress the embedded vector to obtain a first target content; extract key information from the non-functional content to obtain a second target content; and determine the test target based on the first target content and the second target content.
[0133] In some implementations, the determination unit 301 is further specifically used to decompose the test target into tasks to obtain multiple subtasks; based on the degree of influence of each subtask on the test target, key test points are set for each subtask to obtain a test task including multiple subtasks.
[0134] In some embodiments, the judgment unit 303 is also used to judge, for each subtask, whether the execution result of the subtask meets the second preset goal during the execution of the subtask. If the execution result of the subtask does not meet the second preset goal, the subtask and the next subtask after the subtask are adjusted accordingly.
[0135] In some embodiments, the multiple subtasks include at least one of the following: performing quality checks on product information; writing test plans related to product information; configuring test tools and writing test scripts; calling test tools to execute the test process and notifying the user when the test reaches a key test point; and generating a test report after executing the test process.
[0136] In the technical solution of the embodiment of the present application, based on product information and test instructions, a test task including multiple subtasks is determined, the test task including multiple subtasks is executed, the execution result of each subtask is obtained, the execution result of each subtask is integrated, the final execution result is obtained, and it is determined whether the final execution result meets the first preset goal. If the final execution result meets the first preset goal, the final execution result is sent to the user. In this way, by carrying out a full-cycle automatic and intelligent test process, not only can the manual input be reduced, and the test work can be promoted efficiently and accurately, but also the user's test needs can be accurately grasped according to the product information and test instructions, thereby improving the product's test efficiency.
[0137] Those skilled in the art should understand that Figure 3 The functions implemented by each unit in the product testing device shown can be understood by referring to the relevant description of the aforementioned method. Figure 3 The functions of each unit in the product testing device shown can be implemented by a program running on a processor, or by a specific logic circuit.
[0138] Figure 4 is a schematic diagram of the structure of a processing device provided in an embodiment of the present application. The processing device may be a terminal device or a network device. Figure 4 The processing device shown includes a processor 401, which can call and run a computer program from a memory to implement the method in the embodiment of the present application.
[0139] Alternatively, if Figure 4 As shown, the processing device may further include a memory 402. The processor 401 may call and run a computer program from the memory 402 to implement the method in the embodiment of the present application.
[0140] The memory 402 may be a separate device independent of the processor 401 , or may be integrated into the processor 401 .
[0141] Alternatively, if Figure 4 As shown, the processing device may further include a transceiver 403, and the processor 401 may control the transceiver 403 to communicate with other devices, specifically, may send information or data to other devices, or receive information or data sent by other devices.
[0142] The transceiver 403 may include a transmitter and a receiver. The transceiver 403 may further include an antenna, and the number of the antennas may be one or more.
[0143] The processing device may specifically be the product testing device of the embodiment of the present application, and the processing device may implement the corresponding processes implemented by the product testing device in each method of the embodiment of the present application, which will not be described in detail here for the sake of brevity.
[0144] It should be understood that the processor of the embodiment of the present application may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method embodiment can be completed by the hardware integrated logic circuit or software instructions in the processor. The above processor can be a general processor, a digital signal processor (Digital Signal Processor, DSP), an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), a field programmable gate array (Field Programmable Gate Array, FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or the hardware and software modules in the decoding processor are combined and performed. The software module can be located in a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, and other mature storage media in the art. The storage medium is located in the memory, and the processor reads the information in the memory and completes the steps of the above method in combination with its hardware.
[0145] It can be understood that the memory in the embodiments of the present application can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0146] It should be understood that the above-mentioned memory is exemplary but not restrictive. For example, the memory in the embodiments of the present application may also be static random access memory (static RAM, SRAM), dynamic random access memory (dynamic RAM, DRAM), synchronous dynamic random access memory (synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (double data rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (enhanced SDRAM, ESDRAM), synchronous link dynamic random access memory (synch link DRAM, SLDRAM) and direct memory bus random access memory (Direct Rambus RAM, DR RAM), etc. That is to say, the memory in the embodiments of the present application is intended to include but not limited to these and any other suitable types of memory.
[0147] The embodiment of the present application also provides a computer-readable storage medium for storing a computer program. The computer-readable storage medium can be applied to the processing device in the embodiment of the present application, and the computer program enables the computer to execute the corresponding process implemented by the product testing device in each method of the embodiment of the present application, which will not be described in detail here for the sake of brevity.
[0148] The embodiment of the present application also provides a computer program product, including computer program instructions. The computer program product can be applied to the processing device in the embodiment of the present application, and the computer program instructions enable the computer to execute the corresponding processes implemented by the product testing device in each method of the embodiment of the present application, which will not be described in detail here for the sake of brevity.
[0149] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0150] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0151] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0152] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0153] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0154] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory,) ROM, random access memory (RandomAccess Memory, RAM), disk or optical disk and other media that can store program codes.
[0155] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A product testing method, characterized in that: The method comprises: Based on the product information and the test instructions, determine a test task including a plurality of subtasks; Execute the test task including the multiple subtasks to obtain the execution result of each subtask; Integrate the execution results of each subtask to obtain the final execution result; Determine whether the final execution result meets the first preset goal, and if the final execution result meets the first preset goal, send the final execution result to the user.
2. The method according to claim 1, characterized in that Before determining the test task including a plurality of subtasks based on the product information and the test instruction, the method further includes: Acquire the test instruction through dialogue interaction with the user; The product information is obtained through visual interaction with the user.
3. The method according to claim 1, characterized in that The step of determining a test task including a plurality of subtasks based on the product information and the test instruction includes: Based on the product information, preprocessing the test instruction to obtain a test target; Task planning is performed on the test target to obtain a test task including the multiple subtasks.
4. The method according to claim 3, characterized in that The preprocessing of the test instruction based on the product information to obtain a test target includes: Based on the product information, semantically segment the test instruction to obtain functional content and non-functional content; Converting the functional content into an embedding vector and compressing the embedding vector to obtain a first target content; Extracting key information from the non-functional content to obtain second target content; The test target is determined based on the first target content and the second target content.
5. The method according to claim 3, characterized in that: The step of performing task planning on the test target to obtain a test task including the multiple subtasks includes: Decomposing the test target into tasks to obtain the multiple subtasks; Based on the influence degree of each subtask in the multiple subtasks on the test target, key test points are set for each subtask to obtain a test task including the multiple subtasks.
6. The method according to claim 5, characterized in that The multiple subtasks include at least one of the following: Conducting quality checks on the product information; Write test plans related to the product information; Configure test tools and write test scripts; Calling the test tool to execute the test process, and notifying the user when the test reaches a key test point; After executing the test process, a test report is generated.
7. The method according to any one of claims 1 to 6, characterized in that The method further comprises: For each subtask, determine whether the execution result of the subtask meets the second preset goal during the execution of the subtask. If the execution result of the subtask does not meet the second preset goal, make corresponding adjustments to the subtask and the next subtask after the subtask.
8. A product testing device, characterized in that: The device comprises: A determination unit, configured to determine a test task including a plurality of subtasks based on product information and a test instruction; A processing unit, configured to execute the test task including the plurality of subtasks, obtain the execution result of each subtask; and integrate the execution result of each subtask to obtain a final execution result; The judging unit is used to judge whether the final execution result meets the first preset target, and if the final execution result meets the first preset target, send the final execution result to the user.
9. A processing device, characterized in that: include:A processor and a memory, the memory being used to store a computer program, the processor being used to call and run the computer program stored in the memory to execute the method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: Used to store a computer program, wherein the computer program causes a computer to execute the method according to any one of claims 1 to 7.
11. A computer program product, characterized in that The method comprises computer program instructions which cause a computer to execute the method as claimed in any one of claims 1 to 7.
