Chip test management platform

Abstract

The invention relates to the technical field of chip testing, in particular to a chip testing management platform which comprises a scheme module used for setting a testing target, testing steps and an expected result to form a testing scheme; the demand module is connected with the scheme module and is used for initiating and managing a test demand, generating a demand document and associating the demand document with the test scheme; the stage management module is connected with the demand module and is used for dividing the flow of the test scheme into a plurality of test stages, and each test stage is adaptively configured based on the characteristics of the chip to be tested to generate a stage task; and the test module is connected with the stage management module and is used for simulating a workload to execute a test on the chip according to the stage task and outputting a test result. Through automatic process management and templated test process design, errors caused by manual operation are reduced, standardization and consistency of the test process are ensured, and the test efficiency is greatly improved.

Description

Technical Field

[0001] The present invention relates to the field of chip testing technology, and in particular to a chip testing management platform. Background Art

[0002] Existing chip test process management systems are mainly focused on desktop operations. Most systems use a traditional client-server architecture, where users manage and execute test tasks through desktop applications or web browsers. These systems are usually designed as large, comprehensive platforms that integrate a wide range of test functions and management tools to meet a variety of test needs.

[0003] However, the design of such systems is often too complex and lacks flexibility, especially in meeting the testing needs of modern mobile scenarios. In addition, existing AI computing power test management platforms often lack specialized adaptation and optimization for chip types, especially domestic AI hardware, and have limitations in automated test scripts, computing power evaluation and monitoring, compatibility testing and verification, and security testing. Summary of the invention

[0004] The purpose of the present invention is to provide a chip test management platform to solve the above technical problems; the technical problems solved by the present invention can be achieved by adopting the following technical solutions: a chip test management platform, including a solution module, used to set test objectives, test steps and expected results to form a test solution; a requirement module, connected to the solution module, used to initiate and manage test requirements, generate requirement documents and associate the requirement documents with the test solution; a stage management module, connected to the requirement module, used to divide the process of the test solution into multiple test stages, each of the test stages is adaptively configured based on the characteristics of the chip to be tested, and a stage task is generated; a test module, connected to the stage management module, used to simulate the workload according to the stage task to perform testing on the chip, and output the test results.

[0005] Preferably, the scheme module includes a test target definition unit, which is used to set the test target; a test step definition unit, which is connected to the test target definition unit and is used to set the test steps, and the test steps at least include step sequence, input data and execution conditions; an expected result definition unit, which is connected to the test step definition unit and is used to set the expected result for each of the test steps, and the expected result at least includes expected performance data, output format and error handling conditions; a risk assessment unit, which is connected to the test target definition unit, the test step definition unit and the expected result definition unit, and is used to obtain the test target, the test steps and the expected results, identify risks using preset risk assessment standards, and output risk identification results; the scheme module also includes an editing interface, which is used to visually arrange and obtain the test scheme.

[0006] Preferably, the requirement module includes a requirement analysis module, which is used to receive the test requirements and generate a formatted requirement document; a priority management unit, which is connected to the requirement analysis module and is used to assign priorities to the test requirements and associate them with the test plan; and a progress tracking unit, which is connected to the priority management unit and is used to display the test completion progress of the test plan through visual progress.

[0007] Preferably, it also includes a document management module, which is connected to the test module and is used to manage the uploaded test documents and the test documents generated during the test process, and the test documents at least include the test plan, test report and test result analysis document; the stage management module is also used to track the test status of each stage task, generate a stage report, and summarize it to form the test report; the content of the test result analysis document at least includes the expected results and the verification matching results of the test results.

[0008] Preferably, it also includes a mobile application module, which is arranged in a mobile device, and the mobile device is connected to the solution module, the requirement module, the stage management module and the test module through the mobile application module, and is used to monitor the test progress, manage the test plan and submit the test results on the mobile device, and analyze the test results.

[0009] Preferably, it also includes an enterprise communication module, which connects the solution module, the requirement module, the stage management module and the test module, and is used to generate and distribute test project reports to testers, and issue test task notifications, task assignment information and team collaboration information to testers.

[0010] Preferably, the solution module, the requirement module, the stage management module and the test module run independently of each other, the chip test management platform also includes a user interface for interaction, the backend service architecture of the chip test management platform adopts a microservice framework, the front end is developed using React or Vue.js front-end framework and component library, and the database adopts SQLite or NoSQL database.

[0011] Preferably, it also includes a reasoning capability evaluation module connected to the test module, the reasoning capability evaluation module is provided with a benchmark test set optimized according to the characteristics of the chip, the benchmark test set includes test data and test cases adapted to the chip, and the test module performs testing on the chip according to the benchmark test set.

[0012] Preferably, it also includes a computing power cluster performance test module, which is connected to the test module. The computing power cluster performance test module is used to dynamically allocate loads and monitor performance in real time, simulate the computing power requirements of real scenarios and generate a performance bottleneck analysis report.

[0013] Preferably, it also includes a computing power evaluation and monitoring module, which is connected to the test module. The computing power evaluation and monitoring module is also used to monitor and capture the hardware indicators of the chip in real time, and evaluate the hardware performance of the chip according to preset test standards.

[0014] Beneficial effects of the present invention: Due to the adoption of the above technical scheme, the present invention reduces human operation errors through automated process management and templated test process design, ensures the standardization and consistency of the test process, greatly improves the test efficiency, realizes the standardization and intelligence of the test process, optimizes multi-role collaboration and task management, and ensures the security and stability of the test process. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 This is a system architecture diagram of a chip test management platform in an embodiment of the present invention; Figure 2 Schematic diagram of the steps of the chip test management method in an embodiment of the present invention.

[0016] In the attached figure: 1. Solution module; 11. Test target definition unit; 12. Test step definition unit; 13. Expected result definition unit; 14. Risk assessment unit; 2. Requirement module; 21. Requirement analysis module; 22. Priority management unit; 23. Progress tracking unit; 3. Document management module; 4. Phase management module; 5. Mobile device; 51. Mobile application module; 6. Test module; 71. Reasoning ability evaluation module; 72. Computing power cluster performance test module; 73. Computing power evaluation and monitoring module; 8. Enterprise communication module. DETAILED DESCRIPTION

[0017] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0018] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments may be combined with each other.

[0019] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments, but they are not intended to limit the present invention.

[0020] A chip test management platform, such as Figure 1 As shown, it includes a solution module 1, which is used to set test objectives, test steps and expected results to form a test solution; a requirement module 2, which is connected to the solution module 1, and is used to initiate and manage test requirements, generate requirement documents and associate the requirement documents with the test solution; a stage management module 4, which is connected to the requirement module 2, and is used to divide the process of the test solution into multiple test stages, and each test stage is adaptively configured based on the characteristics of the chip to be tested to generate stage tasks; a test module 6, which is connected to the stage management module 4, and is used to perform tests on the chip according to the stage tasks to simulate the workload and output the test results.

[0021] Specifically, the present invention aims to solve the problems of insufficient standardization and automation, complexity of multi-role collaboration, and imperfect task management in the test process management of AI chips, especially domestic AI chips. By building a comprehensive solution, the present invention realizes the standardization and intelligence of the test process, optimizes multi-role collaboration and task management, and ensures the security and stability of the test process.

[0022] The present invention reduces human operation errors through automated process management and templated test process design, ensures the standardization and consistency of the test process, and greatly improves the test efficiency.

[0023] In a preferred embodiment, the solution module 1 includes a test target definition unit 11, which is used to set the test target; a test step definition unit 12, which is connected to the test target definition unit 11 and is used to set the test steps, and the test steps at least include step sequence, input data and execution conditions; an expected result definition unit 13, which is connected to the test step definition unit 12 and is used to set the expected result for each test step, and the expected result at least includes expected performance data, output format and error handling conditions; a risk assessment unit 14, which is connected to the test target definition unit 11, the test step definition unit 12 and the expected result definition unit 13, and is used to obtain the test target, test steps and expected results, identify risks using preset risk assessment standards, and output risk identification results; the solution module 1 also includes an editing interface, which is used to visually arrange and obtain the test plan.

[0024] Specifically, the solution module 1 of the present invention is specially designed for formulating and managing test solutions, supporting complex test goal definition, test step design, expected result setting, and risk assessment.

[0025] Solution module 1 allows users to customize test solutions based on the characteristics of different domestic chips to ensure the pertinence and effectiveness of the test.

[0026] Users can design complex test steps, including the order of steps, input data, execution conditions, etc. The present invention provides a visual step editing interface, supports dragging, sorting and condition setting, and simplifies the arrangement of complex test schemes.

[0027] More specifically, users can set detailed expected results for each test step, including expected performance data, output format, and error handling conditions.

[0028] The main function of the risk assessment unit 14 is to identify potential risks in the test process. The risk unit assesses the impact of each identified risk on the test results. Risks are prioritized according to their severity or probability of occurrence, and risk mitigation measures or adjustment suggestions are provided based on the risk assessment results. The risk assessment unit 14 obtains information from the test target definition unit 11 or the test step definition unit 12, such as test objectives, step sequence, input data, and execution conditions, and uses a preset risk analysis model or algorithm to analyze the collected data to identify and quantify the risks. For example, methods such as failure mode and effect analysis (FMEA) are used. During the test execution process, the risk assessment unit 14 monitors the test process in real time, collects new data generated during the execution process, and updates and adjusts the original risk assessment to maintain dynamic management of risks.

[0029] The present invention supports dynamic verification of the matching of expected results with actual results. In the prior art, test scheme design often relies on manual writing and static documents, which makes it difficult to handle complex test requirements. The present invention makes the definition of complex test objectives and steps more intuitive and efficient through modular design and dynamic editing functions, supports dynamic risk assessment, and provides more comprehensive test planning support.

[0030] In a preferred embodiment, the requirement module 2 includes a requirement analysis module 21, which is used to receive test requirements and generate a formatted requirement document; a priority management unit 22, connected to the requirement analysis module 21, which is used to assign priorities to test requirements and associate them with test plans; and a progress tracking unit 23, which is connected to the priority management unit 22, which is used to display the test completion progress of the test plan through visual progress.

[0031] Specifically, the requirement module 2 targets the special requirements of chip testing, especially domestic chip testing. Users can initiate and manage test requirements through the requirement module 2. The requirement module 2 provides requirement analysis, priority management and progress tracking functions.

[0032] The requirement module 2 automatically generates the requirement document and associates it with the corresponding test tasks to ensure that the test work is carried out in an orderly manner. When the user enters the requirement information, a formatted requirement document is automatically generated, including the requirement description, priority, associated test objectives, etc. The document template can be customized as needed to ensure the consistency and standardization of the document.

[0033] In the prior art, the requirement document needs to be manually written and maintained, which is prone to errors or omissions. The present invention reduces the complexity of manual operations and improves the accuracy of the document by automating document generation.

[0034] Requirements Module 2 provides real-time progress tracking, showing the completion of test tasks through visual tools such as progress bars and Gantt charts. Users can view the progress of tasks at each stage and set milestones and completion percentages.

[0035] The progress tracking in the prior art may rely on manual updates and static reports. The present invention provides more dynamic and accurate progress management through automated progress updates and real-time data display.

[0036] After allowing users to input requirement information, it automatically performs requirement analysis, identifies key points of the requirements, and associates them with test objectives. It generates a requirement analysis report, providing a detailed description of the requirements and real-time suggestions.

[0037] Demand analysis and progress tracking in the prior art may rely on manual updates and static reports, which are inefficient. The present invention improves the efficiency and accuracy of demand management through automated demand analysis and dynamic progress tracking, and provides more comprehensive project progress visualization.

[0038] The requirement analysis unit receives input requirement information through the user interface, such as the user's requirement description. Further, the requirement analysis unit uses natural language processing (NLP) technology to analyze the requirements input by the user and identify key points in the requirements, such as core functions, priorities, dependencies, etc. It can use text classification and entity recognition models to automatically extract and classify information in the requirements, and then generate a requirement analysis report that describes the requirements and their key points, real-time suggestions, and other information in detail.

[0039] The priority management unit 22 can set a priority for each requirement, such as high, medium, and low. The priority management unit 22 provides a function of automatically recommending priorities based on historical data and the importance of the project, or can automatically sort the requirements according to the priorities set by the user.

[0040] The progress tracking unit 23 can automatically update the task progress by integrating with the test task management tools, such as Jira and Trello, to interact with the data, use chart libraries such as Chart.js or D3.js to display the progress, and use progress bars, Gantt charts, etc. to dynamically display the completion status of the task.

[0041] The present invention provides a series of document templates, including fields such as requirement description, priority, and test objectives. Users can customize document templates to meet the needs of different test projects. After the user enters the requirement information, a template engine such as Freemarker and Thymeleaf is used to fill the collected information into the preset template to automatically generate a formatted requirement document.

[0042] The present invention will automatically create corresponding test tasks while generating the requirement document, and associate them with the requirement to ensure that the test work is carried out in an orderly manner. The relationship between the requirement document and the test plan can be established, and the test file can be associated with the requirement document through a foreign key. When the requirement changes, the relevant test tasks can also be automatically identified and updated to ensure the real-time consistency of information.

[0043] Regarding the selection of technology stack, the backend of the present invention can use frameworks such as Spring Boot or Django, the front end can be developed using React or Vue.js, and the database can be MySQL or PostgreSQL.

[0044] In a preferred embodiment, it also includes a document management module 3, connected to a test module 6, for managing the test documents uploaded and generated during the test process, the test documents at least including the test plan, test report and test result analysis document; the stage management module 4 is also used to track the test status of each stage task, generate a stage report, and form a test report after summarizing; the content of the test result analysis document at least includes the expected results and the verification and matching results of the test results. The automatic generation, version management and export functions of the test report simplify the report management process and facilitate the archiving and sharing of test results.

[0045] Specifically, the document management module 3 supports the centralized management of all relevant documents in the test process, including test plans, test reports, test result analysis, etc. Users can easily access, update and archive documents to ensure the integrity and traceability of information. The present invention automatically records the modification history and version information of the document, so that users can view the change record of the document and restore it to the historical version.

[0046] The document management module 3 of the present invention adopts a centralized unified document repository, and all test-related documents such as test plans, test reports, test result analysis, etc. are stored in the document repository. The document repository can use cloud storage or a local database, combined with the document management module 3, such as SharePoint, Confluence, or a custom-developed database for centralized storage.

[0047] Documents can be classified by project, test type, status, etc. and tagged. Metadata management is adopted to allow users to add keywords and tags to documents for quick retrieval through search engines. Different user roles and permissions can also be set. Role-based permission control (RBAC) can be used to manage user access rights to documents to ensure that only authorized users can access, modify or delete specific documents. 1.4 Document update and version control.

[0048] The document management module 3 will automatically record each update of the document and generate a version history, so that users can view and restore to previous versions. Use version control tools such as Git and SVN, or build a version control function in the document management module 3 to record the time, user and specific changes of each modification.

[0049] The document modification in the prior art usually relies on manual recording of versions and changes, which is prone to errors and time-consuming. The document management module 3 of the present invention automatically records the modification history and version information of the document, reduces human errors, and improves the reliability of information.

[0050] Phase management module 4 divides the test process into multiple phases, including test requirement confirmation, program formulation, environment preparation, test execution, result analysis and review, report generation, data archiving, etc. Each phase can be personalized according to the specific needs of the chip to ensure that the test process meets the specific requirements of the chip, especially domestic chips. Real-time recording and data traceability functions ensure the integrity and accuracy of test data and provide a reliable basis for problem analysis and subsequent testing.

[0051] In a preferred embodiment, it also includes a mobile application module 51, which is arranged in the mobile device 5. The mobile device 5 is connected to the solution module 1, the requirement module 2, the stage management module 4 and the test module 6 through the mobile application module 51, and is used to monitor the test progress, manage the test plan and submit the test results on the mobile device 5, and analyze the test results.

[0052] A significant drawback of existing test management platforms is the lack of support for mobile terminals. Since the test platform is mainly designed for desktop terminals, testers cannot operate anytime and anywhere through mobile devices. This limitation greatly limits the flexibility and efficiency of testing work in modern testing environments, especially in scenarios that require rapid response or handling of emergencies.

[0053] The present invention designs a special mobile application module 51, which enables testers to monitor test progress, manage test tasks, submit test results, and perform data analysis in real time through smart phones or tablet computers. The mobile support function of the present invention improves the flexibility and response speed of test task execution and meets the needs of modern work scenarios for mobile office.

[0054] Mobile applications not only simplify the testing process, but also allow testers to efficiently perform testing tasks at any time and any place, greatly improving the flexibility and responsiveness of testing work. Responsive design and adaptive layout technology are used to ensure that the user experience of the application is consistent on different mobile devices5, such as smartphones and tablets.

[0055] Existing APP development uses native development methods or single platform development, resulting in high development and maintenance costs. The present invention uses a cross-platform framework to improve development efficiency and cross-platform compatibility. It allows some functions to be available in a network-free environment, improves the availability and user experience of the application, and solves the network dependency problem of traditional applications. The use of modern cross-platform technology reduces development and maintenance costs while providing a consistent user experience.

[0056] The mobile application module 51 adopts a modular design, allowing different functional modules to be independently developed, tested and updated. It supports maintenance and expansion, which facilitates subsequent functional iteration. The application is based on a service-oriented architecture, allowing each function to interact through an API. The mobile application module 51 has real-time data processing capabilities and can quickly feedback test progress and test results. In addition, the mobile application module 51 of the present invention adopts cross-platform development. The program adopts modern cross-platform frameworks such as Flutter and React Native, so that a code base can support multiple operating systems such as iOS and Android, reducing development and maintenance costs.

[0057] In a preferred embodiment, it also includes an enterprise communication module 8, a connection solution module 1, a requirement module 2, a phase management module 4 and a test module 6, which are used to generate and distribute test project reports to testers, and issue test task notifications, task assignment information and team collaboration information to testers.

[0058] Existing testing platforms are usually not integrated with modern enterprise communication tools, such as Lark. This results in reliance on traditional email or manual methods for notifications and task coordination, making it impossible to achieve instant communication and efficient collaboration, and increasing the complexity of project management and task execution.

[0059] The platform of the present invention is deeply integrated with Feishu, supporting functions such as instant notification, task assignment, and team collaboration. Through the enterprise communication module 8, testers can receive updates and notifications of test tasks in real time, communicate and collaborate across departments, reduce delays in information transmission, and improve the coordination and efficiency of test work. In addition, the enterprise communication module 8 also supports automated report generation and distribution, simplifying the project management process. It not only includes basic notification and collaboration functions, but also realizes automated report generation and intelligent task assignment, reducing manual intervention and errors, and improving work efficiency.

[0060] The invention has clear division of roles, and the collaborative work of each role is effectively supported. The task allocation and tracking function improves the visual management and execution efficiency of the test tasks, ensuring that the test project is completed smoothly as planned.

[0061] In a preferred embodiment, the solution module 1, the requirement module 2, the stage management module 4 and the test module 6 run independently of each other. The chip test management platform also includes a user interface for interaction. The backend service architecture of the chip test management platform adopts a microservice framework, the front end is developed using the React or Vue.js front-end framework and component library, and the database adopts an SQLite or NoSQL database.

[0062] The existing test management platform is rich in functions but has a large structure, which leads to high system resource consumption, high operational complexity, and a steep learning curve. Users need to spend a lot of time to adapt to the platform system's operating interface and functions. In addition, the huge system architecture also leads to increased deployment and maintenance costs, and cannot meet the rapidly changing testing needs.

[0063] Specifically, the present invention adopts a lightweight architecture design, focusing on the optimization of key functional modules, and avoiding overly complex functional stacking. The present invention divides the functions into several independent modules, such as solution module 1, requirement module 2, and stage management module 4, each of which is responsible for specific functions, such as test management, data analysis, report generation, etc. The modular design and flexible version management mechanism enable the platform to have good scalability and maintainability, reducing the long-term operating cost of the platform; the present invention provides a more concise and intuitive user interface, reduces the learning curve, and allows users to quickly get started. Compared with traditional lightweight applications, the present invention further optimizes the operating experience in user interface design. Functional modules can be independently developed, tested and deployed. Through modular design, the platform can tailor functions according to specific needs, reducing the resource occupation and operation complexity of the platform, making the platform easier to deploy and maintain. At the same time, the user interface design is simple and intuitive, reducing the learning curve, and users can quickly get started.

[0064] The present invention adopts a lightweight background service architecture and uses efficient microservice frameworks such as Spring Boot and Node.js to process requests to ensure platform performance and response speed.

[0065] The front-end is developed using modern front-end frameworks such as React, Vue.js and component libraries, which streamlines the page structure and resource loading, and improves page loading speed and user experience.

[0066] Use lightweight databases such as SQLite and NoSQL to manage data storage and access, reducing dependence on heavy databases and reducing platform resource consumption.

[0067] In a preferred embodiment, it also includes a reasoning capability evaluation module 71, which is connected to a test module 6. The reasoning capability evaluation module 71 is provided with a benchmark test set optimized according to the characteristics of the chip. The benchmark test set includes test data and test cases adapted to the chip. The test module 6 performs tests on the chip according to the benchmark test set.

[0068] The present invention introduces the reasoning capability evaluation module 71 as a high-precision reasoning capability evaluation tool, which can perform detailed tests on the reasoning performance of the GPU when processing large-scale models. By using the self-developed reasoning capability evaluation module 71, the present invention can accurately evaluate the reasoning speed, accuracy and energy consumption of specific large models such as Transformer, BERT, etc. under different computing power configurations. It supports dynamic adjustment of GPU computing power configuration, automatically generates reasoning performance comparison reports under multiple scenarios, and integrates an adaptive optimization algorithm based on deep learning.

[0069] In the prior art, benchmark test sets are usually general test tools and data sets, which may not be optimized for the type of chip to be tested, such as domestic AI chips. Therefore, the test results may not fully reflect the performance of domestic chips in actual applications. The present invention integrates a benchmark test set designed specifically for domestic AI chips.

[0070] The benchmark test set includes benchmark test data and algorithms optimized for the characteristics of domestic chips, ensuring that the test results can accurately reflect the performance of the chip in different application scenarios. For example, through test cases customized for the computing power characteristics of domestic chips, more targeted performance data can be provided. By cooperating with domestic chip manufacturers, a special benchmark test set is developed, including test data and algorithms for specific hardware characteristics. The present invention optimizes domestic chips in terms of benchmark test sets and deep learning framework support to ensure the practical applicability of test results.

[0071] In a preferred embodiment, it also includes a computing power cluster performance test module 72 and a connection test module 6. The computing power cluster performance test module 72 is used to dynamically allocate loads and monitor performance in real time, simulate the computing power requirements of real scenarios and generate a performance bottleneck analysis report.

[0072] Specifically, the platform provides a comprehensive computing cluster performance test module 72, which can evaluate the processing power, scalability and stability of the cluster under different load conditions. The computing cluster performance test integrates optimized versions of various AI training frameworks such as TensorFlow and PyTorch, and can automatically generate trend charts and bottleneck analysis reports for various performance indicators.

[0073] The computing power cluster performance test module 72 adopts dynamic load distribution and real-time performance monitoring technology. Compared with the existing technology, it can more accurately simulate the computing power requirements in real application scenarios and provide a detailed performance bottleneck analysis report.

[0074] Dynamic load distribution analyzes the load of the cluster in real time and automatically adjusts the load distribution strategy to adapt to load fluctuations and changes in node status. It improves the processing capacity and stability of the cluster and ensures performance stability under different load conditions.

[0075] The existing technology lacks detailed records and trend analysis of historical data, making it difficult to evaluate long-term performance. The real-time performance monitoring of the computing cluster performance test module 72 not only tracks current performance, but also records historical data and generates trend graphs. This enables the present invention to perform long-term performance analysis, identify potential performance degradation trends, and provide a basis for future optimization.

[0076] Dynamic load distribution is an intelligent resource management method that automatically adjusts the task allocation strategy by real-time monitoring and analyzing the load status of the cluster to optimize resource utilization and improve the overall performance of the cluster. It is possible to identify load peaks and troughs based on real-time data, thereby dynamically adjusting the distribution of workloads. The present invention can quickly adjust itself when the load fluctuates and the node status changes, ensuring efficient use of resources under high or low load conditions. Through continuous performance monitoring and historical data accumulation, the load distribution strategy can be gradually optimized to cope with future load patterns. Real-time performance monitoring is the ability to comprehensively monitor the computing power cluster, track test performance in real time, and record historical data. Combined with current performance indicators, predictive generation of trend graphs and reports, it is possible to record detailed historical data and generate trend graphs, thereby supporting long-term performance analysis and helping to discover potential causes of performance degradation.

[0077] In a preferred embodiment, it also includes a computing power evaluation and monitoring module 73, which is connected to the test module 6. The computing power evaluation and monitoring module 73 is also used to monitor and capture the hardware indicators of the chip in real time, and evaluate the hardware performance of the chip according to preset test standards.

[0078] Specifically, the present invention has developed an advanced computing power evaluation and monitoring module 73 that can comprehensively evaluate the hardware based on recognized AI benchmarks. The computing power evaluation and monitoring module 73 has real-time monitoring capabilities and can capture key indicators of hardware status, such as temperature, power consumption, and computing speed. Through continuous data analysis, the computing power evaluation and monitoring module 73 can warn of potential stability issues in the hardware and provide a more detailed long-term stability assessment compared to the prior art.

[0079] The test module 6 of the present invention is an automated test script and tool that can simulate multiple workloads and perform comprehensive performance and functional testing on AI chip hardware. The test results are obtained by testing through preset test cases and test processes, which greatly improves the test efficiency and the speed of problem discovery compared to traditional manual testing methods. Test module 6 supports scripted test case generation, can automatically execute multiple test types including stress testing and functional testing, and supports one-click regression testing to ensure the stability of software and hardware. The implementation of test module 6 includes the following steps: Step 1: Design phase: determine the test requirements and clarify the test objectives, scope, and use cases. For example, test the performance, functionality, or stability of AI hardware. Select scripting language and framework: Select a scripting language such as Python and a test framework such as pytest to develop scripts to ensure the flexibility and maintainability of the scripts.

[0080] Step 2, script development, write standardized preset test cases, test cases cover various test scenarios, such as performance testing, functional testing. Test cases should include test steps, expected results and test data.

[0081] Step 3: Modular design: split the test cases into different modules. Each module is responsible for a specific test task. Modular design facilitates code reuse and maintenance.

[0082] Step 4, automated execution, automatically runs the test scripts through the scheduling test module 6 without manual intervention. Tests can be triggered based on time or events.

[0083] Step 5, result recording, the test module 6 automatically collects the test results and stores the results in a database for subsequent analysis; Step 6, Generate Report, automatically generate a test report containing test results, performance indicators and problem logs, and the report can be viewed and downloaded through the user interface.

[0084] Step 7, maintenance and expansion, update or add new test cases according to changes in requirements or new test objectives, expand functions, add new functions to test scripts or support more test scenarios to ensure the comprehensiveness and accuracy of the test.

[0085] In a specific embodiment, Figure 2 As shown, the chip test management method applied to the chip test management platform of the present invention includes: Step S1, in the solution module 1, first select an applicable solution template, and input the test target, such as the multi-threaded processing capability of the processor, and generate a test solution based on the input content.

[0086] Step S2, in the requirement module 2, further refine the test requirements, such as measuring the processor performance and power consumption in a multi-threaded environment, and assign a priority to each requirement, generate a requirement document, and associate it with the test solution in the solution module 1.

[0087] Step S3, upload relevant technical documents, test reports and test results in the document management module 3. The document management module 3 supports multiple document formats, such as PDF, DOCX, etc., and provides document version control and permission setting functions.

[0088] Step S4, in the stage management module 4, set the task content of each stage according to the test process, such as environment preparation, test execution, result analysis, etc., and track the progress of each stage, generate interim reports, and summarize and generate the final test report.

[0089] Step S5, during the test process, the user accesses the platform through the mobile device 5, checks the progress, uploads the test results, and receives task reminders and feedback through the enterprise communication module 8, ensuring that the test work is timely and efficient.

[0090] The above description is only a preferred embodiment of the present invention, and does not limit the implementation mode and protection scope of the present invention. For those skilled in the art, it should be aware that all solutions obtained by equivalent substitutions and obvious changes made using the description and illustrations of the present invention should be included in the protection scope of the present invention.

Claims

1. A chip test management platform, characterized in that: The system comprises a scheme module (1) for setting test objectives, test steps and expected results to form a test scheme; a requirement module (2) connected to the scheme module (1) for initiating and managing test requirements, generating a requirement document and associating the requirement document with the test scheme; and a phase management module (4) connected to the requirement module (2) for dividing the flow of the test scheme into a plurality of test phases, each of the test phases being adaptively configured based on the characteristics of the chip to be tested and generating phase tasks; A test module (6) is connected to the stage management module (4) and is used to perform a test on the chip to be tested according to the stage task simulation workload and output a test result.

2. The chip test management platform according to claim 1, characterized in that: The solution module (1) comprises a test target definition unit (11) for setting the test target; a test step definition unit (12) connected to the test target definition unit (11) for setting the test step, wherein the test step at least comprises a step sequence, input data and an execution condition; an expected result definition unit (13) connected to the test step definition unit (12) for setting the expected result for each test step, wherein the expected result at least comprises expected performance data, an output format and an error handling condition; and a risk assessment unit (14) connected to the test target definition unit (11), the test step definition unit (12) and the expected result definition unit (13) for acquiring the test target, the test step and the expected result, identifying risks using a preset risk assessment standard, and outputting a risk identification result. The solution module (1) also includes an editing interface for visually arranging and obtaining the test solution.

3. The chip test management platform according to claim 1, characterized in that: The requirement module (2) includes a requirement analysis module (21) for receiving the test requirement and generating a formatted requirement document; a priority management unit (22) connected to the requirement analysis module (21) for assigning priorities to the test requirements and associating them with the test plan; and a progress tracking unit (23) connected to the priority management unit (22) for displaying the test completion progress of the test plan through visual progress.

4. The chip test management platform according to claim 1, characterized in that: It also includes a document management module (3), connected to the test module (6), and used to manage the test documents uploaded and generated during the test process, wherein the test documents at least include the test plan, the test report and the test result analysis document; The phase management module (4) is also used to track the test status of each phase task, generate a phase report, and form the test report after aggregation; the content of the test result analysis document at least includes the expected result and the verification matching result of the test result.

5. The chip test management platform according to claim 1, characterized in that: The mobile device (5) further comprises a mobile application module (51) which is arranged in the mobile device (5). The mobile device (5) is connected to the solution module (1), the requirement module (2), the phase management module (4) and the test module (6) via the mobile application module (51) and is used for monitoring the test progress, managing the test solution and submitting the test results on the mobile device (5), and analyzing the test results.

6. The chip test management platform according to claim 1, characterized in that: It also includes an enterprise communication module (8) that connects the solution module (1), the requirement module (2), the stage management module (4) and the test module (6) and is used to generate and distribute test project reports to testers, and to issue test task notifications, task assignment information and team collaboration information to testers.

7. The chip test management platform according to claim 1, characterized in that: The solution module (1), the requirement module (2), the stage management module (4) and the test module (6) operate independently of each other. The chip test management platform also includes a user interface for interaction. The backend service architecture of the chip test management platform adopts a microservice framework, the front end is developed using a React or Vue.js front end framework and a component library, and the database adopts an SQLite or NoSQL database.

8. The chip test management platform according to claim 1, characterized in that: It also includes a reasoning capability evaluation module (71) connected to the test module (6), wherein the reasoning capability evaluation module (71) is provided with a benchmark test set optimized according to the characteristics of the chip to be tested, wherein the benchmark test set includes test data and test cases adapted to the chip to be tested, and the test module (6) performs a test on the chip to be tested according to the benchmark test set.

9. The chip test management platform according to claim 1, characterized in that: It also includes a computing power cluster performance test module (72) connected to the test module (6), and the computing power cluster performance test module (72) is used to dynamically allocate loads and monitor performance in real time, simulate the computing power requirements of real scenarios and generate a performance bottleneck analysis report.

10. The chip test management platform according to claim 1, characterized in that: It also includes a computing power evaluation and monitoring module (73) connected to the test module (6), and the computing power evaluation and monitoring module (73) is also used to monitor and capture the hardware indicators of the chip to be tested in real time, and evaluate the hardware performance of the chip to be tested according to a preset test standard.

Images