2results about How to "Accurate performance assessment" patented technology

This application relates to the field of large language model technology, and discloses a method, apparatus, device, and storage medium for model performance optimization. The method includes: acquiring an initial dataset and expanding the problem using a large language model to obtain a target dataset; converting the problem into an actual database query statement using the large language model; performing data queries based on the actual database query statement and a reference database query statement to obtain actual query results and reference query results; evaluating the performance of the large language model based on the reference database query statement, the actual database query statement, the reference query results, and the actual query results to obtain a model performance score; and optimizing the large language model based on the model performance score and the target dataset to obtain an optimized large language model. This application improves the accuracy of SQL statement conversion by increasing the data richness of the dataset, thereby enabling accurate performance evaluation of the large language model.

This invention discloses a method and system for evaluating the performance of damping and thermal insulation materials for battery packs, relating to the field of battery pack thermal management technology. The method includes: extracting a calibration sample set; applying transient thermal excitation and acquiring infrared thermographic sequences to extract thermal response features; performing industrial CT scans to obtain defect quantification indicators, which, together with the thermal response features, form a calibration dataset; establishing a quantitative correlation model based on the calibration dataset and determining batch quality thresholds according to the model output distribution; performing the same excitation and acquisition on online test samples to extract their features, inputting them into the model to obtain defect quantification prediction values, comparing them with the batch quality thresholds, and outputting the evaluation results; and supplementing the model and thresholds by extracting new samples and obtaining new calibration data when a preset period or trigger condition is met. This invention provides accurate material performance evaluation by establishing a quantitative model of thermal response features and defect quantification indicators, and enhances the consistency and stability of the evaluation through a dynamic update mechanism.