Software interface evaluation method and system based on computer automatic comparison technology
Through the software interface evaluation method based on computer automatic comparison technology, the layout and content evaluation are automatically performed, and the problems of low evaluation efficiency and poor objectivity in the existing technology are solved, and efficient and objective software interface design evaluation is achieved.
Patent Information
- Application Number
- CN202411953626.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-27
- Publication Date
- 2025-03-28
AI Technical Summary
In the prior art, the evaluation of software interface design mainly relies on human judgment, and there are problems of low efficiency and poor objectivity, especially when facing dynamically changing interfaces, it is difficult to accurately judge whether they meet the standards.
The evaluation method based on computer automatic comparison technology is adopted. By dividing the software interface into set areas, the pixel color is extracted and compared with the standard color, and the layout evaluation is performed; at the same time, the interface content, such as text, values, and curves, are automatically extracted, and compared with the standard template, and the content evaluation is performed.
The automatic layout and content evaluation of the software interface are realized, the efficiency and objectivity of evaluation are improved, the subjectivity of human judgment is reduced, and the visual fatigue of the judges is reduced.
Smart Images
Figure CN119718320A_ABST
Abstract
Description
Technical Field
[0001] The invention relates to a software interface evaluation method and system based on computer automatic comparison technology, belonging to the field of teaching evaluation. Background Art
[0002] In teaching, teachers will assign students topics related to software interface design. The topics include some standards that students must meet. The standards will specify the colors, text, numbers, and dynamically changing parts of certain locations in the interface. In software development, the design of the software interface is a crucial link. A good software interface can enhance the user experience.
[0003] At present, when students submit their own designed software interfaces, teachers need to use their naked eyes to judge whether the software interfaces designed by students meet the standards they set. Therefore, there are misjudgments and low efficiency; especially when facing the dynamically changing parts of the interface, it is even more difficult to judge whether it meets the standards. Especially in competitions related to software design, the current evaluation of software interfaces is mainly done by judges to manually judge whether the interface design meets the requirements. The evaluation of software interfaces is subjective and inefficient, especially when judges review too many interfaces, which will increase the visual fatigue of judges and further affect the objectivity of the evaluation. Summary of the invention
[0004] The purpose of the present invention is to provide a method and system for evaluating software interfaces based on computer automatic comparison technology, so as to solve the problems of low efficiency and poor objectivity caused by manual evaluation of software interfaces.
[0005] To achieve the above object, the solution of the present invention includes: The present invention discloses a method for evaluating a software interface based on computer automatic comparison technology, comprising the following steps: dividing a software interface to be evaluated into a set number of regions, extracting the colors of a set number of pixel points in each region, comparing the extracted colors with corresponding set standard colors, and if they are consistent, performing at least one of content evaluations including text judgment, numerical judgment and curve judgment; the process of text judgment and numerical judgment comprises: intercepting a picture of a set position of the software interface, identifying the text and numerical values in the picture, respectively comparing the identified text and numerical values with the corresponding set standard text and standard numerical values, and evaluating according to the comparison result; the process of curve judgment comprises: extracting a curve of a set position of the software interface, calculating the distance between the extracted curve and a predetermined standard curve in the same coordinate system, and evaluating according to the obtained distance.
[0006] Furthermore, content evaluation also includes dynamic change judgment, and the process of dynamic change judgment includes: obtaining color data at multiple moments of the change position set in the software interface within a set time window, converting the color data into a time series data set, judging whether there is periodic change in the color in the time series data set, and evaluating according to the judgment result; the time window is greater than the duration of the periodic change of the set change position.
[0007] Furthermore, if the color extracted from a region is inconsistent with the corresponding set standard color, the software interface layout is determined to be unqualified.
[0008] Furthermore, the software interface to be evaluated is divided into a set number of areas in equal proportion.
[0009] Furthermore, when the software interface to be evaluated contains at least two of text, numerical values and curves, a comprehensive evaluation is also performed based on the evaluation results of each category, that is, the comprehensive evaluation result is used as the final evaluation result of the software interface to be evaluated.
[0010] Furthermore, the Fréchet distance algorithm is used to calculate whether the distance between the extracted curve and the set standard curve is within a set error range.
[0011] Furthermore, use image recognition libraries or machine learning models to extract text, numbers, and curves.
[0012] A software interface evaluation system based on computer automatic comparison technology comprises a processor, and the processor executes a computer program to implement the steps of the software interface evaluation method based on computer automatic comparison technology as described above.
[0013] The beneficial effects of the present invention are as follows: the present invention is a pioneering invention, and the present invention divides the evaluation process into layout evaluation and content evaluation. Among them, the layout evaluation is realized by comparing the pixel color of the set area of the software interface to be evaluated with the predetermined standard color, and the comparison can be automatically realized by computer; the content evaluation is realized by automatically extracting the content of the set position of the software interface and automatically comparing the content extraction result with the standard template. Therefore, the present invention can automatically evaluate the layout and content of the software interface to be evaluated, effectively improving the efficiency and objectivity of the evaluation. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] Figure 1 It is a schematic diagram of a color judgment process of the present invention; Figure 2 It is a flow chart of character judgment of the present invention; Figure 3 It is a schematic diagram of a curve judgment process of the present invention; Figure 4 It is a schematic diagram of the distance between two curves of the present invention; Figure 5 It is a schematic diagram of a dynamic change judgment flow chart of the present invention. DETAILED DESCRIPTION
[0015] In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments.
[0016] The idea of the present invention is that, since the topic assigned by the teacher includes the content that the students must complete, that is, there is a standard template, the content of a specific position of the software interface is extracted, and the extracted content is compared with the standard template, so that it can automatically identify whether the design of the software interface meets the requirements. The present invention first performs layout judgment, and then judges the interface content after the layout is qualified.
[0017] Method Example: This embodiment provides a method for evaluating a software interface based on computer automatic comparison technology. The judgment of the software interface includes layout judgment and content judgment. Among them, layout judgment includes color judgment, and content judgment includes at least one of text judgment, numerical judgment and curve judgment. For efficiency considerations, if the layout of the software interface does not meet the requirements, there is no need to evaluate the content. Therefore, if the color judgment fails, the software interface layout is directly considered unqualified. The process of color judgment is as follows: Figure 1 As shown, it includes: capturing the entire interface image of the software interface to be evaluated, and dividing the image into a set number of regions, for example, nine regions, and then extracting the colors corresponding to the set number of set pixels in each region, and comparing the extracted color of each pixel with the pre-set color corresponding to the pixel. If they are consistent, it means that the layout of the current software interface is qualified, and then the specific content in the software interface can be evaluated; otherwise, it is determined that the layout of the current software interface is unqualified, and then the interface content is not evaluated. Based on standardization considerations, the image is divided into a set number of regions in equal proportion.
[0018] A general software interface will contain text, numerical values, dynamically changing parts and curve contents. Therefore, it is necessary to make corresponding evaluations based on the contents contained in the software interface. Therefore, content evaluation includes at least one of text judgment, numerical judgment, dynamic change judgment and curve judgment.
[0019] When evaluating the content of the software interface, in order to conduct a comprehensive evaluation, it is necessary to evaluate all the contents contained in the current software interface. For example, if there are text, numerical values, dynamically changing parts and curves in the software interface, it is necessary to judge the text, numerical values, dynamically changing parts and curves. Among them, the process of text judgment and numerical judgment includes: intercepting a picture of the set position and size of the software interface, extracting the text content and numerical content in the picture, and comparing the extracted text content and numerical content with the corresponding set standard text and standard numerical value, respectively, and evaluating according to the comparison result. If the two are consistent, it means that the part is qualified, and then a qualified score is given; if they are inconsistent, a score is given according to the degree of difference. For example, if the extracted text is only one word different from the standard text, a score lower than but close to qualified is given. Since the process of text judgment and numerical judgment is basically the same, except that the extracted content is different, this embodiment only provides a flowchart of text judgment. The flowchart is as shown in the figure. Figure 2 shown.
[0020] The process of curve judgment is as follows Figure 3 As shown, it includes: capturing a picture of the position and size set in the software interface, extracting the curve data in the picture, and judging whether the distance between the extracted curve and the predetermined standard curve is within the set error range in the same coordinate system. If so, an evaluation is performed based on the distance between the two curves. For example, the smaller the distance, the higher the score. The positional relationship between the extracted curve and the standard curve is shown in FIG. Figure 4 As shown, it should be noted that the extracted curve can be located above or below the standard curve. The Frechet Distance algorithm is used to calculate whether the distance between the two curves is within the set error range.
[0021] When judging the distance between the extracted curve and the predetermined standard curve, several key points with the same coordinates in the two curves can be selected, and the distances of the two curves can be compared to determine whether the distances are within the error range. For example, three key points are selected. When all three key points are outside the error range, the curve is judged to be numerically wrong, and the score for this part is 0.
[0022] The process of dynamic change judgment is as follows Figure 5As shown, it includes: obtaining the color data of multiple moments of the change position set in the software interface within the set time window, and then converting the color data into a time series data set, and then judging whether there is a periodic change in the color in the time series data set, and evaluating according to the judgment result. The time window should be set to be greater than the duration of the periodic change of the set change position (monitoring duration). Among them, the number of set change positions is set according to the specific situation, but in the case of multiple positions, it should be noted that the duration of the periodic change of each position may be different, so the setting of the time window also needs to be synchronized according to the actual change.
[0023] The following is a specific example to illustrate the process of dynamic change judgment: There is a communication light that flashes periodically at a certain setting change position of the software interface to be evaluated. For example, the communication light changes from red to green for 1 second, and then changes from green back to red for 1 second, that is, the communication light changes periodically for at least 2 seconds. In order to accurately determine whether the communication light changes periodically, the time window set for this position should be greater than 2 seconds, and then the color data of the location where the communication light is located is collected at least three times, and the sampling time interval for each time is also about 1 second, to ensure that at least part of the color data collected at each moment is in different periods, so that it can be determined whether the color changes periodically based on the color data at these different moments.
[0024] Specifically, this embodiment uses time series analysis technology to make judgments, converts the color data obtained at different times into a time series data set, and uses ACF (autocorrelation function) to calculate the correlation coefficient of different sampling times in the time series data set, and then judges whether there is a periodic change in color based on the correlation coefficient. If so, it means that the part is qualified, and then a corresponding score is given; if not, the score is 0.
[0025] After executing text judgment, numerical judgment, dynamic change judgment and curve judgment, four corresponding evaluations (for example, scores) are obtained, and then these four evaluations are comprehensively evaluated. For example, the average of the four scores is taken as the comprehensive evaluation score of the software interface, and the scores can also be accumulated.
[0026] The present invention uses an image recognition library or a machine learning model to extract text, numbers and curves, wherein the image recognition library can adopt OpenCV, etc., and the machine learning model can adopt a convolutional neural network, etc., to capture and analyze screenshots of the software interface and the information in the screenshots.
[0027] System Example: This embodiment provides an evaluation system for software interfaces based on computer automatic comparison technology. The computer program executed by the processor in the system is designed using the method introduced in the method embodiment. Since the introduction of the method is clear enough, it will not be repeated here.
[0028] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention rather than to limit it. Although the present invention has been described in detail with reference to the above embodiments, ordinary technicians in the relevant field should understand that the specific implementation methods of the present invention can still be modified or replaced by equivalents. Any modification or equivalent replacement that does not depart from the spirit and scope of the present invention should be covered within the scope of protection of the claims of the present invention.
Claims
1. A method for evaluating software interface based on computer automatic comparison technology, characterized in that: The method comprises the following steps: dividing the software interface to be evaluated into a set number of areas, extracting the colors of a set number of pixel points in each area, comparing the extracted colors with the corresponding set standard colors, and if they are consistent, performing at least one of content evaluations including text judgment, numerical judgment and curve judgment; the text judgment and numerical judgment process comprises: capturing a picture of a set position of the software interface, identifying the text and numerical values in the picture, respectively comparing the identified text and numerical values with the corresponding set standard text and standard numerical values, and performing evaluation according to the comparison result; the curve judgment process comprises: extracting a curve of a set position of the software interface, calculating the distance between the extracted curve and a predetermined standard curve in the same coordinate system, and performing evaluation according to the obtained distance.
2. The method for evaluating software interface based on computer automatic comparison technology according to claim 1, characterized in that: The content evaluation also includes dynamic change judgment, and the process of dynamic change judgment includes: obtaining color data of multiple moments of the change position set in the software interface within a set time window, converting the color data into a time series data set, judging whether there is periodic change in the color in the time series data set, and evaluating according to the judgment result; the time window is greater than the duration of the periodic change of the set change position.
3. The software interface evaluation method based on computer automatic comparison technology according to claim 1 is characterized in that: If the color extracted from an area is inconsistent with the corresponding set standard color, the software interface layout is determined to be unqualified.
4. The method for evaluating software interface based on computer automatic comparison technology according to claim 1, characterized in that: Divide the software interface to be evaluated into a set number of areas in equal proportion.
5. The method for evaluating software interface based on computer automatic comparison technology according to claim 2, characterized in that: When the software interface to be evaluated contains at least two of text, numerical values, dynamically changing parts and curves, a comprehensive evaluation is also performed based on the evaluation results of each category, that is, the comprehensive evaluation result is used as the final evaluation result of the software interface to be evaluated.
6. The method for evaluating software interface based on computer automatic comparison technology according to claim 1, characterized in that: The Fréchet distance algorithm is used to calculate whether the distance between the extracted curve and the set standard curve is within the set error range.
7. The method for evaluating software interface based on computer automatic comparison technology according to claim 1, characterized in that: Use image recognition libraries or machine learning models to extract text, numbers, and curves.
8. A software interface evaluation system based on computer automatic comparison technology, comprising a processor, characterized in that: The processor executes the computer program to implement the steps of the software interface evaluation method based on computer automatic comparison technology as described in any one of claims 1 to 7.