Software quality evaluation and ranking method, system and device
By obtaining the interface quality characteristics of the software interface, calculating the global quality score of the software, the problem of lack of software globalization evaluation standards in the existing technology is solved, and the quantitative and visual display of the globalization quality of the software is realized, and software globalization is provided. An intuitive assessment of the status quo.
Patent Information
- Application Number
- CN201910965604.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-10-12
- Publication Date
- 2024-11-05
- Estimated Expiration
- 2039-10-12
AI Technical Summary
The existing technology lacks evaluation standards for the level of software globalization, and cannot fully understand the current globalization of software, especially in supporting the needs of multiple languages and regions.
By obtaining the interface quality characteristics of the software interface, including content quality characteristics and display quality characteristics, calculate the scores of each feature, and calculate the quality scores of the software based on these scores, provide global quality quantification standards, and summarize the global quality of each software Quantify the value of mass and visually present it.
It has achieved a comprehensive and intuitive display of the quality of software globalization, provided relevant personnel with an accurate assessment of the current status of software globalization, and helped relevant personnel understand the globalization maturity of software.
Smart Images

Figure CN112650664B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a testing field, and in particular to a method, system and device for software quality evaluation and ranking. Background Art
[0002] As globalization progresses, software is also facing the problem of global deployment. In addition to supporting domestic users, various software also need to be able to support multiple languages and regions. In the existing technology, there is a lack of evaluation standards for the globalization level of various software, and relevant personnel cannot fully understand the globalization status of various software.
[0003] To this end, a solution that accurately reflects software quality is needed. Summary of the invention
[0004] A technical problem to be solved by the present disclosure is to provide a software quality evaluation scheme, which quantifies the quality of software, for example, globalization quality, by acquiring features in two dimensions: content and display. Furthermore, the globalization quality quantification values of various software can be summarized and visualized, thereby providing relevant personnel with a comprehensive and intuitive display of the current status of software globalization.
[0005] According to the first aspect of the present disclosure, a software quality evaluation method is provided, comprising: obtaining interface quality features of the software interface, the interface quality features including at least one of content quality features and display quality features; calculating a feature score for each of the at least one feature; and calculating a quality score for the software according to the feature score. The interface quality features may be interface globalization quality features. Thus, a quantitative standard is provided for the globalization quality of the software. The software may be an application installed on a client, or a cloud application.
[0006] Optionally, the interface globalization quality feature may include at least one of the following: at least one interface localization quality feature; and an interface localization switching quality feature. The content quality feature may include a language content quality feature and a content format quality feature, and the display quality feature may include an interface presentation quality feature and an interface interaction quality feature.
[0007] Specifically, the interface quality characteristics include at least two of the language content quality characteristics, content format quality characteristics, interface presentation quality characteristics and interface interaction quality characteristics, and the method may also include: assigning a feature weight to each of the at least two characteristics, wherein the quality score of the software is calculated by weighting the feature scores of the at least two characteristics.
[0008] Optionally, calculating the feature score of each of the at least one feature includes: calculating the feature score deducted for each of the at least one feature, and calculating the quality score of the software based on the feature score includes: subtracting the feature score deducted for each item from a predetermined score to obtain the quality score of the software. Calculating the feature score deducted for each of the at least one feature includes: determining the severity of the defect of each feature; and calculating the corresponding deducted feature score based on the severity of the defect. Thus, the software quality can be assessed by the severity of the defect.
[0009] Optionally, the method may further include: rating the complexity of the software, and calculating the quality score of the software includes: for the same defect, deducting a smaller feature score for software with higher complexity.
[0010] According to a second aspect of the present disclosure, a method for ranking the quality of multiple software is provided, comprising: using the software quality evaluation method as described in any one of the above items to assess the quality score for each of the multiple software; and ranking the multiple software using the quality score as a ranking basis.
[0011] Specifically, the software may be sorted according to the feature scores of the content quality feature and the display quality feature, for example, the quality scores of the plurality of software may be visually sorted on a two-dimensional image with the feature scores of the content quality feature and the display quality feature as one dimension.
[0012] According to a third aspect of the present disclosure, a software quality evaluation system is provided, which is used to: obtain software that needs to be quality evaluated; and calculate the quality score of the software using the software quality evaluation method according to any one of the above items.
[0013] Optionally, it is possible to receive a software program uploaded by a user; receive a software download link submitted by a user; or capture the interface of the software as a cloud application.
[0014] Optionally, the system can also be used to: provide modification suggestions for the software.
[0015] Optionally, the system may also be a software quality ranking system, used for: obtaining a plurality of software that require quality evaluation; and ranking the plurality of software using the software quality ranking method according to any one of the above items.
[0016] According to a fourth aspect of the present disclosure, a software quality evaluation device is provided, comprising: a feature acquisition unit, configured to acquire an interface quality feature of the software interface, wherein the interface quality feature comprises at least one of a content quality feature and a display quality feature; an item feature score calculation unit, configured to calculate a feature score of each of the at least one feature; and
[0017] A software quality score calculation unit is used to calculate the quality score of the software according to the feature score.
[0018] Optionally, the interface quality feature is an interface globalization quality feature, and the interface globalization quality feature includes at least one of the following: at least one interface localization quality feature; and an interface localization switching quality feature.
[0019] The content quality features may include language content quality features and content format quality features, the display quality features may include interface presentation quality features and interface interaction quality features, and the interface quality features may include at least two of the language content quality features, the content format quality features, the interface presentation quality features and the interface interaction quality features, and the page quality score calculation unit is further used to: assign a feature weight to each of the at least two features; and calculate the quality score of the software by weighting the feature scores of the at least two features.
[0020] Optionally, the project feature score calculation unit is used to: determine the defect severity of each feature; based on the defect severity, calculate the feature score deducted for each of the at least one feature, and the software quality score calculation unit is used to: subtract the feature score deducted for each item from a predetermined score to obtain the quality score of the software.
[0021] Optionally, the apparatus may further include: a complexity rating unit, configured to rate the complexity of the software, and the software quality score calculation unit is configured to: for the same defect, deduct a smaller feature score from software with higher complexity.
[0022] Optionally, the apparatus may further include: a sorting unit, such as preferably a visualization unit, for visually sorting the quality scores of multiple software on a two-dimensional image with the feature score of the content quality feature and the feature score of the presentation quality feature as one dimension respectively.
[0023] According to a fifth aspect of the present disclosure, a computing device is provided, comprising: a processor; and a memory on which executable codes are stored, and when the executable codes are executed by the processor, the processor executes the method described in the first aspect above.
[0024] According to a sixth aspect of the present disclosure, a non-temporary machine-readable storage medium is provided, on which executable code is stored. When the executable code is executed by a processor of an electronic device, the processor executes the method described in the first aspect above.
[0025] Therefore, the present disclosure divides the globalization of software into two dimensions, namely, content and presentation, and further refines multiple sub-dimensions to quantify the globalization maturity of software with a formula. Furthermore, the globalization maturity of each software can be summarized and displayed in an intuitive way in a coordinate system. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] The above and other objects, features and advantages of the present disclosure will become more apparent through a more detailed description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, wherein like reference numerals generally represent like components in the exemplary embodiments of the present disclosure.
[0027] Figure 1 A schematic flow chart of a software quality evaluation method according to an embodiment of the present invention is shown.
[0028] Figure 2 An example in which the language cannot be switched is shown.
[0029] Figure 3 An example of a syntax error is shown.
[0030] Figure 4 shows a more significant translation quality flaw.
[0031] Figure 5 An example of missed translation is shown.
[0032] Figure 6 An example of an alternative language selection error is shown.
[0033] Figure 7 An example of a truncation problem is shown.
[0034] Figure 8 Examples of overflow and overlap problems are shown.
[0035] Fig. 9 An example of a misalignment problem is shown.
[0036] Fig.10 A visualization example of software maturity is shown.
[0037] Fig.11 A schematic diagram showing the composition of a software quality evaluation device according to the present invention is shown.
[0038] Fig.12A schematic diagram of the structure of a computing device that can be used to implement the above-mentioned software quality evaluation and ranking method according to an embodiment of the present invention is shown. DETAILED DESCRIPTION
[0039] The preferred embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the preferred embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to make the present disclosure more thorough and complete, and to fully convey the scope of the present disclosure to those skilled in the art.
[0040] As globalization progresses, software is also facing the problem of global deployment. In addition to supporting domestic users, various types of software also need to be able to support multiple languages and regions. In the existing technology, there is a lack of evaluation standards for the globalization level of software, and relevant personnel cannot fully understand the current status of software globalization.
[0041] To this end, the present invention proposes a software quality evaluation scheme, which quantifies the quality of the software interface, for example, the globalization quality, by acquiring features in two dimensions: content and display. Furthermore, the globalization quality quantification values of each software can be summarized and visualized, thereby providing relevant personnel with a comprehensive and intuitive display of the current status of software globalization.
[0042] Internationalization: refers to the process of designing and coding software to enable it to support multiple languages and regions. This includes support for Unicode characters, the ability to support multiple date formats and number formats, complete extraction and translatability of text (resource files), etc. Localization: refers to the translation of text (resource files) and / or documents from the source language to the target language. Globalization: refers to the sum of internationalization and localization. In the disclosure of the present invention, the global quality assessment of pages is not limited to the quality assessment of software (also referred to as "applications"), but can also be performed on websites that include interactive pages.
[0043] Figure 1 A schematic flow chart of a software quality evaluation method according to an embodiment of the present invention is shown. The method is particularly suitable for global testers to perform overall quality evaluation on software containing a large number of interfaces.
[0044] In step S110, the interface quality characteristics of the software interface are obtained. Here, the interface of the software refers to the instruction part of the software that is specially designed for users to operate, use and feedback information. The interface quality characteristics refer to the characteristics that represent the quality of the interface, and may include at least one of the content quality characteristics and the display quality characteristics. The content quality characteristics refer to the content quality of the page itself, for example, whether the language and various formats contained in the interface are correct. The display quality characteristics refer to the degree to which the content of the interface is correctly displayed, for example, whether there are defects in display and interaction. In the present invention, the interface quality characteristics may especially be interface globalization quality characteristics. However, in other embodiments, the interface quality characteristics may also be characteristics that characterize page quality from other perspectives.
[0045] In step S120, the feature score of each of the at least one feature is calculated, preferably, the feature scores of both the content quality feature and the presentation quality feature are calculated. In the present invention, the above content quality feature and presentation quality feature preferably each include a plurality of sub-features as described in detail below.
[0046] In step S130, the quality score of the software may be calculated according to the feature score, thereby quantifying the quality of the page and performing subsequent operations such as sorting.
[0047] In one embodiment, the interface quality feature is an interface globalization quality feature. The interface globalization quality feature is a feature that characterizes the globalization quality of the interface, that is, it characterizes the degree to which the interface supports multiple languages and regions. The interface globalization quality feature may include at least one interface localization quality feature, and / or an interface localization switching quality feature. Here, the interface localization quality feature may characterize the interface quality feature in a specific language. The interface localization switching quality feature may characterize the interface quality feature that can be switched between languages. When the interface (or the software to which the interface belongs as described below) only needs to support one language (e.g., English) other than the release language (e.g., Chinese), the English localization quality feature of the interface may be directly used to characterize the globalization quality feature of the page. When the interface (or the software to which the interface belongs as described below) needs to support at least two languages (e.g., English and Japanese) other than the release language (e.g., Chinese), the English and Japanese localization quality features of the interface (and further interface localization switching quality features) may be used to characterize the globalization quality feature of the software. When performing specific calculations, the feature value of each language may be calculated and subsequently weighted, for example; or the quality of each language may be comprehensively considered to obtain the feature value, which is not limited in the present invention.
[0048] In one embodiment, content quality features may include language content quality features and content format quality features. Language content quality features may be features that characterize the quality of the language itself, while content format quality features may be features that characterize the quality of the content in terms of format. Display quality features include interface presentation quality features and interface interaction quality features. Interface presentation quality features may be quality features that characterize the state presented by the interface, while interface interaction quality features may be quality features that characterize the interface when interacting with the user.
[0049] Therefore, the interface quality characteristics may include at least two of the language content quality characteristics, the content format quality characteristics, the interface presentation quality characteristics and the interface interaction quality characteristics, and the method may also include: assigning a feature weight to each of the at least two characteristics, wherein the quality score of the software is calculated by weighting the feature scores of the at least two characteristics.
[0050] In a preferred embodiment, the above features may further include sub-features to refine the assessment of software quality. Specifically, language content quality features may include at least one of the following: language switchability; language quality acceptability; translation completeness; alternative language accessibility; currency amount correctness; time data correctness. Content format quality features may include at least one of the following: format conforms to local habits; calendar conforms to local habits. Interface presentation quality features may include at least one of the following: interface element presentation correctness; interface elements conform to local habits. Interface interaction quality features may include at least one of the following: local character preservation; local character import / export; interactive elements conform to local habits; local sorting method support; local search method support.
[0051] When calculating feature scores, the features of each sub-dimension can be determined through interface content capture and machine interpretation, and corresponding scores can be given accordingly.
[0052] In one embodiment, a scoring method may be used, that is, each sub-dimension is given a corresponding high or low score according to its corresponding quality and weighted accumulation is performed, for example, to finally obtain an overall quality score of the interface.
[0053] In another embodiment, the deduction method can be used to calculate the overall quality score of the interface. The deduction method is applicable to situations with low tolerance for defects, and is therefore more suitable for use in the present invention. Thus, calculating the feature score of each of the at least one feature may include: calculating the feature score deducted for each of the at least one feature, and calculating the quality score of the software based on the feature score includes: subtracting the feature score deducted for each item from a predetermined score to obtain the quality score of the software.
[0054] Furthermore, calculating the feature score deducted for each of the at least one feature may include: determining the severity of the defect of each feature; and calculating the corresponding deducted feature score based on the severity of the defect.
[0055] As shown above, the interface is an interface belonging to the software and is an interface that needs to interact with the user. Therefore, calculating the quality score of the software may include: calculating the quality score of each interface contained in the software. In the case of using a deduction system, the calculation of the software quality score may summarize the situation of each sub-dimension of each interface in the object, and evaluate the degree of defects in the sub-dimension, and deduct the corresponding score.
[0056] Furthermore, the software may be graded for complexity. Calculating the quality score of the software includes: for the same defect, deducting a smaller feature score for software with higher complexity. In other words, for complex software, more defects can be tolerated.
[0057] Subsequently, the software globalization evaluation scheme of the present invention will be described in conjunction with an application example. The scheme divides software globalization into two dimensions: content (corresponding to the content quality characteristics above) and interaction (corresponding to the display quality characteristics above). The content dimension includes 8 sub-dimensions, and the interaction dimension includes 7 sub-dimensions. Based on the various details (sub-dimensions) of the two dimensions of content and interaction, this method can divide the globalization maturity of cloud products (software) into four levels: excellent, good, qualified, and unqualified. Among them, the content dimension is used to measure the maturity of capabilities such as language quality and data format; the interaction dimension is used to measure the maturity related to capabilities such as user interface and interaction design.
[0058] This method uses a deduction system to quantify the globalization maturity (i.e., globalization quality) of software using a formula. That is, at the beginning of the measurement, the default score of the product can be set to 100 points; if a defect is found, the corresponding score will be deducted according to the description of the measurement method.
[0059] Specifically, an excellent grade means that the product fully complies with local user habits, for example, the language content is accurate and the style is standardized; the page layout is standardized; the page features are in line with habits; the interaction methods are standardized, etc.
[0060] A good level means that local users can use the product without obstacles. For example, the language content is accurate and the style is basically standard; the page layout basically conforms to the standards; the page features basically conform to the habits; the interaction method basically conforms to the standards, etc.
[0061] The qualified level means that users can use the product and there are no defects that seriously block users from performing the next operation or mislead users and affect business. For example, the language content is basically accurate and the style is generally in line with the specifications; the page layout is generally in line with the specifications; the page features are generally in line with habits; the interaction method does not affect normal use, etc.
[0062] The unqualified level means that users who do not reach the qualified rating are rated unqualified. The unqualified rating means that users cannot use the product normally, for example, there are obvious language translation problems; there are obvious truncation and errors on the page; there are obvious defects in the page features; the interaction method does not conform to the user habits, etc.
[0063] The target product can be subjected to industry-standard black-box internationalization testing and language quality testing. After the test is completed, all defects are marked with severity (blocking, major, normal, and minor), and the category to which the defect belongs.
[0064] After labeling is completed, the target product can be scored according to certain rules.
[0065] The scoring rules are as follows:
[0066] 1. The rating is divided into two categories: content and interaction. Content includes 8 subcategories from 1.1 to 1.8 (described below), and a certain number of deductible points are assigned to each subcategory. For example, a total of a point can be deducted from the content category. Interaction includes 7 subcategories from 2.1 to 2.7 (described below), and a certain number of deductible points are assigned to each subcategory. For example, a total of b points can be deducted from the interaction category. In the case of a full score of 100 points, a+b=100.
[0067] 2. For any item, if there is a blocking defect, 8 points will be deducted initially; if there is a major defect, 4 points will be deducted initially; if there is a normal defect, 2 points will be deducted initially; if there is a minor defect, no points will be deducted.
[0068] Here, Blocking corresponds to a mass defect, which makes important functions or key functions unable to be used normally; Major corresponds to a major defect, which affects the normal use of the function and has a difficult solution; Normal corresponds to a conventional defect, which affects the normal use of the function and has an easy solution; Minor corresponds to a minor defect, which does not affect the normal use of the function.
[0069] Since the software usually includes multiple interfaces, when actually evaluating, points can be deducted for each defect on each interface until all the points of the corresponding sub-items are deducted; or the same or similar defects on different pages can be classified as one defect, and the corresponding points can be deducted only once. In specific applications, it can be set according to actual conditions, and the present invention does not limit this.
[0070] Final deduction for an entry = sum of initial deductions * weight / complexity (complexity can be 1 (simple product), 1.25 (ordinary product), 1.5 (complex product), 2 (extremely complex product). 1 is the least complex and 2 is the most complex.).
[0071] 3. Total score calculation method:
[0072]
[0073] in:
[0074] d is the sum of the points deducted for this item based on the acceptance test;
[0075] c is the complexity of the product;
[0076] m is the maximum number of points that can be deducted for this item.
[0077] As mentioned above, the content category includes 8 subcategories, and a certain deductible score is assigned to each subcategory, so a total of a points can be deducted from the content category. The interaction category includes 7 subcategories, and a certain deductible score is assigned to each subcategory, so a total of b points can be deducted from the interaction category. If the full score is 100, a+b=100.
[0078] Each subcategory entry is explained in detail below.
[0079] 1.1 Users can switch to their own language. This item corresponds to the language content quality feature sub-dimension in the content quality feature dimension, and is characterized by the switchability of the language. Figure 2 An example in which the language cannot be switched is shown. Figure 2 The interactive interface of a certain software is shown.
[0080] 1.2 The quality of the language seen by users is acceptable. This item corresponds to the language content quality characteristics sub-dimension in the content quality characteristics dimension and is characterized by the acceptability of language quality.
[0081] Acceptable quality means that the language quality of the product should meet the language quality standards. This includes but is not limited to accurate descriptions, no grammatical errors, language style that complies with standards, and accurate use of terminology. Figure 3 An example of a syntax error is shown. Figure 3The interactive interface of a certain software is shown, and as shown in the pop-up box, "This domain name is exist already" shows a typical syntax error. The correct statement should be "This domain name already exists".
[0082] Figure 4 shows a more significant translation quality flaw. Figure 4 The interactive interface of a certain software is shown, and as shown in the box, the English sentence not only has grammatical errors, but also the user cannot understand what it means. In the scoring criteria of the present invention, Figure 4 The defect will be greater than Figure 3 Deduct more points.
[0083] 1.3 There is no missing translation. This item corresponds to the language content quality feature sub-dimension in the content quality feature dimension and is characterized by translation completeness.
[0084] The product should not have any untranslated content, which is usually manifested as Chinese or key (element name) mixed in with English. Figure 5 An example of missed translation is shown. Figure 5 An interactive interface of a certain software is shown, and as shown in the box, there is untranslated Chinese.
[0085] 1.4 When the product does not support the language selected by the user, the product will provide another appropriate language. This item corresponds to the language content quality feature sub-dimension in the content quality feature dimension and is characterized as alternative language accessibility. For example, when the user selects Korean, if there is no Korean resource, the English resource is displayed as an alternative. Figure 6 An example of an alternative language selection error is shown. Figure 6 A shopping interactive interface is shown, and as shown in the box, when the Japanese translation does not exist, the product should fall back to English instead of directly displaying the page element name (key).
[0086] 1.5 The monetary amount on the page is correct. This item corresponds to the language content quality feature sub-dimension in the content quality feature dimension and is characterized by the correctness of the monetary amount.
[0087] The product should ensure that the currency amounts it displays are correct. By default, the product should display currency amounts according to the user's currency preference. For example, when converting RMB to USD, it should be correct. This item is different from item 1.7. This item focuses on whether the data itself is correct, while item 1.7 focuses on whether the format is correct.
[0088] 1.6 The time data on the page is correct. This item corresponds to the language content quality feature sub-dimension in the content quality feature dimension and is characterized by the correctness of the time data.
[0089] Products should ensure that the time they display is correct. By default, products should display the time according to the user's browser time zone.
[0090] This item is different from item 1.7. This item focuses on whether the data itself is correct, while item 1.7 focuses on whether the format is correct.
[0091] 1.7 The formats of date, time, numbers, currency, phone number, name, and address conform to the user's usage habits. This item corresponds to the content format quality feature sub-dimension in the content quality feature dimension, and is characterized as the format conforming to local habits.
[0092] The product should ensure that the formats of date, time, numbers, currency, phone numbers, names, and addresses are consistent with user habits.
[0093] For example, for English users, the date and time format should be like April 16, 2019, 18:35:56; for Simplified Chinese users, the date and time format should be like 2019 April 16th 18:35:56.
[0094] 1.8 The calendar complies with the user's usage habits. This item corresponds to the content format quality feature sub-dimension in the content quality feature dimension, and is characterized as the calendar conforming to local habits.
[0095] If users have a need, the product should provide the calendar that the user is accustomed to, for example, providing the Japanese calendar for Japanese users.
[0096] 2.1 Page elements are not truncated, overflowed, overlapped, or misplaced. This item corresponds to the sub-dimension of interface presentation quality in the display quality dimension, and is characterized by the correctness of page element presentation.
[0097] In a correct page display, the product interface should not have problems such as truncation, overflow, overlap, or misalignment.
[0098] Figure 7 An example of a truncation problem is shown. Figure 7 An interactive page of a certain software is shown, and as shown in the box, the element content becomes longer and is truncated after being translated into English.
[0099] Figure 8 Examples of overflow and overlap problems are shown. Figure 8 An interactive page of a certain software is shown, and as shown in the box, after being translated into English, the element content becomes longer and overflows and overlaps with the button.
[0100] Fig. 9 An example of a misalignment problem is shown. Fig. 9 An interactive page of a certain software is shown, and as shown in the box, the type item and its corresponding content in the table are misplaced.
[0101] 2.2 Fonts, line spacing, images, colors, etc. conform to user habits. This item corresponds to the sub-dimension of interface presentation quality characteristics in the display quality characteristics dimension, and is characterized by page elements conforming to local habits.
[0102] The font, line spacing, pictures, colors, etc. of software products should conform to the current user's usage habits.
[0103] 2.3 Multilingual characters can be preserved. This item corresponds to the sub-dimension of interface interaction quality characteristics in the display quality characteristics dimension, and is characterized by the preservation of local characters.
[0104] All characters in the language required by the user should be saved without error.
[0105] 2.4 Multilingual characters can be imported and exported. This item corresponds to the interface interaction quality feature sub-dimension in the display quality feature dimension, and is characterized by the import / exportability of local characters.
[0106] Functionality involving importing and / or exporting plain text files should support the full range of characters in the language required by the user.
[0107] 2.5 The categories and options on the navigation bar, drop-down menu, error prompt, etc. are in line with user habits. This item corresponds to the interface interaction quality feature sub-dimension in the display quality feature dimension, and is characterized by the interactive elements conforming to local habits.
[0108] The categories and options on the navigation bar, drop-down menu, error prompts, etc. should conform to the user's usage habits.
[0109] 2.6 Supports user language-specific sorting methods. This item corresponds to the interface interaction quality feature sub-dimension in the display quality feature dimension, and is characterized by support for local sorting methods. For example, English users usually require text to be sorted in alphabetical order; while simplified Chinese users usually require text to be sorted in the order of Chinese pinyin.
[0110] If the user has a need, the product should provide a sorting method specific to the user's language.
[0111] 2.7 Supports user language-specific search methods. This item corresponds to the interface interaction quality feature sub-dimension in the display quality feature dimension, and is characterized by local search method support.
[0112] If users have a need, the product should provide a search method that is specific to the user's language. For example, search keywords entered by English users can be separated by spaces, while search keywords entered by simplified Chinese users should be separated based on syntax and semantics.
[0113] After obtaining the quality score, the present invention can also be implemented as a method for ranking the quality of multiple software. The method includes using the above method to assess the quality score of each software in the multiple software; and ranking the multiple software using the quality score as the ranking basis.
[0114] Specifically, sorting the plurality of software includes sorting them according to the feature scores of the content quality feature and the display quality feature, respectively. For example, the quality scores of the plurality of software can be visually sorted on a two-dimensional image with the feature scores of the content quality feature and the feature scores of the display quality feature as one dimension, respectively.
[0115] Fig.10 An example of software maturity visualization is shown. After measuring multiple software products as above, they can be placed on a maturity visualization chart to graphically display the maturity of each product and the comparison of the maturity of different products from the two dimensions of content and interaction. The three dotted lines in the figure can correspond to the passing, good, and excellent scoring lines respectively.
[0116] The software quality evaluation and ranking scheme of the present invention can evaluate and rank conventional applications installed on the client, and can also evaluate and rank cloud applications. Here, conventional applications refer to applications that are installed on the local disk by the client through downloading or CD installation and run on the local memory. Cloud applications refer to applications that only provide an interactive interface on the client and install and run the program on the cloud (server).
[0117] In one embodiment, the software evaluation solution of the present invention can be implemented as an application program. Users can install the program locally and evaluate the quality of the software they are interested in. The evaluation application program can also include a ranking function, for example, calculating the quality of multiple software programs and performing the following operations: Fig.10 Visual sorting shown.
[0118] In another embodiment, the software evaluation scheme of the present invention itself can be implemented as a software quality evaluation system. The system can be a cloud platform, and the software quality evaluation is performed by a server arranged in the cloud. Thus, the system can first obtain the software that needs to be evaluated, and then execute the evaluation method as described above. Specifically, the system can obtain the software that needs to be evaluated by receiving the software program uploaded by the user; receiving the software download link submitted by the user; and capturing the interface of the software as a cloud application, and complete the evaluation in the cloud (server side).
[0119] After the evaluation is completed, modification suggestions for the above software can also be given. The cloud can first give the software a global quality score, for example, 85 points out of a full score of 100. Subsequently, the specific score on each sub-item can be displayed automatically or at the user's request, and a deduction interface can be displayed. In this way, the user can know the specific defects of the software. Furthermore, the software can also optionally provide users with modification tools, for example, tools to modify the layout of corresponding elements when truncation occurs in the interface.
[0120] In another embodiment, the software ranking scheme of the present invention can also be implemented as a system (for example, a cloud platform), which can use the software quality assessment method of the present invention to score multiple software, and use the quality score as the ranking basis to sort the multiple software, for example, sorting according to the feature scores of content quality features and display quality features respectively (for example, visual sorting). The system for sorting can usually be incorporated into a system for quality evaluation, and the resulting system can be implemented as a cloud service that comprehensively and automatically quantifies, sorts, and gives modification suggestions (and provides modification tools) for the quality of multiple software (for example, software globalization). To this end, the software quality assessment system can obtain multiple software, calculate the quality score of each software, and preferably sort according to the quality score. For example, the system can perform interface splitting for software packages, and / or interface capture for cloud applications, perform automatic content and interaction analysis on each interface, comprehensively obtain the corresponding scores of each sub-item of each software, calculate the total quality score of the software, and put it into a general diagram including multiple software evaluation results for visual sorting.
[0121] The present invention can also be implemented as a software quality evaluation device. Fig.11 A schematic diagram showing the composition of a software quality evaluation device according to the present invention is shown.
[0122] As shown in the figure, the apparatus 1100 includes a feature acquisition unit 1110 , a project feature score calculation unit 1120 , and a software quality score calculation unit 1130 .
[0123] The feature acquisition unit 1110 can be used to acquire the interface quality feature of the page, and the interface quality feature includes at least one of the content quality feature and the display quality feature. The project feature score calculation unit 1120 can be used to calculate the feature score of each of the at least one feature. The software quality score calculation unit 1130 can be used to calculate the quality score of the software according to the feature score.
[0124] The interface quality feature may be an interface globalization quality feature, and the interface globalization quality feature includes at least one of the following: at least one interface localization quality feature; and an interface localization switching quality feature.
[0125] Specifically, the content quality characteristics include language content quality characteristics and content format quality characteristics, the display quality characteristics include interface presentation quality characteristics and interface interaction quality characteristics, and the interface quality characteristics include at least two of the language content quality characteristics, content format quality characteristics, interface presentation quality characteristics and interface interaction quality characteristics, and the software quality score calculation unit 1130 can be further used to: assign a feature weight to each of the at least two features; and calculate the quality score of the software by weighting the feature scores of the at least two features.
[0126] In one embodiment, the project feature score calculation unit 1120 can be used to: determine the defect severity of each feature; based on the defect severity, calculate the feature score deducted for each of the at least one feature, and the software quality score calculation unit 1130 can be used to: subtract the feature score deducted for each item from a predetermined score to obtain the quality score of the software.
[0127] The interface is an interface belonging to software, and the software may be a locally installed application or a cloud application.
[0128] In one embodiment, the apparatus may further include: a complexity rating unit for rating the complexity of the software, and the software quality score calculation unit is used to: for the same defect, deduct a smaller feature score for a target object with a higher complexity.
[0129] In one embodiment, the device may further include: a sorting unit, configured to sort the quality scores of the plurality of software calculated by the software quality score calculation unit. The sorting unit may, for example, include or be implemented as a visualization unit, configured to visually sort the quality scores of the plurality of software on a two-dimensional image with the feature score of the content quality feature and the feature score of the display quality feature as one dimension.
[0130] Fig.12A schematic diagram of the structure of a computing device that can be used to implement the above-mentioned page quality evaluation and ranking method according to an embodiment of the present invention is shown.
[0131] See also Fig.12 , the computing device 1200 includes a memory 1210 and a processor 1220 .
[0132] The processor 1220 may be a multi-core processor or may include multiple processors. In some embodiments, the processor 1220 may include a general-purpose main processor and one or more special coprocessors, such as a graphics processing unit (GPU), a digital signal processor (DSP), etc. In some embodiments, the processor 1220 may be implemented using a customized circuit, such as an application-specific integrated circuit (ASIC) or a field programmable gate array (FPGA).
[0133] The memory 1210 may include various types of storage units, such as system memory, read-only memory (ROM), and permanent storage devices. Among them, ROM can store static data or instructions required by the processor 1220 or other modules of the computer. The permanent storage device may be a readable and writable storage device. The permanent storage device may be a non-volatile storage device that does not lose the stored instructions and data even after the computer is powered off. In some embodiments, the permanent storage device uses a large-capacity storage device (such as a magnetic or optical disk, flash memory) as a permanent storage device. In some other embodiments, the permanent storage device may be a removable storage device (such as a floppy disk, optical drive). The system memory may be a readable and writable storage device or a volatile readable and writable storage device, such as a dynamic random access memory. The system memory may store some or all instructions and data required by the processor at runtime. In addition, the memory 1210 may include any combination of computer-readable storage media, including various types of semiconductor memory chips (DRAM, SRAM, SDRAM, flash memory, programmable read-only memory), and disks and / or optical disks may also be used. In some embodiments, the memory 1210 may include a readable and / or writable removable storage device, such as a laser disc (CD), a read-only digital versatile disc (such as a DVD-ROM, a double-layer DVD-ROM), a read-only Blu-ray disc, an ultra-density optical disc, a flash memory card (such as an SD card, a mini SD card, a Micro-SD card, etc.), a magnetic floppy disk, etc. The computer-readable storage medium does not include carrier waves and transient electronic signals transmitted wirelessly or wired.
[0134] The memory 1210 stores executable codes. When the executable codes are processed by the processor 1220 , the processor 1220 can execute the page quality evaluation and ranking method mentioned above.
[0135] The page quality evaluation and object ranking method and device according to the present invention have been described in detail above with reference to the accompanying drawings. The present disclosure divides the globalization of an application or website into two dimensions, namely, content and presentation, and further refines multiple sub-dimensions to quantify the globalization maturity of an application or website using a formula. Furthermore, the globalization maturity of each application or software can be summarized and displayed in an intuitive manner in a coordinate system.
[0136] In addition, the method according to the present invention may also be implemented as a computer program or a computer program product, which includes computer program code instructions for executing the above steps defined in the above method of the present invention.
[0137] Alternatively, the present invention may also be implemented as a non-temporary machine-readable storage medium (or computer-readable storage medium, or machine-readable storage medium) on which executable code (or computer program, or computer instruction code) is stored. When the executable code (or computer program, or computer instruction code) is executed by a processor of an electronic device (or computing device, server, etc.), the processor executes the various steps of the above-mentioned method according to the present invention.
[0138] Those skilled in the art will further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the disclosure herein may be implemented as electronic hardware, computer software, or a combination of both.
[0139] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system and method according to multiple embodiments of the present invention. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or code, and the part of the module, program segment or code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0140] The embodiments of the present invention have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terms used herein are selected to best explain the principles of the embodiments, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.
Claims
1. A software quality evaluation method, comprising: Acquiring interface quality characteristics of the software interface, wherein the interface quality characteristics include content quality characteristics and display quality characteristics; Calculate the feature score of each feature; as well as Calculate the quality score of the software according to the feature score, The interface quality feature is an interface globalization quality feature, the content quality feature includes a language content quality feature and a content format quality feature, and the display quality feature includes an interface presentation quality feature and an interface interaction quality feature. The language content quality feature includes at least one of the following: Language switchability; The quality acceptability of the language; Translation integrity; Alternative language accessibility; Correctness of currency amount; the correctness of the currency amount is used to indicate whether the converted currency amount displayed on the interface of the software is consistent with the amount corresponding to the currency type in the region where the user is located; and Time data correctness, which is used to indicate whether the time displayed on the software interface is consistent with the time zone of the user's browser; The content format quality feature includes at least one of the following: The format is in accordance with local conventions; and The calendar conforms to local customs, The interface presentation quality characteristics include at least one of the following: Correct presentation of interface elements; and Interface elements conform to local habits. The interface interaction quality feature includes at least one of the following: Local characters can be preserved; Local characters can be imported / exported; Interactive elements conform to local customs; Local sorting support; and Support for local search methods; Calculating a feature score for each of the at least one feature comprises: Determine the quality of each feature; Based on the quality of each feature, a feature score of the corresponding feature is determined.
2. The method of claim 1, wherein: The interface globalization quality characteristics include at least one of the following: At least one interface localization quality characteristic; and Interface localization toggle quality features.
3. The method according to claim 1, The method further includes: Assigning a feature weight to each of the language content quality feature, the content format quality feature, the interface presentation quality feature, and the interface interaction quality feature, The quality score of the software is calculated by weighting the feature scores of the language content quality feature, the content format quality feature, the interface presentation quality feature and the interface interaction quality feature.
4. The method of claim 1, wherein: Calculating the feature score of each of the at least one feature includes: Calculate the feature score deducted for each of the at least one feature, and Calculating the quality score of the software according to the feature score includes: The deducted feature score for each item is subtracted from the predetermined score to obtain the quality score of the software.
5. The method of claim 4, wherein: Calculating the feature score deducted for each of the at least one feature includes: Determine the severity of the defect for each characteristic; Based on the severity of the defect, the corresponding deducted feature score is calculated.
6. The method of claim 1, wherein: The software includes at least one of the following: Applications installed on the client; Cloud applications.
7. The method of claim 1, further comprising: assign a complexity rating to the software, and Calculating the quality score of the software includes: For the same defect, a smaller feature score is deducted for software with higher complexity.
8. A method for ranking the quality of multiple software, comprising: Using the method according to any one of claims 1 to 7, assessing the quality score for each of the plurality of software; as well as The plurality of software are sorted based on the quality score.
9. The method of claim 8, wherein: Sorting the plurality of software includes: The ranking is performed based on the feature scores of content quality features and display quality features respectively.
10. The method of claim 9, wherein: The rankings based on the feature scores of content quality features and display quality features include: The quality scores of the plurality of software are visually ranked on a two-dimensional image with the feature score of the content quality feature and the feature score of the presentation quality feature as one dimension respectively.
11. A software quality evaluation system for: Acquiring the software that requires quality assessment; and The quality score of the software is calculated using the method according to any one of claims 1 to 7.
12. The system of claim 11, wherein: Acquisition of software that requires quality assessment includes at least one of the following: Receive software programs uploaded by users; Receive software download links submitted by users; and Capture the interface of the software as a cloud application.
13. The system of claim 11, further used for: Provide modification suggestions for the software.
14. The system of claim 11, wherein: The software that needs to be evaluated for quality includes: Obtain multiple software that need to be evaluated for quality, and Calculating the quality score of the software includes: The quality scores of the plurality of software are calculated.
15. The system of claim 14, further configured to: The plurality of software are ranked based on the quality scores of the plurality of software.
16. A software quality evaluation device, comprising: A feature acquisition unit, used to acquire interface quality features of the software interface, wherein the interface quality features include content quality features and display quality features; An item feature score calculation unit is used to calculate the feature score of each item in the feature; as well as a software quality score calculation unit, configured to calculate the quality score of the software according to the feature score, The interface quality feature is an interface globalization quality feature, the content quality feature includes a language content quality feature and a content format quality feature, and the display quality feature includes an interface presentation quality feature and an interface interaction quality feature. The language content quality feature includes at least one of the following: Language switchability; The quality acceptability of the language; Translation integrity; Alternative language accessibility; The currency amount correctness is used to indicate whether the converted currency amount displayed on the interface of the software is consistent with the amount corresponding to the currency type in the region where the user is located; and Time data correctness, which is used to indicate whether the time displayed on the software interface is consistent with the time zone of the user's browser; The content format quality feature includes at least one of the following: The format is in accordance with local conventions; and The calendar conforms to local customs, The interface presentation quality characteristics include at least one of the following: Correct presentation of interface elements; and Interface elements conform to local habits. The interface interaction quality feature includes at least one of the following: Local characters can be preserved; Local characters can be imported / exported; Interactive elements conform to local customs; Local sorting support; and Support for local search methods; Calculating a feature score for each of the at least one feature comprises: Determine the quality of each feature; Based on the quality of each feature, a feature score of the corresponding feature is determined.
17. The device of claim 16, wherein: The interface globalization quality characteristics include at least one of the following: At least one interface localization quality characteristic; and Interface localization toggle quality features.
18. The device of claim 16, wherein: The software quality score calculation unit is further used for: Assigning a feature weight to each of the language content quality feature, the content format quality feature, the interface presentation quality feature, and the interface interaction quality feature; as well as The quality score of the software is calculated by weighting the feature scores of the language content quality feature, the content format quality feature, the interface presentation quality feature, and the interface interaction quality feature.
19. The device of claim 16, wherein: The project feature score calculation unit is used for: Determine the severity of the defect for each characteristic; Based on the severity of the defect, a feature score deducted for each of the at least one feature is calculated, and The software quality score calculation unit is used for: The deducted feature score for each item is subtracted from the predetermined score to obtain the quality score of the software.
20. The device of claim 16, wherein: The software includes at least one of the following: Applications installed on the client; Cloud applications.
21. The apparatus of claim 16, further comprising: a complexity rating unit, for performing a complexity rating on the software, and The software quality score calculation unit is used for: For the same defect, a smaller feature score is deducted for software with higher complexity.
22. The apparatus of claim 16, further comprising: The sorting unit is used to sort the quality scores of the multiple software calculated by the software quality score calculation unit.
23. The device of claim 22, wherein: The sorting unit comprises: The visualization unit visually sorts the quality scores of the plurality of software on a two-dimensional image with the feature score of the content quality feature and the feature score of the display quality feature as one dimension respectively.
24. A computing device comprising: processor; as well as A memory having executable codes stored thereon, which, when executed by the processor, causes the processor to execute the method according to any one of claims 1 to 10.
25. A non-transitory machine-readable storage medium having executable codes stored thereon, which, when executed by a processor of an electronic device, causes the processor to execute the method according to any one of claims 1 to 10.
