Graphical interface processing method and device

By creating element comparison information sets in the graphical interface and determining component comparison rules, the problem of labor and time consuming component classification in the design draft is solved, and the automatic classification and efficiency improvement of components are achieved.

CN115033945BActive Publication Date: 2024-11-01BEIJING FLYING ELEPHANT PLANET TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202210752349.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-06-29
Publication Date
2024-11-01
Estimated Expiration
2042-06-29

AI Technical Summary

Technical Problem

In the prior art, component classification in design drafts relies on designers to manually formulate classification rules, resulting in different classification habits of different designers, increasing labor and time costs, making it difficult to achieve automated classification.

Method used

By creating an element comparison information set based on the attribute information of each element in the graphical interface, obtaining the element association information of the components to be compared, determining the target component comparison rules, and generating component comparison information to achieve automatic classification of components.

Benefits of technology

It improves the efficiency of designers in processing design drafts, reduces the time and cost of manual classification, and realizes automatic classification of components.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115033945B_ABST
    Figure CN115033945B_ABST
Patent Text Reader

Abstract

The present application provides a graphical interface processing method and device, wherein the graphical interface processing method includes: creating an element comparison information set according to the attribute information of each element in the graphical interface, wherein the element comparison information set contains element comparison information between elements; obtaining two components to be compared in the graphical interface, and determining the element association information of each component to be compared; determining the target component comparison rule according to the element association information of each component to be compared, and determining the target element comparison information in the element comparison information set, wherein the target element comparison information is the comparison information between the elements contained in the two components to be compared; generating component comparison information of the two components to be compared based on the target component comparison rule and the target element comparison information. By first determining the element comparison information between every two elements, and then determining the component comparison information of each component to be compared, the comparison between any two components is achieved, providing a reference basis for subsequent component classification.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of image processing technology, and in particular to a method for processing a graphical interface. The present application also relates to a graphical interface processing device, a computing device, and a computer-readable storage medium. Background Art

[0002] With the development and application of Internet technology, the visual design of products has received more and more attention. During the product development process, designers will design a visual draft for the product, which is called a design draft. The design draft includes multiple components. Later, the design drafts will be compared and the target design draft will be selected as the final solution. During the comparison process, there are many very similar components, and designers often need to manually classify similar components to complete the comparison between the design drafts.

[0003] In the prior art, component classification processing relies on designers to manually formulate classification rules, such as screening and classifying components according to the names given by designers. Due to the different classification habits of different designers, classification is difficult, and the manpower and time costs of component classification increase. Therefore, how to automatically implement component classification and improve the efficiency of designers in processing design drafts is an urgent problem to be solved. Summary of the invention

[0004] In view of this, the embodiment of the present application provides a graphical interface processing method. The present application also relates to a graphical interface processing device, a computing device, and a computer-readable storage medium to solve the problem that the classification of components in the design draft in the prior art consumes manpower and has high time cost.

[0005] According to a first aspect of an embodiment of the present application, a graphical interface processing method is provided, including:

[0006] Creating an element comparison information set according to the attribute information of each element in the graphical interface, wherein the element comparison information set includes element comparison information between elements;

[0007] Obtain two components to be compared in the graphical interface, and determine element association information of each component to be compared;

[0008] Determine a target component comparison rule according to the element association information of each component to be compared, and determine target element comparison information in the element comparison information set, wherein the target element comparison information is the comparison information between the elements included in the two components to be compared;

[0009] Component comparison information of the two components to be compared is generated based on the target component comparison rule and the target element comparison information.

[0010] According to a second aspect of an embodiment of the present application, there is provided a graphical interface processing device, including:

[0011] A creation module is configured to create an element comparison information set according to the attribute information of each element in the graphical interface, wherein the element comparison information set includes element comparison information between elements;

[0012] An acquisition module is configured to acquire two components to be compared in the graphical interface and determine element association information of each component to be compared;

[0013] A determination module is configured to determine a target component comparison rule according to the element association information of each component to be compared, and to determine target element comparison information in the element comparison information set, wherein the target element comparison information is comparison information between the elements included in the two components to be compared;

[0014] A generating module is configured to generate component comparison information of the two components to be compared based on the target component comparison rule and the target element comparison information.

[0015] According to a third aspect of an embodiment of the present application, a computing device is provided, comprising a memory, a processor, and computer instructions stored in the memory and executable on the processor, wherein the processor implements the steps of the graphical interface processing method when executing the computer instructions.

[0016] According to a fourth aspect of an embodiment of the present application, a computer-readable storage medium is provided, which stores computer instructions, and when the computer instructions are executed by a processor, the steps of the graphical interface processing method are implemented.

[0017] The graphical interface processing method provided by the present application creates an element comparison information set according to the attribute information of each element in the graphical interface, wherein the element comparison information set includes element comparison information between elements; obtains two components to be compared in the graphical interface, and determines the element association information of each component to be compared; determines a target component comparison rule according to the element association information of each component to be compared, and determines target element comparison information in the element comparison information set, wherein the target element comparison information is the comparison information between the elements included in the two components to be compared; and generates component comparison information of the two components to be compared based on the target component comparison rule and the target element comparison information.

[0018] An embodiment of the present application realizes comparison between any two components by calculating element comparison information between every two elements based on the attribute information of each element in the graphical interface, and then determining the component comparison information of each component to be compared based on each element comparison information, thereby realizing comparison between any two components, so that the components in the graphical interface can be clustered and classified. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] Figure 1 is a flowchart of a graphical interface processing method provided by an embodiment of the present application;

[0020] Figure 2 It is a schematic diagram of a layout tree of a graphical interface provided by an embodiment of the present application;

[0021] Figure 3 is a flow chart of multiple element comparison rules provided in one embodiment of the present application;

[0022] Figure 4 It is a processing flow chart of a graphical interface processing method for determining the repetition rate of works provided in one embodiment of the present application;

[0023] Figure 5 It is a structural schematic diagram of a graphical interface processing device provided by an embodiment of the present application;

[0024] Figure 6 It is a structural block diagram of a computing device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0025] Many specific details are described in the following description to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of the present application, so the present application is not limited by the specific implementation disclosed below.

[0026] The terms used in one or more embodiments of the present application are only for the purpose of describing specific embodiments, and are not intended to limit one or more embodiments of the present application. The singular forms of "a", "said" and "the" used in one or more embodiments of the present application and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used in one or more embodiments of the present application refers to and includes any or all possible combinations of one or more associated listed items.

[0027] It should be understood that, although the terms first, second, etc. may be used to describe various information in one or more embodiments of the present application, these information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of the present application, the first may also be referred to as the second, and similarly, the second may also be referred to as the first. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0028] First, the terms involved in one or more embodiments of the present application are explained.

[0029] Design draft: During the product development process, the designer designs the visual draft for the product, which consists of a series of different components according to a customized layout.

[0030] Basic elements: The basic elements that constitute the design draft, such as rectangular frames, texts, etc.

[0031] Components: Components are composed of basic visual elements and have certain semantics, such as buttons, calendar cards, etc.

[0032] Layout tree: When designing a page, designers will group elements according to the relationship between them, such as grouping a text and a rectangular box into a button. According to the grouping relationship, the design draft or component can be abstracted into a multi-branch tree.

[0033] Generally speaking, each company has its own unique, brand-related design system, which is manually refined by the company's designers. In the process of determining and modifying the design system, designers will first design a variety of components and design drafts, and then compare and discuss based on the design drafts to determine the final solution. There are many very similar components in this process. Designers often need to manually classify similar components, and the work is highly repetitive. Existing technologies require designers to follow certain rules when naming components during the design process, such as naming buttons "button / big button" or "button / small button" according to the size of the button, and then filtering and classifying them according to the component name.

[0034] However, in the implementation process, different designers have different naming rules, so when the components are subsequently classified, they cannot be filtered and classified according to the component names. This method not only increases the restrictions on designers, but also fails to achieve the purpose of component classification in some special cases. For example, in the process of multi-party collaborative design, due to the different naming habits of different designers, it is also impossible to filter and classify according to the component names.

[0035] Based on this, in the present application, a graphical interface processing method is provided, firstly determining element comparison information between elements, and then determining component comparison information between components based on the element comparison information, so that the components can be classified based on the component comparison information. The present application also relates to a graphical interface processing device, a computing device, and a computer-readable storage medium, which are described in detail one by one in the following embodiments.

[0036] Figure 1 A flowchart of a graphical interface processing method provided according to an embodiment of the present application is shown, which specifically includes the following steps:

[0037] Step 102: creating an element comparison information set according to the attribute information of each element in the graphical interface, wherein the element comparison information set includes element comparison information between elements.

[0038] Among them, the graphical interface can be understood as an element diagram of the design draft, or a layout tree of the design draft. In practical applications, the graphical interface can also be a picture, which includes multiple elements. For example, a poster picture includes text elements, pattern elements, etc. Each element has its own attribute information. For example, the attribute information of a text element can be attribute information such as font, font size, and character spacing. The attribute information of a rectangular pattern can be attribute information such as height, width, and fill color. The element comparison information set contains element comparison information between every two elements. The element comparison information can be understood as the similarity between elements. The elements can be grouped and classified according to the element comparison information.

[0039] See also Figure 2 , Figure 2 is a schematic diagram of a layout tree of a graphical interface provided by an embodiment of the present application, wherein: Figure 2 (a) is the layout tree of interface a, Figure 2 (b) is the layout tree of interface b. Each leaf node of the tree represents a basic element. The basic element can be text, text box, etc. in the graphical interface. For example Figure 2 In Each non-leaf node (including the root node) represents a component, which is composed of basic elements, such as Figure 2 In Components By element and elements constitute.

[0040] In a specific embodiment of the present application, an element comparison information set is created based on the attribute information of each element in the graphic interface A, and the element comparison information set includes the similarity between every two elements in the graphic interface A.

[0041] In practical applications, since the types of each element are different, before determining the element comparison information between the elements, the types of the elements can be standardized to facilitate the subsequent determination of the element comparison information.

[0042] Specifically, the attribute information of the element to be converted includes type description information;

[0043] Before creating the element comparison information set according to the attribute information of each element in the graphical interface, the method further includes:

[0044] Determine that the type description information in the graphical interface belongs to an element to be converted of a type to be converted;

[0045] The type description information of the element to be converted is changed to a general type, and an element set corresponding to the graphical interface is created according to the general type of the element to be converted and the original elements in the graphical interface.

[0046] Among them, the type description information can be understood as the type information of the element. The type description information includes the types of basic elements, including eight types: vector type (VECTOR), rectangle type (RECTANGLE), text type (TEXT), line type (LINE), ellipse type (ELLIPSE), star type (STAR), polygon type (POLYGON) and arrow type (ARROW). Among them, TEXT, RECTANGLE and VECTOR are three commonly used types. Therefore, LINE, POLYGON, STAR and ARROW can be converted to VECTOR for representation, and the remaining other types of elements remain unchanged, that is, the elements to be converted in the graphical interface that belong to the type to be converted are converted to a common type for representation, so as to complete the standardization of element types.

[0047] In practical applications, the element type of each element in the graphical interface can be determined first, and the types to be converted and the general types that do not need to be converted can be grouped. The types to be converted include LINE, POLYGON, STAR, and ARROW. The grouping result is that the elements of the LINE, POLYGON, STAR, and ARROW types need to be converted into a group, while RECTANGLE, TEXT, and ELLIPSE do not need to be converted into a group. After the grouping is completed, the type description information of the element type in the group that needs to be converted can be changed to the general type to complete the standardization of the elements.

[0048] In a specific embodiment of the present application, following the above example, elements of the LINE, POLYGON, STAR, and ARROW types in the graphical interface A are determined to be elements to be converted, the type description information of the elements to be converted is changed to the VECTOR type, and then an element set corresponding to the graphical interface A is created based on the converted elements to be converted and the remaining original elements that do not need to be converted.

[0049] In a specific implementation, the type description information of the element to be converted is changed to a universal type, so that the element type of the element to be converted belongs to the universal type, and an element set of the graphical interface is created according to the element to be converted and the original element. Because the types of elements in the element set are reduced, when the element comparison information between the elements in the element set is subsequently calculated based on the element set, the calculation complexity of the element comparison information is reduced, and the calculation efficiency is improved.

[0050] Furthermore, after creating the element set corresponding to the graphical interface, element pairs can be formed according to every two elements, and element comparison information of the element pairs, that is, the similarity between the two elements in the element pair, can be calculated to facilitate subsequent calculation of component comparison information.

[0051] Specifically, according to the attribute information of each element in the graphical interface, an element comparison information set is created, including:

[0052] Determine n elements in the element set, and generate m element pairs according to the n elements, where:

[0053] Determine element comparison information of each element pair according to the attribute information of each element;

[0054] Create an element comparison information collection based on each element comparison information.

[0055] Among them, when the element set includes n elements, m element pairs can be generated based on the n elements. For example, if the element set includes 4 elements, 6 element pairs can be assembled, so that the element comparison information of the 6 element pairs can be determined and the corresponding element comparison information set can be created.

[0056] In practical applications, element pairs can be determined by traversing each element. The two elements in the element pair can be elements in two design drafts. After calculating the element similarity of the element pair, the component similarity between the components can be further calculated based on the element comparison information.

[0057] In a specific embodiment of the present application, following the above example, it is determined that there are 5 elements in the element set, 10 element pairs are generated based on the 5 elements, and the element comparison information of each element pair is determined based on the attribute information of each element, thereby creating an element comparison information set.

[0058] In specific implementation, by traversing n elements in the element set to form m element pairs, the two elements contained in the element pair and the corresponding attribute information are quickly determined from the perspective of the element pair, and the element comparison information can be determined more quickly, thereby improving the efficiency of creating the element comparison information set.

[0059] Specifically, the element comparison information of any element pair is determined by:

[0060] Determine whether the types of the two elements in the element pair to be compared are the same according to the attribute information corresponding to the two elements;

[0061] If yes, determine a target element comparison rule according to the types of the two elements, calculate a first comparison value of the to-be-compared element pair based on the target element comparison rule and the attribute information corresponding to each element, and use the first comparison value as element comparison information;

[0062] If not, determine that the second comparison value of the to-be-compared element pair is zero, and use the second comparison value as element comparison information.

[0063] Among them, the target element comparison rule can be understood as the rule for determining element comparison information under the same element type. For example, the element comparison information between TEXT type elements has TEXT element comparison rules, and the element comparison information between VECTOR type elements has VECTOR element comparison rules. Therefore, before determining the element comparison information of an element pair, it is necessary to first determine whether the types are the same based on the element types of the two elements in the element pair. If the types are the same, the target element comparison rule can be determined, and the corresponding element comparison information can be further calculated. If the types are different, the element comparison information is 0.

[0064] In practical applications, after element type standardization, element types should also include VECTOR, RECTANGLE, TEXT, and ELLIPSE. When determining element comparison information for element pairs composed of elements of the same type, the element comparison rules of the corresponding type should be used, and the element comparison information of elements of different types should be directly determined as zero.

[0065] In a specific embodiment of the present application, following the above example, among the 10 element pairs, there are 5 element pairs of the same type, namely, element pair 1 and element pair 2 of TEXT type, element pair 3 of RECTANGLE type, and element pair 4 and element pair 5 of VECTOR type. Then, it is determined that the target element comparison rule of element pair 1 and element pair 2 is the TEXT element comparison rule, the target element comparison rule of element pair 4 and element pair 5 is the VECTOR element comparison rule, and the element comparison rule of element pair 3 is the RECTANGLE element comparison rule.

[0066] In the specific implementation, by first judging whether the types of two elements are the same, and directly determining the comparison value of the element comparison information between the two elements of different types to be zero when the types are different, the element comparison information determination process is optimized, and the redundant step of calculating the comparison value based on the attribute information of the elements when the types are different is avoided; when the types are the same, the first comparison value is calculated according to the element comparison rule and the attribute information of each element and used as the element comparison information. By using a method for determining the element comparison information between elements of multiple types corresponding to multiple element comparison rules, the corresponding element comparison rule can be determined according to the element type, thereby achieving the effect of quickly and accurately determining the element comparison information.

[0067] See also Figure 3 , Figure 3 is a flowchart of multiple element comparison rules provided by an embodiment of the present application, wherein: Figure 3 (a) is the TEXT element comparison rule. Since the attribute information of TEXT type elements includes nine attributes: font, font size, character spacing, bold, italic, color, text direction, text box height, and text box width, when calculating the similarity of TEXT type element pairs, all basic attributes need to be compared, and then the similarity is calculated based on the comparison rule. Figure 3 The similarity (sim) calculation formula in is used to calculate the corresponding similarity. Figure 3 (b) is the RECTANGLE or ELLIPSE element comparison rule. The attribute information of these two types of elements includes five attribute information: height, width, fill color, border thickness, and border color. Therefore, these two types of elements can use the same element comparison rule.

[0068] In practical applications, it should be noted that Figure 3 In the element comparison rules, the judgment process based on attribute information is not fixed, for example Figure 3 In (a), the judgment process of first determining whether the basic attributes such as font, bold, italic, color, etc. are the same, and then determining whether the text direction is the same, etc. can also be changed to first determining whether the text direction is the same, and then determining whether the basic attributes such as font, bold, italic, color, etc. are the same. The specific attribute information judgment process can be determined according to actual conditions, and this application does not limit the process sequence.

[0069] There is also a VECTOR type element comparison rule. Since a VECTOR type element is a closed figure composed of a series of points connected by straight lines, in addition to the path, this type of element also includes attributes such as fill color, border thickness, border color, etc., the element comparison rule of this type can be simply set to when the path and attributes are exactly the same, the comparison value is 1, otherwise it is 0.

[0070] After determining the element comparison information of each element pair, the component comparison information between any two components can be calculated, thereby facilitating subsequent component classification.

[0071] Step 104: Obtain two components to be compared in the graphical interface, and determine element association information of each component to be compared.

[0072] In order to subsequently determine the component comparison information between any two components, it is necessary to first determine the element comparison information of each element. After determining the components to be compared, the corresponding element comparison information can be selected from the element comparison information set based on the element association information of the components to be compared, thereby providing data support for determining the component comparison information and improving the efficiency of determining the component comparison information.

[0073] Among them, the component to be compared can be understood as the component selected for comparison, and the element association information of the component to be compared can be understood as the information of the elements contained in the component to be compared. For example, if the component a1 to be compared is composed of element a2 and element a3, then the element association information of the component a1 to be compared is a2, a3.

[0074] In practical applications, in order to determine the component comparison information of two components to be compared, it is necessary to first determine which elements the two components to be compared are composed of. In some special cases, the components to be compared may also be composed of a single element. Therefore, there will also be situations where comparison information is determined between elements and components. Therefore, this application will provide a method for determining component comparison information between components of different component types.

[0075] In a specific embodiment of the present application, two components to be compared in the graphical interface are obtained, namely, component a1 to be compared and component b1 to be compared, and element association information of each component to be compared is determined. The element association information of component a1 to be compared is a2 and a3, and the element association information of component b1 to be compared is b2 and b3. The comparison information subsequently determined is the comparison information between components.

[0076] In another specific embodiment of the present application, two components to be compared in the graphical interface are obtained, namely, component a1 to be compared and component b1 to be compared, and element association information of each component to be compared is determined. The element association information of component a1 to be compared is a2, and the element association information of component b1 to be compared is b2. The comparison information subsequently determined is the comparison information between elements.

[0077] In another specific embodiment of the present application, two components to be compared in the graphical interface are obtained, namely, component a1 to be compared and component b1 to be compared, and element association information of each component to be compared is determined. The element association information of component a1 to be compared is a2 and a3, and the element association information of component b1 to be compared is b2. The comparison information subsequently determined is the comparison information between the components and the elements.

[0078] Step 106: Determine a target component comparison rule according to the element association information of each component to be compared, and determine target element comparison information in the element comparison information set, wherein the target element comparison information is the comparison information between the elements included in the two components to be compared.

[0079] In practical applications, different component types require different component comparison rules to be used for the components to be compared. In order to more accurately calculate the component comparison information between the current components to be compared, the component type of each component to be compared can be determined based on the element association information of each component to be compared, and the corresponding target element comparison information can be obtained.

[0080] Among them, the target component comparison rule can be understood as the target component comparison rule selected from the comparison rules under different component types. The target component comparison rule can be an element comparison rule, that is, a comparison rule between elements, or a component element comparison rule, that is, a comparison rule between components and elements, or a component comparison rule, that is, a comparison rule between components and components. Then, the target component comparison rule to be used subsequently can be determined according to the element association information of each component to be compared. In practical applications, determining the target component comparison rule according to the element association information of each component to be compared can be understood as determining the component type of each component to be compared, that is, whether the component to be compared is an element or a component. The component type can be determined according to the element association information of the component to be compared, that is, according to the number of elements included in the component to be compared.

[0081] In specific implementation, the element comparison information between the elements respectively contained in the two components to be compared can also be determined based on the element association information of each component to be compared. For example, the component to be compared a1 includes a2 and a3, and the component to be compared b1 includes b2, then the element comparison information of the two element pairs a2b2 and a3b2 can be determined.

[0082] In a specific embodiment of the present application, following the above example, the element association information of the component a1 to be compared is a2 and a3, and the element association information of the component b1 to be compared is b2 and b3, then the target component comparison rule is determined to be the component comparison rule, that is, the rule for comparing components with each other, and the element comparison information of the element pairs whose target element pair comparison information is a2b2, a2b3, a3b2, and a3b3 is determined.

[0083] Specifically, determining the target component comparison rule according to the element association information of the two components to be compared includes:

[0084] Determine the component type of each component to be compared according to the element association information of each component to be compared;

[0085] A target component comparison rule is determined according to the component types of the two components to be compared.

[0086] Among them, the component type of the component to be compared can be a component or an element. When the component type is a component, it means that the component includes at least two elements; when the component type is an element, it means that the component includes only one element. The corresponding target component comparison rules can be determined according to the component types of the two components to be compared.

[0087] Specifically, according to the element association information of each component to be compared, not only the target component comparison rule can be determined, but also the target element comparison information corresponding to the two elements to be compared can be determined, so that when determining the component comparison information later, the target element comparison information can be used as the data basis for determination. Then, it can be determined first that the two components to be compared include a first component to be compared and a second component to be compared;

[0088] Correspondingly, determining the target element comparison information in the element comparison information set according to the element association information of the two components to be compared includes:

[0089] Determine a first element corresponding to the first component to be compared according to the element association information of the first component to be compared;

[0090] Determine a second element corresponding to the second component to be compared according to the element association information of the second component to be compared;

[0091] determining a target element pair based on the first element and the second element;

[0092] Target element comparison information is determined in the element comparison information set according to the target element pair.

[0093] Among them, the first element can be understood as the element included in the first component to be compared, and the second element can be understood as the element included in the second component to be compared. According to the first element and the second element, the target element pair can be determined. For example, if the first element of the first component to be compared is a2 and a3, and the second element of the second component to be compared is b2, the target element pair determined based on the first element and the second element can be a2b2, a3b2. Therefore, the target element comparison information corresponding to each target element pair can be selected in the element comparison information set based on the target element pair.

[0094] In practical applications, this method actually first determines which elements each component to be compared is composed of, that is, determines the first element of the first component to be compared and the second element of the second component to be compared, and then traverses the first element and the second element respectively to determine the target element pair, and finally determines the target element comparison information based on the target element pair.

[0095] In a specific embodiment of the present application, following the above example, the first element of the first component to be compared is determined to be a2 and a3, the second element of the second component to be compared is determined to be b2 and b3, and the target element pairs are determined to be a2b2, a2b3, a3b2, and a3b3 based on the first element and the second element. The element comparison information corresponding to these four target element pairs is selected from the element comparison information set and used as the target element comparison information.

[0096] Optionally, the target element comparison information can also be determined in another way, that is, first selecting the element comparison information containing the first element in the element comparison information set according to the first element of the first component to be compared, and then further screening the element comparison information containing the first element according to the second element of the second component to be compared, and finally obtaining the target element comparison information containing both the first element and the second element.

[0097] Specifically, the two components to be compared include a third component to be compared and a fourth component to be compared; and determining target element comparison information in the element comparison information set according to element association information of the two components to be compared includes:

[0098] Determine a third initial element comparison information set corresponding to the third component to be compared according to the element association information of the third component to be compared;

[0099] The fourth initial element comparison information corresponding to the fourth component to be compared is selected from the third initial element comparison information set according to the element association information of the fourth component to be compared, and is used as the target element comparison information.

[0100] Among them, the third component to be compared can be the same component as the first component to be compared, the fourth component to be compared can be the same component as the second component to be compared, the third initial element comparison information set can be understood as the combination of element comparison information determined according to the third element of the third component to be compared, and the fourth initial element comparison information can be understood as the element comparison information screened out from the third initial element comparison information set according to the fourth element of the fourth component to be compared, and the screened element comparison information includes the third element and the fourth element.

[0101] In actual applications, since there are multiple elements and components composed of multiple elements in the graphical interface, the third element of the third component to be compared can form an element pair with each element and have corresponding element comparison information. Therefore, based on the third element, multiple third initial element comparison information can be determined in the element comparison information set and constructed into a third initial element comparison information set. Then, based on the fourth element, further screening is performed in the third initial element comparison information set, and the screening result is the target element comparison information containing the third element and the fourth element.

[0102] In a specific embodiment of the present application, following the above example, a first step of screening is performed in the element comparison information set according to the third element corresponding to the third component to be compared, the third initial element comparison information containing the third element is screened out, and a third initial element comparison information set is generated, the third initial element comparison information set includes 10 third initial element comparison information, and a second step of screening is performed in the third initial element comparison information set according to the fourth element of the fourth component to be compared, 4 fourth initial element comparison information are screened out, the fourth initial element comparison information is the element comparison information between the third element and the fourth element, and can be used as the target element comparison information.

[0103] After determining the target element comparison information of the two components to be compared, the component comparison information of the two components to be compared can be calculated based on the target element comparison information, that is, the component similarity of the two components to be compared can be calculated, so as to facilitate subsequent component classification based on component similarity.

[0104] In practical applications, component types are divided into element types and component types. When calculating component comparison information between elements, it is necessary to calculate according to the element-component comparison rules; when calculating component comparison information between elements, the element comparison information can be directly used as the component comparison information; when calculating component comparison information between components, it is necessary to calculate according to the component comparison rules.

[0105] Specifically, determining a target component comparison rule according to the component types of the two components to be compared includes:

[0106] In a case where the component types of the two components to be compared are both element types, determining a target component comparison rule in the element comparison rule;

[0107] In a case where the component types of the two components to be compared include an element type, determining the element component comparison rule as the target component comparison rule;

[0108] In a case where the component types of the two components to be compared do not include an element type, the component comparison rule is determined to be a target comparison rule.

[0109] In practical applications, when the component types of two components to be compared are the same and are both element types, it means that the similarity between the two elements is calculated, and the element similarity that has been calculated in the element comparison information set can be directly used; when one of the two components to be compared is an element type and the other is a component type, it means that the similarity between the elements and the components is calculated, and the similarity needs to be calculated according to the element component comparison rule. The element component comparison rule is shown in Formula 1, and the element component comparison rule is the following formula, including:

[0110]

[0111] Among them, sim(a,b) is the element comparison information of component a and element b, area(m i ) is the area of ​​each element in component a.

[0112] When the component types of two components to be compared are the same and are both component types, it means that the similarity calculation between the two components needs to be performed according to the component comparison rule. The component comparison rule is shown in Formula 2. The component comparison rule is the following formula, including:

[0113]

[0114] Among them, sim(a,b) is the element comparison information of component a and component b, area(m i ) is the area of ​​each element in component a, area(n j ) is the area of ​​each element in component b.

[0115] In a specific embodiment of the present application, following the above example, the first component to be compared contains two elements a2 and a3, and the component type of the first component to be compared is component; the second component to be compared contains one element b2, and the component type of the second component to be compared is element. Then, according to the types of the first component to be compared and the second component to be compared, it is determined that the target element comparison rule should be the element component rule, that is, Formula 1. Based on Formula 1, the similarity between the first component to be compared and the second component to be compared is calculated.

[0116] Step 108: Generate component comparison information of the two components to be compared based on the target component comparison rule and the target element comparison information.

[0117] In practical applications, after determining the target component comparison rules and target element comparison information, the target element comparison information can be substituted into the formula of the target component comparison rules to automatically calculate the component comparison information of the two components to be compared, effectively reducing the cost of obtaining component comparison information and improving processing efficiency.

[0118] In a specific embodiment of the present application, the target component comparison rule is an element comparison rule, and the target element comparison information can be directly used as the component comparison information of the two components to be compared.

[0119] In another specific embodiment of the present application, following the above example, the target component comparison rule is the element component comparison rule, and the element comparison information corresponding to a2b3 and a3b3 is substituted into Formula 1 to calculate the similarity of the two components to be compared.

[0120] In another specific embodiment of the present application, following the above example, the target component comparison rule is the component comparison rule, and the element comparison information corresponding to a2b2, a2b3, a3b2, and a3b3 is substituted into Formula 2 to calculate the similarity of the two components to be compared.

[0121] Through the graphical interface processing method provided in the present application, the similarity between any two elements or components in the graphical interface can be calculated, and the similarity between any two elements or components in multiple graphical interfaces can also be calculated, thereby realizing classification processing of components based on a clustering algorithm.

[0122] Furthermore, the method further comprises:

[0123] Determining a reference component and a component to be classified among the two components to be compared;

[0124] The components to be classified are classified according to the component comparison information.

[0125] Among them, the benchmark component can be understood as the component determined as the classification standard. For example, component a1 is now used as the benchmark component, and subsequent components with a similarity greater than 0.6 with component a1 can be classified into the same category as component a1. The component to be classified can be understood as the component that needs to calculate comparison information with the benchmark component. After calculating the component comparison information between the component to be classified and the benchmark component, the classification operation of each component to be classified can be implemented, avoiding the problem of high classification cost caused by manual classification.

[0126] In practical applications, the selection of the benchmark component can be determined according to the type of component. For example, in a poster, components containing text elements can be classified into the same category. Then, a component containing text elements can be selected as the benchmark component, and other components to be classified in the poster can be compared with the benchmark component to obtain component comparison information, and the components to be classified can be classified based on the component comparison information. It should be noted that this clustering rule is only an illustration provided in an embodiment of the present application. In specific implementation, the clustering rule can also adopt kmeans, hierarchical clustering and other rules, and the present application does not make specific restrictions here.

[0127] In a specific embodiment of the present application, following the above example, the first component to be compared is determined as the benchmark component, the second component to be compared is determined as the component to be classified, and the component similarity between the first component to be compared and the second component to be compared is 0.6, which is greater than the preset classification similarity of 0.5. Then, the second component to be compared can be classified as the same category as the first component to be compared, and then the similarity between the first component to be compared and the remaining components is calculated to complete the classification of all components in the graphical interface.

[0128] The present application provides a graphical interface processing method, including: creating an element comparison information set according to the attribute information of each element in the graphical interface, wherein the element comparison information set includes element comparison information between elements; obtaining two components to be compared in the graphical interface, and determining the element association information of each component to be compared; determining the target component comparison rule according to the element association information of each component to be compared, and determining the target element comparison information in the element comparison information set, wherein the target element comparison information is the comparison information between the elements contained in the two components to be compared; generating the component comparison information of the two components to be compared based on the target component comparison rule and the target element comparison information. By first calculating the element comparison information between elements according to the attribute information of each element, and then determining the target component comparison rule and the target element comparison information based on the element association information of each component to be compared, the component comparison information between components is calculated in a bottom-up manner, providing a reference basis for subsequent classification processing, improving the efficiency of classification processing, and reducing labor and time costs.

[0129] The following combination Figure 4 Taking the application of the graphical interface processing method provided by this application in determining the repetition rate of works as an example, the graphical interface processing method is further described. Figure 4 A processing flow chart of a graphical interface processing method for determining a repetition rate of a work provided by an embodiment of the present application is shown, which specifically includes the following steps:

[0130] Step 402: Create an element similarity set based on the attribute information of each element in work A and work B.

[0131] The element similarity set includes the similarity information between each element in work A and each element in work B.

[0132] Step 404: Obtain two components to be compared in Work A and Work B, and determine element association information of each component to be compared.

[0133] The components to be compared are component a1 obtained from work A and component b1 obtained from work B. The element association information of component a1 is determined to be a2 and a3, and the element association information of component b1 is determined to be b2 and b3.

[0134] Step 406: Determine the component type of each component to be compared according to the element association information of each component to be compared.

[0135] Among them, the component type of component a1 is determined to be component according to the element association information of component a1, and the component type of component b1 is determined to be component according to the element association information of component b1, and the similarity calculated subsequently is the similarity between components.

[0136] Step 408: Determine target component comparison rules according to the component types of the two components to be compared.

[0137] The target component comparison rule is a component comparison rule, that is, a formula for calculating the similarity between components.

[0138] Step 410: Determine the target element similarity in the element similarity set according to the element association information of the two components to be compared.

[0139] Among them, in one feasible method, a first initial element similarity can be determined in an element similarity set according to element association information of component a1 to be compared, and then the first initial element similarity is further screened according to element association information of component b1 to be compared, and the target element similarity is determined according to the screening result.

[0140] In another achievable manner, a target element pair may be determined based on element association information of component a1 to be compared and element association information of component b1 to be compared, and a target element similarity may be determined in an element similarity set based on the target element pair.

[0141] Step 412: Generate component similarity of the two components to be compared based on the target component comparison rule and the target element similarity.

[0142] Among them, the target component comparison rule is the component comparison rule.

[0143] Step 414: Calculate the component similarities of all components between work A and work B, and calculate the overall similarity between work A and work B based on the component similarities of all components.

[0144] Among them, after calculating the component similarity of all components between works A and B, the overall similarity between works A and B can be determined, and the overall similarity is the repetition rate of works A and B.

[0145] The present application provides a graphical interface processing method for determining the repetition rate of works, including creating an element similarity set according to the attribute information of each element in works A and B, obtaining two components to be compared in works A and B, determining the element association information of each component to be compared, determining the component type of each component to be compared according to the element association information of each component to be compared, determining a target component comparison rule according to the component type of the two components to be compared, determining a target element similarity in the element similarity set according to the element association information of the two components to be compared, generating a component similarity of the two components to be compared based on the target component comparison rule and the target element similarity, calculating the component similarity of all components between works A and B, and calculating the overall similarity of works A and B according to the component similarity of all components. By first calculating the element similarity between each element of the two works, and then calculating the component similarity between each component of the two works based on the element similarity, the repetition rate between the two works is calculated. This makes it possible to judge the repetition rate of two works based on the component similarity between each component, quickly judge the similarity between work A and work B, and reduce the time and manpower costs of manual identification.

[0146] Corresponding to the above method embodiment, the present application also provides a graphical interface processing device embodiment, Figure 5 FIG. 1 is a schematic diagram showing the structure of a graphical interface processing device provided by an embodiment of the present application. Figure 5 As shown, the device comprises:

[0147] A creation module 502 is configured to create an element comparison information set according to the attribute information of each element in the graphical interface, wherein the element comparison information set includes element comparison information between elements;

[0148] The acquisition module 504 is configured to acquire two components to be compared in the graphical interface and determine element association information of each component to be compared;

[0149] The determination module 506 is configured to determine a target component comparison rule according to the element association information of each component to be compared, and to determine target element comparison information in the element comparison information set, wherein the target element comparison information is comparison information between elements included in the two components to be compared;

[0150] The generating module 508 is configured to generate component comparison information of the two components to be compared based on the target component comparison rule and the target element comparison information.

[0151] Optionally, the device further comprises a conversion module configured to:

[0152] Determine that the type description information in the graphical interface belongs to an element to be converted of a type to be converted;

[0153] The type description information of the element to be converted is changed to a general type, and an element set corresponding to the graphical interface is created according to the general type of the element to be converted and the original elements in the graphical interface.

[0154] Optionally, the creation module 502 is further configured to:

[0155] Determine n elements in the element set, and generate m element pairs according to the n elements, where:

[0156] Determine element comparison information of each element pair according to the attribute information of each element;

[0157] Create an element comparison information collection based on each element comparison information.

[0158] Optionally, the creation module 502 is further configured to:

[0159] Determine whether the types of the two elements in the element pair to be compared are the same according to the attribute information corresponding to the two elements;

[0160] If yes, determine a target element comparison rule according to the types of the two elements, calculate a first comparison value of the to-be-compared element pair based on the target element comparison rule and the attribute information corresponding to each element, and use the first comparison value as element comparison information;

[0161] If not, determine that the second comparison value of the to-be-compared element pair is zero, and use the second comparison value as element comparison information.

[0162] Optionally, the determining module 506 is further configured to:

[0163] Determine the component type of each component to be compared according to the element association information of each component to be compared;

[0164] A target component comparison rule is determined according to the component types of the two components to be compared.

[0165] Optionally, the determining module 506 is further configured to:

[0166] Determine a first element corresponding to the first component to be compared according to the element association information of the first component to be compared;

[0167] Determine a second element corresponding to the second component to be compared according to the element association information of the second component to be compared;

[0168] determining a target element pair based on the first element and the second element;

[0169] Target element comparison information is determined in the element comparison information set according to the target element pair.

[0170] Optionally, the determining module 506 is further configured to:

[0171] Determine a third initial element comparison information set corresponding to the third component to be compared according to the element association information of the third component to be compared;

[0172] The fourth initial element comparison information corresponding to the fourth component to be compared is selected from the third initial element comparison information set according to the element association information of the fourth component to be compared, and is used as the target element comparison information.

[0173] Optionally, the determining module 506 is further configured to:

[0174] In a case where the component types of the two components to be compared are both element types, determining a target component comparison rule in the element comparison rule;

[0175] In a case where the component types of the two components to be compared include an element type, determining the element component comparison rule as the target component comparison rule;

[0176] In a case where the component types of the two components to be compared do not include an element type, the component comparison rule is determined to be a target comparison rule.

[0177] Optionally, the determining module 506 is further configured to:

[0178]

[0179] Among them, sim(a,b) is the element comparison information of component a and element b, area(m i ) is the area of ​​each element in component a.

[0180] Optionally, the determining module 506 is further configured to:

[0181]

[0182] Among them, sim(a,b) is the element comparison information of component a and component b, area(m i ) is the area of ​​each element in component a, area(n j ) is the area of ​​each element in component b.

[0183] Optionally, the device further comprises a classification module configured to:

[0184] Determining a reference component and a component to be classified among the two components to be compared;

[0185] The components to be classified are classified according to the component comparison information.

[0186] A graphical interface processing device provided by the present application includes: a creation module, configured to create an element comparison information set according to the attribute information of each element in the graphical interface, wherein the element comparison information set includes element comparison information between elements; an acquisition module, configured to acquire two components to be compared in the graphical interface, and determine the element association information of each component to be compared; a determination module, configured to determine a target component comparison rule according to the element association information of each component to be compared, and to determine target element comparison information in the element comparison information set, wherein the target element comparison information is the comparison information between the elements contained in the two components to be compared; and a generation module, configured to generate component comparison information of the two components to be compared based on the target component comparison rule and the target element comparison information. By first calculating the element comparison information between elements based on the attribute information of each element, and then determining the target component comparison rules and target element comparison information based on the element association information of each component to be compared, the component comparison information between components is calculated in a bottom-up manner, providing a reference basis for subsequent classification processing, improving the efficiency of classification processing, and reducing labor and time costs.

[0187] The above is a schematic scheme of a graphical interface processing device of this embodiment. It should be noted that the technical scheme of the graphical interface processing device and the technical scheme of the graphical interface processing method described above are of the same concept, and the details not described in detail in the technical scheme of the graphical interface processing device can be found in the description of the technical scheme of the graphical interface processing method described above.

[0188] Figure 6 The block diagram of a computing device 600 according to an embodiment of the present application is shown. The components of the computing device 600 include but are not limited to a memory 610 and a processor 620. The processor 620 is connected to the memory 610 via a bus 630, and the database 650 is used to store data.

[0189] The computing device 600 also includes an access device 640 that enables the computing device 600 to communicate via one or more networks 660. Examples of these networks include a public switched telephone network (PSTN), a local area network (LAN), a wide area network (WAN), a personal area network (PAN), or a combination of communication networks such as the Internet. The access device 640 may include one or more of any type of network interface (e.g., a network interface card (NIC)) whether wired or wireless, such as an IEEE 802.11 wireless local area network (WLAN) wireless interface, a World Wide Interoperability for Microwave Access (Wi-MAX) interface, an Ethernet interface, a universal serial bus (USB) interface, a cellular network interface, a Bluetooth interface, a near field communication (NFC) interface, and the like.

[0190] In one embodiment of the present application, the above components of the computing device 600 and Figure 6 Other components not shown in the figure may also be connected to each other, for example, via a bus. It should be understood that Figure 6 The computing device structure block diagram shown is only for the purpose of illustration, and is not intended to limit the scope of the present application. Those skilled in the art may add or replace other components as needed.

[0191] The computing device 600 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., a tablet computer, a personal digital assistant, a laptop computer, a notebook computer, a netbook, etc.), a mobile phone (e.g., a smart phone), a wearable computing device (e.g., a smart watch, smart glasses, etc.), or other types of mobile devices, or a stationary computing device such as a desktop computer or PC. The computing device 600 may also be a mobile or stationary server.

[0192] The processor 620 implements the steps of the graphical interface processing method when executing the computer instructions.

[0193] The above is a schematic scheme of a computing device of this embodiment. It should be noted that the technical scheme of the computing device and the technical scheme of the above-mentioned graphical interface processing method belong to the same concept, and the details not described in detail in the technical scheme of the computing device can be referred to the description of the technical scheme of the above-mentioned graphical interface processing method.

[0194] An embodiment of the present application further provides a computer-readable storage medium storing computer instructions, which implement the steps of the graphical interface processing method as described above when executed by a processor.

[0195] The above is a schematic scheme of a computer-readable storage medium of this embodiment. It should be noted that the technical scheme of the storage medium and the technical scheme of the above-mentioned graphical interface processing method belong to the same concept, and the details not described in detail in the technical scheme of the storage medium can be referred to the description of the technical scheme of the above-mentioned graphical interface processing method.

[0196] The above describes specific embodiments of the present application. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0197] The computer instructions include computer program codes, which may be in source code form, object code form, executable files or some intermediate forms, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer-readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0198] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described action sequence, because according to the present application, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.

[0199] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0200] The preferred embodiments of the present application disclosed above are only used to help explain the present application. The optional embodiments do not describe all the details in detail, nor do they limit the invention to the specific implementation methods described. Obviously, many modifications and changes can be made according to the content of the present application. The present application selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present application, so that those skilled in the art can understand and use the present application well. The present application is only limited by the claims and their full scope and equivalents.

Claims

1. A graphical interface processing method, characterized in that: include: Creating an element comparison information set according to the attribute information of each element in the graphical interface, wherein the element comparison information set includes element comparison information between elements; Obtain two components to be compared in the graphical interface, and determine element association information of each component to be compared; Determine a target component comparison rule according to the element association information of each component to be compared, and determine the target element comparison information in the element comparison information set, wherein the target element comparison information is the comparison information between the elements contained in the two components to be compared, and the target component comparison rule is selected and determined from the comparison rules of different component types, and the comparison rules of different component types include: element comparison rule, component element comparison rule and component comparison rule, and the target component comparison rule is any one of the element comparison rule, component element comparison rule and component comparison rule; Generate component comparison information of the two components to be compared based on the target component comparison rule and the target element comparison information; The component element comparison rule is the following formula, including: in, is the element comparison information of component a and element b, is the area of ​​each element in component a; Or the component comparison rule is the following formula, including: in, is the element comparison information of component a and component b, is the area of ​​each element in component a, is the area of ​​each element in component b.

2. The method according to claim 1, characterized in that The attribute information of the element to be converted includes type description information; Before creating the element comparison information set according to the attribute information of each element in the graphical interface, the method further includes: Determine that the type description information in the graphical interface belongs to an element to be converted of a type to be converted; The type description information of the element to be converted is changed to a general type, and an element set corresponding to the graphical interface is created according to the general type of the element to be converted and the original elements in the graphical interface.

3. The method according to claim 2, characterized in that According to the attribute information of each element in the graphical interface, create an element comparison information set, including: Determine n elements in the element set, and generate m element pairs according to the n elements, where: ; Determine element comparison information of each element pair according to the attribute information of each element; Create an element comparison information collection based on each element comparison information.

4. The method according to claim 3, characterized in that The element comparison information for any element pair is determined by the following methods, including: Determine whether the types of the two elements in the element pair to be compared are the same according to the attribute information corresponding to the two elements; If yes, determine a target element comparison rule according to the types of the two elements, calculate a first comparison value of the to-be-compared element pair based on the target element comparison rule and the attribute information corresponding to each element, and use the first comparison value as element comparison information; If not, determine that the second comparison value of the to-be-compared element pair is zero, and use the second comparison value as element comparison information.

5. The method according to claim 1, characterized in that Determining a target component comparison rule according to the element association information of the two components to be compared includes: Determine the component type of each component to be compared according to the element association information of each component to be compared; A target component comparison rule is determined according to the component types of the two components to be compared.

6. The method according to claim 1, characterized in that The two components to be compared include a first component to be compared and a second component to be compared; Correspondingly, determining the target element comparison information in the element comparison information set according to the element association information of the two components to be compared includes: Determine a first element corresponding to the first component to be compared according to the element association information of the first component to be compared; Determine a second element corresponding to the second component to be compared according to the element association information of the second component to be compared; determining a target element pair based on the first element and the second element; Target element comparison information is determined in the element comparison information set according to the target element pair.

7. The method according to claim 1, characterized in that The two components to be compared include a third component to be compared and a fourth component to be compared; Correspondingly, determining the target element comparison information in the element comparison information set according to the element association information of the two components to be compared includes: Determine a third initial element comparison information set corresponding to the third component to be compared according to the element association information of the third component to be compared; The fourth initial element comparison information corresponding to the fourth component to be compared is selected from the third initial element comparison information set according to the element association information of the fourth component to be compared, and is used as the target element comparison information.

8. The method according to claim 5, characterized in that Determining a target component comparison rule according to the component types of the two components to be compared includes: In a case where the component types of the two components to be compared are both element types, determining a target component comparison rule in the element comparison rule; In a case where the component types of the two components to be compared include an element type, determining the element component comparison rule as the target component comparison rule; In a case where the component types of the two components to be compared do not include an element type, the component comparison rule is determined to be a target comparison rule.

9. The method according to any one of claims 1 to 8, characterized in that: The method further comprises: Determining a reference component and a component to be classified among the two components to be compared; The components to be classified are classified according to the component comparison information.

10. A graphical interface processing device, characterized in that: include: A creation module is configured to create an element comparison information set according to the attribute information of each element in the graphical interface, wherein the element comparison information set includes element comparison information between elements; An acquisition module is configured to acquire two components to be compared in the graphical interface and determine element association information of each component to be compared; The determination module is configured to determine the target component comparison rule according to the element association information of each component to be compared, and to determine the target element comparison information in the element comparison information set, wherein the target element comparison information is the comparison information between the elements contained in the two components to be compared, and the target component comparison rule is selected and determined from the comparison rules of different component types, and the comparison rules of different component types include: element comparison rule, component element comparison rule and component comparison rule, and the target component comparison rule is any one of the element comparison rule, component element comparison rule and component comparison rule, wherein the component element comparison rule is the following formula, including: in, is the element comparison information of component a and element b, is the area of ​​each element in component a; Or the component comparison rule is the following formula, including: in, is the element comparison information of component a and component b, is the area of ​​each element in component a, is the area of ​​each element in component b; A generating module is configured to generate component comparison information of the two components to be compared based on the target component comparison rule and the target element comparison information.

11. A computing device comprising a memory, a processor, and computer instructions stored in the memory and executable on the processor, characterized in that: When the processor executes the computer instructions, the steps of the method according to any one of claims 1 to 9 are implemented.

12. A computer-readable storage medium storing computer instructions, characterized in that: When the computer instructions are executed by a processor, the steps of the method described in any one of claims 1 to 9 are implemented.

13. A computer program product, characterized in that The method comprises computer instructions which, when executed by a processor, implement the steps of the method according to any one of claims 1 to 9.