Icon processing method and device, electronic equipment, storage medium and product
By matching preset icons from the pages to be processed and combining them with page description information, the meaning of the icons is obtained using a large language model, which solves the problem of low efficiency in determining the meaning of icons in the existing technology and achieves more efficient and accurate determination of the meaning of icons.
Patent Information
- Application Number
- CN202411136254.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-19
- Publication Date
- 2026-03-03
AI Technical Summary
In existing technologies, determining the meaning of icons relies on manual binding, which is inefficient and cannot efficiently and accurately determine the meaning of icons.
By identifying the icon to be processed from the page to be processed, matching the preset icon and obtaining the meaning information of the first icon, and combining it with the page description information, a larger language model and Figma plugin are used to obtain a more accurate icon meaning.
It improves the efficiency and accuracy of determining the meaning of icons, enabling faster and more accurate acquisition of the meaning information of icons on the page.
Smart Images

Figure CN121597206A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of Internet communication technology, and in particular to an icon processing method, apparatus, electronic device, storage medium and product. Background Technology
[0002] With the development of internet communication technology, various applications are emerging in an endless stream, enriching users' work and lives. The icons on application pages are also becoming increasingly diverse. In application development and maintenance, it is often necessary to determine the meaning of these icons. In related technologies, staff typically bind corresponding meaning information to icons, retrieving the meaning information based on this binding relationship when determining the meaning of a particular icon. However, this method of determining icon meaning relies on the staff's prior meaning binding, which is inefficient. Therefore, a more efficient solution for determining icon meaning is needed. Summary of the Invention
[0003] To address at least one of the aforementioned technical problems, this application provides an icon processing method, apparatus, electronic device, storage medium, and product:
[0004] According to a first aspect of this application, an icon processing method is provided, the method comprising:
[0005] Identify the icons to be processed from the pending pages;
[0006] The target icon that matches the icon to be processed is determined from a plurality of preset icons, and the first icon meaning information of the target icon is obtained;
[0007] Obtain page description information that describes the entire page to be processed;
[0008] The second icon meaning information of the icon to be processed is determined based on the first icon meaning information and the page description information.
[0009] According to a second aspect of this application, an icon processing apparatus is provided, the apparatus comprising:
[0010] Icon Determination Module: Used to determine the icons to be processed from the page to be processed;
[0011] First icon meaning information acquisition module: used to determine the target icon that matches the icon to be processed from a plurality of preset icons, and to acquire the first icon meaning information of the target icon;
[0012] Page description information acquisition module: used to acquire page description information that describes the entire page to be processed;
[0013] The second icon meaning information determination module is used to determine the second icon meaning information of the icon to be processed based on the first icon meaning information and the page description information.
[0014] According to a third aspect of this application, an electronic device is provided, the electronic device including at least one processor and a memory communicatively connected to the at least one processor; wherein the memory stores at least one instruction or at least one program, the at least one instruction or at least one program being loaded and executed by the at least one processor to implement the icon processing method as described in the first aspect.
[0015] According to a fourth aspect of this application, a computer-readable storage medium is provided, wherein at least one instruction or at least one program is stored therein, the at least one instruction or at least one program being loaded and executed by a processor to implement the icon processing method as described in the first aspect.
[0016] According to a fifth aspect of this application, a computer program product is provided, the computer program product comprising at least one instruction or at least one program segment, the at least one instruction or at least one program segment being loaded and executed by a processor to implement the icon processing method as described in the first aspect.
[0017] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this application.
[0018] Implementing this application will have the following beneficial effects:
[0019] This application provides a more efficient and accurate scheme for determining the meaning of icons. The application first identifies the icon to be processed from the page to be processed; then, it identifies a target icon matching the icon to be processed from multiple preset icons, and obtains the first icon meaning information of the target icon; furthermore, it obtains page description information describing the entire page to be processed; finally, it determines the second icon meaning information of the icon to be processed based on the first icon meaning information and the page description information. This application not only focuses on the meaning information at the icon level but also on the global description information at the page level of the page containing the icon, thus improving the accuracy of the obtained meaning information of the icon to be processed.
[0020] Other features and aspects of this application will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description
[0021] To more clearly illustrate the technical solutions and advantages in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0022] Figure 1 This diagram illustrates an application environment according to an embodiment of the present application.
[0023] Figure 2 A flowchart illustrating an icon processing method according to an embodiment of this application is shown;
[0024] Figure 3 A flowchart illustrating the determination of a target icon according to an embodiment of this application is shown;
[0025] Figure 4 This diagram illustrates a process for obtaining page description information according to an embodiment of this application.
[0026] Figure 5 A schematic diagram illustrating the process of obtaining a guide template according to an embodiment of this application is shown;
[0027] Figure 6 An interface diagram showing the meaning information of public icons according to an embodiment of this application;
[0028] Figure 7 A schematic diagram showing a page to be processed according to an embodiment of this application;
[0029] Figure 8 An interface diagram illustrating the meaning of the comparison icons according to an embodiment of this application;
[0030] Figure 9 This diagram illustrates a device block diagram according to an embodiment of the present application;
[0031] Figure 10 A schematic diagram of an electronic device according to an embodiment of this application is shown. Detailed Implementation
[0032] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.
[0033] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or server that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or devices.
[0034] In this application embodiment, the terms "module" or "unit" refer to a computer program or part of a computer program that has a predetermined function and works with other related parts to achieve a predetermined goal, and can be implemented wholly or partially using software, hardware (such as processing circuitry or memory), or a combination thereof. Similarly, a processor (or multiple processors or memory) can be used to implement one or more modules or units. Furthermore, each module or unit can be part of an overall module or unit that includes the functionality of that module or unit.
[0035] Various exemplary embodiments, features, and aspects of this application will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.
[0036] The term “exemplary” as used herein means “serving as an example or embodiment.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.
[0037] In this document, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Furthermore, the term "at least one" in this document means any combination of at least two of any one or more elements. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.
[0038] Furthermore, to better illustrate this application, numerous specific details are provided in the following detailed description. Those skilled in the art should understand that this application can be implemented without certain specific details. In some instances, methods, means, components, and circuits well-known to those skilled in the art have not been described in detail in order to highlight the main points of this application.
[0039] Before providing a further detailed description of the embodiments of this application, the nouns and terms involved in the embodiments of this application will be explained, and the nouns and terms involved in the embodiments of this application shall be interpreted as follows.
[0040] ICON: Refers to "icon," which is a graphic symbol used to represent applications, files, folders, or other computer operations. Icons are usually simple, easy to recognize, and help users quickly find the information or action they need.
[0041] Large Language Model (LLM): This is an artificial intelligence model with a huge number of parameters and computational complexity. It requires large-scale computing resources for training and inference and can be used in various application scenarios, such as natural language processing, computer vision, and speech recognition.
[0042] Prompt: Instructions or questions given to a large language model to guide the model in generating specific outputs.
[0043] Figma is a cloud-based collaborative design tool that allows designers and teams to collaborate and edit within the same design file.
[0044] Figma plugins are third-party tools that enhance the functionality of Figma. Developed by the Figma community, they can be downloaded and installed from the Figma plugin repository. Figma plugins help designers complete design tasks more efficiently, improving design productivity. They can be used for various purposes, such as automating repetitive tasks, adding new design features, and integrating with other design tools. Figma plugins can interact with Figma design files through the Figma API, allowing them to access and edit various elements within the Figma file, such as layers, components, text, colors, and styles.
[0045] Automated testing refers to the process of executing test cases and verifying the correctness and performance of an application by writing scripts or using automated testing tools. Automated testing can reduce human error and testing time, and improve testing efficiency and test coverage.
[0046] Please see Figure 1 , Figure 1The left-hand diagram illustrates an application environment according to an embodiment of this application. The application environment may include a terminal 10 and a server 20. The terminal 10 and server 20 can be directly or indirectly connected via wired or wireless communication. A target object (e.g., a target user) sends an icon processing request to the server 20 through the terminal 10. Based on the received icon processing request, the server 20 determines the icon to be processed from the page to be processed; then, it determines the target icon matching the icon to be processed from a plurality of preset icons, and obtains the first icon meaning information of the target icon; furthermore, it obtains page description information describing the entire page to be processed; finally, it determines the second icon meaning information of the icon to be processed based on the first icon meaning information and the page description information. It should be noted that... Figure 1 The diagram on the left is merely an example.
[0047] Terminal 10 can be a physical device such as a smartphone, computer (e.g., desktop computer, tablet computer, laptop computer), augmented reality (AR) / virtual reality (VR) device, digital assistant, smart voice interaction device (e.g., smart speaker), smart wearable device, smart home appliance, in-vehicle terminal, etc. The operating system of Terminal 10 can be Android, iOS (a mobile operating system developed by Apple), Linux, Microsoft Windows, etc. Applications can be installed on Terminal 10, such as video applications, browser applications, news feed applications, game applications, navigation applications, etc.
[0048] The server-side component 20 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server providing basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), and big data and artificial intelligence platforms. The server may include network communication units, processors, and memory, etc.
[0049] In practical applications, the icon processing steps described above, from "determining the icon to be processed from the page to be processed" to "determining the second icon meaning information of the icon to be processed based on the first icon meaning information and the page description information," can be performed by either the server or the terminal. Alternatively, the server and terminal can interact and jointly participate in the execution of the icon processing steps. Furthermore, as... Figure 1As shown in the diagram on the right, the terminal can also provide a question-and-answer interface for icons to the target audience (such as the target user). For example, for icon i, the user's question i could be "What is the meaning of icon i located on page i?", and the user's answer i could be "The meaning of icon i located on page i is xxx". Alternatively, the user's question i could be "The meaning of icon i's icon dimension is yyy, the global description information of page i is zzz, what is the meaning of icon i located on page i?", and the user's answer i could be "The meaning of icon i located on page i is xxx".
[0050] It should be noted that for pending pages that are related to user information, when the embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of related data must comply with the relevant laws, regulations and standards of the relevant countries and regions.
[0051] Figure 2 This diagram illustrates a flowchart of an icon processing method according to an embodiment of this application. Figure 2 As shown, this icon processing method can be executed by an electronic device, which can be a terminal or a server. The method includes:
[0052] S201: Identify the icons to be processed from the pending page;
[0053] In this embodiment, the electronic device determines an icon to be processed from a page to be processed. The number of icons to be processed determined from the page to be processed can be one or more. When the number of icons to be processed is greater than one, meaning information can be obtained for each icon through steps S202-S204 described later. The page to be processed includes at least one icon, which can be an icon randomly determined from at least one icon. Alternatively, the icon to be processed can be an icon determined from at least one icon according to a preset filtering rule, which is used to constrain the conditions that the selected icon should meet.
[0054] Icons are commonly used to convey information to users. An icon can be a single image, or it can consist of an image and a label (or title) to help users better understand its meaning. The label (or title) can be text. Icons can convey information to users and also receive user-triggered actions. Accordingly, icons can be categorized into control icons and non-control icons. Control icons, in particular, can receive user-triggered actions.
[0055] In practical applications, the page to be processed can be a Figma design draft obtained by staff using Figma, which can be used as a reference. Figure 7Figma prototypes can be used to create and share UI designs, prototypes, icons, illustrations, and other design elements. Typically, prototypes serve as the primary source of data for business requirements, with staff describing all elements of the page, including data for various icon types.
[0056] S202: Determine the target icon that matches the icon to be processed from a plurality of preset icons, and obtain the first icon meaning information of the target icon;
[0057] In this embodiment, the electronic device determines a target icon that matches the icon to be processed from a plurality of preset icons, and obtains the first icon meaning information of the target icon. Determining whether the icon to be processed matches a preset icon can be achieved by calculating icon similarity. The similarity between the icon to be processed and each preset icon can be calculated separately to obtain multiple similarities; then, the preset icon corresponding to the highest similarity among the multiple similarities is determined as the target icon.
[0058] Based on the description of icons in step S201 above, when the icon is a pure image, multiple preset pure image icons can be identified from multiple preset icons as candidate sources for the target icon. Alternatively, the multiple preset icons can be divided into multiple preset pure image icons and multiple preset non-pure image icons. The similarity between the icon to be processed and each preset pure image icon is calculated to obtain multiple first-type similarities. The similarity between the icon to be processed and the image portion of each preset non-pure image icon is calculated to obtain multiple second-type similarities. Considering the neglect of labels (or titles) in information transmission, the second-type similarities can be adjusted using preset coefficients to obtain third-type similarities. The preset coefficients can be values greater than 0 and less than 1, and can be adjusted by multiplying the second-type similarities. Correspondingly, the target icon is the preset icon corresponding to the maximum similarity among the multiple first-type and multiple third-type similarities.
[0059] When the icon is not a pure image, the similarity between the image portion of the icon to be processed and the image portion of each preset icon can be calculated separately to obtain multiple image similarities. Similarly, the similarity between the text portion of the icon to be processed and the text portion of each preset icon can be calculated separately to obtain multiple text similarities. Considering that the image contributes more to information delivery than the label (or title) image, a greater image weight is assigned than the text weight. For each preset icon, a corresponding representation similarity can be obtained based on image similarity, image weight, text similarity, and text weight, for example, representation similarity = image similarity * image weight + text similarity * text weight. Correspondingly, the target icon is the preset icon corresponding to the highest similarity among the multiple representation similarities.
[0060] In practical applications, when using a Figma design draft as the page to be processed, the icon to be processed can be taken from the public design component library. Correspondingly, the association between the icon to be processed and the target public icon in the public design component library can be determined through the Figma plugin API, thereby obtaining the meaning information of the target public icon and achieving the acquisition of the first icon's meaning information. The meaning information of the public icons in the public design component library can reflect the basic meaning and design purpose of the public icon, such as search, plus sign, information, editing, and purpose, etc., which can be referenced. Figure 6 .
[0061] As one possible implementation, such as Figure 3 As shown, determining the target icon that matches the icon to be processed from a plurality of preset icons includes:
[0062] S301: Determine a plurality of first candidate icons from the plurality of preset icons, wherein the page type of the page where the first candidate icon is located is the same as the page type of the page to be processed;
[0063] S302: Determine the target icon that matches the icon to be processed from the plurality of first candidate icons.
[0064] For each preset icon, it can be determined whether the page type of the page containing the preset icon is the same as the page type of the page to be processed. Then, preset icons whose page type is the same as the page type of the page to be processed are selected as first candidate icons. Determining multiple first candidate icons based on whether the page type of the icon is the same takes into account the need for the icon to adapt to its page context while narrowing the candidate range to support the efficiency of target icon selection. The page type can be determined based on the page's display theme, such as calendar type or meeting type; the page type can also be determined based on the type of application to which the page belongs, such as indicating the video type for a video application or the game type for a game application. Of course, the page type can be flexibly set according to actual business needs. When there are at least two page types for the page to be processed, the page type of the page containing the first candidate icon is the same as the target page type. The target page type can be any of the at least two page types.
[0065] The meaning information of the preset icons is known. Multiple preset icons may include default icons that do not have page attributes and newly added icons that do have page attributes. The meaning information of the default icons is based on the fundamental meaning of the specific page on which the icon resides. The meaning information of the newly added icons takes into account the specific meaning of the specific page on which the icon resides, such as the meaning information determined through the embodiments of this application. Accordingly, default icons can be excluded first. Then, for each newly added icon, it can be determined whether the page type of the page on which the newly added icon resides is the same as the page type of the page to be processed. Then, newly added icons whose page type is the same as the page type of the page on which the icon resides are selected as first candidate icons.
[0066] Furthermore, the multiple preset icons are simultaneously stored by a first storage module and a second storage module. The first storage module includes storage units of multiple page type dimensions. Each storage unit stores multiple candidate icons. The multiple candidate icons are located on pages of the same page type, and the multiple candidate icons belong to the multiple preset icons.
[0067] For the aforementioned step S301, determining a plurality of first candidate icons from the plurality of preset icons includes: determining a matching target storage unit from the first storage module based on the page type of the page to be processed, wherein the page type corresponding to the target storage unit is the same as the page type of the page to be processed; determining the plurality of candidate icons stored in the target storage unit as the plurality of first candidate icons; correspondingly, after determining a plurality of first candidate icons from the plurality of preset icons, the method further includes: if there is no icon matching the icon to be processed among the plurality of first candidate icons, using the icons stored in the second storage module as candidates, and performing matching for the icon to be processed.
[0068] It's understandable that a two-level storage system is used for multiple preset icons. The first level is a global save of all preset icons, while the second level uses multiple local saves to achieve overall storage of all preset icons. The local saves are based on the page type of the page containing the icon. This two-level storage setup balances the effectiveness of icon storage with the flexibility of icon maintenance. When matching an image to be processed, priority is given to storage units in the first storage module that share the same page type as the page to be processed. If a match using icons stored in the first storage module fails, then icons stored in the second storage module are used as candidates for matching the image to be processed. The page type-based storage unit setting in the first storage module helps improve matching efficiency.
[0069] In practical applications, when matching icons stored in the first storage module fails, associated storage units can be determined from the remaining storage units in the first storage module (excluding the target storage unit) based on the page type of the page to be processed. This allows for the identification of multiple candidate icons stored in the associated storage units as multiple first candidate icons. The page type corresponding to the associated storage unit is related to the page type of the page to be processed. For example, page type 1 is a schedule type, and page type 2 is a meeting type. Both page type 1 and page type 2 indicate branch businesses of online office services, thus page type 1 and page type 2 are related.
[0070] As a possible implementation, combining the above-mentioned determination of the preset icon corresponding to the maximum similarity among multiple similarities as the target icon, and considering that the maximum similarity may be less than the lower similarity limit, leading to failure in determining the target icon, this approach uses local elements of the icon to be processed as anchor points to locate a second candidate icon from multiple preset icons, and then obtains the first icon meaning information based on the candidate icon meaning information of the second candidate icon. Compared to using the meaning information of a target icon with low similarity to the icon to be processed as the first icon meaning information, an icon set with at least one second candidate icon as a whole is more consistent with the icon to be processed, and the first icon meaning information obtained based on the meaning information of at least one candidate icon is also more accurate. At the same time, the utilization of local elements makes it easier to capture meaning information, thereby improving the richness of the first icon meaning information to support the accuracy of subsequent icon meaning determination. Specifically, after determining the icon to be processed from the page to be processed, the method may further include the following steps: First, if no icon matching the icon to be processed exists among the plurality of preset icons, for each local element of the icon to be processed, a second candidate icon matching the local element is determined from the plurality of preset icons, and the candidate icon meaning information of the second candidate icon is obtained; then, based on the candidate icon meaning information corresponding to each local element, the first icon meaning information is obtained. The icon to be processed is divided into at least two segmentation objects, and a local element can be composed of at least one segmentation object. Two different local elements can both include the same segmentation object.
[0071] In practical applications, this method of obtaining the meaning information of the first icon by using local elements as anchor points is effectively suitable for situations where the icon to be processed is a superimposed icon appearing for the first time. For example, the icon to be processed is the result of superimposing preset icon i and preset icon j. Preset icon i is determined as the second candidate icon by using one local element of the icon to be processed, and preset icon j is determined as the second candidate icon by using another local element of the icon to be processed. In this case, the meaning information of the first icon is obtained based on the meaning information of preset icon i and preset icon j.
[0072] S203: Obtain page description information that describes the global state of the page to be processed;
[0073] In this embodiment, the electronic device acquires page description information that describes the entire page to be processed. The page description information can characterize a global description of the page to be processed. It can reflect the page layout and displayed content of the page. The page description information helps determine the page context in which the icon to be processed is located, thus improving the relevance and adaptability of icon meaning determination with richer reference information. This is because if two pages have the same icon, but the page contexts they provide are different, the meaning of the icon may also differ.
[0074] As one possible implementation, such as Figure 4 As shown, obtaining the page description information describing the global state of the page to be processed includes:
[0075] S401: Based on the element text content of each of the multiple page elements in the page to be processed, obtain the page text content;
[0076] S402: Obtain the page structure information of the page to be processed;
[0077] S403: The page description information is obtained by merging the page text content and the page structure information.
[0078] Page elements are the elements on the page to be processed that fulfill interactive requirements. Page elements can be icons, views, controls, windows, dialog boxes, menus, scrollbars, etc. This section uses page elements as the content capture object and text content as the content capture requirement, providing methods for obtaining page text content. The text content of page elements can be represented as text, numbers, letters, etc. Element text content can be taken from text objects that constitute the page element, such as text labels taken from non-pure image icons. Element text content can be obtained by transforming non-text objects that constitute the page element. Using text content to reflect the displayed content of the page to be processed can improve the convenience of using page description information to determine icon meaning; for example, parts of the text content can be directly used to generate meaning information. The page structure information of the page to be processed can characterize the page's layout. Page structure information can record the position information of each page element on the page to be processed and its relationships with other page elements, such as parent-child relationships. Page description information is obtained by integrating page text content and page structure information. This helps to reflect the page to be processed more comprehensively from the perspectives of text content and page layout, thereby supporting the determination of the page scene where the icon to be processed is located through page description information.
[0079] Furthermore, when merging page text content and page structure information, non-visual elements can be excluded from multiple page elements to filter out multiple visible elements. This can be achieved based on the transparency configuration information of page elements. For page text content, target text content can be filtered from multiple visible elements, reflecting the individual text content of each visible element. For page structure information, target structure information can be filtered from multiple visible elements, recording the position information of each visible element on the page to be processed and its parent-child relationships with related page elements. Accordingly, page description information is obtained based on the target text content and target structure information.
[0080] In practical applications, when using a Figma design as the page to be processed, a global page description can be obtained through the Figma plugin API. The Figma plugin API allows filtering based on the type and visual attributes of page elements to extract area images containing all visual icons. Then, using the Figma plugin API, the image text content is obtained based on the individual element text content of each visual icon within the area image. This image text content is then combined with the page structure information of the page to be processed to obtain the page description information. The page structure information is also obtained through the Figma plugin API. The page structure information can be organized in a tree structure, either from top to bottom or left to right. This allows the page description information to reflect the current state of the Figma design.
[0081] S204: Determine the second icon meaning information of the icon to be processed based on the first icon meaning information and the page description information.
[0082] In this embodiment, the electronic device determines the second icon meaning information of the icon to be processed based on the first icon meaning information and the page description information. The first icon meaning information contributes to the meaning information of the icon dimension, while the page description information contributes to the global description information of the page dimension of the page where the icon is located. Determining the second icon meaning information based on these two factors can improve the accuracy of the obtained meaning information of the icon to be processed.
[0083] like Figure 7 As shown, the page to be processed is the schedule homepage, which displays the calendar and a list of scheduled meetings for the day. If the first icon of the target icon indicates "Search," then the second icon of the page to be processed indicates the "Search Button" on the schedule page (used to search for user-scheduled events / meetings). If the first icon of the target icon indicates a "Plus Sign," then the second icon of the page to be processed indicates the "Add Event / Meeting Button" on the schedule page (used to add a new event / meeting).
[0084] As a possible implementation, determining the second icon meaning information of the icon to be processed based on the first icon meaning information and the page description information may include the following steps: taking the icon to be processed, the first icon meaning information, the page description information, and a preset prompt text as input, and using a target model to output the second icon meaning information, wherein the preset prompt text is used to prompt the generation of the meaning information of the icon to be processed based on the first icon meaning information and the page description information.
[0085] The application of the target model can improve the efficiency of icon meaning determination while supporting more accurate acquisition of meaning information for the icons to be processed. It can be understood that the target model adopts a large language model. The large language model outputs information guided by preset prompt text. The output target of the large language model is the meaning information of the icons to be processed. To output the meaning information of the icons to be processed, the large language model refers to the icon to be processed, the meaning information of the first icon, and the page description information. Through the understanding and reasoning of the large language model, the meaning information of the icon to be processed can be the semantic meaning of the icon to be processed that matches the page to be processed. The output meaning information of the icon to be processed can be in JSON format. The icon to be processed and the second meaning information can be stored subsequently, such as through caching. Of course, the page identifier or page type of the page to be processed can also be stored together with the icon to be processed and the second meaning information.
[0086] The pre-defined prompt text can guide the output of the large language model, and this can be handled by the input prompt. The aforementioned icon to be processed, the meaning information of the first icon, and the page description information can be considered as components of a prompt. The prompt input to the large language model is as follows: "You are a professional page designer. Please use your professional knowledge to answer my question. Generate the meaning information of the icon to be processed based on the [meaning information of the first icon] and the [page description information]."
[0087] Furthermore, such as Figure 5 As shown, the method further includes:
[0088] S501: Determine multiple target information groups from the information group set. Each information group consists of historical prompt text input to the target model and historical meaning information output by the target model. The source page type and the target icon indicated by the historical prompt information contained in each of the multiple target information groups are the same.
[0089] S502: Using the multiple target information groups and the summary prompt text as input, the target model is used to summarize the multiple target information groups to obtain a template that guides the target model to output meaningful information.
[0090] Combining the input and output data of the large language model from step S204 above, the input data can be considered as questions, and the output data as answers. Thus, the input and output data together constitute a question-and-answer session. The information group set represents multiple historical question-and-answer sessions. Multiple target information groups represent multiple selected target historical question-and-answer sessions from multiple historical question-and-answer sessions. Each of the questions in multiple target historical question-and-answer sessions targets an icon in the same page type source page (i.e., the page to be processed). The target icons (i.e., the icons to be processed) targeted by the questions in multiple target historical question-and-answer sessions are the same. For example, target historical question-and-answer 1 is the question and answer for icon 1 on page 1, and target historical question-and-answer 2 is the question and answer for icon 3 on page 2. Page 1 and page 2 have the same page type. Icon 1 and icon 2 are the same.
[0091] The large language model's induction is based on multiple target historical question-and-answer sets, and its induction is guided by induction prompt text. The large language model outputs information guided by this prompt text. The output target of the large language model is a guiding template, which guides the model to output the meaning information of the icons to be processed. It should be understood that because the source page type and target icon are the same, multiple target historical question-and-answer sets have a basis for induction. For a single target historical question-and-answer set, its description of the icon's meaning may have semantic or business-related defects. Semantic defects may include colloquial language, inaccurate word choice, or missing descriptive terms. Business-related defects may include word choice that does not fit the business context or includes irrelevant information. To address shortcomings in responses to individual target historical questions, such as colloquialisms, inaccurate word choice, and mismatch between descriptive terms and business context, summarizing multiple target historical questions and answers allows for the identification of better-performing descriptive terms as template elements. Conversely, summarizing multiple poorly performing descriptive terms can help identify better-performing ones for use as template elements. Similarly, addressing deficiencies like missing descriptive terms in specific aspects of responses to individual target historical questions and answers allows for the identification of multiple aspects to be described as template elements based on the intent of the descriptive terms, thus constraining the generation of semantic information. Furthermore, addressing deficiencies like irrelevant information in descriptive terms in responses to individual target historical questions and answers allows for the filtering of multiple descriptive terms containing irrelevant information, serving as exclusion words for template indication. This guided template approach helps solidify the format and content of returned responses. Utilizing multiple target historical questions and answers can improve the quality of responses from large language models to similar questions and reduce the illusions caused by large speech models.
[0092] In practical applications, 1) when identifying multiple target information groups from the information group set, feedback information corresponding to the historical meaning information output by the large language model in the information group can also be considered to ensure the quality of the target information groups. 2) The identified high-quality target information groups can not only serve as a basis for induction to help the large language model output guidance templates, but also as prompt samples to help the large language model output icon meanings based on a small number of prompts, thus improving the accuracy of the obtained icon meanings. For example, target historical question and answer 1 is the question and answer for icon 1 on page 1, and target historical question and answer 2 is the question and answer for icon 3 on page 2. The page types of page 1, page 2, and the page to be processed are all the same. Icon 1, icon 2, and the icon to be processed are all the same. The preset prompt text can be responsible for guiding the output of the large language model by the prompt as input. The icon to be processed, the meaning information of the first icon, the page description information, target historical question and answer 1, and target historical question and answer 2 can be the constituent elements of a prompt. The prompt for the large language model is as follows: "You are a professional page designer. Please answer my questions using your professional knowledge and referring to [Target History Q&A 1] and [Target History Q&A 2]. Generate the [Meaning Information] of the [Icons to be Processed] based on the [First Icon Meaning Information] and the [Page Description Information]."
[0093] As one possible implementation, after determining the meaning of the icons, the secondary icon meaning information of the icons to be processed can be used in the testing phase to support the development and maintenance of related applications. The application of the secondary icon meaning information in the testing phase can be reflected in the updating or generation of test cases. More efficient icon meaning determination can support more efficient acquisition of test cases, thereby improving the timeliness of testing. The methods for obtaining test cases will be described below:
[0094] 1) Obtain a first test case for a benchmark page, wherein the benchmark page and the page to be processed indicate the previous version and the current version of the same page, respectively; and, based on the meaning information of the second icon and the association between the icon to be processed and the benchmark icon in the benchmark page, update the first test case to obtain a second test case for the page to be processed.
[0095] For example, the baseline page is page 1, and the page to be processed is page 2. Page 1 and page 2 indicate version 1 and version 2 of the target page, respectively. The baseline icon in page 1 can be icon a, and the icon to be processed in page 2 can be icon b. The relationship between icon a and icon b can be a substitution relationship. When updating the first test case, the sub-test cases related to icon a can be replaced with sub-test cases related to icon b, where the construction of the sub-test cases related to icon b can refer to the meaning information of icon b. For example, the page scenarios provided by page 1 and page 2 are both schedule management scenarios. The meaning information of icon a indicates schedule search, and the meaning information of icon b indicates schedule editing. Sub-test case 1 in the first test case (focusing on whether test icon a can effectively convey information about schedule search) can be replaced with sub-test case 2 (focusing on whether test icon b can effectively convey information about schedule editing).
[0096] The relationship between icons a and b can be a collaborative one. When updating the first test case, sub-test cases related to icon b can be added to the first test case, creating a linkage between these sub-test cases and the sub-test cases related to icon a in the first test case. The construction of the sub-test cases related to icon b can refer to the meaning information of icon b and the collaborative relationship between icons a and b. For example, both page 1 and page 2 provide a leave application scenario. The meaning information of icon a indicates the leave type selection, and the meaning information of icon b indicates the leave duration to be filled in. Sub-test case 2 (which focuses on whether icon a effectively conveys the candidate leave types and guides the user to select one of the leave types through a trigger operation) can be placed after sub-test case 1 in the first test case (which focuses on whether icon b effectively conveys the information regarding the leave duration and guides the user to fill in the duration required for the selected leave type).
[0097] Furthermore, considering that version differences between the baseline page and the page to be processed may be caused by at least two pending icons, the pending icon dimensions can be updated sequentially based on the previous update results until the pending icon dimensions corresponding to each pending icon are updated, thereby obtaining a second test case for the page to be processed. The initial update of the pending icon dimensions is based on the first test case, and the update instruction for the pending icon dimensions is "to update the test case based on the meaning information of the pending icon and the association between the pending icon and the baseline icon in the baseline page."
[0098] Taking Figma design drafts as the page to be processed as an example, after the version update is completed, Figma can use webhook capabilities to push (such as pushing a link to Figma design drafts), which can improve the timeliness of obtaining Figma design drafts, support the synchronization of icon meaning updates in Figma design drafts with business iterations, and support automated testing.
[0099] 2) Generate target test cases for the icon to be processed based on the meaning information of the second icon. The target test cases generated in this way focus on the icon itself, which can improve the flexibility of icon-level testing.
[0100] In practical applications, automated testing often requires manipulating icons of various control types on a webpage. The aforementioned method for determining the meaning of icons can effectively adapt to the increasing variety of icon meanings, such as multiple icons corresponding to different development implementations. It can effectively support the stable execution of automated testing and reduce the frequency of difficulties in automated testing due to inaccurate icon meaning determination. In automated testing of page icons for online office applications, the icon meanings obtained through the icon processing method provided in this application have been used in the updating or generation of 20,000 test cases, greatly improving testing efficiency.
[0101] Furthermore, after obtaining the meaning information of the second icon of the icon to be processed, it can be compared with the stored preset icons. For example... Figure 8 As shown, the reporting icon corresponds to the icon to be processed, and the matching icon corresponds to the preset icon that has been matched. Of course, in automated testing, when testing the page to be processed, the test script or automated testing tool can also compare the meaning information of the second icon of the icon to be processed with the stored preset icon to update or generate relevant test cases.
[0102] As can be seen from the technical solutions provided by the embodiments of this application above, the embodiments of this application provide a more efficient and accurate method for determining the meaning of icons. The embodiments of this application determine the icon to be processed from the page to be processed; then, determine the target icon that matches the icon to be processed from multiple preset icons, and obtain the first icon meaning information of the target icon; furthermore, obtain page description information describing the entire page to be processed; finally, using the icon to be processed, the first icon meaning information, the page description information, and preset prompt text as input, output the second icon meaning information of the icon to be processed using a large language model. The embodiments of this application not only focus on the meaning information at the icon level, but also on the global description information at the page level of the page where the icon is located, thus improving the accuracy of the obtained meaning information of the icon to be processed.
[0103] This application also provides an icon processing device, such as... Figure 9 As shown, the icon processing device 90 includes:
[0104] Icon determination module 901: Used to determine the icon to be processed from the page to be processed;
[0105] First icon meaning information acquisition module 902: used to determine the target icon that matches the icon to be processed from a plurality of preset icons, and to acquire the first icon meaning information of the target icon;
[0106] Page description information acquisition module 903: used to acquire page description information that describes the global state of the page to be processed;
[0107] Second icon meaning information acquisition module 904: used to determine the second icon meaning information of the icon to be processed based on the first icon meaning information and the page description information.
[0108] In one embodiment, determining the second icon meaning information of the icon to be processed based on the first icon meaning information and the page description information includes: taking the icon to be processed, the first icon meaning information, the page description information, and a preset prompt text as input, and using a target model to output the second icon meaning information, wherein the preset prompt text is used to prompt the generation of the meaning information of the icon to be processed based on the first icon meaning information and the page description information.
[0109] In one embodiment, the apparatus further includes:
[0110] Information group determination module: used to determine multiple target information groups from the information group set. The information group consists of the historical prompt text input to the target model and the historical meaning information output by the target model. The source page type and the target icon indicated by the historical prompt information contained in each of the multiple target information groups are the same.
[0111] Template acquisition module: Used to take the multiple target information groups and the summary prompt text as input, and use the target model to summarize the multiple target information groups to obtain a template that guides the target model to output meaningful information.
[0112] In one embodiment, obtaining page description information describing the global state of the page to be processed includes: obtaining page text content based on the element text content of each of the multiple page elements in the page to be processed; obtaining page structure information of the page to be processed; and fusing the page text content and the page structure information to obtain the page description information.
[0113] In one embodiment, the apparatus further includes:
[0114] The first type of test case generation module is used to obtain a first test case for a benchmark page, wherein the benchmark page and the page to be processed respectively indicate the previous and current versions of the same page; and to update the first test case based on the meaning information of the second icon and the association between the icon to be processed and the benchmark icon in the benchmark page, so as to obtain a second test case for the page to be processed; or...
[0115] The second type of test case generation module is used to generate target test cases for the icon to be processed based on the meaning information of the second icon.
[0116] In one embodiment, determining the target icon that matches the icon to be processed from a plurality of preset icons includes: determining a plurality of first candidate icons from the plurality of preset icons, wherein the page type of the page where the first candidate icon is located is the same as the page type of the page to be processed; and determining the target icon that matches the icon to be processed from the plurality of first candidate icons.
[0117] In one embodiment, the plurality of preset icons are simultaneously stored by a first storage module and a second storage module. The first storage module includes multiple storage units based on page type dimensions. Each storage unit stores multiple candidate icons, and the multiple candidate icons belong to the plurality of preset icons. Determining multiple first candidate icons from the plurality of preset icons includes: determining a matching target storage unit from the first storage module based on the page type of the page to be processed, wherein the page type corresponding to the target storage unit is the same as the page type of the page to be processed; and determining the plurality of candidate icons stored in the target storage unit as the plurality of first candidate icons.
[0118] The device further includes a matching module, which is used to match the icon to be processed by using the icons stored in the second storage module as candidates when there is no icon matching the icon to be processed among the plurality of first candidate icons.
[0119] In one embodiment, the first icon meaning information acquisition module includes:
[0120] Candidate icon meaning information acquisition unit: When there is no icon matching the icon to be processed among the plurality of preset icons, for each partial element of the icon to be processed, a second candidate icon matching the partial element is determined from the plurality of preset icons, and the candidate icon meaning information of the second candidate icon is acquired;
[0121] First icon meaning information acquisition unit: used to obtain the first icon meaning information based on the candidate icon meaning information corresponding to each of the local elements.
[0122] It should be noted that the apparatus and method embodiments described in the device embodiments are based on the same inventive concept.
[0123] In some embodiments, the functions or modules of the apparatus provided in this application can be used to perform the methods described in the above method embodiments. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.
[0124] This application also provides a computer-readable storage medium storing at least one instruction or at least one program segment, which is loaded and executed by a processor to implement the above-described method. The computer-readable storage medium may be a non-volatile computer-readable storage medium.
[0125] This application also provides an electronic device, which includes at least one processor and a memory communicatively connected to the at least one processor; wherein the memory stores at least one instruction or at least one program, and the at least one instruction or at least one program is loaded and executed by the at least one processor to implement the above method.
[0126] Electronic devices can be provided as terminals, servers, or other forms of devices.
[0127] Figure 10 A block diagram of an electronic device according to an embodiment of this application is shown. (Refer to...) Figure 10 The electronic device 1900 includes a processing component 1922, which further includes one or more processors, and memory resources represented by memory 1932 for storing instructions executable by the processing component 1922. Furthermore, the processing component 1922 is configured to execute instructions to perform the methods described above.
[0128] Electronic device 1900 may also include a power supply component 1926 configured to perform power management of electronic device 1900, a wired or wireless network interface 1950 configured to connect electronic device 1900 to a network, and an input / output (I / O) interface 1958. Electronic device 1900 can operate on an operating system stored in memory 1932, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, or similar.
[0129] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 1932 including computer program instructions that can be executed by a processing component 1922 of an electronic device 1900 to perform the above-described method.
[0130] This application may be a system, method, and / or computer program product. A computer program product may include a computer-readable storage medium having on it at least one instruction or at least a program segment for causing a processor to implement various aspects of this application.
[0131] Computer-readable storage media can be tangible devices capable of holding and storing instructions for use by an instruction execution device. Computer-readable storage media can be, for example—but not limited to—electrical storage devices, magnetic storage devices, optical storage devices, electromagnetic storage devices, semiconductor storage devices, or any suitable combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), static random access memory (SRAM), portable compact disc read-only memory (CD-ROM), digital multifunction disc (DVD), memory sticks, floppy disks, mechanical encoding devices, such as punch cards or recessed protrusions storing instructions thereon, and any suitable combination thereof. The computer-readable storage media used herein are not to be construed as transient signals themselves, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through waveguides or other transmission media (e.g., light pulses through fiber optic cables), or electrical signals transmitted through wires.
[0132] At least one instruction or program segment described herein may be downloaded from a computer-readable storage medium to various computing / processing devices, or downloaded via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network, to an external computer or external storage device. The network may include copper transmission cables, fiber optic transmission, wireless transmission, routers, firewalls, switches, gateway computers, and / or edge servers. A network adapter card or network interface in each computing / processing device receives at least one instruction or at least one program segment from the network and forwards the instruction or program segment to a computer-readable storage medium in the respective computing / processing device.
[0133] At least one instruction or at least one program segment used to perform the operations of this application may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages such as Smalltalk, C+, etc., and conventional procedural programming languages such as the "C" language or similar programming languages. At least one instruction or at least one program segment may be executed entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state information of at least one instruction or at least one program to implement various aspects of this application.
[0134] Various aspects of this application are described herein with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by at least one instruction or at least a piece of program.
[0135] The at least one instruction or at least one program segment can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus to produce a machine such that, when executed by the processor of the computer or other programmable data processing apparatus, it creates means for implementing the functions / actions specified in one or more blocks of the flowchart and / or block diagram. The at least one instruction or at least one program segment can also be stored in a computer-readable storage medium that causes a computer, programmable data processing apparatus, and / or other device to operate in a particular manner; thus, the computer-readable medium storing the instructions comprises an article of manufacture that includes instructions for implementing aspects of the functions / actions specified in one or more blocks of the flowchart and / or block diagram.
[0136] At least one instruction or at least one program may be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to perform the functions / actions specified in one or more boxes of a flowchart and / or block diagram.
[0137] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this application. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which includes one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions specified in the blocks may occur in a different order than those specified in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.
[0138] The various embodiments of this application have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical applications, or technological improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.
Claims
1. An icon processing method, characterized in that, The method includes: Identify the icons to be processed from the pending pages; The target icon that matches the icon to be processed is determined from a plurality of preset icons, and the first icon meaning information of the target icon is obtained; Obtain page description information that describes the global state of the page to be processed; The second icon meaning information of the icon to be processed is determined based on the first icon meaning information and the page description information.
2. The method according to claim 1, characterized in that, Determining the second icon meaning information of the icon to be processed based on the first icon meaning information and the page description information includes: Using the icon to be processed, the meaning information of the first icon, the page description information, and the preset prompt text as input, the target model is used to output the meaning information of the second icon. The preset prompt text is used to prompt the generation of the meaning information of the icon to be processed based on the meaning information of the first icon and the page description information.
3. The method according to claim 2, characterized in that, The method further includes: Multiple target information groups are determined from the information group set. Each information group consists of historical prompt text input to the target model and historical meaning information output by the target model. The source page type and the target icon indicated by the historical prompt information contained in each of the multiple target information groups are the same. Using the multiple target information groups and the summarized prompt text as input, the target model is used to summarize the multiple target information groups to obtain a template that guides the target model to output meaningful information.
4. The method according to claim 1, characterized in that, The step of obtaining page description information describing the global state of the page to be processed includes: Based on the element text content of each of the multiple page elements in the page to be processed, the page text content is obtained; Obtain the page structure information of the page to be processed; The page description information is obtained by combining the page text content and the page structure information.
5. The method according to any one of claims 1-4, characterized in that, After determining the second icon meaning information of the icon to be processed based on the first icon meaning information and the page description information, the method further includes: Obtain a first test case for a benchmark page, where the benchmark page and the page to be processed respectively indicate the previous and current versions of the same page; and, based on the meaning information of the second icon and the association between the icon to be processed and the benchmark icon in the benchmark page, update the first test case to obtain a second test case for the page to be processed; or... Based on the meaning information of the second icon, target test cases are generated for the icon to be processed.
6. The method according to claim 1, characterized in that, The step of determining the target icon that matches the icon to be processed from a plurality of preset icons includes: Multiple first candidate icons are determined from the multiple preset icons, and the page type of the page where the first candidate icon is located is the same as the page type of the page to be processed; The target icon that matches the icon to be processed is determined from the plurality of first candidate icons.
7. The method according to claim 6, characterized in that, The multiple preset icons are simultaneously stored by a first storage module and a second storage module. The first storage module includes multiple storage units based on page type. Each storage unit stores multiple candidate icons. The multiple candidate icons are located on pages of the same page type. The multiple candidate icons belong to the multiple preset icons. The step of determining multiple first candidate icons from the multiple preset icons includes: Based on the page type of the page to be processed, a matching target storage unit is determined from the first storage module, and the page type corresponding to the target storage unit is the same as the page type of the page to be processed. The plurality of candidate icons stored in the target storage unit are determined to be the plurality of first candidate icons; After determining a plurality of first candidate icons from the plurality of preset icons, the method further includes: If no icon matches the icon to be processed among the plurality of first candidate icons, the icons stored in the second storage module are used as candidates for matching the icon to be processed.
8. The method according to claim 1, characterized in that, After determining the icon to be processed from the page to be processed, the method further includes: If no icon matches the icon to be processed among the plurality of preset icons, for each local element of the icon to be processed, a second candidate icon that matches the local element is determined from the plurality of preset icons, and the candidate icon meaning information of the second candidate icon is obtained. The first icon meaning information is obtained based on the candidate icon meaning information corresponding to each of the local elements.
9. An icon processing device, characterized in that, The device includes: Icon Determination Module: Used to determine the icons to be processed from the page to be processed; First icon meaning information acquisition module: used to determine the target icon that matches the icon to be processed from a plurality of preset icons, and to acquire the first icon meaning information of the target icon; Page description information acquisition module: used to acquire page description information that describes the entire page to be processed; The second icon meaning information determination module is used to determine the second icon meaning information of the icon to be processed based on the first icon meaning information and the page description information.
10. An electronic device, characterized in that, The electronic device includes at least one processor and a memory communicatively connected to the at least one processor; wherein the memory stores at least one instruction or at least one program, the at least one instruction or at least one program being loaded and executed by the at least one processor to implement the icon processing method as described in any one of claims 1-8.
11. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores at least one instruction or at least one program, which is loaded and executed by a processor to implement the icon processing method as described in any one of claims 1-8.
12. A computer program product, characterized in that, The computer program product includes at least one instruction or at least one program segment, which is loaded and executed by a processor to implement the icon processing method as described in any one of claims 1-8.