Information processing method and device, terminal equipment, storage medium and program product
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- BEIJING XIAOMI MOBILE SOFTWARE CO LTD
- Filing Date
- 2024-10-28
- Publication Date
- 2026-04-28
AI Technical Summary
Existing technologies require repeated calculations using parent elements when determining the background information of target elements in terminal devices, resulting in high resource consumption and long processing times, which negatively impacts user experience.
By associating the target element with a target container at a lower display level in the element structure relationship, and using the layer information below the layer where the target container is located to determine the background information, the redundant calculation of the background of the target element is reduced.
This reduces the number of times background information needs to be determined, lowers resource consumption and processing time, and improves the user experience.
Smart Images
Figure CN121934796A_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of information processing technology, and in particular to an information processing method, apparatus, terminal equipment, storage medium, and computer program product. Background Technology
[0002] With the development of technology, more and more terminal devices have emerged, and their functions have become increasingly diverse. Terminal devices can include devices with display functions, such as mobile phones and tablets.
[0003] Terminal devices can have an operating system installed, as well as applications and various components. When the terminal device is running, it can display the corresponding content through a display module. Summary of the Invention
[0004] This disclosure provides an information processing method, apparatus, terminal equipment, storage medium, and computer program product.
[0005] A first aspect of this disclosure provides an information processing method, comprising: acquiring an element structure relationship for displaying currently displayed information; associating a target element and a target container to obtain an association relationship; wherein the target element and the target container are located in the element structure relationship; the parent element of the target element is different from the target container, and the display layer of the target container is lower than the display layer of the target element; determining background information based on information displayed in the layer below the layer where the target container is located; and determining the background of the target element based on the background information.
[0006] In one embodiment, associating a target element and a target container to obtain an association relationship includes: traversing each element in the element structure relationship; during the traversal, determining the target element and the target container based on configuration information; wherein the configuration information is used to indicate the target element and the target container associated with the target element; when the target element is traversed, storing the information of the target element in the target container.
[0007] In one embodiment, the method further includes: creating a container set; storing indication information of the target container in the container set when traversing to the target container; and searching for the target container based on the indication information in the container set after the traversal is completed.
[0008] In one embodiment, storing the information of the target element into the target container includes: creating an element set in the target container; and storing the target element into the element set when iterating through the target element.
[0009] In one embodiment, the method further includes: after completing the traversal, searching for the target element from the element set.
[0010] In one embodiment, determining the background information based on the information displayed in the layer below the layer containing the target container includes: determining whether to blur and blend the information displayed in the layer below the layer containing the target container based on the various elements contained in the target container.
[0011] A second aspect of this disclosure provides an information processing apparatus, comprising: an acquisition module for acquiring an element structure relationship for displaying currently displayed information; an association module for associating a target element and a target container to obtain an association relationship; wherein the target element and the target container are located in the element structure relationship; the parent element of the target element is different from the target container, and the display layer of the target container is lower than the display layer of the target element; a first determination module for determining background information based on information displayed in the layer below the layer where the target container is located; and a second determination module for determining the background of the target element based on the background information.
[0012] A third aspect of this disclosure provides a terminal device, including: a processor and a memory for storing executable instructions capable of running on the processor, wherein: when the processor runs the executable instructions, the executable instructions perform the method described in any of the above embodiments.
[0013] A fourth aspect of this disclosure provides a non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the method described in any of the above embodiments.
[0014] A fifth aspect of this disclosure provides a computer program product, including a computer program or executable instructions, which, when executed by a processor, implement the method described in any of the above embodiments.
[0015] The technical solutions provided by the embodiments of this disclosure may include the following beneficial effects:
[0016] The solution of this disclosure associates two elements that do not have a parent-child relationship in the element structure relationship, so that the target element and the target container are associated. The display level of the target container is lower than that of the target element. In the element structure relationship, the target container is of the same generation as the parent element of the target element, or has a higher generation than the parent element of the target element. The higher the generation, the lower the display level.
[0017] After determining the background information through the target container, since the target element and the target container have already been associated, the background of the target element can be determined based on the already determined background information. This eliminates the need to redetermine the background information based on the target element's parent elements, reducing the number of times the background information needs to be determined, thereby reducing resource consumption and image processing resource usage, and also reducing the time spent determining the background of the target element, thus improving the user experience.
[0018] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description
[0019] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0020] Figure 1 This is a schematic diagram illustrating an information processing method according to an exemplary embodiment;
[0021] Figure 2 This is a schematic diagram illustrating an elemental structural relationship according to an exemplary embodiment;
[0022] Figure 3 This is a schematic diagram illustrating an association between a target element and a target container according to an exemplary embodiment;
[0023] Figure 4 This is a schematic diagram illustrating another information processing method according to an exemplary embodiment;
[0024] Figure 5 This is a schematic diagram illustrating another information processing method according to an exemplary embodiment;
[0025] Figure 6 This is a schematic diagram illustrating an information processing apparatus according to an exemplary embodiment;
[0026] Figure 7 This is a schematic diagram illustrating another elemental structural relationship according to an exemplary embodiment;
[0027] Figure 8 This is a schematic diagram illustrating another elemental structural relationship according to an exemplary embodiment;
[0028] Figure 9 This is a block diagram illustrating a terminal device according to an exemplary embodiment. Detailed Implementation
[0029] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses consistent with some aspects of this disclosure as detailed in the appended claims.
[0030] refer to Figure 1 This is a schematic diagram of an information processing method, which includes:
[0031] S100, obtain the element structure relationship used to display the currently displayed information.
[0032] S200 associates the target element and the target container to obtain the association relationship; wherein, the target element and the target container are located in the element structure relationship; the parent element of the target element is different from the target container, and the display level of the target container is lower than the display level of the target element.
[0033] S300: Determine background information based on information displayed in the layer below the layer containing the target container.
[0034] S400, determine the background of the target element based on the background information.
[0035] The solution in this embodiment can be applied to terminal devices, and the executing entity can be a terminal device, which can include mobile terminal devices and fixed terminal devices, etc. Mobile terminal devices can include mobile phones, tablets, in-vehicle central control devices, wearable devices, smart devices, and aircraft, etc. Smart devices can include smart office equipment, smart home equipment, and robots, etc.
[0036] For S100, the terminal device may have a display module for displaying the content that the terminal device needs to display.
[0037] Typically, the information displayed through display modules is interconnected, and this interconnection can include element structure relationships, which represent the hierarchical relationships between elements. An element can have its own child elements, and the number of child elements can be multiple. If an element has child elements, then that element can be considered its parent element.
[0038] For example, an element can also have its own parent element. In this element structure relationship, the element that does not have a parent element can be recorded as the root element in the element structure relationship.
[0039] In this element structure relationship, child elements are displayed based on their parent elements.
[0040] In this element structure relationship, the number of elements is not limited, nor is the hierarchy between different elements; it can be determined based on the currently displayed information.
[0041] For example, the element structure relationship may include an element structure relationship tree, that is, the relationship is a tree-like structure relationship. The element structure relationship tree includes multiple element levels, and each element level may include multiple elements. In two adjacent element levels, there must be at least one pair of elements with a parent-child relationship.
[0042] For example, each element in this element structure relationship can also be denoted as a node. In the element relationship tree, the node at the root of the tree is denoted as the root node, and other nodes are determined based on the root node.
[0043] Each element in this element structure relationship can display its own corresponding display information. When displaying the current display information, it can be displayed according to this element structure relationship.
[0044] For example, in an element structure relationship, each element can have its own display layer, and the relationship between each display layer can be determined based on the relationship between the elements.
[0045] For example, an element may include a display control for displaying information, and the display layer corresponding to the element may include a display control for displaying the display information corresponding to that layer.
[0046] refer to Figure 2 This is a schematic diagram of an element structure relationship. Figure 2 The diagram shows seven elements, each represented by a box. `View` is the root element, and it is the parent of `View1` and `View2`. `View1` is the parent of `View11` and `View12`, and `View2` is the parent of `View21` and `View22`. Each element displays different content; elements with higher generational rankings have lower display hierarchys, and vice versa. Display hierarchy here can include layer position; a lower display hierarchy corresponds to a lower layer position, and vice versa.
[0047] For example, an element can be a display control, which may be a display window. A View can be the element corresponding to the system desktop background. View1 and View2 can be elements corresponding to two different display information on the system desktop. View1 corresponds to display information A, and View2 corresponds to display information B. Since View1 and View2 are on a higher layer than the View, they are not obscured by the View, thus allowing View1 and View2 to be displayed.
[0048] View11 displays the element corresponding to interface 1 within information A; View12 displays the element corresponding to interface 2 within information A; View21 displays the element corresponding to interface 3 within information B; and View22 displays the element corresponding to interface 4 within information B. Similarly, View11 and View12 are on a higher layer than View1, and View21 and View22 are on a higher layer than View2. View11 and View12 are not obscured by View1, thus allowing them to be displayed. Likewise, View21 and View22 are not obscured by View2, thus allowing them to be displayed.
[0049] The structural relationship of this element can be predetermined. For example, it can be determined based on the currently displayed information. Once the currently displayed information is determined, the structural relationship of this element can be determined.
[0050] There are no restrictions on how to obtain the structural relationships of elements; they can be obtained directly from the system.
[0051] For S200, after obtaining the element structure relationship, the target element and the target container can be associated to obtain the association relationship between the target element and the target container.
[0052] The target element and target container are located within the element structure relationship. The target element and target container are predetermined; they can be determined once the element structure relationship is obtained. The number of target elements and target containers is not limited; there can be one or more target elements and one or more target containers, depending on display requirements.
[0053] The target container is also an element in the element structure relationship, and can be any element other than at least one target element in the element structure relationship.
[0054] In element structure relationships, the parent element of the target element is different from the target container, and the display hierarchy of the target container is lower than that of the target element. In a relationship between a target element and a target container, the target container is not the parent element of the target element, and the target element is not a child element of the target container; there is no parent-child relationship between the target element and the target container.
[0055] In the element structure relationship, the lower the seniority, the higher the display level, and the higher the position of the element in the layer; conversely, the higher the seniority, the lower the display level, and the lower the position of the element in the layer. The display level of the target container is lower than that of the target element; that is, the layer of the target container is lower than the layer of the target element, and the layer of the target element is above the layer of the target container. Furthermore, since the traversal order of each element in the element structure relationship when displaying information is based on seniority from high to low, and from the lowest layer to the highest layer, this allows us to first determine the background information based on the target container, thus facilitating the determination of the background of the target element based on that background information.
[0056] For example, the association between the target container and the target element can include any of the following:
[0057] A one-to-one relationship, meaning that a target container is associated with a target element;
[0058] A one-to-many relationship, meaning one target container is associated with multiple target elements;
[0059] A many-to-many relationship means that one target container is associated with multiple target elements, and one target element is associated with multiple target containers.
[0060] The way to associate the target element with the target container is not limited and can include:
[0061] Associations are established through indicator information, which can indicate the target element and the target container associated with that target element.
[0062] or,
[0063] Association is established by tagging, adding tag information to each target element and target container, and target elements and target containers with the same tag information are associated with each other.
[0064] refer to Figure 2 You can use element View1 as the target container and element View22 and / or element View21 as the target elements. You can associate View22 with View1, or you can associate View21 with View1.
[0065] Alternatively, you can use element View2 as the target container and elements View12 and / or View11 as the target elements. You can associate View11 with View2, or vice versa.
[0066] For S300, after associating the target container and the target element, the background information can be determined based on the target container. For example, the background information can be determined based on the information displayed in the layer below the layer containing the target container.
[0067] After determining the target container, elements with higher seniority than the target container can be identified based on the element structure relationship. These include the target container's parent element, elements with higher seniority than the target container's parent element, elements with the same seniority as the target container's parent element, and elements with higher seniority than elements with the same seniority as the target container's parent element.
[0068] In the element structure relationship, the lower the seniority, the higher the display layer; conversely, the higher the seniority, the lower the display layer. Elements with a higher seniority than the target container reside on layers below the target container's layer. Therefore, the information displayed in the layers of elements with a higher seniority than the target container is below the content displayed in the target container's layer. The content displayed in the target container's layer will cover and obscure the information displayed in the layers of elements with a higher seniority than the target container. In this way, the background information can be determined based on the information displayed in the layers below the target container's layer.
[0069] For example, the layer below the target container can be overlaid to obtain an overlaid layer, and the background information can be determined based on the overlaid layer. For instance, the information displayed in the overlaid layer can be used as the background information, and the information displayed in the overlaid layer can be further processed, such as blurring and / or color adjustment, and the processed display information can be used as the background information.
[0070] For example, the background information can be an image, i.e., a background image.
[0071] For S400, after determining the background information, the background of the target element can be determined based on the background information. Since the layer containing the target element is located above the layer containing the target container, and the target element and the target container are already associated, after determining the background information based on the target container, if the background of the target element is to be determined, it can be determined based on the background information already obtained from the target container.
[0072] refer to Figure 2 , Figure 2 As shown, after View22 is associated with View1, they have a relationship. After obtaining the background information from View1, the background of View22 can be determined based on this information, without needing to determine the background information again through View2, and then using the background information determined by View2 to determine the background of View22. This allows two elements that do not have a parent-child relationship to be associated, and the background information obtained from View1 can also be used to determine the background of View22.
[0073] For example, determining the background of a target element based on background information may include using the background information as the background of the target element. For instance, if the background information is an image, then the image can be used as the background of the target element.
[0074] For example, the background of the target element is located within the area where the target element is located; the area outside the target element is not considered as the background of the target element.
[0075] By associating two elements that do not have a parent-child relationship in their element structure, a relationship is established between the target element and the target container. After determining the background information through the target container, because the target element and the target container have already been associated, the background of the target element can be determined based on the already determined background information. This eliminates the need to redetermine the background information based on the target element's parent elements, reducing the number of times background information needs to be determined, thereby reducing the consumption of image processing resources and the time required to determine the background of the target element, thus improving the user experience.
[0076] In one embodiment, reference Figure 3 This is a schematic diagram illustrating the association between a target element and a target container. S200: The target element and the target container are associated to obtain the association relationship, including:
[0077] S201, traverse each element in the element structure relationship.
[0078] S202, during the traversal, the target element and target container are determined based on the configuration information; wherein, the configuration information is used to indicate the target element and the target container associated with the target element.
[0079] S203: When traversing to the target element, store the information of the target element in the target container.
[0080] When associating a target element and a target container, the target element and target container in the element structure relationship can be determined by traversing each element in the element structure relationship.
[0081] Traversal can begin with the element of the highest generation in the element structure and proceed to the element of the lowest generation. For example, if the element structure is a tree structure, traverse from the root element to the leaf elements. The root element can also be referred to as the root node, and the leaf elements can also be referred to as leaf nodes.
[0082] During the traversal, the target element and target container can be determined based on the configuration information. The configuration information can be predetermined, obtained when acquiring the element structure relationship, or obtained after acquiring the element structure relationship and before traversing each element in the element structure relationship.
[0083] Configuration information can be used to indicate target elements and their associated target containers. Based on this configuration information, it can be determined which elements in the element structure relationship are target elements and which elements serve as their associated target containers. The representation of the configuration information is not limited and can include: the element identifier of the target element, the container identifier of the target container, and the pointer relationship between the element identifier and the container identifier.
[0084] When traversing the element structure relationship, the target element and target container, as well as the association between the target element and target container, can be determined based on this configuration information.
[0085] refer to Figure 2 ,by Figure 2 Taking the elements shown as an example, the configuration information can be used to indicate that View1 is the target container, View22 is the target element, and View22 is associated with the target container View1. When traversing from the element View, when traversing to the element View1, it can be determined that the element View1 is the target container; when traversing to the element View22, it can be determined that the element View22 is the target element; and it can also be determined that the target container associated with the element View22 is the element View1.
[0086] When iterating over a target element, its information can be stored in the target container. This makes it easier to determine the background of the target element after the iteration is complete.
[0087] For example, storing the information of the target element in the target container can include:
[0088] The target container stores information used to determine the background of the target element and the identification information of the target element.
[0089] In one embodiment, reference Figure 4 This is a schematic diagram of another information processing method, which also includes:
[0090] S10, Create a container collection.
[0091] S20, when traversing to the target container, store the indication information of the target container into the container set.
[0092] S30: After completing the traversal, find the target container based on the indication information in the container set.
[0093] Before traversing each element in the element structure relationship, a container collection can be created. This container collection is used to query the target container. During the traversal, if the target container is encountered, the indicator information of the target container is stored in the container collection.
[0094] For example, the indication information of the target container may include an identifier and / or its position in the element structure relationship.
[0095] After traversing each element in the element structure relationship, the target containers can be determined. There can be multiple target containers. Since the indicator information of the target container has been stored in the container set when iterating to the target container, the required target container can be found in the container set based on the indicator information. This allows us to determine the position of each target container in the element structure relationship and the elements with higher seniority than that target container, facilitating the determination of background information based on the target container.
[0096] In one embodiment, reference Figure 5 This is a schematic diagram of another information processing method, which stores the information of the target element into a target container, including:
[0097] S2031, Create a collection of elements in the target container.
[0098] S2032, when the target element is encountered during traversal, the target element is stored in the element set.
[0099] After traversing to the target container, an element set can be created in the target container. This element set is used to store the information of the target elements, so as to determine which target elements are associated with each target container after traversing each element in the element structure relationship.
[0100] When a target element is encountered, it is stored in the set of elements within the target container that is associated with it, based on the relationship between the target element and the target container. This allows us to determine the information of the target elements stored in each target container after the traversal is complete, thus identifying which target elements are associated with that target container.
[0101] For example, it may also include:
[0102] After completing the traversal, find the target element from the set of elements.
[0103] Since the target element is already stored in the set of elements in the target container that is associated with it when iterating through it, the set of elements in the target container after the traversal is complete already contains the information of the target element that is associated with the target container. This allows the target element to be searched within the set of elements in the target container, thus facilitating the determination of background information.
[0104] In one embodiment, S300, determining background information based on information displayed in the layer below the layer containing the target container includes:
[0105] Based on the elements contained in the target container, determine whether to blur and / or blend the information displayed in the layer below the layer containing the target container.
[0106] The elements contained in the target container can include: child elements of the target container in the element structure relationship, and target elements that are associated with the target container.
[0107] Determining background information may include blurring and / or blending the information displayed in the layer below the layer containing the target container.
[0108] Based on the background configuration parameters of each element contained in the target container, it can be determined whether to blur and / or blend the information displayed in the layer below the layer containing the target container.
[0109] The background configuration parameters of the target element can be pre-configured or determined based on the content displayed by the target element. The background information is obtained by processing the information displayed in the layer below the target container's layer based on the target element's background configuration parameters.
[0110] For example, when the target element has a background configuration parameter, it is determined that the information displayed in the layer below the layer where the target container is located will be blurred and / or mixed to obtain the background information corresponding to the target element.
[0111] For example, the information displayed in the layer below the layer where the target container is located is reference information. The reference information is processed according to the background configuration parameters of the target element to obtain the background information.
[0112] The methods for processing reference information may include at least one of the following:
[0113] Blur processing;
[0114] Adjust transparency;
[0115] Color adjustment;
[0116] Resizing;
[0117] Shape adjustment.
[0118] For example, color adjustment may include color mixing. Blur processing may include blur position and / or blur radius, etc.
[0119] For example, the reference information can be a reference image, which can be an image formed by overlaying information displayed in the layer below the layer where the target container is located.
[0120] For example, different target elements have their own background information. A target container can include multiple target elements. Based on the information displayed in the layer below the layer where the target container is located and the background configuration parameters of the target elements, the background information corresponding to each target element can be obtained.
[0121] Determining the background of a target element based on background information can include: obtaining the background information corresponding to the target element from the target container, transmitting the background information corresponding to the target element to the target element, or directly using the background information corresponding to the target element as the background of the target element.
[0122] In one embodiment, reference Figure 6 This is a schematic diagram of an information processing device, which includes:
[0123] Module 1 is used to obtain the element structure relationship used to display the currently displayed information;
[0124] Association module 2 is used to associate a target element and a target container to obtain an association relationship; wherein the target element and the target container are located in the element structure relationship; the parent element of the target element is different from the target container, and the display level of the target container is lower than the display level of the target element;
[0125] The first determining module 3 is used to determine background information based on the information displayed in the layer below the layer where the target container is located;
[0126] The second determining module 4 is used to determine the background of the target element based on the background information.
[0127] In one embodiment, the associated module 2 includes:
[0128] The traversal submodule is used to traverse each element in the element structure relationship;
[0129] A determination submodule is used to determine the target element and the target container according to configuration information during the traversal; wherein the configuration information is used to indicate the target element and the target container associated with the target element;
[0130] The storage submodule is used to store the information of the target element into the target container when the target element is traversed.
[0131] In one embodiment, the apparatus further includes:
[0132] The first creation unit is used to create a collection of containers;
[0133] The first storage unit is used to store the indication information of the target container into the container set when the target container is traversed;
[0134] The first search unit is used to search for the target container according to the indication information in the container set after the traversal is completed.
[0135] In one embodiment, storing the submodule includes:
[0136] The second creation unit is used to create an element set in the target container;
[0137] The second storage unit is used to store the target element into the element set when the target element is traversed.
[0138] In one embodiment, the apparatus further includes:
[0139] The second search unit is used to search for the target element from the element set after the traversal is completed.
[0140] In one embodiment, the first determining module 3 is used to:
[0141] Based on the elements contained in the target container, determine whether to blur and mix the information displayed in the layer below the layer containing the target container.
[0142] In one embodiment, another example of information processing is also provided.
[0143] Within the display framework of an operating system (such as Android), controls can be blurred, and their backgrounds can also be blurred and / or mixed. Blurring and / or color mixing consumes significant graphics processing unit (GPU) resources and is relatively time-consuming.
[0144] Figure 7 For another schematic diagram of elemental structure relationships, please refer to... Figure 2 and Figure 7 In Android, a window can be viewed as a top-down tree of views. The element structure can encompass this view tree, and elements within this structure can function as controls.
[0145] View12 and View22 require blurred and / or blended backgrounds. The simplest approach is to create separate blurred and / or blended backgrounds for each view. However, this process is very time-consuming and puts a heavy strain on the CPU and GPU. To improve performance, a blurred and / or blended image (SkImage) can be created from a common parent view of both views. The blurred background images for View12 and View22 can then be directly cropped from this SkImage.
[0146] Using View12 and View22 as target elements and the common parent view View as the target container, this approach is feasible.
[0147] If the target container of View12 cannot select View but can only select View1, then View22 and View1 cannot be directly associated.
[0148] A View corresponds to a RenderNode in a rendering component (Hardware UI), and a window corresponds to a context (such as Canvas Context) in a rendering component.
[0149] The relationships between controls are generated during the execution of the `prepare Tree` function of the `Cnavas Context`: the traversal of the Hardware UI layer is from top to bottom: during the traversal of Views, View1 and View2 are traversed; during the traversal of View1, View11 and View12 are traversed; and during the traversal of View2, View21 and View22 are traversed. `RenderNode1` is the node corresponding to View1 in the control tree, `RenderNode2` is the node corresponding to View2 in the control tree, `RenderNode11` is the node corresponding to View11 in the control tree, `RenderNode12` is the node corresponding to View12 in the control tree, `RenderNode21` is the node corresponding to View21 in the control tree, and `RenderNode22` is the node corresponding to View22 in the control tree. Each node has its own contained branch tree structure.
[0150] After traversing View12 in this way, some properties of View12 can be stored in View1.
[0151] However, View22 and View1 have no parent-child relationship, so it is impossible to store the properties of View22 in View1.
[0152] The solution in this embodiment is used to solve this problem.
[0153] refer to Figure 8 This is another type of element structure diagram. (Reference) Figure 8 The method includes:
[0154] 1) Add an interface to View.java to specify the target container for the target element:
[0155] For example, it can be implemented as follows: public void chooseBackgroundBlurContainer(View container).
[0156] After the target element calls this interface, the node (RenderNode) corresponding to the target element will hold a pointer (RenderNode*mParentRenderNode) to the node (RenderNode) corresponding to the target container.
[0157] 2) Add a container collection to the CanvasContext corresponding to the window:
[0158] For example, it can be implemented as follows: std::vector<RenderNode*> mContainers.
[0159] When traversing to the target container, the pointer of the node (RenderNode) corresponding to the target container is stored in the container collection (mContainers).
[0160] 3) Add a collection of target elements to the target container (corresponding to the RenderNode):
[0161] For example, it can be implemented as follows: std::vector<RenderNode*> mElements.
[0162] When the target element is encountered, it is stored in the set of elements (mElements) of the target container that is associated with the target element.
[0163] 4) Add a new function `post Prepare Tree` to the Canvas Context. This function executes after traversing the entire view tree. Its purpose is to iterate through each RenderNode in the container collection `mContainers`, and based on its element collection `mElements`, determine whether a blurred background needs to be created, the size of the SkSurface used, and the size of the generated blurred blending image. Simultaneously, it modifies certain behaviors of all elements in the element collection `mElements` that can only be determined after the container behavior has been decided. This establishes a connection between View1 and View22. When View1 creates a blurred blending background image, it can take into account View22, and View22 can correctly use the blurred blending background image created by View1.
[0164] By storing the properties of View22 within View1, View22 can be considered when using background information (such as blur and / or blending images) obtained from View1. Once View1 determines the parameters for creating the blur and blending image, View22 can adjust accordingly. Relationships can be established between two Views that do not have a parent-child relationship, binding them into element container relationships. This reduces the number of containers, thereby reducing the number of blur and blending operations and ultimately improving performance.
[0165] It should be noted that the terms "first" and "second" in the embodiments of this disclosure are for ease of description and distinction only, and have no other specific meaning.
[0166] Figure 9 This is a block diagram illustrating a terminal device according to an exemplary embodiment. For example, the terminal device may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.
[0167] Reference Figure 9 The terminal device may include one or more of the following components: processing component 902, memory 904, power component 906, multimedia component 908, audio component 910, input / output (I / O) interface 912, sensor component 914, and communication component 916.
[0168] Processing component 902 typically controls the overall operation of the terminal device, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 902 may include one or more processors 920 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 902 may include one or more modules to facilitate interaction between processing component 902 and other components. For example, processing component 902 may include a multimedia module to facilitate interaction between multimedia component 908 and processing component 902.
[0169] Memory 904 is configured to store various types of data to support operation on the terminal device. Examples of this data include instructions for any application or method operating on the terminal device, contact data, phonebook data, messages, pictures, videos, etc. Memory 904 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as Static Random Access Memory (SRAM), Electrically Erasable Programmable Read Only Memory (EEPROM), Erasable Programmable Read-Only Memory (EPROM), Programmable Read Only Memory (PROM), Read-Only Memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.
[0170] Power component 906 provides power to various components of the terminal device. Power component 906 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the terminal device.
[0171] Multimedia component 908 includes a screen that provides an output interface between a terminal device and a user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a Touch Panel, the screen can be implemented as a touchscreen to receive input signals from the user. The Touch Panel includes one or more touch sensors to sense touches, swipes, and gestures on the Touch Panel. The touch sensors can sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 908 includes a front-facing camera and / or a rear-facing camera. When the terminal device is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera can receive external multimedia data. Each front-facing camera and rear-facing camera can be a fixed optical lens system or have focal length and optical zoom capabilities.
[0172] Audio component 910 is configured to output and / or input audio signals. For example, audio component 910 includes a microphone (MIC) configured to receive external audio signals when the terminal device is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 904 or transmitted via communication component 916. In some embodiments, audio component 910 also includes a speaker for outputting audio signals.
[0173] I / O interface 912 provides an interface between processing component 902 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.
[0174] Sensor assembly 914 includes one or more sensors for providing status assessments of various aspects of the terminal device. For example, sensor assembly 914 can detect the on / off state of the terminal device, the relative positioning of components such as the display and keypad of the terminal device, changes in the position of the terminal device or a component of the terminal device, the presence or absence of user contact with the terminal device, the orientation or acceleration / deceleration of the terminal device, and temperature changes of the terminal device. Sensor assembly 914 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 914 may also include an optical sensor, such as a Complementary Metal Oxide Semiconductor (CMOS) or Charge Coupled Device (CCD) image sensor, for use in imaging applications. In some embodiments, sensor assembly 914 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.
[0175] Communication component 916 is configured to facilitate wired or wireless communication between the terminal device and other devices. The terminal device can access wireless networks based on communication standards, such as Wi-Fi, 4G, or 5G, or combinations thereof. In one exemplary embodiment, communication component 916 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 916 also includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wide Band (UWB), Bluetooth (BT), and other technologies.
[0176] In an exemplary embodiment, the terminal device may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.
[0177] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 904 including executable instructions or a computer program, which can be executed by the processor 920 of the device 900 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), a compact disc read-only memory (CD-ROM), magnetic tape, floppy disk, and optical data storage device, etc.
[0178] A non-transitory computer-readable storage medium, wherein when instructions in the storage medium are executed by a processor of a terminal device, the terminal device is able to perform any of the information processing methods described in the embodiments of this disclosure.
[0179] This disclosure provides a computer program product comprising a computer program or executable instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer program or executable instructions from the computer-readable storage medium and executes the computer program or executable instructions, causing the computer device to perform any of the information processing methods described in this disclosure.
[0180] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.
[0181] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.
Claims
1. An information processing method, characterized in that, include: Retrieve the element structure relationships used to display the currently displayed information; Associating a target element with a target container yields an association relationship; wherein the target element and the target container are located within the element structure relationship; the parent element of the target element is different from the target container, and the display layer of the target container is lower than the display layer of the target element; The background information is determined based on the information displayed in the layer below the layer containing the target container; The background of the target element is determined based on the background information.
2. The method according to claim 1, characterized in that, The step of associating the target element and the target container to obtain the association relationship includes: Iterate through each element in the aforementioned element structure relationship; During the traversal, the target element and the target container are determined according to configuration information; wherein, the configuration information is used to indicate the target element and the target container associated with the target element; When the target element is encountered, its information is stored in the target container.
3. The method according to claim 2, characterized in that, The method further includes: Create a collection of containers; When the target container is encountered, the indication information of the target container is stored in the container set; After completing the traversal, the target container is located according to the indication information in the container set.
4. The method according to claim 2, characterized in that, The step of storing the information of the target element into the target container includes: Create an element collection in the target container; When the target element is encountered during traversal, the target element is stored in the element set.
5. The method according to claim 4, characterized in that, The method further includes: After completing the traversal, the target element is searched from the set of elements.
6. The method according to claim 1, characterized in that, The step of determining the background information based on the information displayed in the layer below the layer containing the target container includes: Based on the elements contained in the target container, determine whether to blur and / or blend the information displayed in the layer below the layer containing the target container.
7. An information processing device, characterized in that, include: The acquisition module is used to acquire the element structure relationships used to display the currently displayed information; The association module is used to associate a target element with a target container to obtain an association relationship; wherein the target element and the target container are located in the element structure relationship; the parent element of the target element is different from the target container, and the display level of the target container is lower than the display level of the target element; The first determining module is used to determine background information based on the information displayed in the layer below the layer where the target container is located; The second determining module is used to determine the background of the target element based on the background information.
8. A terminal device, characterized in that, include: A processor and a memory for storing computer programs or executable instructions capable of running on the processor, wherein: When the processor is used to run the computer program or the executable instructions, the executable instructions perform the method described in any one of claims 1 to 6.
9. A non-transitory computer-readable storage medium, characterized in that, The non-transitory computer-readable storage medium stores a computer program or computer-executable instructions, which, when executed by a processor, implement the method described in any one of claims 1 to 6.
10. A computer program product, comprising a computer program or executable instructions, characterized in that, When the computer program or executable instructions are executed by a processor, they implement the method of any one of claims 1 to 6.