Interface display method and electronic equipment
By detecting trigger conditions in electronic devices and displaying the interface matching of materials, the problem of inconsistency between interface elements and wallpaper is solved, achieving better visual effects and user experience.
Patent Information
- Application Number
- CN202311436668.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-10-30
- Publication Date
- 2025-05-02
AI Technical Summary
In existing electronic devices, the visual effects of the user interface are affected by the appearance of wallpaper and interface elements. How to make the interface elements more coordinated and unified with the wallpaper to improve the visual effects is a technical challenge.
By detecting trigger conditions (such as bright screen or off screen operation) to display the interface matching the material, ensuring that the material of the interface elements matches the main material in the wallpaper, thereby achieving coordination between material and color.
It improves the overall visual effect of the user interface, makes the interface elements more coordinated and unified with the wallpaper, and enhances the user experience.
Smart Images

Figure CN119917195A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of terminal technology, and in particular to an interface display method and an electronic device. Background Art
[0002] With the popularity of electronic devices such as smartphones and tablets, the visual effects of their user interfaces are becoming increasingly important.
[0003] In current electronic devices, the two factors that have a greater impact on the visual effect of the user interface are the wallpaper of the user interface and the appearance of the interface elements (such as controls). Therefore, how to improve the visual effect of the user interface through the wallpaper of the user interface and the appearance of the interface elements is a technical problem that people in this field need to solve. Summary of the invention
[0004] In view of this, the present application provides an interface display method and an electronic device, which are used to improve the visual effect of the user interface through the wallpaper of the user interface and the appearance of the interface elements.
[0005] In order to achieve the above objectives, in a first aspect, an embodiment of the present application provides an interface display method, comprising:
[0006] A first trigger condition is detected and a first interface is displayed, wherein the first interface includes a wallpaper and a first interface element, and a material of the first interface element matches a material of a main body included in the wallpaper.
[0007] The interface display method provided in the embodiment of the present application matches the material of the first interface element in the displayed first interface with the material of the wallpaper, so that the first interface element in the first interface and the wallpaper are more coordinated and unified, thereby improving the overall visual effect of the user interface.
[0008] In a possible implementation of the first aspect, the first trigger condition is a screen-on operation, and the first interface is a lock screen interface.
[0009] Through the above implementation, the material of the interface elements in the lock screen interface can be matched with the material of the wallpaper, so that the interface elements in the lock screen interface and the wallpaper are more coordinated and unified, thereby improving the overall visual effect of the lock screen interface.
[0010] In a possible implementation of the first aspect, the first trigger condition is a screen-off operation, and the first interface is a screen-off interface.
[0011] Through the above implementation, the material of the interface elements in the screen off interface can be matched with the material of the wallpaper, so that the interface elements in the screen off interface and the wallpaper are more coordinated and unified, thereby improving the overall visual effect of the screen off interface.
[0012] In a possible implementation of the first aspect, a first material of the first interface element is the same as a second material of the target subject in the wallpaper.
[0013] The target subject may be the only subject in the wallpaper or the main subject among the multiple subjects of the wallpaper. The main subject may be the subject in the wallpaper whose area ratio is greater than the set ratio. In this way, when the only subject or the main subject in the wallpaper includes only one material, the material of the first interface element is the same as the material of the only subject or the main subject in the wallpaper; when the only subject or the main subject in the wallpaper includes multiple materials, the material of the first interface element may be partially the same as or completely the same as the material of the only subject or the main subject in the wallpaper, thereby expanding the range of selectable materials for the first interface element.
[0014] In a possible implementation of the first aspect, the first material is a main material of the first interface element, and the second material is a main material of the target body.
[0015] Through the above implementation, when the main body of the wallpaper includes multiple materials, the main material of the first interface element can be the same as the main material of the only main body of the wallpaper or the main body, and the secondary material of the first interface element can be the same as or different from the secondary material of the only main body of the wallpaper or the main body, thereby expanding the selectable range of the secondary material of the first interface element.
[0016] In a possible implementation of the first aspect, the third material of the first interface element is the same as the fourth material of the target body.
[0017] In the case where the wallpaper includes multiple main subjects, the first material and the fourth material can be different materials of the same main subject in the wallpaper, or different materials of different main subjects in the wallpaper. In this way, when the wallpaper's subject includes multiple materials, the main material of the first interface element is the same as the main material of the only subject or the main subject of the wallpaper, and the secondary material of the first interface element is also the same as the secondary material of the only subject or the main subject of the wallpaper (either partially the same or completely the same), so that the first interface element in the first interface can be more coordinated and unified with the wallpaper, further improving the overall visual effect of the user interface.
[0018] In a possible implementation of the first aspect, the area ratio of each material in the first interface element matches the area ratio of each corresponding material in the target body. In this way, the first interface element and the wallpaper can be more matched in terms of material, making the first interface element and the wallpaper more coordinated, further improving the overall visual effect of the user interface.
[0019] In a possible implementation of the first aspect, the color of the first interface element matches the color of the main body, so that the first interface element and the wallpaper can be more coordinated in color, further improving the overall visual effect of the user interface.
[0020] In a possible implementation of the first aspect, when the main body includes multiple colors, the first interface element includes one or more colors corresponding to the color of the main body. In this way, the color of the first interface element can be the same as only the main color of the main body (the main color can include one or more), or the same as both the main color and the secondary color of the main body, thereby expanding the selectable range of the color of the first interface element.
[0021] In a possible implementation of the first aspect, the first interface further includes a second interface element, and the color of the second interface element matches the color of the main body, so that the second interface element and the wallpaper can be more coordinated in color, further improving the overall visual effect of the user interface.
[0022] In a possible implementation of the first aspect, when the main body includes multiple colors, the color of the second interface element is one of the main colors of the main body. In this way, when the main body of the wallpaper includes multiple colors, the color of the second interface element can be any one of the various colors included in the main body, thereby expanding the selectable range of the color of the second interface element.
[0023] In a possible implementation of the first aspect, the first interface element includes one of the following: text, an icon, and a card.
[0024] In a possible implementation of the first aspect, the first interface element includes text, and a font of the text matches a style of the wallpaper.
[0025] Through the above implementation, the style of the first interface element and the style of the wallpaper can be matched, so that the styles of the first interface element and the wallpaper are more coordinated, further improving the overall visual effect of the user interface.
[0026] In a possible implementation of the first aspect, the first interface element includes a first text in a clock control, such as text in the clock control for displaying time.
[0027] In a possible implementation manner of the first aspect, the first interface element is generated in the following manner:
[0028] According to the material of the subject, determine the corresponding material map and PBR parameters;
[0029] A first interface element is generated by rendering according to the material map and the PBR parameters.
[0030] Through the above implementation, the material of the first interface element in the rendered first interface can match the material of the wallpaper, so that the first interface element in the first interface and the wallpaper are more coordinated and unified, thereby improving the overall visual effect of the user interface.
[0031] In a possible implementation of the first aspect, the material map is determined according to the material of the main body and the color of the main body.
[0032] Through the above implementation, the color of the rendered first interface element can also match the color of the wallpaper, so that the first interface element in the first interface and the wallpaper are more coordinated and unified in color, further improving the overall visual effect of the user interface.
[0033] In a possible implementation of the first aspect, before rendering and generating the first interface element, the method further includes: generating a corresponding normal map and corresponding texture map coordinates according to the material map;
[0034] The rendering and generating a first interface element according to the material map and the PBR parameters includes:
[0035] A first interface element is generated by rendering according to the material map, the PBR parameters, the normal map and the texture map coordinates.
[0036] Through the above implementation, the first interface element generated by rendering can have a three-dimensional visual effect, further improving the overall visual effect of the user interface.
[0037] In a second aspect, an embodiment of the present application provides an interface display device, the interface display device comprising:
[0038] Display module: used to detect a first trigger condition and display a first interface, wherein the first interface includes wallpaper and a first interface element, and the material of the first interface element matches the material of the main body contained in the wallpaper.
[0039] In a possible implementation of the second aspect, the first trigger condition is a screen-on operation, and the first interface is a lock screen interface.
[0040] In a possible implementation of the second aspect, the first trigger condition is a screen-off operation, and the first interface is a screen-off interface.
[0041] In a possible implementation of the second aspect, a first material of the first interface element is the same as a second material of the target subject in the wallpaper.
[0042] In a possible implementation of the second aspect, the first material is a main material of the first interface element, and the second material is a main material of the target body.
[0043] In a possible implementation of the second aspect, the third material of the first interface element is the same as the fourth material of the target body.
[0044] In a possible implementation of the second aspect, an area ratio of each material in the first interface element matches an area ratio of each corresponding material in the target body.
[0045] In a possible implementation manner of the second aspect, a color of the first interface element matches a color of the main body.
[0046] In a possible implementation of the second aspect, when the main body includes multiple colors, the first interface element includes one or more colors corresponding to the color of the main body.
[0047] In a possible implementation manner of the second aspect, the first interface further includes a second interface element, and a color of the second interface element matches a color of the main body.
[0048] In a possible implementation of the second aspect, when the main body includes multiple colors, the color of the second interface element is one of the main colors of the main body.
[0049] In a possible implementation of the second aspect, the first interface element includes one of the following: text, an icon, and a card.
[0050] In a possible implementation of the second aspect, the first interface element includes text, and a font of the text matches a style of the wallpaper.
[0051] In a possible implementation of the second aspect, the first interface element includes a first text in a clock control.
[0052] In a possible implementation of the second aspect, the interface display device further includes a determination module and a generation module, wherein the determination module is used to: determine a corresponding material map and PBR parameters according to the material of the subject;
[0053] The generation module is used to render and generate a first interface element according to the material map and the PBR parameters.
[0054] In a possible implementation of the second aspect, the material map is determined according to the material of the main body and the color of the main body.
[0055] In a possible implementation of the second aspect, before rendering and generating the first interface element, the generating module is further used to: generate a corresponding normal map and corresponding texture map coordinates according to the material map;
[0056] The generation module is specifically used to render and generate a first interface element according to the material map, the PBR parameters, the normal map and the texture map coordinates.
[0057] In a third aspect, an embodiment of the present application provides an electronic device, comprising: a memory and a processor, the memory being used to store a computer program; the processor being used to execute the method described in the first aspect or any one of the implementations of the first aspect when calling the computer program.
[0058] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the method described in the first aspect or any one of the embodiments of the first aspect is implemented.
[0059] In a fifth aspect, an embodiment of the present application provides a computer program product. When the computer program product runs on an electronic device, the electronic device executes the method described in the first aspect or any implementation method of the first aspect.
[0060] In a sixth aspect, an embodiment of the present application provides a chip system, including a processor, the processor is coupled to a memory, and the processor executes a computer program stored in the memory to implement the method described in the first aspect or any embodiment of the first aspect. The chip system can be a single chip or a chip module composed of multiple chips.
[0061] It can be understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0062] Figure 1 A flowchart of an interface display method provided in an embodiment of the present application;
[0063] Figure 2 to Figure 5 A schematic diagram of a first interface provided in an embodiment of the present application;
[0064] Figure 6 A schematic diagram of the relationship between the wallpaper style and the font style of the text in the first interface provided by an embodiment of the present application;
[0065] Figure 7 A schematic diagram of a flow chart of a method for generating a first interface element and a second interface element provided in an embodiment of the present application;
[0066] Figure 8 A schematic diagram of a wallpaper and corresponding image description information provided in an embodiment of the present application;
[0067] Fig. 9 A schematic diagram of the software architecture of an electronic device provided in an embodiment of the present application;
[0068] Fig.10 A schematic diagram of the structure of an interface display device provided in an embodiment of the present application;
[0069] Fig.11 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0070] The embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. The terms used in the implementation method section of the embodiments of the present application are only used to explain the specific embodiments of the present application, and are not intended to limit the present application. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments.
[0071] Electronic devices can improve the visual effect of a user interface (UI) by changing the wallpaper and the appearance of interface elements (such as controls) of the user interface. However, when a user resets the wallpaper or the wallpaper is automatically changed regularly, the new wallpaper is likely to be inconsistent with or even contradictory to the style of the original interface elements of the user interface, thereby affecting the visual effect of the user interface.
[0072] To this end, the present application provides an interface display method for improving the visual effect of the user interface through the wallpaper of the user interface and the appearance of the interface elements.
[0073] The interface display method provided in the present application can be applied to various electronic devices that present a user interface to a user through a screen, such as a personal computer (PC), a smart phone, a netbook, a tablet computer, a handheld computer, etc. In the embodiments of the present application, the electronic device is a mobile phone as an example for exemplary description.
[0074] In order to facilitate understanding of the technical solutions in the embodiments of the present application, some of the terms involved in the embodiments of the present application are first explained below:
[0075] User interface: Also known as user interface, it is the medium for interaction and information exchange between the system and the user, and is used to realize the conversion between the internal form of information and the form acceptable to humans. The user interface includes software and hardware parts that realize the information exchange between users and systems. The software part includes the agreement of information exchange between users and systems, operation commands and other processing software, and the hardware part includes input devices and output devices (including but not limited to display screens, touch screens, soft keyboards, virtual controls, physical keyboards, function keys (such as volume control buttons, switch buttons, etc.), trackballs, mice, joysticks, cameras, and input and output devices that can be realized by future technologies). The user interface enables users to conveniently and effectively operate the hardware to achieve interaction and complete the work they want to complete with the help of hardware. The definition of user interface is broad, and user interface exists in all fields involving information exchange between humans and machines.
[0076] Interface elements: refers to a series of elements contained in the system interface, such as software that can meet user interaction needs. Interface elements can include windows, dialog boxes, menus, scroll bars, graphics, text, icons, cards, etc.
[0077] Figure 1 A flow chart of the interface display method provided in the embodiment of the present application is shown as follows: Figure 1 As shown, the interface display method provided in this embodiment may include the following steps:
[0078] S110: Detect a first trigger condition and display a first interface.
[0079] The first trigger condition may be a first operation input by a user. The first operation may be a screen-on operation, and the corresponding first interface may be a lock screen interface or a desktop of an electronic device, etc.; the first operation may also be a screen-off operation, and the corresponding first interface may be a screen-off interface; the first operation may also be an unlocking operation or an operation in which the user switches a user interface on the electronic device, etc., and the corresponding first interface may be the desktop of the electronic device or other user interfaces.
[0080] The first trigger condition may also be timeout screen lock or timeout screen off, etc.
[0081] For ease of explanation, in the embodiment of the present application, an example is given by taking the first trigger condition being a screen-on operation and the first interface being a lock screen interface.
[0082] Among them, the first operation can be a button operation, or it can be a touch operation, voice control operation or air gesture operation, etc., among which the touch operation can be a click operation or a gesture operation, etc. The embodiment of the present application does not specifically limit this. The other user operations described in the embodiment of the present application are similar. For the sake of convenience of explanation, the embodiment of the present application takes button operation / click operation as an example for illustrative explanation.
[0083] The naming method for the operations input by the user in the embodiment of the present application is only an example and should not be understood as a limitation to the embodiment of the present application. In some embodiments, the same operation may also be named by other names.
[0084] The first interface may include a wallpaper and a first interface element.
[0085] The first interface element may be located above the wallpaper or around the wallpaper.
[0086] The material of the first interface element can be similar to or the same as the material of the main body in the wallpaper (i.e., the main object in the wallpaper, the area of the main object in the wallpaper can be greater than or equal to the set ratio, such as 1 / 10), so as to make the first interface element more coordinated and unified with the wallpaper, and improve the overall visual effect of the first interface.
[0087] In some embodiments, when the wallpaper includes only one main body and the main body includes only one material, the material of the first interface element may be similar to or the same as the material of the main body in the wallpaper.
[0088] For example, the first interface element is text displayed in the interface, such as the time displayed by a clock control. Figure 2 As shown in (a), the main body of the wallpaper in the first interface is a dog, and its corresponding material is hair. The material of the text used to display the time in the clock control in the first interface can also be hair, which is the same as the material of the main body of the wallpaper. Figure 2 As shown in (b), the main body of the wallpaper in the first interface is a metal object with a strong sense of technology, the corresponding material is metal, and the shape is relatively smooth, then the material of the text used to display the time in the clock control can be a metal material similar to mercury, which is similar to the material of the main body of the wallpaper.
[0089] In some embodiments, the first interface element may also include a card element, such as a music control in a card. Figure 3 As shown, the main body of the wallpaper in the first interface is a dog, and the corresponding material is hair. In the card displayed in the first interface, the material corresponding to the "Play / Pause" button of the music control is also hair, which is the same as the material of the main body of the wallpaper.
[0090] In some embodiments, the first interface element may also include an icon. Figure 3 As shown, the main body of the wallpaper in the first interface is a dog, and its corresponding material is hair. The material of the camera icon in the first interface is also hair, which is the same as the material of the main body of the wallpaper.
[0091] In some embodiments, when the only subject in the wallpaper includes multiple materials, the material of the first interface element can be the main material of the subject in the wallpaper. Figure 4 As shown, the main body of the wallpaper is a flower, and the materials of its petals, stamens and flower stems are different (the main material is the material of the petals and flower stems), and the material of the text used to display time in the clock control includes the material of the petals and flower stems.
[0092] In some embodiments, when the only subject in the wallpaper includes multiple main materials, the material of the first interface element may also include only part of the main materials of the only subject in the wallpaper. For example, the only subject in the wallpaper is a flower, and its main materials include the materials of the petals and the materials of the flower stems. The material of the text used to display the time in the clock control may only include the materials of the petals or the flower stems.
[0093] In some embodiments, when the only subject in the wallpaper includes multiple materials, the material of the first interface element may include both the primary material of the subject in the wallpaper and the secondary material of the subject in the wallpaper. For example, if the subject of the wallpaper is a flower, the materials of its petals, stamens, and flower stems are different, and the material of the text used to display the time in the clock control may include both the materials of the petals and flower stems and the material of the stamens.
[0094] It is understandable that, when the only main body of the wallpaper includes multiple secondary materials, the first interface element may include some of the secondary materials in the main body, or may include all of the secondary materials in the main body.
[0095] In some embodiments, there may be multiple subjects in the wallpaper, in which case the material of the first interface element may include the material of each subject in the wallpaper. For example, if the subjects in wallpaper 1 include trees, dogs, and stones, the material of the first interface element may include wood (corresponding to trees), hair (corresponding to dogs), and stone (corresponding to stones).
[0096] In some embodiments, when there are multiple subjects in the wallpaper, the material of the first interface element may also include only the material of the most important subject in the wallpaper. For example, the subjects in wallpaper 1 include trees, dogs and stones, among which the dog is the most important subject, then the material of the first interface element may include only hair.
[0097] In some embodiments, when there are multiple subjects in the wallpaper, the material of the first interface element may also include the material of the main subject and part of the secondary subject in the wallpaper. For example, the subjects in wallpaper 1 include trees, dogs and stones, where the dog is the main subject and the trees and stones are the secondary subjects. Then the material of the first interface element may include hair and wood, or hair and stone.
[0098] In some embodiments, when there are multiple subjects in the wallpaper and some of the subjects include multiple materials, the material of the first interface element may include only the main material of each subject in the wallpaper, or may include both the main material of each subject in the wallpaper and some secondary materials of each subject in the wallpaper, or may include both the main material of each subject in the wallpaper and all secondary materials of each subject in the wallpaper.
[0099] Furthermore, the area ratio of each material in the first interface element can also match the area ratio of each corresponding material in each main body, so that the first interface element and the wallpaper can be more matched in terms of material, making the first interface element and the wallpaper more coordinated, further improving the overall visual effect of the user interface. For example, the area ratio of trees and dogs in wallpaper 1 is about 4 to 1, and the area ratio of wood and hair in the first interface element can also be 4 to 1.
[0100] In some embodiments, the color of the first interface element may also match the color of the main body of the wallpaper, so that the first interface element and the wallpaper are more coordinated in color, further improving the overall visual effect of the user interface.
[0101] The color of the first interface element can be the same as the color of the main body of the wallpaper, such as Figure 2 As shown in (a), the main body of the wallpaper is a white dog, and the material of the text corresponding to the clock control can be hair and the color can be white. The color of the first interface element can also be the same color as the main body of the wallpaper or a contrasting color of the wallpaper.
[0102] In the case where the main body of the wallpaper includes multiple colors, the color of the first interface element may correspond to the main body of the wallpaper, including multiple colors. Figure 5 As shown, the main body of the wallpaper is jade of different colors, the material of the text used to display time in the clock control is also jade, and the color includes the color of each jade in the wallpaper.
[0103] In the case where the wallpaper includes multiple subjects, the color of the first interface element may include the color of each subject in the wallpaper. For example, if the subject in wallpaper 1 includes green trees and a white dog, the color of the first interface element may include green and white.
[0104] In some embodiments, when the wallpaper includes multiple subjects, the color of the first interface element may also include only the main color of each subject in the wallpaper. For example, the subjects in wallpaper 2 include a black dog wearing a silver collar (main color is black, secondary color is silver) and a flower with a green flower path and red flowers (main color is red, secondary color is green), then the color of the first interface element may include black and red.
[0105] When the first interface element includes text, in some embodiments, the font of the text in the first interface can match the style of the wallpaper, so that the first interface element and the wallpaper are more coordinated in style, further improving the overall visual effect of the user interface. Figure 6 As shown in (a) in FIG. 1 , the main body of the wallpaper is a handsome dog, and the text used to display the time in the corresponding time control can be a standard font of a similar style, such as Times New Roman. For example, Figure 6 As shown in (b), the main body of the wallpaper is a cute dog, and the text used to display the time in the corresponding time control can be an artistic font of a similar style.
[0106] In some embodiments, the first interface element may also have a three-dimensional display effect to further improve the overall visual effect of the user interface. Figure 2 As shown in (a) and (b) in the figure, the text used to display time in the time control has a three-dimensional display effect.
[0107] In some embodiments, the first interface may further include a second interface element, such as Figure 2 As shown in (a), the signal icon, power icon, time icon, and text for displaying the date in the clock control, etc., located above the first interface. The color of the second interface element can be the same as the color of the main body of the wallpaper, so that the second interface element and the wallpaper are more coordinated and unified, and the overall visual effect of the first interface is improved.
[0108] When the main body of the wallpaper includes multiple colors, the color of the second interface element can correspond to the color of the main body of the wallpaper, including multiple colors, and the color of the second interface element can also be one of the main colors of the main body. For example, the main body of the wallpaper is a flower, and its main colors include red (flowers) and green (flower stems). The color of the second interface element can be red, green, or both red and green.
[0109] It will be understood that the user interface shown in the embodiment of the present application is merely an example and is not intended to limit the present application. In some embodiments, the user interface displayed by the electronic device may include more or fewer interface elements than shown in the figure to implement more or fewer functions; the position of each interface element may be adjusted as needed; each function may also be implemented using other interface elements or in other user interfaces, and this embodiment does not specifically limit this.
[0110] The specific generation method of the first interface element and the second interface element in the present application is described below.
[0111] Figure 7A schematic diagram of a flow chart of a method for generating a first interface element and a second interface element provided in an embodiment of the present application, such as Figure 7 As shown, the method for generating the first interface element and the second interface element provided in the embodiment of the present application may include the following steps:
[0112] S210: Determine image description information of the wallpaper of the first interface.
[0113] Different user interfaces may correspond to the same wallpaper or different wallpapers. For example, the wallpaper corresponding to the screen-lit interface may be the same as or different from the wallpaper corresponding to the desktop of the electronic device.
[0114] The image description information of the wallpaper may include a description of the subject and background of the wallpaper.
[0115] Specifically, the image description information corresponding to the wallpaper can be determined by means of artificial intelligence generated content (AIGC) and the like. Figure 8 As shown in (a) in FIG. 1 , the corresponding image description information may include white, long hair, fox dog, erect ears, cute, etc. Figure 8 As shown in (b) in FIG. 1 , the corresponding image description information may include forest, white, long hair, fox dog, erect ears, cute, hand, ring, etc. Figure 8 As shown in (c) in the figure, the corresponding image description information may include seaside, black, wolfhound, collar, handsome, etc.
[0116] S220: Determine a texture keyword corresponding to the wallpaper according to the image description information.
[0117] Specifically, the image description information of the wallpaper can be filtered to generate corresponding sticker keywords. The filtered sticker keywords may include a description of the material, color, etc. of the main body of the wallpaper. For example, Figure 8 The generated map keywords after filtering the image description information in (a) can be white, long hair, Figure 8 The keywords of the stickers generated after filtering the image description information in (b) can be white, long hair, Figure 8 The keywords of the stickers generated after filtering the image description information in (c) may be black, short hair, silver, and collar.
[0118] S230. Generate corresponding material maps and PBR parameters according to the map keywords.
[0119] Specifically, the corresponding material map can be generated by AIGC according to the map keyword related to the material. For example, if the map keyword related to the material is long hair, the generated material map can be a map of the hair material.
[0120] In some embodiments, the color of the corresponding material map can be further determined according to the color-related map keyword, so that the color of the first interface element finally generated matches the color of the wallpaper body. For example, if the color-related map keyword is white, the color of the material map can also be white.
[0121] The material map can occupy the space corresponding to the first interface element for subsequent rendering.
[0122] Physically based rendering (PBR) parameters may include metalness, roughness, reflectivity, etc. The specific values of the PBR parameters are related to the material of the first interface element. For example, plastic material corresponds to a higher roughness, and metal material corresponds to a higher reflectivity and metalness.
[0123] PBR parameters can be determined based on the map keywords associated with the material.
[0124] Specifically, the specific PBR parameter corresponding to a certain texture keyword can be determined according to the mapping relationship between the set texture keyword and the PBR parameter.
[0125] In some embodiments, when no PBR parameters directly corresponding to a certain texture keyword A are found, the PBR parameters corresponding to the texture keyword B closest to the texture keyword A in the above mapping relationship can also be used as the PBR parameters corresponding to the texture keyword A.
[0126] In some embodiments, when a PBR parameter directly corresponding to a certain texture keyword A is not found, it is also possible to first determine a texture keyword B, a texture keyword C, etc. that are closer to the texture keyword A, and then use the average value of the PBR parameters corresponding to the texture keyword B, the texture keyword C, etc. in the above mapping relationship as the PBR parameter corresponding to the texture keyword A.
[0127] S240, generating a corresponding normal map and corresponding UV coordinates according to the material map.
[0128] In order to make the finally generated first interface element have a three-dimensional visual effect, a corresponding normal map and UV coordinates (UV coordinates) may also be generated according to the material map to facilitate subsequent 3D rendering.
[0129] S250: Determine a font model of the characters in the text corresponding to the first interface element according to the image description information.
[0130] Specifically, the words related to the wallpaper style in the image description information can be first identified, and then the fonts corresponding to the words related to the wallpaper style in the image description information can be determined based on the mapping relationship between the words describing various styles and the fonts. Then, the corresponding font model can be determined based on the font, and the determined font model can be used as the font model of the text corresponding to the first interface element.
[0131] For example, the image description information is forest, white, long hair, fox dog, erect ears, cute, hand, and ring. The word related to the wallpaper style in the image description information is cute. In the mapping relationship between words and fonts, the font mapped to the word "cute" is art font C. The font model of the text corresponding to the first interface element can be the font model corresponding to art font C.
[0132] In some embodiments, if there is no font that is mapped to word a in the mapping relationship between words and fonts, the font model corresponding to word b in the mapping relationship between words and fonts that is closest to the style described by word a can be used as the font model for the text corresponding to the first interface element.
[0133] The font model may be a two-dimensional (2D) model or a three-dimensional (3D) model. In this embodiment, the font model is a 3D model as an example for exemplary description.
[0134] It is understandable that different font models of the same text may have different corresponding UV coordinates.
[0135] S260, rendering and generating a first interface element according to the material map, PBR parameters, normal map and UV coordinates.
[0136] Specifically, the material map, PBR parameters, normal map, UV coordinates, lighting parameters and camera parameters may be first input into a 3D rendering engine to generate a corresponding first interface element.
[0137] The lighting parameters and the camera parameters may be fixed or adjusted according to different wallpapers. For example, the lighting parameters may be adjusted according to the light intensity and the light angle in the wallpaper.
[0138] In some embodiments, the font model of the characters in the text corresponding to the first interface element may also be input as an input parameter to the 3D rendering engine to generate the corresponding first interface element.
[0139] S270: Generate a corresponding second interface element according to the texture keyword.
[0140] Specifically, the second interface element of the corresponding color can be generated according to the color-related map keywords. For example, if the color-related map keywords are black and silver, the color of the generated second interface element can be either black or silver, or both black and silver.
[0141] It is understandable that some first interface elements may change over time, for example, the text in the clock control may change over time, or may change in response to user operations, for example, the pause icon in the music control may change when the user clicks it. Therefore, when the first interface element changes, the changed first interface element may be updated according to the wallpaper of the first interface.
[0142] Taking the clock control as an example, when the text in the clock control changes, you can first determine the UV coordinates and font model corresponding to the changed text, and then input the new UV coordinates, new font model, material map, PBR parameters, normal map, lighting parameters and camera parameters corresponding to the clock control into the 3D rendering engine to generate new text.
[0143] In some implementations, each time a new character (such as 0 to 9) of the clock control is generated, the image corresponding to the character may be stored for subsequent reuse.
[0144] Specifically, each time the text of the clock control changes, you can first search whether there is a picture corresponding to the changed text. If so, you can directly replace the original picture with the picture; if not, you can first determine the UV coordinates and the corresponding font model corresponding to the changed text, and then input the new UV coordinates, the new font model, the material map, PBR parameters, normal map, lighting parameters and camera parameters corresponding to the clock control into the 3D rendering engine to generate new text and store the picture corresponding to the new text.
[0145] The interface display method provided in the embodiment of the present application matches the material of the first interface element in the displayed first interface with the material of the wallpaper, so that the first interface element in the first interface and the wallpaper are more coordinated and unified, thereby improving the overall visual effect of the user interface.
[0146] Those skilled in the art will appreciate that the above embodiments are exemplary and are not intended to limit the present application. Where possible, the execution order of one or more of the above steps may be adjusted or selectively combined to obtain one or more other embodiments. For example, in some embodiments, step S250 may be performed after step S220, and in other embodiments, step S250 may also be performed before step S220; in some embodiments, step S270 may be performed after step S230, and in other embodiments, step S270 may also be performed before step S230; in some embodiments, step S240, step S250, and step S270 may not be performed, and in some embodiments, some steps in step S240, step S250, and step S270 may be performed. Those skilled in the art may select and combine any of the above steps as needed, and all those that do not depart from the essence of the present application scheme shall fall within the scope of protection of the present application.
[0147] Based on the same concept, the embodiment of the present application also provides an electronic device, the software system of the electronic device can adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture or a cloud architecture. The embodiment of the present invention takes the Android system of the layered architecture as an example to illustrate the software structure of the electronic device.
[0148] Fig. 9 A schematic diagram of the software architecture of an electronic device provided in an embodiment of the present application, such as Fig. 9 As shown, the software system of the electronic device can be divided into several layers. In some embodiments, the Android system can be divided into an application layer, an application framework layer, an Android runtime (Android runtime) and a system library, and a kernel layer from top to bottom.
[0149] The application layer may include applications such as camera, gallery, calendar, call, map, WLAN, Bluetooth, music, video, short message, multi-tasking management, etc.
[0150] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.
[0151] like Fig. 9 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
[0152] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.
[0153] Content providers are used to store and retrieve data and make it accessible to applications.
[0154] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. The display interface can be composed of one or more views.
[0155] The phone manager is used to provide communication functions for electronic devices, such as the management of call status (including answering, hanging up, etc.).
[0156] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.
[0157] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of an icon or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.
[0158] Android runtime includes core libraries and virtual machines. Android runtime is responsible for Scheduling and management of the system.
[0159] The core library consists of two parts: one is the function that the Java language needs to call, and the other is The core library.
[0160] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
[0161] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.
[0162] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.
[0163] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0164] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0165] A 2D graphics engine is a drawing engine for 2D drawings.
[0166] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.
[0167] After the user inputs a touch operation, the touch sensor in the hardware device can generate a corresponding hardware interrupt and send it to the kernel layer. The kernel layer can encapsulate the touch operation into a touch event (for example, a touch press (action down) event, a touch move (action move) event, and a touch lift (action up) event, etc.), and can report the touch event to the upper-level APP through the input module in the system library.
[0168] Based on the same concept, as an implementation of the above method, an embodiment of the present application provides an interface display device, and the device embodiment corresponds to the above method embodiment. For ease of reading, the present device embodiment will no longer repeat the details of the above method embodiment one by one, but it should be clear that the device in this embodiment can correspond to and implement all the contents in the above method embodiment.
[0169] Fig.10 A schematic diagram of the structure of the interface display device provided in the embodiment of the present application, such as Fig.10 As shown, the interface display device provided in this embodiment may include:
[0170] Display module 310: used to detect a first trigger condition and display a first interface, wherein the first interface includes a wallpaper and a first interface element, and the material of the first interface element matches the material of the main body included in the wallpaper.
[0171] In a possible implementation of the second aspect, the first trigger condition is a screen-on operation, and the first interface is a lock screen interface.
[0172] In a possible implementation of the second aspect, the first trigger condition is a screen-off operation, and the first interface is a screen-off interface.
[0173] In a possible implementation of the second aspect, a first material of the first interface element is the same as a second material of the target subject in the wallpaper.
[0174] In a possible implementation of the second aspect, the first material is a main material of the first interface element, and the second material is a main material of the target body.
[0175] In a possible implementation of the second aspect, the third material of the first interface element is the same as the fourth material of the target body.
[0176] In a possible implementation of the second aspect, an area ratio of each material in the first interface element matches an area ratio of each corresponding material in the target body.
[0177] In a possible implementation manner of the second aspect, a color of the first interface element matches a color of the main body.
[0178] In a possible implementation of the second aspect, when the main body includes multiple colors, the first interface element includes one or more colors corresponding to the color of the main body.
[0179] In a possible implementation manner of the second aspect, the first interface further includes a second interface element, and a color of the second interface element matches a color of the main body.
[0180] In a possible implementation of the second aspect, when the main body includes multiple colors, the color of the second interface element is one of the main colors of the main body.
[0181] In a possible implementation of the second aspect, the first interface element includes one of the following: text, an icon, and a card.
[0182] In a possible implementation of the second aspect, the first interface element includes text, and a font of the text matches a style of the wallpaper.
[0183] In a possible implementation of the second aspect, the first interface element includes a first text in a clock control.
[0184] In a possible implementation of the second aspect, the interface display device further includes a determination module 320 and a generation module 330, wherein the determination module 320 is used to: determine a corresponding material map and PBR parameters according to the material of the subject;
[0185] The generating module 330 is used to render and generate a first interface element according to the material map and the PBR parameters.
[0186] In a possible implementation of the second aspect, the material map is determined according to the material of the main body and the color of the main body.
[0187] In a possible implementation of the second aspect, before rendering and generating the first interface element, the generating module 330 is further used to: generate a corresponding normal map and corresponding texture map coordinates according to the material map;
[0188] The generation module 330 is specifically used to render and generate a first interface element according to the material map, the PBR parameters, the normal map and the texture map coordinates.
[0189] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated in a processing unit, or each unit can exist physically separately, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of this application. The specific working process of the units and modules in the above-mentioned system can refer to the corresponding process in the aforementioned method embodiment, which will not be repeated here.
[0190] Based on the same concept, the present application also provides an electronic device, see Fig.11 , Fig.11 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
[0191] The electronic device may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display screen 294, and a subscriber identification module (SIM) card interface 295, etc. The sensor module 280 may include a solid pressure sensor 280A, a gyroscope sensor 280B, a pressure sensor 280C, a magnetic sensor 280D, an acceleration sensor 280E, a distance sensor 280F, a proximity light sensor 280G, a fingerprint sensor 280H, a temperature sensor 280J, a touch sensor 280K, an ambient light sensor 280L, a bone conduction sensor 280M, etc.
[0192] It is to be understood that the structures illustrated in the embodiments of the present application do not constitute specific limitations on the electronic device. In other embodiments of the present application, the electronic device may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0193] The processor 210 may include one or more processing units, for example, the processor 210 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated in one or more processors.
[0194] The controller can be the nerve center and command center of the electronic device. The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.
[0195] The processor 210 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 210 is a cache memory. The memory may store instructions or data that the processor 210 has just used or cyclically used. If the processor 210 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 210, and thus improves the efficiency of the system.
[0196] In some embodiments, the processor 210 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0197] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). The I2S interface can be used for audio communication. The PCM interface can also be used for audio communication to sample, quantize and encode analog signals. The UART interface is a universal serial data bus used for asynchronous communication; the bus can be a bidirectional communication bus, which converts the data to be transmitted between serial communication and parallel communication. The MIPI interface can be used to connect the processor 210 with peripheral devices such as the display screen 294 and the camera 293; the MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. The GPIO interface can be configured by software, and the GPIO interface can be configured as a control signal or a data signal. The USB interface 230 is an interface that complies with the USB standard specification, and can specifically be a Mini USB interface, a MicroUSB interface, a USB Type C interface, etc. The USB interface 230 can be used to connect a charger to charge an electronic device, and can also be used to transmit data between an electronic device and a peripheral device. It can also be used to connect headphones and play audio through headphones. This interface can also be used to connect other electronic devices, such as AR devices, etc.
[0198] It is understandable that the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.
[0199] The charging management module 240 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 240 may receive charging input from a wired charger through the USB interface 230. In some wireless charging embodiments, the charging management module 240 may receive wireless charging input through a wireless charging coil of the electronic device. While the charging management module 240 is charging the battery 242, it may also power the electronic device through the power management module 241.
[0200] The power management module 241 is used to connect the battery 242, the charging management module 240 and the processor 210. The power management module 241 receives input from the battery 242 and / or the charging management module 240, and supplies power to the processor 210, the internal memory 221, the external memory, the display screen 294, the camera 293, and the wireless communication module 260. The power management module 241 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 241 can also be set in the processor 210. In other embodiments, the power management module 241 and the charging management module 240 can also be set in the same device.
[0201] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 250, wireless communication module 260, modem processor and baseband processor.
[0202] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0203] The mobile communication module 250 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to electronic devices. The mobile communication module 250 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 250 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 250 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 250 can be set in the processor 210. In some embodiments, at least some of the functional modules of the mobile communication module 250 can be set in the same device as at least some of the modules of the processor 210.
[0204] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 270A, a receiver 270B, etc.), or displays an image or video through a display screen 294. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 210 and be set in the same device as the mobile communication module 250 or other functional modules.
[0205] The wireless communication module 260 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc., which are applied to electronic devices. The wireless communication module 260 can be one or more devices integrating at least one communication processing module. The wireless communication module 260 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering processing, and sends the processed signal to the processor 210. The wireless communication module 260 can also receive the signal to be sent from the processor 210, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0206] In some embodiments, the antenna 1 of the electronic device is coupled to the mobile communication module 250, and the antenna 2 is coupled to the wireless communication module 260, so that the electronic device can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division-synchronous code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GNSS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).
[0207] The electronic device implements the display function through a GPU, a display screen 294, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 210 may include one or more GPUs that execute program instructions to generate or change display information.
[0208] The display screen 294 is used to display images, videos, etc. The display screen 294 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a Micro LED, a quantum dot light emitting diode (QLED), etc. In some embodiments, the electronic device may include 1 or N display screens 294, where N is a positive integer greater than 1.
[0209] The electronic device can realize the shooting function through ISP, camera 293, video codec, GPU, display screen 294 and application processor.
[0210] The ISP is used to process data fed back by the camera 293. The camera 293 is used to capture static images or videos. The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. The video codec is used to compress or decompress digital videos.
[0211] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and continuously self-learn. NPU can realize applications such as intelligent cognition of electronic devices, such as image recognition, face recognition, voice recognition, text understanding, etc.
[0212] The internal memory 221 can be used to store computer executable program codes, which include instructions. The processor 210 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 221. The internal memory 221 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, and at least one application required for a function (such as a sound playback function, an image playback function, etc.). The data storage area may store data created during the use of the electronic device (such as audio data, a phone book, etc.). In addition, the internal memory 221 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0213] The external memory interface 220 can be used to connect an external memory, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 210 through the external memory interface 220 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.
[0214] The electronic device can implement audio functions such as music playing and recording through the audio module 270, the speaker 270A, the receiver 270B, the microphone 270C, the headphone jack 270D, and the application processor.
[0215] The audio module 270 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 270 can also be used to encode and decode audio signals. In some embodiments, the audio module 270 can be arranged in the processor 210, or some functional modules of the audio module 270 are arranged in the processor 210. The speaker 270A, also known as the "speaker", is used to convert audio electrical signals into sound signals. The receiver 270B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 270C, also known as the "microphone" and "microphone", is used to convert sound signals into electrical signals. The headphone interface 270D is used to connect wired headphones. The headphone interface 270D can be a USB interface 230, or it can be a 3.5mm open mobile electronic equipment platform (open mobile terminal platform, OMTP) standard interface, the American Cellular Telecommunications Industry Association (cellular telecommunications industry association of the USA, CTIA) standard interface.
[0216] The key 290 includes a power button, a volume button, etc. The key 290 can be a mechanical key. It can also be a touch key. The electronic device can receive key input and generate key signal input related to the user settings and function control of the electronic device. The motor 291 can generate a vibration prompt. The motor 291 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. The indicator 292 can be an indicator light, which can be used to indicate the charging status, power changes, messages, missed calls, notifications, etc. The SIM card interface 295 is used to connect the SIM card. The SIM card can be inserted into the SIM card interface 295, or pulled out from the SIM card interface 295 to achieve contact and separation with the electronic device. The electronic device can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 295 can support Nano SIM cards, Micro SIM cards, SIM cards, etc.
[0217] The electronic device provided in this embodiment can execute the above method embodiment, and its implementation principle and technical effect are similar, which will not be repeated here.
[0218] The embodiment of the present specification also provides a computer device, which includes a processor and a memory, wherein the memory is used to store a computer program, and the processor is used to read the computer program to implement the method described in the above method embodiment.
[0219] The embodiments of the present specification also provide a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the method described in the above method embodiments is implemented.
[0220] The embodiments of the present specification also provide a computer program product. When the computer program product is run on an electronic device, the electronic device implements the method described in the above method embodiments when executing the computer program product.
[0221] The embodiment of this specification also provides a chip system, including a processor, the processor is coupled to a memory, and the processor executes a computer program stored in the memory to implement the method described in the above method embodiment. The chip system can be a single chip or a chip module composed of multiple chips.
[0222] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of this specification is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from a website site, computer, server or data center to another website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk or a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.
[0223] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiments can be implemented by computer programs to instruct related hardware, and the programs can be stored in computer-readable storage media. When the programs are executed, they can include the processes of the above-mentioned method embodiments. The aforementioned storage media can include: ROM or random access memory RAM, magnetic disk or optical disk and other media that can store program codes.
[0224] The naming or numbering of the steps in this specification does not mean that the steps in the method flow must be executed in the time / logical sequence indicated by the naming or numbering. The execution order of the named or numbered process steps can be changed according to the technical purpose to be achieved, as long as the same or similar technical effects can be achieved.
[0225] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0226] In the embodiments provided in this specification, it should be understood that the disclosed devices / equipment and methods can be implemented in other ways. For example, the device / equipment embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0227] It should be understood that in the description of the present application specification and the appended claims, the terms "include", "comprises", "have" and any variations thereof are intended to cover non-exclusive inclusions and mean "including but not limited to", unless otherwise specifically emphasized. For example, a process, method, system, product or device that includes a series of steps or modules is not necessarily limited to those steps or modules that are clearly listed, but may include other steps or modules that are not clearly listed or inherent to these processes, methods, products or devices.
[0228] In the description of this specification, unless otherwise specified, " / " means that the objects associated before and after are in an "or" relationship, for example, A / B can mean A or B; "and / or" in this specification is used to describe the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural.
[0229] Furthermore, in the description of this specification, unless otherwise specified, "plurality" means two or more than two. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple.
[0230] As used in the specification and appended claims of this application, the term "if" can be interpreted as "when" or "uponce" or "in response to determining" or "in response to detecting", depending on the context. Similarly, the phrase "if it is determined" or "if [described condition or event] is detected" can be interpreted as meaning "uponce it is determined" or "in response to determining" or "uponce [described condition or event] is detected" or "in response to detecting [described condition or event]", depending on the context.
[0231] In addition, in the description of the present specification and the appended claims, the terms "first", "second", etc. are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence, nor can they be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein; the features defined as "first" or "second" may explicitly or implicitly include at least one of the features.
[0232] In the embodiments of this specification, words such as "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this specification should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.
[0233] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of this specification include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways.
[0234] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this specification, rather than to limit them. Although this specification has been described in detail with reference to the aforementioned embodiments, a person of ordinary skill in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some or all of the technical features therein may be replaced by equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this specification.
Claims
1. An interface display method, characterized in that: include: A first trigger condition is detected and a first interface is displayed, wherein the first interface includes a wallpaper and a first interface element, and a material of the first interface element matches a material of a main body included in the wallpaper.
2. The method according to claim 1, characterized in that The first trigger condition is a screen-on operation, and the first interface is a lock screen interface.
3. The method according to claim 1, characterized in that The first trigger condition is a screen-off operation, and the first interface is a screen-off interface.
4. The method according to any one of claims 1 to 3, characterized in that: The first material of the first interface element is the same as the second material of the target subject in the wallpaper.
5. The method according to claim 4, characterized in that The first material is the main material of the first interface element, and the second material is the main material of the target body.
6. The method according to claim 4 or 5, characterized in that: The third material of the first interface element is the same as the fourth material of the target body.
7. The method according to claim 6, characterized in that The area ratio of each material in the first interface element matches the area ratio of each corresponding material in the target body.
8. The method according to any one of claims 1 to 7, characterized in that: The color of the first interface element matches the color of the main body.
9. The method according to claim 8, characterized in that In the case that the main body includes multiple colors, the first interface element includes one or more colors corresponding to the colors of the main body.
10. The method according to any one of claims 1 to 9, characterized in that: The first interface also includes a second interface element, and the color of the second interface element matches the color of the main body.
11. The method according to claim 10, characterized in that In the case where the main body includes multiple colors, the color of the second interface element is one of the main colors of the main body.
12. The method according to any one of claims 1 to 11, characterized in that: The first interface element includes one of the following: text, icon and card.
13. The method according to claim 12, characterized in that The first interface element includes text, and the font of the text matches the style of the wallpaper.
14. The method according to any one of claims 1 to 13, characterized in that: The first interface element includes first text in a clock control.
15. The method according to any one of claims 1 to 14, characterized in that: The first interface element is generated in the following manner: Determine the corresponding material map and physically based rendering PBR parameters according to the material of the subject; A first interface element is generated by rendering according to the material map and the PBR parameters.
16. The method according to claim 15, characterized in that The material map is determined according to the material of the subject and the color of the subject.
17. The method according to claim 15 or 16, characterized in that Before rendering and generating the first interface element, the method further includes: generating a corresponding normal map and corresponding texture map coordinates according to the material map; The rendering and generating a first interface element according to the material map and the PBR parameters includes: A first interface element is generated by rendering according to the material map, the PBR parameters, the normal map and the texture map coordinates.
18. An electronic device, characterized in that: include: A memory and a processor, wherein the memory is used to store a computer program; and the processor is used to execute the method according to any one of claims 1 to 17 when calling the computer program.
19. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 17 is implemented.
20. A computer program product, characterized in that When the computer program product runs on an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 17.
21. A chip system, characterized in that: The chip system includes a processor, which is coupled to a memory, and the processor executes a computer program stored in the memory to implement the method according to any one of claims 1-17.
Citation Information
Cited By
Interface display method and electronic device
EP4749442A1
Interface display method and electronic device
WO2025091915A1