Interface display method, and electronic device and computer-readable storage medium

Abstract

The present application relates to the technical field of terminals. Provided are an interface display method, and an electronic device and a computer-readable storage medium, wherein a user can be provided with real-time feedback on their emotional states, enabling them to quickly understand their own emotional condition and thus further managing their psychological health in a timely manner. The method is applied to an electronic device, and comprises: displaying a first interface (S310), wherein the first interface is an interface displayed by the electronic device in a locked state; in response to an unlocking operation, acquiring emotional state information of a user on the basis of a facial image of the user (S320); and modifying the display state of a second interface on the basis of the emotional state information (S330), wherein the second interface is an interface displayed by the electronic device in an unlocked state.

Description

A method for displaying an interface, an electronic device, and a computer-readable storage medium.

[0001] This application claims priority to Chinese Patent Application No. 2025102329257, filed on February 26, 2025, entitled "An Interface Display Method, Electronic Device and Computer-Readable Storage Medium", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal technology, and in particular to an interface display method, electronic device, and computer-readable storage medium. Background Technology

[0003] With the ever-accelerating pace of modern life and increasing competitive pressure, people are prone to developing various complex emotions such as anxiety and irritability. Emotional problems don't develop overnight but rather accumulate and evolve over a long period. If we can promptly and keenly perceive changes in our emotional state and take effective measures to regulate and intervene as soon as emotional problems arise, preventing them from worsening, we can better maintain our physical and mental health and face life's challenges with a positive attitude. Therefore, how to efficiently and accurately help users obtain their own emotional state perception results has become an urgent problem to be solved. Summary of the Invention

[0004] This application provides an interface display method, an electronic device, and a computer-readable storage medium that can provide users with real-time feedback on their emotional state, enabling users to quickly understand their own emotional state and facilitate timely management of their mental health.

[0005] To achieve the above objectives, this application adopts the following technical solution:

[0006] In a first aspect, this application provides a method for displaying an interface, which is applied to an electronic device. The method includes:

[0007] Display a first interface, which is the interface displayed when the electronic device is locked;

[0008] In response to the unlocking operation, the user's emotional state information is obtained based on the user's facial image;

[0009] The display state of the second interface is modified according to the emotional state information. The second interface is the interface displayed when the electronic device is unlocked.

[0010] Based on the interface display method provided in this application, a first interface is displayed when the electronic device is in an unlocked state (i.e., locked screen state). Subsequently, not only can the electronic device be unlocked using the user's facial image, but the user's emotional state information can also be obtained based on the facial image. After the electronic device is unlocked, it can instantly modify the display state of the second interface based on the obtained user's emotional state information. Therefore, users do not need to rely on specific applications; they can clearly perceive their own emotional state simply through the intuitive changes in the display state of the second interface, effectively achieving instant feedback. This method effectively avoids the limitation of users needing to rely on specific applications to know their own emotions, promoting users' instant awareness of their own emotions.

[0011] Furthermore, linking emotional state with the display state of the unlocked second interface enables more efficient establishment of emotional resonance through real-time adaptation of visuals and interactions, and faster delivery of emotional reminders to users. This achieves a high degree of synchronization between emotional perception and interface presentation, enhancing the user experience while realizing personalized display of the second interface.

[0012] In one possible implementation of the first aspect, modifying the display state of the second interface according to the emotional state information includes: determining first information according to the emotional state information, the first information including at least one of the display color scheme of the wallpaper, the display color scheme of the background area in the wallpaper, the interface layout of the interface elements in the identification area of ​​the wallpaper, the display attributes of the filter, the display attributes of the application icon, and the display attributes of the application name; and modifying the display state of the second interface according to the first information.

[0013] It should be understood that the color scheme of the wallpaper can be a single color (i.e., a solid color) or two or more colors.

[0014] The display attributes of filters can include any of the following: filters with different colors, filters with different effects, filters with different textures, and filters with different themes. In other words, the display state of the second interface can be changed by changing the color, adding effects, applying textures, or using a specific theme.

[0015] The background area in a wallpaper refers to the area outside the designated areas. These designated areas can be used to identify different objects in the wallpaper (such as faces, flowers, trees, cats, dogs, text, icons, etc.). Correspondingly, the color scheme of the background area can be a combination of one or more colors.

[0016] It's easy to understand that the interface elements in a wallpaper can include text elements, image elements, etc. Text elements can include information such as time and date, while image elements can include images of different objects, logos of other devices that communicate with electronic devices (such as headphones), battery information, etc.

[0017] Based on the above possible implementation methods, the electronic device can obtain the user's emotional state information to determine first information including at least one of the following: wallpaper display color scheme, filter display attributes, wallpaper background area display color scheme, display style of interface elements in the marked area of ​​the wallpaper, and display color scheme of application icons. Then, based on the first information, the display state of the second interface is modified so that after the user unlocks the device, they can quickly understand their own emotional state from the intuitive changes in one or more of the aforementioned first information, thus realizing instant feedback on emotions.

[0018] In one possible implementation of the first aspect, modifying the display state of the second interface based on the emotional state information includes: determining a first image based on the emotional state information, the first image including at least one of an emoticon, a plant object, and an animal object corresponding to the emotional state information; and modifying the display state of the second interface based on the first image.

[0019] It should be understood that the plants included in the first image, corresponding to the emotional state information, can include different flowers, different trees, different vegetables, etc. Among these, different flowers can be flowers of different color families, flowers with different flower meanings, or flowers from different growing environments. Different trees can be trees with different leaf shapes, trees from different growing environments, or trees at different life stages, etc.

[0020] Optionally, the animals in the first image that correspond to the emotional state information may include animals of different body shapes, different living habits, or different dietary habits and living environments.

[0021] Based on the above possible implementation methods, a first image including emoticons, plants, animals, etc., is determined using the user's emotional state information. Then, the display state of the second interface is adjusted according to the first image. This allows users to intuitively and quickly understand their current emotional state from the relevant images appearing on the interface the moment they unlock the device, achieving instant emotional feedback and enabling them to understand their own emotional state in a timely manner.

[0022] For example, if a user's emotional state is "happy," the corresponding emoji may include one or more of the following: laughing emoji, smiling emoji, and playful emoji. In this case, the content displayed on the second interface can be directly modified to a first image composed of one or more of the aforementioned emojis, such as laughing emoji, smiling emoji, and playful emoji. Based on this, the user can quickly receive feedback on their emotional state through the first image displayed on the second interface.

[0023] The display state of the second interface can be further enriched by using the first image with different display content.

[0024] In one possible implementation of the first aspect, the method further includes: switching the sound effects of the currently playing media resource based on the emotional state information; or,

[0025] The media resource to be played is determined based on the emotional state information, and the media resource to be played is played. The media resource to be played includes one of the following: audio stored in the server corresponding to the first application, local audio, system audio, audio generated based on the user's second information, video stored in the server corresponding to the first application, local video, system video, and video generated based on the user's third information. The second information includes one or more of the following: the emotional state information, the user's location information, the user's personal information, time information, holiday information, and weather information. The third information is completely the same as, partially the same as, or completely different from the second information.

[0026] In one possible implementation of the first aspect, the method further includes: determining fourth information based on the emotional state information, the fourth information including emotion regulation information and / or prompting information, the prompting information being used to indicate the emotional state information; and displaying the fourth information on the second interface.

[0027] It should be understood that the display methods of the fourth information in the second interface may include full-screen display, pop-up display, half-screen display, display in the notification bar, or display in the live window, etc.

[0028] In one possible implementation of the first aspect, the second interface includes any one of an unlock interface, a desktop, and an application interface, wherein the unlock interface is related to the first interface.

[0029] It should be noted that the unlock screen can refer to the display screen shown by the electronic device in the unlocked state, which may be completely the same as or partially the same as the first screen, or partially different.

[0030] In one possible implementation of the first aspect, obtaining the user's emotional state information based on the user's facial image includes: determining the user's emotional state information based on the user's facial image and the user's physiological state data obtained by the wearable device, wherein the wearable device and the electronic device have a communication connection.

[0031] Optionally, user emotional state information can also be obtained based on one or more of the following: the user's historical operation records on electronic devices, the user's progress information on a certain task, the user's location information, the user's personal information, time information, holiday information, weather information, etc.

[0032] Secondly, this application provides an interface display device, which may include:

[0033] The display unit is used to display a first interface, which is the interface displayed by the electronic device in the unlocked state;

[0034] The acquisition unit is used to acquire the user's emotional state information based on the user's facial image in response to the unlocking operation;

[0035] The modification unit is used to modify the display state of the second interface according to the emotional state information. The second interface is the interface displayed by the electronic device in the unlocked state.

[0036] In one possible implementation of the second aspect, the modification unit is further configured to: determine first information based on the emotional state information, the first information including at least one of the display color scheme of the wallpaper, the display color scheme of the background area in the wallpaper, the display style of the interface elements in the identification area of ​​the wallpaper, the display attributes of the filter, and the display attributes of the application icon; and modify the display state of the second interface based on the first information.

[0037] In one possible implementation of the second aspect, the modification unit is further configured to: determine a first image based on the emotional state information, the first image including at least one of an emoticon, a plant, and an animal corresponding to the emotional state information; and modify the display state of the second interface based on the first image.

[0038] In one possible implementation of the second aspect, the interface display device further includes:

[0039] The switching unit is used to switch the sound effects of the currently playing media resource according to the emotional state information; or,

[0040] The first determining unit is configured to determine the media resource to be played based on the emotional state information, and play the media resource to be played. The media resource to be played includes one of the following: audio stored in the server corresponding to the first application, local audio, system audio, audio generated based on the user's second information, video stored in the server corresponding to the first application, local video, system video, and video generated based on the user's third information. The second information includes one or more of the following: the emotional state information, the user's location information, the user's personal information, time information, holiday information, and weather information. The third information is completely identical, partially identical, or completely different from the second information.

[0041] In one possible implementation of the second aspect, the interface display device further includes:

[0042] The second determining unit is configured to determine fourth information based on the emotional state information, the fourth information including emotion regulation information and / or prompting information, the prompting information being used to indicate the emotional state information;

[0043] The fourth information is displayed on the second interface.

[0044] In one possible implementation of the second aspect, the second interface includes any one of an unlock interface, a desktop, and an application interface, wherein the unlock interface is related to the first interface.

[0045] In one possible implementation of the second aspect, the acquisition unit is further configured to: determine the user's emotional state information based on the user's facial image and the user's physiological state data acquired by the wearable device, wherein the wearable device and the electronic device have a communication connection.

[0046] Thirdly, embodiments of this application provide an electronic device comprising: one or more processors; one or more memories; and one or more computer programs; wherein the one or more computer programs are stored in the one or more memories, and the one or more computer programs include instructions that, when executed by the electronic device, cause the electronic device to perform the method as described in any possible implementation of the second aspect above.

[0047] Fourthly, a computer-readable storage medium is provided, the computer-readable medium storing a computer program (also referred to as code or instructions) that, when the computer program code is run on a computer, causes the computer to perform the method in any of the above aspects or any possible implementation of any of the above aspects.

[0048] Fifthly, a computer program product comprising instructions is provided, the computer program product including: a computer program (also referred to as code or instructions) that, when the computer program is run on a computer, causes the computer to perform the method in any of the above aspects or any possible implementation of any of the above aspects.

[0049] It should be noted that the above-mentioned computer program code can be stored in whole or in part on the first storage medium, wherein the first storage medium can be packaged together with the processor or packaged separately from the processor, and this application does not make specific limitations in this regard.

[0050] In a sixth aspect, a chip system is provided, comprising: a processor and a memory, the memory for storing a computer program (also referred to as code or instructions), the processor for calling and running the computer program stored in the memory, such that a device or apparatus on which the chip system is installed performs the method of any of the above aspects or any possible implementation thereof.

[0051] It is understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant descriptions in the first aspect mentioned above, and will not be repeated here. Attached Figure Description

[0052] Figure 1 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.

[0053] Figure 2 is a schematic diagram of the software structure of an electronic device provided in an embodiment of this application.

[0054] Figure 3 is a flowchart illustrating an interface display method provided in an embodiment of this application.

[0055] Figure 4 is a schematic diagram of the lock screen interface of an electronic device in an unlocked state according to an embodiment of this application.

[0056] Figure 5 is a schematic diagram of the unlocking interface of an electronic device in an unlocked state according to an embodiment of this application.

[0057] Figure 6 is a schematic diagram of the unlocking interface of another electronic device in an unlocked state provided in an embodiment of this application.

[0058] Figure 7 is a schematic diagram of the desktop interface of an electronic device provided in an embodiment of this application.

[0059] Figure 8 is a schematic diagram of the interface of another electronic device desktop provided in an embodiment of this application.

[0060] Figure 9 is a schematic diagram of the interface related to the wallpaper in the second interface of an electronic device in an unlocked state, according to an embodiment of this application.

[0061] Figure 10 is a schematic diagram of the gradual change of wallpaper color in another second interface provided in an embodiment of this application.

[0062] Figure 11 is a schematic diagram of the interface of an electronic device in an unlocked state and related to various emoticons in a second interface, provided by an embodiment of this application.

[0063] Figure 12 is a schematic diagram of the interface of another electronic device in an unlocked state and related to an emoticon in the second interface, provided by an embodiment of this application.

[0064] Figure 13 is a schematic diagram of the interface related to flowers in the second interface of an electronic device in an unlocked state according to an embodiment of this application.

[0065] Figure 14 is a schematic diagram of the interface related to the gradual change of flowers in the second interface when an electronic device is in an unlocked state, according to an embodiment of this application.

[0066] Figure 15 is a schematic diagram of a wallpaper image before modification of the second interface provided in an embodiment of this application.

[0067] Figure 16 is a schematic diagram of setting a filter on the wallpaper image shown in Figure 14 according to an embodiment of this application.

[0068] Figure 17 is a schematic diagram of another method of applying a filter to the wallpaper image shown in Figure 14, according to an embodiment of this application.

[0069] Figure 18 is a schematic diagram of another process of gradually applying filters to the wallpaper image shown in Figure 14, provided by an embodiment of this application.

[0070] Figure 19 is a schematic diagram of an interface for modifying text information in a wallpaper based on the user's emotional state, according to an embodiment of this application.

[0071] Figure 20 is a schematic diagram showing the process of changes in the font of text information in a wallpaper image according to an embodiment of this application.

[0072] Figure 21 is a schematic diagram of an interface that modifies the time information in the second interface according to the user's emotional state, according to an embodiment of this application.

[0073] Figure 22 is a schematic diagram of a second interface provided in an embodiment of this application, in which time information changes with the user's emotional state.

[0074] Figure 23 is a schematic diagram of an interface in which the unlock icon changes with the user's emotional state in a second interface provided in an embodiment of this application.

[0075] Figure 24 is a schematic diagram of a second interface provided in an embodiment of this application, in which the signature changes with the user's emotional state.

[0076] Figure 25 is a schematic diagram of an interface that displays emotion regulation information on a second interface based on the user's emotional state, according to an embodiment of this application.

[0077] Figure 26 is a schematic diagram of another interface provided in this application embodiment, which displays emotion regulation information in a second interface based on the user's emotional state.

[0078] Figure 27 is a schematic diagram of an interface that displays corresponding prompt information on a second interface based on the user's emotional state, according to an embodiment of this application.

[0079] Figure 28 is a schematic diagram of an interface provided in this application embodiment, which displays both emotion regulation information and prompt information on a second interface based on the user's emotional state.

[0080] Figure 29 is a schematic diagram of an interface for playing media resources based on the user's emotional state, provided in an embodiment of this application.

[0081] Figure 30 is a schematic diagram of another interface for playing media resources based on the user's emotional state, provided in an embodiment of this application.

[0082] Figure 31 is a schematic diagram of another interface for playing media resources based on the user's emotional state, provided in an embodiment of this application.

[0083] Figure 32 is a schematic diagram of another interface for playing media resources based on the user's emotional state, provided in an embodiment of this application.

[0084] Figure 33 is a schematic diagram of an interface provided in this application embodiment, showing that the display color scheme of a desktop application icon changes with the user's emotional state.

[0085] Figure 34 is a schematic diagram of an interface provided in an embodiment of this application, showing how the font size of a desktop application name changes with the user's emotional state.

[0086] Figure 35 is a schematic diagram of an interface with a white display color scheme for a settings application page provided in an embodiment of this application.

[0087] Figure 36 is a schematic diagram of an interface provided in an embodiment of this application, showing that the display color scheme of the settings application page changes with the user's emotional state.

[0088] Figure 37 is a schematic diagram of the structure of an interface display device provided in an embodiment of this application. Detailed Implementation

[0089] The technical solutions of the embodiments of this application are described below with reference to the accompanying drawings and related embodiments. In the description of the embodiments of this application, the terminology used in the following embodiments is for the purpose of describing specific embodiments only and is not intended to limit the application. As used in the specification and appended claims of this application, the singular expressions "a," "the," "the," "the," and "this" are intended to also include expressions such as "one or more," unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, "at least one" and "one or more" refer to one or more (including two). The term "and / or" is used to describe the relationship between related objects, indicating that three relationships can exist; for example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship.

[0090] References to "one embodiment" or "some embodiments" in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized. The term "connection" includes direct connections and indirect connections, unless otherwise stated. "First" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated.

[0091] In the embodiments of this application, the words "exemplarily" or "for example" are used to indicate examples, illustrations, or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design solutions. Specifically, the use of the words "exemplarily" or "for example" is intended to present the relevant concepts in a specific manner.

[0092] With the ever-accelerating pace of modern life and increasing competitive pressure, people are prone to developing various complex emotions such as anxiety and irritability. Emotional problems don't develop overnight but rather accumulate and evolve over a long period. If we can promptly and keenly perceive changes in our emotional state and take effective measures to regulate and intervene as soon as emotional problems arise, preventing them from worsening, we can better maintain our physical and mental health and face life's challenges with a positive attitude. Therefore, how to efficiently and accurately help users obtain their own emotional state perception results has become an urgent problem to be solved.

[0093] In existing technologies, electronic devices (such as mobile phones) are equipped with sensors and processors that can automatically detect and record users' emotional data. After installing a relevant application (APP), users can view their emotional changes over a specified period (such as a year, six months, a month, a week, or a day) through the APP, thereby gaining insight into their mental health and daily stress levels. Alternatively, users can manually record their emotional states over a preset time period within the APP. The electronic device then performs statistical analysis based on these records, displaying the emotional fluctuations to the user through charts and other methods. However, both of these methods rely on periodic (or phased) or preset time period data display, meaning that the emotional state results obtained by the user are delayed and cannot provide immediate feedback. Furthermore, based on the above methods, if the user installs the corresponding APP or installs the APP but does not access the designated application page within the APP, the user still cannot obtain information about their emotional changes, thus reducing the user experience.

[0094] Therefore, addressing the current issue of users not being able to instantly receive feedback on their emotional state, this application provides an interface display method. After the electronic device is unlocked, it can obtain the user's emotional state information based on the acquired facial image and instantly modify the display state of the second interface after unlocking. This allows users to intuitively and clearly perceive their own emotional state through changes in the second interface display, achieving instant feedback on their emotional state. This method effectively avoids the limitation of users needing to rely on a specific app or a corresponding application page within an app to know their emotions, promoting users' immediate awareness of their own emotions.

[0095] The interface display method provided in this application can be applied to electronic devices. For example, electronic devices may include, but are not limited to, personal computers (PCs), mobile phones, tablets, wearable devices (such as watches, bracelets, helmets, smart glasses, etc.), augmented reality (AR) / virtual reality (VR) devices, mixed reality (MR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), in-vehicle devices, smart screens, smart home devices (such as smart TVs, smart speakers, smart cameras, and electronic door locks, etc.), servers, and motion-sensing game consoles in human-computer interaction scenarios, etc. This application does not impose any limitations on the specific type of electronic device.

[0096] Referring to Figure 1, this is a schematic diagram of the hardware structure of an electronic device 100 provided in an embodiment of this application. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 131, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0097] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0098] For example, when the electronic device 100 is a mobile phone or a tablet computer, it may include all the components shown in the figure, or it may include only some of the components shown in the figure.

[0099] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0100] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0101] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0102] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0103] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0104] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 131, external memory interface 120, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance).

[0105] In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may also be located in the same device.

[0106] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0107] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0108] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1.

[0109] In some embodiments, at least some functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be disposed in the same device.

[0110] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0111] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0112] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. Wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. GNSS can include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0113] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0114] The display screen 194 is used to display images, videos, etc., such as various display interfaces in the embodiments of this application. The display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0115] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0116] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0117] Camera 193 is used to capture still images or videos. An object passes through the lens, generating an optical image that is projected onto a photosensitive element. The focal length of the lens indicates the camera's field of view; a smaller focal length indicates a larger field of view. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts light signals into electrical signals, which are then transmitted to the ISP (Image Signal Processor) for conversion into digital image signals. The ISP outputs the digital image signals to the DSP (Digital Signal Processor) for processing. The DSP converts the digital image signals into standard RGB, YUV, or other image signal formats.

[0118] In this embodiment, camera 193 may include a front-facing camera. The front-facing camera can be used to acquire images of the user's face. The front-facing camera can acquire high-resolution images (e.g., images with rich detail and clear image quality).

[0119] Optionally, the front-facing camera can be a 3D depth-sensing camera to capture depth information of the user's face, such as the three-dimensional shape of the user's face and key facial features. In other examples, the front-facing camera can also be any one of a depth camera, an RGB camera, a near-infrared camera, a hyperspectral camera, or a thermal imaging camera. This application does not limit this.

[0120] Optionally, the front-facing camera may also have low-light performance and / or automatic dimming capabilities.

[0121] In some embodiments, the front-facing camera can also be combined with other technologies to further acquire higher quality images. For example, the front-facing camera can be combined with image stabilization technologies (such as optical image stabilization and / or electronic image stabilization) to acquire image-stabilized images.

[0122] In some embodiments, the front-facing camera may also be used in conjunction with technologies such as micro-expression monitoring and emotion recognition to detect the user's current emotional state or changes in the user's emotional state over a preset period of time.

[0123] Of course, in other embodiments, the camera 193 may also include a rear camera.

[0124] In this application, the electronic device 100 may include two or more cameras 193 with different focal lengths. This application does not limit the number of cameras 193 in the electronic device 100.

[0125] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0126] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG1, MPEG3, MPEG4, etc.

[0127] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0128] In this embodiment of the application, the NPU or other processor can be used to perform operations such as analysis and processing of the face images acquired by the electronic device 100.

[0129] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0130] Internal memory 131 can be used to store executable program code, including instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 131. Internal memory 131 may include a program storage area and a data storage area. The program storage area may store the operating system and at least one application required for a function (such as sound playback, image playback, etc.). The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.).

[0131] In addition, the internal memory 131 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0132] Electronic device 100 can implement audio functions through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0133] The audio module 170 is used to convert digital audio signals into analog audio signals for output, and also to convert analog audio inputs into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0134] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or hands-free calls through the speaker 170A. For example, the speaker can play the comparison analysis results provided in the embodiments of this application.

[0135] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0136] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0137] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0138] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0139] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can be corresponding to touch operations applied to different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations applied to different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0140] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0141] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0142] Referring to Figure 2, which is a schematic diagram of the software structure of an electronic device according to an embodiment of this application, the operating system in the electronic device may be... or Operating systems such as OS. Here, we will take HarmonyOS, the operating system for electronic devices, as an example for explanation.

[0143] In some embodiments, the HarmonyOS system can be divided into four layers, including the kernel layer, system service layer, framework layer, and application layer, with the layers communicating with each other through software interfaces.

[0144] As shown in Figure 2, the kernel layer includes the kernel abstract layer (KAL) and the driver subsystem. The KAL contains multiple kernels, such as the Linux kernel for the Linux system and the LiteOS kernel for lightweight IoT systems. The driver subsystem can include a hardware driver foundation (HDF). The hardware driver foundation provides unified peripheral access capabilities and a framework for driver development and management. A multi-kernel kernel layer can select the appropriate kernel for processing based on the system's needs.

[0145] The system service layer is the core capability set of the HarmonyOS system. It provides services to apps through the framework layer. This layer may include a set of basic system capability subsystems, a set of basic software service subsystems, a set of enhanced software service subsystems, and a set of hardware service subsystems.

[0146] The system's basic capability subsystems provide foundational capabilities for the operation, scheduling, and migration of distributed applications on HarmonyOS devices. These may include subsystems such as distributed soft bus, distributed data management, distributed task scheduling, Ark multi-language runtime, common basic libraries, multi-modal input, graphics, security, artificial intelligence (AI), and user program frameworks. Among these, the Ark multi-language runtime provides runtime environments for C, C++, or JavaScript (JS) languages ​​and basic system class libraries. It can also provide a runtime environment for Java programs statically generated using the Ark compiler (i.e., the parts of the application or framework layer developed using the Java language).

[0147] The basic software service subsystem provides common and general software services for the HarmonyOS system. These may include subsystems such as event notification, telephony, multimedia, design for X (DFX), and MSDP & DV.

[0148] The enhanced software service subsystem provides HarmonyOS with differentiated enhanced software services for different devices. It may include dedicated business subsystems for smart screens, wearables, and Internet of Things (IoT).

[0149] The hardware service subsystem provides hardware services for the HarmonyOS system. This may include subsystems such as location services, biometric recognition, wearable hardware services, and IoT hardware services.

[0150] The framework layer provides user program frameworks and capability frameworks in multiple languages ​​such as Java, C, C++, and JS for HarmonyOS application development. It also includes two user interface (UI) frameworks (a Java UI framework for Java and a JS UI framework for JS) and various multi-language application programming interfaces (APIs) for exposing software and hardware services. The APIs supported by HarmonyOS devices will vary depending on the degree of system componentization.

[0151] The application layer includes system applications and third-party applications (or extended applications). System applications can include apps that are installed by default on electronic devices, such as those for the desktop, control bar, settings, and phone. Extended applications can be non-essential applications developed and designed by the electronic device manufacturer, such as apps for managing electronic devices, migrating between devices, note-taking, and weather. Third-party non-system applications can be apps developed by other manufacturers that can run on the HarmonyOS system, such as games, navigation, social networking, or shopping apps.

[0152] It provides the ability to run background tasks and a unified data access abstraction. The process area (PA) primarily supports functional applications (FAs), such as providing computing power as a background service or providing data access capabilities as a data warehouse. Applications developed based on FAs or PAs can implement specific business functions, support cross-device scheduling and distribution, and provide users with a consistent and efficient application experience.

[0153] Multiple electronic devices running the HarmonyOS system can achieve hardware cooperation and resource sharing through distributed soft bus, distributed device virtualization, distributed data management, and distributed task scheduling.

[0154] It should be noted that the software structure of the electronic device shown in Figure 2 is only an exemplary description and does not limit the specific structure of the electronic device.

[0155] The following description uses a mobile phone terminal as an example to illustrate the interface display method provided in the embodiments of this application.

[0156] Referring to Figure 3, which is a flowchart illustrating an interface display method 300 provided in an embodiment of this application, the interface display method 300 can be executed by a mobile terminal. Specifically, it can be executed by a module (e.g., processor, chip, or chip system) in the mobile terminal; it can also be implemented by a logic module or software capable of performing all or part of the functions. As shown in Figure 3, the interface display method 300 may include the following steps:

[0157] S301, Display the first interface, which is the interface displayed when the electronic device is locked.

[0158] It should be understood that the first screen can also be called the lock screen, which refers to the interface displayed on an electronic device (i.e., a mobile terminal) when it is not unlocked or locked.

[0159] For example, Figure 4 shows a schematic diagram of a first interface provided in an embodiment of this application. Referring to Figure 4, the first interface 400 may display the lock screen status icon 410 of the mobile terminal, time 420, date 430, etc.

[0160] In some embodiments, the first interface 400 may also display wallpaper 440 and shortcut operation icons 450 such as flashlight and camera.

[0161] In other embodiments, the first interface 400 may also include a status bar 460 located at the top of the mobile terminal, which may display system status information such as time, battery level, signal strength, and network connection.

[0162] In other embodiments, the first interface 400 may also display other content, such as motion data, lock screen signature, music information being played (e.g., music player cover art, title, and control buttons), and notifications such as SMS and email.

[0163] Of course, the first interface 400 can also display less content, such as not displaying the lock screen status icon 410 of the mobile terminal, etc.

[0164] In the example described in Figure 4 above, the wallpaper 440 displayed on the first interface 400 can be an image or theme pre-configured by the user through any of the settings app, theme app, or gallery app. For clarity, the dotted pattern in Figure 4 indicates the specific content displayed by the wallpaper 440 on the first interface 400.

[0165] S302, in response to the unlocking operation, obtains the user's emotional state information based on the user's facial image.

[0166] In this embodiment of the application, the unlocking operation can be used to unlock the electronic device so that the electronic device changes from a locked state to an unlocked state.

[0167] It should be understood that the unlocking operation may include a single action. For example, the unlocking operation may be an action in which the user holds the electronic device and keeps the front-facing camera of the electronic device within a preset distance range from the user's face, so that the front-facing camera of the electronic device can capture the user's facial image and unlock the electronic device after facial recognition.

[0168] In some embodiments, the unlocking operation may also include multiple operations (i.e., a series of operations). For example, the unlocking operation may include two operations. Specifically, one operation may include the user waking up the electronic device to put the screen on, such as pressing the power button; the other operation may include the user holding the electronic device and keeping the front-facing camera of the electronic device within a preset distance range from the user's face, so that the front-facing camera of the electronic device can capture the user's facial image and unlock the electronic device after facial recognition.

[0169] In some embodiments, a user can pre-configure a facial image (hereinafter referred to as the target facial image) for unlocking the electronic device, so that the electronic device can match the captured facial image with the target facial image and unlock the electronic device if the match is successful. Furthermore, if the facial image captured by the front-facing camera of the mobile terminal matches the target facial image, the electronic device can transition from an unlocked state to an unlocked state.

[0170] In one example, when unlocking an electronic device, the captured facial image may include one or more facial images.

[0171] In this embodiment, the captured facial image can be used to unlock an electronic device, or it can be used to obtain the user's emotional state information. It is easy to understand that emotional state information can be used to indicate the user's current emotional state.

[0172] It should be understood that emotional state information can include at least one emotion type. Emotion types, also known as emotion tags, can be broadly categorized into positive and negative emotions. Positive emotions can be characterized by feelings of joy, energy, and interest, such as happiness, delight, excitement, satisfaction, and confidence. Negative emotions can be characterized by feelings of depression, restlessness, or fear, such as sadness, anger, anxiety, dread, and frustration. In some examples, emotion types can also be represented using corresponding emojis.

[0173] In some embodiments, emotional state information may also include emotional type and emotional intensity. It should be understood that emotional intensity can be used to represent the strength of an emotional type. Emotional intensity can be categorized into mild, moderate, and severe emotions. For example, the emotional type "happy" can be categorized into at least three different emotional intensities: somewhat happy, happy, and very happy.

[0174] In some embodiments, emotional state information may further include emotion type, emotion intensity, and emotion characteristics. It should be understood that emotion characteristics may refer to facial expressions corresponding to different emotion types; for example, facial expressions may include frowning, widening eyes, raised eyebrows, and downturned corners of the mouth.

[0175] In one possible embodiment, the electronic device may, in response to an unlocking operation, perform face detection, feature extraction, and emotion classification on the acquired face image to obtain the user's emotional state information.

[0176] In the above example, face detection can employ at least one of the following algorithms: the Viola-Jones object detection framework algorithm, multi-task cascaded convolutional neural networks (MT-CNN) based on deep learning, etc.

[0177] Feature extraction can employ one or more of the following: convolutional neural networks (CNN), principal component analysis (PCA), and local binary patterns (LBP).

[0178] Emotion classification can employ machine learning-based algorithms (such as support vector machines, Naive Bayes, decision trees, etc.), deep learning-based algorithms (such as CNNs, recurrent neural networks, and attention mechanisms, etc.), and hidden Markov models, etc.

[0179] In some embodiments, liveness detection technology can be combined with face detection to effectively distinguish between real faces and faces in photos (or videos), avoid interference from faces in photos (or videos) on the face recognition process, and improve the security and reliability of face recognition.

[0180] For example, liveness detection technology may include at least one of silent liveness detection, interactive liveness detection, life-characteristic-based methods, or color and texture feature detection algorithms.

[0181] In order to obtain more accurate emotional state information based on facial images, in the above possible examples, the acquired facial images can be preprocessed before face detection is performed, and then the preprocessed facial images can be used for face detection.

[0182] For example, methods for preprocessing the acquired face image may include, but are not limited to, one or more of the following: grayscale processing, noise reduction processing, and normalization processing.

[0183] Of course, in addition to the possible examples mentioned above, the specific processing steps for obtaining user emotional state information using user facial images can also be found in the prior art, and will not be repeated here in the embodiments of this application.

[0184] In some embodiments, physiological state data of the user detected by the wearable device can also be used to obtain information about the user's emotional state.

[0185] It's easy to understand that wearable devices can have communication connections with electronic devices.

[0186] In one example, the user's physiological state data acquired by the wearable device can be transmitted to an electronic device via a communication connection.

[0187] In another example, the wearable device can obtain the user's emotional state information based on the acquired physiological state data, and then transmit the user's emotional state information to the electronic device through the aforementioned communication connection.

[0188] In some embodiments, the physiological state data of a user acquired through a wearable device may include, but is not limited to, one or more of the following: heart rate, electrical activity (EDA) value, body temperature, blood pressure, and blood flow velocity. It is easy to understand that sensors such as EDA sensors, heart rate sensors, and blood pressure sensors can be incorporated into the wearable device to acquire the aforementioned physiological state data of the user.

[0189] In some embodiments, facial images can also be combined with the user's physiological state data to obtain the user's emotional state information. It should be understood that the specific methods for obtaining facial images and the user's physiological state data, as well as the specific content included in the user's physiological state data, can be found in the descriptions of the foregoing related embodiments, and will not be repeated here.

[0190] In some embodiments, user emotional state information can also be obtained by combining user behavior data when unlocking electronic devices.

[0191] In one example, user behavior data when unlocking an electronic device could include the degree of hand tremor when using the slide-to-unlock function. For instance, if a user's hand trembles frequently when using the slide-to-unlock function, it can be determined that the user's current emotional state is tense; if the user's hand hardly trembles when using the slide-to-unlock function, it can be determined that the user's current emotional state is not tense.

[0192] In another example, user behavior data when unlocking an electronic device could also include the pressure applied when using the fingerprint unlock function. For instance, if the electronic device detects a light pressure when using the fingerprint unlock function, it can be determined that the user's current emotional state is happy; if the electronic device detects a heavy pressure when using the fingerprint unlock function, it can be determined that the user's current emotional state is angry or unhappy.

[0193] In other embodiments, the user's emotional state information can also be obtained by combining one or more of the following: the user's historical operation records in the electronic device, the user's execution progress information for a certain task (or matter), the user's location information, the user's personal information, time information, holiday information, weather information, etc.

[0194] In the above embodiments, the historical operation record information can be related information generated based on the user's historical operations on electronic devices. The historical operation record information is different for different users, and the historical operation record information of the same user on different electronic devices can be the same or different. For example, content published on social media platforms, online comments, and feedback information, etc.

[0195] The progress information of a task can include whether it has not yet started, is in progress, or has been completed. A task can be one or more items, such as fitness, exercise, learning, listening to music, or watching videos.

[0196] A user's location information can refer to their geographical location, such as home, company, school, park, hospital, etc.

[0197] A user's personal information can be a self-portrait of the user, which can be used to identify the corresponding user. For example, personal information may include at least one of the following: gender, age, occupation, hobbies, habits, social activities, personality, etc.

[0198] Time information can be used to represent different points in time during the day, such as morning, forenoon, noon, afternoon, and evening.

[0199] Festival information can be used to represent different festivals, such as Spring Festival, Mid-Autumn Festival, New Year's Day, etc.

[0200] Weather information can be used to indicate specific weather conditions, such as cloudy, sunny, rainy, snowy, and windy.

[0201] In other possible embodiments, other information (such as voice tone information) can also be used to obtain the user's emotional state information. This application does not limit this in any way.

[0202] S303, modify the display state of the second interface according to the emotional state information. The second interface is the interface displayed when the electronic device is unlocked.

[0203] It should be understood that the second interface can refer to any interface displayed after the electronic device changes from an unlocked state to an unlocked state. In other words, the second interface can refer to the interface displayed after the electronic device completes identity verification (such as facial recognition).

[0204] The display state of the second interface can include static display state and dynamic display state.

[0205] The static display state mainly includes the layout of the second interface. This layout can include the color scheme of the interface elements, their display styles, their positions within the second interface, and their arrangement.

[0206] It should be understood that interface elements may include text, images, audio, video, etc. Text may refer to information such as time, calendar, weather, user-defined signature, activity data, application names of various apps installed on the electronic device, displayed battery level, signal strength, etc. Images may include wallpapers, icons, etc. Icons may include icons corresponding to the electronic device's battery level, network status, etc., information notification icons, shortcut icons for convenient and quick operation, and application icons corresponding to various apps, etc. Audio may refer to any audio being played on the electronic device. Video may refer to any video being played on the electronic device. In some embodiments, the specific content of interface elements may differ depending on the specific type of the second interface; this application embodiment does not limit the specific content of interface elements.

[0207] The color scheme of interface elements refers to the color combination corresponding to each interface element in the second interface. In some embodiments, each interface element may use the same, completely different, or partially the same and partially different color combinations.

[0208] The display style of interface elements can refer to the specific form in which they are displayed in the second interface, such as the font, size, and color of text. Display position can refer to the specific coordinates of each interface element within the second interface. Arrangement method can refer to the display style of each interface element in the second interface; for example, whether application icons are arranged in a list or a grid.

[0209] The dynamic display state of the second interface can include the loading state of interface elements, the interactive feedback state, and dynamic visual effects. The loading state indicates the progress of interface elements in the second interface; for example, an application icon may gradually become clearer or thicker than blurry as it loads. The interactive feedback state can refer to changes in the second interface based on the user's emotional state; for example, all application icons in the second interface may display a magnified effect for a preset duration based on the user's emotional state. Dynamic visual effects can include the gradual changes in the display color scheme and style of interface elements; for example, dynamic effects such as color transitions and shape gradients.

[0210] In some embodiments, the display state of the second interface before modification may be pre-configured by the user using a settings app, theme app, or gallery app; it may also be the system default setting; or it may be the setting that the electronic device modified last time based on the determined emotional state of the user.

[0211] In one example, the second interface could be the unlock interface.

[0212] In this embodiment of the application, the unlock interface can be an interface associated with the first interface, through which the main interactive interface of the electronic device can be accessed.

[0213] Assuming the interface shown in Figure 4 is still the first interface, the electronic device can respond to the unlocking operation and display the unlocking interface, which can be seen in the user interface 500 shown in Figure 5. Referring to Figure 5, the user interface 500 can also display the unlocking status icon 510 of the mobile terminal, the time 520, the date 530, etc.

[0214] In some embodiments, the user interface 500 may also display wallpaper 540 and quick operation icons 550, etc. In other embodiments, the user interface 500 may also include a status bar 560 located at the top of the mobile terminal, which may display system status information such as time, battery level, signal strength, and network connection. Of course, in other embodiments, the unlock interface 500 may also display more or less content, as detailed in Figure 4 above, which will not be repeated here.

[0215] By comparing the first interface 400 shown in Figure 4 and the user interface 500 shown in Figure 5, it can be seen that the icons corresponding to the states of the electronic device are different. That is, the lock screen icon 410 shown in Figure 4 and the lock status icon 510 shown in Figure 5 are different. The lock screen icon 410 can be used to indicate that the electronic device is in an unlocked state or a locked state; the lock status icon 510 can indicate that the electronic device is in an unlocked state. In some embodiments, after determining the emotional state information based on the user's facial image, the wallpaper 440 shown in Figure 4 may change to the wallpaper 540 shown in Figure 5 according to the user's emotional state information. Apart from the above, the user interface 500 and other interface elements in the first interface 400 can be completely identical. It can be understood that when the second interface is an unlock interface, the unlock interface can be an interface associated with the first interface.

[0216] In some embodiments, after the electronic device changes from an unlocked state to an unlocked state, the interface elements in the aforementioned example user interface 500 may be completely different from the interface elements in the first interface 400. Based on this, the obvious interface changes before and after the electronic device is unlocked intuitively and clearly indicate to the user that the unlocked state of the electronic device has changed.

[0217] In some embodiments, the interface elements in the unlock screen can be exactly the same as those in the first screen. That is, after the electronic device changes from an unlocked state to an unlocked state, the display interface of the electronic device does not change. However, the electronic device can respond to the user's triggering operation on the unlock screen and display the main interactive interface of the electronic device. In other words, in this case, the unlock screen is an interface between the first screen and the desktop.

[0218] For example, assuming the first interface is user interface 610 in Figure 6, the unlock interface displayed by the electronic device after responding to the unlock operation is user interface 620 in Figure 6. In user interface 620 shown in Figure 6, the electronic device can display the desktop of the electronic device in response to the user's trigger operation on user interface 620 (e.g., a swipe operation). The desktop can be seen in user interface 630 shown in Figure 6. For example, multiple pre-installed apps can be displayed on user interface 630, including clock app, calendar app, gallery app, memo app, file management app, email app, music app, calculator app, video playback app, sports and health app, weather app, browser app, smart living app, settings app, voice recorder app, app store app, camera app, contacts app, phone app, and messaging app, etc. Of course, other apps, such as phone management apps, can also be pre-installed in user interface 630 shown in Figure 6, and this application does not limit this.

[0219] In another example, the second interface could also be the desktop.

[0220] It should be understood that the desktop can be the user interface 630 shown in Figure 6, the negative one screen interface 700 shown in Figure 7, or the interactive main interface 800 shown in Figure 8. In some embodiments, the desktop can be at least one of multiple desktops.

[0221] In yet another example, the second interface could also be the application interface.

[0222] It's easy to understand that an application interface can refer to any page displayed after launching any of the multiple apps pre-installed on an electronic device.

[0223] In this embodiment, after the electronic device obtains the user's emotional state information based on the user's facial image, it can modify the display state of the second interface according to the emotional state information. By modifying the display state of the second interface, the user can intuitively and timely understand their own emotional state.

[0224] In some embodiments, the display state of the second interface modified according to the user's emotional state information can be a display state corresponding to the user's emotional state.

[0225] For example, if the user's emotional state is "happy", then the modified display state of the second interface can reflect the user's "happy" emotional state.

[0226] In some embodiments, the display state of the second interface modified according to the user's emotional state information can also be the opposite of the user's emotional state. In this way, the modified display state of the second interface can be used to adjust the user's current emotional state in order to maintain the stability of the user's emotional state.

[0227] For example, if a user's emotional state is sadness, the modified second interface can display a state that can adjust the user's sad emotional state to a happy or calm state, in order to eliminate or alleviate the user's negative emotions.

[0228] In one possible embodiment, if the electronic device obtains the user's emotional state based on the user's facial image and it is the same as the user's emotional state determined in the previous instance, then the display state of the second interface may remain unchanged.

[0229] The following example, using the scenario where the second interface is the unlock screen and its modified display state corresponds to the user's emotional state, will illustrate the specific display state of the second interface in conjunction with a specific user interface. It should be noted that the scenario where the modified second interface's display state is the opposite of the user's emotional state can be reasonably extended based on the specific circumstances of the following embodiments; this scenario will not be described in detail below.

[0230] In some embodiments, the electronic device can determine the display color scheme of the wallpaper based on the user's emotional state information, and then modify the display color scheme of the wallpaper in the unlock screen according to the determined display color scheme.

[0231] It should be understood that the original display color scheme of the wallpaper before modification in the unlock interface can be referred to as the original display color scheme.

[0232] In one example, the original display color scheme can be a display color scheme pre-configured by the user using the Settings app, Themes app, or Gallery app.

[0233] In another example, the original display color scheme could also be the wallpaper color scheme determined based on the user's previous emotional state information. The following embodiments will use the unlock interface 500 shown in Figure 5 as an example for illustrative purposes.

[0234] In the above possible embodiments, the display color scheme of the wallpaper can refer to the colors of the wallpaper image. The display color scheme of the wallpaper may include only one color, that is, the wallpaper image is displayed in a solid color. The display color scheme of the wallpaper may also be formed by a combination of multiple colors, that is, the wallpaper image is displayed in gradient colors or mixed colors.

[0235] In some embodiments, the color scheme of the wallpaper display can use warm and cool color schemes to distinguish the user's emotional state. It should be understood that the specific details of warm and cool color schemes can be found in existing technologies and will not be elaborated here.

[0236] For example, assuming white belongs to the cool color family and red belongs to the warm color family, the wallpaper color scheme can be closer to white when the user's emotional state is closer to unhappiness; conversely, the wallpaper color scheme can be closer to red when the user's emotional state is closer to happiness.

[0237] In some embodiments, the color scheme of the wallpaper can also indicate the user's emotional state through light and dark colors. It should be understood that the specific details of light and dark colors can be found in the prior art, and will not be elaborated here.

[0238] As an example, and not a limitation, assuming that white is a light color and black is a dark color, then the closer the user's emotional state is to unhappiness, the closer the wallpaper's color scheme can be to black; conversely, the closer the user's emotional state is to happiness, the closer the wallpaper's color scheme can be to white.

[0239] In some embodiments, the wallpaper's color scheme can also be based on the principle of Plutchik's wheel of emotions, using different colors to express different emotional states of the user. For example, the Plutchik's wheel of emotions principle can include eight basic emotions: joy, admiration, fear, surprise, grief, disgust, anger, and alertness. The colors corresponding to each emotion can be found in relevant descriptions in the prior art, and will not be repeated here.

[0240] Other possible examples include customizing colors or color combinations to correspond to different emotions based on the user's interests. For instance, when the user is happy, the wallpaper's color scheme could be a combination of yellow and orange, creating an orange-yellow hue; when the user is sad, the wallpaper's color scheme could be a combination of purple and blue, creating a bluish-purple hue, and so on.

[0241] For example, suppose the wallpaper color corresponding to a user's customized emotional state is blue. If the electronic device determines that the user's current emotional state is sad based on the user's facial image, then the electronic device can change the display color of the wallpaper in the unlock interface to blue based on the user's sad emotional state. The unlock interface can be seen in the user interface 900 shown in Figure 9. The display color of wallpaper 910 in user interface 900 can be represented by a diagonal fill in Figure 9, indicating that the display color of wallpaper 910 is blue.

[0242] Based on the above embodiments, the electronic device directly modifies the display color scheme of the wallpaper in the unlock interface based on the user's emotional state, so that the display color scheme of the wallpaper in the unlock interface that the user sees after unlocking the electronic device is the modified display color scheme.

[0243] In some embodiments, the electronic device can also dynamically modify the display color scheme of the wallpaper in the unlock interface based on the user's emotional state. That is, the display color scheme of the wallpaper in the unlock interface, seen after unlocking the electronic device, gradually changes from its original color scheme to a color scheme corresponding to the user's emotional state information; thus, for the user, the display color scheme of the wallpaper in the unlock interface has a dynamic changing effect. Continuing with the previous example, if the electronic device determines that the user's emotional state is sadness based on their facial image, then the display color scheme of the wallpaper in the unlock interface can be as shown in the user interface 1000 in Figure 10. In this user interface 1000, the wallpaper's display color scheme first changes from a small portion of blue to a partial blue, and then from most of blue to completely blue.

[0244] In addition to a dynamic color scheme transition from one color to another, the wallpaper color scheme in the unlock screen can also exhibit a dynamic color change from light to dark in other possible examples. This application does not limit the specific display effect of the wallpaper color scheme.

[0245] In some embodiments, the electronic device may also determine the display color scheme of the background area in the wallpaper based on the user's emotional state information, and then modify the display state of the unlock interface based on the determined display attributes of the background area in the wallpaper.

[0246] It should be understood that the background area of ​​the wallpaper, also known as the background region, refers to the area within the wallpaper image that carries the user interface elements; in other words, it is the area within the wallpaper image excluding the designated area. For example, assuming the wallpaper in the unlock screen displays an image of a cat, then the background area in that wallpaper image can refer to the area other than the image occupied by the cat. Specific details regarding the color scheme can be found in the corresponding descriptions in the foregoing related embodiments, and will not be repeated here.

[0247] For example, let's say the wallpaper on the unlock screen displays an image of a cat, and the background area of ​​that wallpaper is red. If the user's emotional state is happy, the background color of the wallpaper is changed to white; if the user's emotional state is sad, the background color is changed to black. If the electronic device determines the user's emotional state is happy based on their facial image, then the background color of the wallpaper on the unlock screen can be changed from red to white. If the electronic device determines the user's emotional state is sad based on their facial image, then the background color of the wallpaper on the unlock screen can be changed from red to black.

[0248] In other words, the background color scheme of the wallpaper can be modified to a predefined color scheme corresponding to the user's emotional state. The process of modifying the background color scheme and its display method can be found in the aforementioned introduction, and will not be repeated here.

[0249] In some embodiments, the electronic device may also determine a first image based on the user's emotional state information. The first image may include emoticons corresponding to the user's emotional state, and then the electronic device may modify the wallpaper of the unlock screen based on the first image including emoticons.

[0250] It should be understood that an emoji corresponding to a user's emotional state may include one or more.

[0251] For example, suppose an electronic device determines that the user's emotional state is happy based on the user's facial image. Then, based on the user's "happy" emotional state, the emojis representing happiness could include "grinning", "smiling through tears", "smiling", "smirking", "laughing", etc.

[0252] In one example, referring to Figure 11, a first image 1100 can be obtained based on an emoji, such as a "grinning" emoji 1110, and the wallpaper of the unlock screen can be modified using the first image 1100.

[0253] In another example, referring to Figure 12, a first image 1200 can also be obtained based on multiple emojis 1210, and the wallpaper image of the unlock screen can be modified to the first image 1200 composed of multiple emojis 1210.

[0254] In some embodiments, the emoticons in the first image can be determined based on the intensity of the user's emotions, and then the first image can be obtained based on the determined emoticons, and the wallpaper image of the unlock interface can be modified using the first image.

[0255] In one example, determining the emoji in the first image based on the intensity of the user's emotion can include a single emoji. For instance, assuming the user's determined "happy" emotional state is "very happy," then a "laughing" emoji can be determined based on the user's very happy emotion. The first image can be obtained based on the "laughing" emoji, and then the wallpaper of the unlock screen can be modified using the first image including the "laughing" emoji.

[0256] In another example, determining the emojis in the first image based on the intensity of the user's emotion can also include multiple emojis. For instance, assuming the intensity of the user's determined "happy" emotional state is "very happy," then "laughing" and "smiling through tears" emojis can be determined based on the user's very happy emotion. This allows the first image to be obtained based on the "laughing" and "smiling through tears" emojis, and the wallpaper of the unlock screen can be modified using this first image.

[0257] In some embodiments, modifying the wallpaper image of the unlock screen using the first image can be done by directly using the first image containing emojis as the wallpaper image of the unlock screen. Alternatively, it can involve modifying at least one object in the wallpaper of the unlock screen to an emoji included in the first image. It can also involve adding an emoji from the first image to the wallpaper of the unlock screen, or adding a new first image containing emojis. This application does not impose any limitations on these embodiments.

[0258] In some embodiments, the electronic device may also determine a first image based on the user's emotional state information. The first image may also include a plant object corresponding to the user's emotional state. Based on this, the electronic device may modify the wallpaper image of the unlock screen according to the first image including the plant object.

[0259] In one example, the plant object could be a flower. Specifically, different flower meanings can be determined based on the user's emotional state, and a first image is obtained based on the flowers with different meanings.

[0260] As an example, and not a limitation, referring to Figure 13, assuming that the electronic device determines the user's emotional state as confident based on the facial image, then the specific plant object can be determined as buttercup based on the user's "confident" emotional state. The flower language of buttercup can be represented as charming. Based on this, a first image 1300 including buttercup 1310 can be obtained, and the wallpaper of the unlock interface can be modified using the first image 1300 including buttercup 1310.

[0261] In one example, the name of the flower corresponding to the flower language can be determined based on the user's emotional state information, and then the corresponding flower image can be determined using the flower name. In other words, the flower image can be used as the first image to modify the wallpaper of the unlock screen.

[0262] In this example, the flower image corresponding to the flower name can be either pre-stored or found by searching the webpage based on the flower name.

[0263] In another example, the flower name corresponding to the flower language can be determined based on the user's emotional state information. Then, a flower image corresponding to the flower name can be generated based on the morphological characteristics of the flower. Finally, the flower image can be used to modify the wallpaper of the unlock screen.

[0264] It should be understood that flower images corresponding to flower names can be generated using methods such as deep learning algorithms or intelligent painting tools.

[0265] Based on the above possible examples, the obtained flower image can be further processed to obtain a processed flower image, which can then be used as the first image.

[0266] It should be understood that the processing operations performed on flower images can correspond to the intensity of the user's emotional state. For example, if the user's emotional state is very happy, the processing operation could be dilation. The processing operation can also be other methods, such as abstraction or sharpening.

[0267] It should be noted that, in the above possible embodiments, the specific operation of modifying the wallpaper image of the unlock interface using a flower image can be to directly use the flower image as the wallpaper in the unlock interface, as shown in the examples in Figures 11 and 12. Alternatively, at least one object in the wallpaper image of the unlock interface can be modified to a corresponding flower. Another possibility is to modify the background area or the logo area in the wallpaper to a flower image. The background area can be an area in the wallpaper where no objects (e.g., people, animals, plants, or tables and chairs) exist; the logo area is an area in the wallpaper where objects exist.

[0268] In some embodiments, the electronic device may also dynamically display the first image based on the user's emotional state.

[0269] It should be understood that in the embodiments of this application, the first image can be dynamically presented through a two-dimensional animation display. Of course, in some embodiments, the specific display method of the first image may also include a three-dimensional animation display.

[0270] For example, when a user's emotional state is happy, the wallpaper on the unlock screen can display a gradual animation effect from bud to full bloom. Specifically, referring to Figure 14, the user can see that in the unlock screen wallpaper, the flower is first in a budding state (1410), and as time goes by, the petals gradually extend outward (1420), finally reaching a fully bloomed state (1430). Similarly, when a user's emotional state is sad, the unlock screen wallpaper can display a gradual animation effect from blooming to withering or from blooming to drooping.

[0271] In one example of dynamically displaying the first image, the wallpaper on the unlock screen can continuously loop and display the dynamic effect of the first image, which can also be understood as a dynamic image.

[0272] In another example, the wallpaper on the unlock screen can also display any of the dynamic display effects after presenting the first image's dynamic display effect once or multiple times. Taking Figure 14 as an example, after presenting the gradual animation effect of the flower from bud to full bloom as shown in Figure 14 once, the wallpaper on the unlock screen can finally display the flower image corresponding to the fully bloomed state 1430.

[0273] Based on the above possible implementation methods, by using the metaphor of the plant life cycle in a visual presentation, users can intuitively perceive their own emotional state, thus achieving a clever integration of interface personalization and the visual expression of users' emotional state.

[0274] In addition to determining flowers corresponding to different flower meanings based on the user's emotional state, some embodiments can also determine flowers of different colors based on the user's emotional state. Flowers from different growing environments can also be determined based on the user's emotional state. Alternatively, flowers that include two or more characteristics from flower attribute information such as different flower meanings, different colors, and different growing environments can be determined based on the user's emotional state information.

[0275] It is easy to understand that the plant in the first image can also be at least one of trees, vegetables, grass, fruits, algae, ferns, etc. The correspondence between at least one plant in the first image and the user's emotional state can be found in the relevant explanations regarding the correspondence between flowers with different flower meanings and user emotional states, which will not be repeated here. This application embodiment does not limit the specific type of plant in the first image.

[0276] In some embodiments, the electronic device may also determine a first image based on the user's emotional state information. The first image may also include an animal object corresponding to the user's emotional state. Based on this, the electronic device may modify the wallpaper of the unlock screen according to the first image including the animal.

[0277] It should be understood that animal objects can include dogs, cats, chickens, sheep, cows, etc.

[0278] In some embodiments, an animal object can be determined based on the user's emotional state, including at least one characteristic such as different morphological structures, living habits, reproductive methods, diet, and whether its body temperature is constant. For example, assuming the user's emotional state is happy, a first image including a cat can be determined, and the wallpaper of the unlock screen can be modified using this first image. If the user's emotional state is angry, a first image including a yazi (a mythical beast) can be determined, and the wallpaper of the unlock screen can be modified using this first image, and so on. The specific process of determining a first image including a certain animal object based on the user's emotional state and the specific process of modifying the wallpaper of the unlock screen based on the first image including an animal object can be found in the aforementioned embodiments related to the first image including plant objects, and will not be repeated here.

[0279] In some embodiments, the electronic device may also determine a first image based on the user's emotional state information. The first image may include both plant objects and animal objects corresponding to the user's emotional state, as well as emoticons corresponding to the user's emotional state. Based on this, the electronic device may modify the display state of the unlock interface based on the aforementioned first image including emoticons, plant objects, and animal objects.

[0280] It should be understood that the first image may also include other target objects, such as vehicles, people, buildings, tables and chairs, etc. The embodiments of this application do not limit the specific objects included in the first image.

[0281] In some embodiments, the electronic device may also determine the display attributes of the filter based on the user's emotional state information, and modify the display state of the unlock interface using the determined display attributes of the filter.

[0282] It should be understood that filters can be used to change the visual effects of the content displayed on the unlock screen. Filter display attributes can include color, brightness, saturation, contrast, texture features, lighting effects, sharpening and blurring, artistic style, etc.

[0283] Color features can be used to change the display color scheme of filters.

[0284] Brightness can be used to adjust the overall brightness of the filter.

[0285] Saturation can be used to adjust the vibrancy of filter colors, making the filter's display colors more vibrant or more muted.

[0286] Contrast can be adjusted to enhance the depth of the filter's presentation by correcting its colors and to adjust the style of the filter's display.

[0287] Texture features can be used to change the texture properties of a filter's surface. For example, adding a frosted texture can make the filter appear rough and non-reflective.

[0288] Light and shadow effects can be used to simulate changes in light and shadow, adding light sources of different angles and intensities to achieve effects such as shadows, highlights, and halos in wallpapers or images.

[0289] Sharpening and blurring can create a blurred effect on wallpapers or images and enhance the contrast of edges in wallpapers or images.

[0290] Artistic styles can be used to simulate the characteristics of different painting genres such as sketching and oil painting, allowing filters to present different artistic effects.

[0291] Taking color as an example of the filter's display attribute, Figure 15 shows a schematic diagram of the wallpaper before the unlock interface is modified according to an embodiment of this application, and Figure 16 shows a schematic diagram of setting a filter on the wallpaper image shown in Figure 15 according to an embodiment of this application. Referring to Figure 15, the wallpaper image before the unlock interface is modified includes a wallpaper 1500 containing a cat 1510. Assuming that the user's emotional state is "joyful," the corresponding filter color can be set to yellow; if the user's emotional state is "bored," the corresponding filter color can be set to purple. Based on the above example, if the electronic device obtains that the user's emotional state is "joyful" based on the user's facial image, then a yellow filter can be applied to the wallpaper 1500 shown in Figure 15 to obtain the modified unlock interface wallpaper. The modified unlock interface wallpaper can be seen in the user interface 1600 shown in Figure 16. In Figure 16, vertical stripes are used to indicate that the display color of the wallpaper corresponding to the unlock interface is yellow.

[0292] In the above example, if the electronic device obtains the user's emotional state as "bored" based on the user's facial image, then a purple filter can be applied to the wallpaper shown in Figure 15 to obtain a modified unlock screen wallpaper. The modified unlock screen wallpaper can be seen in the user interface 1700 shown in Figure 17. In Figure 17, a dotted fill method is used to indicate that the display color of the unlock screen wallpaper is purple.

[0293] Based on the above embodiments, electronic devices can also dynamically display the display attributes corresponding to the filter in the unlock interface.

[0294] Using the example above, assuming the user's emotional state obtained from their facial image is joy, the filter color covering the wallpaper on the unlock screen can gradually change from yellow to white, that is, from the unlock screen shown in Figure 15 to the unlock screen shown in Figure 16. The specific change process can be seen in the user interface 1800 shown in Figure 18. It is easy to understand that in practical applications, the specific change process may also include more or fewer user interfaces 1800 than those shown in Figure 18, and this embodiment does not limit this.

[0295] It is not difficult to understand that the process of covering the filter color on the wallpaper corresponding to the unlock screen can continuously present the dynamic change effect of the user interface 1800 shown in Figure 18; or after displaying the dynamic change effect of the user interface 1800 shown in Figure 18 once or multiple times, the user interface 1600 shown in Figure 16 will finally be presented on the wallpaper of the unlock screen.

[0296] In some embodiments, the electronic device may also determine the interface layout of the interface elements in the marked area of ​​the wallpaper based on the user's emotional state information, and then modify the display state of the unlock interface based on the determined interface layout.

[0297] It should be understood that the identifying area of ​​a wallpaper, also known as the foreground area, refers to the area containing at least one object in the wallpaper. This object is used to attract the user's attention or arouse their interest. Examples of objects include text, people, animals, plants, trees, buildings, tables, and chairs.

[0298] The interface elements in a wallpaper can include text and / or image information displayed on the wallpaper. The text information displayed on the wallpaper can be content presented in text form within the wallpaper image. For example, the text information "What you think, you get" 1910 shown in Figure 19. The image information displayed on the wallpaper can refer to visual content displayed in graphic or image form within the wallpaper image. For example, the image of a cat displayed in the wallpaper shown in Figure 15.

[0299] It's easy to understand that the layout of interface elements can include display style, display position, and arrangement.

[0300] The display style of interface elements refers to the way interface elements are presented in the wallpaper. For example, the font, size, and color of text information in the wallpaper, or the display style of images in the wallpaper.

[0301] The display position of interface elements can refer to their specific coordinates within the wallpaper image. The arrangement of interface elements can refer to their display style within the wallpaper image; for example, text information as the foreground and an image as the background. Another example is multiple objects arranged in a list or grid format within the wallpaper image.

[0302] Taking a wallpaper where the interface element is text information and the display style of the interface element is font as an example (see Figure 19), assuming that the font of the text information 1910 for "What you think, you get" in the original wallpaper 1900 is in the "KaiTi" style, if the user's emotional state is happy, then the font style of the text information 1910 in the corresponding wallpaper 1900 will be changed to Fangzheng HeiChuSongSimplified; if the user's emotional state is sad, then the font style of the text information 1910 in the corresponding wallpaper 1900 will be changed to LiShu. If the electronic device determines that the user's emotional state is happy based on the user's facial image, then the font style of the text information 1910 in the wallpaper 1900 can be changed to "Fangzheng HeiChuSongSimplified" based on the user's happy emotional state. If the electronic device determines that the user's emotional state is sad based on the user's facial image, then the font style of the text information 1910 in the corresponding wallpaper 1900 can be changed to LiShu based on the user's sad emotional state.

[0303] In the above embodiments, the text information 1910 in the wallpaper 1900 can also present the font change process of the text information 1910 in a dynamic display effect. Based on this, the user's attention can be attracted by the dynamic display, so that the user can understand his / her own emotional changes in real time according to the font change process of the text in the wallpaper.

[0304] Taking the example in Figure 19 above, assuming that the user's emotional state obtained from the user's face image is happy, then as shown in Figure 20, the font of the text information 2010 in the wallpaper 2000 can gradually change from "KaiTi" to "Fangzheng Heizuo Song JianTi".

[0305] It's easy to understand that the dynamic changes of wallpaper 2000 shown in Figure 20 can be displayed continuously in a loop; or after displaying the dynamic changes of wallpaper 2000 shown in Figure 20 once or multiple times, the text information 2010 with the font changed to "Fangzheng Heizuo Song Jianti" can be finally displayed on the wallpaper screen of the unlock interface.

[0306] In some embodiments, the electronic device may also determine whether to add, modify, or delete at least one of the interface elements of the wallpaper based on the user's emotional state information.

[0307] In other words, electronic devices can determine whether to display at least one (or one) of the existing interface elements based on the user's emotional state information; and / or, they can also determine whether to add at least one (or one) of the existing interface elements based on the user's emotional state information. And / or, they can also determine whether to modify the display content of at least one (or one) of the existing interface elements based on the user's emotional state information.

[0308] As is understandable, in addition to the wallpapers mentioned above, the interface elements in the unlock screen can also include text, icons, audio and video elements. These interface elements are used to interact with and use the user. For details, please refer to the explanation of each interface element in the previous text, which will not be repeated here.

[0309] It should be noted that, in some embodiments, the electronic device can also determine the display attributes of interface elements (such as text, icons, etc.) in the unlock interface based on the user's emotional state information, and can also modify the display state of the unlock interface based on the determined display attributes of the interface elements in the unlock interface.

[0310] It should be understood that the display attributes of text may include the font, font size, color, etc. The display attributes of icons may include the icon's color scheme, size, shape, style (i.e., display style), display method (e.g., dynamic or static display), etc. This application embodiment does not limit the specific content of the interface elements in the unlock interface or the specific content of the display attributes of each interface element.

[0311] Using the user interface 500 shown in Figure 5 as the unlock interface, and taking the "08:08" time 520 in user interface 500 as an example, and the display attribute as the font corresponding to the "08:08" time 520, assuming that the font of the "08:08" time 520 in the user interface 500 before modification is in the "KaiTi" style, if the user's emotional state is happy, then the font style of the "08:08" time 520 in user interface 500 is changed to Fangzheng Heizu Song JianTi; if the user's emotional state is sad, then the font style of the "08:08" time 520 in user interface 500 is changed to LiShu. If the electronic device determines that the user's emotional state is sad based on the user's facial image, then as shown in Figure 21, the font style of the "08:08" time 2110 in user interface 2100 is changed to LiShu based on the user's sad emotional state.

[0312] In some embodiments, the font style of the "08:08" time 2110 in the user interface 2100 shown in FIG. 21 can also present a dynamic display effect. Taking the example of FIG. 21 above, assuming that the user's emotional state obtained based on the user's facial image is sad, then the font style of the "08:08" time 2210 in the user interface 2200 can gradually change from "KaiTi" to "LiShu". The specific change process can be seen in the multiple user interfaces 2200 shown in FIG. 22.

[0313] It is not difficult to understand that the dynamic change effect of the font style of the "08:08" time 2210 in the user interface 2200 shown in Figure 22 can be displayed continuously; or after displaying the dynamic change effect of the font style of the "08:08" time 2210 in the user interface 2200 shown in Figure 22 once or multiple times, the "08:08" time 2210 after the font has been changed to "Lishu" can finally be displayed on the unlock screen.

[0314] In another example, taking the user interface 500 shown in Figure 5 as the unlock interface, and the interface element being the unlock status icon 510 in the user interface 500, with the display attribute being the shape corresponding to the unlock status icon 510, let's assume that if the user's emotional state is happy, the display shape of the unlock status icon 510 in the user interface 500 is changed to a heart shape; if the user's emotional state is sad, the display shape of the unlock status icon 510 in the user interface 500 is changed to a rectangle. If the electronic device determines that the user's emotional state is happy based on the user's facial image, then referring to Figure 23, the display shape of the unlock status icon 510 in the user interface 500 shown in Figure 5 can be changed to a heart shape 2310.

[0315] In some embodiments, the electronic device may also determine whether to add, modify, or delete at least one of the text information or images in the unlock interface based on the user's emotional state information.

[0316] For example, taking the user interface 2400 shown in Figure 24 as an unlock interface, suppose the user interface 2400 displays a lock screen signature 2410 that reads "Do good deeds and don't worry about the future." If the user's emotional state is happy, the lock screen signature 2410 can be undisplayed. If the user's emotional state is sad, multiple identical lock screen signatures 2410 can be repeatedly displayed in the user interface 2400. If the electronic device determines that the user's emotional state is happy based on the user's facial image, then the "Do good deeds and don't worry about the future" lock screen signature 2410 can be not displayed in the user interface 2400 based on the user's sad emotional state.

[0317] It is easy to understand that the specific process of adding, modifying or deleting at least one of the text information or images in the unlock interface can also present a dynamic display effect. For details, please refer to the corresponding description in the aforementioned related embodiments, which will not be repeated here.

[0318] In some embodiments, the electronic device may also determine fourth information based on the user's emotional state information. The fourth information may include emotion regulation information and / or prompt information, the prompt information being used to indicate the user's emotional state information; and the aforementioned fourth information may be displayed on the unlock screen.

[0319] In one example, the fourth piece of information could include emotion regulation information.

[0320] It should be understood that emotion regulation information, also known as emotion guidance information, can be used to regulate a user's current emotional state. Emotion regulation information may include a song title recommended based on the user's emotional state information, resonant or encouraging words, exercise information suitable for the user based on their emotional state information (such as exercise names, links to exercise videos, etc.), suggestions for outdoor activities, travel information (such as travel destinations, travel programs, etc.), videos (such as movies, short videos, etc.), audio, etc.

[0321] In some embodiments, the emotion regulation information may be generated by at least one of the following algorithms: large language model (LLM), rule-based algorithm, deep learning algorithm, reinforcement learning algorithm, etc.

[0322] For example, assuming the electronic device determines the user's current emotional state as happy based on their facial image, then, referring to Figure 25, the electronic device can display activity suggestion information 2510 on the unlock screen 2500: "When you're happy, it's perfect to get together with friends! Why don't you invite your best friends to go sing karaoke or have a meal?" As another example, assuming the electronic device determines the user's current emotional state as bored based on their facial image, then, referring to Figure 26, the electronic device can display exercise suggestion information 2610 on the unlock screen 2600: "Put down your phone and rest for a moment, go for a walk!"

[0323] In another example, the fourth piece of information may also include a cue message corresponding to the user's emotional state.

[0324] It should be understood that the prompts may include one or more of the following: the user's current emotional state, the intensity of the emotion, and the benefits or harms corresponding to the current emotional state. Specific types of prompts may include at least one of the following: comforting and empathetic, encouraging and supportive, offering advice, providing rational guidance, or humorous and amusing.

[0325] Referring to Figure 27, assuming the user's emotional state is sadness, a prompt message 2710 corresponding to the sad emotional state can be displayed on the unlock screen 2700. For example, the prompt message 2710 could be "Every sad experience is an opportunity for growth; perhaps we can learn a lot from this experience."

[0326] In some embodiments, different types of prompt messages can be generated by combining the personal information of different users (such as personality traits or hobbies).

[0327] In another example, the fourth information may include both emotion regulation information and prompts corresponding to the user's emotional state. In this case, the fourth information, which includes both emotion regulation information and prompts, can be displayed on the unlock screen.

[0328] Referring to Figure 28, assuming the user's emotional state is sadness, then a prompt message 2810 and an emotion regulation message 2820 corresponding to the sad emotional state can be displayed on the unlock screen 2800. For example, the prompt message 2810 could be "Your current emotional state is: Sadness", and the emotion regulation message 2820 could be "We suggest you listen to some soothing music to alleviate your sad emotions. I can recommend the following songs to you: XXX".

[0329] It's easy to understand that emotion regulation information and / or prompts can also be displayed on the desktop or application interface. For example, when the unlock screen is the desktop, emotion regulation information and / or prompts can be displayed on the desktop in the form of notifications, pop-ups, etc.; they can also be displayed in the live stream window (i.e., live capsule) on the desktop.

[0330] In some embodiments, the electronic device may also switch the sound effects of the currently playing media resource according to the user's emotional state.

[0331] It should be understood that media resources can include audio, video, etc. Audio can specifically include music files, audiobooks, user-recorded audio (such as radio program recordings), audio in video files, recorded audio, etc.; video can specifically include movies, TV series, online videos (such as funny videos on short video platforms or documentaries on long video platforms), surveillance videos, etc.

[0332] Understandably, media resources can be audio or video being played on an electronic device, or audio or video determined based on the user's emotional state.

[0333] Of course, in some embodiments, the audio or video in the media resources may also be generated based on the second information. It is easy to understand that the second information may include one or more of the following: user's emotional state information, user's location information, user's personal information, time information, holiday information, weather information, etc.

[0334] It should be understood that a user's emotional state information can be used to identify the user's mood, such as happy, unhappy, calm, etc.

[0335] Location information can refer to the user's geographical location, such as home, company, school, park, hospital, etc.

[0336] A user's personal information can be a self-portrait of the user, which can be used to identify the corresponding user. For example, personal information may include at least one of the following: gender, age, occupation, hobbies, habits, social activities, personality, etc.

[0337] Time information can be used to represent different points in time during the day, such as morning, forenoon, noon, afternoon, and evening.

[0338] Festival information can be used to represent different festivals, such as Spring Festival, Mid-Autumn Festival, New Year's Day, etc.

[0339] Weather information can be used to indicate specific weather conditions, such as cloudy, sunny, rainy, snowy, and windy.

[0340] Based on the above embodiments, the second information may further include seasonal information, solar term information, temperature and humidity information, etc. The seasonal information can be used to identify different seasons, such as spring, summer, autumn, or winter. The solar term information can indicate any of the 24 solar terms. The temperature and humidity information may include specific temperature and humidity values. This application does not limit the specific content or generation method of the second information.

[0341] The sound effects of media resources can include music-related sound effects, such as electronic music style sound effects, concert style sound effects, 3D surround sound style sound effects, exclusive vocal sound effects, pure style sound effects, etc. The sound effects of media resources can also include rhythm sound effects, harmony sound effects, reverb sound effects, delay sound effects, ambient sound effects, character sound effects, object sound effects, etc.

[0342] Among these, rhythmic sound effects can be the sounds produced by instruments such as metronomes. Harmony effects can be the superimposed sounds of chords, the changes in harmony, and so on. Reverb effects can be the reflection or attenuation effects of sound in different spaces. Delay effects can be the sound effect of sound repeating after a certain delay, which can create an echo effect.

[0343] Ambient sound effects can include natural environmental sound effects, such as wind, rain, thunder, birdsong, and flowing water; ambient sound effects can also include living environment sound effects, such as horns, electrical appliance sounds, and other noises.

[0344] Character sound effects can include action sound effects and physiological sound effects. For example, action sound effects can be the sounds of walking, opening a door, running, closing a door, sitting down, and standing up; physiological sound effects can be breathing sounds, heartbeat sounds, etc.

[0345] Sound effects for objects can include everyday objects and vehicle sounds. Everyday objects can be the sound of a blanket hitting something or the sound of turning pages in a book. Vehicle sounds can be the sound of a vehicle's engine, horn, brakes, or roar.

[0346] Based on the above embodiments, taking music as an example, assuming the currently playing music has a clean sound effect, if the user's emotional state is happy, the sound effect will be changed to a concert-style sound effect; conversely, if the user's emotional state is sad, the sound effect will be changed to a sound effect featuring only vocals. If the electronic device determines that the user's emotional state is happy based on their facial image, it can change the sound effect of the currently playing music from a clean style to a concert style, allowing the user to instantly perceive their emotional state through changes in the sound effect of the currently playing music.

[0347] In some embodiments, the electronic device may also determine the media resource to be played based on the user's emotional state information and play the media resource to be played.

[0348] It is not difficult to understand that the media resources to be played may include any one of the following: audio stored in the server corresponding to the first application, local audio, system audio, audio generated based on the user's second information, video stored in the server corresponding to the first application, local video, system video, and video generated based on third information.

[0349] Here, the first application can refer to any music playback app. The audio stored on the server corresponding to the first application can be used to indicate the cloud audio corresponding to the first application.

[0350] Local audio can refer to audio stored in an electronic device, such as music files or recordings stored in the device.

[0351] System audio can refer to various system notification sounds.

[0352] It is easy to understand that the second information may include one or more of the following: the user's emotional state information, the user's location information, the user's personal information, time information, holiday information, weather information, etc. The specific content of the second information can be found in the corresponding descriptions in the aforementioned related embodiments.

[0353] In this embodiment, the third information can be exactly the same as the second information. That is, the third information can also include one or more of the following: the user's emotional state information, the user's location information, the user's personal information, time information, holiday information, weather information, etc.

[0354] In some embodiments, the third information may be partially the same as or partially different from the second information. For example, the second information may include the user's emotional state information, the user's location information, the user's personal information, time information, holiday information, and weather information. The third information may include the user's emotional state information, the user's location information, the user's personal information, seasonal information, solar term information, and temperature and humidity information.

[0355] In some embodiments, the third information may be entirely different from the second information. For example, the second information may include the user's emotional state information, the user's location information, the user's personal information, time information, holiday information, and weather information. The third information may include seasonal information, solar term information, and temperature and humidity information.

[0356] In one possible embodiment, after determining the media resource to be played based on the user's emotional state information, the electronic device can directly play the media resource to be played.

[0357] For example, taking music as the media resource to be played, referring to Figure 29, assuming the electronic device determines the music to be played as "A New Point" based on the user's emotional state information, then the music information 2910 corresponding to the music "A New Point" can be directly displayed in the user interface 2900 shown in Figure 29, and the music "A New Point" can be played. In this example, the music information 2910 may include the album art, title, and control buttons corresponding to the music player.

[0358] In another example, after determining the media resource to be played based on the user's emotional state information, the electronic device can also switch the currently playing media resource to the media resource to be played, and then play the aforementioned media resource to be played.

[0359] For example, taking the music information 2910 in the user interface 2900 shown in Figure 29 as an example of the relevant information of the music being played by the electronic device, and referring to Figure 30, if the electronic device determines that the music to be played is music 2 based on the user's emotional state information, then the currently playing music can be switched from A New Point to music 2 directly in the user interface 3000. The music information corresponding to music 2 can be seen in the music information 3010 shown in Figure 30.

[0360] It is easy to understand that, in the example described in Figure 30 above, the electronic device can directly play the music 2 to be played.

[0361] In another example, the electronic device may also update the music information 3010 in the user interface 3000 after determining that the music to be played is music 2 based on the user's emotional state information. Then, the electronic device responds to the user's trigger operation on the playback control 3010a in the music information 3010 and plays music 2.

[0362] In the above possible examples, determining the media resource to be played based on the user's emotional state information may include one media resource to be played. In other possible implementations, determining the media resource to be played based on the user's emotional state information may also include multiple media resources to be played.

[0363] In some embodiments, if it is determined from the user's emotional state information that the media resources to be played include multiple media resources, then the multiple media resources can be played directly in sequence. Specific interface changes can be found in the relevant descriptions in the foregoing embodiments, and will not be repeated here.

[0364] In some embodiments, if it is determined from the user's emotional state information that the media resources to be played include multiple media resources to be played, then multiple media resources to be played can also be played sequentially in response to the user's triggering operation.

[0365] Referring to Figure 31, and still taking music as the media resource to be played as an example, after the electronic device determines the music to be played based on the user's emotional state, it can display a prompt message 3110 in the user interface 3100. For example, the prompt message 3110 could be "Would you like to listen to some music?". Then, in response to the user's triggering operation on the prompt message 3110, an "Immediate Play" control 3120 can be displayed on the user interface 3100. The "Immediate Play" control 3120 can be used to directly play the first music among multiple music tracks. The electronic device can then play the first music track (e.g., music 1) in response to the user's triggering operation on the "Immediate Play" control 3120. The music information corresponding to the first music track can be found in the music information 3130 in the user interface 3100.

[0366] Of course, based on the above examples, more or fewer controls can be displayed in the user interface 3100 shown in Figure 31. The user's trigger operation for sequentially playing multiple media resources to be played can also include at least one operation. This application embodiment does not limit the specific content of the above examples and trigger operations.

[0367] In other embodiments, if it is determined from the user's emotional state information that the media resources to be played include multiple media resources to be played, then in response to the user's operation, the first media resource to be played among the multiple media resources to be played can also be played. The first media resource to be played can be the media resource to be played determined in response to the user's operation.

[0368] Referring to Figure 32, and still taking music as the media resource to be played as an example, after the electronic device determines the music to be played based on the user's emotional state, it can display a prompt message 3210 in the user interface 3200. For example, the prompt message 3210 could be "Would you like to listen to some music?". Then, in response to the user's triggering operation on the prompt message 3210, a "View Music List" control 3220 can be displayed on the user interface 3200. The "View Music List" control 3220 can be used to display multiple music tracks to be played. The electronic device can then, in response to the user's triggering operation on the "View Music List" control 3220, display a music list 3220a corresponding to multiple music tracks to be played. Furthermore, in response to the user's triggering operation on any one of the multiple music tracks to be played (e.g., music 1), the electronic device can display the user interface 3230 corresponding to music 1 and play the corresponding music 1.

[0369] Of course, based on the above example, more or fewer controls can be displayed in the user interface 3200 shown in Figure 32. The user operation for playing the first media resource among multiple media resources to be played can also include one or more specific operations. This application embodiment does not impose any limitations on this.

[0370] In addition to the various possible embodiments where the second interface is the unlock interface, when the second interface is the desktop, the electronic device can determine the display attributes of the application icons on the desktop based on the user's emotional state information, and then modify the display state of the desktop based on the display attributes of the application icons.

[0371] It should be understood that the display attributes of application icons may also include the color scheme, size, shape, style (e.g., border thickness or display style), display method (e.g., dynamic or static display), arrangement order of application icons on the desktop, and category. This application embodiment does not impose any limitations on these aspects.

[0372] Taking the display attributes of application icons as the color scheme, and using the desktop shown in Figure 8 as an example, assuming the display color scheme of the application icons on the desktop shown in Figure 8 is white, if the user's emotional state is happy, the display color scheme of the application icons on the desktop will be changed to brown; if the user's emotional state is sad, the display color scheme of the application icons on the desktop will be changed to cyan. If the electronic device determines that the user's emotional state is sad based on the user's facial image, then referring to Figure 33, the electronic device can change the display color scheme of the application icon 3310 on the desktop 3300 from white to cyan. In Figure 33, the application icon 3310 is represented by filling the bottom diagonal with cyan.

[0373] In some embodiments, the electronic device can also determine the display attributes of the application name corresponding to at least one APP on the desktop based on the user's emotional state information, and then modify the display state of the desktop based on the display attributes of the application name.

[0374] It should be understood that the display attributes of an application name can include the font, font size, and color corresponding to the application name. If the display attribute of an application name is the font, then the font of the application name for at least one app on the desktop can be modified based on the font of the application name. If the display attribute of an application name is the font size, then the font size of the application name for at least one app on the desktop can be modified based on the font of the application name. If the display attribute of an application name is the color, then the color of the application name for at least one app on the desktop can be modified based on the font of the application name.

[0375] Taking desktop 3300 as shown in Figure 33, and using font size as an example where the display attribute of application names is font size, assuming the font size of each application name on desktop 3300 is size 5, if the user's emotional state is happy, the font size of each application name on desktop 3300 will be changed to size 3; if the user's emotional state is sad, the font size of the application names on desktop 3300 will be changed to size 8. If the electronic device determines that the user's emotional state is happy based on the user's facial image, then referring to Figure 34, the electronic device can change the font size of application name 3410 on desktop 3400 from size 5 to size 3.

[0376] In addition to the possible embodiments described above, the electronic device can also determine the display attributes of other interface elements on the desktop based on the user's emotional state information, and then modify the desktop display state based on the determined display attributes of other interface elements.

[0377] It should be understood that other interface elements may include a live view window, folders, widgets (such as a weather widget), a search box, a notification bar, a status bar, a quick settings panel, etc. The display attributes of each interface element on the desktop may also include at least one of the following: color scheme, display size, display shape, display style, display method, arrangement order, font, font size, and color. The process of modifying the desktop display state can be found in the descriptions of the aforementioned related embodiments, and will not be repeated here.

[0378] When the second interface is the application interface, the electronic device can determine the layout of the interface elements in the application interface based on the user's emotional state information, and then modify the display state of the application interface based on the layout of the application interface.

[0379] It should be understood that the application interface can refer to the relevant content in the embodiment where the second interface is the application interface. The interface elements and layout of the application interface can refer to the corresponding content of the interface layout and interface elements in the display state of the second interface, and will not be repeated here.

[0380] As an example, and not a limitation, Figure 35 shows the user interface 3500 displayed after the settings app is launched. The interface layout is illustrated by the color scheme. Assuming the color scheme of the settings app's interface 3500 in Figure 35 is white, if the user's emotional state is happy, the color scheme of the interface 3500 will be changed to pink; if the user's emotional state is sad, the color scheme will be changed to purple. If the electronic device determines the user's emotional state is happy based on their facial image, then, referring to Figure 36, the electronic device can change the color scheme of the application interface 3600 from white to pink. In the example described in Figure 36, a large diamond shape is used to fill the application interface 3600 to represent the change of the application interface 3600's color scheme to pink.

[0381] In practical applications, users can configure the display mode of the second interface through settings such as an app, enabling the electronic device to execute the interface display method provided in this application embodiment. For example, in response to a user's activation of the "mood wallpaper" function, the electronic device can configure the display mode of the second interface so that after the electronic device transitions from an unlocked state to an unlocked state, the display state of the second interface can be modified according to the user's emotional state.

[0382] Of course, users can also choose not to set the display mode of the second interface. That is, after the electronic device changes from an unlocked state to an unlocked state, the electronic device can automatically execute the interface display method provided in this application embodiment, so that the display state of the second interface changes with the user's emotional state.

[0383] Based on the interface display method provided in this application, a first interface is displayed when the electronic device is in an unlocked state (i.e., locked screen state). Subsequently, not only can the electronic device be unlocked using the user's facial image, but the user's emotional state information can also be further obtained based on the facial image. After the electronic device is unlocked, it can instantly modify the display state of the second interface based on the obtained user's emotional state information. Therefore, users do not need to rely on specific applications; they can intuitively and clearly perceive their own emotional state simply through changes in the second interface display state, effectively achieving instant feedback. This method avoids the limitation of relying on specific applications to know one's own emotions and promotes the user's instant awareness of their own emotions.

[0384] Furthermore, linking emotional state with the display state of the unlocked second interface enables more efficient establishment of emotional resonance through real-time adaptation of visuals and interactions, and faster delivery of emotional reminders to users. This achieves a high degree of synchronization between emotional perception and interface presentation, enhancing the user experience while realizing personalized display of the second interface.

[0385] It should be noted that the specific content of the above embodiments can be applied to other embodiments, that is, the specific content of each embodiment can also be extended to other embodiments. The specific content of different embodiments can also be combined with each other to form new embodiments.

[0386] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.

[0387] Based on the interface display methods provided in the above embodiments, FIG37 is a schematic block diagram of an interface display device 3700 provided in an embodiment of this application. The interface display device 3700 shown in FIG37 may include: a display unit 3710, an acquisition unit 3720, and a modification unit 3730.

[0388] Display unit 3710 is used to display a first interface, which is the interface displayed by the electronic device when it is not unlocked;

[0389] The acquisition unit 3720 is used to acquire the user's emotional state information based on the user's facial image in response to the unlocking operation;

[0390] Modification unit 3730 is used to modify the display state of the second interface based on emotional state information. The second interface is the interface displayed when the electronic device is unlocked.

[0391] In some embodiments, the modification unit 3730 is further configured to: determine first information based on the emotional state information, the first information including at least one of the display color scheme of the wallpaper, the display color scheme of the background area in the wallpaper, the interface layout of the interface elements in the identification area of ​​the wallpaper, the display attributes of the filter, the display attributes of the application icon, and the display attributes of the application name; and modify the display state of the second interface based on the first information.

[0392] In some embodiments, the modification unit 3730 is further configured to: determine a first image based on emotional state information, the first image including at least one of an emoticon, a plant object, and an animal object corresponding to the emotional state information; and modify the display state of the second interface based on the first image.

[0393] In some embodiments, the interface display device 3700 further includes:

[0394] The switching unit is used to switch the sound effects of the currently playing media resource based on emotional state information; or,

[0395] The first determining unit is used to determine the media resource to be played based on the emotional state information, and to play the media resource to be played. The media resource to be played includes one of the following: audio stored in the server corresponding to the first application, local audio, system audio, audio generated based on the user's second information, video stored in the server corresponding to the first application, local video, system video, and video generated based on the user's third information. The second information includes one or more of the following: emotional state information, user location information, user personal information, time information, holiday information, and weather information. The third information is completely the same as, partially the same as, or completely different from the second information.

[0396] In some embodiments, the interface display device 3700 further includes:

[0397] The second determining unit is used to determine the fourth information based on the emotional state information. The fourth information includes emotional regulation information and / or prompting information, and the prompting information is used to indicate the emotional state information.

[0398] The fourth piece of information is displayed on the second screen.

[0399] In some embodiments, the second interface includes any one of an unlock interface, a desktop, and an application interface, with the unlock interface being related to the first interface.

[0400] In some embodiments, the acquisition unit 3720 is further configured to: determine the user's emotional state information based on the user's facial image and the user's physiological state data acquired by the wearable device, wherein the wearable device and the electronic device have a communication connection.

[0401] It should be understood that the description of the device embodiments can refer to the relevant descriptions of the various method embodiments above. Their implementation principles and technical effects are similar to those of the method embodiments above, and will not be repeated here.

[0402] The "module" of the interface display device 3700 shown in Figure 37 can be implemented in hardware, software, or by hardware executing corresponding software. For example, the "module" can refer to an application-specific integrated circuit (ASIC), electronic circuits, a processor (e.g., a shared processor, a proprietary processor, or a group processor) and memory for executing one or more software or firmware programs, integrated logic circuits, and / or other suitable components that support the described functions.

[0403] Based on the methods provided in the above embodiments, this application also provides the following:

[0404] This application provides a computer program product, which includes a program that, when run by an electronic device, causes the electronic device to perform the methods shown in the above embodiments.

[0405] This application provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the methods shown in the above embodiments.

[0406] This application provides a chip including a memory and a processor. The processor executes a computer program stored in the memory to control the electronic device to perform the methods shown in the various embodiments above.

[0407] It should be understood that the processor mentioned in the embodiments of this application can be a CPU, or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0408] It should also be understood that the memory mentioned in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).

[0409] Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is merely an example. In practical applications, the above functions can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this application. In the above embodiments, the descriptions of each embodiment have different focuses; parts not described in detail or recorded in a certain embodiment can be referred to in the relevant descriptions of other embodiments.

[0410] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0411] In the embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the system embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection between devices or units through some interfaces, and may be electrical, mechanical, or other forms.

[0412] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0413] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0414] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the processes in the methods of the above embodiments can be implemented by a computer program instructing related hardware. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the various method embodiments described above. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. The computer-readable medium can include at least: any entity or device capable of carrying computer program code to a large-screen device, a recording medium, a computer memory, a read-only memory, a random access memory, an electrical carrier signal, a telecommunication signal, and a software distribution medium. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0415] Finally, it should be noted that the above description is only a specific implementation of this application, but the protection scope of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be covered within the protection scope of this application.

Claims

1. A method for displaying an interface, characterized in that, Applied to electronic devices, the method includes: Display a first interface, which is the interface displayed when the electronic device is locked; In response to the unlocking operation, the user's emotional state information is obtained based on the user's facial image; The display state of the second interface is modified according to the emotional state information. The second interface is the interface displayed when the electronic device is unlocked.

2. The interface display method according to claim 1, characterized in that, Modifying the display state of the second interface based on the emotional state information includes: The first information is determined based on the emotional state information. The first information includes at least one of the following: the display color scheme of the wallpaper, the display color scheme of the wallpaper background area, the interface layout of the interface elements in the marked area of ​​the wallpaper, the display attributes of the filter, the display attributes of the application icon, and the display attributes of the application name. Modify the display state of the second interface based on the first information.

3. The interface display method according to claim 1, characterized in that, Modifying the display state of the second interface based on the emotional state information includes: A first image is determined based on the emotional state information, wherein the first image includes at least one of the following: an emoji, a plant object, and an animal object corresponding to the emotional state information; Modify the display state of the second interface based on the first image.

4. The interface display method according to claim 1, characterized in that, The method further includes: The sound effects of the currently playing media resource are switched based on the emotional state information; or, The media resource to be played is determined based on the emotional state information, and the media resource to be played is played. The media resource to be played includes any one of the following: audio stored in the server corresponding to the first application, local audio, system audio, audio generated based on the user's second information, video stored in the server corresponding to the first application, local video, system video, and video generated based on the user's third information. The second information includes one or more of the following: the emotional state information, the user's location information, the user's personal information, time information, holiday information, and weather information. The third information is completely identical, partially identical, or completely different from the second information.

5. The interface display method according to any one of claims 1 to 4, characterized in that, The method further includes: A fourth piece of information is determined based on the emotional state information, the fourth piece of information including emotion regulation information and / or prompting information, the prompting information being used to indicate the emotional state information; The fourth information is displayed on the second interface.

6. The interface display method according to any one of claims 1 to 5, characterized in that, The second interface includes any one of the following: an unlock interface, a desktop, and an application interface, wherein the unlock interface is related to the first interface.

7. The interface display method according to any one of claims 1 to 6, characterized in that, The step of obtaining the user's emotional state information based on the user's facial image includes: The user's emotional state information is determined based on the user's facial image and the user's physiological state data obtained from the wearable device. The wearable device and the electronic device have a communication connection.

8. An electronic device, characterized in that, The electronic device is configured to perform the method as described in any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when executed by a processor, implements the method as described in any one of claims 1 to 7.

10. A chip system, characterized in that, The chip system includes a processor that executes a computer program stored in a memory to implement the method as described in any one of claims 1 to 7.

Images