Interface display method and related device

Abstract

The present application discloses an interface display method and a related device. When detecting that a preset condition is triggered, an electronic device can display a virtual avatar. The state of the virtual avatar can be associated with the preset condition, and when the preset condition is different, the state of the virtual avatar is also different. In addition, the electronic device can also support a user to interact with the virtual avatar by means of an interactive operation (for example, clicking and other interactive operations). In this way, interestingness and interactivity can be increased, and user experience can be improved.

Description

Interface display method and related device

[0001] The present application claims priority to the Chinese patent application No. 202411306977.6, filed on September 18, 2024, and entitled "Interface display method and related device", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of terminals, and in particular to an interface display method and related device. BACKGROUND

[0003] With the rapid development of terminal technology, more and more smart electronic devices (such as smart watches, smart bracelets, and other wearable devices) have entered the lives of users. However, the current electronic devices lack interactivity in interface design, the display content is monotonous, the user experience is poor, and the diversified needs of users cannot be met. SUMMARY

[0004] The embodiments of the present application provide an interface display method and related device, an electronic device can display a pet image, and can support a user to interact with the pet image through an interactive operation, increase the interest and interactivity, and improve the user experience.

[0005] In a first aspect, the embodiments of the present application provide an interface display method applied to a first electronic device, the method comprising: when detecting first information, the first electronic device displays a first picture, the first picture comprising a first virtual image, the first virtual image being in a first state, the first state being used to indicate the first information; when detecting second information, the first electronic device displays a second picture, the second picture comprising the first virtual image, the first virtual image being in a second state, the second state being used to indicate the second information; wherein the first state and the second state are different.

[0006] The first electronic device can be the electronic device 100 mentioned in the following embodiments, the first information and the second information can be two different notification messages, and the first picture and the second picture can be a picture displayed on the entire screen of the electronic device 100 or a picture displayed in a part of the screen.

[0007] In the embodiments of the present application, the virtual image can be various types of images, such as pet images, character images, plant images, etc. The specific type of the virtual image is not limited in the embodiments of the present application. The virtual image can be different, for example, the virtual image can be a panda or a puppy. It can be understood that the panda and the puppy belong to different virtual images.

[0008] The first electronic device can generate the virtual image based on one or more parameters. The parameters include, but are not limited to, emotion detection results, environment information in which the user is located, motion health data, associated event information, personal information of the user, and notification messages. The electronic device can determine one or more of the following according to the parameters: an expression of the virtual image, a motion of the virtual image, an accessory of the virtual image, a background of the virtual image, and the like.

[0009] The virtual image can also be used to indicate the one or more parameters. For example, the virtual image shown in FIG. 1A is a virtual image holding an umbrella and in a calm expression, and the state of the virtual image is a state of holding an umbrella and in a calm emotion. At this time, the state of the virtual image can be used to indicate that the weather at the location where the user is located is rainy and the emotion of the user is calm.

[0010] In an embodiment, the virtual image can be the pet image described above. The virtual image in a certain state can include, but is not limited to, the virtual images shown in FIGS. 1A-1F, 2A, 2B, 3A-3B, 4, 5A-5J, 6A-6B, 7, 8, 9, 10A-10B in the following embodiments.

[0011] The first state and the second state are states of the virtual image. It can be understood that for the same virtual image, the state of the virtual image can be different.

[0012] The first state described above can be, for example, a state of any one of the virtual images shown in FIGS. 1A-10B in the following embodiments. For example, the first state can be a state of exercise such as pre-exercise, during exercise, and post-exercise, a state of sleep such as falling asleep, sleeping, and waking up, a state of meal such as pre-meal, during meal, and post-meal, and an emotional state such as positive emotion, neutral emotion, and negative emotion. The second state described above can also be, for example, a state of any one of the virtual images shown in FIGS. 1A-10B in the following embodiments, but is different from the first state described above. The description of the second state can refer to the description of the first state.

[0013] By implementing the method of the first aspect, the electronic device 100 can trigger the electronic device 100 to display the virtual image when it is necessary to output a notification message of some application (system application or third-party application), so that the electronic device 100 can use the virtual image to indicate the monotonous text notification message, and achieve the purpose of more effectively reminding the user.

[0014] In a possible implementation, when the first information is detected, the first electronic device further displays first text prompt information, the first text prompt information being used for indicating the first information; or, when the second information is detected, the first electronic device further displays second text prompt information, the second text prompt information being used for indicating the second information.

[0015] In a possible implementation, the first picture and the first text prompt information are displayed simultaneously, or the first picture is displayed before the first text prompt information, or the first picture is displayed after the first text prompt information; or, the second picture and the second text prompt information are displayed simultaneously, or the second picture is displayed before the second text prompt information, or the second picture is displayed after the second text prompt information.

[0016] The first text prompt information can be the first information itself or information processed from the first information, and the information can be used for indicating the first information. That is, the first text prompt information can be displayed simultaneously with the first virtual image, or displayed before or after the first virtual image.

[0017] The second text prompt information can be the second information itself or information processed from the second information, and the information can be used for indicating the second information. That is, the second text prompt information can be displayed simultaneously with the first virtual image, or displayed before or after the first virtual image.

[0018] In a possible implementation, the first picture is displayed before the first text prompt information, specifically including: the first electronic device displays the first text prompt information after displaying the first picture for a first preset time length; or, the first electronic device displays the first picture, and in response to a user operation, the first electronic device displays the first text prompt information; the first picture is displayed after the first text prompt information, specifically including: the first electronic device displays the first picture after displaying the first text prompt information for a second preset time length; or, the first electronic device displays the first text prompt information, and in response to a user operation, the first electronic device displays the first picture; the second picture is displayed before the second text prompt information, specifically including: the first electronic device displays the second text prompt information after displaying the second picture for a third preset time length; or, the first electronic device displays the second picture, and in response to a user operation, the first electronic device displays the second text prompt information; the second picture is displayed after the second text prompt information, specifically including: the first electronic device displays the second picture after displaying the second text prompt information for a fourth preset time length; or, the first electronic device displays the second text prompt information, and in response to a user operation, the first electronic device displays the second picture.

[0019] In this way, the first electronic device can automatically switch the display or switch the display of the first virtual image and the text prompt information (i.e., the first text prompt information or the second text prompt information) through user operation.

[0020] In a possible implementation, before the first electronic device displays the first screen, the method further includes: the first electronic device detects that the user is in a first emotion, and determines that the first virtual image is in a first state based on the first emotion and the first information; and / or, before the first electronic device displays the second screen, the method further includes: the first electronic device detects that the user is in a second emotion, and determines that the first virtual image is in a second state based on the second emotion and the second information.

[0021] In this way, the state of the first virtual image can not only be used to indicate the emotion of the user, but also be used to indicate that the notification message is detected.

[0022] In a possible implementation, the method further includes: while the first electronic device displays the first screen, the first electronic device detects a first operation; in response to the first operation, the first electronic device displays a third screen, the third screen including the first virtual image, the first virtual image being in a third state, the third state being different from the first state.

[0023] The third state is a state of the virtual image. Exemplarily, the third state can be any one of the states of the virtual images shown in FIGS. 1A-10B. Taking the first information as a sleep alarm reminder and the first operation as a click operation as an example, the first screen includes the pet image (virtual image) that is digging into the quilt (first state) as shown in FIG. 5A. After detecting the click operation, the electronic device can display the third screen, the third screen including the pet image (virtual image) in a sleeping state (third state) as shown in FIG. 5B. For another example, the first state is the state of the virtual image shown in FIG. 5D, and the third state can be the state of the virtual image shown in FIG. 5E; for another example, the first state is the state of the virtual image shown in FIG. 5F, and the third state can be the state of the virtual image shown in FIG. 5G, which will not be described herein.

[0024] In this way, the first electronic device can support the user to interact with the virtual image, so that the state of the virtual image can be changed through the interactive operation.

[0025] In a possible implementation, the method further includes: while the first electronic device displays the second screen, the first electronic device detects a second operation, the second operation being the same operation as the first operation; in response to the second operation, the first electronic device displays a fourth screen, the fourth screen including the first virtual image, the first virtual image being in a fourth state, the fourth state being different from the second state.

[0026] The fourth state is a state of the avatar. For example, the fourth state can be any one of the states of the avatar shown in FIGS. 1A-10B. The description of the fourth state can refer to the description of the third state. For example, if the second state is the state of the avatar shown in FIG. 5A, the fourth state can be the state of the avatar shown in FIG. 5B; for another example, if the second state is the state of the avatar shown in FIG. 5D, the fourth state can be the state of the avatar shown in FIG. 5E; for yet another example, if the second state is the state of the avatar shown in FIG. 5F, the fourth state can be the state of the avatar shown in FIG. 5G. Details are not described herein.

[0027] The first operation and the second operation can both be an interaction operation between the user and the first avatar. The interaction operation can trigger the avatar to perform a specific behavior. Further, the state of the avatar displayed by the first electronic device is different from the state of the avatar displayed before the interaction operation. Different interaction operations can trigger different behaviors of the avatar. The same interaction operation can also trigger different behaviors of the avatar in different states of the avatar. The types of the interaction operation can include, but are not limited to, finger clicking, finger sliding, finger long pressing, double-finger pinching / separating, knuckle tapping, and the like. Details can refer to FIGS. 5A-5G in Example 1 and the related description in Example 2, which are not described herein.

[0028] In a possible implementation, the first state satisfies one or more of the following: the first state is used to indicate content of the first information or an overview of the content of the first information; the first state is used to indicate a task to be performed by the user, the task being associated with the first information; the first state is used to indicate that the first information is an audio / video call request; and / or the second state satisfies one or more of the following: the second state is used to indicate content of the second information or an overview of the content of the second information; the second state is used to indicate a task to be performed by the user, the task being associated with the second information; and / or the second state is used to indicate that the second information is an audio / video call request.

[0029] In a possible implementation, if the first state is used to indicate a summary of the content of the first information, the third state is used to indicate the content of the first information; or, if the first state is used to indicate a task to be performed by the user, the third state is used to indicate that the task is being performed; or, if the first state is used to indicate that the first information is an audio / video call request, the third state is used to indicate that the audio / video call request has been answered or rejected; or, if the second state is used to indicate a summary of the content of the second information, the fourth state is used to indicate the content of the second information; or, if the second state is used to indicate a task to be performed by the user, the fourth state is used to indicate that the task is being performed; or, if the second state is used to indicate that the second information is an audio / video call request, the fourth state is used to indicate that the audio / video call request has been answered or rejected.

[0030] In a possible implementation, the first information is a service reminder type notification message, the third state is used to indicate the content of the first information, or the third state is used to indicate that the task is being performed; or, the first information is an instant chat type notification message or an information marketing type notification message, the third state is used to indicate the content of the first information; or, the first information is an audio / video call type notification message, the third state is used to indicate that the audio / video call request has been answered or rejected; the second information is a service reminder type notification message, the fourth state is used to indicate the content of the second information, or the fourth state is used to indicate that the task is being performed; or, the second information is an instant chat type notification message or an information marketing type notification message, the fourth state is used to indicate the content of the second information; or, the second information is an audio / video call type notification message, the audio / video call request has been answered or rejected.

[0031] That is to say, for different types of notification messages, after the interactive operation, the virtual image can be in different states.

[0032] For example, in the case of a service reminder type notification message (for example, a notification message of a clock application or a schedule application in the following embodiments), after the interactive operation, the electronic device 100 can display a pet image indicating a task to be performed by the user after the notification message, for example, when the notification message is a sleep notification message, after the interactive operation, a pet image in a sleeping state in the following embodiments can be displayed to indicate that the user needs to sleep, and for example, when the notification message is a meeting notification message, after the interactive operation, a pet image in a meeting state in the following embodiments can be displayed to indicate that the user needs to attend a meeting.

[0033] For example, in the case of a marketing information type notification message or an instant chat type notification message, after the interactive operation, the electronic device 100 can display a pet image related to the specific content of the marketing information type notification message or the specific content of the instant chat type notification message.

[0034] Exemplarily, in a case where the notification message is an audio / video call type notification message, after the interaction operation, the electronic device 100 can display a pet image for indicating that the user has answered or has rejected the audio / video call.

[0035] In a possible implementation, the method further includes: when the first electronic device displays the first virtual image, the first electronic device collects first data; and the first electronic device controls the first virtual image based on the first data; wherein the first data includes one or more of user operation data, environment data, and user physiological data.

[0036] The display of the first virtual image can specifically refer to displaying the first virtual image in the first picture, the second picture, the third picture, or the fourth picture.

[0037] That is, the electronic device 100 can control the first virtual image based on the data collected by the sensor, for example, change the size, state, position, and the like of the first virtual image.

[0038] In a possible implementation, the method further includes: the first electronic device detects that a first preset condition is triggered; and the first electronic device displays a fourth picture, the fourth picture including the first virtual image, and a state of the first virtual image being associated with the first preset condition; wherein the first preset condition includes one or more of a specific user action, a specific wake-up word, a notification message, a preset scene, a preset time, and a preset location.

[0039] That is, the condition for triggering the electronic device 100 to display the virtual image can be one or more, and the state of the virtual image can be different when the condition is triggered.

[0040] In a possible implementation, the method further includes: the first electronic device detects that the second electronic device is close to the first electronic device; and the first electronic device displays the first virtual image and a second virtual image for interaction, the second virtual image being associated with the second electronic device.

[0041] The second electronic device can be the electronic device 200. When the second electronic device is close to the first electronic device, the second electronic device can or can not display the second virtual image, the first electronic device can obtain the second virtual image on the second electronic device, and the second virtual image can be a virtual image for representing the emotion of a user of the second electronic device.

[0042] In this way, the common behavior actions (for example, two virtual images shaking hands with each other) when meeting friends in a real scene can be vividly and visually presented, and the interest is increased.

[0043] In a possible implementation, the first information and the second information are different.

[0044] Specifically, the first state and the second state are different because of different types of the first information and the second information, and / or different contents indicated by the first information and the second information.

[0045] The types of the first information and the second information can include, but are not limited to, social communication, service reminder, information, and marketing.

[0046] In a possible implementation, the first electronic device is a watch, and the user operation data is operation data of rotating a crown. The first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device enlarges the display of the first virtual image, or reduces the display of the first virtual image; or the user operation data is operation data of pressing a volume key. The first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device enlarges the display of the first virtual image, or reduces the display of the first virtual image.

[0047] In this way, the virtual image can be enlarged or reduced in display in various ways (for example, rotating a crown, pressing a volume key, and the like).

[0048] In a possible implementation, the user operation data is operation data of tapping a screen with a knuckle. The first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controls the first virtual image to move away from the position of tapping the screen with the knuckle; or the user operation data is operation data of pinching with two fingers. The first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device reduces the display of the first virtual image, and displays the reduced first virtual image suspended between the two fingers; or the user operation data is operation data of touching a screen with a single finger. The first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controls the first virtual image to move to the position of the single finger.

[0049] The user operation and the effect of triggering the electronic device 100 to control the virtual image can be referred to the following description about FIG. 7.

[0050] In a possible implementation, the user operation data is operation data of tilting the first electronic device, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controls the first virtual image to tilt in the tilting direction of the first electronic device; or, the user operation data is operation data of moving the first electronic device, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controls the first virtual image to move along the moving track of the first electronic device; or, the user operation data is operation data of jumping of the first electronic device worn by the user, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controls the first virtual image to jump along the first electronic device.

[0051] The user operation and the effect of triggering the electronic device 100 to control the virtual image can be referred to the description of FIG. 8.

[0052] In a possible implementation, the user operation data is operation data of the user blowing air to the microphone, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device displays the first virtual image in a wind blowing state.

[0053] The first virtual image in the wind blowing state may, for example, be a first virtual image with hair flowing in the wind or a first virtual image with hair standing up.

[0054] In a possible implementation, the environment data is environment smell data, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device determines the environment smell based on the environment smell data, and displays the first virtual image in a fifth state, the fifth state being used to indicate a state of the first virtual image smelling the environment smell; or, the environment data is environment light data, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device determines the intensity of the environment light based on the environment light data, and displays the first virtual image in a sixth state, the sixth state being used to indicate a state of a background in which the first virtual image is located, and the background is used to indicate the intensity of the environment light; or, the user physiological data is hydration degree data of the user's skin, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device determines the hydration degree of the user's skin based on the hydration degree data of the user's skin, and displays the first virtual image in a seventh state, the seventh state being used to indicate the hydration degree of the user's skin.

[0055] The fifth state can be, for example, a state in which the virtual image is happy when smelling a fragrance or covers the nose when smelling a stench, as shown in FIG. 1D, the sixth state can be, for example, a state in which the background is bright when the intensity of the ambient light is high or the background is dim when the intensity of the ambient light is low, as shown in FIG. 1E, and the seventh state can be, for example, a state in which the virtual image is sweating, as shown in FIG. 1F.

[0056] In a second aspect, an embodiment of the present application provides a chip system, comprising: a processor, the processor being coupled with a memory, the memory being configured to store programs or instructions, when the programs or instructions are executed by the processor, the chip system is caused to perform the method in any possible implementation manner of the first aspect.

[0057] In a third aspect, an embodiment of the present application provides an electronic device, comprising one or more processors and one or more memories; wherein the one or more memories are coupled with the one or more processors, and the one or more memories are configured to store computer program codes, the computer program codes comprising computer instructions, when the one or more processors execute the computer instructions, the electronic device is caused to perform the method in any possible implementation manner of the first aspect.

[0058] In a fourth aspect, an embodiment of the present application provides a computer storage medium, the computer storage medium storing a computer program, the computer program comprising program instructions, when the program instructions are executed on an electronic device, the electronic device is caused to perform the method in any possible implementation manner of the first aspect.

[0059] In a fifth aspect, an embodiment of the present application provides a computer program product, when the computer program product is executed on a computer, the computer is caused to perform the method in any possible implementation manner of the first aspect. BRIEF DESCRIPTION OF DRAWINGS

[0060] FIGS. 1A-1F are schematic diagrams of a group of generated pet images provided by an embodiment of the present application;

[0061] FIG. 2A is a schematic diagram of displaying a pet image provided by an embodiment of the present application;

[0062] FIG. 2B is a schematic diagram of displaying a pet image provided by another embodiment of the present application;

[0063] FIG. 3A is a schematic diagram of displaying a pet image provided by another embodiment of the present application;

[0064] FIG. 3B is a schematic diagram of displaying a pet image provided by another embodiment of the present application;

[0065] FIG. 4 is another schematic diagram of displaying a pet image according to an embodiment of the present application;

[0066] FIGS. 5A-5J are a set of schematic diagrams of displaying a pet image according to an embodiment of the present application;

[0067] FIG. 6A is a schematic diagram of adjusting a shape of a pet image according to an embodiment of the present application;

[0068] FIG. 6B is another schematic diagram of adjusting a shape of a pet image according to an embodiment of the present application;

[0069] FIG. 7 is another schematic diagram of adjusting a shape of a pet image according to an embodiment of the present application;

[0070] FIG. 8 is another schematic diagram of adjusting a shape of a pet image according to an embodiment of the present application;

[0071] FIG. 9 is another schematic diagram of adjusting a shape of a pet image according to an embodiment of the present application;

[0072] FIG. 10A is a schematic diagram of displaying a pet image after an interaction according to an embodiment of the present application;

[0073] FIG. 10B is a schematic diagram of displaying a pet image when a device is close according to an embodiment of the present application;

[0074] FIG. 10C is a schematic diagram of performing mood improvement according to an embodiment of the present application;

[0075] FIG. 11 is a schematic diagram of a flow of an interface display method according to an embodiment of the present application;

[0076] FIG. 12 is a schematic diagram of a software structure of an electronic device according to an embodiment of the present application;

[0077] FIG. 13 is a schematic diagram of a structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0078] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, “ / ” represents the meaning of or, for example, A / B can represent A or B; “and / or” in the text only represents a description of the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which means that there are three cases of A alone, A and B together, and B alone. In addition, in the description of the embodiments of the present application, “multiple” means two or more than two.

[0079] It should be understood that the terms "first", "second", etc. in the specification and claims of the present application and the drawings are used to distinguish different objects, and are not used to describe a particular order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but can optionally include steps or units not listed, or can optionally include other steps or units inherent to the process, method, product or device.

[0080] In the present application, the term "embodiment" means that the specific features, structures or characteristics described in conjunction with the embodiment can be included in at least one embodiment of the present application. The appearance of this phrase at various places in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment to other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described in the present application can be combined with other embodiments.

[0081] The term "user interface (UI)" in the following embodiments of the present application is a medium interface for interaction and information exchange between an application program or an operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The user interface is source code written in a specific computer language such as Java, extensible markup language (XML), etc. The interface source code is parsed, rendered and finally presented as content recognizable by the user on the electronic device. The commonly used form of user interface is graphic user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be a visual interface element such as text, icon, button, menu, tab, text box, dialog box, status bar, navigation bar, Widget, etc. displayed in the display screen of the electronic device.

[0082] At present, the display content of many intelligent electronic devices (such as smart watches, smart bracelets and other wearable devices) on the interface of watch face, theme, service card, etc. is unchangeable or cycled, which lacks interest and interactivity in interface design and cannot meet the diversified interactive needs of users.

[0083] Based on the above problems, the embodiment of the present application provides an interface display method. The electronic device can display a virtual image when detecting that a preset condition is triggered. The state of the virtual image can be associated with the user's preset condition. Different preset conditions correspond to different states of the virtual image. In addition, the electronic device can also support the user to interact with the virtual image through interactive operations (such as clicking and other interactive operations). In this way, the interest and interactivity can be increased, and the user experience can be improved.

[0084] It should be noted that the virtual image mentioned in the embodiment of the present application can be various types of images, such as pet images, character images, plant images, etc. The specific type of the virtual image is not limited in the embodiment of the present application.

[0085] In the embodiment of the present application, the interface display method provided by the embodiment of the present application is described by taking the virtual image as a pet image (or called a cute pet image, a cute pet expression, or a pet expression).

[0086] It should be noted that the electronic device (such as the electronic device 100 and the electronic device 200) mentioned in the embodiment of the present application can be various types of terminal devices. For example, the electronic device can be a smart watch, a smart bracelet, or other wearable devices. For another example, the electronic device can also be a mobile phone, a tablet computer, a personal computer, etc. The specific type of the electronic device is not limited in the embodiment of the present application.

[0087] In the embodiment of the present application, the interface display method provided by the embodiment of the present application is described by taking the electronic device as a smart watch.

[0088] For ease of understanding, some related concepts involved in the embodiment of the present application are described below.

[0089] 1, emotion (or emotional state)

[0090] Emotion is a state that combines a person's feelings, thoughts, and behaviors. It is a subjective experience often accompanied by physiological arousal and external manifestations. It is a psychological phenomenon mediated by the subject's needs, desires, and other tendencies. It is a reflection of whether a person's needs are met. When the objective things meet the needs and desires of the subject, the subject will produce positive emotions, and conversely, the subject will produce negative emotions.

[0091] 2, emotion model classification

[0092] Common emotion models are mainly divided into two categories: continuous emotion model and discrete emotion model.

[0093] The continuous emotion model can be understood from the perspective of dimension. The continuous emotion model is based on multi-dimensional theory and classifies emotions in multiple dimensions or scales.

[0094] A continuous emotion model can describe an emotion as a point in a multi-dimensional emotion space, each dimension in the space corresponding to a psychological attribute of the emotion. Almost all emotions can find a corresponding mapping point in the emotion space.

[0095] The dimensional space model of emotion can be divided into different types such as two-dimensional, three-dimensional, etc.

[0096] A commonly used continuous emotion model is a two-dimensional emotion representation model, in which the horizontal axis and the vertical axis represent valence and arousal, respectively.

[0097] Valence (or called valence) can represent the degree of pleasure (or the degree of positive / negative) of an emotion. It is easy to understand that when a person's needs are met, they usually have positive emotions (or positive emotions), and their activity (or called motivation) is improved; when a person's needs are not met, they usually have negative emotions (or negative emotions), and their activity is reduced.

[0098] Arousal can represent the intensity of an emotion. The intensity of an emotion can have two extremes, such as from joy to ecstasy, from slight anger to rage.

[0099] For example, in the above-mentioned two-dimensional emotion representation model, happiness can be represented by high valence and high arousal, and sadness can be represented by low valence and low arousal.

[0100] A discrete emotion model can be understood from the perspective of category theory. The discrete emotion model is based on the basic emotion theory and labels emotions as discrete categories.

[0101] The discrete emotion model can describe emotions as discrete (basic) and adjective labels, such as joy, anger, pity, happiness, sadness, fear, surprise, etc.

[0102] It should be noted that in the embodiments of the present application, the emotion detection result (or emotion classification result) obtained by performing emotion detection can include the emotion category to which the user's emotion state belongs. The emotion category can be obtained by classifying the emotion in N dimensions using the aforementioned continuous emotion model (where N can be a positive integer greater than 1, such as N = 3 or 5 or 7, i.e. three classification, five classification or seven classification of emotion), or can be obtained by labeling the emotion as joy, anger, pity, happiness, sadness, fear, surprise, etc. discrete category using the aforementioned discrete emotion model, and the embodiments of the present application are not limited thereto. The embodiments of the present application are described by taking examples of emotions including positive emotions, neutral emotions, and negative emotions. It can be understood that negative emotions can also be referred to as not pleasant, neutral emotions can also be referred to as calm, and positive emotions can also be referred to as pleasant. The category of emotion can also include others, and the embodiments of the present application are not limited thereto.

[0103] 3. Emotion detection

[0104] As emotions are the compound product of brain conditioned reflexes (or emotional memory) and cognitive evaluation, which eventually act on the viscera and skeletal muscles to produce physiological stress (or physiological signs) reactions, when the emotional state changes, the autonomic nervous system is awakened, accompanied by a series of physiological changes.

[0105] With the rapid development of smart wearable devices, their hardware sensor capabilities and basic physiological signal detection capabilities are gradually enhanced, and emotion detection based on physiological signals has the application advantages of anytime, anywhere, real-time collection, and no disguise. Through photoplethysmography (PPG) sensors, electrocardiogram sensors, etc. on smart wearable devices (such as watches, bracelets, etc.), heart rate variability indicators are collected, and the activity index of sympathetic nerves and parasympathetic nerves in the user's autonomic nervous system is analyzed. Emotion state detection can also be combined with temperature information collected by temperature sensors such as body temperature / skin temperature.

[0106] Changes in emotions are accompanied by changes in sympathetic nerves and parasympathetic nerves in the autonomic nervous system. Generally, PPG sensors, electrocardiogram sensors, etc. are used to collect raw physiological data, and based on the data, the user's R-R interval (RRI) sequence within a period of time can be obtained, thereby calculating heart rate variability (HRV) related indicators (such as time domain features, frequency domain features), analyzing changes in sympathetic nerves and parasympathetic nerves in the autonomic nervous system. Through the RRI sequence, sympathetic sequences and parasympathetic sequences can be further calculated, and features can be counted, some indicators reflecting sympathetic nerve and parasympathetic nerve activity can be obtained, and based on these indicators, the coordination function of the time-varying autonomic nervous system can be analyzed. Further, based on HRV, sympathetic sequences, parasympathetic sequences, etc. features, a valence model can be established to realize emotion state detection and obtain emotion classification results.

[0107] 4. Emotion regulation

[0108] Emotion regulation refers to the process of managing and changing an individual's emotional state through certain strategies and mechanisms, so that the individual's emotions change in physiological activity, subjective experience, expression behavior, etc.

[0109] There can be various ways of emotion regulation. For example, emotion regulation can be performed by applying external stimuli, which can be divided into long-path and short-path, wherein the long-path stimulus information is processed by the cerebral cortex, which is beneficial for taking appropriate coping ways to control emotion, and the short-path stimulus information is not processed by the cerebral cortex and is faster, which can ensure a rapid response to fear stimulus.

[0110] The application scenarios of emotion regulation are everywhere. Short-term emotion regulation can improve the state of learning and work, and reduce traffic accidents caused by road rage, fatigue, drowsiness, etc. of drivers. Long-term intervention regulation can reduce depression disorders (such as prenatal depression and postpartum depression of women) and anxiety disorders (such as anxiety disorders of college students caused by long-term academic and employment pressure).

[0111] The pet image can be different. For example, the pet image can be a panda, a puppy, or a rabbit. It can be understood that the panda, the puppy, and the rabbit are different pet images. In a possible scenario, different users can use different pet images. Embodiments of the present application are described by taking the same pet image as an example.

[0112] Embodiment one: pet image generation and display

[0113] In the embodiments of the present application, the electronic device 100 can generate a pet image based on one or more parameters. The parameters include but are not limited to emotion detection results, environmental information of the user, motion health data, associated event information, and personal information of the user.

[0114] It can be understood that the electronic device 100 can generate a pet image according to the parameters. For example, one or more of the following can be determined according to the parameters: the expression of the pet image, the action of the pet image, the accessory of the pet image, and the background of the pet image.

[0115] For example, if the environmental information parameter of the user indicates that the weather of the user's location is rainy, the pet image can be configured with an umbrella and / or a rainy background. If the emotion detection result parameter indicates that the user's emotion is calm, the pet image can be configured with a calm expression. If the motion health data parameter indicates that the user is jogging, the pet image can be configured with a running action. If the associated event information parameter indicates that the user is eating, the pet image can be configured with an eating action. If the personal information parameter of the user indicates that the user's interest is singing, the pet image can be configured with a humming action.

[0116] In a possible implementation, the electronic device 100 can generate a pet image that can represent the user's emotion based on the emotion detection result.

[0117] In a possible implementation, the emotion detection result is obtained based on physiological data of the user. For example, when the emotion of the user is a positive emotion, the pet image can be a pet image with a smiley face; for another example, when the emotion of the user is a neutral emotion, the pet image can be a pet image with a relaxed / contented expression; for yet another example, when the emotion of the user is a negative emotion, the pet image can be a pet image with a slightly sad expression.

[0118] In another possible implementation, the electronic device 100 can obtain one or more of personalized information of the user, for example, environment information in which the user is located, motion health data, associated event information, personal information of the user, and generate a pet image capable of representing a personalized feature of the user based on the one or more of the personalized information of the user.

[0119] The environment information can include one or more of weather, ambient temperature, ambient humidity, ambient odor, ambient light, and the like. For example, the electronic device 100 can obtain temperature information, humidity information from a weather application. For another example, the electronic device 100 can obtain ambient odor based on an odor sensor, and the like, which are not limited in the embodiments of the present application.

[0120] The motion health data can include one or more of sleep data (for example, one or more of sleep-out data, sleep-in data, sleep duration, sleep quality, and the like), motion data (for example, one or more of motion type, activity calorie, average heart rate, motion time, average pace, average step frequency, average step length, step count, training performance, and the like), breathing training data (for example, one or more of breathing guidance data, training completion times, and the like), physiological data (for example, one or more of heart rate, blood oxygen, body temperature, blood pressure, blood sugar, physiological cycle, hydration level of skin, and the like), and the like.

[0121] The associated event information can include one or more of social activity data (for example, one or more of work, study, housework, dating, and the like), personality and hobby data (for example, one or more of fitness, travel, solitude, and the like), interpersonal relationship data (for example, one or more of partner, neighborhood, friend, family, and the like), life routine data (for example, one or more of listening to music, eating, drinking milk tea, playing games, driving, taking a car, exercising, and the like), and the like. In the embodiments of the present application, the associated event information can be obtained in various ways, for example, can be manually input by the user, or can be obtained through device data (for example, one or more of schedule data, application data), which are not limited in the embodiments of the present application.

[0122] The personal information of the user can include one or more of the user's age, gender, interests, user portrait, and the like. In one possible implementation, the personal information of the user can be obtained based on account information of the user.

[0123] In another possible implementation, the electronic device 100 can generate a pet image that can represent both the user's emotion and the user's personalized features based on one or more of the emotion detection result and the personalized information of the user.

[0124] For example, a pet image is generated based on an emotion detection result and environmental information of a user. For example, a pet's expression indicating a calm emotion is a polite smile, and a pet holding an umbrella indicates that the weather at the user's current location is raining. When the emotion detection result shows that the user's emotion is calm, and the environmental information of the user is weather information, and the weather at the user's current location is raining, a pet image shown in FIG. 1A can be generated, for example, which holds an umbrella in a calm emotion in a rainy day background. That is, the rainy weather can be represented by the pet image holding an umbrella and / or the pet image in a rainy day background shown in FIG. 1A; the user's calm emotion can be represented by the pet's expression being a calm expression shown in FIG. 1A. At this time, the pet image can be used to indicate that the user's emotion is calm, and the weather at the user's current location is raining.

[0125] For example, a pet image is generated based on an emotion detection result and exercise health data of a user. For example, a pet's head with hot air indicating that the user's body temperature is high, and a pet with a sad expression indicating that the user's emotion is sad. When the emotion detection result shows that the user's emotion is sad, and the user's exercise health data is body temperature data, and the body temperature data shows that the user's body temperature is higher than the normal body temperature value, a pet image shown in FIG. 1B can be generated, for example, which is feverish and in a sad emotion. That is, the pet image with hot air on the head shown in FIG. 1B can be used to represent that the user is feverish or has a high body temperature, but is not limited thereto, and can be represented in other forms (e.g., the pet image with red cheeks, etc.); the user's sad emotion can be represented by the pet's expression being a sad expression shown in FIG. 1B. At this time, the pet image is used to indicate that the user's body temperature is high or is feverish, and the user is in a sad emotion.

[0126] Exemplarily, taking the generation of the pet image in combination with the emotion detection result and the associated event information as an example. Taking the pet holding the tableware as an example to indicate that the user is eating, and taking the happy expression of the pet as an example to indicate that the emotion of the user is happy. When the emotion detection result shows that the emotion of the user is happy and the associated event is eating, a pet image of eating and being in a happy emotion as exemplarily shown in FIG. 1C can be generated. That is, eating can be represented by taking the pet image holding the tableware as shown in FIG. 1C as an example; the happy emotion of the user can be represented by taking the happy expression of the pet as shown in FIG. 1C as an example. At this time, the pet image is used to indicate that the user is eating and the user is in a happy emotion.

[0127] The manner in which the electronic device 100 obtains the parameters can include one or more of the following: obtaining from the electronic device 100, obtaining from other devices. Exemplarily, the method of obtaining the parameters from the electronic device 100 can include one or more of the following: obtaining through the sensor of the electronic device 100, obtaining through the application program of the electronic device 100.

[0128] The application program of the electronic device 100 can include but is not limited to: sports health, innovation research, weather, calendar schedule, map. The embodiments of the present application are not limited.

[0129] Exemplarily, the electronic device 100 can obtain the motion state of the user according to sports health, obtain the cardiovascular risk of the user according to innovation research, obtain the temperature of the location where the user is located according to weather, and obtain the location of the user according to the historical navigation information of the map.

[0130] The sensor of the electronic device 100 can include one or more of the following: odor sensor, light sensor, hydration sensor, pressure sensor, gyroscope sensor, photoplethysmography (PPG) sensor, magnetic sensor, acceleration sensor, distance sensor, hydration sensor, fingerprint sensor, temperature sensor, touch sensor, ambient light sensor, bone conduction sensor. The embodiments of the present application are not limited.

[0131] Exemplarily, the electronic device 100 can detect the environmental odor according to the odor sensor, detect the ambient light according to the light sensor, detect the sweat and / or hydration degree of the skin of the user according to the hydration sensor, detect the heart rate of the user according to the PPG, detect the step count of the user according to the acceleration sensor, and detect the ambient temperature and / or body temperature of the user according to the temperature sensor.

[0132] The following will be introduced respectively by taking the generation of the pet image based on the parameters obtained by the odor sensor, the light sensor, and the hydration sensor as an example:

[0133] 1. Odor sensor

[0134] In a possible implementation, the pet image can be determined according to the environmental smell information detected by the smell sensor. That is, the pet image can be used to indicate the environmental smell information. The environmental smell information can include that the environment has a fragrance, the environment has a stench, and the environment has neither a fragrance nor a stench.

[0135] It can be understood that the pet image corresponding to different environmental smell information can be different.

[0136] For example, the pet image of the pet taking a deep breath indicates that the environment has a fragrance, the pet image of the pet covering the nose indicates that the environment has a stench, and the pet image of the pet sniffing the nose indicates that the environment has neither a fragrance nor a stench.

[0137] For example, referring to FIG. 1D, the electronic device 100 can display the pet image of taking a deep breath when smelling a fragrance as shown in FIG. 1D in a case where it is detected by the smell sensor that the user is in an environment with a fragrance. For example, continuing to refer to FIG. 1D, the electronic device 100 can display the pet image of covering the nose when smelling a stench as shown in FIG. 1D in a case where it is detected that the user is in an environment with a stench.

[0138] In another possible implementation, the pet image can be determined according to the environmental smell information and the user emotion. That is, the pet image can be used to indicate the user emotion and the environmental smell information. For example, the pet with a happy expression can be used to indicate that the user emotion is a positive emotion, and the pet taking a deep breath can be used to indicate that the environment has a fragrance. Therefore, the pet image of taking a deep breath with a happy expression can be used to indicate that the current user emotion is a positive emotion and the environment has a fragrance.

[0139] In some examples, in a case where the user is in the same environment smell, the pet image can also be different if the user emotion is different.

[0140] For example, in a case where it is detected that the environment has a fragrance, if the user emotion is a positive emotion, the pet image described above can take a deep breath while turning around; if the user emotion is a neutral emotion, the pet image described above can take a deep breath while lying down; and if the user emotion is a negative emotion, the pet image described above can take a deep breath while lying on the stomach. The “turning around”, “lying down”, and “lying on the stomach” are respectively used to indicate that the user emotion is a positive emotion, a neutral emotion, and a negative emotion.

[0141] 2, light sensor

[0142] In a possible implementation, the pet image can be determined according to the environmental light information detected by the light sensor. That is, the environment background in which the pet image is located can be used to indicate the environmental light information.

[0143] The ambient light information can be used to determine the brightness of the environment background. The bright environment background can be used to indicate that the intensity of the ambient light is high. The dim environment background can be used to indicate that the intensity of the ambient light is low.

[0144] Referring to FIG. 1E, the electronic device 100 can display the pet image in a bright background as exemplarily shown in FIG. 1E in the case where it is detected that the user is in a bright light environment.

[0145] Referring to FIG. 1E, the electronic device 100 can display the pet image in a dim background as exemplarily shown in FIG. 1E in the case where it is detected that the user is in a dim light environment.

[0146] In another possible implementation, the pet image can be determined according to the emotion of the user, and the environment background in which the pet image is located can be determined according to the ambient light information. For example, the happy expression of the pet can be used to indicate that the emotion of the user is a positive emotion, and the bright environment background can be used to indicate that the intensity of the ambient light is high. Therefore, the pet image with the happy expression and in the bright background can be used to indicate that the current emotion of the user is a positive emotion and the intensity of the ambient light is high.

[0147] In some examples, in the case where the user is in the same ambient light, the pet image can also be different if the emotion of the user is different. Details are not described herein again.

[0148] 3. Hydration sensor

[0149] In a possible implementation, the pet image can be determined according to the sweating condition of the user detected by the hydration sensor. That is, the pet image can be used to indicate the sweating condition of the user.

[0150] Referring to FIG. 1F, the electronic device 100 can display the pet image that is sweating as exemplarily shown in FIG. 1F in the case where it is detected that the skin of the arm of the user wearing the electronic device 100 has sweat.

[0151] In a possible implementation, the pet image can be determined according to the emotion of the user and the sweating condition of the user. That is, the pet image can be used to indicate the emotion of the user and the sweating condition of the user. For example, the happy expression of the pet can be used to indicate that the emotion of the user is a positive emotion, and the sweating can be used to indicate that the user is sweating. Therefore, the pet image with the happy expression and the sweating can be used to indicate that the current emotion of the user is a positive emotion and the user is sweating.

[0152] In some examples, in the case where the user is in the same sweating condition, the pet image can also be different if the emotion of the user is different. Details are not described herein again.

[0153] In some examples, the background of the picture where the pet image is located can be a preset background, or a background generated based on one or more parameters, which can include but are not limited to weather, location, time. For example, when the pet image needs to be displayed, it is detected that the current weather of the location where the user is located is rainy, then the background of the picture where the pet image is located can be a background of continuous rain. For another example, when the pet image needs to be displayed, it is detected that the current location where the user is located is home, then the background of the picture where the pet image is located can be a background of a bedroom / living room at home, and the like.

[0154] In the scenario of generating the pet image according to multiple parameters, if one of the parameters changes, the pet image can use the same or different way to represent other parameters.

[0155] In a possible implementation, in the scenario of generating the pet image according to multiple parameters, if one of the parameters changes, the pet image uses the same way to represent other parameters. That is, the pet image can be superimposed with image details used to represent different parameters. The image details can be a part of the pet image.

[0156] In a possible implementation, in the scenario of generating the pet image according to multiple parameters, if one of the parameters changes, the pet image uses different ways to represent other parameters. For example, the image details used to indicate the parameters can be changed according to the association between the multiple parameters used.

[0157] Taking the determination of the pet image according to the environmental odor information and the user emotion as an example for description.

[0158] For example, in the case of detecting that the environment has a fragrance, "turning around", "lying down", and "lying on the stomach" can be used to indicate that the user's emotion is a positive emotion, a neutral emotion, and a negative emotion, respectively.

[0159] For example, in the case of detecting that the environment has a stench, if the user's emotion is a positive emotion, the pet image can be smiling and covering the nose; if the user's emotion is a neutral emotion, the pet image can be closing the eyes and covering the nose; and if the user's emotion is a negative emotion, the pet image can be covering the nose with one hand and covering the chest with the other hand. That is, "smiling", "closing the eyes", and "covering the chest with one hand" are used to indicate that the user's emotion is a positive emotion, a neutral emotion, and a negative emotion, respectively.

[0160] That is, even if the user is in the same emotion, the pet image can use different ways to indicate the user's emotion if the environmental odor information is different.

[0161] In the embodiments of the present application, after the pet image is generated, the electronic device 100 can display the pet image and support the user to interact with the pet image (for example, click and other interaction operations).

[0162] For example, the electronic device 100 can display the pet image when detecting that a preset condition is triggered. According to different parameters for generating the pet image, and / or different preset conditions, the state of the pet image can be different. That is, the state of the pet image can be determined according to one or more parameters, and / or the preset condition for triggering the display of the virtual image. The state of the pet image can be used to indicate the parameters for generating the virtual image, and / or the preset condition for triggering the display of the virtual image.

[0163] In a possible implementation, the state of the pet image can be associated with the preset condition. That is, under different preset conditions, the state of the displayed pet image is different. Further, for different states of the pet image, if the user performs the same interaction operation, the state of the pet image after the interaction can also be different. The interaction operation can include but is not limited to finger click, finger slide, finger long press, double finger pinch / separation, knuckle tapping.

[0164] The above-mentioned preset condition can include one or more of the following: a specific user action, a specific event, a specific wake-up word, detection of a notification message.

[0165] The above-mentioned specific event can include one or more of the following: a specific scene (for example, a sports scene, a sleep scene, a dining scene, an emotional scene, etc.), a specific time (for example, a specific time point, a specific time period), wherein the specific scene can include the state of the user in the specific scene.

[0166] Referring to FIG. 2A, FIG. 2A exemplarily shows a schematic diagram of triggering the display of the pet image under different preset conditions. The following will introduce how the electronic device 100 displays the pet image when different preset conditions are triggered.

[0167] 1. Specific user action

[0168] In the embodiments of the present application, the electronic device 100 can support the user to trigger the electronic device 100 to display the pet image by inputting a specific user action to the electronic device 100.

[0169] The above-mentioned specific user action can be pre-set by the system of the electronic device 100, or can be set by the user, and the embodiments of the present application do not limit this.

[0170] The specific user action can include, but is not limited to, an action of shaking an arm of the user wearing the electronic device 100, a tapping action or a sliding action of the user on the screen, a hand-washing action of the user, or an action of the user pressing a crown.

[0171] Referring to FIG. 2B, the user can wear the electronic device 100 on an arm of the user (for example, the left arm shown in FIG. 2B), and after wearing the electronic device 100, the user can shake the arm. After the electronic device 100 detects the action of the user shaking the arm (for example, shaking the arm for two or three times), the electronic device 100 can display the pet image.

[0172] In the embodiments of the present application, in order to make the pet image more matched with the action of the user shaking the arm, the electronic device 100 can present the pet image with the effect of shaking the head and swinging the brain as shown in FIG. 2B. The effect of shaking the head and swinging the brain can represent that the state of the current pet image is a state of shaking the head and swinging the brain.

[0173] It is easy to understand that the specific user action can be detected by a sensor on the electronic device 100. For example, in the case that the specific user action is the action of the user shaking the arm wearing the electronic device 100, the electronic device 100 can detect the action through an inertial measurement unit (IMU). For another example, in the case that the specific user action is the tapping action or the sliding action of the user on the screen, the electronic device 100 can detect the action through a touch sensor. For another example, in the case that the specific user action is the hand-washing action of the user, the electronic device 100 can detect the action through a hydration sensor, and so on.

[0174] In some examples, the electronic device 100 can also detect the specific user action through other hardware, for example, the action of the user pressing the crown, so as to trigger the electronic device 100 to display the pet image through the action.

[0175] 2. Specific scene

[0176] In the embodiments of the present application, the electronic device 100 can display the pet image associated with a specific scene when detecting that the user is in the specific scene.

[0177] The specific scene can be pre-set by the system of the electronic device 100, or can be set by the user, and the embodiments of the present application do not limit this.

[0178] In the embodiments of the present application, the electronic device 100 can identify the scene in one or more of the following ways: sensor identification, application information, preset mode. For example, in the motion scene identification, whether the user is in motion can be identified by an acceleration sensor, a gyroscope sensor, etc., or whether the user is in motion can be identified according to motion data in a motion health application, or whether the user is in motion can be identified according to a preset period of time. For another example, in the sleep scene identification, whether the user is sleeping can be identified according to sleep data in a motion health application, or whether the user is sleeping can be identified according to a preset period of time. For yet another example, in the dining scene identification, whether the user is dining can be identified according to location data in a navigation application, or whether the user is dining can be identified according to a preset period of time.

[0179] Further, in some possible implementations, the electronic device 100 can determine the pet image according to the data collected by the sensor. It can be understood that the data collected by the sensor is associated with a specific scene in which the user is located. That is, after determining the specific scene in which the user is located, the pet image can be determined according to the data collected by the sensor and associated with the specific scene.

[0180] The following are four specific scenes:

[0181] Scene (1), motion scene

[0182] In the embodiments of the present application, the electronic device 100 can obtain the motion state of the user (for example, the state of pre-motion preparation, in-motion, post-motion, etc.), so that the pet image can be further displayed based on the motion state. It can be understood that the pet image corresponding to different motion states can be different.

[0183] In the embodiments of the present application, the electronic device 100 can identify the motion state in one or more ways, which can include but are not limited to: sensor identification, application information.

[0184] For example, the sensor can include a PPG sensor, which can measure the heart rate of the user, evaluate the motion intensity of the user according to the heart rate of the user, and thus determine the motion state of the user. For example, if the heart rate of the user is lower than a certain threshold, it can be considered that the user is in the pre-motion preparation state, the heart rate of the user is higher than a certain threshold, it can be considered that the user is in the in-motion state, and the heart rate of the user is first higher than a certain threshold and then lower than a certain threshold within a period of time, it can be considered that the user is in the post-motion state.

[0185] For example, the application information can include that the user has started a pre-motion preparation corresponding exercise course, so that it is considered that the user is in the pre-motion preparation state. For example, the pre-motion preparation corresponding exercise course can be "warm-up before running".

[0186] In some possible implementation, the electronic device 100 can determine the pet image according to the above-mentioned motion state of the user. For example, when the user is in the state of pre-exercise warm-up, the pet image of being in warm-up can be displayed; when the user is in the state of exercising, the pet image of being in exercise can be displayed; when the user is in the state of post-exercise, the pet image of being in relaxation can be displayed. For example, referring to FIG. 3A, taking the state of the user being in post-exercise as an example, it can be understood that, generally, the user will sweat when in post-exercise, and thus the pet image of being in sweat or the pet image of being in relaxation can be used to indicate that the user is in the state of post-exercise. When the electronic device 100 determines that the user is currently in the state of post-exercise, the pet image of being in sweat shown in FIG. 3A or the pet image of being in relaxation can be displayed.

[0187] In some possible implementation, the electronic device 100 can determine the pet image according to the data collected by the sensor. It can be understood that the data collected by the sensor is associated with the special scene in which the user is in. For example, the electronic device 100 can detect the amount of sweat of the user through the sensor (for example, a hydration sensor), and display different pet images based on different amounts of sweat of the user. For example, when it is detected that the amount of sweat of the user is lower than a certain preset threshold, that is, the amount of sweat of the user is less, the electronic device 100 can display the pet image of being in a small amount of sweat; for another example, when it is detected that the amount of sweat of the user is higher than a certain preset threshold, that is, the amount of sweat of the user is more, the electronic device 100 can display the pet image of being in heavy sweat and wiping sweat.

[0188] In some possible implementation, the electronic device 100 can determine the pet image according to the above-mentioned motion state of the user and the data collected by the sensor. For example, when the motion state is in exercise and the amount of sweat of the user collected by the hydration sensor is higher than a certain preset threshold, the electronic device 100 can display the pet image of being in exercise and heavy sweat.

[0189] Scene (2), sleep scene

[0190] In the embodiment of the present application, the electronic device 100 can acquire the sleep state (for example, the state of falling asleep, being in sleep, waking up, etc.) of the user, so as to display the pet image based on the sleep state. It can be understood that the pet image corresponding to different sleep states can be different. For example, referring to FIG. 3A, taking the state of the user being in wake-up (that is, the state of the user just waking up) as an example, it can be understood that, generally, the user will have sleepy eyes when just waking up, and thus the electronic device 100 can display the pet image of having sleepy eyes shown in FIG. 3A when determining that the user is currently in the state of wake-up.

[0191] It should be noted that in the embodiments of the present application, the electronic device 100 can determine the sleep state of the user according to one or more of the following: data collected by the sensor, application information, alarm information, and a pre-set sleep period. The embodiments of the present application do not limit the method of determining the sleep state of the user. For example, the sleep state of the user can be obtained by collecting physiological data of the user through the sensor and combining a relevant algorithm (such as a sleep detection algorithm, etc.); for another example, the sleep state of the user can be determined through application information (such as information in an alarm application), for example, the user sets a nap end alarm at a certain time point, and when the current time point reaches the set time point, it can be determined that the user is in a nap wake-up state; and the like, which are not limited in the embodiments of the present application.

[0192] Scenario (3), meal scenario

[0193] In the embodiments of the present application, the electronic device 100 can obtain the meal state of the user (such as a pre-meal state, an in-meal state, a post-meal state, etc.), so that the pet image can be further displayed based on the meal state. It can be understood that the pet image corresponding to different meal states can be different.

[0194] For example, continuing to refer to FIG. 3A, taking the case that the user is in a “post-meal” state as an example, it is easy to understand that in general, the user will be satisfied after finishing a meal, and therefore, the electronic device 100 can display the satisfied pet image shown in FIG. 3A when it is determined that the user is currently in a post-meal state.

[0195] It should be noted that in the embodiments of the present application, the electronic device 100 can determine the meal state of the user according to one or more of the following: data collected by the sensor, application information, location information, and a pre-set meal period. The embodiments of the present application do not limit the method of determining the meal state of the user. For example, the meal state of the user can be obtained by collecting physiological data (such as blood glucose physiological data) of the user through the sensor and combining a relevant algorithm, for example, the electronic device 100 can collect blood glucose data of the user within a period of time, and analyze the collected blood glucose data through a relevant algorithm to obtain the trend of the blood glucose of the user within the period of time, so as to determine the current meal state of the user; for another example, the meal state of the user can be determined by obtaining the location information of the user through a navigation application, for example, the electronic device 100 can determine that the user is currently at a certain restaurant based on the location information of the user, and then the electronic device 100 can determine that the user is currently in a meal state; the electronic device 100 can also determine that the user has left the restaurant based on the location information of the user, and then the electronic device 100 can determine that the user is currently in a post-meal state; and the like, which are not limited in the embodiments of the present application.

[0196] In some examples, the electronic device 100 can also determine the eating condition of the user based on the blood glucose data of the user, and generate and display a corresponding pet image based on the eating condition, where the eating condition can refer to the type of food (e.g., high-calorie food, low-calorie food) eaten by the user. For example, the electronic device 100 detects that the blood glucose rise rate of the user is relatively fast or the blood glucose rise amplitude is relatively large, and it can be considered that the food eaten by the user is likely to be high-calorie food, in which case the electronic device 100 can generate and display a pet image that is eating high-calorie food; for another example, the electronic device 100 detects that the blood glucose rise rate of the user is relatively slow or the blood glucose rise amplitude is relatively small, and it can be considered that the food eaten by the user is likely to be low-calorie food, in which case the electronic device 100 can generate and display a pet image that is eating low-calorie food.

[0197] Scenario (4), emotional scenario

[0198] In the embodiments of the present application, the electronic device 100 can obtain the emotional state (e.g., positive emotion, neutral emotion, negative emotion, etc.) of the user within a preset time, so that the pet image can be further displayed based on the emotional state.

[0199] In the embodiments of the present application, the emotional state of the user within a preset time can be obtained according to one or more of the following methods: a plurality of emotional detection results within a preset time, behavior information of the user within a preset time, and the like. The embodiments of the present application do not limit this.

[0200] In a possible implementation, the emotional state can be determined according to a plurality of emotional detection results of the user within a preset time. The plurality of emotional detection results can be the same, partially the same, or all different. Exemplarily, each of the plurality of emotional detection results can be a positive emotion, a neutral emotion, or a negative emotion; that is, the type of emotional detection result can include a positive emotion, a neutral emotion, and a negative emotion. Correspondingly, the emotional state can be a positive emotion, a neutral emotion, or a negative emotion. In the present application, the detection result of the emotion or the emotional state can also include joy, calmness, and unhappiness. This will not be described again in other places in the present application.

[0201] In a possible implementation, if the number of emotional detection results of a first type among the plurality of emotional detection results of the user within a preset time threshold exceeds a preset value, the emotional state is of the first type. The first type is one of a positive emotion, a neutral emotion, and a negative emotion.

[0202] For example, with reference to FIG. 3A, it is assumed that the preset time is 7 days, the preset threshold is 4 days, and the user is in the "negative emotion" mood detection result for 5 days within the preset time. In this case, the user's mood state is negative emotion. It is easy to understand that, in general, when the user's mood is poor for several consecutive days, the user may have physical discomfort, negative and depressed, bedridden, and other adverse conditions. Therefore, when the electronic device 100 determines that the user is in a negative mood state for several consecutive days, the electronic device 100 can display the pet image shown in FIG. 3A, which is lying on the ground.

[0203] In another possible embodiment, the mood state of the user can be determined according to the behavior information of the user within the preset time. The behavior information of the user indicates that the user is in a certain mood state. The behavior information of the user can include the use information of the user on the electronic device 100, the location information or the trajectory information of the user. For example, according to the location information of the user, it is determined that the user goes to a place for emotional release for several consecutive days, and it is determined that the mood state of the user is negative emotion. The use information of the user on the electronic device 100 can include the browsing record of the user, the chat record of the user, and the like, which are not limited in the present application. For example, if the browsing record of the user includes records such as "depression", "relieve stress", "collapse", and the like, which indicate negative emotion, it can be determined that the mood state of the user is negative emotion.

[0204] 3. Specific time

[0205] In the embodiment of the present application, the specific time described above can refer to a specific time point, or can refer to a specific time period. The electronic device 100 can display the pet image associated with the time (for example, display the pet image with the current time background) when it is detected that the current time point reaches the specific time point, or when it is detected that the current time point is within the specific time period.

[0206] In some examples, when it is detected that the current time point is within the specific time period, the electronic device 100 can display the pet image after detecting a specific user operation, for example, detecting a wrist lifting operation of the user, and then displaying the pet image after the electronic device 100 is turned on.

[0207] The specific time described above can be pre-set by the system of the electronic device 100, or can be set by the user, which is not limited in the embodiment of the present application.

[0208] The following are four specific time points:

[0209] 7:00 am:

[0210] For example, referring to FIG. 3B, it can be easily understood that, generally, 7 o'clock in the morning is in the sunrise period, and thus, the electronic device 100 can display the pet image in the background of the rising sun as exemplarily shown in FIG. 3B when detecting that the current time reaches 7 o'clock in the morning.

[0211] 12 o'clock in the noon:

[0212] For example, continuing to refer to FIG. 3B, it can be easily understood that 12 o'clock in the noon is in the noon, and thus, the electronic device 100 can display the pet image in the background of the noon sun as exemplarily shown in FIG. 3B when detecting that the current time reaches 12 o'clock in the noon.

[0213] 6 o'clock in the afternoon:

[0214] For example, continuing to refer to FIG. 3B, it can be easily understood that, generally, 6 o'clock in the afternoon is in the sunset period, and thus, the electronic device 100 can display the pet image in the background of the setting sun as exemplarily shown in FIG. 3B when detecting that the current time reaches 6 o'clock in the afternoon.

[0215] 10 o'clock in the evening:

[0216] For example, continuing to refer to FIG. 3B, it can be easily understood that 10 o'clock in the evening is in the night, and thus, the electronic device 100 can display the pet image in the background of the moonlight and stars as exemplarily shown in FIG. 3B when detecting that the current time reaches 10 o'clock in the evening.

[0217] It can be understood that the above examples are described by taking one time point corresponding to one background pet image, and in some examples, one time period can correspond to one background pet image, for example, the time period from 5 o'clock in the morning to 8 o'clock in the morning is the sunrise period, and thus, the electronic device 100 can display the pet image in the background of the rising sun when detecting that the current time point is in the above sunrise period.

[0218] 4. Specific wake-up word

[0219] In the embodiment of the present application, the electronic device 100 can support the user triggering the electronic device 100 to display the pet image by inputting a specific wake-up word to the electronic device.

[0220] The specific wake-up word can be a fixed wake-up word pre-set by the system of the electronic device 100, or a custom wake-up word (or preset wake-up word) set by the user, and the embodiment of the present application does not limit this.

[0221] Exemplarily, referring to FIG. 4, the user can input a specific wake-up word (for example, "hi, my little pet") to the electronic device 100 in the form of voice, and after the electronic device 100 detects the specific wake-up word input by the user, the electronic device 100 can wake up the pet and display the pet image exemplarily shown in FIG. 4.

[0222] In the embodiment of the present application, after displaying the pet image, the electronic device 100 can also support the user to perform an interactive operation (for example, a click or the like) on the pet image, and the interactive operation can trigger the pet to perform a specific behavior. It can be understood that the process of the user performing the interactive operation on the pet image will be described in detail in subsequent embodiments, which is not expanded here.

[0223] In a possible implementation, the pet image can be different with different preset conditions for triggering the display of the pet image, and the behavior (which can also be referred to as an interactive result) of the pet after the interactive operation can also be different with different preset conditions.

[0224] In the embodiment of the present application, the electronic device 100 can also display the basic information (for example, time information or the like) while displaying the pet image, for example, the main body of the display screen can be the above-mentioned pet image, and the basic information can be displayed on a certain part of the screen (for example, the upper left corner of the screen).

[0225] It should be noted that after triggering the electronic device 100 to display the pet image, the electronic device 100 can always display the pet image, or the electronic device 100 can cancel the display of the pet image when detecting that a certain preset condition is met, and the embodiment of the present application does not limit the above-mentioned preset condition, for example, the preset condition can be a preset time length, wherein the preset time length can be a preset display time length of the pet image, and the electronic device 100 can cancel the display of the pet image when detecting that the display time of the pet reaches the preset time length.

[0226] In the embodiment of the present application, the pet image can be displayed on the local device, or can be displayed on a remote device (for example, a full-scene device of the user of the local device or a device of another person). The full-scene device of the user of the local device can refer to a device logged in to the same account as the local device.

[0227] In a possible implementation, after generating the pet image, the pet image can be saved on the local device and can be displayed on the local device.

[0228] In another possible implementation, after the pet image is generated, the pet image can be uploaded to a server (or referred to as a data platform), and the local device and the remote device can both download and display the pet image. In some examples, the remote device can download and display the pet image only when the user of the local device grants the remote device the permission to display the pet image.

[0229] In another possible implementation, the local device can also send the pet image to the remote device, so that the pet image can be displayed on the remote device.

[0230] It can be understood that the preset condition for triggering the electronic device 100 to display the pet image is described above by taking the specific user action, the specific scene, the specific time, and the specific wake-up word as examples, which should not be construed as a limitation to the present application. In some examples, the preset condition for triggering the electronic device 100 to display the pet image can also be other conditions.

[0231] For example, the electronic device 100 can trigger the electronic device 100 to display the pet image when the electronic device 100 needs to output a notification message of some application (a system application or a third-party application). In the embodiments of the present application, the electronic device 100 can use the pet image to indicate (or present) a monotonous text notification message, so as to achieve the purpose of more effectively reminding the user.

[0232] First, the classification of the notification message is introduced below.

[0233] Based on the content of the message and the sending scene of the message, the notification message can be divided into two categories: service and communication type notification message, and information marketing type notification message.

[0234] The service and communication type notification message can be further divided into social communication type notification message and service reminder type notification message. The social communication type notification message can be a chat message or a call information between users, and the service reminder type notification message can be an important notification reminder transmitted by an application to a user in time through a notification center, and the user usually has an expectation for receiving this type of message. The message type description and the scene description of the social communication type notification message can be referred to Table 1 below, and the message type description and the scene description of the service reminder type notification message can be referred to Table 2 below. It should be noted that the message type of the social communication type notification message can include but is not limited to the message type shown in Table 1 below, and the message type of the service reminder type notification message can include but is not limited to the message type shown in Table 2 below.

[0235] The information marketing type notification message can be information such as activity information, content recommendation, information, and the like sent by an operator to a user. The information marketing type notification message can also be divided into an information type notification message and a marketing type notification message. The message type description and scenario description of the information type notification message can be found in Table 3 below, and the message type description and scenario description of the marketing type notification message can be found in Table 4 below. It should be noted that the message type of the information type notification message can include but is not limited to the message type shown in Table 3 below, and the message type of the marketing type notification message can include but is not limited to the message type shown in Table 4 below.

[0236] Social communication type notification message

[0237] Table 1

[0238] Service reminder type notification message

[0239] Table 2

[0240] Information type notification message

[0241] Table 3

[0242] Marketing type notification message

[0243] Table 4

[0244] In the embodiments of the present application, the electronic device 100 can display a pet image when it needs to output a notification message of certain application. It can be understood that in the prior art, notification messages are mostly presented in the form of text notification messages. In the embodiments of the present application, a pet image indicating a notification message can be displayed. For example, for an alarm clock type notification message, a pet image can be used to prompt that a specific time has arrived.

[0245] According to the foregoing, the pet image can be generated based on one or more parameters, which can be referred to in FIGS. 1A-1F, 2B, 3A-3B, 4 and related descriptions, which will not be repeated here. It can be understood that the pet image generated based on one or more parameters can be used to indicate information corresponding to the one or more parameters. For example, a pet image generated based on a temperature parameter and an emotion parameter can be used to indicate that the user has a high body temperature and is in a negative emotion when the temperature parameter shows that the user has a high body temperature and the emotion parameter shows that the user is in a negative emotion.

[0246] In the embodiments of the present application, the parameters used to generate the pet image can also include a notification message. That is, the one or more parameters described above can also include a notification message. The information indicated by the notification message can include one or more of the following: the type of the notification message, the content of the notification message, the number of the notification message, and the like. The embodiments of the present application are not limited in this regard. That is, the pet image can be used to indicate the notification message. Illustratively, for a notification message of the health type, such as a notification message used to indicate exercise data, the state of the pet image can be the state of the pet image in the exercise scene shown in FIG. 3A described above. This will be described in detail below in conjunction with several specific application scenarios, which will not be expanded here.

[0247] Optionally, the pet image can be used to indicate the content of the notification message, or the pet image can include text or images or dynamic effects used to indicate the content of the notification message. Illustratively, if the content of the notification message is “the meeting will start soon, and the meeting room is A01”, the pet image can include the pet walking towards the meeting room A01.

[0248] In the embodiments of the present application, after displaying the pet image, the electronic device 100 can also support the user to perform an interactive operation with the pet image, thereby triggering the pet to appear a specific behavior, improving the interest and interactivity.

[0249] It can be understood that the electronic device 100 can generate different pet images. For different pet images, the result after the interactive operation can be the same or different. The result after the interactive operation can include one or more of the following: re-prompting the user through the pet image about the notification message, pulling up related functions (such as playing a video / animation, playing audio, running an artificial intelligence chat, running a small game, and the like). Among them, the above re-prompting the user through the pet image about the notification message can include but is not limited to: indicating the content of the notification message through the state of the pet image, indicating that the task is in progress, indicating that the audio / video call has been answered or has been rejected.

[0250] The following are three typical application scenarios:

[0251] Application scenario 1: alarm clock type application (such as a clock application)

[0252] In a possible implementation, for an alarm clock type notification message, a pet image can be used to indicate that a specific time point has arrived. In some examples, the pet image is used to prompt that a specific time point for the user to perform a certain task has arrived.

[0253] For example, assuming that the user sets a sleep alarm reminder at a certain time point on an alarm application, when the time point arrives, the alarm application can generate a sleep reminder event, and after detecting the sleep reminder event, the electronic device 100 can generate and display a pet image capable of prompting the user to sleep, such as the pet image shown in FIG. 5A, which is digging into a burrow, by presenting the pet image, a monotonous sleep notification message can be indicated, and the user can be more vividly and effectively prompted to sleep.

[0254] Optionally, the one or more parameters used to generate the pet image can include an emotion detection result, that is, the pet image can also reflect the current emotion of the user. For example, in a case where it is detected that the current emotion of the user is a positive emotion, the pet image can be a happy pet image digging into a burrow; for another example, in a case where it is detected that the current emotion of the user is a neutral emotion, the pet image can be a calm pet image digging into a burrow; for another example, in a case where it is detected that the current emotion of the user is a negative emotion, the pet image can be a slightly sad pet image digging into a burrow; and the like.

[0255] It can be understood that for different pet images displayed, based on the same interaction operation of the user, the displayed interaction result can be the same or different. Taking the pet image displayed by the electronic device 100 as an example, which includes a happy pet image digging into a burrow, or a calm pet image digging into a burrow, or a slightly sad pet image digging into a burrow.

[0256] In a possible implementation, for different pet images displayed, based on the same interaction operation of the user, the displayed interaction result can be the same. Regardless of which pet image is displayed by the electronic device 100, after the electronic device 100 displays the pet image, the same interaction operation of the user can be detected (for example, the interaction operation is a click operation on the pet image), and in response to the interaction operation, the electronic device 100 can display the pet image in a sleep state as shown in FIG. 5B, so that the user can be guided into a sleep state again after being prompted to sleep, so as to achieve a better sleep prompting effect.

[0257] In another possible implementation, for different pet images displayed, different interaction results are displayed based on the same interaction operation of the user. In some examples, after detecting the same interaction operation of the user (for example, the interaction operation is all a click operation on the pet image described above), the electronic device 100 can determine which feedback to give the user (for example, which state of the pet image to display) based on the current pet image. It can be understood that the pet image can be used to indicate the mood of the user. For example, when the pet image indicates that the current mood of the user is a positive mood or a neutral mood, the electronic device 100 can display the pet image in the sleep state as shown in the example of FIG. 5B; for another example, in the case of detecting that the current mood of the user is a negative mood, the electronic device 100 can display a pet image that recommends a mood regulation strategy to the user, or does not display a pet image, but recommends a mood regulation strategy to the user in the form of text, voice, etc., to prompt the user to regulate the mood, so that the user can better and faster enter the sleep state. The mood regulation strategy described above can include but is not limited to: watching a video / animation, listening to audio, talking and confiding, mindfulness practice, playing a small game. In some examples, the mood regulation strategy described above can be a mood regulation strategy suitable for execution in a scene in which the user is located, which is determined by the electronic device 100.

[0258] In a possible implementation, when the pet image indicates that the current mood of the user is a negative mood, the electronic device 100 can display the user interface as shown in the example of FIG. 5C, which can include an option for triggering the regulation of the mood of the user (for example, the heart-shaped option shown in FIG. 5C), and the user can click the option to trigger the electronic device 100 to execute a mood regulation strategy (for example, play a video / animation, play audio, run an artificial intelligence chat, run a small game, etc.).

[0259] Application scenario 2: schedule application (for example, calendar application)

[0260] In a possible implementation, for the schedule application, a pet image can be used to prompt the scheduling (for example, meeting scheduling, course scheduling, etc.).

[0261] For example, assuming that the user sets a meeting scheduling reminder at a certain time point on the schedule application, when the time point arrives or is about to arrive, the schedule application can generate a meeting scheduling reminder event, and after detecting the meeting scheduling reminder event, the electronic device 100 can generate and display a pet image that can be used to prompt the user to have a meeting, for example, the pet image as shown in the example of FIG. 5D that is holding a megaphone and shouting at the user to have a meeting. By presenting the pet image, a monotonous meeting schedule notification message can be indicated, and the user can be more vividly and effectively prompted to have a meeting.

[0262] Optionally, the one or more parameters used to generate the pet image can include the emotion detection result, that is, the pet image can also reflect the current emotion of the user. For example, in the case where it is detected that the current emotion of the user is a positive emotion, the pet image can be a pet image holding a megaphone and shouting to the user to have a meeting happily; for another example, in the case where it is detected that the current emotion of the user is a neutral emotion, the pet image can be a pet image holding a megaphone and shouting to the user to have a meeting calmly; for another example, in the case where it is detected that the current emotion of the user is a negative emotion, the pet image can be a pet image holding a megaphone and shouting to the user to have a meeting with a slightly sad look, and the like.

[0263] It can be understood that, for different pet images displayed, the displayed interaction result can be the same or different based on the same interaction operation of the user. Taking the pet image displayed by the electronic device 100 as an example, the pet image includes a pet image holding a megaphone and shouting to the user to have a meeting happily, or a pet image holding a megaphone and shouting to the user to have a meeting calmly, or a pet image holding a megaphone and shouting to the user to have a meeting with a slightly sad look. In a possible implementation, for different pet images displayed, the displayed interaction result can be the same based on the same interaction operation of the user. Regardless of which pet image is displayed by the electronic device 100, after the electronic device 100 displays the pet image, the same interaction operation of the user can be detected (for example, the interaction operation is all a click operation on the pet image), and in response to the interaction operation, the electronic device 100 can display the pet image in the meeting as shown in FIG. 5E, so that on the one hand, a better prompting effect can be achieved, and on the other hand, if the user enters the meeting, the state of the pet image is consistent with the current state of the user, and an intelligent experience can be provided to the user.

[0264] In another possible implementation, for different pet images displayed, the displayed interaction result is different based on the same type of interaction operation of the user. In some examples, after the same interaction operation of the user is detected (for example, the interaction operation is all a click operation on the pet image), the electronic device 100 can determine which feedback to give to the user (for example, which state of the pet image to display) based on the current pet image, and it can be understood that the pet image is used to indicate the emotion of the user. For example, when the pet image indicates that the current emotion of the user is a positive emotion or a neutral emotion, the electronic device 100 can display the pet image in the meeting as shown in FIG. 5E; for another example, when the pet image indicates that the current emotion of the user is a negative emotion, the electronic device 100 can prompt the user to adjust the emotion in the form of text, voice, or the like (for example, prompting the user to cheer up and be ready for the meeting), so that the user can participate in the meeting in a better state.

[0265] Application scenario 3: social application

[0266] In a possible implementation, for a social application, a pet image can be used to prompt an instant messaging message.

[0267] For example, assuming that an instant messaging message (e.g., a message sent by a friend XXX) is received on a social application, the electronic device 100 can generate and display a pet image that can be used to prompt the user that the electronic device 100 has received an instant messaging message, for example, the pet image shown in FIG. 5F that is holding a mobile phone and calling the user to a message. By presenting the pet image, the monotonous instant messaging prompt message can be indicated, and the prompt effect can be achieved more vividly and effectively.

[0268] Optionally, the one or more parameters used to generate the pet image can include an emotion detection result, that is, the pet image can also reflect the current emotion of the user. For example, in a case where it is detected that the current emotion of the user is a positive emotion, the pet image can be a pet image that is happily holding a mobile phone and calling the user to a message. For another example, in a case where it is detected that the current emotion of the user is a neutral emotion, the pet image can be a pet image that is calmly holding a mobile phone and calling the user to a message. For another example, in a case where it is detected that the current emotion of the user is a negative emotion, the pet image can be a pet image that is slightly sad holding a mobile phone and calling the user to a message. And the like.

[0269] It can be understood that, for different pet images displayed, based on the same type of interaction operation of the user, the interaction result of the display can be the same or different. For example, the pet image displayed by the electronic device 100 includes a pet image that is happily holding a mobile phone and calling the user to a message, or a pet image that is calmly holding a mobile phone and calling the user to a message, or a pet image that is slightly sad holding a mobile phone and calling the user to a message.

[0270] In a possible implementation, for different pet images displayed, the displayed interaction results can be the same based on the same type of interaction operation of the user. Regardless of which pet image is displayed by the electronic device 100, after the electronic device 100 displays the pet image, the same interaction operation (for example, the interaction operation is all a click operation on the pet image) of the user can be detected, and in response to the interaction operation, the electronic device 100 can display a pet image related to the specific content of the instant messaging message (for example, a keyword in the message content) based on the specific content of the instant messaging message. For example, if the instant messaging message includes content related to sports, the electronic device 100 can display a pet image that is moving, as shown in the example of FIG. 5G. In this way, the user can be vividly informed of the content of the instant messaging message, and the interest can be improved. In some examples, the electronic device 100 can also switch to display the specific content of the instant messaging message when the display time of the pet image reaches a preset time length, or when a user operation such as a click operation on the display interface is detected.

[0271] In some examples, in a case where the social application prompts an audio / video call message, after the interaction operation, the electronic device 100 can display a pet image for indicating that the user answers or rejects the audio / video call.

[0272] In another possible implementation, for different pet images displayed, the displayed interaction results are different based on the same type of interaction operation of the user. In some examples, after the same interaction operation (for example, the interaction operation is all a click operation on the pet image) of the user is detected, the electronic device 100 can determine whether to recommend an emotion regulation strategy to the user based on the current pet image. It can be understood that the pet image is used to indicate the emotion of the user. For example, when the pet image indicates that the current emotion of the user is a negative emotion, after the user views the instant messaging message, the electronic device 100 can display a pet image that recommends an emotion regulation strategy to the user, or does not display the pet image, but recommends an emotion regulation strategy to the user in the form of text, voice, etc., to prompt the user to regulate the emotion, so that the user can be in a better state. The emotion regulation strategy can include but is not limited to: watching a video / animation, listening to audio, talking and confiding, mindfulness practice, playing a small game. In some examples, the emotion regulation strategy can be an emotion regulation strategy suitable for the scene in which the user is located and determined by the electronic device 100.

[0273] It is easy to understand that, in the case that the notification message is a service reminder type notification message (such as the notification message of the alarm clock type application / calendar type application described above), after the interaction operation, the electronic device 100 can display a pet image for indicating a task to be performed by the user after the notification message, for example, in the case that the notification message is a sleep-in notification message, after the interaction operation, the pet image in the sleep-in state described above can be displayed to indicate that the user is going to sleep, and for example, in the case that the notification message is a meeting notification message, after the interaction operation, the pet image in the meeting described above can be displayed to indicate that the user is going to have a meeting.

[0274] In some examples, in the case that the notification message is a marketing information type notification message, after the interaction operation, the electronic device 100 can display a pet image related to the specific content of the marketing information type notification message based on the specific content of the marketing information type notification message.

[0275] It should be noted that the above examples of the present application illustrate the pet image indicating monotonous text notification information by taking the above three typical application scenarios as examples, and are not limited thereto. The pet image indicating monotonous text notification information can also be applied to other application scenarios, which are not limited by the examples of the present application. For example, in the case that the electronic device 100 is a mobile phone, a tablet or other non-wearable device, when the electronic device 100 detects that a pop-up message is coming, the electronic device 100 can also display a pet image for indicating the pop-up message, which can be displayed in full screen or in the form of a card without full screen.

[0276] It is understood that, in some examples, the electronic device 100 can also display the notification message and the pet image for indicating the notification message at the same time, for example, the main body of the display interface can be the pet image, and the notification message can be displayed in a reduced size at other positions (such as the upper left corner of the position of the pet image) of the position of the pet image. In other examples, the electronic device 100 can first display the notification message and then display the pet image for indicating the notification message. For example, the electronic device 100 displays the notification message, and when the display time length of the notification message reaches a preset time length, or when a user operation such as clicking the display interface is detected, the display of the pet image for indicating the notification message can be switched. In other examples, the electronic device 100 can first display the pet image for indicating the notification message and then display the notification message. For example, the electronic device 100 displays the pet image for indicating the notification message, and when the display time length of the pet image for indicating the notification message reaches a preset time length, or when a user operation such as clicking the display interface is detected, the display of the notification message can be switched.

[0277] In the embodiments of the present application, the pet image displayed by the electronic device 100 can also be used to reflect the mood of the user. For example, in the case where it is detected that the current mood of the user is a positive mood, the electronic device 100 can display the pet image in a positive mood (e.g. happy) as shown in Fig. 5H; for another example, in the case where it is detected that the current mood of the user is a neutral mood, the electronic device 100 can display the pet image in a neutral mood (e.g. calm) as shown in Fig. 5I; for yet another example, in the case where it is detected that the current mood of the user is a negative mood, the electronic device 100 can display the pet image in a negative mood (e.g. surprised) as shown in Fig. 5J.

[0278] Embodiment Two: Adjustment of the Morphology (e.g. size, posture, position, action, etc.) of the Pet Image

[0279] In the embodiments of the present application, after displaying the pet image, the electronic device 100 can also support the user to adjust the morphology (e.g. size, posture, position, action, etc.) of the pet image through relevant operations.

[0280] In one implementation, referring to Fig. 6A, the electronic device 100 can collect the data of the user's operation on the electronic device 100 through sensors (e.g. capacitive sensors, pressure sensors, acceleration sensors, gyroscope sensors, microphones, odor sensors, etc.), mechanical components (e.g. crown, volume keys, etc.), and convert the data into relevant instructions, so as to further adjust the morphology of the pet image based on the instructions, and realize the interaction between the user and the pet image.

[0281] Among them, the above-mentioned sensors can be sensors called and started by the application of displaying the pet image.

[0282] The following will be introduced respectively through different sensors, mechanical components to detect the user's operation to realize the process of adjusting the morphology of the pet image:

[0283] 1. Mechanical components (e.g. crown, volume keys, etc.) detect user's operation

[0284] The mechanical component can refer to the physical structure on the electronic device 100, and the user can realize the control of the electronic device 100 through the operation on the mechanical component. Illustratively, the mechanical component can include crown, volume keys, etc.

[0285] Taking the crown as an example, the electronic device 100 can support the user to adjust the size of the pet image by rotating the crown.

[0286] For example, referring to FIG. 6B, the electronic device 100 can detect that the user performs an operation of rotating the crown clockwise, and in response to the operation, the electronic device 100 can implement an effect of enlarging the pet image. As the user continuously rotates the crown clockwise, the pet image can be continuously enlarged.

[0287] For example, referring to FIG. 6B, the electronic device 100 can detect that the user performs an operation of rotating the crown counterclockwise, and in response to the operation, the electronic device 100 can implement an effect of reducing the pet image. As the user continuously rotates the crown counterclockwise, the pet image can be continuously reduced.

[0288] It can be understood that the above example of enlarging the pet image by rotating the crown clockwise and reducing the pet image by rotating the crown counterclockwise should not be construed as a limitation on the present application. In some examples, it can also be that the crown is rotated clockwise to reduce the pet image and the crown is rotated counterclockwise to enlarge the pet image.

[0289] For example, the electronic device 100 can support the user adjusting the size of the pet image by performing an operation of pressing the volume key (e.g., volume up key, volume down key).

[0290] For example, referring to FIG. 6B, the electronic device 100 can detect that the user performs an operation of pressing the volume up key, and in response to the operation, the electronic device 100 can implement an effect of enlarging the pet image. As the user continuously presses the volume up key, the pet image can be continuously enlarged.

[0291] For example, referring to FIG. 6B, the electronic device 100 can detect that the user performs an operation of pressing the volume down key, and in response to the operation, the electronic device 100 can implement an effect of reducing the pet image. As the user continuously presses the volume down key, the pet image can be continuously reduced.

[0292] 2. Capacitive sensor / pressure sensor detects user operation

[0293] For example, referring to FIG. 7, the electronic device 100 can detect that the user performs an operation of tapping the screen with the knuckle, and in response to the operation, the electronic device 100 can implement an effect of the pet image avoiding and moving away from the place tapped by the knuckle.

[0294] For example, referring to FIG. 7, the electronic device 100 can detect that the user performs an operation of pinching the screen with two fingers, and in response to the operation, the electronic device 100 can implement an effect of the pet image being reduced and hanging between the two fingers.

[0295] In some examples, the electronic device 100 can detect that the user performs an operation of separating the two fingers, and in response to the operation, the electronic device 100 can implement an effect of enlarging the pet image.

[0296] For example, with reference to FIG. 7, the electronic device 100 can detect that the user performs an operation of tapping the screen with a single finger, and in response to the operation, the electronic device 100 can implement an effect in which the pet image moves in the direction of the finger.

[0297] In some examples, in the case where the emotion of the user is a positive emotion, the pet image described above avoids the knuckle tapping place, specifically, a pet image with a smile can bounce to avoid the knuckle tapping place; for example, in the case where the emotion of the user is a neutral emotion, the pet image described above avoids the knuckle tapping place, specifically, a pet image with a relaxed expression can jump to avoid the knuckle tapping place; for example, in the case where the emotion of the user is a negative emotion, the pet image described above avoids the knuckle tapping place, specifically, a pet image with a slightly sad expression can run to avoid the knuckle tapping place.

[0298] 3. Accelerometer / gyro sensor detects user operation

[0299] For example, with reference to FIG. 8, the electronic device 100 can detect that the user performs an operation of tilting the arm (i.e., tilting the arm on which the electronic device 100 is worn), and in response to the operation, the electronic device 100 can implement an effect in which the pet image tilts in the direction in which the body tilts.

[0300] For example, with reference to FIG. 8, the electronic device 100 can detect that the user performs an operation of moving the arm (i.e., moving the arm on which the electronic device 100 is worn), and in response to the operation, the electronic device 100 can implement an effect in which the pet image moves along the movement trajectory of the body.

[0301] For example, with reference to FIG. 8, the electronic device 100 can detect that the user performs an operation of jumping, and in response to the operation, the electronic device 100 can implement an effect in which the pet image jumps along with the body.

[0302] In some examples, in the case where the emotion of the user is a positive emotion, the pet image described above jumps along with the body, specifically, a pet image with a smile can jump high; for example, in the case where the emotion of the user is a neutral emotion, the pet image described above jumps along with the body, specifically, a pet image with a relaxed expression can jump high; for example, in the case where the emotion of the user is a negative emotion, the pet image described above jumps along with the body, specifically, a pet image with a slightly sad expression can jump with straight legs.

[0303] 4. Microphone detects user operation

[0304] Exemplarily, referring to FIG. 9, the electronic device 100 can detect an operation of the user blowing air to the microphone, and in response to the operation, the electronic device 100 can implement an effect of the fur of the pet image being blown by the wind.

[0305] In some examples, in a case where the emotion of the user is a negative emotion, the electronic device 100 can implement an effect of the fur of the pet image being erected.

[0306] It should be noted that the pet image displayed in the above-mentioned embodiment two can be the pet image displayed by the electronic device 100 in a case where the electronic device 100 detects that the preset condition is triggered in the above-mentioned embodiment one. That is to say, the above-mentioned embodiment two can be adjusting the shape of the pet image on the basis of the pet image displayed in the embodiment one.

[0307] It can be understood that the embodiments of the present application can interact with the pet image generated or displayed by any one of the methods in the embodiment one. The interaction can trigger the pet to appear a specific behavior. It can be understood that the specific behavior can be associated with the information indicated by the pet image. Exemplarily, taking the case that the electronic device 100 detects a specific scene and displays a pet image as an example, the interaction with the pet image is described.

[0308] Exemplarily, referring to FIG. 3A, after the electronic device 100 displays the pet image that is sweating in the foregoing exercise scene, the electronic device 100 can detect an operation (such as a click operation, etc.) of the user on the pet image, and in response to the operation, the electronic device 100 can display the pet image that is raising the thumb as exemplarily shown in FIG. 10A. In this way, the user can be given a praise type feedback after completing a task (such as exercise, learning, etc.), so that the user has more sense of achievement.

[0309] In some examples, the specific behavior of the pet appearing triggered by the interaction can be related to the current emotion of the user, for example, in a case where the current emotion of the user is a negative emotion, in response to the above-mentioned interaction, the electronic device 100 can display the pet image that is lying on the ground; or, the electronic device 100 can display the pet image for encouraging the user, for example, display the pet image that is outputting the encouraging speech “a little at a time, it is already very good”; for another example, in a case where the current emotion of the user is a neutral emotion, in response to the above-mentioned interaction, the electronic device 100 can display the pet image that is exhaling with the mouth open; for another example, in a case where the current emotion of the user is a positive emotion, in response to the above-mentioned interaction, the electronic device 100 can display the pet image that is happily raising the thumb.

[0310] Exemplarily, referring to FIG. 3A, after the electronic device 100 displays the pet image with sleepy eyes in the foregoing sleeping scenario, the electronic device 100 can detect an operation (for example, a click operation, etc.) of the user on the pet image, and in response to the operation, the electronic device 100 can display the pet image rubbing eyes as exemplarily shown in FIG. 10A. In this way, the common behavior action of just waking up can be vividly presented, and the interest is increased.

[0311] In some examples, the specific behavior of the pet appearing triggered by the interaction operation can be related to the current emotion of the user. For example, in the case that the current emotion of the user is a negative emotion, in response to the interaction operation, the electronic device 100 can display a pet image unwilling to get up, or the electronic device 100 can display a pet image outputting an encouraging speech “A new day has begun, let’s be happy!”; for another example, in the case that the current emotion of the user is a neutral emotion, in response to the interaction operation, the electronic device 100 can display a pet image rubbing eyes; for another example, in the case that the current emotion of the user is a positive emotion, in response to the interaction operation, the electronic device 100 can display a pet image getting up with a high spirit.

[0312] Exemplarily, referring to FIG. 3A, after the electronic device 100 displays the pet image with a satisfied heart in the foregoing dining scenario, the electronic device 100 can detect an operation (for example, a click operation, etc.) of the user on the pet image, and in response to the operation, the electronic device 100 can display the pet image belching as exemplarily shown in FIG. 10A. In this way, the common behavior action of just finishing eating can be vividly presented, and the interest is increased.

[0313] In some examples, taking the state of “dining” of the user as an example, the electronic device 100 can display a pet image eating. The specific behavior of the pet appearing triggered by the interaction operation can be related to the current emotion of the user. For example, in the case that the current emotion of the user is a negative emotion, in response to the interaction operation, the electronic device 100 can display a pet image eating in a simple dining environment with a bowl and a ladle, or the electronic device 100 can display a pet image outputting an encouraging speech “Be a happy eater!”. For another example, in the case that the current emotion of the user is a neutral emotion, in response to the interaction operation, the electronic device 100 can display a pet image eating slowly. For another example, in the case that the current emotion of the user is a positive emotion, in response to the interaction operation, the electronic device 100 can display a pet image eating with great relish.

[0314] Exemplarily, referring to FIG. 3A, in the foregoing mood scenario, if the mood state of the user is a negative mood, the electronic device 100 can display a pet image lying on the ground. Upon detecting an operation (e.g., a click operation, etc.) of the user on the pet image, in response to the operation, the electronic device 100 can display a pet image standing up and cheering, as exemplarily shown in FIG. 10A. In this way, the user can be encouraged, and the user's bad mood can be improved to some extent, so that the user can adjust his / her state as soon as possible.

[0315] In some examples, the specific behavior of the pet appearing in response to the interaction operation can be related to the current mood of the user, for example, in the case that the current mood of the user is a negative mood, in response to the foregoing interaction operation, the electronic device 100 can display a pet image sighing, or the electronic device 100 can display a pet image encouraging the user, for example, a pet image outputting an encouraging speech "be happy every day". For another example, in the case that the current mood of the user is a neutral mood, in response to the foregoing interaction operation, the electronic device 100 can display a pet image standing up and patting its buttocks. For another example, in the case that the current mood of the user is a positive mood, in response to the foregoing interaction operation, the electronic device 100 can display a pet image shaking off fatigue and cheering itself up.

[0316] Exemplarily, taking the case that the electronic device 100 detects a specific time and displays a pet image as an example, the interaction operation with the pet image is described.

[0317] Exemplarily, referring to FIG. 3B, after the electronic device 100 displays a pet image associated with the time (e.g., a pet image with a current time background) in response to the specific time, the electronic device 100 can detect an operation (e.g., a click operation, etc.) of the user on the pet image, and in response to the operation, the electronic device 100 can display the current time and give the user a thoughtful reminder. For example, at 10 o'clock in the evening, the electronic device 100 can output a prompt information to remind the user that it is time to go to bed.

[0318] In some examples, the interaction operation can trigger the pet image to be in the current emotion of the user, and the time context in which the pet image is in can remain unchanged. For example, in a case where the current emotion of the user is a negative emotion, in response to the above interaction operation, the electronic device 100 can display a pet image that is not happy, or the electronic device 100 can display a pet image that encourages the user, for example, a pet image that is outputting an encouraging speech “Be happy all the time, oh!”; for another example, in a case where the current emotion of the user is a neutral emotion, in response to the above interaction operation, the electronic device 100 can display a pet image that is calm; for another example, in a case where the current emotion of the user is a positive emotion, in response to the above interaction operation, the electronic device 100 can display a pet image that is happy.

[0319] It should be noted that the above is an example of a single device to introduce the process of triggering the pet to appear a specific behavior through an interaction operation. In some examples, in a multi-device scenario, the pet can also be triggered to appear a specific behavior. For example, referring to FIG. 10B, taking two electronic devices 100 and 200 as an example, assuming that the user of the electronic device 100 and the user of the electronic device 200 are in a friend relationship, and the electronic device 100 and the electronic device 200 respectively display their own pet images, in a case where the electronic device 100 and the electronic device 200 are close to each other, the electronic device 100 and the electronic device 200 can update the displayed pet images based on the communication connection established between the two, for example, display pet images that are shaking hands with each other. In this way, the common behavior actions of friends meeting in a real scene can be vividly presented, and the interest can be increased.

[0320] Embodiment three: providing a personalized emotion improvement method based on the emotion of the user

[0321] In the embodiments of the present application, the electronic device 100 can collect physiological data of the user, and can perform emotion detection and emotion classification based on the physiological data (for example, the emotion can be divided into three categories of positive emotion, neutral emotion, and negative emotion, and can also be divided into happy, calm, and unhappy), so as to further provide a personalized emotion improvement method for the user based on the result of emotion classification.

[0322] It can be understood that, in a possible implementation, the emotion of the user can be the emotion indicated by the pet image.

[0323] Referring to FIG. 10C, after obtaining the emotion detection result by performing emotion detection, the electronic device 100 can input the emotion detection result to a data platform. In the case where an application such as a watch face / control / theme / FA card / screen saver calls and opens a related sensor, the electronic device 100 can classify the emotion based on the emotion detection result to perform three classification of the emotion (i.e., positive emotion, neutral emotion, and negative emotion). The following describes how the electronic device 100 provides personalized emotion improvement methods for the user in the case where the emotion of the user is detected as a positive emotion, a neutral emotion, or a negative emotion.

[0324] 1. Positive emotion

[0325] In the embodiments of the present application, in the case where the emotion of the user is detected as a positive emotion (e.g., happy, excited, etc.), the electronic device 100 can provide praise-type feedback for the user.

[0326] In some examples, in the case where the emotion of the user is detected as a positive emotion, the electronic device 100 can display a user interface including a pet image. Further, the electronic device 100 can support the user to interact with the pet through an interactive operation. For example, the electronic device 100 can pull up a microphone to support the user to control the pet image to perform a specific action (e.g., laughing, dancing, etc.) in the form of voice interaction (e.g., the user issuing a voice such as “laugh one” or “jump once”).

[0327] In other examples, in the case where the emotion of the user is detected as a positive emotion, the electronic device 100 can provide related text suggestions. In a possible implementation manner, the electronic device 100 can pull up a suggestion library, the suggestion library can match feedback content corresponding to the positive emotion, and after the matching is completed, the electronic device 100 can display the feedback content (e.g., recommending the user to perform outdoor activities, etc. when the user is in a positive emotion, recommending the user to share joy with family, etc.).

[0328] 2. Neutral emotion

[0329] In the embodiments of the present application, in the case where the emotion of the user is detected as a neutral emotion (e.g., calm, etc.), the electronic device 100 can provide encouragement-type feedback for the user.

[0330] In some examples, in the case where the emotion of the user is detected as a neutral emotion, the electronic device 100 can provide related text suggestions. In a possible implementation manner, the electronic device 100 can pull up a suggestion library, the suggestion library can match feedback content corresponding to the neutral emotion, and after the matching is completed, the electronic device 100 can display the feedback content (e.g., recommending the user to perform book reading, etc. when the user is in a neutral emotion).

[0331] 3. Negative emotion

[0332] In the embodiment of the present application, the electronic device 100 can provide the user with comforting feedback when detecting that the user's emotion is a negative emotion (such as sadness, anxiety, etc.).

[0333] In some examples, the electronic device 100 can pull up a video application or a music application and play a funny video or soothing music when detecting that the user's emotion is a negative emotion.

[0334] In other examples, the electronic device 100 can pull up a suggestion library when detecting that the user's emotion is a negative emotion. The suggestion library can match feedback content corresponding to the negative emotion, and after matching, the electronic device 100 can also provide the user with emotion improvement suggestions (such as recommending the user to drink a cup of milk tea, etc.) combined with the user's historical preference records.

[0335] In other examples, the electronic device 100 can pull up a game application to recommend a decompression game to the user and improve the user's emotion by reducing the difficulty of the game, etc. when detecting that the user's emotion is a negative emotion.

[0336] In a possible implementation, the electronic device 100 pulls up the above-mentioned video application or music application or game application, which can specifically include: the electronic device 100 displays an icon of the above-mentioned video application or an icon of the music application or an icon of the game application, and detects an operation (such as a click operation) of the user on the above-mentioned icon. In response to the operation, the electronic device 100 can pull up the above-mentioned video application or music application or game application. After the application is pulled up, the electronic device 100 can support the user to randomly select a song or a video to be played or a game to be opened.

[0337] It can be understood that the third embodiment can provide a personalized emotion improvement method based on the emotion detection result detected by the electronic device 100, or a personalized emotion improvement method based on the user emotion indicated by the pet image displayed in the first embodiment or the second embodiment, or a personalized emotion improvement method based on the interaction operation on the pet image in the first embodiment or the second embodiment. The present application does not limit the triggering condition of providing a personalized emotion improvement method.

[0338] FIG. 11 exemplarily shows a specific flow of a method for displaying an interface provided by the embodiment of the present application.

[0339] As shown in FIG. 11, the method can be applied to a first electronic device. The specific steps of the method are described in detail as follows:

[0340] S1101, when detecting the first information, the first electronic device displays a first screen, the first screen comprising a first virtual image, the first virtual image being in a first state, the first state being used to indicate the first information.

[0341] S1102, when detecting the second information, the first electronic device displays a second screen, the second screen comprising the first virtual image, the first virtual image being in a second state, the second state being used to indicate the second information; wherein the first state and the second state are different.

[0342] The first electronic device can be the electronic device 100 mentioned in the foregoing embodiments, the first information and the second information can be two different notification messages, and the first screen and the second screen can be interfaces displayed on the entire screen of the electronic device 100 or interfaces displayed in a part of the screen.

[0343] In the embodiments of the present application, the virtual image can be various types of images, such as pet images, character images, plant images, etc. The specific type of the virtual image is not limited in the embodiments of the present application. The virtual image can be different. For example, the virtual image can be a panda or a puppy. It can be understood that the panda and the puppy belong to different virtual images.

[0344] The first electronic device can generate the virtual image based on one or more parameters. The parameters include but are not limited to emotion detection results, environmental information where the user is located, motion health data, associated event information, personal information of the user, and notification messages. The electronic device can determine one or more of the following according to the parameters: expression of the virtual image, action of the virtual image, accessory of the virtual image, background of the virtual image, etc.

[0345] The virtual image can also be used to indicate the one or more parameters. For example, the virtual image shown in FIG. 1A is a virtual image holding an umbrella and in a calm expression. The state of the virtual image is holding an umbrella and in a calm state. At this time, the state of the virtual image can be used to indicate that the weather at the location where the user is located is rainy and the emotion of the user is calm.

[0346] In an embodiment, the virtual image can be the pet image described above. The virtual image can include but is not limited to the virtual images shown in the foregoing FIGS. 1A-1F, 2A, 2B, 3A-3B, 4, 5A-5J, 6A-6B, 7, 8, 9, 10A-10B.

[0347] The first state and the second state are states of the virtual image.

[0348] It can be understood that for the same virtual image, the state of the virtual image can be different.

[0349] In a possible implementation, the state of the virtual image can be determined according to one or more parameters, and / or, preset conditions for triggering display of the virtual image. The state of the virtual image can be used to indicate the parameters for generating the virtual image, and / or, the preset conditions for triggering display of the virtual image. The state of the virtual image can be different according to different parameters for generating the virtual image, and / or, different preset conditions for triggering display of the virtual image.

[0350] Different parameters for generating the virtual image can be understood as one or more of the following cases: different number of parameters for generating the virtual image, different types of parameters for generating the virtual image, and different information indicated by the parameters for generating the virtual image. Specifically, if the number of parameters for generating virtual image 1 is 2 in case 1, and the number of parameters for generating virtual image 2 is 3 in case 2, the states of virtual image 1 and virtual image 2 can be different. Specifically, if a panda running in the rain is generated according to environmental information and motion health data of the user in case 3, and a happy panda running is generated according to emotion detection results and motion health data in case 4, the types of virtual images generated in case 3 and case 4 are different, which can be understood as that "running in the rain" and "happy running" are different states of the panda virtual image. Specifically, the generation of the virtual image according to the emotion detection results and the motion health data is described. If the emotion detection result is not happy and the motion health data is running in case 5, the generated virtual image is a panda with an unhappy expression and running. If the emotion detection result is happy and the motion health data is walking in case 6, the generated virtual image is a panda with a happy expression and walking. For case 5 and case 6, the states of the virtual images are different because the information indicated by the parameters of the virtual images is different, which can be understood as that "unhappy expression and running" and "happy expression and walking" are different states of the panda virtual image.

[0351] Different preset conditions for triggering display of the virtual image can be understood as one or more of the following cases: different number of preset conditions, different types of preset conditions, and different information indicated by the preset conditions. In a possible implementation, the electronic device 100 can display the virtual image when it is detected that the preset condition is triggered. The preset condition can include one or more of the following: a specific user action, a specific event, a specific wake-up word, and detection of a notification message. The specific event can include one or more of the following: a specific scenario (for example, a motion scenario, a sleep scenario, a meal scenario, an emotion scenario, etc.), a specific time (for example, a specific time point, a specific time period), wherein the specific scenario can include a state of the user in the specific scenario.

[0352] Specifically, if in case 7, the preset condition for triggering the display of the virtual image is the action of the user shaking the arm wearing the electronic device 100, the virtual image can be displayed in a state of shaking head and waving hands; in case 8, the preset condition for triggering the display of the virtual image is the action of the user shaking the arm wearing the electronic device 100 within a specific time period, the number of preset conditions of case 7 and case 8 is different. Specifically, if in case 9, the preset condition is to detect a notification message, and the notification message is a sleep alarm reminder, a virtual image that is digging into a quilt can be displayed; the types of preset conditions of case 7 and case 9 are different. If in case 10, the preset condition is to detect a notification message, and the notification message indicates that a meeting is about to start, a virtual image that holds a loudspeaker to shout at the user to start the meeting can be displayed, in case 9 and case 10, although the preset conditions are both notification information, the information indicated by the notification information is different, and the state of the virtual image can be different.

[0353] Exemplarily, the first state can be, for example, any one of the states of the virtual images shown in the foregoing FIGS. 1A-10B. Exemplarily, the first state can be a state of exercise such as pre-exercise, during-exercise, post-exercise, a state of sleep such as falling asleep, sleeping, and waking up, a state of meal such as pre-meal, during-meal, and post-meal, and a state of emotion such as positive emotion, neutral emotion, and negative emotion. The second state can also be, for example, any one of the states of the virtual images shown in the foregoing FIGS. 1A-10B, but is different from the first state. The description of the second state can refer to the description of the first state.

[0354] In a possible implementation, the first information and the second information are notification messages. That is, when the first message is detected, that is, when the preset condition is detected, the first electronic device can trigger the display of the first virtual image in the first state, and the first state is used to indicate the first message. Exemplarily, taking the meeting arrangement reminder in FIG. 5D as the first message, when the first message is detected, the first electronic device can display a first screen, and the first screen includes a first virtual image holding a loudspeaker to shout at the user to start a meeting (first state); it can be understood that holding a loudspeaker to shout at the user to start a meeting (first state) can be used to indicate that the first information detected by the first electronic device is the meeting arrangement reminder. Similarly, the first state can be used to indicate the first information, and the second state can be used to indicate the second information, which will not be described herein.

[0355] In some possible implementation manners, the first virtual image can also be used to indicate the content of the notification message, or can include words or images or animations for indicating the content of the notification message. For example, the first information can include information about a meeting arrangement, for example, the meeting time is 2 p.m., the meeting room is A01, and the meeting theme is “Project Kick-off Meeting”, and then the first virtual image can include the first virtual image walking to the meeting room A01.

[0356] In some examples, simple text or icon reminders can be displayed in the first and second screens, for example, the text “Meeting” and the icon “bell” shown in FIG. 5D, and for example, the text “Message” and the icon “mobile phone” shown in FIG. 5F.

[0357] In a possible implementation manner, when the first information is detected, the first electronic device also displays first text prompt information, the first text prompt information being used to indicate the first information; or, when the second information is detected, the first electronic device also displays second text prompt information, the second text prompt information being used to indicate the second information.

[0358] In a possible implementation manner, the first screen and the first text prompt information are displayed simultaneously, or the first screen is displayed before the first text prompt information, or the first screen is displayed after the first text prompt information; or, the second screen and the second text prompt information are displayed simultaneously, or the second screen is displayed before the second text prompt information, or the second screen is displayed after the second text prompt information.

[0359] The first text prompt information can be the first information itself or information processed from the first information, and the information can be used to indicate the first information. That is, the first text prompt information can be displayed simultaneously with the first virtual image, or can be displayed before or after the first virtual image. For example, taking the meeting arrangement reminder in FIG. 5D as an example, in a possible implementation manner, the first information includes information about a meeting arrangement, for example, the meeting time is 2 p.m., the meeting room is A01, and the meeting theme is “Project Kick-off Meeting”. In an example implementation manner, the first text prompt information can be the information included in the first information, that is, the first text information can be “the meeting time is 2 p.m., the meeting room is A01, and the meeting theme is “Project Kick-off Meeting”. In another example implementation manner, the first text prompt information is information processed from the first information, and it can be understood that the first information can be a meeting arrangement reminder at 2 p.m. set by a schedule application, that is, redundant information “the meeting time is 2 p.m.” in the first information can be processed to obtain the first text information “the meeting room is A01, and the meeting theme is “Project Kick-off Meeting”.

[0360] The second text prompt information can be the second information itself or information processed from the second information, which can be used to indicate the second information. That is, the second text prompt information can be displayed simultaneously with the first virtual image, or displayed before or after the first virtual image. The second text information is similar to the first text information, and reference is made to the description of the first text information, which will not be repeated here.

[0361] In a possible implementation, the first picture is displayed before the first text prompt information, specifically including: the first electronic device displays the first text prompt information after displaying the first picture for a first preset time length; or, the first electronic device displays the first text prompt information in response to a user operation while displaying the first picture; or, the first picture is displayed after the first text prompt information, specifically including: the first electronic device displays the first picture after displaying the first text prompt information for a second preset time length; or, the first electronic device displays the first picture in response to a user operation while displaying the first text prompt information; or, the second picture is displayed before the second text prompt information, specifically including: the first electronic device displays the second text prompt information after displaying the second picture for a third preset time length; or, the first electronic device displays the second text prompt information in response to a user operation while displaying the second picture; or, the second picture is displayed after the second text prompt information, specifically including: the first electronic device displays the second picture after displaying the second text prompt information for a fourth preset time length; or, the first electronic device displays the second picture in response to a user operation while displaying the second text prompt information.

[0362] In a possible implementation, before the first electronic device displays the first picture, the method further includes: the first electronic device detects that the user is in a first emotion, and determines that the first virtual image is in a first state based on the first emotion and the first information; and / or, before the first electronic device displays the second picture, the method further includes: the first electronic device detects that the user is in a second emotion, and determines that the first virtual image is in a second state based on the second emotion and the second information.

[0363] It can be understood that the first electronic device can determine the state of the first virtual image according to the parameter for generating the first virtual image and the preset condition for triggering the display of the first virtual image. Exemplarily, the parameter for generating the first virtual image is an emotion detection result, and the preset condition for triggering the display of the first virtual image is detecting a notification message. In this way, the state of the first virtual image can be used not only to indicate the emotion of the user, but also to indicate that a notification message is detected.

[0364] In a possible implementation, the method further includes: when the first electronic device displays the first screen, the first electronic device detects a first operation; and in response to the first operation, the first electronic device displays a third screen, the third screen including the first virtual image, the first virtual image being in a third state, the third state being different from the first state.

[0365] The third state is a state of the virtual image. For example, the third state can be any one of the states of the virtual image shown in FIGS. 1A-10B. For example, the first information is a sleep alarm, the first operation is a click operation, and the first screen includes the pet image (virtual image) shown in FIG. 5A that is digging into a nest (first state). After detecting the click operation, the electronic device can display a third screen including the pet image (virtual image) in a sleeping state (third state) shown in FIG. 5B. For another example, the first state is the state of the virtual image shown in FIG. 5D, and the third state can be the state of the virtual image shown in FIG. 5E. For another example, the first state is the state of the virtual image shown in FIG. 5F, and the third state can be the state of the virtual image shown in FIG. 5G. Details are not described herein.

[0366] In a possible implementation, the method further includes: when the first electronic device displays the second screen, the first electronic device detects a second operation, the second operation being the same as the first operation; and in response to the second operation, the first electronic device displays a fourth screen, the fourth screen including the first virtual image, the first virtual image being in a fourth state, the fourth state being different from the second state.

[0367] The fourth state is a state of the virtual image. For example, the fourth state can be any one of the states of the virtual image shown in FIGS. 1A-10B. The description of the fourth state can refer to the description of the third state. For example, the second state is the state of the virtual image shown in FIG. 5A, and the fourth state can be the state of the virtual image shown in FIG. 5B. For another example, the second state is the state of the virtual image shown in FIG. 5D, and the fourth state can be the state of the virtual image shown in FIG. 5E. For another example, the second state is the state of the virtual image shown in FIG. 5F, and the fourth state can be the state of the virtual image shown in FIG. 5G. Details are not described herein.

[0368] The first operation and the second operation can both be an interactive operation between the user and the first virtual image. The interactive operation can trigger the virtual image to perform a specific behavior. Further, the state of the virtual image displayed by the first electronic device is different from the state of the virtual image displayed before the interactive operation. Different interactive operations can trigger the virtual image to perform different behaviors. The same interactive operation can also trigger the virtual image to perform different behaviors in different states of the virtual image. The types of the interactive operation can include, but are not limited to, finger clicking, finger sliding, finger long pressing, double finger pinching / separating, finger joint tapping, and the like. For details, reference can be made to the related descriptions of FIGS. 5A-5G in Embodiment I and Embodiment II, which will not be repeated here.

[0369] For example, the interactive operation is taken as finger clicking. When the user clicks the pet image that is digging a nest as shown in FIG. 5A with a finger, the electronic device can display the pet image in a sleeping state as shown in FIG. 5B. When the user clicks the pet image that is holding a horn and shouting at the user to have a meeting as shown in FIG. 5D with a finger, the electronic device can display the pet image in a meeting as shown in FIG. 5E. It can be understood that the two clicking operations are the same interactive operation, and the state of the pet image after the interactive operation is different due to the different states of the pet image before the interactive operation.

[0370] In a possible implementation, the first state satisfies one or more of the following: the first state is used to indicate content of the first information or an outline of the content of the first information; the first state is used to indicate a task to be performed by the user, the task being associated with the first information; the first state is used to indicate that the first information is an audio / video call request; and / or, the second state satisfies one or more of the following: the second state is used to indicate content of the second information or an outline of the content of the second information; the second state is used to indicate a task to be performed by the user, the task being associated with the second information; and / or, the second state is used to indicate that the second information is an audio / video call request.

[0371] In a possible implementation, if the first state is used to indicate an outline of the content of the first information, the third state is used to indicate the content of the first information; or, if the first state is used to indicate a task to be performed by the user, the third state is used to indicate that the task is being performed; or, if the first state is used to indicate that the first information is an audio / video call request, the third state is used to indicate that the audio / video call request has been answered or rejected; or, if the second state is used to indicate an outline of the content of the second information, the fourth state is used to indicate the content of the second information; or, if the second state is used to indicate a task to be performed by the user, the fourth state is used to indicate that the task is being performed; or, if the second state is used to indicate that the second information is an audio / video call request, the fourth state is used to indicate that the audio / video call request has been answered or rejected.

[0372] In a possible implementation, the first information is a service reminder type notification message, the third state is used to indicate the content of the first information, or the third state is used to indicate that a task is being performed; or, the first information is an instant chat type notification message or an information marketing type notification message, the third state is used to indicate the content of the first information; or, the first information is an audio / video call type notification message, the third state is used to indicate that the audio / video call request has been answered or has been rejected; the second information is a service reminder type notification message, the fourth state is used to indicate the content of the second information, or the fourth state is used to indicate that a task is being performed; or, the second information is an instant chat type notification message or an information marketing type notification message, the fourth state is used to indicate the content of the second information; or, the second information is an audio / video call type notification message, the audio / video call request has been answered or has been rejected.

[0373] That is to say, for different types of notification messages, the virtual image can be in different states after the interaction operation.

[0374] For example, in the case of a service reminder type notification message (for example, the notification message of the alarm clock type application or the schedule type application described above), after the interaction operation, the electronic device 100 can display a pet image indicating a task to be performed by the user after the notification message. For example, when the notification message is a sleep notification message, after the interaction operation, the pet image in the sleep state described above can be displayed to indicate that the user is going to sleep. For another example, when the notification message is a meeting notification message, after the interaction operation, the pet image in the meeting described above can be displayed to indicate that the user is going to have a meeting.

[0375] For example, in the case of an information marketing type notification message or an instant chat type notification message, after the interaction operation, the electronic device 100 can display a pet image related to the specific content of the information marketing type notification message or the specific content of the instant chat type notification message.

[0376] For example, in the case of an audio / video call type notification message, after the interaction operation, the electronic device 100 can display a pet image indicating that the user has answered or rejected the audio / video call.

[0377] In a possible implementation, the method further includes: when the first electronic device displays the first virtual image, the first electronic device collects first data; and the first electronic device controls the first virtual image based on the first data; wherein the first data includes one or more of user operation data, environment data, and user physiological data.

[0378] The display of the first virtual image can be specifically displaying the first virtual image in the first picture, the second picture, the third picture, or the fourth picture.

[0379] That is, the electronic device 100 can control the first virtual image based on the data collected by the sensor, for example, change the size, state, position, etc. of the first virtual image.

[0380] In a possible implementation, the method further includes: the first electronic device detecting that a first preset condition is triggered; and the first electronic device displaying a fourth screen, the fourth screen including the first virtual image, a state of the first virtual image being associated with the first preset condition; wherein the first preset condition includes one or more of a specific user action, a specific wake-up word, a notification message, a preset scene, a preset time, and a preset location.

[0381] It can be understood that the first preset condition can be the preset condition used to trigger the pet image in the foregoing. The preset condition can include one or more of the following: a specific user action, a specific event, a specific wake-up word, and detection of a notification message. The specific event can include one or more of the following: a specific scene (for example, a sports scene, a sleep scene, a dining scene, an emotional scene, etc.), a specific time (for example, a specific time point, a specific time period), wherein the specific scene can include a state of a user in the specific scene.

[0382] That is, the condition for triggering the electronic device 100 to display the virtual image can be one or more, and the state of the virtual image can be different when the triggering condition is different.

[0383] In a possible implementation, the method further includes: the first electronic device detecting that a second electronic device is close to the first electronic device; and the first electronic device displaying the first virtual image and a second virtual image for interaction, the second virtual image being associated with the second electronic device.

[0384] The second electronic device can be the electronic device 200. When the second electronic device is close to the first electronic device, the second virtual image can or can not be displayed on the second electronic device. The first electronic device can be the second virtual image obtained on the second electronic device. The second virtual image can be a virtual image for representing the emotion of a user of the second electronic device.

[0385] In this way, the common behavior actions (for example, two virtual images shaking hands with each other) of friends meeting in a real scene can be vividly presented, and the interest is increased.

[0386] In a possible implementation, the first information and the second information are different. Specifically, the reason why the first state and the second state are different can be that the type of the first information and the type of the second information are different, and / or the content indicated by the first information and the content indicated by the second information are different.

[0387] The type of the first information and the type of the second information can include, but are not limited to, social communication, service reminder, information, and marketing.

[0388] In a possible implementation, the first electronic device is a watch, the user operation data is operation data of rotating a crown, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device enlarges the display of the first virtual image, or the first electronic device reduces the display of the first virtual image; or the user operation data is operation data of pressing a volume key, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device enlarges the display of the first virtual image, or the first electronic device reduces the display of the first virtual image.

[0389] In this way, the virtual image can be enlarged or reduced in display in various ways (for example, rotating the crown, pressing the volume key, and the like).

[0390] In a possible implementation, the user operation data is operation data of tapping a screen with a knuckle, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controls the first virtual image to move away from the position of tapping the screen with the knuckle; or the user operation data is operation data of pinching with two fingers, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device reduces the display of the first virtual image, and displays the reduced first virtual image suspended between the two fingers; or the user operation data is operation data of touching the screen with a single finger, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controls the first virtual image to move to the position of the single finger.

[0391] The user operation and the effect of triggering the electronic device 100 to control the virtual image can be referred to the foregoing description of FIG. 7, and will not be described herein.

[0392] In a possible implementation, the user operation data is operation data of tilting the first electronic device, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controls the first virtual image to tilt in the tilting direction of the first electronic device; or the user operation data is operation data of moving the first electronic device, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controls the first virtual image to move along the moving track of the first electronic device; or the user operation data is operation data of jumping while wearing the first electronic device, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controls the first virtual image to jump along with the first electronic device.

[0393] The user operation and the effect of triggering the electronic device 100 to control the virtual image can refer to the foregoing description about FIG. 8, and will not be described herein again.

[0394] In a possible implementation, the user operation data is operation data of the user blowing air to the microphone, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device displays the first virtual image in a wind blowing state.

[0395] The first virtual image in the wind blowing state may, for example, be a first virtual image with hair flowing in the wind or a first virtual image with hair standing up.

[0396] In a possible implementation, the environmental data is environmental smell data, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device determines an environmental smell based on the environmental smell data, and displays the first virtual image in a fifth state, the fifth state being used to indicate a state of the first virtual image smelling the environmental smell; or, the environmental data is environmental light data, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device determines an intensity of environmental light based on the environmental light data, and displays the first virtual image in a sixth state, the sixth state being used to indicate a state of a background in which the first virtual image is located, the background being used to indicate the intensity of the environmental light; or, the user physiological data is hydration degree data of the user's skin, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device determines a hydration degree of the user's skin based on the hydration degree data of the user's skin, and displays the first virtual image in a seventh state, the seventh state being used to indicate the hydration degree of the user's skin.

[0397] The fifth state may, for example, be a state of the virtual image smelling a fragrance and being happy or a state of the virtual image smelling a stench and pinching the nose, the sixth state may, for example, be a state of a bright background when the intensity of the environmental light is large or a state of a dim background when the intensity of the environmental light is small, and the seventh state may, for example, be a state of the virtual image sweating.

[0398] The software structure of the electronic device 100 provided in the embodiments of the present application will be introduced below.

[0399] FIG. 12 exemplarily shows a software structure of an electronic device 100 provided in the embodiments of the present application.

[0400] As shown in FIG. 12, the software system of the electronic device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiments of the present application take an Android system with a layered architecture as an example to exemplarily explain the software structure of the electronic device 100.

[0401] The layered architecture divides software into several layers, each with a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the system library, and the kernel layer.

[0402] The application layer can include a series of application packages.

[0403] As shown in FIG. 12, the application package can include clock, emotion, calendar, call, map, settings, WLAN, Bluetooth, music, video, short message, etc.

[0404] Among them, the emotion application is an application installed on the electronic device 100 for emotion detection and emotion regulation.

[0405] In the embodiments of the present application, the emotion application can be used to monitor the user's emotion based on the results detected by various sensors, and can perform multi-classification on the emotion (such as positive emotion, neutral emotion, negative emotion, etc.), and generate an emotion detection result.

[0406] It can be understood that the emotion detection result generated by the emotion application can be used as a parameter for generating a virtual image. In a possible implementation, the virtual image can be used to indicate the emotion detection result. It can be understood that the description of the virtual image here can refer to the description of the pet image in the foregoing and the description of the virtual image in the method of FIG. 11, but the virtual image is not limited to the pet image, and can also be a character image, a plant image, etc.

[0407] In the embodiments of the present application, the emotion application can also display a virtual image representing the user's emotion. That is, the virtual image can be displayed in the electronic device 100 in response to the user's operation of opening the emotion application. In a possible implementation, the virtual image can be generated by the emotion application and displayed. In another possible embodiment, the virtual image representing the user's emotion can be generated in the following virtual image generation module, and the emotion application can obtain information of the virtual image and display the virtual image based on the information.

[0408] In the embodiments of the present application, the emotion application can also be used to provide emotion regulation strategies, so that the user can regulate his / her own emotion through the emotion regulation strategies. Among them, the emotion regulation strategies can include but are not limited to: video / animation, audio, artificial intelligence chat, mindfulness practice, small game. Specifically, the emotion regulation strategies can refer to the personalized emotion improvement method based on the user's emotion in Embodiment Three, which will not be described here.

[0409] It should be noted that the name of the emotion application is only a word used in the embodiments of the present application, and the meaning represented thereby has been described in the embodiments of the present application, and the name does not constitute any limitation on the embodiments of the present application.

[0410] The application framework layer provides an application programming interface (API) and a programming framework for the applications of the application layer. The application framework layer includes some pre-defined functions.

[0411] As shown in FIG. 12, the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0412] The window manager is used to manage window programs. The window manager can acquire a display screen size, determine whether there is a status bar, lock a screen, and the like.

[0413] The content provider is used to store and acquire data, and make the data accessible to the applications. The data can include videos, images, audios, dialed and received calls, browsing history and bookmarks, a phonebook, and the like.

[0414] The view system includes visual controls, such as a control for displaying text, a control for displaying pictures, and the like. The view system can be used to build an application. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0415] The phone manager is used to provide a communication function of the electronic device 100. For example, management of a call state (including call connection, call hang-up, and the like).

[0416] The resource manager provides various resources for the applications, such as localized strings, icons, pictures, layout files, video files, and the like.

[0417] The notification manager enables the applications to display notification information in a status bar, and can be used to convey a message of the notification type, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify a download completion, a message reminder, and the like. The notification manager can also be a notification appearing in a system top status bar in a form of a graph or a scroll bar text, for example, a notification of an application running in the background, and can also be a notification appearing on a screen in a form of a dialogue window. For example, a text information is prompted in a status bar, a prompt sound is emitted, the electronic device is vibrated, a light flashes, and the like.

[0418] In the embodiments of the present application, the notification manager can be configured to receive a message notification event / message reminder event sent by an application program, and generate a corresponding notification message (e.g., a text prompt message) based on the event; and can also be configured to send the notification message to the virtual image generation module, so that the virtual image generation module can generate a corresponding virtual image based on the notification message. For example, the message notification event / message reminder event can be a meeting arrangement reminder event, a sleep reminder event, a chat prompt message, etc. The notification message is described above (e.g., in the first embodiment, in FIG. 11), and will not be described here again.

[0419] The core library includes two parts: one part is a function function that needs to be called by the java language, and the other part is the core library of Android.

[0420] The application program layer and the application program framework layer run in the virtual machine. The virtual machine executes the java files of the application program layer and the application program framework layer into binary files. The virtual machine is configured to perform functions such as management of object life cycle, stack management, thread management, security and exception management, and garbage collection.

[0421] The system library can include a plurality of functional modules. For example: a surface manager, media libraries, a three-dimensional graphics processing library (e.g., OpenGL ES), a 2D graphics engine (e.g., SGL), a virtual image generation module, etc.

[0422] The surface manager is configured to manage the display subsystem, and provides a plurality of applications with fusion of 2D and 3D layers.

[0423] The media library supports playback and recording of a plurality of commonly used audio, video formats, and static image files, etc. The media library can support a plurality of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0424] The three-dimensional graphics processing library is configured to implement three-dimensional graphics drawing, image rendering, synthesis, and layer processing, etc.

[0425] The 2D graphics engine is a drawing engine for 2D drawing.

[0426] The virtual image generation module can generate a virtual image. Specifically, the virtual image generation module can be configured to acquire one or more parameters and generate a virtual image based on the acquired one or more parameters. For example, the virtual image generation module can be configured to acquire the emotion detection result from the emotion application, and generate a corresponding virtual image based on the emotion detection result and the prompt information described above, a state of the virtual image can be used to indicate the notification message and the emotion of the user. The virtual image generation module can also be configured to receive the notification message sent by the notification manager, and generate a corresponding virtual image based on the notification message, a state of the virtual image can be used to indicate the notification message.

[0427] In some examples, the virtual image generation module can also generate a virtual image based only on the emotion detection result acquired in the emotion application.

[0428] In other examples, the virtual image generation module can also generate a virtual image based on the emotion detection result acquired in the emotion application and personalized information of the user (such as environment information in which the user is located, sports health data, associated event information, personal information of the user, etc.).

[0429] The virtual image generation module can also be configured to generate a virtual image when a preset condition is met. For example, the virtual image generation module can be configured to generate a virtual image when it is determined that a preset condition of detecting a notification message is met. The virtual image generation module can also be configured to update a state of the virtual image after the user interacts with the virtual image; can also be configured to acquire an emotion regulation strategy from the emotion application, and determine an emotion regulation strategy matched with a current scene based on the emotion regulation strategy and the current scene, to prompt the user to use the emotion regulation strategy to regulate his / her emotion; and the like.

[0430] It can be understood that the description of the virtual image herein can refer to the description of the pet image in the foregoing and the description of the virtual image in the method of FIG. 11. The emotion regulation strategy can refer to the personalized emotion improvement method based on the emotion of the user in Embodiment Three, which will not be described herein again.

[0431] After the virtual image generation module generates a corresponding virtual image, a display driver in the kernel layer can be started, so that the virtual image and / or content related to the emotion regulation strategy can be displayed through a display screen. For details, refer to the foregoing description, which will not be described herein again.

[0432] The kernel layer is a layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, a Bluetooth driver, and a sensor driver.

[0433] The structure of an electronic device 100 provided in an embodiment of the present application is described below.

[0434] FIG. 13 illustrates a structure of an electronic device 100 according to an embodiment of the disclosure.

[0435] As shown in FIG. 13, the electronic device 100 can include a processor 110, a memory 120, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna, a wireless communication module 160, an audio module 170, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and the like. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a photoplethysmography (PPG) sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a hydration sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0436] It can be understood that the structure illustrated in the embodiments of the disclosure does not constitute a specific limitation on the electronic device 100. In other embodiments of the disclosure, the electronic device 100 can include more or fewer components than those illustrated, or combine certain components, or split certain components, or different arrangement of components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

[0437] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), and the like. Different processing units can be independent devices, or can be integrated in one or more processors.

[0438] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0439] The processor 110 can also include memory that stores instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The cache memory can hold instructions or data recently used or frequently used by the processor 110. If the processor 110 needs to use the instructions or data again, it can directly call them from the cache memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.

[0440] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0441] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can include multiple sets of I2C buses. The processor 110 can be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 can be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the electronic device 100.

[0442] The UART interface is a universal serial bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 110 and the wireless communication module 160. For example, the processor 110 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to realize the Bluetooth function. In some embodiments, the audio module 170 can transmit audio signals to the wireless communication module 160 through the UART interface to realize the function of playing music through Bluetooth earphones.

[0443] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation of the electronic device 100. In some other embodiments of the present application, the electronic device 100 can also use different interface connection modes or a combination of multiple interface connection modes in the above embodiments.

[0444] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via an antenna, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive signals to be sent from the processor 110, frequency modulate them, amplify them, and radiate them as electromagnetic waves via an antenna.

[0445] The electronic device 100 realizes the display function through the GPU, the display screen 194, and the application processor, etc. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs that execute program instructions to generate or change display information.

[0446] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1.

[0447] The electronic device 100 can implement audio functions through the audio module 170. For example, music playing, voice recording, and the like.

[0448] The pressure sensor 180A is configured to sense a pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. The pressure sensor 180A can be of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor can include at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation according to the pressure sensor 180A. The electronic device 100 can also calculate the position of the touch according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation instructions. For example, when a touch operation with a touch operation intensity less than a first pressure threshold is applied to a short message application icon, an instruction to view short messages is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold is applied to the short message application icon, an instruction to create a new short message is executed.

[0449] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. Illustratively, when the shutter is pressed, the gyroscope sensor 180B detects the angle of shaking of the electronic device 100, calculates the distance that the lens module needs to compensate according to the angle, and lets the lens offset the shaking of the electronic device 100 by reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and motion sensing game scenarios.

[0450] The PPG sensor 180C (which can also be referred to as a PPG module) can be used to collect physiological data (e.g., heart rate, blood oxygen, respiration rate, blood pressure, blood sugar, muscle oxygen, vascular resistance, brain oxygen, etc.) of a user. In embodiments of the present application, the electronic device 100 can detect the mood of the user based on the collected physiological data of the user.

[0451] The acceleration sensor 180E can detect the magnitude of acceleration of the electronic device 100 in various directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device 100 and applied to landscape / portrait switching, pedometer, etc.

[0452] The hydration sensor 180G can be used to measure the hydration level of an object close to it. In embodiments of the present application, the hydration sensor 180G can be used to detect the hydration level (e.g., whether there is sweat) of the skin of the arm of the user wearing the electronic device 100.

[0453] The ambient light sensor 180L is used to sense the ambient light brightness. In embodiments of the present application, the electronic device 100 can adaptively adjust the state of the pet image based on the sensed ambient light brightness.

[0454] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 performs temperature handling strategies using the temperature detected by the temperature sensor 180J. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold value, the electronic device 100 reduces the performance of the processor located near the temperature sensor 180J in order to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold value, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 caused by low temperature. In other embodiments, when the temperature is lower than yet another threshold value, the electronic device 100 performs voltage boosting on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature. In embodiments of the present application, the temperature sensor 180J can also monitor the body temperature of the user.

[0455] Touch sensor 180K, also referred to as "touch panel". Touch sensor 180K can be disposed on display screen 194, and touch sensor 180K and display screen 194 together form a touch screen, also referred to as "touch panel". Touch sensor 180K is configured to detect a touch operation applied to or near the touch sensor 180K. The touch sensor 180K can transmit the detected touch operation to the application processor to determine the touch event type. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K can also be disposed on the surface of electronic device 100, which is different from the position where display screen 194 is disposed.

[0456] Keys 190 include a power key, a volume key, and the like. Keys 190 can be mechanical keys. Alternatively, keys 190 can be touch keys. Electronic device 100 can receive key input and generate key signal input related to user settings and function control of electronic device 100.

[0457] It should be understood that electronic device 100 shown in FIG. 13 is only an example, and electronic device 100 can have more or fewer components than those shown in FIG. 13, two or more components can be combined into one, or different component configurations can be used. The various components shown in FIG. 13 can be implemented in hardware, software, or a combination of hardware and software, including one or more signal processing and / or application specific integrated circuits.

[0458] The chip system provided in the embodiments of the present application comprises: a processor coupled with a memory, the memory being configured to store programs or instructions, when the programs or instructions are executed by the processor, the chip system implements the method in any of the method embodiments described above.

[0459] Optionally, the processor in the chip system can be one or more. The processor can be implemented by hardware or software. When implemented by hardware, the processor can be a logic circuit, an integrated circuit, or the like. When implemented by software, the processor can be a general-purpose processor, which implements by reading software codes stored in the memory.

[0460] Optionally, the memory in the chip system can also be one or more. The memory can be integrated with the processor, or can be disposed separately from the processor, which is not limited in the embodiments of the present application. For example, the memory can be a non-transient processor, such as a read-only memory (ROM), which can be integrated on the same chip as the processor, or can be disposed on different chips, respectively. The type of the memory and the arrangement of the memory and the processor are not limited in the embodiments of the present application.

[0461] Exemplarily, the chip system can be a field programmable gate array (FPGA), can be an application specific integrated circuit (ASIC), can also be a system on chip (SoC), can also be a central processor unit (CPU), can also be a network processor (NP), can also be a digital signal processor (DSP), can also be a micro controller unit (MCU), can also be a programmable logic device (PLD) or other integrated chip.

[0462] It should be understood that each step in the above method embodiments can be completed by integrated logic circuits of hardware in the processor or instructions in the form of software. The method steps disclosed in combination with the embodiments of the present application can be directly embodied as hardware processor execution completion, or executed by hardware and software modules in the processor.

[0463] In the above embodiments, all or part of them can be realized by software, hardware, firmware or any combination thereof. When realized by software, all or part of them can be realized in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the present application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another, for example, the computer instructions can be transferred from one website, computer, server or data center to another website, computer, server or data center through wired (such as coaxial cable, optical fiber, digital subscriber line) or wireless (such as infrared, wireless, microwave, etc.) mode. The computer readable storage medium can be any available medium that a computer can access or a data storage device such as a server, data center, etc. integrated with one or more available media. The available medium can be a magnetic medium (for example, floppy disk, hard disk, magnetic tape), optical medium (for example, DVD), or semiconductor medium (for example, solid state disk (SSD)) and the like.

[0464] Those skilled in the art can understand that all or part of the processes in the above-mentioned method embodiments can be implemented by a computer program instructing relevant hardware to complete, and the program can be stored in a computer readable storage medium. When the program is executed, the processes of the above-mentioned method embodiments can be included. The aforementioned storage medium includes ROM, random access memory (RAM), magnetic disk or optical disk, and various storage media that can store program codes.

[0465] The above embodiments are only used to illustrate the technical solutions of the present application, rather than limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that the technical solutions recorded in the foregoing embodiments can be modified, or some technical features can be replaced by equivalent substitutes. These modifications or replacements do not make the essence of the corresponding technical solutions deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

An interface display method applied to a first electronic device, characterized in that, The method comprises: When the first information is detected, the first electronic device displays a first screen, the first screen comprising a first virtual image, the first virtual image being in a first state, the first state being used to indicate the first information; When the second information is detected, the first electronic device displays a second screen, the second screen comprising the first virtual image, the first virtual image being in a second state, the second state being used to indicate the second information; Wherein, the first state and the second state are different. According to the method of claim 1, wherein, When the first information is detected, the first electronic device also displays first text prompt information, the first text prompt information being used to indicate the first information; Or, When the second information is detected, the first electronic device also displays second text prompt information, the second text prompt information being used to indicate the second information. The method according to claim 2, characterized in that The first screen and the first text prompt information are displayed simultaneously, or the first screen is displayed before the first text prompt information, or the first screen is displayed after the first text prompt information; Or, The second screen and the second text prompt information are displayed simultaneously, or the second screen is displayed before the second text prompt information, or the second screen is displayed after the second text prompt information. According to the method of claim 3, wherein, The first screen is displayed before the first text prompt information, specifically comprising: the first electronic device switches to display the first text prompt information after displaying the first screen for a first preset time length; or, the first electronic device displays the first screen, and in response to a user operation, the first electronic device switches to display the first text prompt information; or, The first screen is displayed after the first text prompt information, specifically comprising: the first electronic device switches to display the first screen after displaying the first text prompt information for a second preset time length; or, the first electronic device displays the first text prompt information, and in response to a user operation, the first electronic device switches to display the first screen; or, The second screen is displayed before the second text prompt information, specifically comprising: the first electronic device switches to display the second text prompt information after displaying the second screen for a third preset time length; or, the first electronic device displays the second screen, and in response to a user operation, the first electronic device switches to display the second text prompt information; or, The second screen is displayed after the second text prompt information, specifically comprising: the first electronic device switches to display the second screen after displaying the second text prompt information for a fourth preset time length; or, the first electronic device displays the second text prompt information, and in response to a user operation, the first electronic device switches to display the second screen. According to any one of claims 1-4, wherein, Before the first electronic device displays the first screen, the method further includes: the first electronic device detecting that a user is in a first emotion, and determining that the first virtual image is in the first state based on the first emotion and the first information; and / or, Before the first electronic device displays a second screen, the method further includes: the first electronic device detecting that a user is in a second emotion, and determining that the first virtual image is in the second state based on the second emotion and the second information. The method according to any one of claims 1 to 5, characterized in that The method further includes: While the first electronic device displays the first screen, the first electronic device detects a first operation; In response to the first operation, the first electronic device displays a third screen, the third screen including the first virtual image, the first virtual image being in a third state, the third state being different from the first state. The method according to any one of claims 1 to 6, characterized in that The method further includes: While the first electronic device displays the second screen, the first electronic device detects a second operation; the second operation being the same as the first operation; In response to the second operation, the first electronic device displays a fourth screen, the fourth screen including the first virtual image, the first virtual image being in a fourth state, the fourth state being different from the second state. The method according to any one of claims 1 to 7, characterized in that The first state satisfies one or more of the following: The first state is used to indicate the content of the first information or an overview of the content of the first information; The first state is used to indicate a task that needs to be performed by the user, the task being associated with the first information; The first state is used to indicate that the first information is an audio / video call request; and / or, The second state satisfies one or more of the following: The second state is used to indicate the content of the second information or an overview of the content of the second information; The second state is used to indicate a task that needs to be performed by the user, the task being associated with the second information; The second state is used to indicate that the second information is an audio / video call request. According to the method of claim 8, wherein, if the first state is used to indicate an overview of the content of the first information, the third state is used to indicate the content of the first information; or, if the first state is used to indicate a task that needs to be performed by the user, the third state is used to indicate that the task is being performed; or, if the first state is used to indicate that the first information is an audio / video call request, the third state is used to indicate that the audio / video call request has been answered or has been rejected; or, if the second state is used to indicate an overview of the content of the second information, the fourth state is used to indicate the content of the second information; or, if the second state is used to indicate a task that needs to be performed by the user, the fourth state is used to indicate that the task is being performed; or, if the second state is used to indicate that the second information is an audio / video call request, the fourth state is used to indicate that the audio / video call request has been answered or has been rejected. According to the method of claim 9, wherein, The first information is a service reminder type notification message, the third state is used for indicating content of the first information, or the third state is used for indicating that the task is being executed; or, the first information is an instant chat type notification message or an information marketing type notification message, the third state is used for indicating content of the first information; or, the first information is an audio / video call type notification message, the third state is used for indicating that the audio / video call request has been answered or has been rejected; The second information is a service reminder type notification message, the fourth state is used for indicating content of the second information, or the fourth state is used for indicating that the task is being executed; or, the second information is an instant chat type notification message or an information marketing type notification message, the fourth state is used for indicating content of the second information; or, the second information is an audio / video call type notification message, the audio / video call request has been answered or has been rejected. The method according to any one of claims 1 to 10, characterized in that The method further comprises: The first electronic device collects first data when displaying the first virtual image; The first electronic device controls the first virtual image based on the first data; The first data comprises one or more of user operation data, environmental data, and user physiological data. The method according to any one of claims 1 to 11, characterized in that The method further comprises: The first electronic device detects that a first preset condition is triggered; The first electronic device displays a fourth screen, the fourth screen comprising the first virtual image, and a state of the first virtual image being associated with the first preset condition; The first preset condition comprises one or more of a specific user action, a specific wake-up word, a notification message, a preset scene, a preset time, and a preset location. The method according to any one of claims 1 to 12, characterized in that The method further comprises: The first electronic device detects that a second electronic device is close to the first electronic device; The first electronic device displays the first virtual image and a second virtual image that are interacting, the second virtual image being associated with the second electronic device. The method according to any one of claims 1-13, wherein The first information is different from the second information. The method according to any one of claims 11-14, wherein The first electronic device is a watch, the user operation data is operation data of rotating a crown, and the first electronic device controls the first virtual image based on the first data, specifically comprising: the first electronic device enlarges the display of the first virtual image, or reduces the display of the first virtual image. Or, The user operation data is operation data of pressing a volume key, and the first electronic device controls the first virtual image based on the first data, specifically comprising: the first electronic device enlarges the display of the first virtual image, or reduces the display of the first virtual image. The method according to any one of claims 11-14, wherein The user operation data is operation data of tapping a screen with a knuckle, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controlling the first virtual image to move away from a position where the knuckle taps the screen. Or, The user operation data is operation data of pinching with two fingers, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device reducing the display of the first virtual image and displaying the reduced first virtual image suspended between the two fingers. Or, The user operation data is operation data of touching a screen with a single finger, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controlling the first virtual image to move to a position where the single finger is located. According to any one of claims 11-14, wherein The user operation data is operation data of tilting the first electronic device, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controlling the first virtual image to tilt in a tilting direction of the first electronic device. Or, The user operation data is operation data of moving the first electronic device, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controlling the first virtual image to move along a moving track of the first electronic device. Or, The user operation data is operation data of jumping of the first electronic device worn by the user, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device controlling the first virtual image to jump along with the first electronic device. According to any one of claims 11-14, wherein The user operation data is operation data of the user blowing into a microphone, and the first electronic device controls the first virtual image based on the first data, specifically including: The first electronic device displays the first virtual image in a wind blowing state. According to any one of claims 11-14, wherein The environment data is environment smell data, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device determining an environment smell based on the environment smell data and displaying the first virtual image in a fifth state, the fifth state being used to indicate a state of the first virtual image smelling the environment smell. Or, The environment data is environment light data, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device determining an intensity of environment light based on the environment light data and displaying the first virtual image in a sixth state, the sixth state being used to indicate a state of a background in which the first virtual image is located, the background being used to indicate the intensity of the environment light. Or, The user physiological data is hydration degree data of user skin, and the first electronic device controls the first virtual image based on the first data, specifically including: the first electronic device determines the hydration degree of user skin based on the hydration degree data of user skin, and displays the first virtual image in a seventh state, the seventh state being used to indicate the hydration degree of user skin. An electronic device, characterized by comprising: The electronic device includes one or more processors and one or more memories; wherein the one or more memories are coupled with the one or more processors, and the one or more memories are configured to store computer program codes, the computer program codes including computer instructions, when the one or more processors execute the computer instructions, the electronic device executes the method as claimed in any one of claims 1-19. A computer storage medium, characterized by The computer storage medium stores a computer program, and the computer program includes program instructions, when the program instructions run on an electronic device, the electronic device executes the method as claimed in any one of claims 1-19. A computer program product, when the computer program product runs on a computer, makes the computer execute the method as claimed in any one of claims 1-19.

Images