Screen-off display method, electronic equipment and readable storage medium

Abstract

The embodiment of the invention provides a screen-off display method, electronic equipment and a readable storage medium. The method is applied to the electronic equipment, and the electronic equipment comprises a main processor and an auxiliary processor. The method comprises the steps that under the condition that the electronic equipment is in a screen-off display state, an auxiliary processor plays a first 3D animation, the first 3D animation comprises multiple animation frames, and the first 3D animation is obtained through processing of the auxiliary processor according to a first 3D model; when the auxiliary processor plays the first 3D animation, the main processor is in a dormant state. The display effect of the electronic equipment in the screen-off display mode is improved, and the power consumption of the electronic equipment is also saved.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a screen-off display method, electronic device, and readable storage medium. Background Technology

[0002] Terminal devices (such as mobile phones) are being used more and more widely because they can provide rich and intelligent services.

[0003] To reduce power consumption and accidental touches in electronic devices, they can enter a screen-off display state after prolonged periods of inactivity. In this state, to further reduce power consumption, devices can employ low-power always-on display modes, such as AOD (always-on display). This mode controls the illumination of specific areas of the screen to display important information, such as time and date, without illuminating the entire screen. However, the current display quality in AOD mode is limited, and improving the display experience remains a key technical challenge. Summary of the Invention

[0004] This application provides a screen-off display method, an electronic device, and a readable storage medium. The electronic device includes a secondary processor. After the screen of the electronic device is turned off, the secondary processor is in operation. The electronic device can drive the movement of a first 3D model through the secondary processor to render a first 3D animation. The secondary processor can display 3D animations with the screen off, improving the display effect of the electronic device in screen-off display mode. Furthermore, the rendering of 3D animations by the secondary processor also saves power consumption of the electronic device.

[0005] In a first aspect, this application provides a screen-off display method, which is applied to an electronic device, the electronic device including a main processor and a secondary processor; the method includes: when the electronic device is in a screen-off display state, the secondary processor plays a first 3D animation, the first 3D animation including multiple animation frames, the first 3D animation being processed by the secondary processor according to a first 3D model; while the secondary processor plays the first 3D animation, the main processor is in a sleep state.

[0006] After the electronic device's screen is off, the auxiliary processor runs while the main processor enters sleep mode. The electronic device can use the auxiliary processor to drive the movement of the first 3D model and render the first 3D animation. The auxiliary processor can display 3D animations with the screen off, improving the display effect of the electronic device in screen-off mode. Furthermore, the fact that the main processor is in sleep mode and the electronic device renders 3D animations through the auxiliary processor also saves power consumption.

[0007] Optionally, the first condition may include, but is not limited to, any of the following triggering methods.

[0008] Triggering method 1: Screen lock is triggered by the power button of the electronic device. For example, when the power button of the electronic device is pressed and released by the user, the electronic device locks the screen and enters the screen-off display state.

[0009] Trigger Method 2: Timeout Screen Lock. When the electronic device's screen remains on for a preset period of time, the electronic device locks its screen and enters a screen-off state.

[0010] Triggering method 3: Screen lock triggered by proximity sensor. During a call, if the proximity sensor detects a face approaching the display screen, the electronic device locks the screen and enters a screen-off display state.

[0011] It should be noted that the first condition can also be triggered by other methods, and this application does not limit this.

[0012] Optionally, the first 3D model can be sent from the main processor to the secondary processor, or it can be stored in the secondary processor.

[0013] Optionally, if the user does not change the first 3D model, the main processor only needs to send the first 3D model to the auxiliary processor once. It is not necessary to send the first 3D model every time the electronic device enters the always-on display state. The auxiliary processor can use the first 3D model previously sent by the main processor and stored in the auxiliary processor. After the user changes the first 3D model, the main processor then sends the changed first 3D model to the auxiliary processor, and the auxiliary processor then uses the most recently sent first 3D model from the main processor.

[0014] For example, the UI for the secondary processor playing the first 3D animation can be referenced. Figures 5A-5C , Figures 5D-5E Description in the embodiments.

[0015] In conjunction with the first aspect, in one possible implementation, the method further includes: in response to the user's selection of a second 3D model, when the electronic device is in a screen-off display state, the auxiliary processor plays a second 3D animation, the second 3D animation including multiple animation frames, the second 3D animation being processed by the auxiliary processor based on the second 3D model; while the auxiliary processor is playing the second 3D animation, the main processor is in the sleep state.

[0016] Optionally, the second 3D model can be different from the first 3D model, and the second 3D animation can be the same as or different from the first 3D animation. Different 3D models can play the same animation or different animations.

[0017] Optionally, 3D models and motion sequences can be related. Different 3D models can use different motion sequences, resulting in different 3D animations.

[0018] Optionally, the 3D model and the motion sequence may not be related. Different 3D models can use the same motion sequence, so different 3D models can produce the same 3D animation.

[0019] In conjunction with the first aspect, in one possible implementation, the first 3D model or the second 3D model is a preset 3D model; or, the first 3D model or the second 3D model is obtained by the main processor based on an image or video selected by the user.

[0020] In this way, users can change to their preferred 3D model to improve the always-on display effect and enhance the user experience.

[0021] For an example of how users can change 3D models, please refer to [link / reference]. Figures 4A-4L Description in the embodiments.

[0022] In conjunction with the first aspect, in one possible implementation, the first 3D animation is obtained by the auxiliary processor based on the first 3D model and the first motion sequence.

[0023] In conjunction with the first aspect, in one possible implementation, the method further includes: the main processor sending a first 3D model and one or more motion sequences to an auxiliary processor, the one or more motion sequences including the first motion sequence or the second motion sequence; the auxiliary processor generating a first animation based on the first 3D model and the first motion sequence, or the auxiliary processor generating a fifth animation based on the first 3D model and the second motion sequence.

[0024] In this way, the coprocessor can generate different animations based on the same 3D model through different motion sequences.

[0025] Optionally, the main processor may send only the first motion sequence or the second motion sequence from one or more motion sequences to the auxiliary processor.

[0026] Optionally, the main processor can also send one or more motion sequences to the auxiliary processor.

[0027] In conjunction with the first aspect, in one possible implementation, the second 3D animation is obtained by the auxiliary processor based on the second 3D model and the first motion sequence.

[0028] In this way, the coprocessor can generate different animations based on different 3D models using the same motion sequence.

[0029] In conjunction with the first aspect, in one possible implementation, the first motion sequence is a user-selected or default motion sequence.

[0030] In this way, the auxiliary processor can generate the first 3D animation based on the motion sequence selected by the user, or it can generate the first 3D animation based on the default motion sequence to be used.

[0031] In conjunction with the first aspect, in one possible implementation, before the auxiliary processor plays the first 3D animation, the method further includes: the auxiliary processor acquiring first information, the first information including any one of the following: image data captured by the camera, biometric data, interaction data, and a first music file, the first music file being a music file played after the electronic device enters a screen-off display state; the auxiliary processor obtaining the first 3D animation based on the first information.

[0032] Optionally, the image data captured by the camera may include facial images, eye movements, etc.

[0033] Optional biometric data may include heart rate, steps, exercise duration, calories burned, etc.

[0034] Optionally, the interaction data may include user operation data on the display screen collected by sensors pre-installed in the display screen.

[0035] In this way, the auxiliary processor obtains the first 3D animation based on the first information, enriching the diversity of 3D animation playback by the auxiliary processor.

[0036] In conjunction with the first aspect, in one possible implementation, the method further includes: a secondary processor acquiring second information, the second information including any one of the following: image data captured by a camera, biometric data, interaction data, and a second music file; the secondary processor determining a second 3D animation based on the second information, the second information being different from the first information, and the second 3D animation being different from the first 3D animation.

[0037] Optionally, if the first information changes, for example, if the auxiliary processor obtains the second information, the auxiliary processor can obtain a second 3D animation based on the second information. When the second information is the same as the first information, the second 3D animation is the same as the first 3D animation. When the second information is different from the first information, the second 3D animation is different from the first 3D animation.

[0038] In this way, the 3D animation played by the coprocessor changes as the information acquired by the coprocessor changes, enriching the diversity of 3D animation played by the coprocessor.

[0039] For details on how the coprocessor obtains the first 3D animation based on the first information, and how the coprocessor obtains the second 3D animation based on the second information, please refer to [reference needed]. Figures 8A-8D Description in the embodiments.

[0040] In conjunction with the first aspect, in one possible implementation, the first 3D animation is obtained by the auxiliary processor based on the first 3D model and the first motion sequence; the auxiliary processor determines the first 3D animation based on the first information, specifically including: the auxiliary processor determines a first response event based on the first information; the auxiliary processor determines a first motion sequence from one or more motion sequences based on the first response event; the auxiliary processor obtains the first 3D animation based on the first motion sequence and the first 3D model.

[0041] Optionally, when the first information includes image data captured by the camera, the first response event includes a first facial expression / emotion.

[0042] When the first information includes biometric data, the first response event includes the first operation type.

[0043] When the first information includes interactive data, the first response event includes the first motion type.

[0044] When the first information includes the first music file, the first response event includes the music genre of the first music.

[0045] For information on how the coprocessor determines the first motion sequence based on the first information, please refer to [reference needed]. Figures 8A-8D Description in the embodiments.

[0046] In conjunction with the first aspect, in one possible implementation, the method further includes: the auxiliary processor determining a first response event based on the first information; the auxiliary processor determining a first motion sequence from one or more motion sequences based on the first response event; the auxiliary processor acquiring third information; the auxiliary processor obtaining a third motion sequence based on the third information and the first motion sequence; and the auxiliary processor obtaining a fourth 3D animation based on the third motion sequence and the first 3D model.

[0047] In this way, the auxiliary processor can modify the first motion sequence determined by the auxiliary processor based on the third information, thereby changing the style of the first 3D animation played by the auxiliary processor and further enriching the diversity of 3D animation played by the auxiliary processor.

[0048] For example, the third information may be the music information of the first piece of music played by the auxiliary processor. The music information of the first piece of music may include, but is not limited to, any of the following: the rhythm, beat, intensity, etc. of the first piece of music.

[0049] The third information may include other information, not limited to the musical information of the first piece of music. This application does not limit this information.

[0050] For information on how the coprocessor obtains the third motion sequence based on the third information and the first motion sequence, please refer to [reference needed]. Figure 8E Description in the embodiments.

[0051] In conjunction with the first aspect, in one possible implementation, before detecting that the first condition for entering the screen-off display state is met, the method further includes: the main processor playing a first piece of music; after detecting that the first condition for entering the screen-off display state is met, the method further includes: the auxiliary processor continuing to play the first piece of music based on the first music file.

[0052] In this way, the main processor plays the first track before the electronic device enters the always-on display state. After the electronic device enters the always-on display state, the secondary processor can play the first track.

[0053] Optionally, before the main processor enters sleep mode, the main processor may also send the first music file to the secondary processor, allowing the secondary processor to continue playing the first music.

[0054] For example, the UI for the secondary processor playing the first piece of music and the first 3D animation can be referenced. Figures 5F-5H Description in the embodiments.

[0055] In conjunction with the first aspect, in one possible implementation, the auxiliary processor plays the first 3D animation, specifically including: if the user is not recognized, the auxiliary processor displays the first frame of the first 3D animation; if the user is recognized, the auxiliary processor continues to play the remaining frames of the first 3D animation.

[0056] In this way, when no user touch event or gaze event on the display screen is detected, the electronic device only displays the first frame of the first 3D animation. After the user touch event or gaze event on the display screen is detected, the electronic device continues to play the animation frames of the first 3D animation, which can save the power consumption of the electronic device.

[0057] For example, a user's touch event on the display screen can refer to a user's click, swipe, long press, or other actions on the display screen.

[0058] In conjunction with the first aspect, in one possible implementation, the first motion sequence is a preset motion sequence; or, the first motion sequence is obtained by the main processor based on one or more actions performed by a target object in a first video selected by the user; or, the first motion sequence is downloaded by the main processor from a server.

[0059] In this way, users can also change their preferred motion sequences to improve the always-on display effect and enhance the user experience.

[0060] For example, you can refer to [link / reference] for how a user can change motion sequences. Figure 4N-Figure 4T Description in the embodiments.

[0061] In a second aspect, this application provides an electronic device including a main processor and a secondary processor, the main processor and the secondary processor being used to implement the method as described in any of the first aspects.

[0062] Thirdly, this application provides an electronic device including a memory and a processor, wherein the memory is used to store a computer program; and the processor is used to invoke the computer program to cause the electronic device to perform the method as described in any of the first aspects.

[0063] Fourthly, this application provides an apparatus comprising a unit or module for performing any of the methods in the first aspect, or a unit or module for performing any of the methods in the first aspect.

[0064] Fifthly, this application provides a readable storage medium storing a program or instructions that, when executed on a device, cause an electronic device to perform any of the methods in the first aspect.

[0065] In a sixth aspect, this application provides a chip system including one or more processors, the processors being configured to invoke computer instructions to cause a first electronic device to perform any of the methods in the first aspect.

[0066] In a seventh aspect, this application provides a program product comprising computer instructions that, when executed on an electronic device, cause the electronic device to perform any one of the methods in the present application.

[0067] For a description of the beneficial effects in aspects two through seven, please refer to the description of the beneficial effects in aspect one; this application will not repeat them here. Attached Figure Description

[0068] Figure 1A A schematic diagram illustrating how the main processor and auxiliary processor in an electronic device 100 provided in this application obtain the first 3D animation;

[0069] Figure 1B A schematic diagram of a first motion sequence is shown;

[0070] Figure 2 A schematic diagram of the hardware structure of an electronic device 100 provided in this application is shown;

[0071] Figure 3A This is a software structure block diagram of the electronic device 100 according to an embodiment of the present invention;

[0072] Figure 3B A schematic diagram of software interaction is shown for an electronic device 100 receiving user operations to generate a first 3D model;

[0073] Figure 3CA software interaction diagram illustrating how an electronic device 100 plays a first 3D animation is shown.

[0074] Figures 4A-4J This diagram illustrates how an electronic device 100 determines the style of a 3D model based on an image selected by the user.

[0075] Figure 4K A flowchart illustrating a method for an electronic device 100 to determine the style of a 3D model based on a user-selected image is shown.

[0076] Figure 4L The skeletal models corresponding to several different types of target objects are shown;

[0077] Figure 4M-Figure 4T A schematic diagram is shown showing how an electronic device 100 changes the display style of a 3D animation based on a user-selected motion sequence;

[0078] Figures 5A-5C A schematic diagram of a group of electronic devices 100 playing a first 3D animation is shown;

[0079] Figures 5D-5E A schematic diagram of another set of electronic devices 100 playing the first 3D animation is shown;

[0080] Figures 5F-5H A schematic diagram is shown of another set of electronic devices 100 playing the first 3D animation;

[0081] Figure 6 A flowchart illustrating a method for an electronic device 100 to play a first 3D animation is shown.

[0082] Figure 7 A flowchart illustrating the method by which an electronic device 100 plays the first piece of music and the first 3D animation after entering a screen-off display state is shown.

[0083] Figures 8A-8E The diagram illustrates how several coprocessors obtain the first motion sequence;

[0084] Figure 9 This is a flowchart illustrating a screen-off display method provided in this application. Detailed Implementation

[0085] The technical solutions in the embodiments of this application will be clearly and thoroughly described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; the word "and / or" in the text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0086] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature, and in the description of the embodiments of this application, unless otherwise stated, "multiple" means two or more.

[0087] In the following embodiments of this application, the term "user interface (UI)" refers to the medium interface through which an application (APP) or operating system interacts and exchanges information with the user. It realizes the conversion between the internal form of information and the form that the user can accept. The user interface is source code written in a specific computer language such as Java or Extensible Markup Language (XML). The interface source code is parsed and rendered on the electronic device, ultimately presenting content that the user can recognize. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be visible interface elements such as text, icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets displayed on the screen of an electronic device.

[0088] First, the technical terms used in this application will be explained.

[0089] 1. Main processor and secondary processor.

[0090] In electronic devices with a main processor and a coprocessor, the main processor, such as an application processor (AP), is typically a CPU and performs most processing operations. The coprocessor, also known as a coprocessor, is a processor specifically designed to assist the main processor in completing certain computational tasks. For example, a coprocessor can include a microcontroller unit (MCU, or single-chip microcomputer), a digital signal processor (DSP), etc. For instance, a coprocessor could be a Sensor Hub (a low-power MCU). A coprocessor can also be a small core within a system-on-a-chip (SoC). Compared to the main processor, coprocessors typically have lower performance, lower current consumption, higher energy efficiency, and lower power consumption.

[0091] Optionally, in this embodiment, the auxiliary processor may include one or more of the following components: communication components (such as Bluetooth Low Energy communication components), power system, navigation and positioning system related components (such as positioning system protocol stack), near-field communication components, graphic code payment related components, call service related components, SMS related components, and always-on display (AOD) related components. The navigation and positioning system may include a Global Navigation Satellite System (GNSS), etc., and this embodiment does not limit this.

[0092] 2. Main operating system and lightweight operating system.

[0093] In this embodiment, the main processor of the electronic device can run a main operating system, while the secondary processor can run a lightweight operating system (LiteOS, or a lightweight operating system). The main operating system and the lightweight operating system are relatively independent. For example, the main operating system can be... operating system A lightweight operating system could be Harmony Lite OS, such as HarmonyL3 or later versions, which can serve as the primary operating system. As another example, the primary operating system could be Android. A lightweight operating system could be a lightweight version of Android. As another example, the primary operating system could be a Microsoft operating system. A lightweight operating system could be a Microsoft lightweight operating system.

[0094] Compared to the main operating system, a lightweight operating system refers to a type of operating system that is small, flexible, fast, and easy to use. Lightweight operating systems have fewer functions and consume relatively fewer resources compared to the main operating system, thus saving system resources and improving system efficiency.

[0095] An application can run on either the main operating system or a lightweight operating system. When running on a lightweight operating system, it may consume fewer system resources (including memory) than when running on the main operating system. An application running on a lightweight operating system may only implement some of its functionalities. For example, an audio player running on a lightweight operating system may only support play, pause, previous, and next playback functions, lacking features like album selection. Therefore, an application running on a lightweight operating system can be called a simplified version of the application.

[0096] 3. Always-on display.

[0097] AOD, short for Always On Display, is a screen-off display technology that allows for partial screen illumination to display important information such as time, weather, and notifications without turning on the entire screen. Optionally, the content displayed in AOD can continuously change position on the screen to avoid the risk of screen burn-in caused by maintaining a screen-off display mode for extended periods. In some embodiments of this application, the user interface of applications such as wallpapers can also be displayed in full screen in AOD display mode.

[0098] AOD (Always-On Display) technology leverages the characteristics of OLED screens, allowing some information to be displayed even in standby mode, while also offering the advantage of low power consumption. OLED stands for Organic Light-Emitting Diode or Organic Electroluminescence Display. The black areas of an OLED screen consume no power; power is only consumed when displaying non-black areas.

[0099] AOD (Always-On Display) can also be called always-on display or screen-off display. This application describes an example of always-on display.

[0100] In this embodiment, when the electronic device is in always-on display mode, the main processor of the electronic device goes into sleep mode, while the auxiliary processor of the electronic device runs. In always-on display mode, the interface displayed on the screen of the electronic device is handled by the auxiliary processor.

[0101] The electronic device 100 includes a main processor and a secondary processor. In order to improve the screen-off display effect, when the electronic device 100 is detected to meet the first condition for entering the screen-off display state, before the electronic device 100 enters the screen-off display state, the main processor of the electronic device 100 can send the first 3D model and the first motion sequence to the secondary processor.

[0102] After the electronic device 100 enters the screen-off display state, the main processing of the electronic device 100 is in a sleep state. The electronic device 100 can render a first 3D animation based on the first 3D model and the first motion sequence through the auxiliary processor, and play the first 3D animation, which includes multiple animation frames.

[0103] The first motion sequence includes multiple actions. The first motion sequence is used by the auxiliary processor to drive the first 3D model to execute multiple actions in the first motion sequence to obtain the first 3D animation.

[0104] In this way, on the one hand, after the electronic device 100 enters the screen-off display state, the main processing unit of the electronic device 100 enters a sleep state, and the screen-off display processing is handled by the auxiliary processing unit of the electronic device 100, which can reduce the power consumption of the electronic device 100. Furthermore, the auxiliary processing unit renders the first 3D animation based on the first motion sequence and the first 3D model, which can further save the power consumption of the electronic device 100. On the other hand, the electronic device 100 can play the first 3D animation in the screen-off display state, which can also improve the screen-off display effect of the electronic device 100.

[0105] Optionally, the first motion sequence can be a default motion sequence, which can be sent from the main processor to the auxiliary processor.

[0106] Optionally, the main processor can also send more motion sequences to the auxiliary processor, which can acquire the first information and determine the first motion sequence from multiple motion sequences based on the first information.

[0107] For example, the first information may include, but is not limited to, any one or more of the following: user facial expression / emotion, user operation type, user motion state, and the type of music played by the electronic device 100.

[0108] The first piece of information is different, and so is the first motion sequence. In this way, the diversity of lock screen animations that electronic devices can play can be achieved.

[0109] Optionally, determining the first motion sequence may include, after acquiring the first motion sequence, the main processor may also adjust the first motion sequence based on third information to obtain a third motion sequence.

[0110] For example, the third information may include, but is not limited to, music information played by the electronic device 100. The music information played by the electronic device 100 may include, but is not limited to, any one or more of the following: the beat, rhythm, intensity, etc. of the music played by the electronic device 100.

[0111] Figure 1A This is a schematic diagram illustrating how the main processor and auxiliary processor in an electronic device 100 provided in this application obtain the first 3D animation.

[0112] like Figure 1A As shown, the electronic device 100 includes a main processor and a secondary processor.

[0113] The main processor is used to obtain a first 3D model based on a user-selected first image, or based on a preset image, or to acquire a preset first 3D model, and then sends the first 3D model and a first motion sequence to the main processor. The auxiliary processor is used to drive the first 3D model to perform actions in the motion sequence based on the first 3D model and motion sequence sent by the main processor, thereby obtaining a first 3D animation.

[0114] Figure 1A Two methods are shown for the main processor to obtain the first 3D model based on the first image.

[0115] Method 1: The main processor can generate a first 3D model based on the first image.

[0116] Optionally, the main processor has a pre-installed network model that can generate a first 3D model based on the first image.

[0117] Optionally, the main processor can also send the first image to a server or other device. The server or other device has a pre-installed network model, which can generate a first 3D model based on the first image.

[0118] Method 2: The main processor can identify the type and texture features of the target object in the first image based on the first image, and generate a first 3D model based on the type and texture features of the target object in the first image.

[0119] The type of target object can refer to the type of the target object, such as people (e.g., children, adults, boys, girls), animals (e.g., cats, dogs, birds), etc. Different types of target objects correspond to different skeletal models; for example, the skeletal model of a person is different from that of an animal. The skeletal models of different people are also different; for example, the skeletal models of children and adults are different, and the skeletal models of boys and girls are also different. The skeletal models of different animals are also different; for example, the skeletal models of cats and dogs are different.

[0120] After obtaining the type of the target object in the first image, the main processor can determine the corresponding skeletal model from multiple preset skeletal models based on the target type, such as the first skeletal model. For example, if the main processor identifies the type of the target object in the first image as an animal (cat), then the first skeletal model can be the skeletal model corresponding to the animal cat. Similarly, if the main processor identifies the type of the target object in the first image as an animal (bird), then the first skeletal model can be the skeletal model corresponding to the animal bird.

[0121] The texture features of a target object can refer to the correspondence between the surface features of the target object and the filling positions of those surface features on the first skeletal model. For example, the surface features of a target object can include, but are not limited to, the surface color and surface pattern of the target object.

[0122] In some embodiments, the texture features of the target object can be represented by a texture map and a skinning matrix. The texture map represents the surface features of the target object. The skinning matrix represents the correspondence between the infill positions of the surface features of the target object on the first skeletal model.

[0123] After acquiring the texture features and first skeletal model of the target object in the first image, the main processor can obtain a first 3D model based on these features. The first 3D model can be understood as a three-dimensional stereoscopic model. It reflects the shape, size, and texture features of the target object in different directions in three-dimensional space. The texture features of the first 3D model are the same as or similar to those of the target object in the first image, and the skeleton of the first 3D model is the same as or similar to the corresponding skeleton of the target object in the first image. A three-dimensional target object is more realistic than a two-dimensional target object, resulting in more realistic animations and better display effects.

[0124] The electronic device 100 also has one or more preset motion sequences, such as a first motion sequence. The motion sequence includes multiple different actions and is used to determine the actions of the 3D model in each frame of the final generated 3D animation.

[0125] Figure 1B A schematic diagram of a first motion sequence is shown.

[0126] like Figure 1B (a) Figure 1B (b) Figure 1B (c) Figure 1B (d) Figure 1B As shown in (e), the first motion sequence includes multiple different actions. The first 3D model can perform similar... Figure 1B (a) Figure 1B (b) Figure 1B (c) Figure 1B (d) Figure 1B The action shown in (e) in the diagram is used to obtain the first 3D animation. In each frame of the first 3D animation, the actions performed by the first 3D model are... Figure 1B (a) Figure 1B (b) Figure 1B (c) Figure 1B (d) Figure 1B The action shown in (e) is similar.

[0127] The main processor needs to send the first motion sequence and the first 3D model to the auxiliary processor.

[0128] The auxiliary processor can generate a first 3D animation based on a first 3D model and a first motion sequence. The first 3D animation includes multiple animation frames, and the first 3D model in the first 3D animation moves based on multiple different actions in the first motion sequence.

[0129] In other embodiments, the main processor may send other motion sequences to the auxiliary processor, not only the first motion sequence, but also other motion sequences. The auxiliary processor may obtain first information and determine the first motion sequence from multiple motion sequences based on the first information.

[0130] In other embodiments, the auxiliary processor can acquire a first motion sequence and third information, and adjust the first motion sequence based on the third information to obtain a third motion sequence, and then obtain a fourth 3D animation based on the first 3D model and the third motion sequence.

[0131] In this way, after the electronic device 100 enters the screen-off display state, the screen-off display processing is handled by the auxiliary processor of the electronic device 100, which can effectively reduce the power consumption of the electronic device 100. Furthermore, the auxiliary processor renders the first 3D animation based on a preset first motion sequence and a first 3D model, which can further save the power consumption of the electronic device 100. On the other hand, playing the first 3D animation in the screen-off display state also improves the display effect of the electronic device 100.

[0132] Figure 2 A schematic diagram of the hardware structure of an electronic device 100 provided in this application is shown.

[0133] Electronic device 100 can be a mobile phone, tablet computer, laptop computer, netbook, smart screen, in-vehicle device, as well as business intelligent terminal (including: video phone, conference desktop intelligent terminal, etc.), personal digital assistant (PDA), augmented reality (AR) / virtual reality (VR) device, artificial intelligence (AI) device, etc. Electronic device 100 can also be other electronic devices, such as laptop computers with touch-sensitive surfaces (e.g., touch panels). The specific form of the electronic device is not limited in the embodiments of this application.

[0134] Electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a sensor module 180, a display screen 194, a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include one or more sensors, such as a gyroscope sensor 180B, a magnetic sensor 180D, an accelerometer sensor 180E, a proximity sensor 180F, a touch sensor 180K, etc. In some embodiments, the sensor module 180 may also include one or more of the following sensors: a pressure sensor, a barometric pressure sensor, a proximity sensor, a fingerprint sensor, a temperature sensor, an ambient light sensor, a bone conduction sensor, etc.

[0135] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0136] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0137] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0138] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system. In some embodiments, the processor 110 may include one or more interfaces, such as a universal serial bus (USB) interface.

[0139] USB port 130 is a USB standard compliant interface, specifically a Mini USB port, Micro USB port, or USB Type-C port. USB port 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0140] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0141] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, display screen 194, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0142] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0143] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0144] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0145] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, demodulates and filters the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, frequency modulate and amplify them, and then convert them into electromagnetic waves for radiation via antenna 2.

[0146] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0147] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0148] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0149] Internal memory 121 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM).

[0150] The random access memory can be directly read and written by the processor 110. It can be used to store executable programs (such as machine instructions) of the operating system or other running programs, as well as user and application data.

[0151] Non-volatile memory can also store executable programs and user and application data, and can be pre-loaded into random access memory for direct reading and writing by the processor 110.

[0152] The external memory interface 120 can be used to connect to external non-volatile memory, thereby expanding the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to perform data storage functions. For example, music, video, and other files can be stored in the external non-volatile memory.

[0153] Electronic device 100 can implement audio functions, such as making calls and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, and application processor.

[0154] The audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. The audio module 170 can also be used for encoding and decoding audio signals. In some embodiments, the audio module 170 may be located in the processor 110, or some functional modules of the audio module 170 may be located in the processor 110.

[0155] The speaker 170A, also known as a "loudspeaker," is used to convert audio electrical signals into sound signals. The electronic device 100 can listen to music or make hands-free calls through the speaker 170A.

[0156] The receiver 170B, also known as the "earpiece," is used to convert audio electrical signals into sound signals. When the electronic device 100 answers a telephone call or voice message, the receiver 170B can be brought close to the ear to listen to the voice.

[0157] Microphone 170C, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When making a phone call or sending a voice message, the user can speak by bringing their mouth close to microphone 170C, inputting the sound signal into microphone 170C. Electronic device 100 may have at least one microphone 170C. In some embodiments, electronic device 100 may have two microphones 170C, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, electronic device 100 may also have three, four, or more microphones 170C, which can collect sound signals, reduce noise, identify the sound source, and perform directional recording, etc.

[0158] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.

[0159] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover.

[0160] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.

[0161] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.

[0162] Touch sensor 180K, also known as a "touch device," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0163] In some embodiments, the electronic device 100 may further include one or more of buttons, a motor, and an indicator. Buttons may include a power button, volume buttons, etc. Buttons may be mechanical buttons or touch buttons. The electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of the electronic device 100. The motor may generate vibration cues. The indicator may be an indicator light, which can be used to indicate charging status, battery level changes, and can also be used to indicate messages, missed calls, notifications, etc.

[0164] The SIM card interface 195 is used to connect the SIM card.

[0165] Figure 3A This is a software structure block diagram of the electronic device 100 according to an embodiment of the present invention.

[0166] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture.

[0167] like Figure 3A As shown, the layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, from top to bottom, these layers are the application layer, application framework layer, system libraries, and kernel layer.

[0168] The application layer can include a series of application packages.

[0169] like Figure 3A As shown, the application package can include applications such as lock screen applications and always-on display applications.

[0170] Lock screen apps can lock the screen to prevent unauthorized use of electronic devices. Lock screen apps can lock the screen in response to user actions, such as pressing the power button or using gestures. Lock screen apps can also lock the screen if the electronic device has been unattended for more than a certain period.

[0171] Always-on display applications are those that allow electronic devices to continue displaying specific content, such as the time, date, wallpaper, or service cards, while the screen is locked. Some examples of always-on display applications may include:

[0172] Always-on display clock app: This app can display various times on your phone without waking it up. It also offers the option to set different always-on screen images.

[0173] Always-on display wallpaper app: This app can display cool wallpapers when the phone is in always-on display mode, maintaining the cool effect of the screensaver.

[0174] In some embodiments of this application, the always-on display application can allow the display of the application's service card when the electronic device is in always-on display mode. Optionally, the user can be allowed to configure which application(s)' service cards are allowed to be displayed.

[0175] In other embodiments of this application, the always-on display application may allow the display of a corresponding user interface for new messages from the network side when the electronic device is in always-on display mode.

[0176] It should be understood that an always-on display application can perform one or more of the above functions, such as displaying the time or service cards, and this application does not limit this.

[0177] The application framework layer consists of a main operating system and a lightweight operating system. The main operating system runs on the main processor, while the lightweight operating system runs on the secondary processor.

[0178] Lock screen applications and always-on display applications can run on the main operating system, or in other words, lock screen applications and always-on display applications can run on the main processor.

[0179] The application framework layer of a lightweight operating system can include modules such as animation and 3D rendering (TinyGL).

[0180] The kernel layer can include modules / services for the main operating system, such as display drivers. It can also include modules / services for lightweight operating systems, such as the Always-on Display (AOD) service, the AOD WakeUp Sender, and the display subsystem (DSS) driver. Furthermore, the kernel layer can include other modules / services, such as sensor drivers, camera drivers, and display drivers, which can be used in both the main and lightweight operating systems.

[0181] The hardware layer includes devices such as displays, cameras, and sensors.

[0182] The always-on display service receives the first information sent by the hardware layer, confirms the response event based on the first information, and then sends the response event to the animation module. The response event is used by the animation module to determine the first motion sequence from multiple motion sequences.

[0183] For example, the first information could be image data captured by a camera. The always-on display service can determine a person's expression / emotion based on the facial image in the image data, and the response event could be the person's expression / emotion. As another example, the first information could also be first sensor data captured by a sensor in the display screen. The always-on display service can determine the user's operation type based on the first sensor data, and the response event could be the user's operation type. As yet another example, the first information could also be second sensor data captured by a motion sensor. The always-on display service can determine the user's motion state based on the second sensor data, and the response event could be the user's motion state. Furthermore, the first information could also be a first music file obtained by a secondary processor. The always-on display service can determine the music genre based on the first music file, and the response event could be the music genre of the first music.

[0184] The always-on display service can also be used to obtain third information and send it to the animation module. The third information can also be used by the animation module to adjust the first motion sequence to obtain the third motion sequence.

[0185] For example, the third information can be the music information of the first music, such as the rhythm, beat, intensity, etc. of the first music. The animation module can adjust the first motion sequence based on the music information of the first music to obtain the third motion sequence.

[0186] It should be noted that the first message and the third message may also include other information, and this application does not limit this.

[0187] The animation module is also used to receive the first 3D model sent by the main operating system application framework layer, and send the first 3D model and the first motion sequence, or the first 3D model and the third motion sequence, to the 3D rendering module.

[0188] The 3D rendering module is used to render a first 3D animation based on a first 3D model and a first motion sequence, or to render a fourth 3D animation based on a first 3D model and a third motion sequence.

[0189] The 3D rendering module is also used to send the first 3D animation to the display screen, so that the display screen can play the first 3D animation.

[0190] It should be understood that in some embodiments of this application, "display", "display device", "screen" and "screen" may be used interchangeably.

[0191] It should also be understood that Figure 3A In the system architecture shown, the names of each functional module are only one possible example, and this application does not restrict the naming method of functional modules.

[0192] It should also be understood that Figure 3A The system architecture shown is only one possible example. In other embodiments of this application, there may be more or fewer components than shown, or some components may be combined, some components may be split, or different component arrangements may be made.

[0193] Figure 3B A schematic diagram of software interaction is shown in which an electronic device 100 receives user operations to generate a first 3D model.

[0194] like Figure 3B As shown, the electronic device 100 includes an application layer, an application framework layer, and a hardware layer.

[0195] The application layer includes the always-on display application, the application framework layer includes the animation settings module, and the hardware layer includes the memory.

[0196] The method by which electronic device 100 receives user input to generate a first 3D model includes, but is not limited to, the following steps:

[0197] 1. The always-on display application receives the first image entered by the user.

[0198] Optionally, the first image can be an image selected from a gallery or an image captured in real time by the camera of the electronic device 100.

[0199] 2. The always-on display application sends the first image to the animation settings module.

[0200] In response to a first image sent by an always-on display application, in one possible implementation, the always-on display application can obtain a first 3D model based on the type and texture features of a target object in the first image. In other possible implementations, the electronic device 100 has a pre-installed network model, and the always-on display application can input the first image into the network model to obtain the first 3D model.

[0201] 3. The animation settings module sends the first 3D model to the memory.

[0202] In response to the first 3D model sent by the animation settings module, the memory can store the first 3D model.

[0203] Optionally, electronic device 100 can also be configured according to... Figure 3B The method shown generates the first motion sequence and saves it to memory.

[0204] Figure 3C A software interaction diagram illustrating how an electronic device 100 plays a first 3D animation is shown.

[0205] like Figure 3C As shown, the electronic device 100 includes an application framework layer, a kernel layer, and a hardware layer. The application framework layer includes an animation module and a 3D rendering module (TinyGL); the kernel layer includes an Always-On Display (AOD) WakeUp Sender, an Always-On Display (AOD) App, and a DSS driver; and the hardware layer includes sensors, memory, a camera, and a display screen.

[0206] 1. The sensor acquires data from the second sensor and sends it to the Always On Display WakeUpSendor.

[0207] 2. The memory retrieves the first music file and sends it to the Always On Display WakeUpSendor.

[0208] 3. The camera acquires image data and sends it to the Always On Display WakeUp Sender.

[0209] 4. The display screen acquires the first sensor data and sends it to the Always On Display WakeUpSendor.

[0210] 5. The Always-on Display (AOD) WakeUp Sender sends data from the first sensor, the second sensor, the first music file, or the image data to the Always-on Display service (AOD App).

[0211] 6. The always-on display service sends the first response event to the animation module.

[0212] In response to the first sensor data, second sensor data, first music file, or image data sent by the Always On Display WakeUp Sendor, the Always On Display Service (AOD App) can obtain a first response event based on the first sensor data, second sensor data, first music file, or image data.

[0213] For example, when the Always-on Display Service (AOD App) acquires image data captured by the camera, the first response event includes a first expression / emotion.

[0214] For example, when the Always-on Display Service (AOD App) acquires the first sensor data, the first response event includes a first operation type.

[0215] For example, when the Always-on Display Service (AOD App) acquires the second sensor data, the first response event includes a first motion type.

[0216] For example, when the Always-On Display (AOD) app retrieves the first music file, the first response event includes the music genre of the first music file.

[0217] 7. The animation module sends the first 3D model, the first motion sequence, or the third motion sequence to the 3D rendering module (TinyGL).

[0218] 8. The 3D rendering module (TinyGL) sends the first or fourth 3D animation to the DSS driver.

[0219] After receiving the first response event, the animation module can select the first motion sequence from one or more animation modules. The 3D rendering module (TinyGL) can render the first 3D animation based on the first 3D model, the first motion sequence, or the third motion sequence.

[0220] In some embodiments, the animation module may also obtain a preset first motion sequence instead of the first response event.

[0221] In some embodiments, after obtaining the first motion sequence, the animation module can also obtain third information and adjust the first motion sequence based on the third information to obtain the third motion sequence.

[0222] The 3D rendering module (TinyGL) can render a first 3D animation based on a first 3D model and a first motion sequence, or render a fourth 3D animation based on a third motion sequence.

[0223] 9. The DSS driver sends the first or fourth 3D animation to the display screen.

[0224] The display screen plays either the first or fourth 3D animation.

[0225] The following section provides a detailed explanation of the always-on display method involved in this application, using the UI as an example.

[0226] First, the user selects the style of the first 3D model.

[0227] Optionally, the first 3D model can be preset.

[0228] Optionally, the style of the first 3D model can be determined based on the target object in an image selected by the user (e.g., a first image). The first image can be an image saved in a gallery or an image taken by an electronic device through a camera. The user can select different images, and if the target object type is different in the different images, then the style of the first 3D model will also be different. Alternatively, if the target object type is the same in different images, but the texture features of the target object are different, then the style of the first 3D model will also be different.

[0229] Figures 4A-4J This diagram illustrates how an electronic device 100 determines the style of a 3D model based on an image selected by the user.

[0230] like Figure 4A As shown, the electronic device 100 can display a desktop, on which a page containing application icons is displayed. This page includes multiple application icons (e.g., settings application icon, app store application icon, gallery application icon, browser application icon, etc.). Below the multiple application icons, a page indicator is also displayed to indicate the positional relationship between the currently displayed page and other pages. Below the page indicator, a tray area is displayed. The tray area includes multiple tray icons, such as camera application icon, contacts application icon, phone application icon, and messaging application icon. The tray area remains displayed when switching pages. In some embodiments, the page may also include multiple application icons and a page indicator. The page indicator may not be part of the page and may exist independently. The tray icons are also optional, and this embodiment does not limit this.

[0231] Electronic device 100 can receive user input (e.g., clicking) on ​​a settings application icon, and in response to this input, electronic device 100 can display, for example... Figure 4B The user interface shown. Figure 4B This is the main interface of the settings application provided by an electronic device 100 according to an embodiment of this application.

[0232] like Figure 4B As shown, the main interface of the settings application includes multiple settings options, such as airplane mode on / off, Wi-Fi on / off, Bluetooth on / off, personal hotspot on / off, mobile network on / off, Do Not Disturb mode on / off, always-on display on / off, Huawei account viewing, and privacy mode on / off. The electronic device 100 can receive user input regarding the always-on display option, such as a click. In response to the user's input, the electronic device 100 can display... Figure 4C The always-on display settings interface is shown.

[0233] like Figure 4C As shown, the always-on display settings interface includes a 3D model display area 4001 and a theme style display area.

[0234] The 3D model display area 4001 includes the style of the 3D model currently used by the electronic device 100, for example, the style of the 3D model currently used by the electronic device 100 is an animal cat. The theme style display area includes multiple animation options, including animation option A, animation option B, animation option C, and animation option D. Animation option A is displayed with an icon 4002, which indicates that animation A is selected. Therefore, after the electronic device 100 screen is turned off, the 3D animation played by the electronic device 100 is based on the motion sequence corresponding to animation A.

[0235] The 3D model of the animal cat can be pre-installed on the electronic device or it can be obtained based on a picture of an animal cat selected by the user.

[0236] In some embodiments, the electronic device 100 can receive a user-selected image to change the style of the 3D model.

[0237] For example, such as Figure 4C As shown, the electronic device 100 can receive user input operations on the 3D model display area 4001, such as a click operation. In response to the user's input operation, the electronic device 100 can display... Figure 4D The window shown is 4003. Window 4003 displays options 4004 and 4005. The user can select an image using option 4004 to regenerate the 3D model. Option 4005 is selected, indicating that the 3D model currently used by the electronic device 100 is an animal, a cat.

[0238] For example, such as Figure 4DAs shown, the electronic device 100 can receive user input for option 4004, such as a click operation. In response to the user's input, the electronic device 100 can display... Figure 4E The gallery interface shown.

[0239] Optionally, in response to user input on option 4004, electronic device 100 may also prompt the user to either capture an image using a camera or select an image from the gallery. When the user confirms selecting an image from the gallery, electronic device 100 may then display... Figure 4E The gallery interface shown.

[0240] like Figure 4E As shown, the gallery interface includes multiple album names, such as "All Photos," "Screenshots," "Huawei Share," "Instant Messaging," and "Maps." Users can select images from any of these albums, and the electronic device 100 can generate a 3D model corresponding to the target object in the selected image.

[0241] For example, such as Figure 4E As shown, the electronic device 100 can receive user input operations for the album name "All Photos," such as a click operation. In response to the user's input operation, the electronic device 100 can display... Figure 4F The image shown is the photo display interface of the gallery application. This photo display interface includes image 4006.

[0242] For example, such as Figure 4F As shown, the electronic device 100 can receive user input operations on the image 4006, such as a click operation. In response to the user's input operation, the electronic device 100 can select the image 4006 and obtain a first 3D model based on the image 4006.

[0243] In response to the user selecting image 4006, electronic device 100 can display... Figure 4G The window 4007 shown includes the text "Apply the image you selected to the always-on display?", which prompts the user to confirm whether to use the selected image. After the user confirms the use of the selected image, the electronic device 100 can receive input from the user regarding the "Apply" option in window 4007, such as a click. In response to the user's input, the electronic device 100 can obtain a first 3D model based on image 4006.

[0244] Before obtaining the first 3D model, the electronic device 100 can display... Figure 4HThe window 4008 shown includes text and a progress bar. The text includes "Applying the image you selected to the always-on display, please wait a moment." The progress bar includes the generation progress of the first 3D model, for example, 70%. Both the text and the progress bar in window 4008 are used to indicate the generation progress of the first 3D model.

[0245] After obtaining the first 3D model based on image 4006, the electronic device 100 can display it. Figure 4I The window 4009 shown includes the text "Apply the picture you selected to the always-on display". The electronic device 100 can receive user input operations for the "Apply" option in window 4009, such as a click operation. In response to the user's input operation, the electronic device 100 can display... Figure 4J The always-on display settings interface shown is shown below. Figure 4J The 3D model display area 4001 shown includes an image of the newly generated first 3D model. Users can view the appearance of the first 3D model in the 3D model display area 4001.

[0246] In some embodiments, in response to a user's input operation on the "Apply" option in window 4009, the electronic device 100 can also obtain a 3D animation based on the newly generated first 3D model and the motion sequence corresponding to animation A, and play the 3D animation so that the user can preview the display effect of the 3D animation.

[0247] Optionally, the steps described above for determining the 3D model can be performed by the main processor in the electronic device 100.

[0248] Figure 4K A flowchart illustrating a method for an electronic device 100 to determine the style of a 3D model based on a user-selected image is shown.

[0249] S401. The main processor obtains the first image, which is the image selected by the user.

[0250] The first image can be a picture selected by the user from the image library of the electronic device 100, or a picture taken by the camera of the electronic device 100.

[0251] S402, The main processor obtains the type of the target object and the texture features of the target object in the first image.

[0252] After acquiring the first image, the main processor can obtain the type of the target object in the first image and the texture features of the target object.

[0253] In some embodiments, if the main processor does not recognize the target object in the first image, or if the main processor recognizes the target object in the first image but the target object in the first image does not belong to any of the preset multiple target objects, the electronic device 100 may prompt the user to reselect the image.

[0254] S403, The main processor obtains the first skeletal model based on the type of the target object.

[0255] Optionally, the electronic device 100 has multiple pre-installed skeletal models corresponding to different types of target objects. The main processor can obtain a first skeletal model based on the type of the target object in the first image.

[0256] Figure 4L The skeletal models corresponding to several different types of target objects are shown.

[0257] Figure 4L (a) shows the skeletal model corresponding to the animal bird. Figure 4L (b) shows the skeletal model corresponding to the child. Figure 4L (c) shows the skeletal model corresponding to an adult. Figure 4L (d) shows the skeletal model corresponding to the animal cat. Figure 4L (e) in the figure shows the skeletal model corresponding to the animal rabbit.

[0258] The skeletal models are not limited to the types of target objects mentioned above, but can also include skeletal models for many other types of target objects.

[0259] S404. The main processing is based on the texture features of the target object and the first skeletal model to obtain the first 3D model.

[0260] After acquiring the texture features of the target object and the first skeletal model, the main processor can bind the texture features of the target object to the first skeletal model to obtain the first 3D model. The texture features of the first 3D model are the same as or similar to the texture features of the target object in the first image.

[0261] Optionally, the main processing can be based on various algorithms such as rasterization algorithm, primitive matching algorithm, and shading texture algorithm to obtain the first 3D model based on the texture features of the target object and the first skeleton model.

[0262] Using this method, the electronic device 100 can construct different 3D models based on different target objects selected by the user, and play 3D animations through different 3D models to enhance the user experience.

[0263] Different target objects can refer to target objects of different types, or target objects of the same type but with different texture features.

[0264] Optionally, the electronic device 100 may have a pre-installed network model, and the main processor may also input the first image into the network model and output the first 3D model based on the first image through the network model.

[0265] 2. Electronic device 100 changes the style of 3D animation based on the motion sequence selected by the user.

[0266] In this embodiment, the motion sequence is used by the auxiliary processor to drive the 3D model to execute multiple actions within the motion sequence. In other words, the motion sequence determines the actions of the 3D model in each frame of the 3D animation. Different motion sequences contain different actions, resulting in different styles of 3D animations.

[0267] In some embodiments, the motion sequence may be preset.

[0268] In some embodiments, the electronic device 100 may also receive user input to change the motion sequence in order to change the display style of the 3D animation.

[0269] Figure 4M-Figure 4T This diagram illustrates how an electronic device 100 changes the display style of a 3D animation based on a user-selected motion sequence.

[0270] like Figure 4M As shown, the electronic device 100 can receive swipe operations from the user on various animation options, such as a swipe to the left. In response to the swipe operation, the electronic device 100 can display other animation options that are not currently displayed. For example, the electronic device 100 can display... Figure 4N The always-on display interface shown. Figure 4N The always-on display interface shown is the same as Figure 4M The always-on display interface shown is similar, but the difference is that... Figure 4N The always-on display also shows Animation D, Animation E, and Custom Animation 4011. Below Animation E is Download 4012, which indicates that the electronic device 100 has not downloaded the motion sequence corresponding to Animation E. The user can use Download 4012 to download the motion sequence corresponding to Animation E from the server. The user can use Custom Animation 4011 to generate a motion sequence based on the user-selected video, analyze the video's animation, and obtain the name of the motion sequence.

[0271] Optionally, users can also select videos from the gallery, or capture videos using the camera of the electronic device 100.

[0272] For example, such as Figure 4NAs shown, the electronic device 100 can receive user input for the custom animation option 4011, such as a click operation. In response to the user's input, the electronic device 100 can display... Figure 4O The gallery interface shown. Figure 4O The gallery interface shown displays multiple video covers, such as the cover of video 4013. The user can select any video to generate a motion sequence. For example, the user can select video 4013. In response to selecting video 4013, the electronic device 100 can analyze the motion of the target object in each frame of video 4013 and generate a motion sequence based on the motion of the target object in each frame of video 4013. Before obtaining the motion sequence based on video 4013, the electronic device 100 can display... Figure 4P The prompt message 4014 shown may include the text "Generating a motion sequence based on the user-selected video, please wait...". The prompt message 4014 is used to inform the user that the electronic device 100 is generating a motion sequence.

[0273] After the electronic device 100 generates a motion sequence based on the video 4013, the electronic device 100 can analyze the animation of the video 4013 to obtain the name of the motion sequence generated based on the video 4013, for example, the name could be "Animation F", and display it. Figure 4Q The always-on display interface shown is as follows. Figure 4Q The always-on display interface shown is the same as Figure 4N The always-on display interface shown is similar, but the difference is that... Figure 4Q The always-on display also shows the Animation F option. The motion sequence corresponding to the Animation F option can be obtained by the electronic device 100 from a video selected by the user from the gallery.

[0274] Optionally, in addition to selecting videos from the gallery, the electronic device 100 can also capture videos using a camera and generate motion sequences based on the videos captured by the camera.

[0275] Optionally, if the electronic device 100 is unable to generate a motion sequence based on the video 4013, for example, if the electronic device 100 cannot recognize the target object in the video 4013 or cannot recognize the action of the target object in the video 4013, the electronic device 100 may also prompt the user to select a new video.

[0276] In some embodiments, the server may also have one or more motion sequences pre-configured, and the electronic device 100 may download the motion sequence from the server and store it in the electronic device 100.

[0277] For example, such as Figure 4RAs shown, the electronic device 100 can receive user input for the download option 4012, such as a click operation. In response to the user's input, the electronic device 100 can display... Figure 4S The displayed prompt message 4015 includes the text "Downloading the motion sequence corresponding to animation E, please wait...". Prompt message 4015 is used to inform the user that the electronic device 100 is downloading the motion sequence.

[0278] After the electronic device 100 downloads the motion sequence corresponding to animation E, the electronic device 100 can display it. Figure 4T The always-on display interface shown is as follows. Figure 4T The always-on display interface shown is the same as Figure 4R The always-on display interface shown is similar, but the difference is that... Figure 4T The always-on display interface shown does not include the download option 4012 below the animation F option, which indicates that the motion sequence corresponding to animation E has been downloaded and saved in the electronic device 100.

[0279] 3. Electronic device 100 plays 3D animation in screen-off display mode.

[0280] Upon detecting that the first condition for entering the always-on display state is met, before entering the always-on display state, the main processor of the electronic device 100 may send the first 3D model and one or more motion sequences to the auxiliary processor, wherein the one or more motion sequences include the first motion sequence.

[0281] After the electronic device 100 enters the screen-off display state, the main processor of the electronic device 100 enters a sleep state, while the auxiliary processor of the electronic device 100 enters a running state. The electronic device 100 can play a first 3D animation or a fourth 3D animation through the auxiliary processor. The first 3D animation is obtained by the auxiliary processor based on a first 3D model and a first motion sequence, or the fourth 3D animation is obtained based on a first 3D model and a third motion sequence. The third motion sequence is different from the first motion sequence; the third motion sequence is obtained based on the first motion sequence.

[0282] Figures 5A-5C A schematic diagram of a set of electronic devices 100 playing a first 3D animation is shown.

[0283] like Figure 5A As shown, after the electronic device 100 enters the screen-off display state, the electronic device 100 can display... Figure 5A The user interface shown is Figure 5AThe user interface shown includes display area 501 and display area 502. Display area 501 displays the first animation frame of the first 3D animation. Display area 502 displays the date and time, for example, the date is "Wednesday, August 14th, the 30th day of the third month of the Xin Chou year", and the time is "08:08".

[0284] After the first frame of the first 3D animation is played, the electronic device 100 can sequentially play within the display area 501. Figure 5B The second animation frame in the first 3D animation shown Figure 5C The third animation frame in the first 3D animation shown.

[0285] Optionally, the electronic device 100 can repeatedly play multiple animation frames from the first 3D animation.

[0286] Optional, not limited to Figures 5A-5C The first 3D animation consists of three frames, and it can also include more frames and different display styles. Figures 5A-5C This is for illustrative purposes only and does not constitute a limitation thereof.

[0287] Figures 5D-5E A schematic diagram is shown of another set of electronic devices 100 playing the first 3D animation.

[0288] Figures 5D-5E and Figures 5A-5C Similar, the difference is that, Figures 5D-5E The animation shown is Figures 5A-5C The animations shown are different.

[0289] Figures 5F-5H This diagram illustrates another set of electronic devices 100 playing the first 3D animation.

[0290] Figures 5F-5H and Figures 5A-5C Similar, the difference is that, Figures 5F-5H The animation shown is Figures 5A-5C The animations shown are different. Figures 5F-5H It also includes a display area 503, which displays detailed information about the first music played by the electronic device 100, such as the name of the first music "Song 1", the total duration of the first music "04:42", the playback progress of the first music "00:42", the option to switch to the previous music, the option to switch to the next music, and the option to pause playback.

[0291] In other words, in Figures 5F-5H In the middle, after the electronic device 10 enters the screen-off display state, the electronic device 100 is still playing the first music.

[0292] Optional, Figures 5A-5F The animation shown can be based on Figure 4L The 3D model shown in (c) is obtained by performing multiple actions in the first motion sequence.

[0293] Optional, Figures 5A-5F The animation shown can be executed by a 3D model. Figure 1B The motion sequence shown is obtained from multiple actions.

[0294] Figure 6 A schematic flowchart of a method for an electronic device 100 to play a first 3D animation is shown.

[0295] like Figure 6 As shown, the electronic device 100 may include a lock screen application, a main processor, a secondary processor, and a display. The secondary processor includes an always-on display service, an animation module, and a 3D rendering module (TinyGL).

[0296] The method for an electronic device 100 to play a first 3D animation includes, but is not limited to, the following steps:

[0297] S601A: The first condition for entering the screen-off display state is detected, and the main processor enters sleep state.

[0298] S602A: The first condition for entering the screen-off display state is detected, and the auxiliary processor enters the running state.

[0299] Optionally, the first condition may include, but is not limited to, any of the following triggering methods.

[0300] Triggering method 1: Screen lock is triggered by the power button of the electronic device. For example, when the power button of the electronic device is pressed and released by the user, the electronic device locks the screen and enters the screen-off display state.

[0301] Trigger Method 2: Timeout Screen Lock. When the electronic device's screen remains on for a preset period of time, the electronic device locks its screen and enters a screen-off state.

[0302] Triggering method 3: Screen lock triggered by proximity sensor. During a call, if the proximity sensor detects a face approaching the display screen, the electronic device locks the screen and enters a screen-off display state.

[0303] It should be noted that the first condition can also be triggered by other methods, and this application does not limit this.

[0304] Once the first condition for entering the always-on display state is met, the main processor enters sleep mode, and the auxiliary processor enters running mode. In this way, the auxiliary processor handles the always-on display process, reducing the power consumption of the electronic device by 100%.

[0305] Optionally, S601A and S602A can be executed simultaneously, or S602A can be executed before S601A. This application does not limit this.

[0306] S603A: Before entering sleep mode, the main processor sends a first 3D model and one or more motion sequences to the animation module, the one or more motion sequences including the first motion sequence.

[0307] Before entering sleep mode, the main processor can send a first 3D model and one or more motion sequences to the animation module. The first 3D model and one or more motion sequences are then used by the 3D rendering module (TinyGL) to render the first 3D animation.

[0308] Optionally, after detecting that the first condition for entering the always-on display state is met, before entering the sleep state, the main processor may send the first 3D model and one or more motion sequences to the animation module.

[0309] Optionally, after obtaining the first 3D model, before entering the sleep state, the main processor can send the first 3D model and one or more motion sequences to the animation module.

[0310] This application does not limit the timing of the main processor sending the first 3D model and one or more motion sequences to the animation module.

[0311] Optionally, the first 3D model, one or more motion sequences may be sent from the lock screen application to the secondary processor via the main processor.

[0312] Optionally, the first 3D model can be a pre-set 3D model, or a 3D model generated based on a user-selected image or an image captured by the electronic device 100 via a camera, showing the target object. The electronic device 100 can extract the type and texture features of the target object from the image, determine a first skeletal model based on the type of the target object, and then obtain the first 3D model based on the first skeletal model and the texture features of the target object. Optionally, different types of target objects can have different skeletal models, and therefore different 3D models. For example, refer to... Figures 4C-4L Description in the embodiments.

[0313] Optionally, one or more motion sequences can be preset motion sequences in the electronic device 100, motion sequences obtained by analyzing video selected by the user or video captured by the electronic device 100 through a camera, or motion sequences downloaded by the electronic device 100 from a server upon receiving user input. For example, refer to... Figure 4M-Figure 4T Description in the embodiments.

[0314] S604A, the animation module, obtains the first motion sequence from one or more motion sequences.

[0315] The S605A animation module sends the first 3D model, the first motion sequence, or the third motion sequence to the 3D rendering module (TinyGL), where the third motion sequence is obtained based on the first motion sequence.

[0316] Once the first condition for entering the always-on display state is met, the main processor can send the first 3D model, one or more motion sequences, to the animation module.

[0317] After acquiring one or more motion sequences, the animation module can obtain a first motion sequence from them. The animation module then sends the first 3D model and the first motion sequence to the 3D rendering module (TinyGL).

[0318] Optionally, the first motion sequence can be a default motion sequence, or it can be determined by the animation module from one or more motion sequences based on the first information.

[0319] For details on how the animation module determines the first motion sequence from one or more motion sequences based on the first information, please refer to [link to documentation]. Figures 8A-8D Description in the embodiments.

[0320] In some embodiments, the animation module can acquire third information and a first motion sequence, and adjust the first motion sequence based on the third information to obtain a third motion sequence. The third motion sequence is different from the first motion sequence, and is obtained based on the first motion sequence. The animation module then sends the first 3D model and the first motion sequence to the 3D rendering module (TinyGL).

[0321] The S606A 3D rendering module (TinyGL) generates a first 3D animation based on a first 3D model and a first motion sequence, or generates a fourth 3D animation based on a first 3D model and a third motion sequence.

[0322] The first 3D model is used to determine the style of the 3D model in each frame of the final generated first 3D animation, and the first motion sequence or the third motion sequence is used to determine the motion of the 3D model in each frame of the final generated first 3D animation.

[0323] After receiving the first 3D model, first motion sequence, or third motion sequence sent by the animation module, the 3D rendering module (TinyGL) can obtain a first 3D animation based on the first 3D model and first motion sequence, or obtain a fourth 3D animation based on the first 3D model and third motion sequence.

[0324] The S607A 3D rendering module (TinyGL) sends the first or fourth 3D animation to the monitor.

[0325] S608A, the monitor plays either the first or fourth 3D animation.

[0326] After acquiring the first 3D animation, the auxiliary processor can send the first 3D animation to the display (or screen), and the display can play the first 3D animation.

[0327] For example, the first 3D animation could be Figures 5A-5C The animation frames shown.

[0328] In some embodiments, before playing the first 3D animation, the electronic device 100 may display the first frame of the first 3D animation. Upon detecting a user touch event or a user gaze event on the display screen, the electronic device 100 will then play the remaining frames of the first 3D animation. Thus, when no user touch event or user gaze event is detected, the electronic device 100 only displays the first frame of the first 3D animation; after detecting a user touch event or user gaze event, the electronic device 100 continues playing the remaining frames of the first 3D animation, saving power consumption.

[0329] For example, a user's touch event on the display screen can refer to a user's click, swipe, long press, or other actions on the display screen.

[0330] In some embodiments, the electronic device 100 may play the first piece of music before entering the always-on display state. After the electronic device 100 enters the always-on display state, since the main processor has entered hibernation mode, the electronic device 100 may play the first piece of music through the secondary processor.

[0331] Figure 7A schematic diagram of the method for an electronic device 100 to play a first piece of music and a first 3D animation after entering a screen-off display state is shown.

[0332] like Figure 7 As shown, the electronic device 100 may include a lock screen application, a main processor, a secondary processor, and a display. The secondary processor includes an animation module and a 3D rendering module (TinyGL).

[0333] The method by which electronic device 100 plays the first piece of music and the first 3D animation includes, but is not limited to, the following steps:

[0334] S601B, Electronic Device 100 executes S601A-S608A.

[0335] In S601B, if the first condition for entering the screen-off display state is detected, the main processor of the electronic device 100 enters a sleep state, and the auxiliary processor of the electronic device 100 enters a running state. Before the main processor of the electronic device 100 enters the sleep state, the main processor of the electronic device 100 can send a first 3D model and one or more motion sequences to the auxiliary processor. The auxiliary processor can obtain a first 3D animation based on the first 3D model, the first motion sequence, or the third motion sequence, and display the first 3D animation on the display screen. For a description of S601B, please refer to the descriptions in S601A-S608A.

[0336] Before entering hibernation mode, the S602B main processor sends the first music file to the auxiliary processor.

[0337] Before entering hibernation, the main processor can send the first music file to the animation module.

[0338] Optionally, after detecting that the first condition for entering the always-on display state is met, the main processor may send the first music file to the animation module before entering the sleep state.

[0339] This application does not limit the timing of when the main processor sends the first music file to the animation module.

[0340] If the electronic device 100 is playing the first piece of music before detecting that the first condition for entering the always-on display state is met, the electronic device 100 can continue playing the first piece of music after entering the always-on display state. Optionally, before entering the always-on display state, the electronic device 100 plays the first piece of music through the main processor. However, after entering the always-on display state, the processor will enter the always-on display state. In order to allow the electronic device 100 to continue playing the first piece of music, before entering the always-on display state, the main processor of the electronic device 100 can send the first piece of music file to the auxiliary processor of the electronic device 100, and the auxiliary processor of the electronic device 100 will continue playing the first piece of music.

[0341] Therefore, upon detecting that the first condition for entering the screen-off display state is met, the main processor can send the first music file to the auxiliary processor before the main processor of the electronic device 100 enters the hibernation state.

[0342] S603B, the auxiliary processor plays the first music based on the first music file.

[0343] After receiving the first music file sent by the main processor of the electronic device 100, the auxiliary processor of the electronic device 100 can play the first music based on the first music file. The main processor of the electronic device 100 then stops playing the first music file.

[0344] Optionally, the main processor of the electronic device 100 can also send the playback progress of the first music to the auxiliary processor of the electronic device 100, and the auxiliary processor of the electronic device 100 can play the first music based on the first music file according to the playback progress of the first music.

[0345] Optionally, S602B can be executed simultaneously with S603A, or S602B can be executed before S603A, or S602B can be executed after S603A.

[0346] The following section describes how the auxiliary processor determines the first motion sequence from one or more motion sequences based on the first information.

[0347] To enhance the versatility of the first 3D animation played by the electronic device 100 after the screen is turned off and then on again, the always-on display service receives first information sent by the hardware layer, confirms a response event based on the first information, and then sends the response event to the animation module. The response event is used by the animation module to determine the first motion sequence from multiple motion sequences. The animation module then obtains the first 3D animation based on the first 3D model and the first motion sequence.

[0348] For example, the first information could be image data captured by a camera, and the response event could be a user's facial expression / emotion.

[0349] For example, the first information could be first sensor data collected by a sensor on the display screen, and the response event could be the type of user operation.

[0350] For example, the first information could be second sensor data collected by a motion sensor, and the response event could be the user's motion state.

[0351] For example, the first information could be the first music file, and the response event could be the music genre of the first music.

[0352] 1. The first piece of information can be image data captured by the camera, and the response event can be the first facial expression / emotion.

[0353] Figure 8A A schematic diagram is shown of an auxiliary processor of an electronic device 100 determining a first motion sequence from one or more motion sequences based on a first expression / emotion.

[0354] like Figure 8A As shown, the electronic device 100 may include a secondary processor, a camera, and a display screen. The secondary processor includes an always-on display service, an animation module, and a 3D rendering module (TinyGL).

[0355] The method by which the auxiliary processor of electronic device 100 determines a first motion sequence from one or more motion sequences based on a first facial expression / emotion includes, but is not limited to, the following steps:

[0356] The camera of S801A, electronic device 100, acquires the first image data.

[0357] Optionally, the camera of the electronic device 100 can capture the first image data after the electronic device 100 enters the screen-off display state, which can save the power consumption of the electronic device 100.

[0358] For example, the camera may be the front-facing camera of an electronic device 100.

[0359] The camera of S802A, electronic device 100, sends the first image data to the always-on display service.

[0360] S803A, the Always-on Display service determines the first emotion / expression based on the first image data.

[0361] S804A, Always-on Display service sends the first emotion / expression to the animation module.

[0362] The S805A animation module determines the first motion sequence from multiple motion sequences based on the first emotion / expression.

[0363] The Always-on Display service can identify facial images in the first image data and determine the first emotion / expression of that facial image.

[0364] After determining the first emotion / expression, the always-on display service sends the first emotion / expression to the animation module. The animation module can determine the first motion sequence from one or more motion sequences based on the first emotion / expression.

[0365] For example, the first emotion / expression can include, but is not limited to, any of the following: joy, surprise, sadness, anger, disgust, and fear. Different emotions / expressions can correspond to different motion sequences. For instance, when the first emotion / expression is joy, the first motion sequence can be light and cheerful; when the first emotion / expression is sadness, the first motion sequence can be somber and heavy. Through this method, the electronic device 100 can match different styles of motion sequences based on the user's different emotions / expressions to generate 3D animations of different styles, enhancing the diversity of 3D animation playback on the electronic device 100 and improving the user experience.

[0366] For example, if the first emotion / expression is pleasant, then the first movement sequence can be of a brisk style. Figures 5A-5C and Figures 5F-5G The animation shown is based on a light and fast-paced motion sequence.

[0367] For example, if the first emotion / expression is sadness, then the first movement sequence can be in a somber style. Figures 5E-5F The animation shown is based on a heavy-style motion sequence.

[0368] In some embodiments, if the user's emotion / expression is not recognized, the animation module can determine a default motion sequence from one or more motion sequences. The animation module can then send this default motion sequence to the 3D rendering module (TinyGL), which can generate a 3D animation based on the default motion sequence. For example, the default motion sequence could be a fifth motion sequence, which may be the same as or different from the first motion sequence.

[0369] The S806A animation module sends the first motion sequence to the 3D rendering module (TinyGL).

[0370] The S807A and the 3D rendering module (TinyGL) generate a first 3D animation based on the first 3D model and the first motion sequence.

[0371] The S808A and the 3D rendering module (TinyGL) send the first 3D animation to the display screen.

[0372] S809A, the display screen plays the first 3D animation.

[0373] After acquiring the first motion sequence, the animation module sends the first motion sequence to the 3D rendering module (TinyGL). The 3D rendering module (TinyGL) can obtain the first 3D animation based on the first 3D model and the first motion sequence, and then send the first 3D animation to the display screen, where the display screen plays the first 3D animation.

[0374] In some embodiments, the camera of the electronic device 100 may include a front-facing camera, which can capture image data and send it to an always-on display service. The always-on display service can identify the user's eye movement direction based on the image data captured by the camera, and instruct the animation module to change the movement direction of the 3D model based on the user's eye movement direction, so that the movement direction of the 3D model can change with the change of the user's eye movement direction.

[0375] 2. The first information can be the first sensor data collected by the sensor on the display screen, and the response event can be the first operation type.

[0376] In some embodiments, the first sensor data may also be referred to as interactive data.

[0377] Figure 8B A schematic diagram is shown of an auxiliary processor of an electronic device 100 determining a first motion sequence from one or more motion sequences based on a first operation type.

[0378] like Figure 8B As shown, the electronic device 100 may include a secondary processor and a display screen. The secondary processor includes an always-on display service, an animation module, and a 3D rendering module (TinyGL).

[0379] The method by which the auxiliary processor of electronic device 100 determines a first motion sequence from one or more motion sequences based on a first operation type includes, but is not limited to, the following steps:

[0380] The S801B electronic device 100's display screen acquires data from the first sensor.

[0381] Optionally, the display screen of the electronic device 100 can collect the first sensor data after the electronic device 100 enters the screen-off display state, which can save the power consumption of the electronic device 100.

[0382] Optionally, the display screen of the electronic device 100 is equipped with one or more sensors, which can collect data from the first sensor and determine the operating area and operation type of the user on the display screen based on the first sensor data.

[0383] For example, one or more sensors may include, but are not limited to, any one or more of the following: touch sensors (e.g., Figure 2 The sensor shown includes a touch sensor (180K), a vision sensor, and an infrared sensor.

[0384] The S802B and the display screen of the electronic device 100 send the first sensor data to the always-on display service.

[0385] S803B, Always-on Display Service determines the first operation type based on the first sensor data.

[0386] S804B, the Always-on Display service sends the first operation type to the animation module.

[0387] S805B, the animation module, determines a first motion sequence from one or more motion sequences based on a first operation type.

[0388] The always-on display service can identify the operation type in the first sensor data, such as the first operation type, and then, based on the first operation type, determine the first motion sequence from one or more motion sequences.

[0389] The first operation type can include, but is not limited to, any of the following: click, long press, swipe, pinch, rotate, swipe, pan, etc. Different types of user operations correspond to different motion sequences. When the first operation type is a click, the electronic device 100 can play a 3D animation based on the motion sequence corresponding to the click operation. When the first operation type is a long press, the electronic device 100 can play a 3D animation based on the motion sequence corresponding to the long press operation. When the first operation type is a swipe, the electronic device 100 can play a 3D animation based on the motion sequence corresponding to the swipe operation. When the first operation type is a rotation, the electronic device 100 can play a 3D animation based on the motion sequence corresponding to the rotation operation. Through this method, the electronic device 100 can obtain different motion sequences based on different user operations applied to the display screen to generate different 3D animations, improving the diversity of 3D animation playback and enhancing the user experience.

[0390] For example, when the first operation type is a click operation, Figures 5A-5C and Figures 5F-5G The animation shown is based on the motion sequence corresponding to the click operation.

[0391] For example, when the first operation type is a long press, Figures 5D-5E The animation shown is based on the motion sequence corresponding to the long press operation.

[0392] In some embodiments, the always-on display service can also determine the user operation area based on the first sensor data. If the user operation area is within the 3D animation display area, the always-on display service further identifies the user operation type. If the user operation area is not within the 3D animation display area, the animation module may not identify the user operation type. The animation module can determine a default motion sequence from one or more motion sequences and send the default motion sequence to the 3D rendering module (TinyGL).

[0393] In some embodiments, if no user operation type is identified based on the first sensor data, the animation module can determine a default motion sequence from one or more motion sequences. The animation module can then send the default motion sequence to the 3D rendering module (TinyGL), which can generate a 3D animation based on the default motion sequence.

[0394] The S806B animation module sends the first motion sequence to the 3D rendering module (TinyGL).

[0395] The S807B and the 3D rendering module (TinyGL) generate the first 3D animation based on the first 3D model and the first motion sequence.

[0396] The S808B and the 3D rendering module (TinyGL) send the first 3D animation to the display screen.

[0397] S809B, the display screen plays the first 3D animation.

[0398] After acquiring the first motion sequence, the animation module sends the first motion sequence to the 3D rendering module (TinyGL). The 3D rendering module (TinyGL) can obtain the first 3D animation based on the first 3D model and the first motion sequence, and then send the first 3D animation to the display screen, where the display screen plays the first 3D animation.

[0399] 3. The first information is the second sensor data collected by the motion sensor, and the response event can be the first motion type.

[0400] In some embodiments, the second sensor data may also be referred to as biometric data, which includes, but is not limited to, heart rate, steps, exercise duration, calories burned, etc.

[0401] Figure 8C A schematic diagram is shown of an auxiliary processor of an electronic device 100 determining a first motion sequence from one or more motion sequences based on a first motion type.

[0402] like Figure 8C As shown, the electronic device 100 may include a secondary processor, a motion sensor, and a display screen. The secondary processor includes an always-on display service, an animation module, and a 3D rendering module (TinyGL).

[0403] The method by which the auxiliary processor of electronic device 100 determines a first motion sequence from one or more motion sequences based on a first motion type includes, but is not limited to, the following steps:

[0404] The motion sensor of the S801C electronic device 100 acquires data from the second sensor.

[0405] Optionally, after the electronic device 100 enters the screen-off display state, the motion sensor of the electronic device 100 can collect data from the second sensor, which can save power consumption of the electronic device 100.

[0406] Optionally, the electronic device 100 is equipped with one or more motion sensors, which can collect data from the second sensor and determine the user's movement type based on the second sensor data.

[0407] For example, one or more motion sensors may include, but are not limited to, accelerometers, gyroscopes, etc.

[0408] The motion sensor of S802C electronic device 100 sends the second sensor data to the always-on display service.

[0409] The S803C Always-on Display service determines the first motion type based on data from the second sensor.

[0410] S804C, Always-on Display service sends the first motion type to the animation module.

[0411] The S805C animation module determines a first motion sequence from one or more motion sequences based on a first motion type.

[0412] The always-on display service can identify the motion type corresponding to the second sensor data, such as the first motion type, and then determine the first motion sequence from one or more motion sequences based on the first motion type.

[0413] For example, the first type of motion may include, but is not limited to, any of the following: a stationary state, a moving state, etc.

[0414] For example, the movement state can be further divided into any of the following: walking, running, cycling, dancing, playing football, playing basketball, playing tennis, playing badminton, etc.

[0415] When the first motion type is a stationary state, the electronic device 100 can play a 3D animation based on the motion sequence corresponding to the stationary state. When the first motion type is a moving state, the electronic device 100 can play a 3D animation based on the motion sequence corresponding to the moving state. Through this method, the electronic device 100 can obtain different motion sequences based on different motion types to generate different 3D animations, thus increasing the diversity of 3D animation playback and improving the user experience.

[0416] For example, when the first type of motion is a stationary state, Figures 5A-5C and Figures 5F-5G The animation shown is based on the motion sequence corresponding to the static state.

[0417] For example, when the first type of motion is a motion state, Figures 5D-5E The animation shown is based on the motion sequence corresponding to the motion state.

[0418] Optionally, electronic device 100 may not execute S802C and S803C. Electronic device 100 may establish a communication connection with other electronic devices (such as wearable devices). Other electronic devices may collect second sensor data and send the second sensor data to electronic device 100 through the communication connection.

[0419] Different motion types correspond to different motion sequences. Using this method, the electronic device 100 can obtain different motion sequences based on different motion types to generate different 3D animations, thus increasing the diversity of 3D animation playback on the electronic device 100 and improving the user experience.

[0420] In some embodiments, if no user operation type is identified based on the second sensor data, the animation module can determine a default motion sequence from one or more motion sequences. The animation module can then send the default motion sequence to the 3D rendering module (TinyGL), which can generate a 3D animation based on the default motion sequence.

[0421] The S806C animation module sends the first motion sequence to the 3D rendering module (TinyGL).

[0422] The S807C and the 3D rendering module (TinyGL) generate the first 3D animation based on the first 3D model and the first motion sequence.

[0423] The S808C and the 3D rendering module (TinyGL) send the first 3D animation to the display screen.

[0424] S809C, the display screen plays the first 3D animation.

[0425] After acquiring the first motion sequence, the animation module sends the first motion sequence to the 3D rendering module (TinyGL). The 3D rendering module (TinyGL) can obtain the first 3D animation based on the first 3D model and the first motion sequence, and then send the first 3D animation to the display screen, where the display screen plays the first 3D animation.

[0426] 4. The first piece of information is the first music file, and the response event can be the music type of the first music file.

[0427] Figure 8D A schematic diagram is shown of an auxiliary processor of an electronic device 100 determining a first motion sequence from one or more motion sequences based on the music type of a first piece of music.

[0428] like Figure 8D As shown, the electronic device 100 may include a secondary processor, a memory, and a display screen. The secondary processor includes an always-on display service, an animation module, and a 3D rendering module (TinyGL).

[0429] The method by which the auxiliary processor of electronic device 100 determines a first motion sequence from one or more motion sequences based on the music genre of a first piece of music includes, but is not limited to, the following steps:

[0430] The S801D and memory send the first music file to the always-on display service.

[0431] S802D, Always-on Display Service obtains the first music type of the first music file based on the first music file.

[0432] In some embodiments, after the electronic device 100 enters a screen-off display state, the electronic device 100 can play the first music. Since the main processor has entered a sleep state, the main processor can send the first music file to the auxiliary processor, and the auxiliary processor can continue playing the first music based on the first music file.

[0433] The storage device can send the first music file to the Always-on Display service. After obtaining the first music file, the Always-on Display service can determine the first music genre based on the first music file.

[0434] S803D and Always-on Display Service send the first music type of the first music to the animation module.

[0435] The S804D animation module determines the first motion sequence from multiple motion sequences based on the first music type.

[0436] The always-on display service can identify the music genre corresponding to the first piece of music being played by the secondary processor, such as the first music genre. The animation module can determine the first motion sequence from one or more motion sequences based on the first music genre.

[0437] For example, the first music genre may include, but is not limited to, any of the following: classical music, popular music, folk music, etc.

[0438] Different music genres correspond to different motion sequences. Using this method, the electronic device 100 can obtain different motion sequences based on different music genres to generate different 3D animations, thus increasing the diversity of 3D animation playback on the electronic device 100 and enhancing the user experience.

[0439] For example, when the primary music genre is pop music, Figures 5F-5G The animation shown is based on the motion sequences corresponding to popular music.

[0440] For example, when the primary music genre is classical music, Figures 5D-5E The animation shown is based on motion sequences corresponding to classical music. (Optional) Figures 5D-5E The music information being played by electronic device 100 is not shown in the image.

[0441] In some embodiments, if the music type of the first music is not identified, the animation module can determine a default motion sequence from one or more motion sequences. The animation module can then send the default motion sequence to the 3D rendering module (TinyGL), which can generate a 3D animation based on the default motion sequence.

[0442] The S805D animation module sends the first motion sequence to the 3D rendering module (TinyGL).

[0443] The S806D and 3D rendering module (TinyGL) generate the first 3D animation based on the first 3D model and the first motion sequence.

[0444] The S807D 3D rendering module (TinyGL) sends the first 3D animation to the display screen.

[0445] The S808D display plays the first 3D animation.

[0446] After acquiring the first motion sequence, the animation module sends the first motion sequence to the 3D rendering module (TinyGL). The 3D rendering module (TinyGL) can obtain the first 3D animation based on the first 3D model and the first motion sequence, and then send the first 3D animation to the display screen, where the display screen plays the first 3D animation.

[0447] In some embodiments, the auxiliary processor can acquire first information, determine a first motion sequence from one or more motion sequences based on the first information, and obtain a first 3D animation based on the first motion sequence and a first 3D model. After the electronic device 100 enters a screen-off display state, the information acquired by the electronic device 100 changes. The electronic device 100 can acquire second information, determine a third motion sequence from one or more motion sequences based on the second information, and obtain a third 3D animation based on the third motion sequence and the first 3D model. If the second information is the same as the first information, then the third motion sequence is different from the first motion sequence, and the first 3D animation and the second 3D animation are the same. If the second information is different from the first information, then the first 3D animation and the third 3D animation are different.

[0448] For example, after the electronic device 100 enters the screen-off display state, the auxiliary processor can acquire first information, which may be first image data captured by the camera. Based on the first image data, the auxiliary processor can identify the user's expression / emotion as cheerful, and if so, the style of the first motion sequence is cheerful, and the first 3D animation is obtained based on a cheerful-style motion sequence. Subsequently, if the user's expression / emotion changes, the auxiliary processor can acquire second information, which may be second image data captured by the camera. Based on the second image data, the auxiliary processor can identify the user's expression / emotion as sad, and if so, the style of the third motion sequence is sad, and the third 3D animation is obtained based on a sad-style motion sequence.

[0449] For example, after the electronic device 100 enters the screen-off display state, the auxiliary processor can acquire first information, which may be first image data captured by the camera. Based on the first image data, the auxiliary processor can identify the user's expression / emotion as cheerful, and thus the style of the first motion sequence is cheerful. The first 3D animation is obtained based on the cheerful-style motion sequence. Subsequently, if the electronic device 100 detects a long-press operation by the user on the display screen, the auxiliary processor can acquire second information, which may be interaction data collected by the auxiliary processor. Based on the interaction data, the auxiliary processor can identify the user's long-press operation, and the third 3D animation is obtained based on the motion sequence corresponding to the long-press operation.

[0450] In some embodiments, the auxiliary processor can also acquire the music information of the first music and adjust the default motion sequence (e.g., the third motion sequence) based on the music information of the first music to obtain the adjusted motion sequence (e.g., the first motion sequence), so that the adjusted motion sequence matches the music information of the first music. Then, the 3D animation obtained by the auxiliary processor based on the adjusted motion sequence also matches the music information of the first music, improving the effect of the 3D animation played by the electronic 100 and enhancing the user's visual and auditory experience.

[0451] Figure 8E A schematic diagram is shown of an auxiliary processor of an electronic device 100 obtaining a first motion sequence based on music information of a first piece of music and a third motion sequence.

[0452] like Figure 8E As shown, the electronic device 100 may include a secondary processor and a display screen. The secondary processor includes an always-on display service, an animation module, and a 3D rendering module (TinyGL).

[0453] The method by which the auxiliary processor of electronic device 100 obtains the first motion sequence based on the music information of the first music and the third motion sequence includes, but is not limited to, the following steps:

[0454] The S801E animation module determines the first motion sequence from one or more motion sequences.

[0455] Optionally, the first motion sequence can be the default motion sequence.

[0456] Optionally, the first motion sequence can also be determined from one or more motion sequences based on the first information. For example, the first information could be... Figure 8A The first emotion / expression or the first piece of information shown can be Figure 8B The first user operation and the first information shown can be Figure 8C The first motion type and the first information shown can be Figure 8D The first music type shown, etc.

[0457] S802E, Always-on Display service obtains music information of the first song currently playing.

[0458] In some embodiments, after the electronic device 100 enters a screen-off display state, the electronic device 100 can play the first music. Since the main processor has entered a sleep state, the main processor can send the first music file to the auxiliary processor, and the auxiliary processor can continue playing the first music based on the first music file.

[0459] The Always-on Display service can obtain the first music file and, based on the first music file, obtain the music information of the first music.

[0460] For example, the musical information of the first piece of music may include, but is not limited to, any of the following: rhythm, beat, intensity, etc.

[0461] The music information of First Music may also include other information, which is not limited in this application.

[0462] The S803E always-on display service sends the music information of the first track to the animation module.

[0463] The S804E animation module adjusts the first motion sequence based on the music information of the first music to obtain the third motion sequence.

[0464] After obtaining the first motion sequence and the music information of the first piece of music, the animation module can adjust the first motion sequence based on the music information of the first piece of music to obtain the third motion sequence. The third motion sequence is different from the first motion sequence.

[0465] The S805E animation module sends the third motion sequence to the 3D rendering module (TinyGL).

[0466] The S806E and the 3D rendering module (TinyGL) use the first 3D model and the third motion sequence to obtain the fourth 3D animation.

[0467] The S807E and 3D rendering module (TinyGL) send the fourth 3D animation to the display screen.

[0468] S808E, the display screen plays the fourth 3D animation.

[0469] After acquiring the third motion sequence, the animation module sends it to the 3D rendering module (TinyGL). The 3D rendering module (TinyGL) can then generate a fourth 3D animation based on the first 3D model and the third motion sequence, and send the fourth 3D animation to the display screen for playback.

[0470] In this way, the animation module can adjust the third motion sequence based on the rhythm, beat, and intensity of the music being played on the electronic device 100, so that the adjusted motion sequence (e.g., the first motion sequence) matches the rhythm, beat, and intensity of the music being played on the electronic device 100. Then, the 3D animation obtained by the auxiliary processor based on the first motion sequence also matches the rhythm, beat, and intensity of the music being played on the electronic device 100, improving the effect of the 3D animation played by the electronic device 100 and enhancing the user's visual and auditory experience.

[0471] Figure 9 This is a flowchart illustrating a screen-off display method provided in this application.

[0472] S901. When the electronic device is in a screen-off display state, the auxiliary processor plays a first 3D animation. The first 3D animation includes multiple animation frames and is obtained by the auxiliary processor based on the first 3D model.

[0473] S902. When the secondary processor is playing the first 3D animation, the main processor is in sleep mode.

[0474] After the electronic device's screen is off, the auxiliary processor runs while the main processor enters sleep mode. The electronic device can use the auxiliary processor to drive the movement of the first 3D model and render the first 3D animation. The auxiliary processor can display 3D animations with the screen off, improving the display effect of the electronic device in screen-off mode. Furthermore, the fact that the main processor is in sleep mode and the electronic device renders 3D animations through the auxiliary processor also saves power consumption.

[0475] Optionally, the first condition may include, but is not limited to, any of the following triggering methods.

[0476] Triggering method 1: Screen lock is triggered by the power button of the electronic device. For example, when the power button of the electronic device is pressed and released by the user, the electronic device locks the screen and enters the screen-off display state.

[0477] Trigger Method 2: Timeout Screen Lock. When the electronic device's screen remains on for a preset period of time, the electronic device locks its screen and enters a screen-off state.

[0478] Triggering method 3: Screen lock triggered by proximity sensor. During a call, if the proximity sensor detects a face approaching the display screen, the electronic device locks the screen and enters a screen-off display state.

[0479] It should be noted that the first condition can also be triggered by other methods, and this application does not limit this.

[0480] Optionally, the first 3D model can be sent from the main processor to the secondary processor, or it can be stored in the secondary processor.

[0481] Optionally, if the user does not change the first 3D model, the main processor only needs to send the first 3D model to the auxiliary processor once. It is not necessary to send the first 3D model every time the electronic device enters the always-on display state. The auxiliary processor can use the first 3D model previously sent by the main processor and stored in the auxiliary processor. After the user changes the first 3D model, the main processor then sends the changed first 3D model to the auxiliary processor, and the auxiliary processor then uses the most recently sent first 3D model from the main processor.

[0482] For example, the UI for the secondary processor playing the first 3D animation can be referenced. Figures 5A-5C , Figures 5D-5E Description in the embodiments.

[0483] In one possible implementation, the method further includes: in response to a user's selection of a second 3D model, when the electronic device is in a screen-off display state, a secondary processor plays a second 3D animation, the second 3D animation comprising multiple animation frames, the second 3D animation being processed by the secondary processor based on the second 3D model; while the secondary processor plays the second 3D animation, the main processor is in the sleep state.

[0484] Optionally, 3D models and motion sequences can be related. Different 3D models can use different motion sequences, resulting in different 3D animations.

[0485] Optionally, the 3D model and the motion sequence may not be related. Different 3D models can use the same motion sequence, so different 3D models can produce the same 3D animation.

[0486] Optionally, the second 3D model can be different from the first 3D model, and the second 3D animation can be the same as or different from the first 3D animation. Different 3D models can play the same animation or different animations.

[0487] In one possible implementation, the first 3D model or the second 3D model is a preset 3D model; or, the first 3D model or the second 3D model is obtained by the main processor based on an image or video selected by the user.

[0488] In this way, users can change to their preferred 3D model to improve the always-on display effect and enhance the user experience.

[0489] For an example of how users can change 3D models, please refer to [link / reference]. Figures 4A-4L Description in the embodiments.

[0490] In one possible implementation, the first 3D animation is obtained by the auxiliary processor based on the first 3D model and the first motion sequence.

[0491] In one possible implementation, the method further includes: the main processor sending a first 3D model and one or more motion sequences to an auxiliary processor, the one or more motion sequences including the first motion sequence or the second motion sequence; the auxiliary processor generating a first animation based on the first 3D model and the first motion sequence, or the auxiliary processor generating a fifth animation based on the first 3D model and the second motion sequence.

[0492] In this way, the coprocessor can generate different animations based on the same 3D model through different motion sequences.

[0493] Optionally, the main processor may send only the first motion sequence or the second motion sequence from one or more motion sequences to the auxiliary processor.

[0494] Optionally, the main processor can also send one or more motion sequences to the auxiliary processor.

[0495] In one possible implementation, the second 3D animation is obtained by the auxiliary processor based on the second 3D model and the first motion sequence.

[0496] In this way, the coprocessor can generate different animations based on different 3D models using the same motion sequence.

[0497] In one possible implementation, the first motion sequence is either user-selected or the default motion sequence.

[0498] In this way, the auxiliary processor can generate the first 3D animation based on the motion sequence selected by the user, or it can generate the first 3D animation based on the default motion sequence to be used.

[0499] In one possible implementation, before the auxiliary processor plays the first 3D animation, the method further includes: the auxiliary processor acquiring first information, the first information including any one of the following: image data captured by the camera, biometric data, interaction data, and a first music file, the first music file being a music file played after the electronic device enters a screen-off display state; the auxiliary processor obtaining the first 3D animation based on the first information.

[0500] Optionally, the image data captured by the camera may include facial images, eye movements, etc.

[0501] Optional biometric data may include heart rate, steps, exercise duration, calories burned, etc.

[0502] Optionally, the interaction data may include user operation data on the display screen collected by sensors pre-installed in the display screen.

[0503] In this way, the auxiliary processor obtains the first 3D animation based on the first information, enriching the diversity of 3D animation playback by the auxiliary processor.

[0504] In one possible implementation, the method further includes: a secondary processor acquiring second information, which includes any one of the following: image data captured by a camera, biometric data, interaction data, and a second music file; the secondary processor determining a second 3D animation based on the second information, wherein the second information is different from the first information, and the second 3D animation is different from the first 3D animation.

[0505] Optionally, if the first information changes, for example, if the auxiliary processor obtains the second information, the auxiliary processor can obtain a second 3D animation based on the second information. When the second information is the same as the first information, the second 3D animation is the same as the first 3D animation. When the second information is different from the first information, the second 3D animation is different from the first 3D animation.

[0506] In this way, the 3D animation played by the coprocessor changes as the information acquired by the coprocessor changes, enriching the diversity of 3D animation played by the coprocessor.

[0507] For details on how the coprocessor obtains the first 3D animation based on the first information, and how the coprocessor obtains the second 3D animation based on the second information, please refer to [reference needed]. Figures 8A-8D Description in the embodiments.

[0508] In one possible implementation, the first 3D animation is obtained by the auxiliary processor based on the first 3D model and the first motion sequence; the auxiliary processor determines the first 3D animation based on first information, specifically including: the auxiliary processor determines a first response event based on the first information; the auxiliary processor determines a first motion sequence from one or more motion sequences based on the first response event; the auxiliary processor obtains the first 3D animation based on the first motion sequence and the first 3D model.

[0509] Optionally, when the first information includes image data captured by the camera, the first response event includes a first facial expression / emotion.

[0510] When the first information includes biometric data, the first response event includes the first operation type.

[0511] When the first information includes interactive data, the first response event includes the first motion type.

[0512] When the first information includes the first music file, the first response event includes the music genre of the first music.

[0513] For information on how the coprocessor determines the first motion sequence based on the first information, please refer to [reference needed]. Figures 8A-8D Description in the embodiments.

[0514] In one possible implementation, the method further includes: a secondary processor determining a first response event based on the first information; the secondary processor determining a first motion sequence from one or more motion sequences based on the first response event; the secondary processor acquiring third information; the secondary processor obtaining a third motion sequence based on the third information and the first motion sequence; and the secondary processor obtaining a fourth 3D animation based on the third motion sequence and the first 3D model.

[0515] In this way, the auxiliary processor can modify the first motion sequence determined by the auxiliary processor based on the third information, thereby changing the style of the first 3D animation played by the auxiliary processor and further enriching the diversity of 3D animation played by the auxiliary processor.

[0516] For example, the third information may be the music information of the first piece of music played by the auxiliary processor. The music information of the first piece of music may include, but is not limited to, any of the following: the rhythm, beat, intensity, etc. of the first piece of music.

[0517] The third information may include other information, not limited to the musical information of the first piece of music. This application does not limit this information.

[0518] For information on how the coprocessor obtains the first motion sequence based on the third information and the second motion sequence, please refer to [reference needed]. Figure 8E Description in the embodiments.

[0519] In one possible implementation, before detecting that the first condition for entering the always-on display state is met, the method further includes: the main processor playing a first piece of music; after detecting that the first condition for entering the always-on display state is met, the method further includes: the secondary processor continuing to play the first piece of music based on the first music file.

[0520] In this way, the main processor plays the first track before the electronic device enters the always-on display state. After the electronic device enters the always-on display state, the secondary processor can play the first track.

[0521] Optionally, before the main processor enters sleep mode, the main processor may also send the first music file to the secondary processor, allowing the secondary processor to continue playing the first music.

[0522] For example, the UI for the secondary processor playing the first piece of music and the first 3D animation can be referenced. Figures 5F-5H Description in the embodiments.

[0523] In one possible implementation, the secondary processor plays a first 3D animation, specifically including: if the user is not recognized, the secondary processor displays the first frame of the first 3D animation; if the user is recognized, the secondary processor continues to play the remaining frames of the first 3D animation.

[0524] In this way, when no user touch event or gaze event on the display screen is detected, the electronic device only displays the first frame of the first 3D animation. After the user touch event or gaze event on the display screen is detected, the electronic device continues to play the animation frames of the first 3D animation, which can save the power consumption of the electronic device.

[0525] For example, a user's touch event on the display screen can refer to a user's click, swipe, long press, or other actions on the display screen.

[0526] In one possible implementation, the first motion sequence is a preset motion sequence; or, the first motion sequence is obtained by the main processor based on one or more actions performed by a target object in a first video selected by the user; or, the first motion sequence is downloaded by the main processor from a server.

[0527] In this way, users can also change their preferred motion sequences to improve the always-on display effect and enhance the user experience.

[0528] For example, you can refer to [link / reference] for how a user can change motion sequences. Figure 4N-Figure 4T Description in the embodiments.

[0529] This application provides an electronic device, including a main processor and a secondary processor, which are used to implement... Figure 9 This illustrates a screen-off display method.

[0530] This application provides an electronic device, which includes a memory and a processor. The memory stores a computer program, and the processor invokes the computer program to cause the electronic device to perform... Figure 9 This illustrates a screen-off display method.

[0531] This application provides an apparatus, including a unit or module for performing any of the methods in the first aspect, or for performing... Figure 9 This illustrates a screen-off display method.

[0532] This application provides a readable storage medium storing a program or instructions that, when executed on a device, cause the electronic device to perform... Figure 9 This illustrates a screen-off display method.

[0533] This application provides a chip system, which includes one or more processors, the processors being used to invoke computer instructions to cause a first electronic device to perform... Figure 9 This illustrates a screen-off display method.

[0534] This application provides a program product, a computer program product containing computer instructions that, when executed on an electronic device, cause the electronic device to perform... Figure 9 This illustrates a screen-off display method.

[0535] The electronic device 100 to which this application embodiment can be applied may, for example, include, but is not limited to, devices equipped with... Or electronic devices with other operating systems.

[0536] The electronic device 100 in this application embodiment can realize human-computer interaction.

[0537] The electronic device 100 in this embodiment has at least two processors, one of which is a main processor and the other is a secondary processor. The main processor runs a main operating system, and the secondary processor runs a lightweight operating system.

[0538] The electronic device 100 in this application embodiment may have one or more displays. Taking a single-screen electronic device with one display as an example, the single-screen electronic device may be a single-screen candybar phone, tablet computer, etc. Taking a dual-screen electronic device with two displays as an example, the dual-screen electronic device may be a foldable screen phone, dual-screen candybar phone, etc.

[0539] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer program or instructions are loaded and executed on a computer, the processes or functions described in the embodiments of this application are performed entirely or partially. The computer can be a general-purpose computer, a special-purpose computer, a computer network, a network device, a user equipment, or other programmable device. The computer program or instructions can be stored in a computer-readable storage medium or transferred from one computer-readable storage medium to another. For example, the computer program or instructions can be transferred from one website, computer, server, or data center to another website, computer, server, or data center via wired or wireless means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium, such as a floppy disk, hard disk, or magnetic tape; it can also be an optical medium, such as a digital video optical disc; or it can be a semiconductor medium, such as a solid-state drive. The computer-readable storage medium may be a volatile or non-volatile storage medium, or may include both types of storage media.

[0540] In the various embodiments of this application, unless otherwise specified or in case of logical conflict, the terminology and / or descriptions of different embodiments are consistent and can be referenced by each other. The technical features of different embodiments can be combined to form new embodiments according to their inherent logical relationship.

[0541] In this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. In the textual description of this application, the character " / " generally indicates an "or" relationship between the preceding and following related objects; in the formulas of this application, the character " / " indicates a "division" relationship between the preceding and following related objects. "Including at least one of A, B, and C" can mean: including A; including B; including C; including A and B; including A and C; including B and C; including A, B, and C.

[0542] It is understood that the various numerical designations used in the embodiments of this application are merely for descriptive convenience and are not intended to limit the scope of the embodiments of this application. The order of the process numbers described above does not imply the order of execution; the execution order of each process should be determined by its function and internal logic.

Claims

1. A method for displaying a screen when it is off, characterized in that, The method is applied to an electronic device, the electronic device comprising a main processor and an auxiliary processor; the method comprising: In a case where the electronic device is in an off-screen display state, the auxiliary processor plays a first 3D animation, the first 3D animation comprising a plurality of animation frames, the first 3D animation being obtained by the auxiliary processor based on a first 3D model; In a case where the auxiliary processor plays the first 3D animation, the main processor is in a hibernation state.

2. The method of claim 1, wherein, The method further comprises: In response to an operation of selecting a second 3D model by a user, in a case where the electronic device is in the off-screen display state, the auxiliary processor plays a second 3D animation, the second 3D animation comprising a plurality of animation frames, the second 3D animation being obtained by the auxiliary processor based on a second 3D model; In a case where the auxiliary processor plays the second 3D animation, the main processor is in the hibernation state.

3. The method of claim 2, wherein, The first 3D model or the second 3D model is a preset 3D model. Alternatively, The first 3D model or the second 3D model is obtained by the main processor based on a picture or a video selected by a user.

4. The method according to any one of claims 1 to 3, characterized in that, The first 3D animation is obtained by the auxiliary processor based on the first 3D model and a first motion sequence.

5. The method according to any one of claims 1 to 3, characterized in that, The method further comprises: The main processor sends the first 3D model and one or more motion sequences to the auxiliary processor, the one or more motion sequences comprising the first motion sequence or a second motion sequence; The auxiliary processor generates the first animation based on the first 3D model and the first motion sequence, or generates a fifth animation based on the first 3D model and the second motion sequence.

6. The method according to claim 2 or 3, characterized in that, The second 3D animation is obtained by the auxiliary processor based on the second 3D model and the first motion sequence.

7. The method according to any one of claims 4-6, characterized in that, The first motion sequence is a motion sequence selected by a user or a default motion sequence.

8. The method according to any one of claims 1 to 7, characterized in that, Before the auxiliary processor plays the first 3D animation, the method further comprises: The auxiliary processor obtains first information, the first information comprising any one of the following: image data collected by a camera, biometric data, interaction data, and a first music file, the first music file being a music file played after the electronic device enters the off-screen display state; The auxiliary processor obtains the first 3D animation based on the first information.

9. The method of claim 8, wherein, The method further comprises: The auxiliary processor obtains second information, the second information comprising any one of the following: image data collected by a camera, biometric data, interaction data, and a second music file; The auxiliary processor determines a third 3D animation based on the second information, the second information being different from the first information, and the third 3D animation being different from the first 3D animation.

10. The method according to claim 8 or 9, characterized in that, The first 3D animation is obtained by the auxiliary processor based on the first 3D model and a first motion sequence. The auxiliary processor obtains the first 3D animation based on the first information, specifically comprising: The auxiliary processor determines a first response event based on the first information; The auxiliary processor determines the first motion sequence from the one or more motion sequences based on the first response event; The auxiliary processor obtains the first 3D animation based on the first motion sequence and the first 3D model.

11. The method of claim 10, wherein, The method further comprises: The auxiliary processor determines a first response event based on the first information; The auxiliary processor determines a first motion sequence from the one or more motion sequences based on the first response event; The auxiliary processor obtains third information; The auxiliary processor obtains the third motion sequence based on the third information and the first motion sequence; The auxiliary processor obtains a fourth 3D animation based on the third motion sequence and the first 3D model.

12. The method according to claim 10 or 11, characterized in that, When the first information comprises image data captured by the camera, the first response event comprises a first expression / emotion; When the first information comprises the biometric data, the first response event comprises a first operation type; When the first information comprises the interaction data, the first response event comprises a first motion type; When the first information comprises the first music file, the first response event comprises a music type of the first music.

13. The method of claim 11, wherein, The third information comprises music information of the first music, and the music information of the first music comprises any one or more of: a first rhythm, a first beat, and a first intensity.

14. The method according to any one of claims 1 to 13, characterized in that, Before detecting that the first condition for entering the screen-off display state is met, the method further comprises: The main processor plays first music; After detecting that the first condition for entering the screen-off display state is met, the method further comprises: The auxiliary processor continues to play the first music based on the first music file.

15. The method according to any one of claims 1 to 14, characterized in that, The auxiliary processor plays a first 3D animation, specifically comprising: In a case where no user is identified, the auxiliary processor displays a first frame of animation frame in the first 3D animation; In a case where a user is identified, the auxiliary processor continues to play remaining animation frames in the first 3D animation.

16. The method of claim 15, wherein, Wherein, The case where the auxiliary processor identifies a user comprises any one or more of: the auxiliary processor identifies a user voiceprint, the auxiliary processor identifies a user fingerprint, the auxiliary processor identifies a user facial image, and the auxiliary processor identifies an operation of the user on the display screen.

17. The method according to any one of claims 1 to 16, characterized in that, The one or more motion sequences are preset motion sequences; Or, The one or more motion sequences are obtained by the main processor based on one or more actions of a target object in a first video selected by a user; Or, The one or more motion sequences are downloaded by the main processor from a server.

18. An electronic device, comprising: The electronic device comprises a memory and a processor, wherein the memory is configured to store a computer program, and the processor is configured to invoke the computer program, so that the electronic device executes the method in any one of claims 1-17.

19. A computer readable storage medium comprising instructions, wherein: When the instructions are run on the electronic device, the electronic device executes the method in any one of claims 1-17.

20. A computer program product, characterised in that, The computer program product comprises computer instructions, when the computer instructions are run on the electronic device, the electronic device executes the method in any one of claims 1-17.

Images