Always-on display method, electronic device and readable storage medium

Abstract

Provided in the embodiments of the present application are an always-on display method, an electronic device and a readable storage medium. The method is applied to an electronic device, wherein the electronic device comprises a main processor and an auxiliary processor. The method comprises: when an electronic device is in an always-on display state, an auxiliary processor playing a first 3D animation, wherein the first 3D animation comprises a plurality of animation frames, and the first 3D animation is obtained by means of the auxiliary processor performing processing on the basis of a first 3D model; and when the auxiliary processor plays the first 3D animation, a main processor being in a sleep state. The display effect of an electronic device in an always-on display mode is improved, and the power consumption of the electronic device is also reduced.

Description

Screen-off display method, electronic device and readable storage medium

[0001] The present application claims priority to the Chinese patent application No. 202411400975.3, filed on September 30, 2024, with the State Intellectual Property Office of China, and entitled "Screen-off display method, electronic device and readable storage medium", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the technical field of terminal, and in particular to a screen-off display method, an electronic device and a readable storage medium. BACKGROUND

[0003] Terminal devices (such as mobile phones) are being used more and more widely because they can provide rich and intelligent services.

[0004] In order to reduce the power consumption of electronic devices and reduce the occurrence of accidental touch, the electronic device can enter a screen-off display state when it has not been operated for a long time. After the electronic device enters the screen-off display state, in order to reduce power consumption, the terminal device can use a low-power screen-off display mode, such as an AOD (always on display) display mode, to control the screen to light up locally to display some important information, such as time, date, etc., without lighting up the entire screen. However, the display effect of the electronic device in the AOD display mode is currently single, and how to improve the display effect of the electronic device is a technical problem to be solved at present. SUMMARY

[0005] The present application provides a screen-off display method, an electronic device and a readable storage medium. The electronic device includes a secondary processor, which is in a running state after the electronic device is turned off. The electronic device can drive a first 3D model to move through the secondary processor to render a first 3D animation. The secondary processor can display the 3D animation in a screen-off state, which improves the display effect of the electronic device in the screen-off display mode. Moreover, the electronic device renders the 3D animation through the secondary processor, which also saves the power consumption of the electronic device.

[0006] In a first aspect, the present application provides a screen-off display method. The method is applied to an electronic device, which includes a primary processor and a secondary processor. The method includes: playing, by the secondary processor, a first 3D animation in a screen-off display state of the electronic device, the first 3D animation including a plurality of animation frames, the first 3D animation being processed by the secondary processor according to a first 3D model; and putting, by the primary processor, the primary processor into a hibernation state while the secondary processor plays the first 3D animation.

[0007] After the electronic device is turned off, the auxiliary processor is in a running state, and the main processor enters a sleep state. The electronic device can drive the first 3D model to move through the auxiliary processor, and render the first 3D animation. The auxiliary processor can display the 3D animation in the off-screen display mode, thereby improving the display effect of the electronic device in the off-screen display mode. In addition, the main processor enters the sleep state, and the electronic device renders the 3D animation through the auxiliary processor, thereby saving the power consumption of the electronic device.

[0008] Optionally, the first condition can include, but is not limited to, any one of the following triggering manners.

[0009] Triggering manner 1: The screen is locked by the power key of the electronic device. For example, when the power key of the electronic device is pressed and then lifted by the user, the electronic device is locked and enters the off-screen display state.

[0010] Triggering manner 2: The screen is locked when the time length of the display screen in the on-screen state reaches the preset time length. For example, when the time length of the display screen in the on-screen state reaches the preset time length, the electronic device is locked and enters the off-screen display state.

[0011] Triggering manner 3: The screen is locked by the distance sensor. For example, during a call, if the distance sensor detects that the face is close to the display screen, the electronic device is locked and enters the off-screen display state.

[0012] It should be noted that the first condition can also be other triggering manners, which are not limited in the present application.

[0013] Optionally, the first 3D model can be sent to the auxiliary processor by the main processor. Alternatively, the first 3D model can be stored in the auxiliary processor.

[0014] Optionally, if the user does not replace the first 3D model, the main processor only needs to send the first 3D model to the auxiliary processor once. The main processor does not need to send the first 3D model every time the electronic device enters the off-screen display state. The auxiliary processor can use the first 3D model sent by the main processor and stored in the auxiliary processor. After the user replaces the first 3D model, the main processor sends the replaced first 3D model to the auxiliary processor, and the auxiliary processor uses the first 3D model sent by the main processor.

[0015] For example, the UI of the auxiliary processor playing the first 3D animation can refer to the description in the embodiments of FIGS. 5A-5C and FIGS. 5D-5E.

[0016] With reference to the first aspect, in a possible implementation manner, the method further includes: in response to the operation of selecting the second 3D model by the user, playing, by the auxiliary processor, the second 3D animation in a case where the electronic device is in an off-screen display state, the second 3D animation including a plurality of animation frames, the second 3D animation being obtained by the auxiliary processor based on the second 3D model; and in the playing of the second 3D animation by the auxiliary processor, the main processor is in the sleep state.

[0017] Optionally, the second 3D model is different from the first 3D model, and the second 3D animation and the first 3D animation can be the same or different. Different 3D models can play the same animation or different animations.

[0018] Optionally, the 3D model and the motion sequence can have an association relationship. Different 3D models can use different motion sequences, and then different 3D models obtain different 3D animations.

[0019] Optionally, the 3D model and the motion sequence can have no association relationship. Different 3D models can use the same motion sequence, and then different 3D models obtain the same 3D animation.

[0020] With reference to the first aspect, in a possible implementation manner, the first 3D model or the second 3D model is a preset 3D model; or the first 3D model or the second 3D model is obtained by the main processor based on a picture or a video selected by the user.

[0021] In this way, the user can replace the 3D model that the user likes, so as to improve the off-screen display effect and improve the user experience.

[0022] For example, how the user operates to replace the 3D model can refer to the description in the embodiments of FIGS. 4A-4L.

[0023] With reference to the first aspect, in a possible implementation manner, the first 3D animation is obtained by the auxiliary processor based on the first 3D model and the first motion sequence.

[0024] With reference to the first aspect, in a possible implementation manner, the method further includes: sending, by the main processor, the first 3D model and one or more motion sequences to the auxiliary processor, the one or more motion sequences including the first motion sequence or a second motion sequence; and generating, by the auxiliary processor, the first animation based on the first 3D model and the first motion sequence, or generating, by the auxiliary processor, a fifth animation based on the first 3D model and the second motion sequence.

[0025] In this way, the auxiliary processor can generate different animations based on the same 3D model through different motion sequences.

[0026] Optionally, the main processor can also send only the first motion sequence or the second motion sequence in the one or more motion sequences to the auxiliary processor.

[0027] Optionally, the main processor can also send all the one or more motion sequences to the auxiliary processor.

[0028] With reference to the first aspect, in a possible implementation, the second 3D animation is obtained by the auxiliary processor based on the second 3D model and the first motion sequence.

[0029] In this way, the auxiliary processor can generate different animations based on different 3D models through the same motion sequence.

[0030] With reference to the first aspect, in a possible implementation, the first motion sequence is a user-selected or default motion sequence.

[0031] In this way, the auxiliary processor can generate the first 3D animation based on a user-selected motion sequence, and the auxiliary processor can also generate the first 3D animation based on a default motion sequence to be used.

[0032] With reference to the first aspect, in a possible implementation, before the auxiliary processor plays the first 3D animation, the method further includes: the auxiliary processor obtaining first information, the first information including any one of the following: image data collected by a camera, biological feature data, interaction data, and a first music file, the first music file being a music file played after the electronic device enters an off-screen display state; and the auxiliary processor obtaining the first 3D animation based on the first information.

[0033] Optionally, the image data collected by the camera can include a face image, eye movement, etc.

[0034] Optionally, the biological feature data can include heart rate, step count, motion duration, calorie consumption, etc.

[0035] Optionally, the interaction data can include operation data of a user on a display screen collected by a sensor preinstalled in the display screen.

[0036] In this way, the auxiliary processor obtains the first 3D animation based on the first information, which enriches the diversity of the auxiliary processor playing 3D animations.

[0037] With reference to the first aspect, in a possible implementation, the method further includes: the auxiliary processor obtaining second information, the second information including any one of the following: image data collected by a camera, biological feature data, interaction data, and a second music file; and the auxiliary processor determining a second 3D animation based on the second information, the second information being different from the first information, and the second 3D animation being different from the first 3D animation.

[0038] Optionally, if the first information changes, for example, the secondary processor obtains second information, the secondary processor can obtain a second 3D animation based on the second information. When the second information is the same as the first information, the second 3D animation is the same as the first 3D animation. When the second information is different from the first information, the second 3D animation is different from the first 3D animation.

[0039] In this way, the 3D animation played by the secondary processor changes with the information obtained by the secondary processor, enriching the diversity of the 3D animation played by the secondary processor.

[0040] For how the secondary processor obtains the first 3D animation based on the first information and how the secondary processor obtains the second 3D animation based on the second information, refer to the description in the embodiments of FIGS. 8A-8D.

[0041] In combination with the first aspect, in a possible implementation, the first 3D animation is obtained by the secondary processor based on the first 3D model and a first motion sequence; the secondary processor determines the first 3D animation based on the first information, specifically including: the secondary processor determines a first response event based on the first information; the secondary processor determines the first motion sequence from one or more motion sequences based on the first response event; and the secondary processor obtains the first 3D animation based on the first motion sequence and the first 3D model.

[0042] Optionally, when the first information includes image data collected by a camera, the first response event includes a first expression / emotion.

[0043] When the first information includes biological feature data, the first response event includes a first operation type.

[0044] When the first information includes interaction data, the first response event includes a first motion type.

[0045] When the first information includes a first music file, the first response event includes a music type of the first music.

[0046] For how the secondary processor determines the first motion sequence based on the first information, refer to the description in the embodiments of FIGS. 8A-8D.

[0047] In combination with the first aspect, in a possible implementation, the method further includes: the secondary processor determines a first response event based on the first information; the secondary processor determines a first motion sequence from one or more motion sequences based on the first response event; the secondary processor obtains third information; the secondary processor obtains a third motion sequence based on the third information and the first motion sequence; and the secondary processor obtains a fourth 3D animation based on the third motion sequence and the first 3D model.

[0048] In this way, the auxiliary processor can change the first motion sequence determined by the auxiliary processor based on the third information, so as to change the style of the first 3D animation played by the auxiliary processor, and further enrich the diversity of the auxiliary processor playing the 3D animation.

[0049] For example, the third information can be music information of the first music played by the auxiliary processor, and the music information of the first music can include, but is not limited to, any one of the following: rhythm, beat, intensity, etc. of the first music.

[0050] The third information is not limited to the music information of the first music, and can also include other information, which is not limited in the present application.

[0051] For how the auxiliary processor obtains the third motion sequence based on the third information and the first motion sequence, reference can be made to the description in the embodiment of FIG. 8E.

[0052] In combination with the first aspect, in a possible implementation, before detecting that the first condition for entering the screen-off display state is met, the method further includes: playing, by the main processor, the first music; and after detecting that the first condition for entering the screen-off display state is met, the method further includes: continuing, by the auxiliary processor, to play the first music based on the first music file.

[0053] In this way, the main processor plays the first music before the electronic device enters the screen-off display state. After the electronic device enters the screen-off display state, the auxiliary processor can play the first music.

[0054] Optionally, before the main processor enters the sleep state, the main processor is further configured to send the first music file to the auxiliary processor, so that the auxiliary processor can continue to play the first music.

[0055] For example, the UI in which the auxiliary processor plays the first music and the first 3D animation can refer to the description in the embodiments of FIGS. 5F-5H.

[0056] In combination with the first aspect, in a possible implementation, the auxiliary processor plays the first 3D animation, specifically including: displaying, by the auxiliary processor, a first frame of animation frame in the first 3D animation in a case where the user is not recognized; and continuing, by the auxiliary processor, to play the remaining animation frames in the first 3D animation in a case where the user is recognized.

[0057] In this way, when the touch event of the user on the display screen is not recognized or the gaze event of the user on the display screen is not recognized, the electronic device only displays the first frame of animation frame in the first 3D animation, and after the touch event of the user on the display screen is recognized or the gaze event of the user on the display screen is recognized, the electronic device continues to play the animation frames in the first 3D animation, which can save the power consumption of the electronic device.

[0058] For example, the touch event of the user on the display screen can refer to a click operation, a sliding operation, a long press operation, and the like of the user on the display screen.

[0059] In a possible implementation of the first aspect, the first motion sequence is a preset motion sequence, or the first motion sequence is obtained based on one or more actions of the target object in the first video selected by the user, or the first motion sequence is downloaded from a server by the main processor.

[0060] In this way, the user can also replace the motion sequence that the user likes, so as to improve the screen-off display effect and improve the user experience.

[0061] For example, how the user replaces the motion sequence can refer to the description in the embodiments of FIGS. 4N-4T.

[0062] In the second aspect, the present application provides an electronic device, including a main processor and an auxiliary processor, and the main processor and the auxiliary processor are used to implement the method in any one of the first aspect.

[0063] In the third aspect, the present application provides an electronic device, including a memory and a processor, wherein the memory is used to store a computer program, and the processor is used to call the computer program, so that the electronic device executes the method in any one of the first aspect.

[0064] In the fourth aspect, the present application provides an apparatus, including a unit or module used to execute the method in any one of the first aspect, or the unit or module used to execute the method in any one of the first aspect.

[0065] In the fifth aspect, the present application provides a readable storage medium, and the readable storage medium stores a program or instructions, when the program or instructions are executed on the apparatus, so that the electronic device executes the method in any one of the first aspect.

[0066] In the sixth aspect, the present application provides a chip system, and the chip system includes one or more processors, and the processor is used to call computer instructions to make the first electronic device execute the method in any one of the first aspect.

[0067] In the seventh aspect, the present application provides a program product, and the computer program product includes computer instructions, when the computer instructions are executed on the electronic device, so that the electronic device executes the method in any one of the first aspect.

[0068] For the beneficial effects of the second aspect to the seventh aspect, refer to the beneficial effects of the first aspect, and the present application will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0069] FIG. 1A is a schematic diagram illustrating how the main processor and the auxiliary processor obtain a first 3D animation in an electronic device 100 according to the present application;

[0070] FIG. 1B is a schematic diagram illustrating a first motion sequence;

[0071] FIG. 2 is a schematic diagram illustrating the hardware structure of an electronic device 100 according to the present application;

[0072] FIG. 3A is a software structure block diagram of an electronic device 100 according to an embodiment of the present application;

[0073] FIG. 3B is a schematic diagram illustrating the software interaction of an electronic device 100 receiving user operation to generate a first 3D model;

[0074] FIG. 3C is a schematic diagram illustrating the software interaction of an electronic device 100 playing a first 3D animation;

[0075] FIG. 4A-FIG. 4J are schematic diagrams illustrating how the electronic device 100 determines the style of the 3D model based on the picture selected by the user;

[0076] FIG. 4K is a schematic diagram illustrating the method of how the electronic device 100 determines the style of the 3D model based on the picture selected by the user;

[0077] FIG. 4L is a schematic diagram illustrating several different types of target objects corresponding to the skeleton model;

[0078] FIG. 4M-FIG. 4T are schematic diagrams illustrating how the electronic device 100 changes the display style of the 3D animation based on the motion sequence selected by the user;

[0079] FIG. 5A-FIG. 5C are schematic diagrams illustrating a group of electronic devices 100 playing a first 3D animation;

[0080] FIG. 5D-FIG. 5E are schematic diagrams illustrating another group of electronic devices 100 playing a first 3D animation;

[0081] FIG. 5F-FIG. 5H are schematic diagrams illustrating yet another group of electronic devices 100 playing a first 3D animation;

[0082] FIG. 6 is a schematic diagram illustrating the method of how an electronic device 100 plays a first 3D animation;

[0083] FIG. 7 is a schematic diagram illustrating the method of how an electronic device 100 plays a first music and a first 3D animation after entering the screen-off display state;

[0084] FIG. 8A-FIG. 8E are schematic diagrams illustrating how several auxiliary processors obtain a first motion sequence;

[0085] FIG. 9 is a schematic diagram illustrating the method of a screen-off display method according to the present application. DETAILED DESCRIPTION

[0086] The technical solutions in the embodiments of the present application will be described clearly and exhaustively below with reference to the drawings. In the description of the embodiments of the present application, unless otherwise specified, " / " represents the meaning of or, for example, A / B can represent A or B; the "and / or" in the text only describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can represent three cases of A alone, A and B together, and B alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0087] Hereinafter, the terms "first" and "second" are only used for description purposes, and cannot be understood as implying or suggesting relative importance or implicitly indicating the number of indicated technical features. Therefore, the features defined with "first" and "second" can explicitly or implicitly include one or more of the features, and in the description of the embodiments of the present application, unless otherwise specified, the meaning of "multiple" is two or more than two.

[0088] The term "user interface (UI)" in the following embodiments of the present application is a medium interface for interaction and information exchange between an application (APP) or an operating system and a user, which realizes the conversion between the internal form of information and the form that the user can accept. The user interface is source code written in specific computer languages such as java and extensible markup language (XML), and the interface source code is parsed, rendered, and finally presented as content that can be recognized by the user on the electronic device. The commonly used form of user interface is graphic user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be a visual interface element such as text, icon, button, menu, tab, text box, dialog box, status bar, navigation bar, Widget, etc. displayed in the display screen of the electronic device.

[0089] First, the technical terms related to the present application are explained.

[0090] 1. Main processor and auxiliary processor.

[0091] In an electronic device having a main processor and an auxiliary processor, the main processor, such as an application processor (AP), typically a CPU, is used to perform most of the processing operations. The auxiliary processor, also referred to as a co-processor, is a processor specially used to cooperate with the main processor to complete certain computing tasks. For example, the auxiliary processor can include a microcontroller unit (MCU), a digital signal processor (DSP), etc. For example, the auxiliary processor can be a SensorHub (SensorHub is a low-power MCU). The auxiliary processor can also be a small core in a system on chip (SoC). The auxiliary processor generally has lower performance, lower bottom current, higher energy efficiency, and lower power consumption compared to the main processor.

[0092] Optionally, in an embodiment of the present application, the auxiliary processor can include one or more of the following components: a communication component (such as a low-power Bluetooth communication component), a power system, a navigation positioning system related component (such as including a positioning system protocol stack), a near field communication component, a graphical code payment related component, a call service related component, a short message related component, an always on display (AOD) related component, etc. The navigation positioning system can include a global navigation satellite system (GNSS), etc., and embodiments of the present application do not limit this.

[0093] 2. A main operating system and a lightweight operating system.

[0094] In an embodiment of the present application, the main processor in the electronic device can be loaded with a main operating system, and the auxiliary processor can be loaded with a lightweight operating system (LiteOS, or lightweight operating system). The main operating system and the lightweight operating system are relatively independent. For example, the main operating system can be Operating system The lightweight operating system can be a Harmony Lite OS, such as a Harmony L3 or later version, which can be used as a main operating system. For example, the main operating system can be an Android system The lightweight operating system can be an Android Lite OS. For example, the main operating system can be a Microsoft operating system The lightweight operating system can be a Microsoft Lite OS.

[0095] Compared with the main operating system, the lightweight operating system refers to a kind of small and flexible, small, fast running and convenient operating system. Compared with the main operating system, the lightweight operating system has less function and relatively small resource consumption, thereby saving system resources and improving system efficiency.

[0096] For an application, it can run on the main operating system or run on the lightweight operating system. When it runs on the lightweight operating system, the system resources (such as including memory) it occupies may be less than when it runs on the main operating system. When an application runs on the lightweight operating system, it can only implement part of the function of the application. For example, for an audio player, when it runs on the lightweight operating system, it can only implement the functions of playing, pausing playing, playing the previous one and playing the next one, and cannot implement the function of selecting music albums provided by the audio player. Therefore, the application running on the lightweight operating system can also be called a simple version application.

[0097] 3, screen-off display.

[0098] AOD display, full name Always On Display, is a screen-off display technology that can control the local screen to light up to display some important information such as time, weather, message notification, etc. without turning on the whole screen. Optionally, the content of the AOD display can be constantly changed in position on the screen to avoid the risk of screen burn caused by long-term maintenance of the screen-off display mode. In some embodiments of the present application, in the AOD display mode, the user interface of the application program such as wallpaper can also be displayed full screen.

[0099] The AOD display technology is based on the characteristics of the OLED screen, so that part of the information can be obtained in the standby interface, and it has the advantage of low power consumption. OLED is the English abbreviation of organic light-emitting diode or organic electroluminescence display, that is, organic light-emitting diode or organic electroluminescence display (or organic light-emitting semiconductor display). The black area of the OLED screen does not consume power, and only the display in the non-black area will consume power.

[0100] AOD display can also be called screen-off display or screen-out display. The embodiments of the present application take screen-off display as an example for description.

[0101] In the embodiments of the present application, when the electronic device is in the screen-off display mode, the main processor of the electronic device is dormant, and the auxiliary processor of the electronic device is running. In the screen-off display mode, the interface displayed on the screen of the electronic device is displayed and processed by the auxiliary processor.

[0102] The electronic device 100 includes a main processor and an auxiliary processor. In order to improve the screen-off display effect, when it is detected that the electronic device 100 meets a first condition for entering a screen-off display state, before the electronic device 100 enters the screen-off display state, the main processor of the electronic device 100 can send a first 3D model and a first motion sequence to the auxiliary processor.

[0103] After the electronic device 100 enters the screen-off display state, the main processor of the electronic device 100 is in a sleep state, and the electronic device 100 can render a first 3D animation based on the first 3D model and the first motion sequence through the auxiliary processor, and play the first 3D animation. The first 3D animation includes a plurality of animation frames.

[0104] The first motion sequence includes a plurality of actions, and the first motion sequence is used to drive the first 3D model to perform the plurality of actions in the first motion sequence to obtain the first 3D animation.

[0105] In this way, on the one hand, after the electronic device 100 enters the screen-off display state, the main processor of the electronic device 100 enters the sleep state, and the screen-off display processing is performed by the auxiliary processor of the electronic device 100, which can reduce the power consumption of the electronic device 100. And the auxiliary processor is based on the first motion sequence and the first 3D model to render the first 3D animation, which can further save the power consumption of the electronic device 100. On the other hand, the electronic device 100 can play the first 3D animation in the screen-off display state, which can improve the screen-off display effect of the electronic device 100.

[0106] Optionally, the first motion sequence can be a default motion sequence, and the first motion sequence can be sent by the main processor to the auxiliary processor.

[0107] Optionally, the main processor can also send more motion sequences to the auxiliary processor, and the auxiliary processor can obtain the first information and determine the first motion sequence from the plurality of motion sequences based on the first information.

[0108] For example, the first information can include but is not limited to any one or several of the following: user expression / emotion, user operation type, user motion state, and music type of the music played by the electronic device 100.

[0109] The first information is different, and the first motion sequence is also different. In this way, the diversity of the screen-off animation played by the electronic device 100 can be realized.

[0110] Optionally, determining the first motion sequence can include, after obtaining the first motion sequence, the main processor can also adjust the first motion sequence based on third information to obtain a third motion sequence.

[0111] For example, the third information can include, but is not limited to, music information of the music played by the electronic device 100, and the music information of the music played by the electronic device 100 can include, but is not limited to, any one or more of the following: a rhythm, a tempo, an intensity, and the like of the music played by the electronic device 100.

[0112] FIG. 1A is a schematic diagram of how a main processor and an auxiliary processor in an electronic device 100 obtain a first 3D animation according to the present application.

[0113] As shown in FIG. 1A, the electronic device 100 includes a main processor and an auxiliary processor.

[0114] The main processor is configured to obtain a first 3D model based on a first picture selected by a user or based on a preset picture or obtain a preset first 3D model, and send the first 3D model and a first motion sequence to the auxiliary processor. The auxiliary processor is configured to drive the first 3D model to perform an action in the first motion sequence based on the first 3D model and the motion sequence sent by the main processor, and obtain a first 3D animation.

[0115] FIG. 1A shows two ways in which the main processor obtains a first 3D model based on a first picture.

[0116] In the first way, the main processor can generate a first 3D model based on a first picture.

[0117] Optionally, the main processor is preset with a network model that can generate a first 3D model based on a first picture.

[0118] Optionally, the main processor can also send the first picture to a server or other device, and the server or other device is preset with a network model that can generate a first 3D model based on a first picture.

[0119] In the second way, the main processor can identify a type of a target object in a first picture and a texture feature of the target object in the first picture based on the first picture, and generate a first 3D model based on the type of the target object in the first picture and the texture feature of the target object in the first picture.

[0120] The type of the target object can refer to a type to which the target object belongs, such as a person (e.g., a child, an adult, a male, a female), an animal (e.g., an animal cat, an animal dog, an animal bird), and the like. Different types of target objects correspond to different skeletal models, such as a skeletal model of a person and a skeletal model of an animal. Different skeletal models of different persons are different, such as a skeletal model of a child and a skeletal model of an adult, and a skeletal model of a male and a skeletal model of a female. Different skeletal models of different animals are different, such as a skeletal model of an animal cat and a skeletal model of an animal dog.

[0121] After obtaining the type of the target object in the first picture, the main processor can determine a skeleton model corresponding to the type of the target object from a plurality of preset skeleton models, for example, a first skeleton model, based on the type of the target object. For example, if the main processor identifies that the type of the target object in the first picture is an animal cat, the first skeleton model can be a skeleton model corresponding to the animal cat. For example, if the main processor identifies that the type of the target object in the first picture is an animal bird, the first skeleton model can be a skeleton model corresponding to the animal bird.

[0122] The texture feature of the target object can refer to a corresponding relationship between a surface feature of the target object and a filling position of the surface feature of the target object on the first skeleton model. For example, the surface feature of the target object can include but is not limited to a surface color of the target object, a surface pattern of the target object, and the like.

[0123] In some embodiments, the texture feature of the target object can be represented by a texture map and a skin matrix. The texture map can represent the surface feature of the target object. The skin matrix can represent a corresponding relationship between the surface feature of the target object and a filling position of the surface feature of the target object on the first skeleton model.

[0124] After obtaining the texture feature of the target object in the first picture and the first skeleton model, the main processor can obtain a first 3D model based on the texture feature of the target object in the first picture and the first skeleton model. The first 3D model can be understood as a three-dimensional model. The first 3D model can reflect the shape, size, and texture feature of the target object in different directions in a three-dimensional space. The texture feature of the first 3D model is the same as or similar to the texture feature of the target object in the first picture. The skeleton of the first 3D model is the same as or similar to the skeleton corresponding to the target object in the first picture. The three-dimensional target object is more realistic than the two-dimensional target object. The animation obtained based on the three-dimensional target object is also more realistic, and the display effect is better.

[0125] The electronic device 100 also has one or more motion sequences, for example, a first motion sequence, preset. The motion sequence includes a plurality of different actions, and the motion sequence is used to determine the action of the 3D model in each animation frame of the finally generated 3D animation.

[0126] FIG. 1B shows a schematic diagram of a first motion sequence.

[0127] The first motion sequence includes a plurality of different actions, as shown in (a) of FIG. 1B, (b) of FIG. 1B, (c) of FIG. 1B, (d) of FIG. 1B, and (e) of FIG. 1B. The first 3D model can perform actions similar to those shown in (a) of FIG. 1B, (b) of FIG. 1B, (c) of FIG. 1B, (d) of FIG. 1B, and (e) of FIG. 1B to obtain a first 3D animation. The actions performed by the first 3D model in each frame of the first 3D animation are similar to those shown in (a) of FIG. 1B, (b) of FIG. 1B, (c) of FIG. 1B, (d) of FIG. 1B, and (e) of FIG. 1B.

[0128] The main processor can send the first motion sequence and the first 3D model to the auxiliary processor.

[0129] The auxiliary processor can obtain a first 3D animation based on the first 3D model and the first motion sequence. The first 3D animation includes a plurality of animation frames, and the first 3D model in the first 3D animation moves based on the plurality of different actions in the first motion sequence.

[0130] In other embodiments, the main processor can send other motion sequences to the auxiliary processor in addition to the first motion sequence. The auxiliary processor can obtain the first information and determine the first motion sequence from the plurality of motion sequences based on the first information.

[0131] In other embodiments, the auxiliary processor can obtain the first motion sequence and third information, adjust the first motion sequence based on the third information to obtain a third motion sequence, and obtain a fourth 3D animation based on the first 3D model and the third motion sequence.

[0132] In this way, after the electronic device 100 enters the screen-off display state, the screen-off display processing is performed by the auxiliary processor of the electronic device 100, which can effectively reduce the power consumption of the electronic device 100. Moreover, the auxiliary processor renders the first 3D animation based on the preset first motion sequence and the first 3D model, which can further save the power consumption of the electronic device 100. On the other hand, the electronic device 100 plays the first 3D animation in the screen-off display state, which also improves the display effect of the electronic device 100.

[0133] FIG. 2 shows a hardware structure diagram of an electronic device 100 provided in the present application.

[0134] The electronic device 100 can be a mobile phone, a tablet computer, a notebook computer, a netbook, a smart screen, a vehicle-mounted device, and a business intelligent terminal (including a video phone, a conference table intelligent terminal, etc.), a personal digital assistant (PDA), an augmented reality (AR) \ virtual reality (VR) device, an artificial intelligence (AI) device, etc. The electronic device 100 can also be other electronic devices, such as a laptop computer having a touch-sensitive surface (e.g., a touch panel), etc. The embodiments of the present application do not limit the specific form of the electronic device.

[0135] The electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a loudspeaker 170A, a receiver 170B, a microphone 170C, a sensor module 180, a display screen 194, a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include one or more sensors, such as a gyroscope sensor 180B, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a touch sensor 180K, etc. In some embodiments, the sensor module 180 can also include one or more of a pressure sensor, an air pressure sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, an ambient light sensor, a bone conduction sensor, etc.

[0136] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0137] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units can be independent devices, or can be integrated in one or more processors.

[0138] The controller can generate operation control signals according to instruction operation codes and timing signals, complete the control of fetching instructions and executing instructions.

[0139] The processor 110 can also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that the processor 110 has just used or repeatedly uses. If the processor 110 needs to use the instructions or data again, it can be directly called from the memory. Avoiding repeated access reduces the waiting time of the processor 110, thereby improving the efficiency of the system. In some embodiments, the processor 110 can include one or more interfaces, such as a universal serial bus (USB) interface and the like.

[0140] The USB interface 130 is an interface conforming to the USB standard specification, and can be a MiniUSB interface, a MicroUSB interface, a USB Type-C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and a peripheral device. It can also be used to connect earphones to play audio through the earphones. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0141] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive the charging input of the wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive the wireless charging input through the wireless charging coil of the electronic device 100. The charging management module 140 can charge the battery 142 while also supplying power to the electronic device through the power management module 141.

[0142] The power management module 141 is configured to connect the battery 142 and the charging management module 140 to the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the display 194, the wireless communication module 160, and the like. The power management module 141 can also be configured to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), and the like. In some other embodiments, the power management module 141 can also be disposed in the processor 110. In some other embodiments, the power management module 141 and the charging management module 140 can also be disposed in the same device.

[0143] The wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, and the like.

[0144] The antenna 1 and the antenna 2 are configured to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be configured to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in combination with a tuning switch.

[0145] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G and the like applied to the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and perform filtering, amplification, and the like on the received electromagnetic waves, and transfer the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can also amplify signals modulated by the modem processor, and convert the amplified signals into electromagnetic waves to be radiated through the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 can be disposed in the same device.

[0146] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives an electromagnetic wave via the antenna 2, demodulates and filters the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 160 can also receive a signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and radiate it as an electromagnetic wave via the antenna 2.

[0147] In some embodiments, the antenna 1 and the mobile communication module 150 of the electronic device 100 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite based augmentation systems (SBAS).

[0148] The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0149] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1.

[0150] The internal memory 121 can include one or more random access memories (RAMs) and one or more non-volatile memories (NVMs).

[0151] The random access memory can be directly readable and writable by the processor 110, and can be used to store executable programs (e.g., machine instructions) of an operating system or other programs that are currently running, and can also be used to store data of users and application programs, and the like.

[0152] The non-volatile memory can also store executable programs and store data of users and application programs, and the like, and can be loaded in advance into the random access memory for direct reading and writing by the processor 110.

[0153] The external memory interface 120 can be configured to connect an external non-volatile memory, and to expand the storage capacity of the electronic device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to realize a data storage function. For example, files such as music and videos can be saved in the external non-volatile memory.

[0154] The electronic device 100 can realize audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an application processor, and the like. For example, the electronic device 100 can realize functions such as calling and recording.

[0155] The audio module 170 is for converting digital audio information into analog audio signals output, and for converting analog audio input into digital audio signals. The audio module 170 can also be for encoding and decoding audio signals. In some embodiments, the audio module 170 can be disposed in the processor 110, or some functional modules of the audio module 170 can be disposed in the processor 110.

[0156] The speaker 170A, also known as a "loudspeaker", is for converting audio electrical signals into sound signals. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0157] The microphone 170B, also known as a "receiver", is for converting audio electrical signals into sound signals. When the electronic device 100 receives a call or a voice message, the user can listen to the voice through the microphone 170B close to the ear.

[0158] The microphone 170C, also known as a "microphone", "sound collector", is for converting sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound through the mouth close to the microphone 170C, and input the sound signal into the microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, in addition to collecting sound signals, it can also realize the function of noise reduction. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C, which can realize the functions of collecting sound signals, noise reduction, identifying sound sources, realizing directional recording, etc.

[0159] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around the three axes (i.e., x, y and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 100 shaking, and calculates the distance that the lens module needs to compensate according to the angle, so that the lens can offset the shaking of the electronic device 100 through reverse movement, realizing anti-shake. The gyroscope sensor 180B can also be used for navigation and motion sensing game scenarios.

[0160] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of a flip leather cover.

[0161] The acceleration sensor 180E can detect the acceleration of the electronic device 100 in each direction (generally three axes). When the electronic device 100 is stationary, it can detect the size and direction of gravity. It can also be used to identify the posture of the electronic device, and applied to landscape / portrait screen switching, pedometer and other applications.

[0162] Distance sensor 180F for measuring distance. Electronic device 100 can measure distance by infrared or laser. In some embodiments, electronic device 100 can measure distance by distance sensor 180F to achieve fast focusing when taking a picture.

[0163] Touch sensor 180K, also referred to as “touch device”. Touch sensor 180K can be disposed on display screen 194, and touch sensor 180K and display screen 194 together form a touch screen, also referred to as “touch panel”. Touch sensor 180K is used to detect touch operations acting on or near it. Touch sensor 180K can transmit detected touch operations to application processor to determine touch event type. Visual output related to touch operations can be provided through display screen 194. In other embodiments, touch sensor 180K can also be disposed on the surface of electronic device 100, which is different from the position where display screen 194 is located.

[0164] In some embodiments, electronic device 100 can also include one or more of a key, a motor, and an indicator. The key can include a power key, a volume key, and the like. The key can be a mechanical key. It can also be a touch key. Electronic device 100 can receive key input and generate key signal input related to user settings and function control of electronic device 100. The motor can generate a vibration prompt. The indicator can be an indicator light, which can be used to indicate charging status, power change, and can also be used to indicate messages, missed calls, notifications, and the like.

[0165] SIM card interface 195 is used to connect a SIM card.

[0166] FIG. 3A is a software structure block diagram of electronic device 100 according to an embodiment of the present application.

[0167] The software system of electronic device 100 can adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture.

[0168] As shown in FIG. 3A, the layered architecture divides software into several layers, each of which has a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, from top to bottom, they are application layer, application framework layer, system library and system library, and kernel layer.

[0169] The application layer can include a series of application packages.

[0170] As shown in FIG. 3A, the application package can include lock screen application and screen-off display application, and the like.

[0171] The lock screen application can lock the screen to avoid others using the electronic device. The lock screen application can lock the screen in response to a user's lock screen operation, such as an operation of pressing the power key of the electronic device, or an operation of a user gesture, etc. The lock screen application can also lock the screen when the electronic device is in an unattended state and the duration exceeds a threshold.

[0172] The screen-off display application is an application that can continue to display certain content, such as time, date, wallpaper, service card, etc., when the electronic device is in a lock screen state. Some examples of the screen-off display application can include:

[0173] Screen-off clock application: This application can display various times on the phone, and the time can be viewed without waking up the phone. The application also provides the function of setting different screen-off pictures.

[0174] Screen-off wallpaper application: This application can display cool wallpaper when the phone is in a screen-off display mode, maintaining the cool effect of the screen saver.

[0175] In some embodiments of the present application, the screen-off display application can allow the service card of an application to be displayed when the electronic device is in a screen-off display mode. Optionally, the user can be allowed to make a setting through which it can be allowed to display the service card of which application or which applications.

[0176] In some embodiments of the present application, the screen-off display application can allow the service card of an application to be displayed when the electronic device is in a screen-off display mode. Optionally, the user can be allowed to make a setting through which it can be allowed to display the service card of which application or which applications.

[0177] It should be understood that the screen-off display application can implement one or more of the above functions, such as displaying time and displaying service cards, and the present application does not limit this.

[0178] The application framework layer includes a main operating system and a lightweight operating system. The main operating system runs in the main processor, and the lightweight operating system runs in the auxiliary processor.

[0179] The lock screen application and the screen-off display application can run on the main operating system, or in other words, the lock screen application and the screen-off display application can run on the main processor.

[0180] The application framework layer of the lightweight operating system can include an animation module, a 3D rendering module (TinyGL), etc.

[0181] The kernel layer can include modules / services for the main operating system, such as including a display driver. The kernel layer can also include modules / services for the light operating system, such as including an always-on display (AOD) application, an AOD wake-up sensor, and a display subsystem (DSS) driver. The kernel layer can also include other modules / services, such as a sensor driver, a camera driver, and a display driver, which can be used for both the main operating system and the light operating system.

[0182] The hardware layer includes devices such as a display, a camera, and a sensor.

[0183] The AOD application receives first information sent by the hardware layer, determines a response event based on the first information, and sends the response event to the animation module. The response event is used by the animation module to determine a first motion sequence from a plurality of motion sequences.

[0184] For example, the first information can be image data collected by the camera, and the AOD application can determine an expression / emotion of a person based on a face image in the image data. In this case, the response event can be the expression / emotion of the person. For another example, the first information can also be first sensor data collected by a sensor in the display, and the AOD application can determine a type of operation of a user based on the first sensor data. In this case, the response event can be the type of operation of the user. For another example, the first information can also be second sensor data collected by a motion sensor, and the AOD application can determine a motion state of the user based on the second sensor data. In this case, the response event can be the motion state of the user. For another example, the first information can also be a first music file obtained by the auxiliary processor, and the AOD application can determine a music type of the first music based on the first music file. In this case, the response event can be the music type of the first music.

[0185] The AOD application can also obtain third information and send the third information to the animation module. The third information can also be used by the animation module to adjust the first motion sequence to obtain a third motion sequence.

[0186] For example, the third information can be music information of the first music, such as rhythm, tempo, intensity, etc. of the first music. The animation module can adjust the first motion sequence based on the music information of the first music to obtain the third motion sequence.

[0187] It should be noted that the first message and the third message can also include other information, which is not limited in the present application.

[0188] The animation module is further configured to receive the first 3D model sent by the main operating system application framework layer, and send the first 3D model and the first motion sequence or the first 3D model and the third motion sequence to the 3D rendering module.

[0189] The 3D rendering module is configured to render a first 3D animation based on the first 3D model and the first motion sequence, or render a fourth 3D animation based on the first 3D model and the third motion sequence.

[0190] The 3D rendering module is further configured to send the first 3D animation to the display screen, so that the display screen can play the first 3D animation.

[0191] It should be understood that in some embodiments of the present application, "display", "display device", "display screen" and "screen" can be replaced with each other.

[0192] It should be further understood that in the system architecture shown in FIG. 3A, the names of the functional modules are only one possible example, and the naming manner of the functional modules is not limited in the present application.

[0193] It should be further understood that the system architecture shown in FIG. 3A is only one possible example, and in other embodiments of the present application, more or fewer components than those shown can be included, or some components can be combined, or some components can be split, or different component arrangements can be included.

[0194] FIG. 3B shows a schematic diagram of software interaction of an electronic device 100 receiving user operation to generate a first 3D model.

[0195] As shown in FIG. 3B, the electronic device 100 includes an application layer, an application framework layer and a hardware layer.

[0196] The application layer includes an off-screen display application, the application framework layer includes an animation setting module, and the hardware layer includes a memory.

[0197] The method of the electronic device 100 receiving user operation to generate a first 3D model includes but is not limited to the following steps:

[0198] 1. The off-screen display application receives a first picture input by the user.

[0199] Optionally, the first picture can be a picture selected from a gallery or a picture collected in real time through a camera of the electronic device 100.

[0200] 2. The off-screen display application sends the first picture to the animation setting module.

[0201] In response to the first picture sent by the AOD application, in one possible implementation, the AOD application can obtain the first 3D model based on the type of the target object and the texture features of the target object in the first picture. In other possible implementations, a network model is pre-stored in the electronic device 100, and the AOD application can input the first picture into the network model to obtain the first 3D model through the network model.

[0202] 3. The animation setting module sends the first 3D model to the storage.

[0203] In response to the first 3D model sent by the animation setting module, the storage can store the first 3D model.

[0204] Optionally, the electronic device 100 can also generate the first motion sequence according to the method shown in FIG. 3B and save it to the storage.

[0205] FIG. 3C shows a software interaction diagram of how the electronic device 100 plays the first 3D animation.

[0206] As shown in FIG. 3C, the electronic device 100 includes an application framework layer, a kernel layer, and a hardware layer. The application framework layer includes an animation module and a 3D rendering module (TinyGL), the kernel layer includes an AOD wake-up sensor, an AOD application, and a DSS driver, and the hardware layer includes a sensor, a storage, a camera, and a display screen.

[0207] 1. The sensor obtains the second sensor data and sends it to the AOD wake-up sensor.

[0208] 2. The storage obtains the first music file and sends it to the AOD wake-up sensor.

[0209] 3. The camera obtains the image data and sends it to the AOD wake-up sensor.

[0210] 4. The display screen obtains the first sensor data and sends it to the AOD wake-up sensor.

[0211] 5. The AOD wake-up sensor sends the first sensor data or the second sensor data or the first music file or the image data to the AOD application.

[0212] 6、The AOD App sends the first response event to the animation module.

[0213] In response to the first sensor data or the second sensor data or the first music file or the image data sent by the AOD WakeUp Sendor, the AOD App can obtain the first response event based on the first sensor data or the second sensor data or the first music file or the image data.

[0214] For example, when the AOD App obtains the image data collected by the camera, the first response event includes the first expression / emotion.

[0215] For example, when the AOD App obtains the first sensor data, the first response event includes the first operation type.

[0216] For example, when the AOD App obtains the second sensor data, the first response event includes the first motion type.

[0217] For example, when the AOD App obtains the first music file, the first response event includes the music type of the first music.

[0218] 7、The animation module sends the first 3D model, the first motion sequence or the third motion sequence to the TinyGL.

[0219] 8、The TinyGL sends the first 3D animation or the fourth 3D animation to the DSS driver.

[0220] After obtaining the first response event, the animation module can screen the first motion sequence from one or more animation modules. The TinyGL can render the first 3D animation based on the first 3D model, the first motion sequence or the third motion sequence.

[0221] In some embodiments, the animation module can also not obtain the first response event, but obtain the preset first motion sequence.

[0222] In some embodiments, after obtaining the first motion sequence, the animation module can also obtain the third information, and adjust the first motion sequence based on the third information to obtain the third motion sequence.

[0223] The 3D rendering module (TinyGL) can render the first 3D animation based on the first 3D model and the first motion sequence, or render the fourth 3D animation based on the third motion sequence.

[0224] 9. The DSS driver sends the first 3D animation or the fourth 3D animation to the display screen.

[0225] The display screen plays the first 3D animation or the fourth 3D animation.

[0226] Next, the power-off display method related to the present application will be explained in detail in combination with the UI.

[0227] I. The user selects the style of the first 3D model.

[0228] Optionally, the first 3D model can be preset.

[0229] Optionally, the style of the first 3D model can be determined based on the target object in the picture (e.g., the first picture) selected by the user. The first picture can be a picture saved in the gallery or a picture taken by the camera of the electronic device. The user can select different pictures, and the types of the target objects in different pictures are different, so the styles of the first 3D models are different. Or the types of the target objects in different pictures are the same, but the texture features of the target objects are different, so the styles of the first 3D models are different.

[0230] FIGS. 4A-4J show schematic diagrams of determining the style of the 3D model based on the picture selected by the user by the electronic device 100.

[0231] As shown in FIG. 4A, the electronic device 100 can display a desktop, and the desktop displays a page with application icons, which includes a plurality of application icons (e.g., a settings application icon, an application market application icon, a gallery application icon, a browser application icon, etc.). A page indicator is also displayed below the plurality of application icons to indicate the positional relationship between the currently displayed page and other pages. A tray area is displayed below the page indicator. The tray area includes a plurality of tray icons, such as a camera application icon, a contacts application icon, a phone application icon, and a message application icon. The tray area remains displayed when the page is switched. In some embodiments, the above-mentioned page can also include a plurality of application icons and a page indicator, the page indicator can not be part of the page, but exist separately, and the above-mentioned tray icons are optional, and the embodiments of the present application do not limit this.

[0232] The electronic device 100 can receive an input (e.g., a single tap) of a user acting on a setting application icon, and in response to the input operation, the electronic device 100 can display a user interface as shown in FIG. 4B. FIG. 4B is a main interface of a setting application provided by the electronic device 100 according to an embodiment of the present application.

[0233] As shown in FIG. 4B, the main interface of the setting application includes a plurality of setting items, such as a flight mode on / off option, a Wi-Fi on / off option, a Bluetooth on / off option, a personal hotspot on / off option, a mobile network on / off option, a do not disturb mode on / off option, a screen off display on / off option, a Huawei account viewing option, and a privacy mode on / off option. The electronic device 100 can receive an input operation of a user on the screen off display on / off option, such as a single tap operation, and in response to the input operation of the user, the electronic device 100 can display a screen off display setting interface as shown in FIG. 4C.

[0234] As shown in FIG. 4C, the screen off display setting interface includes a 3D model display area 4001 and a theme style display area.

[0235] The 3D model display area 4001 includes a style of a 3D model currently used by the electronic device 100, such as an animal cat. The theme style display area includes a plurality of animation options, such as an animation A option, an animation B option, an animation C option, an animation D option, and an animation E option. The animation A option displays an icon 4002, and the icon 4002 is used to indicate that the animation A is in a selected state. Thus, after the electronic device 100 is turned off, the electronic device 100 plays a 3D animation based on a motion sequence corresponding to the animation A.

[0236] The current 3D model of the animal cat can be pre-stored in the electronic device, or can be obtained based on a picture selected by the user.

[0237] In some embodiments, the electronic device 100 can receive an input operation of a user changing the picture to change the style of the 3D model.

[0238] As shown in FIG. 4C, the electronic device 100 can receive an input operation of a user on the 3D model display area 4001, such as a single tap operation, and in response to the input operation of the user, the electronic device 100 can display a window 4003 as shown in FIG. 4D. The window 4003 displays an option 4004 and an option 4005. The user can select a picture through the option 4004 to regenerate the 3D model. The option 4005 is in a selected state to indicate that the 3D model currently used by the electronic device 100 is an animal cat.

[0239] As shown in FIG. 4D, the electronic device 100 can receive an input operation, for example, a single-click operation, of the user on the option 4004. In response to the input operation of the user, the electronic device 100 can display the gallery interface shown in FIG. 4E.

[0240] Alternatively, in response to the input operation of the user on the option 4004, the electronic device 100 can also prompt the user to take a picture by using the camera or to select a picture from the gallery. When the user confirms to select a picture from the gallery, the electronic device 100 can display the gallery interface shown in FIG. 4E again.

[0241] As shown in FIG. 4E, the gallery interface includes a plurality of album names, for example, “All Photos”, “Screenshot Photos”, “Huawei Share”, “Instant Messaging”, “Map”, and the like. The user can select a picture from any one of the plurality of albums, and the electronic device 100 can obtain a 3D model corresponding to a target object in the picture selected by the user based on the picture.

[0242] As shown in FIG. 4E, the electronic device 100 can receive an input operation, for example, a single-click operation, of the user on the album name “All Photos”. In response to the input operation of the user, the electronic device 100 can display the photo display interface of the gallery application shown in FIG. 4F. The photo display interface includes the picture 4006.

[0243] As shown in FIG. 4F, the electronic device 100 can receive an input operation, for example, a single-click operation, of the user on the picture 4006. In response to the input operation of the user, the electronic device 100 can select the picture 4006 and obtain a first 3D model based on the picture 4006.

[0244] In response to the operation of the user selecting the picture 4006, the electronic device 100 can display the window 4007 shown in FIG. 4G, which includes the text “Do you want to apply the picture you selected to the screen-off display?”. The text is used to prompt the user to confirm whether to use the selected picture. After the user confirms to use the selected picture, the electronic device 100 can receive an input operation, for example, a single-click operation, of the user on the “Apply” option in the window 4007. In response to the input operation of the user, the electronic device 100 can obtain the first 3D model based on the picture 4006.

[0245] Before obtaining the first 3D model, the electronic device 100 can display the window 4008 shown in FIG. 4H, which includes the text “The picture you selected is being applied to the screen-off display. Please wait a moment” and the progress bar including the generation progress of the first 3D model, for example, 70%. The text and the progress bar in the window 4008 are both used to indicate the generation progress of the first 3D model.

[0246] After obtaining the first 3D model based on the picture 4006, the electronic device 100 can display the window 4009 shown in FIG. 4I, which includes the text "Apply the picture you selected to the screen-off display", and the electronic device 100 can receive an input operation, such as a single-click operation, of the user on the "Apply" option in the window 4009. In response to the input operation of the user, the electronic device 100 can display the screen-off display setting interface shown in FIG. 4J, which includes the picture of the first 3D model just generated in the 3D model display area 4001. The user can view the style of the first 3D model in the 3D model display area 4001.

[0247] In some embodiments, in response to the input operation of the user on the "Apply" option in the window 4009, the electronic device 100 can also obtain a 3D animation based on the first 3D model just generated and the motion sequence corresponding to the animation A, and play the 3D animation, so that the user can preview the display effect of the 3D animation.

[0248] Optionally, the step of determining the 3D model can be performed by the main processor in the electronic device 100.

[0249] FIG. 4K shows a flowchart of a method for determining the style of a 3D model based on a picture selected by a user.

[0250] S401. The main processor obtains a first picture, which is a picture selected by a user.

[0251] The first picture can be a picture selected by the user from the gallery of the electronic device 100, or a picture taken by the camera of the electronic device 100.

[0252] S402. The main processor obtains the type of a target object in the first picture and the texture features of the target object.

[0253] After obtaining the first picture, the main processor can obtain the type of a target object in the first picture and the texture features of the target object.

[0254] In some embodiments, if the main processor does not recognize the target object in the first picture, or the main processor recognizes the target object in the first picture but the target object in the first picture does not belong to any of the preset target objects, the electronic device 100 can prompt the user to select a picture again.

[0255] S403. The main processor obtains a first skeleton model based on the type of the target object.

[0256] Optionally, the electronic device 100 has pre-stored a plurality of skeleton models corresponding to target objects of different types. The main processor can obtain a first skeleton model based on the type of the target object in the first picture.

[0257] FIG. 4L shows the skeleton models corresponding to several different types of target objects.

[0258] (a) of FIG. 4L shows the skeleton model corresponding to the animal bird, (b) of FIG. 4L shows the skeleton model corresponding to the child, (c) of FIG. 4L shows the skeleton model corresponding to the adult, (d) of FIG. 4L shows the skeleton model corresponding to the animal cat, and (e) of FIG. 4L shows the skeleton model corresponding to the animal rabbit.

[0259] The skeleton models corresponding to the target objects are not limited to the above several types, and can also include skeleton models corresponding to other more types of target objects.

[0260] S404, the main processor obtains a first 3D model based on the texture features of the target object and the first skeleton model.

[0261] After obtaining the texture features of the target object and the first skeleton model, the main processor can bind the texture features of the target object on the first skeleton model to obtain the first 3D model. The texture features of the first 3D model are the same as or similar to the texture features of the target object in the first picture.

[0262] Optionally, the main processor can obtain the first 3D model based on the texture features of the target object and the first skeleton model based on a rasterization algorithm, a primitive collocation algorithm, a shading texture algorithm, etc.

[0263] Through the method, the electronic device 100 can construct different 3D models based on different target objects selected by the user, and play 3D animations through different 3D models, so as to improve the user experience.

[0264] The different target objects can refer to different types of target objects, or the same type of target objects but different texture features of the target objects.

[0265] Optionally, the network model can be pre-installed in the electronic device 100, and the main processor can also input the first picture into the network model to output the first 3D model based on the first picture through the network model.

[0266] II. The electronic device 100 changes the style of the 3D animation based on the motion sequence selected by the user.

[0267] In the embodiments of the present application, the motion sequence is used to drive the 3D model to perform a plurality of actions in the motion sequence by the auxiliary processor, that is, the motion sequence determines the actions of the 3D model in each animation frame of the 3D animation. The plurality of actions in different motion sequences are different, and the style of the 3D animation obtained based on different motion sequences is also different.

[0268] In some embodiments, the motion sequence can be preset.

[0269] In some embodiments, the electronic device 100 can also receive a user operation to replace the motion sequence to replace the display style of the 3D animation.

[0270] FIGS. 4M-4T show schematic diagrams of the electronic device 100 changing the display style of the 3D animation based on the user-selected motion sequence.

[0271] As shown in FIG. 4M, the electronic device 100 can receive a user swipe operation on each animation option, for example, a left swipe operation, and in response to the swipe operation, the electronic device 100 can display other un-displayed animation options, for example, the electronic device 100 can display the screen-off display interface shown in FIG. 4N. The screen-off display interface shown in FIG. 4N is similar to the screen-off display interface shown in FIG. 4M, except that the screen-off display interface shown in FIG. 4N further displays an animation D option, an animation E option, and a custom animation option 4011. The animation E option is displayed below a download option 4012, which is used to indicate that the electronic device 100 has not downloaded the motion sequence corresponding to the animation E, and the user can download the motion sequence corresponding to the animation E from the server through the download option 4012. The user can generate a motion sequence based on a user-selected video through the custom animation option 4011, and analyze the animation of the video to obtain the name of the motion sequence.

[0272] Optionally, the user can also select a video from the gallery, and the user can also obtain a video by shooting through the camera of the electronic device 100.

[0273] For example, as shown in FIG. 4N, the electronic device 100 can receive a user input operation, for example, a single-click operation, on the custom animation option 4011, and in response to the user input operation, the electronic device 100 can display the gallery interface shown in FIG. 4O. The gallery interface shown in FIG. 4O displays the cover of a plurality of videos, for example, the cover of a video 4013. The user can select any one of the videos to generate a motion sequence. For example, the user can select the video 4013, and in response to the selection of the video 4013, the electronic device 100 can analyze the motion of the target object in each frame of the video 4013 and generate a motion sequence based on the motion of the target object in each frame of the video 4013. Before obtaining the motion sequence based on the video 4013, the electronic device 100 can display the prompt information 4014 shown in FIG. 4P, which can include the text “Generating a motion sequence based on the user-selected video, please wait...”, and the prompt information 4014 is used to prompt the user that the electronic device 100 is generating a motion sequence.

[0274] After the electronic device 100 generates the motion sequence based on the video 4013, the electronic device 100 can analyze the animation of the video 4013, obtain the name of the motion sequence generated based on the video 4013, for example, the name can be "animation F", and display the screen-off display interface shown in FIG. 4Q. The screen-off display interface shown in FIG. 4Q is similar to the screen-off display interface shown in FIG. 4N, except that the animation F option is further displayed in the screen-off display interface shown in FIG. 4Q. The motion sequence corresponding to the animation F option can be obtained by the electronic device 100 by selecting a video from the gallery by the user.

[0275] Optionally, the electronic device 100 can also shoot a video through the camera and generate a motion sequence based on the video shot by the camera, not limited to selecting a video from the gallery.

[0276] Optionally, if the electronic device 100 cannot generate a motion sequence based on the video 4013, for example, in the case that the electronic device 100 cannot recognize the target object in the video 4013 or cannot recognize the action of the target object in the video 4013, the electronic device 100 can also prompt the user to reselect the video.

[0277] In some embodiments, one or more motion sequences can also be pre-installed in the server, and the electronic device 100 can download the motion sequence from the server and save it in the electronic device 100.

[0278] For example, as shown in FIG. 4R, the electronic device 100 can receive an input operation of the user for the download option 4012, for example, a single-click operation. In response to the input operation of the user, the electronic device 100 can display the prompt information 4015 shown in FIG. 4S. The prompt information 4015 includes the text "Downloading the motion sequence corresponding to the animation E, please wait...". The prompt information 4015 is used to prompt the user that the electronic device 100 is downloading the motion sequence.

[0279] After the electronic device 100 downloads the motion sequence corresponding to the animation E, the electronic device 100 can display the screen-off display interface shown in FIG. 4T. The screen-off display interface shown in FIG. 4T is similar to the screen-off display interface shown in FIG. 4R, except that the download option 4012 is not included below the animation F option in the screen-off display interface shown in FIG. 4T, to indicate that the motion sequence corresponding to the animation E has been downloaded and saved in the electronic device 100.

[0280] III. The electronic device 100 plays a 3D animation in a screen-off display state.

[0281] After detecting that the first condition for entering the screen-off display state is met, before entering the screen-off display state, the main processor of the electronic device 100 can send the first 3D model and one or more motion sequences to the auxiliary processor, the one or more motion sequences including the first motion sequence.

[0282] After the electronic device 100 enters the screen-off display state, the main processor of the electronic device 100 enters a sleep state, and the auxiliary processor of the electronic device 100 is in a running state. The electronic device 100 can play the first 3D animation or the fourth 3D animation through the auxiliary processor. The first 3D animation is obtained based on the first 3D model and the first motion sequence, or the fourth 3D animation is obtained based on the first 3D model and the third motion sequence. The third motion sequence is different from the first motion sequence, and the third motion sequence is obtained based on the first motion sequence.

[0283] FIGS. 5A-5C show a set of schematic diagrams of the electronic device 100 playing the first 3D animation.

[0284] As shown in FIG. 5A, after the electronic device 100 enters the screen-off display state, the electronic device 100 can display the user interface shown in FIG. 5A, which includes a display area 501 and a display area 502. The first animation frame of the first 3D animation is displayed in the display area 501. The date and time, for example, the date is “Wednesday, August 14, 2021”, and the time is “08:08”, are displayed in the display area 502.

[0285] After playing the first animation frame in the first 3D animation, the electronic device 100 can play the second animation frame in the first 3D animation shown in FIG. 5B and the third animation frame in the first 3D animation shown in FIG. 5C in the display area 501 in turn.

[0286] Optionally, the electronic device 100 can repeatedly play multiple animation frames in the first 3D animation.

[0287] Optionally, the first 3D animation can include more animation frames, and the first 3D animation can have other display styles, not limited to the three animation frames in FIGS. 5A-5C. FIGS. 5A-5C are used for explanation only and do not constitute a limitation.

[0288] FIGS. 5D-5E show another set of schematic diagrams of the electronic device 100 playing the first 3D animation.

[0289] FIGS. 5D-5E are similar to FIGS. 5A-5C, except that the animation shown in FIGS. 5D-5E is different from the animation shown in FIGS. 5A-5C.

[0290] FIGS. 5F-5H show another set of schematic diagrams of the electronic device 100 playing the first 3D animation.

[0291] Figures 5F-5H are similar to Figures 5A-5C, except that the animation shown in Figures 5F-5H is different from the animation shown in Figures 5A-5C, and further, in Figures 5F-5H, a display area 503 is included, in which details of the first music played by the electronic device 100 are displayed, such as the name of the first music, "Song 1", the total duration of the first music, "04:42", the playing progress of the first music, "00:42", the option of switching to play the previous music, the option of switching to play the next music, the option of pausing the playing, and the like.

[0292] That is, in Figures 5F-5H, after the electronic device 100 enters the screen-off display state, the electronic device 100 is still playing the first music.

[0293] Optionally, the animation shown in Figures 5A-5F can be obtained by the 3D model shown in (c) of Figure 4L performing a plurality of actions in the first motion sequence.

[0294] Optionally, the animation shown in Figures 5A-5F can be obtained by the 3D model performing a plurality of actions in the motion sequence shown in Figure 1B.

[0295] Figure 6 shows a flowchart of a method for playing a first 3D animation by an electronic device 100.

[0296] As shown in Figure 6, the electronic device 100 can include a lock screen application, a main processor, an auxiliary processor, and a display, the auxiliary processor including a screen-off display service, an animation module, and a 3D rendering module (TinyGL).

[0297] The method for playing a first 3D animation by the electronic device 100 includes but is not limited to the following steps:

[0298] S601A, detecting that a first condition for entering a screen-off display state is met, the main processor enters a sleep state.

[0299] S602A, detecting that a first condition for entering a screen-off display state is met, the auxiliary processor enters a running state.

[0300] Optionally, the first condition can include but is not limited to any one of the following triggering manners.

[0301] Triggering manner 1: triggering the lock screen by the power key of the electronic device. For example, after the power key of the electronic device is pressed and lifted by the user, the electronic device is locked and enters the screen-off display state.

[0302] Triggering manner 2: timeout lock screen. When the time length that the display screen of the electronic device is in the screen-on state reaches a preset time length, the electronic device is locked and enters the screen-off display state.

[0303] Trigger mode 3: the lock screen is triggered by the distance sensor. During the call, if the distance sensor detects that the face is close to the display screen, the electronic device locks the screen and enters the screen-off display state.

[0304] It should be noted that the first condition can also be other triggering modes, which are not limited in the present application.

[0305] When the first condition for entering the screen-off display state is detected, the main processor enters the sleep state and the auxiliary processor enters the running state. In this way, the screen-off display processing is performed by the auxiliary processor, which can reduce the power consumption of the electronic device 100.

[0306] Optionally, S601A and S602A can be executed simultaneously, and S602A can also be executed before S601A, which is not limited in the present application.

[0307] S603A, before entering the sleep state, the main processor sends the first 3D model and one or more motion sequences to the animation module, and the one or more motion sequences include the first motion sequence.

[0308] Before entering the sleep state, the main processor can send the first 3D model and one or more motion sequences to the animation module. The first 3D model and the one or more motion sequences are used for the 3D rendering module (TinyGL) to render the first 3D animation.

[0309] Optionally, after detecting that the first condition for entering the screen-off display state is met, the main processor can send the first 3D model and one or more motion sequences to the animation module before entering the sleep state.

[0310] Optionally, after obtaining the first 3D model, the main processor can send the first 3D model and one or more motion sequences to the animation module before entering the sleep state.

[0311] The present application does not limit the timing of the main processor sending the first 3D model and one or more motion sequences to the animation module.

[0312] Optionally, the first 3D model and one or more motion sequences can be sent to the auxiliary processor by the lock screen application through the main processor.

[0313] Optionally, the first 3D model can be a preset 3D model, or can be a 3D model generated based on a target object in a picture selected by the user or a picture captured by the camera of the electronic device 100. The electronic device 100 can extract the type of the target object and the texture feature of the target object in the picture, determine the first skeleton model based on the type of the target object, and obtain the first 3D model based on the first skeleton model and the texture feature of the target object. Optionally, the skeleton model corresponding to different types of target objects can be different, and the 3D model corresponding to different types of target objects is also different. For example, refer to the description in the embodiments of FIGS. 4C-4L.

[0314] Optionally, the one or more motion sequences can be preset motion sequences in the electronic device 100, or can be motion sequences obtained by analyzing a video selected by the user or a video captured by the camera of the electronic device 100, or can be motion sequences downloaded from a server by the electronic device 100 receiving user operations. For example, refer to the description in the embodiments of FIGS. 4M-4T.

[0315] S604A, the animation module obtains a first motion sequence from the one or more motion sequences.

[0316] S605A, the animation module sends the first 3D model, the first motion sequence, or a third motion sequence to the 3D rendering module (TinyGL), and the third motion sequence is obtained based on the first motion sequence.

[0317] After detecting that the first condition for entering the screen-off display state is met, the main processor can send the first 3D model and the one or more motion sequences to the animation module.

[0318] After obtaining the one or more motion sequences, the animation module can obtain a first motion sequence from the one or more motion sequences. The animation module then sends the first 3D model and the first motion sequence to the 3D rendering module (TinyGL)

[0319] Optionally, the first motion sequence can be a default motion sequence, or the first motion sequence can be determined by the animation module based on the first information from the one or more motion sequences.

[0320] For how the animation module determines the first motion sequence from the one or more motion sequences based on the first information, refer to the description in the embodiments of FIGS. 8A-8D.

[0321] In some embodiments, the animation module can obtain the third information and the first motion sequence, and adjust the first motion sequence based on the third information to obtain a third motion sequence, the third motion sequence being different from the first motion sequence, the third motion sequence being obtained based on the first motion sequence. The animation module sends the first 3D model and the first motion sequence to the 3D rendering module (TinyGL).

[0322] S606A, the 3D rendering module (TinyGL) obtains a first 3D animation based on the first 3D model and the first motion sequence, or obtains a fourth 3D animation based on the first 3D model and the third motion sequence.

[0323] The first 3D model is used to determine the style of the 3D model in each frame of the final generated first 3D animation, and the first motion sequence or the third motion sequence is used to determine the action of the 3D model in each frame of the final generated first 3D animation.

[0324] After obtaining the first 3D model, the first motion sequence or the third motion sequence sent by the animation module, the 3D rendering module (TinyGL) can obtain a first 3D animation based on the first 3D model and the first motion sequence, or obtain a fourth 3D animation based on the first 3D model and the third motion sequence.

[0325] S607A, the 3D rendering module (TinyGL) sends the first 3D animation or the fourth 3D animation to the display.

[0326] S608A, the display plays the first 3D animation or the fourth 3D animation.

[0327] After obtaining the first 3D animation, the auxiliary processor can send the first 3D animation to the display (or referred to as the display screen), and the display screen can play the first 3D animation.

[0328] For example, the first 3D animation can be the animation frames shown in FIGS. 5A-5C.

[0329] In some embodiments, before playing the first 3D animation, the electronic device 100 can display a first frame of the first 3D animation. Upon identifying a touch event of the user on the display or a gaze event of the user on the display, the electronic device 100 can play the remaining frames of the first 3D animation. In this way, when no touch event of the user on the display is identified or no gaze event of the user on the display is identified, the electronic device 100 only displays the first frame of the first 3D animation, and upon identifying a touch event of the user on the display or a gaze event of the user on the display, the electronic device 100 can continue to play the frames of the first 3D animation, which can save the power consumption of the electronic device 100.

[0330] For example, the touch event of the user on the display can refer to a click operation, a sliding operation, a long press operation, etc. of the user on the display.

[0331] In some embodiments, before the electronic device 100 enters the screen-off display state, the electronic device 100 can play the first music. After the electronic device 100 enters the screen-off display state, since the main processor has entered the sleep state, the electronic device 100 can play the first music through the auxiliary processor.

[0332] FIG. 7 shows a flowchart of a method for playing the first music and the first 3D animation by the electronic device 100 after entering the screen-off display state.

[0333] As shown in FIG. 7, the electronic device 100 can include a lock screen application, a main processor, an auxiliary processor, and a display, and the auxiliary processor can include an animation module and a 3D rendering module (TinyGL).

[0334] The method for playing the first music and the first 3D animation by the electronic device 100 can include, but is not limited to, the following steps:

[0335] S601B, the electronic device 100 performs S601A-S608A.

[0336] In S601B, if it is detected that the first condition for entering the screen-off display state is met, the main processor of the electronic device 100 enters the sleep state, and the auxiliary processor of the electronic device 100 enters the running state. Before the main processor of the electronic device 100 enters the sleep state, the main processor of the electronic device 100 can send the first 3D model and one or more motion sequences to the auxiliary processor, and the auxiliary processor can obtain the first 3D animation based on the first 3D model, the first motion sequence, or the third motion sequence, and display the first 3D animation through the display. For the description of S601B, reference can be made to the description in S601A-S608A.

[0337] S602B, before entering the sleep state, the main processor sends the first music file to the auxiliary processor.

[0338] Before entering the sleep state, the main processor can send the first music file to an animation module.

[0339] Optionally, before entering the sleep state, the main processor can send the first music file to the animation module after detecting that the first condition for entering the screen-off display state is met.

[0340] The application does not limit the timing of the main processor sending the first music file to the animation module.

[0341] If the electronic device 100 plays the first music before detecting that the first condition for entering the screen-off display state is met, the electronic device 100 can continue to play the first music after the electronic device 100 enters the screen-off display state. Optionally, before the electronic device 100 enters the screen-off display state, the electronic device 100 plays the first music through the main processor. However, after the electronic device 100 enters the screen-off display state, the processor enters the screen-off display state. In order to enable the electronic device 100 to continue to play the first music, before the electronic device 100 enters the screen-off display state, the main processor of the electronic device 100 can send the first music file to the auxiliary processor of the electronic device 100, and the auxiliary processor of the electronic device 100 continues to play the first music.

[0342] Therefore, before the main processor of the electronic device 100 enters the sleep state after detecting that the first condition for entering the screen-off display state is met, the main processor can send the first music file to the auxiliary processor.

[0343] S603B, the auxiliary processor plays the first music based on the first music file.

[0344] After receiving the first music file sent by the main processor of the electronic device 100, the auxiliary processor of the electronic device 100 can play the first music based on the first music file. The main processor of the electronic device 100 stops playing the first music file.

[0345] Optionally, the main processor of the electronic device 100 can also send the playing progress of the first music to the auxiliary processor of the electronic device 100, and the auxiliary processor of the electronic device 100 can play the first music based on the first music file according to the playing progress of the first music.

[0346] Optionally, S602B can be executed simultaneously with S603A, or S602B can be executed before S603A, or S602B can be executed after S603A.

[0347] Next, it is introduced how the secondary processor determines the first motion sequence from one or more motion sequences based on the first information.

[0348] In order to improve the diversity of the electronic device 100 playing the first 3D animation after the screen is turned off and then turned on, the screen-off display service is configured to receive the first information sent by the hardware layer, determine the response event based on the first information, and send the response event to the animation module. The response event is used by the animation module to determine the first motion sequence from a plurality of motion sequences. The animation module obtains the first 3D animation based on the first 3D model and the first motion sequence.

[0349] For example, the first information can be image data collected by the camera, and the response event can be a user expression / emotion.

[0350] For example, the first information can be first sensor data collected by a sensor in the display screen, and the response event can be a user operation type.

[0351] For example, the first information can be second sensor data collected by a motion sensor, and the response event can be a user motion state.

[0352] For example, the first information can be a first music file, and the response event can be a music type of the first music.

[0353] 1. The first information can be image data collected by the camera, and the response event can be a first expression / emotion.

[0354] FIG. 8A shows a schematic diagram of the secondary processor of the electronic device 100 determining the first motion sequence from one or more motion sequences based on the first expression / emotion.

[0355] As shown in FIG. 8A, the electronic device 100 can include a secondary processor, a camera, and a display screen. The secondary processor includes a screen-off display service, an animation module, and a 3D rendering module (TinyGL).

[0356] The method for the secondary processor of the electronic device 100 to determine the first motion sequence from one or more motion sequences based on the first expression / emotion includes but is not limited to the following steps:

[0357] S801A, the camera of the electronic device 100 collects first image data.

[0358] Optionally, after the electronic device 100 enters the screen-off display state, the camera of the electronic device 100 can collect the first image data, which can save the power consumption of the electronic device 100.

[0359] The camera can be a front-facing camera of the electronic device 100, for example.

[0360] In S802A, the camera of the electronic device 100 sends the first image data to the screen-off display service.

[0361] In S803A, the screen-off display service determines the first emotion / expression based on the first image data.

[0362] In S804A, the screen-off display service sends the first emotion / expression to the animation module.

[0363] In S805A, the animation module determines the first motion sequence from the plurality of motion sequences based on the first emotion / expression.

[0364] The screen-off display service can recognize the face image in the first image data and determine the first emotion / expression of the face image.

[0365] After determining the first emotion / expression, the screen-off display service sends the first emotion / expression to the animation module, and the animation module can determine the first motion sequence from one or more motion sequences based on the first emotion / expression.

[0366] The first emotion / expression can include, but is not limited to, any one of the following: happy, surprised, sad, angry, disgusted, and scared, for example. Different emotion / expressions can correspond to different motion sequences. For example, when the first emotion / expression is happy, the first motion sequence can be light and brisk, and when the first emotion / expression is sad, the first motion sequence can be heavy. In this way, the electronic device 100 can match different motion sequences of different styles based on different emotions / expressions of the user to generate 3D animations of different styles, thereby improving the diversity of the electronic device 100 playing 3D animations and improving the user experience.

[0367] When the first emotion / expression is happy, the first motion sequence can be light and brisk, for example. The animations shown in FIGS. 5A-5C and 5F-5G are based on the light and brisk motion sequence.

[0368] When the first emotion / expression is sad, the first motion sequence can be heavy, for example. The animations shown in FIGS. 5E-5F are based on the heavy motion sequence.

[0369] In some embodiments, if the emotion / expression of the user is not identified, the animation module can determine a default motion sequence from the one or more motion sequences, the animation module can send the default motion sequence to the 3D rendering module (TinyGL), and the 3D rendering module (TinyGL) can generate the 3D animation based on the default motion sequence. For example, the default motion sequence can be the fifth motion sequence, which is the same as or different from the first motion sequence.

[0370] S806A, the animation module sends the first motion sequence to the 3D rendering module (TinyGL).

[0371] S807A, the 3D rendering module (TinyGL) obtains the first 3D animation based on the first 3D model and the first motion sequence.

[0372] S808A, the 3D rendering module (TinyGL) sends the first 3D animation to the display screen.

[0373] S809A, the display screen plays the first 3D animation.

[0374] After obtaining the first motion sequence, the animation module sends the first motion sequence to the 3D rendering module (TinyGL). The 3D rendering module (TinyGL) can obtain the first 3D animation based on the first 3D model and the first motion sequence, and then send the first 3D animation to the display screen, and the display screen plays the first 3D animation.

[0375] In some embodiments, the camera of the electronic device 100 can include a front camera, which can collect image data and send it to the screen-off display service. The screen-off display service can identify the eye movement direction of the user based on the image data collected by the camera, and instruct the animation module to change the motion direction of the 3D model based on the eye movement direction of the user, so that the motion direction of the 3D model can change with the change of the eye movement direction of the user.

[0376] 2, the first information can be first sensor data collected by a sensor in the display screen, and the response event can be a first operation type.

[0377] In some embodiments, the first sensor data can also be referred to as interaction data.

[0378] FIG. 8B shows a schematic diagram of the auxiliary processor of the electronic device 100 determining the first motion sequence from the one or more motion sequences based on the first operation type.

[0379] As shown in FIG. 8B, the electronic device 100 can include a secondary processor, a display screen, the secondary processor including an off-screen display service, an animation module, a 3D rendering module (TinyGL).

[0380] The method for the secondary processor of the electronic device 100 to determine the first motion sequence from the one or more motion sequences based on the first operation type includes but is not limited to the following steps:

[0381] S801B, the display screen of the electronic device 100 collects first sensor data.

[0382] Optionally, the display screen of the electronic device 100 can collect the first sensor data again after the electronic device 100 enters the off-screen display state, which can save the power consumption of the electronic device 100.

[0383] Optionally, the display screen of the electronic device 100 is configured with one or more sensors, and the one or more sensors can collect the first sensor data and determine the operation area and operation type of the user acting on the display screen based on the first sensor data.

[0384] For example, the one or more sensors can include but are not limited to any one or several of the following: a touch sensor (such as the touch sensor 180K shown in FIG. 2), a visual sensor, an infrared sensor, etc.

[0385] S802B, the display screen of the electronic device 100 sends the first sensor data to the off-screen display service.

[0386] S803B, the off-screen display service determines the first operation type based on the first sensor data.

[0387] S804B, the off-screen display service sends the first operation type to the animation module.

[0388] S805B, the animation module determines the first motion sequence from the one or more motion sequences based on the first operation type.

[0389] The off-screen display service can identify the operation type in the first sensor data, such as the first operation type, and then determine the first motion sequence from the one or more motion sequences based on the first operation type.

[0390] The first operation type can include, but is not limited to, any one of the following: clicking, long pressing, sliding, pinching, rotating, swiping, panning, etc. Different types of user operations correspond to different motion sequences. When the first operation type is a clicking operation, the electronic device 100 can play a 3D animation based on the motion sequence corresponding to the clicking operation. When the first operation type is a long pressing operation, the electronic device 100 can play a 3D animation based on the motion sequence corresponding to the long pressing operation. When the first operation type is a sliding operation, the electronic device 100 can play a 3D animation based on the motion sequence corresponding to the sliding operation. When the first operation type is a rotating operation, the electronic device 100 can play a 3D animation based on the motion sequence corresponding to the rotating operation. In this way, the electronic device 100 can obtain different motion sequences based on different user operations of the user acting on the display screen, to generate different 3D animations, thereby improving the diversity of the electronic device 100 playing 3D animations and improving the user experience.

[0391] For example, when the first operation type is a clicking operation, the animations shown in FIGS. 5A-5C and FIGS. 5F-5G are obtained based on the motion sequence corresponding to the clicking operation.

[0392] For another example, when the first operation type is a long pressing operation, the animations shown in FIGS. 5D-5E are obtained based on the motion sequence corresponding to the long pressing operation.

[0393] In some embodiments, the screen-off display service can also determine a user operation region based on the first sensor data. If the user operation region is within the 3D animation display region, the screen-off display service identifies the user operation type. If the user operation region is not within the 3D animation display region, the animation module can not identify the user operation type, the animation module can determine a default motion sequence from one or more motion sequences, and the animation module can send the default motion sequence to the 3D rendering module (TinyGL).

[0394] In some embodiments, if the user operation type is not identified based on the first sensor data, the animation module can determine a default motion sequence from one or more motion sequences, the animation module can send the default motion sequence to the 3D rendering module (TinyGL), and the 3D rendering module (TinyGL) can generate a 3D animation based on the default motion sequence.

[0395] S806B, the animation module sends the first motion sequence to the 3D rendering module (TinyGL).

[0396] S807B, the 3D rendering module (TinyGL) obtains the first 3D animation based on the first 3D model and the first motion sequence.

[0397] S808B, the 3D rendering module (TinyGL) sends the first 3D animation to the display screen.

[0398] S809B, the display screen plays the first 3D animation.

[0399] After obtaining the first motion sequence, the animation module sends the first motion sequence to the 3D rendering module (TinyGL). The 3D rendering module (TinyGL) can obtain the first 3D animation based on the first 3D model and the first motion sequence, and then send the first 3D animation to the display screen, and the display screen plays the first 3D animation.

[0400] 3. The first information is second sensor data collected by the motion sensor, and the response event can be the first motion type.

[0401] In some embodiments, the second sensor data can also be referred to as biometric data, which includes but is not limited to heart rate, step count, motion duration, calories consumed, etc.

[0402] FIG. 8C shows a schematic diagram of the auxiliary processor of the electronic device 100 determining the first motion sequence from one or more motion sequences based on the first motion type.

[0403] As shown in FIG. 8C, the electronic device 100 can include an auxiliary processor, a motion sensor, and a display screen, and the auxiliary processor includes an off-screen display service, an animation module, and a 3D rendering module (TinyGL).

[0404] The method of the auxiliary processor of the electronic device 100 determining the first motion sequence from one or more motion sequences based on the first motion type includes but is not limited to the following steps:

[0405] S801C, the motion sensor of the electronic device 100 collects second sensor data.

[0406] Optionally, the motion sensor of the electronic device 100 can collect the second sensor data after the electronic device 100 enters the off-screen display state, which can save the power consumption of the electronic device 100.

[0407] Optionally, one or more motion sensors are configured on the electronic device 100, and the one or more motion sensors can collect the second sensor data and determine the motion type of the user based on the second sensor data.

[0408] Exemplarily, the one or more motion sensors can include, but are not limited to, an acceleration sensor, a gyroscope sensor, and the like.

[0409] S802C, the motion sensor of the electronic device 100 sends the second sensor data to the screen-off display service.

[0410] S803C, the screen-off display service determines the first motion type based on the second sensor data.

[0411] S804C, the screen-off display service sends the first motion type to the animation module.

[0412] S805C, the animation module determines the first motion sequence from the one or more motion sequences based on the first motion type.

[0413] The screen-off display service can identify the motion type corresponding to the second sensor data, for example, the first motion type, and determine the first motion sequence from the one or more motion sequences based on the first motion type.

[0414] Exemplarily, the first motion type can include, but is not limited to, any one of the following: a static state, a motion state, and the like.

[0415] Exemplarily, the motion state can be further divided into any one of the following motion states: walking, running, cycling, dancing, playing football, playing basketball, playing tennis, playing badminton, and the like.

[0416] When the first motion type is the static state, the electronic device 100 can play the 3D animation based on the motion sequence corresponding to the static state. When the first motion type is the motion state, the electronic device 100 can play the 3D animation based on the motion sequence corresponding to the motion state. In this way, the electronic device 100 can obtain different motion sequences based on different motion types to generate different 3D animations, thereby improving the diversity of the electronic device 100 playing the 3D animation and improving the user experience.

[0417] For example, when the first motion type is the static state, the animations shown in FIGS. 5A-5C and FIGS. 5F-5G are obtained based on the motion sequence corresponding to the static state.

[0418] For another example, when the first motion type is the motion state, the animations shown in FIGS. 5D-5E are obtained based on the motion sequence corresponding to the motion state.

[0419] Optionally, the electronic device 100 can also not perform S802C and S803C, and the electronic device 100 can establish a communication connection with another electronic device (for example, a wearable device), the other electronic device can collect second sensor data, and send the second sensor data to the electronic device 100 through the communication connection.

[0420] Different motion types correspond to different motion sequences. Through this method, the electronic device 100 can obtain different motion sequences based on different motion types to generate different 3D animations, thereby improving the diversity of the electronic device 100 playing 3D animations and improving the user experience.

[0421] In some embodiments, if the user operation type is not identified based on the second sensor data, the animation module can determine a default motion sequence from one or more motion sequences, the animation module can send the default motion sequence to the 3D rendering module (TinyGL), and the 3D rendering module (TinyGL) can generate a 3D animation based on the default motion sequence.

[0422] S806C, the animation module sends the first motion sequence to the 3D rendering module (TinyGL).

[0423] S807C, the 3D rendering module (TinyGL) obtains a first 3D animation based on the first 3D model and the first motion sequence.

[0424] S808C, the 3D rendering module (TinyGL) sends the first 3D animation to the display screen.

[0425] S809C, the display screen plays the first 3D animation.

[0426] After obtaining the first motion sequence, the animation module sends the first motion sequence to the 3D rendering module (TinyGL). The 3D rendering module (TinyGL) can obtain a first 3D animation based on the first 3D model and the first motion sequence, and then send the first 3D animation to the display screen, and the display screen plays the first 3D animation.

[0427] 4. The first information is a first music file, and the response event can be a music type of the first music.

[0428] FIG. 8D shows a schematic diagram in which the auxiliary processor of the electronic device 100 determines a first motion sequence from one or more motion sequences based on a music type of the first music.

[0429] As shown in FIG. 8D, the electronic device 100 can include a secondary processor, a memory, and a display screen, the secondary processor including a screen-off display service, an animation module, and a 3D rendering module (TinyGL).

[0430] The method in which the secondary processor of the electronic device 100 determines the first motion sequence from one or more motion sequences based on the music type of the first music includes, but is not limited to, the following steps:

[0431] S801D, the memory sends the first music file to the screen-off display service.

[0432] S802D, the screen-off display service obtains the first music type of the first music based on the first music file.

[0433] In some embodiments, after the electronic device 100 enters the screen-off display state, the electronic device 100 can play the first music. Since the main processor has entered the sleep state, the main processor can send the first music file to the secondary processor, and the secondary processor can continue to play the first music based on the first music file.

[0434] The memory can send the first music file to the screen-off display service. After obtaining the first music file, the screen-off display service can obtain the first music type of the first music based on the first music file.

[0435] S803D, the screen-off display service sends the first music type of the first music to the animation module.

[0436] S804D, the animation module determines the first motion sequence from a plurality of motion sequences based on the first music type.

[0437] The screen-off display service can identify the music type corresponding to the first music being played by the secondary processor, for example, the first music type. The animation module can determine the first motion sequence from one or more motion sequences based on the first music type.

[0438] For example, the first music type can include, but is not limited to, any one of the following: classical music, popular music, folk music, etc.

[0439] Different music types correspond to different motion sequences. Through this method, the electronic device 100 can obtain different motion sequences based on different music types to generate different 3D animations, improving the diversity of the electronic device 100 playing 3D animations and improving the user experience.

[0440] For example, when the first music type is pop music, the animation shown in FIGS. 5F-5G is based on the motion sequence corresponding to pop music.

[0441] For another example, when the first music type is classical music, the animation shown in FIGS. 5D-5E is based on the motion sequence corresponding to classical music. Optionally, the music information being played by the electronic device 100 is not shown in FIGS. 5D-5E.

[0442] In some embodiments, if the music type of the first music is not identified, the animation module can determine a default motion sequence from the one or more motion sequences, and the animation module can send the default motion sequence to the 3D rendering module (TinyGL), which can generate a 3D animation based on the default motion sequence.

[0443] S805D, the animation module sends the first motion sequence to the 3D rendering module (TinyGL).

[0444] S806D, the 3D rendering module (TinyGL) generates a first 3D animation based on the first 3D model and the first motion sequence.

[0445] S807D, the 3D rendering module (TinyGL) sends the first 3D animation to the display screen.

[0446] S808D, the display screen plays the first 3D animation.

[0447] After obtaining the first motion sequence, the animation module sends the first motion sequence to the 3D rendering module (TinyGL). The 3D rendering module (TinyGL) can generate a first 3D animation based on the first 3D model and the first motion sequence, and send the first 3D animation to the display screen, which plays the first 3D animation.

[0448] In some embodiments, the secondary processor can obtain first information, determine a first motion sequence from the one or more motion sequences based on the first information, and generate a first 3D animation based on the first motion sequence and a first 3D model. After the electronic device 100 enters the screen-off display state, the information obtained by the electronic device 100 can change. The electronic device 100 can obtain second information, determine a third motion sequence from the one or more motion sequences based on the second information, and generate a third 3D animation based on the third motion sequence and the first 3D model. If the second information is the same as the first information, the third motion sequence is different from the first motion sequence, and the first 3D animation is the same as the second 3D animation. If the second information is different from the first information, the first 3D animation is different from the third 3D animation.

[0449] For example, after the electronic device 100 enters the screen-off display state, the auxiliary processor can obtain first information, which can be first image data collected by the camera. The auxiliary processor can identify the user's expression / emotion as happy based on the first image data collected by the camera. The style of the first motion sequence is happy, and the first 3D animation is obtained based on the happy-style motion sequence. Then, if the user's expression / emotion changes, the auxiliary processor can obtain second information, which can be second image data collected by the camera. The auxiliary processor can identify the user's expression / emotion as sad based on the second image data collected by the camera. The style of the third motion sequence is sad, and the third 3D animation is obtained based on the sad-style motion sequence.

[0450] For example, after the electronic device 100 enters the screen-off display state, the auxiliary processor can obtain first information, which can be first image data collected by the camera. The auxiliary processor can identify the user's expression / emotion as happy based on the first image data collected by the camera. The style of the first motion sequence is happy, and the first 3D animation is obtained based on the happy-style motion sequence. Then, if the electronic device 100 monitors a long-press operation of the user on the display screen, the auxiliary processor can obtain second information, which can be interaction data collected by the auxiliary processor. The auxiliary processor can identify the user's long-press operation based on the interaction data, and the third 3D animation is obtained based on the motion sequence corresponding to the long-press operation.

[0451] In some embodiments, the auxiliary processor can also obtain music information of the first music, and adjust the default motion sequence (e.g., the third motion sequence) based on the music information of the first music to obtain an adjusted motion sequence (e.g., the first motion sequence), so that the adjusted motion sequence matches the music information of the first music. Then, the 3D animation obtained by the auxiliary processor based on the adjusted motion sequence also matches the music information of the first music, which improves the effect of the 3D animation played by the electronic device 100 and improves the user's visual and auditory experience.

[0452] FIG. 8E shows a schematic diagram of the auxiliary processor of the electronic device 100 obtaining the first motion sequence based on the music information of the first music and the third motion sequence.

[0453] As shown in FIG. 8E, the electronic device 100 can include an auxiliary processor, a display screen, and the auxiliary processor can include a screen-off display service, an animation module, and a 3D rendering module (TinyGL).

[0454] The method for the auxiliary processor of the electronic device 100 to obtain the first motion sequence based on the music information of the first music and the third motion sequence includes but is not limited to the following steps:

[0455] S801E、The animation module determines a first motion sequence from one or more motion sequences.

[0456] Optionally, the first motion sequence can be a default motion sequence.

[0457] Optionally, the first motion sequence can also be determined from one or more motion sequences based on first information. For example, the first information can be the first emotion / expression shown in FIG. 8A, the first information can be the first user operation shown in FIG. 8B, the first information can be the first motion type shown in FIG. 8C, the first information can be the first music type shown in FIG. 8D, etc.

[0458] S802E、The screen-off display service obtains music information of the first music being played.

[0459] In some embodiments, after the electronic device 100 enters the screen-off display state, the electronic device 100 can play the first music. Since the main processor has entered the sleep state, the main processor can send the first music file to the auxiliary processor, and the auxiliary processor can continue to play the first music based on the first music file.

[0460] The screen-off display service can obtain the first music file and obtain the music information of the first music based on the first music file.

[0461] For example, the music information of the first music can include, but is not limited to, any one of the following: rhythm, beat, intensity, etc. of the first music.

[0462] The music information of the first music can also include other information, which is not limited by the present application.

[0463] S803E、The screen-off display service sends the music information of the first music to the animation module.

[0464] S804E、The animation module adjusts the first motion sequence based on the music information of the first music to obtain a third motion sequence.

[0465] After obtaining the first motion sequence and the music information of the first music, the animation module can adjust the first motion sequence based on the music information of the first music to obtain a third motion sequence. The third motion sequence is different from the first motion sequence.

[0466] S805E、The animation module sends the third motion sequence to the 3D rendering module (TinyGL).

[0467] S806E, the 3D rendering module (TinyGL) obtains a fourth 3D animation based on the first 3D model and the third motion sequence.

[0468] S807E, the 3D rendering module (TinyGL) sends the fourth 3D animation to the display screen.

[0469] S808E, the display screen plays the fourth 3D animation.

[0470] After obtaining the third motion sequence, the animation module sends the third motion sequence to the 3D rendering module (TinyGL). The 3D rendering module (TinyGL) can obtain a fourth 3D animation based on the first 3D model and the third motion sequence, and then send the fourth 3D animation to the display screen, and the display screen plays the fourth 3D animation.

[0471] In this way, the animation module can adjust the third motion sequence based on the rhythm, beat, intensity, etc. of the music being played by the electronic device 100, so that the adjusted motion sequence (for example, the first motion sequence) is consistent with the rhythm, beat, intensity, etc. of the music being played by the electronic device 100, and then the 3D animation obtained by the auxiliary processor based on the first motion sequence is also consistent with the rhythm, beat, intensity, etc. of the music being played by the electronic device 100, thereby improving the effect of the 3D animation played by the electronic device 100 and improving the visual and auditory experience of the user.

[0472] FIG. 9 is a method flow diagram of a screen-off display method provided by the present application.

[0473] S901, in a case where the electronic device is in a screen-off display state, the auxiliary processor plays a first 3D animation, the first 3D animation includes a plurality of animation frames, and the first 3D animation is obtained by the auxiliary processor processing a first 3D model.

[0474] S902, while the auxiliary processor plays the first 3D animation, the main processor is in a sleep state.

[0475] After the electronic device is turned off, the auxiliary processor is in a running state, and the main processor enters a sleep state. The electronic device can drive the first 3D model to move by the auxiliary processor, and obtain a first 3D animation by rendering. The auxiliary processor can display the 3D animation in a screen-off state, thereby improving the display effect of the electronic device in a screen-off display mode. In addition, the main processor enters a sleep state, and the electronic device obtains a 3D animation by the auxiliary processor, thereby saving the power consumption of the electronic device.

[0476] Optionally, the first condition can include, but is not limited to, any one of the following triggering modes.

[0477] Trigger mode 1: the lock screen is triggered by the power key of the electronic device. For example, when the power key of the electronic device is pressed and then released by the user, the electronic device is locked and enters the screen-off display state.

[0478] Trigger mode 2: timeout lock screen. When the display screen of the electronic device is in the screen-on state for a length of time reaching a preset length of time, the electronic device is locked and enters the screen-off display state.

[0479] Trigger mode 3: the lock screen is triggered by the distance sensor. During a call, if the distance sensor detects that the face is close to the display screen, the electronic device is locked and enters the screen-off display state.

[0480] It should be noted that the first condition can also be other triggering modes, which are not limited in the present application.

[0481] Optionally, the first 3D model can be sent to the secondary processor by the primary processor. It can also be stored in the secondary processor.

[0482] Optionally, if the user does not replace the first 3D model, the primary processor only needs to send the first 3D model to the secondary processor once, and does not need to send the first 3D model every time the electronic device enters the screen-off display state. The secondary processor can use the first 3D model previously sent by the primary processor and stored in the secondary processor. After the user replaces the first 3D model, the primary processor sends the replaced first 3D model to the secondary processor, and the secondary processor uses the first 3D model sent by the primary processor.

[0483] For example, the UI of the secondary processor playing the first 3D animation can refer to the description in the embodiments of FIGS. 5A-5C and FIGS. 5D-5E.

[0484] In a possible implementation, the method further includes: in response to the user selecting the second 3D model, the secondary processor plays a second 3D animation in the screen-off display state of the electronic device, the second 3D animation includes a plurality of animation frames, and the second 3D animation is processed by the secondary processor according to the second 3D model; and the primary processor is in the sleep state when the secondary processor plays the second 3D animation.

[0485] Optionally, the 3D model and the motion sequence can have an association relationship. Different 3D models can use different motion sequences, so that different 3D models obtain different 3D animations.

[0486] Optionally, the 3D model and the motion sequence can have no association relationship. Different 3D models can use the same motion sequence, so that different 3D models obtain the same 3D animation.

[0487] Optionally, the second 3D model is different from the first 3D model, and the second 3D animation can be the same as or different from the first 3D animation. Different 3D models can play the same animation or different animations.

[0488] In a possible implementation, the first 3D model or the second 3D model is a preset 3D model, or the first 3D model or the second 3D model is obtained by the main processor based on a picture or a video selected by a user.

[0489] In this way, the user can replace a 3D model that the user likes, so as to improve the screen-off display effect and improve the user experience.

[0490] For example, how the user operates to replace the 3D model can refer to the description in the embodiments of FIGS. 4A-4L.

[0491] In a possible implementation, the first 3D animation is obtained by the auxiliary processor based on the first 3D model and the first motion sequence.

[0492] In a possible implementation, the method further includes: the main processor sends the first 3D model and one or more motion sequences to the auxiliary processor, the one or more motion sequences including the first motion sequence or a second motion sequence; the auxiliary processor generates the first animation based on the first 3D model and the first motion sequence, or the auxiliary processor generates a fifth animation based on the first 3D model and the second motion sequence.

[0493] In this way, the auxiliary processor can generate different animations based on the same 3D model through different motion sequences.

[0494] Optionally, the main processor can also send only the first motion sequence or the second motion sequence in the one or more motion sequences to the auxiliary processor.

[0495] Optionally, the main processor can also send all the one or more motion sequences to the auxiliary processor.

[0496] In a possible implementation, the second 3D animation is obtained by the auxiliary processor based on the second 3D model and the first motion sequence.

[0497] In this way, the auxiliary processor can generate different animations based on different 3D models through the same motion sequence.

[0498] In a possible implementation, the first motion sequence is a motion sequence selected by a user or a default motion sequence.

[0499] In this way, the auxiliary processor can generate the first 3D animation based on the motion sequence selected by the user, and the auxiliary processor can also generate the first 3D animation based on a default motion sequence to be used.

[0500] In a possible implementation, before the auxiliary processor plays the first 3D animation, the method further includes: the auxiliary processor obtaining first information, the first information including any one of the following: image data collected by the camera, biometric data, interaction data, and a first music file, the first music file being a music file played after the electronic device enters the screen-off display state; and the auxiliary processor obtaining the first 3D animation based on the first information.

[0501] Optionally, the image data collected by the camera can include a face image, eye movement, etc.

[0502] Optionally, the biometric data can include heart rate, step count, motion duration, calories consumed, etc.

[0503] Optionally, the interaction data can include operation data of the user on the display screen collected by a sensor preinstalled in the display screen.

[0504] In this way, the auxiliary processor obtains the first 3D animation based on the first information, thereby enriching the diversity of the 3D animation played by the auxiliary processor.

[0505] In a possible implementation, the method further includes: the auxiliary processor obtaining second information, the second information including any one of the following: image data collected by the camera, biometric data, interaction data, and a second music file; and the auxiliary processor determining a second 3D animation based on the second information, the second information being different from the first information, and the second 3D animation being different from the first 3D animation.

[0506] Optionally, if the first information changes, for example, the auxiliary processor obtains the second information, the auxiliary processor can obtain a second 3D animation based on the second information. When the second information is the same as the first information, the second 3D animation is the same as the first 3D animation. When the second information is different from the first information, the second 3D animation is different from the first 3D animation.

[0507] In this way, the 3D animation played by the auxiliary processor changes with the information obtained by the auxiliary processor, thereby enriching the diversity of the 3D animation played by the auxiliary processor.

[0508] For how the auxiliary processor obtains the first 3D animation based on the first information and how the auxiliary processor obtains the second 3D animation based on the second information, refer to the description in the embodiments of FIGS. 8A-8D.

[0509] In a possible implementation, in a possible implementation, the first 3D animation is obtained by the auxiliary processor based on the first 3D model and the first motion sequence; the auxiliary processor determines the first 3D animation based on the first information, specifically including: the auxiliary processor determines the first response event based on the first information; the auxiliary processor determines the first motion sequence from one or more motion sequences based on the first response event; and the auxiliary processor obtains the first 3D animation based on the first motion sequence and the first 3D model.

[0510] Optionally, when the first information includes image data collected by the camera, the first response event includes a first expression / emotion.

[0511] When the first information includes biological feature data, the first response event includes a first operation type.

[0512] When the first information includes interaction data, the first response event includes a first motion type.

[0513] When the first information includes a first music file, the first response event includes a music type of the first music.

[0514] For how the auxiliary processor determines the first motion sequence based on the first information, refer to the description in the embodiments of FIGS. 8A-8D.

[0515] In a possible implementation, the method further includes: the auxiliary processor determines a first response event based on the first information; the auxiliary processor determines a first motion sequence from one or more motion sequences based on the first response event; the auxiliary processor obtains third information; the auxiliary processor obtains a third motion sequence based on the third information and the first motion sequence; and the auxiliary processor obtains a fourth 3D animation based on the third motion sequence and the first 3D model.

[0516] In this way, the auxiliary processor can change the first motion sequence determined by the auxiliary processor based on the third information, so as to change the style of the first 3D animation played by the auxiliary processor, further enriching the diversity of the 3D animation played by the auxiliary processor.

[0517] For example, the third information can be music information of the first music played by the auxiliary processor, and the music information of the first music can include, but is not limited to, any one of the following: rhythm, beat, intensity, etc. of the first music.

[0518] The third information is not limited to the music information of the first music, and can also include other information, which is not limited in the present application.

[0519] For how the auxiliary processor obtains the first motion sequence based on the third information and the second motion sequence, refer to the description in the embodiment of FIG. 8E.

[0520] In a possible implementation, before detecting that the first condition for entering the screen-off display state is met, the method further includes: playing, by the main processor, first music; and after detecting that the first condition for entering the screen-off display state is met, the method further includes: continuing, by the auxiliary processor, to play the first music based on the first music file.

[0521] In this way, the main processor plays the first music before the electronic device enters the screen-off display state. After the electronic device enters the screen-off display state, the auxiliary processor can play the first music.

[0522] Optionally, before the main processor enters the sleep state, the main processor is further configured to send the first music file to the auxiliary processor, so that the auxiliary processor can continue to play the first music.

[0523] For example, the auxiliary processor plays the first music and the UI of the first 3D animation, which can refer to the description in the embodiments of FIGS. 5F-5H.

[0524] In a possible implementation, the auxiliary processor plays the first 3D animation, and specifically includes: displaying, by the auxiliary processor, a first frame of animation frames in the first 3D animation when no user is recognized; and continuing, by the auxiliary processor, to play the remaining animation frames in the first 3D animation when a user is recognized.

[0525] In this way, when no touch event of the user on the display screen or no gaze event of the user on the display screen is recognized, the electronic device only displays the first frame of animation frames in the first 3D animation, and after a touch event of the user on the display screen or a gaze event of the user on the display screen is recognized, the electronic device continues to play the animation frames in the first 3D animation, which can save power consumption of the electronic device.

[0526] For example, the touch event of the user on the display screen can refer to a click operation, a sliding operation, a long press operation, and the like of the user on the display screen.

[0527] In a possible implementation, the first motion sequence is a preset motion sequence; or the first motion sequence is obtained by the main processor based on one or more actions of a target object in the first video selected by the user; or the first motion sequence is downloaded by the main processor from a server.

[0528] In this way, the user can also replace the motion sequence that the user likes, so as to improve the screen-off display effect and improve the user experience.

[0529] For example, how the user replaces the motion sequence can refer to the description in the embodiments of FIGS. 4N-4T.

[0530] The application provides an electronic device, comprising a main processor and an auxiliary processor, and the main processor and the auxiliary processor are used to implement a screen-off display method shown in FIG. 9.

[0531] The application provides an electronic device, comprising a memory and a processor, wherein the memory is used to store a computer program, and the processor is used to call the computer program to make the electronic device execute a screen-off display method shown in FIG. 9.

[0532] The application provides an apparatus, comprising units or modules used to execute any method in the first aspect or a screen-off display method shown in FIG. 9.

[0533] The application provides a readable storage medium, which stores a program or instructions, and when the program or instructions are run on an apparatus, the electronic device executes a screen-off display method shown in FIG. 9.

[0534] The application provides a chip system, comprising one or more processors, and the processors are used to call computer instructions to make a first electronic device execute a screen-off display method shown in FIG. 9.

[0535] The application provides a program product, comprising computer instructions, and when the computer instructions are run on an electronic device, the electronic device executes a screen-off display method shown in FIG. 9.

[0536] The electronic device 100 to which the embodiments of the application can be applied can exemplarily include, but is not limited to, an electronic device carrying or other operating systems.

[0537] The electronic device 100 in the embodiments of the application can realize human-computer interaction.

[0538] The electronic device 100 in the embodiments of the application has at least two processors, one of which is a main processor and the other of which is an auxiliary processor. The main processor carries a main operating system, and the auxiliary processor carries a lightweight operating system.

[0539] The electronic device 100 in the embodiments of the application can have one display screen or multiple display screens. Taking a single-screen electronic device with one display screen as an example, the single-screen electronic device can be a single-screen straight phone, a tablet computer, etc. Taking a double-screen electronic device with two display screens as an example, the double-screen electronic device can be a folding-screen phone, a double-screen straight phone, etc.

[0540] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware or any combination thereof. When implemented by software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer programs or instructions. When the computer programs or instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments are performed. The computer can be a general purpose computer, a special purpose computer, a computer network, a network device, a user equipment or other programmable apparatus. The computer programs or instructions can be stored in a computer readable storage medium or transferred from one computer readable storage medium to another computer readable storage medium, for example, the computer programs or instructions can be transferred from one website site, computer, server or data center to another website site, computer, server or data center through wired or wireless manner. The computer readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, data center and the like integrated with one or more available media. The available media can be a magnetic medium, such as a floppy disk, a hard disk, a magnetic tape; or an optical medium, such as a digital video disc; or a semiconductor medium, such as a solid state disk. The computer readable storage medium can be a volatile or non-volatile storage medium, or can include both volatile and non-volatile storage media.

[0541] In various embodiments of the present application, the terms and / or descriptions of different embodiments are consistent and can be referred to each other if there is no special description and logical conflict. The technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationship.

[0542] In the present application, "at least one" means one or more, and "multiple" means two or more. The association relationship between the associated objects is described, which means that there can be three kinds of relationships, for example, A and / or B, which can represent the following cases: A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. In the literal description of the present application, the character " / ", generally represents that the associated objects before and after are in an "or" relationship; in the formula of the present application, the character " / ", represents that the associated objects before and after are in a "division" relationship. "Including at least one of A, B and C" can mean: including A; including B; including C; including A and B; including A and C; including B and C; including A, B and C.

[0543] It can be understood that various numbers involved in the embodiments of the present application are only distinguished for convenience of description, and are not used to limit the scope of the embodiments of the present application. The size of the serial number of the above processes does not mean the execution order, and the execution order of the processes should be determined according to their functions and inherent logic.

Claims

1. A method for displaying a screen when it is off, characterized in that, The method is applied to an electronic device, the electronic device comprising a main processor and an auxiliary processor; the method comprising: In a case where the electronic device is in an off-screen display state, the auxiliary processor plays a first 3D animation, the first 3D animation comprising a plurality of animation frames, the first 3D animation being obtained by the auxiliary processor based on a first 3D model; In a case where the auxiliary processor plays the first 3D animation, the main processor is in a hibernation state.

2. The method of claim 1, wherein, The method further comprises: In response to an operation of selecting a second 3D model by a user, in a case where the electronic device is in the off-screen display state, the auxiliary processor plays a second 3D animation, the second 3D animation comprising a plurality of animation frames, the second 3D animation being obtained by the auxiliary processor based on a second 3D model; In a case where the auxiliary processor plays the second 3D animation, the main processor is in the hibernation state.

3. The method of claim 2, wherein, The first 3D model or the second 3D model is a preset 3D model. Alternatively, The first 3D model or the second 3D model is obtained by the main processor based on a picture or a video selected by a user.

4. The method according to any one of claims 1 to 3, characterized in that, The first 3D animation is obtained by the auxiliary processor based on the first 3D model and a first motion sequence.

5. The method according to any one of claims 1 to 3, characterized in that, The method further comprises: The main processor sends the first 3D model and one or more motion sequences to the auxiliary processor, the one or more motion sequences comprising the first motion sequence or a second motion sequence; The auxiliary processor generates the first animation based on the first 3D model and the first motion sequence, or generates a fifth animation based on the first 3D model and the second motion sequence.

6. The method according to claim 2 or 3, characterized in that, The second 3D animation is obtained by the auxiliary processor based on the second 3D model and the first motion sequence.

7. The method according to any one of claims 4-6, characterized in that, The first motion sequence is a motion sequence selected by a user or a default motion sequence.

8. The method according to any one of claims 1 to 7, characterized in that, Before the auxiliary processor plays the first 3D animation, the method further comprises: The auxiliary processor obtains first information, the first information comprising any one of the following: image data collected by a camera, biometric data, interaction data, and a first music file, the first music file being a music file played after the electronic device enters the off-screen display state; The auxiliary processor obtains the first 3D animation based on the first information.

9. The method of claim 8, wherein, The method further comprises: The auxiliary processor obtains second information, the second information comprising any one of the following: image data collected by a camera, biometric data, interaction data, and a second music file; The auxiliary processor determines a third 3D animation based on the second information, the second information being different from the first information, and the third 3D animation being different from the first 3D animation.

10. The method according to claim 8 or 9, characterized in that, The first 3D animation is obtained by the auxiliary processor based on the first 3D model and a first motion sequence. The auxiliary processor obtains the first 3D animation based on the first information, specifically comprising: The auxiliary processor determines a first response event based on the first information; The auxiliary processor determines the first motion sequence from the one or more motion sequences based on the first response event; The auxiliary processor obtains the first 3D animation based on the first motion sequence and the first 3D model.

11. The method of claim 10, wherein, The method further comprises: The auxiliary processor determines a first response event based on the first information; The auxiliary processor determines a first motion sequence from the one or more motion sequences based on the first response event; The auxiliary processor obtains third information; The auxiliary processor obtains the third motion sequence based on the third information and the first motion sequence; The auxiliary processor obtains a fourth 3D animation based on the third motion sequence and the first 3D model.

12. The method according to claim 10 or 11, characterized in that, When the first information comprises image data captured by the camera, the first response event comprises a first expression / emotion; When the first information comprises the biometric data, the first response event comprises a first operation type; When the first information comprises the interaction data, the first response event comprises a first motion type; When the first information comprises the first music file, the first response event comprises a music type of the first music.

13. The method of claim 11, wherein, The third information comprises music information of the first music, and the music information of the first music comprises any one or more of: a first rhythm, a first beat, and a first intensity.

14. The method according to any one of claims 1 to 13, characterized in that, Before detecting that the first condition for entering the screen-off display state is met, the method further comprises: The main processor plays first music; After detecting that the first condition for entering the screen-off display state is met, the method further comprises: The auxiliary processor continues to play the first music based on the first music file.

15. The method according to any one of claims 1 to 14, characterized in that, The auxiliary processor plays a first 3D animation, specifically comprising: In a case where no user is identified, the auxiliary processor displays a first frame of animation frame in the first 3D animation; In a case where a user is identified, the auxiliary processor continues to play remaining animation frames in the first 3D animation.

16. The method of claim 15, wherein, Wherein, The case where the auxiliary processor identifies a user comprises any one or more of: the auxiliary processor identifies a user voiceprint, the auxiliary processor identifies a user fingerprint, the auxiliary processor identifies a user facial image, and the auxiliary processor identifies an operation of the user on the display screen.

17. The method according to any one of claims 1 to 16, characterized in that, The one or more motion sequences are preset motion sequences; Or, The one or more motion sequences are obtained by the main processor based on one or more actions of a target object in a first video selected by a user; Or, The one or more motion sequences are downloaded by the main processor from a server.

18. An electronic device, comprising: The electronic device comprises a memory and a processor, wherein the memory is configured to store a computer program, and the processor is configured to invoke the computer program, so that the electronic device executes the method in any one of claims 1-17.

19. A computer readable storage medium comprising instructions, wherein: When the instructions are run on the electronic device, the electronic device executes the method in any one of claims 1-17.

20. A computer program product, characterised in that, The computer program product comprises computer instructions, when the computer instructions are run on the electronic device, the electronic device executes the method in any one of claims 1-17.

Images