Display method and electronic equipment

Abstract

The invention provides a display method and electronic equipment. In the method, the electronic equipment detects that a first condition is met, the electronic equipment displays a first interface in response to the first condition, the first interface comprises a first area and a second area, the first area displays a virtual image, and the second area displays an interface of a second application. Through the scheme, the electronic equipment can respectively display the virtual image and the application interface in different display areas when the first condition is met, so that rich display effects are provided for a user, the interestingness is improved, and the user experience is improved. For example, the second area may display an application card of the music player, and the first area may display a virtual image, which may be associated with the music player, such as the virtual image may be worn with an earphone.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of terminal, and in particular, to a display method and an electronic device. BACKGROUND

[0002] With the development of terminal technology, the use scenarios of electronic devices such as mobile phones tend to be diversified. Electronic devices are no longer limited to displaying content in a bright screen unlocked state. For example, always on display (AOD) technology can support electronic devices to display a clock and other controls in a lock screen state, so that users can view the controls at any time without waking up the electronic device.

[0003] In some examples, when the electronic device is in a charging state and the electronic device is placed horizontally, the electronic device can enter a table mode, and display content such as a clock control on the electronic device in a horizontal screen mode, so that users can view practical information at any time, and the display scenarios of the electronic device are enriched. SUMMARY

[0004] The present application provides a display method and an electronic device to provide a display scheme with rich content and strong interactivity.

[0005] In a first aspect, the present application provides a display method, which can be executed by an electronic device. In the method, the electronic device detects that a first condition is met, and in response to the first condition being met, the electronic device displays a first interface. The first interface includes a first region and a second region. The first region displays a virtual image, and the second region displays an interface of a second application.

[0006] In the above method, the electronic device can display a virtual image and an interface of an application in different display regions when the first condition is met, thereby providing users with rich display effects and improving the interest, and thus improving the user experience.

[0007] In a possible design, the virtual image is a virtual image in a first application.

[0008] Optionally, the first application and a third application to which the first interface belongs can be the same application.

[0009] In a possible design, the virtual image is associated with the second application. Through this design, the virtual image displayed in the first region by the electronic device can be associated with the second application, such as the appearance or action of the virtual image being related to the second application, thereby improving the interest of the displayed content and further improving the user experience.

[0010] In a possible design, the virtual image is determined according to the second application.

[0011] In a possible design, the virtual image is determined according to at least one of the following: a type of the second application, a type of the interface of the second application displayed in the second region, information in the interface of the second application displayed in the second region.

[0012] By this design, the virtual image displayed in the first region by the electronic device can be determined according to at least one of the following: the type of the second application, the type of the interface displayed in the second region, and the content in the interface of the second application displayed in the second region, so that the two parts of content in the first interface are more relevant, the displayed content is more abundant and interesting, and the user experience is improved.

[0013] In a possible design, the first condition includes at least one of the following: the electronic device is in a charging state; the electronic device is in a horizontal screen state; a first operation of a user is detected, and the first operation is used to start a third application to which the first interface belongs. By this design, the electronic device can display the first interface including the virtual image and the interface of the second application when the electronic device is charging, placed horizontally, or the user triggers the running of the application displaying the first interface, so that the first interface is displayed when the electronic device is placed on a desktop or the like, the display scenario of the electronic device is enriched, and the user experience is improved.

[0014] In a possible design, the method further includes: determining a virtual image appearance parameter corresponding to an application type of the second application according to a stored correspondence between a plurality of application types and virtual image appearance parameters, and the virtual image displayed in the first region is determined according to the virtual image appearance parameter corresponding to the application type of the second application.

[0015] In a possible design, the method further includes: determining a virtual image appearance parameter corresponding to a type of the interface of the second application displayed in the second region according to a stored correspondence between a plurality of interface types and virtual image appearance parameters, and the virtual image displayed in the first region is determined according to the virtual image appearance parameter corresponding to the type of the interface of the second application.

[0016] By the above design, the appearance of the virtual image displayed in the first interface of the electronic device can be related to the type of the second application or the type of the interface of the second application in the second region, so that the interestingness of the displayed content is increased, and the display effect is enriched.

[0017] In a possible design, the interface of the second application is an application card of the second application or an application interface of the second application.

[0018] In a possible design, the interface of the second application includes a control and / or multimedia content.

[0019] In one possible design, the method further includes: in response to a second user action, displaying the adjusted virtual avatar in the first area, or displaying an animation of the virtual avatar corresponding to the second action in the first area. This design allows users to trigger electronic devices to adjust the appearance of the virtual avatar or display its animation, enhancing the interactivity of the displayed content and thus improving the user experience.

[0020] In one possible design, the method further includes: responding to the user's second operation by controlling the interface displayed in the second area to perform a response action corresponding to the second operation. This design allows the user to trigger the interface displayed in the second area to perform a response action, making the interface content or display method in the second area more in line with the user's needs and improving the user experience.

[0021] In one possible design, the second operation is the user moving a position in front of the electronic device's display screen, or the second operation is a gesture triggered by the user in front of the display screen, or the second operation is a touch gesture triggered by the user on the display screen. This design allows the electronic device to support user operations in response to multiple input methods, enhancing interactivity.

[0022] In one possible design, the electronic device includes a management module. The step of displaying an adjusted virtual avatar in the first area, or displaying an animation of the virtual avatar corresponding to the first operation, in response to a second user action, includes: the management module acquiring information about the second operation; sending a first request message to the first application, the first request message including information about the second operation; the management module receiving parameters of the virtual avatar corresponding to the second operation sent by the first application; and the management module adjusting the appearance of the virtual avatar or displaying an animation of the virtual avatar based on the parameters of the virtual avatar corresponding to the second operation. Through this design, the management module can interact with the first application after acquiring information about the second user action to adjust the appearance of the virtual avatar or display an animation of the virtual avatar.

[0023] In one possible design, the response to the user's second operation, displaying the virtual avatar with adjusted appearance in the first area, or displaying an animation of the virtual avatar corresponding to the first operation in the first area, includes: the management module obtaining information about the second operation and sending a first request message to the first application, the first request message being used to request the virtual avatar or the animation of the virtual avatar, so that the first application sends the virtual avatar or the animation of the virtual avatar to the management module.

[0024] In one possible design, the step of responding to a user's second operation by displaying an adjusted virtual avatar in the first area, or displaying an animation of the virtual avatar corresponding to the first operation in the first area, includes: the management module acquiring information about the second operation and sending a first request message to the first application, the first request message being used to request the first application to display the adjusted virtual avatar or display an animation of the virtual avatar in the first area.

[0025] In one possible design, the second operation is an operation performed on the virtual avatar.

[0026] In one possible design, the electronic device includes a management module that, in response to the user's second operation, controls the interface displayed in the second area to perform a response action corresponding to the second operation, comprising: the management module receiving a second request message sent by the first application, the second request message being used to request the second application to perform a response action corresponding to the second operation in the interface of the second application; and the management module sending a third request message to the second application, the third request message being used to request the second application to perform a response action corresponding to the second operation in the interface of the second application.

[0027] In one possible design, the electronic device includes a management module that, in response to the user's second operation, controls the interface displayed in the second area to execute a response action corresponding to the second operation, comprising: the management module receiving a second request message sent by the first application, the second request message being used to request the execution of a response action corresponding to the second operation; the management module determining, based on the type of the second application, the response action corresponding to the second operation that the second application can execute in the interface of the second application; and the management module sending a third request message to the second application, the third request message being used to request the second application to execute the response action corresponding to the second operation in the interface of the second application.

[0028] In one possible design, the electronic device includes a management module that, in response to the user's second operation, controls the interface displayed in the second area to execute a response action corresponding to the second operation. This includes: the management module receiving a second request message sent by the first application, the second request message including information about the second operation; and the management module sending a third request message to the second application, the third request message including information about the second operation, so that the second application determines and executes a response action corresponding to the second operation based on the information about the second operation.

[0029] Through the above design, the first application can also request the management module to instruct the second application to perform the response action corresponding to the second operation, thereby enabling the virtual image in the first interface and the interface of the second application to perform the corresponding response action after the user inputs the operation, and ensuring the transmission order of instructions between the first application, the management module and the second application, so that the first application and the second application in the electronic device can perform the correct response to the user operation.

[0030] In one possible design, the electronic device includes a management module that, in response to the user's second operation, controls the interface displayed in the second area to perform a response action corresponding to the second operation. This includes: the management module acquiring information about the second operation and sending a fourth request message to the second application, the fourth request message including information about the second operation, so that the second application determines and performs a response action corresponding to the second operation based on the information about the second operation.

[0031] In one possible design, the second operation is an operation performed on the interface of the second application displayed in the second area.

[0032] In one possible design, the electronic device includes a management module that, in response to a second user operation, displays an adjusted virtual avatar in the first area, or displays an animation of the virtual avatar corresponding to the second operation in the first area. This includes: the management module receiving a fifth request message sent by a second application, the fifth request message requesting control of the virtual avatar to perform a response action corresponding to the second operation; the management module sending a sixth request message to a first application, the sixth request message requesting access to parameters of the virtual avatar corresponding to the second operation; the management module receiving the parameters of the virtual avatar corresponding to the second operation sent by the first application; and the management module adjusting the appearance of the virtual avatar or displaying an animation of the virtual avatar based on the parameters of the virtual avatar corresponding to the second operation.

[0033] In one possible design, the electronic device includes a management module. The action of displaying an adjusted virtual avatar in the first area, or displaying an animation of the virtual avatar corresponding to the second operation in the first area, in response to a second user's second operation, includes: the management module receiving a fifth request message sent by a second application, the fifth request message requesting control of the virtual avatar to perform a response action corresponding to the second operation; the management module determining, based on the attributes of the virtual avatar, that the response action corresponding to the second operation is adjusting the appearance of the virtual avatar or displaying an animation of the virtual avatar, sending a sixth request message to the first application, the sixth request message requesting access to parameters for adjusting the appearance of the virtual avatar or displaying the animation of the virtual avatar; the management module receiving the parameters of the virtual avatar sent by the first application; and the management module adjusting the appearance of the virtual avatar or displaying the animation of the virtual avatar based on the parameters of the virtual avatar.

[0034] Optionally, in the above design, the sixth request message can also be used to obtain a virtual avatar or a virtual avatar animation. The management module can receive the virtual avatar or virtual avatar animation sent by the first application and display the virtual avatar or virtual avatar animation in the first area. Alternatively, the sixth request message can also be used to request the display of a virtual avatar or virtual avatar animation. The sixth request message may include the location information of the first area so that the first application displays the virtual avatar or virtual avatar animation in the first area after receiving the sixth request message.

[0035] In one possible design, the electronic device includes a management module. The action of displaying an adjusted virtual avatar in the first area, or displaying an animation of the virtual avatar corresponding to the second operation in the first area, in response to a second user's second operation, includes: the management module receiving a fifth request message sent by a second application, the fifth request message including information about the second operation; the management module sending a sixth request message to the first application, the sixth request message including information about the second operation; the management module receiving parameters of the virtual avatar corresponding to the second operation sent by the first application; and the management module adjusting the appearance of the virtual avatar or displaying an animation of the virtual avatar based on the parameters of the virtual avatar corresponding to the second operation.

[0036] Through the above design, the second application can also request the management module to instruct the first application to perform the response action corresponding to the second operation, thereby enabling the virtual image in the first interface and the interface of the second application to perform the corresponding response action after the user inputs the operation, and ensuring the transmission order of instructions between the first application, the management module and the second application, so that the first application and the second application in the electronic device can perform the correct response to the user operation.

[0037] In one possible design, the management module is an application within the electronic device, or the management module belongs to the framework layer of the electronic device.

[0038] In one possible design, the first interface can be any one of a lock screen, an always-on display (AOD) interface, or an application interface for a third application. This design allows the electronic device to display the first interface in various display scenarios, enriching the display experience.

[0039] In one possible design, the virtual avatar displayed in the first area is a virtual avatar determined from multiple candidate virtual avatars based on user settings, system settings, or recommendation algorithms.

[0040] Secondly, this application provides an electronic device comprising multiple functional modules; the multiple functional modules interact to implement the methods performed by the electronic device in any of the above aspects and their respective embodiments. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementations.

[0041] Thirdly, this application provides an electronic device including at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the electronic device is running, the at least one processor executes any of the above aspects and the methods executed by the electronic device in its various embodiments.

[0042] Fourthly, this application also provides a computer program product containing instructions that, when the computer program product is run on a computer, cause the computer to perform the method executed by the electronic device in any of the above aspects and embodiments.

[0043] Fifthly, this application also provides a computer-readable storage medium storing a computer program that, when executed by a computer, causes the computer to perform the method executed by the electronic device in any of the above aspects and embodiments.

[0044] Sixthly, this application also provides a chip for reading a computer program stored in a memory and executing the method performed by the electronic device in any of the above aspects and embodiments.

[0045] Seventhly, this application also provides a chip system including a processor for supporting a computer device in implementing the methods executed by the electronic devices in any of the above aspects and embodiments. In one possible design, the chip system further includes a memory for storing programs and data necessary for the computer device. The chip system may be composed of chips or may include chips and other discrete devices. Attached Figure Description

[0046] Figure 1 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0047] Figure 2 A software structure block diagram of an electronic device provided in an embodiment of this application;

[0048] Figure 3 A schematic diagram of a display interface provided in an embodiment of this application;

[0049] Figure 4 A flowchart illustrating a display method provided in an embodiment of this application;

[0050] Figure 5 A schematic diagram of a display interface provided in an embodiment of this application;

[0051] Figure 6 This is a schematic diagram of a display interface provided in an embodiment of this application;

[0052] Figure 7 A flowchart illustrating a display method provided in an embodiment of this application;

[0053] Figure 8 A schematic diagram of a display interface provided in an embodiment of this application;

[0054] Figure 9 A flowchart illustrating a display method provided in an embodiment of this application. Detailed Implementation

[0055] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings. In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature.

[0056] It should be understood that in the embodiments of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.

[0057] With the development of terminal technology, electronic devices are able to provide users with increasingly rich display scenarios. For example, when an electronic device is charging and placed horizontally, it can enter a "tabletop mode". In this mode, the electronic device displays clocks, photos and other content on the screen in a horizontal manner, so that users can view practical information at any time. However, in this display mode, the electronic device can only display a few fixed widgets, and the user operation it supports is very limited, resulting in a poor user experience.

[0058] To address the aforementioned problems, this application provides a display method that can be executed by an electronic device. In this method, the electronic device detects that a first condition is met; in response to the first condition being met, the electronic device displays a first interface, which includes a first area and a second area. The first area displays a virtual avatar, and the second area displays the interface of a second application. Through this design, the electronic device can display the virtual avatar and the application interface in different display areas when placed in landscape mode, providing users with rich display effects, enhancing engagement, and thus improving the user experience.

[0059] The following describes an electronic device and embodiments for using such an electronic device. The electronic device in this application embodiment can be a tablet computer, mobile phone, in-vehicle device, augmented reality (AR) / virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), wearable device, etc. This application embodiment does not limit the specific type of electronic device.

[0060] In some embodiments of this application, the electronic device may also be a portable terminal device that includes other functions such as a personal digital assistant and / or a music player. Exemplary embodiments of the portable terminal device include, but are not limited to, devices equipped with... Or portable terminal devices with other operating systems.

[0061] Figure 1 This is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of this application. Figure 1 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0062] Processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the central nervous system and command center of the electronic device 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. Processor 110 may also include memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that processor 110 has recently used or is repeatedly used. If processor 110 needs to reuse an instruction or data, it can directly retrieve it from the memory. This avoids repeated access, reduces the waiting time of processor 110, and thus improves system efficiency.

[0063] USB interface 130 is a USB standard compliant interface, specifically a Mini USB interface, Micro USB interface, USB Type-C interface, etc. USB interface 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. Charging management module 140 receives charging input from the charger. Power management module 141 connects battery 142, charging management module 140, and processor 110. Power management module 141 receives input from battery 142 and / or charging management module 140, providing power to processor 110, internal memory 121, external memory, display 194, camera 193, and wireless communication module 160, etc.

[0064] The wireless communication function of electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0065] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0066] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0067] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0068] The display screen 194 is used to display the display interface of an application, such as the display page of an application installed on the electronic device 100. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Mini LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, where N is a positive integer greater than 1.

[0069] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0070] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and software code for at least one application program. The data storage area may store data generated during the use of electronic device 100 (e.g., captured images, recorded videos, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0071] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, images, videos, and other files can be saved on the external memory card.

[0072] Electronic device 100 can implement audio functions such as music playback and recording through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0073] The sensor module 180 may include a pressure sensor 180A, an acceleration sensor 180B, a touch sensor 180C, etc.

[0074] The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194.

[0075] Touch sensor 180C, also known as a "touch panel," can be located on display screen 194. The touch sensor 180C and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180C detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180C may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0076] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. Electronic device 100 can receive button inputs and generate key signal inputs related to user settings and function control. Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, touch operations applied to different applications (such as taking photos, audio playback, etc.) can correspond to different vibration feedback effects. Touch vibration feedback effects can also be customized. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, or to indicate messages, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with electronic device 100.

[0077] Understandable, Figure 1The components shown do not constitute a specific limitation on the electronic device 100. The electronic device may also include more or fewer components than shown, or combine some components, or separate some components, or have different component arrangements. Furthermore, Figure 1 The combination / connection relationships between the components can also be adjusted and modified.

[0078] Figure 2 This is a software structure block diagram of an electronic device provided in an embodiment of this application. For example... Figure 2 As shown, the software architecture of an electronic device can be a layered architecture. For example, the software can be divided into several layers, each with a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers, from top to bottom: the application layer, the application framework layer (framework, FWK), the runtime and system libraries, and the kernel layer.

[0079] The application layer can include a series of application packages. For example... Figure 2 As shown, the application layer may include a camera, settings, skin modules, a user interface (UI), and third-party applications. These third-party applications may include a gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS. In this embodiment, the application layer may further include a management module for integrating, managing, and maintaining the interface displayed when the electronic device is placed in landscape mode. Optionally, as... Figure 2 As shown, the management module may include a 3D control container and a 2D control container. The 3D control container can be used to hold a 3D virtual character provided by the first application, and the 2D control container can be used to hold the application interface, application window, controls, etc., provided by the second application. The management module can interact with the first and second applications by reading configuration files or providing external interfaces to display the 3D virtual character and application interface in the interface. Optionally, in this embodiment, the application layer may also include a multimodal input module. The multimodal input module is used to receive input events such as touch gestures and air gestures, and send the received input events to the management module. The multimodal input module can be an independent application in the electronic device, or it can be a functional module integrated into other applications.

[0080] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer can include some predefined functions. For example... Figure 2As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, and a notification manager. In this embodiment, the application framework layer may further include a management module. The function of the management module is the same as that of the management module in the application layer described above, and will not be repeated here. It should be noted that the management module in this embodiment may be located in the application layer or the application framework layer. In specific implementation, the location of the management module in the application layer or the application framework layer can be determined based on factors such as the operating system configuration and performance of the electronic device. Optionally, the application framework layer in this embodiment may further include a multi-mode input module. The multi-mode input module can be a system service function of the electronic device. For example, the multi-mode input module can be an additional module in the input subsystem of the electronic device, or it can also be a separate system service. The function of the multi-mode input module is the same as that of the multi-mode input module in the application layer described above, and will not be repeated here.

[0081] The window manager is used to manage windowed applications. It can obtain the screen size, determine if a status bar is present, lock the screen, and capture screenshots. The content provider stores and retrieves data, making this data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0082] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0083] A phone manager is used to provide communication functions for electronic devices. For example, it manages call status (including connection and disconnection).

[0084] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0085] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0086] The runtime includes the core libraries and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.

[0087] The core library consists of two parts: one part contains the functionalities that the Java language needs to call, and the other part contains the core libraries of the operating system. The application layer and application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0088] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), image processing libraries, etc.

[0089] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0090] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0091] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0092] A 2D graphics engine is a graphics engine for 2D drawing.

[0093] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0094] The hardware layer can include various types of sensors, such as accelerometers, gyroscopes, and touch sensors.

[0095] It should be noted that, Figure 1 and Figure 2 The structure shown is merely an example of an electronic device provided in this application embodiment and is not intended to limit the electronic device provided in this application embodiment in any way. In specific implementations, the electronic device may have more than Figure 1 or Figure 2 The structure shown may contain more or fewer devices or modules.

[0096] The methods provided in the embodiments of this application will be described below.

[0097] In the display method provided in this application embodiment, when the electronic device detects that the first condition is met, the electronic device can display a first interface on the display screen. The first interface includes a first area and a second area. The first area displays a virtual image, which is a virtual image provided by a first application in the electronic device. The second area displays the interface of a second application in the electronic device.

[0098] Optionally, the first condition may include at least one of the following: the electronic device is in a charging state, the electronic device is in landscape mode, and a first user operation is detected, the first operation being used to launch the application to which the first interface belongs. In this embodiment, the electronic device being in a charging state may include the electronic device being connected to a charging cable, the electronic device being placed on a wireless charging device, or the electronic device being connected to any other charging device; the electronic device being in landscape mode may include the electronic device being placed at a certain angle to the horizontal plane, or the electronic device being placed flat on the horizontal plane; the function of the electronic device displaying the first interface may also be a function provided by a third-party application installed on the electronic device or a system-level application of the electronic device, in which case the first operation may be an operation by which the user triggers the launch of the application on the electronic device, such as the first operation being that the user clicks the application icon of the application, and after the electronic device runs the application, the first interface can be displayed. It should be noted that if the function of the electronic device displaying the first interface requires the user to trigger the launch of the application and then perform operations such as searching or setting before it can be displayed, then the first operation may also include the above-mentioned search, setting, and other operation steps.

[0099] For example, when a user connects an electronic device to a charging device and places the device in landscape mode, the electronic device can then display the first screen.

[0100] In this embodiment of the application, the first interface displayed by the electronic device can be any one of the lock screen interface, the AOD interface, and the application interface of the third application, wherein the third application is the application in the electronic device used to display the first interface.

[0101] Optionally, when the electronic device is in a locked state and detects that the first condition is met, the electronic device can display a first interface, which is the lock screen interface. When the electronic device enters AOD mode and detects that the first condition is met, the electronic device can display the first interface, which is the AOD interface. The user can also run a third application on the electronic device, and the application interface of the third application can be the first interface. In some examples, when the first interface displayed by the electronic device is the application interface of the third application, the user can also trigger a screen lock operation. At this time, the electronic device enters a locked state, and the first interface can continue to be displayed on top of the lock screen interface.

[0102] As described in the above embodiments, the electronic device displays a first interface in response to a first condition. The first interface includes a first area and a second area, wherein the first area displays a virtual avatar, which is a virtual avatar in a first application; and the second area displays the interface of a second application.

[0103] Optionally, the virtual image displayed in the first area can be a two-dimensional virtual image or a three-dimensional virtual image. In the following description, a three-dimensional virtual image is displayed in the first area as an example. In specific implementations, the electronic device can also display a two-dimensional virtual image in the first area. Please refer to the following description for implementation details, and repeated parts will not be repeated. The three-dimensional virtual image displayed in the first area can be a three-dimensional virtual image generated based on three-dimensional data provided by a first application in the electronic device. For example, if the first application is a game application in the electronic device, then the three-dimensional virtual image can be a game character image in that game application; or, for example, if the first application is a video application in the electronic device, then the three-dimensional virtual image can be a virtual image in the video content of the video application. It should be noted that the first application can also be other applications in the electronic device, and the type of the first application is not limited in the embodiments of this application.

[0104] The interface displayed in the second area can be an application card or application interface of a second application in the electronic device. The interface displayed in the second area may include controls and / or multimedia content. An application card is a form of interface display that can provide some of the application's functions and can interact with the corresponding application to achieve the corresponding function when a control operation is received on a corresponding button. For example, an application card for a payment application can display a payment code, a receiving code, etc., while an application card for a music application can provide play / pause buttons, next track buttons, previous track buttons, etc. Application cards are usually customized by third parties (e.g., application developers). Application cards can be embedded into other applications as part of their interface. For example, users (such as desktop applications, third applications in this embodiment) can embed application cards into their own interfaces (e.g., embedded in an activity component of the Android operating system). That is, for any application, the application card corresponding to that application is independent of the application itself and can interact with the application to update or add important information or operations of the application to the application card. Application cards set up based on the Android operating system can be called widgets or widget cards, while application cards set up based on the HarmonyOS operating system can be called service cards, such as form ability (FA).

[0105] Optionally, when the second area displays the application interface of the second application, the application interface of the second application can be implemented through an extension component (UIExtention). The second area of ​​the first interface can include the extension component. After the second application draws its application interface, it can send the drawn application interface to the extension component, thereby displaying the application interface in the second area. It should be noted that the first application and the second application mentioned above can also be the same application. That is to say, the 3D virtual image and the interface in the first interface can belong to the same application.

[0106] In this embodiment, the interface of the second application displayed in the second area can be an application card or application interface selected from multiple application interfaces that can be displayed in the second area on the electronic device. The interface of the second application can be any of the following: the default interface among multiple interfaces, the interface last displayed in the second area by the electronic device, the interface whose usage frequency is higher than a preset threshold, the interface determined according to the current business scenario of the electronic device, or a user-defined interface. For example, when the electronic device is displaying the first interface, if the electronic device detects that it is currently playing audio, the electronic device can determine that the current business scenario is an audio playback scenario. Then, the electronic device can display an application card of a music player application in the second area. The application card can display information about the currently playing audio, as well as controls for controlling audio playback, pause, and song switching.

[0107] For example, Figure 3 This is a schematic diagram of a display interface provided in an embodiment of this application. (Reference) Figure 3 When the electronic device is in landscape orientation, it can display a first interface, which includes a 3D virtual avatar 301 and an application interface 302, such as... Figure 3 Taking the 3D virtual avatar 301 as a "snowman" virtual avatar and the application interface 302 as a music player application interface as an example, when the electronic device displays the 3D virtual avatar 301 in the first area, it can display animations of the 3D virtual avatar 301, such as the electronic device displaying an animation effect of the 3D virtual avatar 301 swaying to the music. Users can trigger operations in the controls of the application interface 302 to control the playback, pause, or switch songs.

[0108] Optionally, the virtual avatar displayed by the electronic device in the first area can be associated with a second application, and the virtual avatar displayed in the first area can be determined based on the second application. In some embodiments, the electronic device can determine the virtual avatar displayed in the first area based on at least one of the following: the type of the second application, the type of the interface of the second application displayed in the second area, and information in the interface of the second application displayed in the second area. The information in the interface of the second application displayed in the second area can be, for example, multimedia content, control information, etc., within the interface of the second application. In the embodiments of this application, the first application can develop various types of accessories for the virtual avatar corresponding to the second application, or the second application can modify the configuration file provided by the first application to provide accessories or actions for the virtual avatar corresponding to the second application. Therefore, when different types of application interfaces are displayed in the second area, the virtual avatar in the first area can have different appearances, increasing interest.

[0109] In some examples, the electronic device can store a mapping between multiple application types and virtual avatar appearance parameters. When displaying a virtual avatar, the electronic device can determine the virtual avatar appearance parameters corresponding to the type of the second application and display the virtual avatar in the first area according to the virtual avatar appearance parameters corresponding to the type of the second application. For example, when the type of the second application is a calendar, the base of the 3D virtual avatar can be today's calendar page; when the type of the second interface is a music player, the base of the 3D virtual avatar can be a record.

[0110] In other examples, the electronic device can store the correspondence between multiple interface types and virtual avatar appearance parameters. When displaying a virtual avatar, the electronic device can determine the virtual avatar appearance parameters corresponding to the interface type of the second application, and display the virtual avatar in the first area according to the virtual avatar appearance parameters corresponding to the interface type of the second application. For example, when the interface type of the second application is a music interface, the 3D virtual avatar displayed in the first area can wear headphones; when the interface type of the second application is a reading interface, the 3D virtual avatar in the first area can hold a book and can display the 3D virtual avatar's page-turning animation.

[0111] In other examples, the electronic device can determine the virtual avatar displayed in the first area based on information from the interface of the second application. For instance, when the interface of the second application includes an image, the virtual avatar displayed in the first area could be the appearance of holding the image.

[0112] In this embodiment of the application, the first area of ​​the electronic device can display multiple virtual images, which may come from the same or different applications. The virtual image displayed in the first area of ​​the electronic device may be a virtual image determined from multiple virtual images based on user settings, system settings, or recommendation algorithms.

[0113] In one optional implementation, the management module in the electronic device can be used to generate the first interface. This management module can be a system-level service, a system-level application, or a standalone application of the electronic device. When the management module is a system-level service, it can reside in the application layer or application framework layer of the electronic device. When the management module is a system-level application or a standalone application, it can be the third application described in the above embodiments, residing in the application layer of the electronic device. For example, the management module can provide a three-dimensional control container and a two-dimensional control container. The three-dimensional control container is used to hold a three-dimensional virtual image. The developer of the first application can develop the three-dimensional virtual image, and the first application can send the data of the three-dimensional virtual image to the management module. The management module can render and display the three-dimensional virtual image in the three-dimensional control container to achieve the effect of displaying the three-dimensional virtual image in the first area of ​​the display screen. The two-dimensional control container is used to hold the application interface. The developer of the second application can develop an application interface that can be held in the two-dimensional control container. After the second application sends the data of its application interface to the management module, the management module can display the application interface of the second application in the two-dimensional control container to achieve the effect of displaying the application interface in the second area of ​​the display screen.

[0114] Optionally, in the embodiments of this application, the first application and the third application that provide the virtual image can be the same application. In some examples, the first application, the second application and the third application can also be the same application.

[0115] In some implementations, when the electronic device displays a virtual avatar in the first area, the management module can receive parameters of the virtual avatar sent by the first application. The management module can then display the virtual avatar or its animation in the first area based on these parameters. Alternatively, the management module can receive the virtual avatar or its animation from the first application and display it in the first area. Or, the management module can send information such as the location of the first area to the first application, allowing the first application to display the virtual avatar or its animation in the first area. It should be noted that the above methods for displaying a virtual avatar in the first area also apply to updating the virtual avatar displayed in the first area. For example, when a user triggers an operation or updates the virtual avatar displayed in the first area according to a preset cycle, the above methods can also be used. Repeated details will not be elaborated further.

[0116] As described above, the electronic device can store multiple correspondences between application types and virtual avatar appearance parameters, or multiple correspondences between interface types and virtual avatar appearance parameters. Optionally, the first application or management module in the electronic device can store multiple correspondences between application types and virtual avatar appearance parameters, or multiple correspondences between interface types and virtual avatar appearance parameters. When the first application stores the above correspondences, the management module can also send the type of the second application or the type of the second application's interface to the first application, so that the first application can determine the appearance parameters of the virtual avatar based on the type of the second application or the type of the second application's interface. When the management module stores the above correspondences, the management module can determine the appearance parameters of the virtual avatar based on the type of the second application or the type of the second application's interface, and the management module can send the determined appearance parameters of the virtual avatar to the first application. The first application can adjust or determine appearance parameters including more display details based on the received parameters.

[0117] In this embodiment, when the electronic device displays the first interface, it responds to a second operation triggered by the user by adjusting the appearance of the virtual avatar displayed in the first area or displaying an animation of the virtual avatar corresponding to the second operation, and / or controlling the application interface in the second area to execute the response action corresponding to the second operation. Optionally, the second operation may be an operation in which the user moves in front of the display screen of the electronic device, or the second operation may be an air gesture operation triggered by the user in front of the display screen or a touch gesture operation triggered by the user on the display screen.

[0118] In some examples, when the electronic device displays the first interface, the user moves in front of the screen. The electronic device can detect the orientation of the user's face relative to the screen and adjust the eye position of the 3D virtual image in the first area according to the orientation of the user's face relative to the screen, thereby achieving the effect that the 3D virtual image's gaze follows the user's movement.

[0119] In other examples, the electronic device stores a correspondence between multiple user gesture operations and the electronic device's response actions. When the electronic device displays a first interface, in response to a user-triggered gesture operation, the electronic device determines the response action corresponding to the user-triggered gesture operation and executes the response action. The response action includes at least one of the following: adjusting the appearance of the virtual image displayed in the first area, displaying an animation of the virtual image corresponding to the gesture operation in the first area, or controlling the application interface in the second area to execute the response action corresponding to the gesture operation.

[0120] Optionally, the management module in the electronic device can register with the multi-mode input module to listen for input events. After detecting a second user input operation, the multi-mode input module can send information about the second operation to the management module. The management module can then send a request message to either the first or second application, containing information about the second operation. The first or second application determines the corresponding response action based on the request message and sends parameters related to that response action to the management module. The management module can then execute the response action based on the received parameters. For example, the management module can call a system function interface to execute the response action; or, after determining the response action based on the request message, the first or second application can execute the response action.

[0121] In this embodiment, the user's second operation may trigger a change in the appearance of the virtual avatar in the first area or an animation effect of the virtual avatar. The user's second operation may also trigger a change in the application interface in the second area. When the second operation can trigger both the 3D virtual avatar and the application interface to respond, the multi-modal input module can send the information of the second operation to the management module after detecting the user's second operation. The management module can send a request message to the first application or the second application. The first application or the second application that receives the request message determines the corresponding response action based on the information of the second operation in the request message. The first application or the second application that receives the request message can request the management module to call the relevant interface of another application so that the other application can execute the response action corresponding to the second operation. Optionally, when the second operation is an operation applied to a virtual avatar, such as when the user triggers an air gesture closer to the first area, or when the user triggers a touch gesture operation in the first area, the management module can send a request message to the first application, and the first application executes the response action corresponding to the second operation. The first application can also request the management module to request the second application to execute the response action corresponding to the second operation. When the second operation is an operation applied to the interface of the second application displayed in the second area, such as when the user triggers an air gesture closer to the second area, or when the user triggers a touch gesture operation in the second area, the management module can send a request message to the second application, and the second application executes the response action corresponding to the second operation. The second application can also request the management module to request the first application to execute the response action corresponding to the second operation.

[0122] Optionally, the management module can provide various interactive prototype interfaces. The first and second applications can be configured according to these interfaces to implement corresponding functions. For example, the first application can implement interfaces for adjusting the appearance of the virtual avatar, changing the virtual avatar, and displaying virtual avatar animations. The second application can implement interfaces for adjusting display brightness, page turning, and adjusting display transparency. The management module can manage the interfaces implemented by the first and second applications. The management module can call the interfaces implemented by the first and second applications to invoke corresponding functions. The first application can also request the management module to call the interfaces of the second application, and vice versa.

[0123] In some embodiments of this application, when the electronic device displays a first interface, the multi-modal input module in the electronic device detects a second operation triggered by the user. The multi-modal input module sends information about the second operation to the management module. The management module sends a first request message to the first application, which includes information about the second operation. The first application determines the parameters of the virtual image corresponding to the second operation. The first application sends the parameters of the virtual image corresponding to the second operation to the management module. The management module can adjust the appearance of the virtual image or display the animation of the virtual image according to the received parameters of the virtual image.

[0124] For example, taking a 3D virtual avatar displayed on the first interface and a music player as the second application, when a user triggers a right swipe gesture, the management module sends a first request message to the first application. The first request message includes information about the right swipe gesture. After receiving the first request message, the first application can determine that the response action corresponding to the right swipe gesture is to display an animation of the 3D virtual avatar jumping to the next track control of the music player in the second application. The first application can send the parameters of the 3D virtual avatar corresponding to the right swipe gesture to the management module. Based on the received parameters of the 3D virtual avatar, the management module displays the animation of the 3D virtual avatar jumping to the next track control of the music player in the second application on the first interface.

[0125] Optionally, the first request message sent by the management module to the first application can also be used to obtain a virtual avatar or an animation of a virtual avatar. The first application can send the rendered virtual avatar or animation of a virtual avatar to the management module, and the management module can display the virtual avatar or animation of a virtual avatar in the first area. Alternatively, the first request message can also be used to request the display of a virtual avatar or animation of a virtual avatar. The first request message may include the location information of the first area. After receiving the first request message, the first application can display the virtual avatar or animation of a virtual avatar in the first area.

[0126] In some examples, the first application can also send a second request message to the management module, which requests the second application to perform the response action corresponding to the second operation in the interface of the second application. Optionally, the first application can send the second request message to the management module by calling the management module's interface. After receiving the second request message, the management module can send a third request message to the second application, which requests the second application to perform the response action corresponding to the second operation in the interface of the second application. Optionally, the management module can send the third request message to the second application by calling the second application's first interface, which is the function call interface for the response action corresponding to the second operation. After receiving the third request message, the second application can perform the response action corresponding to the second operation in the interface of the second application displayed in the second area.

[0127] For example, taking a scenario where a 3D virtual avatar is displayed on the first interface and a music player is used as the second application, when the user triggers a right swipe gesture, the first application can call the management module's interface to send a second request message. This second request message requests the second application to switch songs. After receiving the second request message, the management module can call the second application's song-switching interface to send a third request message. This third request message also requests the second application to switch songs. Upon receiving the third request message, the second application can switch the song currently playing in the music player.

[0128] In some examples, the first application can also send a second request message to the management module. This second request message requests the execution of a response action corresponding to the second operation. In this example, the first application can request the execution of the response action corresponding to the second operation without instructing the management module on the specific content of the response action to be executed. Optionally, the first application can send the second request message to the management module by calling the management module's interface. After receiving the second request message, the management module can determine the response action corresponding to the second operation that the second application can execute in the second application's interface based on the type of the second application. The management module then sends a third request message to the second application, requesting the second application to execute the response action corresponding to the second operation in the second application's interface. Optionally, the management module can send the third request message to the second application by calling the second application's first interface, which is the function call interface for the response action corresponding to the second operation. After receiving the third request message, the second application can execute the response action corresponding to the second operation in the interface of the second application displayed in the second area.

[0129] For example, taking a scenario where a 3D virtual avatar is displayed on the first interface and a music player is used as the second application, when a user triggers a right swipe gesture, the first application can call the management module's interface to send a second request message. This second request message requests the execution of a switching action, which can include multiple different response actions corresponding to various applications, such as page turning in a reading application or song switching in a music player application. After receiving the second request message, the management module can determine, based on the music player's type, that the response action corresponding to the second operation the music player can perform is song switching. The management module can then call the second application's song switching interface to send a third request message to the second application. This third request message requests the second application to switch songs. After receiving the third request message, the second application can switch the song currently playing in the music player.

[0130] In some examples, the first application may also send a second request message to the management module, which includes information about the second operation. Optionally, the first application may send the second request message to the management module by calling its interface. After receiving the second request message, the management module may send a third request message to the second application, which includes information about the second operation. Optionally, the management module may send the third request message to the second application by calling its interface. After receiving the third request message, the second application may determine and execute the response action corresponding to the second operation.

[0131] For example, taking a scenario where a 3D virtual avatar is displayed on the first interface and a music player is used as the second application, when a user triggers a right swipe gesture, the first application can call the management module's interface to send a second request message, which includes information about the right swipe gesture. Upon receiving the second request message, the management module can call the second application's song-switching interface to send a third request message, which also includes information about the right swipe gesture. After receiving the third request message, the second application can determine that the response to the right swipe gesture is to switch songs, and thus can switch the currently playing song.

[0132] like Figure 4 A flowchart illustrating a display method provided in an embodiment of this application. (Reference) Figure 4 This method can be executed by a multi-mode input module, a management module, a first application, and a second application in an electronic device. (See reference) Figure 4 The method includes the following steps:

[0133] S401: The multi-mode input module has detected the user's second action.

[0134] S402: The multi-mode input module sends information for the second operation to the management module.

[0135] S403: The management module sends the first request message to the first application.

[0136] The first request message includes information about the second operation. The first request message can be used to request the first application to determine the parameters of the three-dimensional virtual image corresponding to the second operation.

[0137] S404: The first application determines the parameters of the three-dimensional virtual image corresponding to the second operation.

[0138] S405: The first application sends the parameters of the 3D virtual image corresponding to the second operation to the management module.

[0139] S406: The management module displays the adjusted 3D virtual image or an animation of the 3D virtual image in the first area according to the parameters of the 3D virtual image corresponding to the second operation.

[0140] S407: The first application sends a second request message to the management module.

[0141] Optionally, the second request message may be used to request the second application to perform the response action corresponding to the second operation in the interface of the second application, or the second request message may be used to request the execution of the response action corresponding to the second operation, or the second request message may include information about the second operation.

[0142] S408: The management module sends a third request message to the second application.

[0143] Optionally, the third request message can be used to request the second application to perform the response action corresponding to the second operation in the interface of the second application; or after the management module determines the response action corresponding to the second operation that the second application can perform in the interface of the second application based on the type of the second application, the third request message can be used to request the second application to perform the response action corresponding to the second operation in the interface of the second application; or the third request message may include information about the second operation.

[0144] S409: The second application executes the response action corresponding to the second operation.

[0145] When the third request message includes information about the second operation, the second application can determine the response action corresponding to the second operation based on the information about the second operation, and then execute the response action corresponding to the second operation.

[0146] It should be noted that the execution order of S405-S406 and S407-S409 is not limited in this application embodiment. In practice, S405 and S407 can be executed simultaneously, S406 and S408-S409 can be executed simultaneously, or S405-S406 can be executed first and then S407-S409 can be executed, or S407-S409 can be executed first and then S405-S406 can be executed.

[0147] For example, such as Figure 5 This is a schematic diagram of a display interface provided in an embodiment of this application. (Reference) Figure 5 In (a), when the electronic device is in a horizontal position, a first interface is displayed. This first interface includes a three-dimensional virtual image in a first area and an application interface in a second area, such as... Figure 5 The application interface is a calendar interface. Users trigger an air-press gesture in front of the screen, see reference. Figure 5 In (b), the electronic device displays an animation of a three-dimensional virtual image emitting lightning, and the electronic device brightens the display brightness of the calendar interface, thereby creating an effect of the three-dimensional virtual image emitting lightning to illuminate the application interface.

[0148] It should be noted that when a user triggers an operation to adjust the display brightness of the application interface, parameters such as the brightness value, the coordinates of the area to be adjusted, the illumination radius, and the number of illuminated points can be adjusted. This application embodiment does not limit this.

[0149] For example, Figure 6 This is a schematic diagram illustrating a display interface provided in an embodiment of this application. (Reference) Figure 6 In (a), when the electronic device is in a horizontal position, a first interface is displayed. This first interface includes a three-dimensional virtual image in a first area and an application interface in a second area, such as... Figure 6 The application interface is that of a music player. The user triggers a right swipe gesture in front of the screen, as shown in the reference. Figure 5 In (b), the electronic device displays an animation of a three-dimensional virtual image jumping to the top of the music player interface, and the music player switches to the next song to play, thus creating the effect of a three-dimensional virtual image helping the user click the song skip button.

[0150] In some embodiments of this application, when the electronic device displays a first interface, the multi-mode input module in the electronic device detects a second operation triggered by the user, the multi-mode input module sends information about the second operation to the management module, the management module sends a fourth request message to the second application, the fourth request message including information about the second operation, the second application determines the response action corresponding to the second operation, and the second application executes the response action.

[0151] For example, taking a three-dimensional virtual image displayed on the first interface and a music player as the second application, when the user triggers a right swipe gesture, the management module sends a fourth request message to the second application. The fourth request message includes information about the right swipe gesture. After receiving the fourth request message, the second application can determine that the response action corresponding to the right swipe gesture is to switch songs, and the second application can switch the currently playing song.

[0152] In some examples, the second application can also send a fifth request message to the management module. This fifth request message requests control over the virtual avatar in the first area to perform the response action corresponding to the second operation. Optionally, the second application can send the fifth request message to the management module by calling its interface. After receiving the fifth request message, the management module sends a sixth request message to the first application. This sixth request message requests the acquisition of parameters for the virtual avatar corresponding to the second operation. Optionally, the management module can send the sixth request message to the first application by calling its interface. After receiving the sixth request message, the first application can determine the parameters for the virtual avatar corresponding to the second operation and send these parameters to the management module. The management module then adjusts the appearance of the virtual avatar or displays its animation based on these parameters.

[0153] For example, taking a scenario where a 3D virtual avatar is displayed on the first interface and a music player is used as the second application, when the user triggers a right swipe gesture, the second application can call the management module's interface to send a fifth request message. This fifth request message requests control over the 3D virtual avatar's jump. Upon receiving the fifth request message, the management module can call the first application's jump interface to send a sixth request message. This sixth request message requests the parameters of the 3D virtual avatar's jump animation. After receiving the sixth request message, the first application can determine the parameters of the 3D virtual avatar's jump animation corresponding to the second operation and send these parameters to the management module. The management module can then display the 3D virtual avatar's jump animation on the first interface based on these parameters.

[0154] In some examples, the second application can also send a fifth request message to the management module. This fifth request message requests control over the virtual avatar in the first area to perform the response action corresponding to the second operation. Optionally, the second application can send the fifth request message to the management module by calling its interface. After receiving the fifth request message, the management module can determine the response action corresponding to the second operation based on the virtual avatar's attributes, which is to adjust the virtual avatar's appearance or display its animation. The management module then sends a sixth request message to the first application. This sixth request message requests parameters for adjusting the virtual avatar's appearance or displaying its animation. Optionally, the management module can send the sixth request message to the first application by calling its interface. After receiving the sixth request message, the first application can determine the parameters for adjusting the virtual avatar's appearance or displaying its animation and send these parameters to the management module. The management module then adjusts the virtual avatar's appearance or displays its animation based on the received parameters.

[0155] For example, taking a scenario where a 3D virtual avatar is displayed on the first interface and a music player is used as the second application, when a user triggers a right swipe gesture, the second application can call the management module's interface to send a fifth request message. This fifth request message requests control over the 3D virtual avatar's jump. Upon receiving the fifth request message, the management module can determine the corresponding response action based on the virtual avatar's attributes: displaying a jump animation of the 3D virtual avatar jumping to the next control in the second area. The management module then calls the first application's jump interface to send a sixth request message. This sixth request message requests parameters for the jump animation of the 3D virtual avatar jumping to the next control in the second area. Upon receiving the sixth request message, the first application can send these parameters to the management module, which can then display the jump animation of the 3D virtual avatar jumping to the next control in the second area on the first interface.

[0156] Optionally, in the above embodiments, the sixth request message sent by the management module to the first application can also be used to obtain a virtual avatar or an animation of a virtual avatar. The first application can send the rendered virtual avatar or virtual avatar animation to the management module, and the management module can display the virtual avatar or virtual avatar animation in the first area. Alternatively, the sixth request message can also be used to request the display of a virtual avatar or virtual avatar animation. The sixth request message may include the location information of the first area. After receiving the sixth request message, the first application can display the virtual avatar or virtual avatar animation in the first area.

[0157] In some examples, the second application can also send a fifth request message to the management module, which includes information about the second operation. Optionally, the second application can send the fifth request message to the management module by calling its interface. After receiving the fifth request message, the management module can send a sixth request message to the first application, which includes information about the second operation. Optionally, the management module can send the sixth request message to the first application by calling its interface. After receiving the sixth request message, the first application can determine the parameters of the virtual avatar corresponding to the second operation and send these parameters to the management module. The management module then adjusts the appearance of the virtual avatar or displays its animation based on these parameters.

[0158] For example, taking a scenario where a 3D virtual avatar is displayed on the first interface and a music player is used as the second application, when a user triggers a right swipe gesture, the second application can call the management module's interface to send a fifth request message, which includes information about the right swipe gesture. Upon receiving the fifth request message, the management module can call the first application's interface to send a sixth request message, which also includes information about the right swipe gesture. Upon receiving the sixth request message, the first application can determine that the response to the right swipe gesture is to display an animation of the 3D virtual avatar jumping with both feet. The first application sends the parameters of this animation to the management module, which then displays the animation on the first interface based on the received parameters.

[0159] like Figure 7 A flowchart illustrating a display method provided in an embodiment of this application. (Reference) Figure 7 This method can be executed by a multi-mode input module, a management module, a first application, and a second application in an electronic device. (See reference) Figure 7 The method includes the following steps:

[0160] S701: The multi-mode input module detected the user's second operation.

[0161] S702: The multi-mode input module sends information for the second operation to the management module.

[0162] S703: The management module sends a fourth request message to the second application.

[0163] The fourth request message includes information about the second operation, and can be used to request the second application to determine the response action corresponding to the second operation.

[0164] S704: The second application determines the response action corresponding to the second operation and executes the response action corresponding to the second operation.

[0165] S705: The second application sends a fifth request message to the management module.

[0166] The fifth request message can be used to request the virtual avatar to perform the response action corresponding to the second operation, or the fifth request message can include information about the second operation.

[0167] S706: The management module sends the sixth request message to the first application.

[0168] The sixth request message can be used to request the parameters of the virtual image corresponding to the second operation, or after the management module receives the fifth request message, it determines that the response action corresponding to the second operation is to adjust the appearance of the virtual image or display the animation of the virtual image based on the attributes of the virtual image. In this case, the sixth request message can be used to request the parameters for adjusting the appearance of the virtual image or displaying the animation of the virtual image, or the sixth request message includes information about the second operation.

[0169] S707: The first application determines the parameters of the three-dimensional virtual image.

[0170] S708: The first application sends the parameters of the 3D virtual image to the management module.

[0171] S709: The management module displays the adjusted appearance of the 3D virtual image or an animation of the 3D virtual image on the first interface based on the parameters of the 3D virtual image.

[0172] It should be noted that the execution order of S704 and S705-S709 is not limited in the embodiments of this application. In practice, S704 and S705-S709 can be executed simultaneously, or S704 can be executed first and then S705-S709 can be executed, or S705-S709 can be executed first and then S704 can be executed.

[0173] For example, such as Figure 8 This is a schematic diagram of a display interface provided in an embodiment of this application. (Reference) Figure 8 In (a), when the electronic device is in a horizontal position, a first interface is displayed. This first interface includes a three-dimensional virtual image in a first area and an application interface in a second area, such as... Figure 8 The application interface is that of a music player. When the user swipes up on the screen, the music player starts playing music, and the electronic device adjusts the appearance of its 3D virtual avatar, such as... Figure 8 As shown in (b) in the image, the three-dimensional virtual avatar is wearing headphones.

[0174] For example, when an electronic device is in landscape mode and displays a first interface, this first interface includes a 3D virtual avatar in a first area and a music player interface in a second area. When the user triggers a press gesture in front of the screen, the electronic device changes the background of the music player interface and calls the interface for changing the 3D virtual avatar, switching the 3D virtual avatar displayed in the first area, such as switching from a "snowman" to a "cat".

[0175] In some embodiments of this application, after receiving the second operation information sent by the multi-mode input module, the management module can also send the second operation information to the first application and the second application respectively. Thus, the first application can determine the parameters of the virtual image based on the second operation information, and then adjust the appearance of the virtual image or display the animation of the virtual image. The second application can execute the response action corresponding to the second operation. In order to avoid the problem of repeated responses caused by the application requesting to call each other's interface again after the management module sends the second operation information to the first application and the second application, the electronic device can also be set to respond according to the last received instruction when the first application and the second application receive multiple messages or instructions corresponding to the second operation. The functions performed by the management module, the first application and the second application in this way can be referred to the above embodiments, and the repeated parts will not be described again.

[0176] In some implementations, besides changing the appearance or animation of a virtual avatar by calling an interface as shown in the above embodiments, the electronic device can also change the appearance or actions of the virtual avatar by modifying a configuration file after detecting a user-triggered operation. For example, the electronic device can modify the joint rotation values ​​in the configuration file of the 3D virtual avatar to display the effect of the 3D virtual avatar's arm rotating, thereby creating a dynamic effect of the 3D virtual avatar waving, providing greater editability of the virtual avatar and improving the display effect.

[0177] Based on the same concept, embodiments of this application also provide a display method, which can be executed by an electronic device, such as... Figure 9 A flowchart of a display method provided in an embodiment of this application is shown below. Figure 9 The method includes the following steps:

[0178] S901: The electronic device detects that the first condition is met.

[0179] S902: The electronic device displays a first interface in response to a first condition. The first interface includes a first area and a second area, wherein the first area displays a virtual avatar, which is a virtual avatar in a first application; and the second area displays the interface of a second application.

[0180] For example, the first interface displayed by an electronic device can be as follows: Figure 3As shown, the first interface may include a three-dimensional virtual image 301 and a second application interface 302.

[0181] It should be noted that this application Figure 9 The display method shown can be referred to in the above embodiments of this application in specific implementation, and repeated parts will not be described again.

[0182] Based on the above embodiments, this application also provides an electronic device, which includes multiple functional modules; the multiple functional modules interact to realize the functions performed by the electronic device in the methods described in the embodiments of this application. For example, [the following is an example of implementation]. Figure 4 , Figure 7 or Figure 9 The display method is shown. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on the specific implementation.

[0183] Based on the above embodiments, this application also provides an electronic device, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions. When the electronic device is running, the at least one processor executes the functions performed by the electronic device in the various methods described in the embodiments of this application. For example, when executing... Figure 4 , Figure 7 or Figure 9 The display method shown.

[0184] Based on the above embodiments, this application also provides a computer program product containing instructions, which, when run on a computer, causes the computer to execute the methods described in the embodiments of this application.

[0185] Based on the above embodiments, this application also provides a computer-readable storage medium storing a computer program, which, when executed by a computer, causes the computer to perform the methods described in the embodiments of this application.

[0186] Based on the above embodiments, this application also provides a chip for reading computer programs stored in a memory to implement the methods described in the embodiments of this application.

[0187] Based on the above embodiments, this application provides a chip system including a processor for supporting a computer device in implementing the methods described in the embodiments of this application. In one possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. This chip system may be composed of chips or may include chips and other discrete devices.

[0188] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0189] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0190] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0191] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0192] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of protection of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A display method characterized by comprising: The method is applied to an electronic device, and the method comprises: detecting that a first condition is met; in response to the first condition being met, displaying a first interface, the first interface comprising a first region and a second region, wherein the first region displays a virtual image; and the second region displays an interface of a second application.

2. The method of claim 1, wherein, The virtual image is a virtual image in a first application.

3. The method of claim 1 or 2, wherein, The virtual image is associated with the second application.

4. The method according to any one of claims 1 to 3, characterized in that, The virtual image is determined according to the second application.

5. The method of claim 4, wherein, The virtual image is determined according to at least one of the following: a type of the second application, a type of the interface of the second application displayed in the second region, information in the interface of the second application displayed in the second region.

6. The method according to any one of claims 1 to 5, wherein, The first condition comprises at least one of the following: The electronic device is in a charging state. The electronic device is in a landscape state. detecting a first operation of a user, the first operation being used to start a third application to which the first interface belongs.

7. The method according to any one of claims 1 to 6, wherein The interface of the second application is an application card of the second application or an application interface of the second application.

8. The method according to any one of claims 1 to 7, wherein The interface of the second application comprises a control and / or multimedia content.

9. The method according to any one of claims 1 to 8, wherein, The method further comprises: in response to a second operation of the user, displaying, in the first region, a virtual image with an adjusted appearance or displaying, in the first region, an animation of a virtual image corresponding to the second operation.

10. The method of claim 9, wherein, The method further comprises: in response to the second operation of the user, controlling the interface displayed in the second region to perform a response action corresponding to the second operation.

11. The method of claim 9 or 10, wherein, The second operation is an operation of the user moving a position in front of a display screen of the electronic device, or the second operation is a gesture operation triggered by the user in front of the display screen, or the second operation is a touch gesture operation triggered by the user on the display screen.

12. The method according to any one of claims 9 to 11, wherein, The electronic device comprises a management module, and the response to the second operation of the user, displaying, in the first region, a virtual image with an adjusted appearance or displaying, in the first region, an animation of a virtual image corresponding to the second operation, comprises: The management module obtains information of the second operation, and sends a first request message comprising the information of the second operation to the first application; The management module receives a parameter of a virtual image corresponding to the second operation sent by the first application; The management module adjusts an appearance of the virtual image or displays an animation of the virtual image according to the parameter of the virtual image corresponding to the second operation.

13. The method of claim 10, wherein, The second operation is an operation acting on the virtual image.

14. The method of claim 13, wherein, The electronic device comprises a management module, and the response to the second operation of the user, controlling the interface displayed in the second region to perform a response action corresponding to the second operation, comprises: The management module receives a second request message sent by the first application, the second request message being used to request the second application to perform a response action corresponding to the second operation in the interface of the second application; The management module sends a third request message to the second application, the third request message being used to request the second application to perform a response action corresponding to the second operation in the interface of the second application.

15. The method of claim 13, wherein, The electronic device comprises a management module, and the management module controls the interface displayed in the second area to perform a response action corresponding to the second operation of the user, including: The management module receives a second request message sent by the first application, and the second request message is used to request to perform a response action corresponding to the second operation; The management module determines the response action corresponding to the second operation that can be performed by the second application in the interface of the second application according to the type of the second application; The management module sends a third request message to the second application, and the third request message is used to request the second application to perform the response action corresponding to the second operation in the interface of the second application.

16. The method of claim 13, wherein, The electronic device comprises a management module, and the management module controls the interface displayed in the second area to perform a response action corresponding to the second operation of the user, including: The management module receives a second request message sent by the first application, and the second request message comprises information of the second operation; The management module sends a third request message to the second application, and the third request message comprises information of the second operation, so that the second application performs a response action corresponding to the second operation according to the information of the second operation.

17. The method of claim 10, wherein, The electronic device comprises a management module, and the management module controls the interface displayed in the second area to perform a response action corresponding to the second operation of the user, including: The management module obtains information of the second operation, and sends a fourth request message comprising the information of the second operation to the second application, so that the second application performs a response action corresponding to the second operation according to the information of the second operation.

18. The method of claim 9, wherein, The second operation is an operation acting on the interface of the second application displayed in the second area.

19. The method of claim 18, wherein, The electronic device comprises a management module, and the management module displays a virtual image with adjusted appearance in the first area or displays an animation of a virtual image corresponding to the second operation in the first area in response to the second operation of the user, including: The management module receives a fifth request message sent by the second application, and the fifth request message is used to request to control the virtual image to perform a response action corresponding to the second operation; The management module sends a sixth request message to the first application, and the sixth request message is used to request to obtain parameters of a virtual image corresponding to the second operation; The management module receives the parameters of the virtual image corresponding to the second operation sent by the first application; The management module adjusts the appearance of the virtual image or displays the animation of the virtual image according to the parameters of the virtual image corresponding to the second operation.

20. The method of claim 18, wherein, The electronic device comprises a management module, and the management module displays a virtual image with adjusted appearance in the first area or displays an animation of a virtual image corresponding to the second operation in the first area in response to the second operation of the user, including: The management module receives a fifth request message sent by the second application, and the fifth request message is used to request to control the virtual image to perform a response action corresponding to the second operation; The management module determines, according to the attribute of the virtual image, that the response action corresponding to the second operation is adjusting the appearance of the virtual image or displaying an animation of the virtual image, and sends a sixth request message to the first application, the sixth request message being used for requesting to acquire a parameter for adjusting the appearance of the virtual image or displaying the animation of the virtual image; The management module receives the parameter of the virtual image sent by the first application; The management module adjusts the appearance of the virtual image or displays the animation of the virtual image according to the parameter of the virtual image.

21. The method of claim 18, wherein, The electronic device includes a management module, and the management module displays, in response to a second operation of a user, a virtual image with adjusted appearance in the first area or displays an animation of the virtual image corresponding to the second operation in the first area, and the method includes the following steps: The management module receives a fifth request message sent by the second application, and the fifth request message includes information of the second operation; The management module sends a sixth request message to the first application, and the sixth request message includes information of the second operation; The management module receives a parameter of the virtual image corresponding to the second operation sent by the first application; The management module adjusts the appearance of the virtual image or displays the animation of the virtual image according to the parameter of the virtual image corresponding to the second operation.

22. The method of any one of claims 12-21, wherein, The management module is for an application in the electronic device, or the management module belongs to a framework layer of the electronic device.

23. The method of any one of claims 1-22, wherein, The first interface is any one of a lock screen interface, an all-weather display (AOD) interface, and an application interface of a third application.

24. An electronic device, comprising: The at least one processor is coupled with the at least one memory, and is configured to read a computer program stored in the at least one memory to perform the method in any one of claims 1-23.

25. A computer program product comprising instructions, wherein: The computer program product, when running on a computer, causes the computer to perform the method in any one of claims 1-23.

26. A computer-readable storage medium, characterized in that, The computer readable storage medium stores instructions, and when the instructions run on a computer, cause the computer to perform the method in any one of claims 1-23.

Images