Interface display method and related device

By obtaining weather information, the dynamic effects to be displayed are determined. There are physical rules constraining the positional interaction between weather elements and display elements, which solves the problem that weather effects cannot change with the display page, and achieves a more realistic and dynamic weather effect display.

WO2025260742A9PCT designated stage Publication Date: 2026-02-19HUAWEI TECH CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2025/073236
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-06-20
Filing Date
2025-01-20
Publication Date
2026-02-19

AI Technical Summary

Technical Problem

In existing technologies, the presentation of weather effects cannot be changed with the changes in the displayed page, resulting in poor presentation of weather effects.

Method used

By obtaining weather information, the dynamic effects to be displayed are determined. There is a positional interaction between weather elements and display elements that meets the constraints of physical rules. The effects after the interaction are displayed include the movement, collision, and light propagation of weather elements and display elements, so as to achieve realism and dynamism.

Benefits of technology

The display of weather effects has been improved, making them more realistic and dynamic, and enhancing the presentation of weather information.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2025073236_19022026_PF_FP_ABST
    Figure CN2025073236_19022026_PF_FP_ABST
Patent Text Reader

Abstract

An interface display method, comprising: acquiring a weather condition; on the basis of the weather condition, determining a dynamic special effect to be displayed, wherein the dynamic special effect comprises a weather element, a display element and an interactive special effect, the weather element indicates the weather condition, there is a positional interaction between the weather element and the display element, which positional interaction satisfies physical rule constraints, and the interactive special effect is a special effect generated after the positional interaction; and displaying the dynamic special effect. In the present application, when a weather element is moved to a display element on a display interface (that is, there is a positional interaction, which may alternatively be described as a collision or contact), a special effect of the positional interaction that meets physical rule constraints can be displayed, the special effect is an effect that occurs when the positional interaction occurs between the weather element and the display element, and is displayed in real time on the basis of the position of the display element, and thus a display special effect of weather can achieve realism, thereby improving the presentation effect of the special effect of weather.
Need to check novelty before this filing date? Find Prior Art

Description

Interface display method and related device

[0001] The present application claims priority to the Chinese patent application No. 202410808466.8, filed on June 20, 2024, and entitled "Interface display method and related device", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the field of terminal, in particular to an interface display method and related device. BACKGROUND

[0003] An operating system (OS) is a set of interrelated system software programs that govern and control computer operations, utilize and run hardware, software resources, and provide common services to organize user interactions, and is also the kernel and cornerstone of a computer system. The operating system needs to handle basic transactions such as managing and configuring memory, determining the priority of system resource supply and demand, controlling input and output devices, operating networks, and managing file systems.

[0004] Weather is a topic that users pay close attention to in their daily life, and it is close to human production and life. An excellent mobile operating system will also provide clear and beautiful visual weather data, and will take the display of weather as a very important feature. Further, the push of weather data can use heart-moving 3D dynamic effects to present a better system presentation effect. The weather theme has always been the most frequently used theme, and the next generation of operating system version will further promote the evolution of weather effects. 3D weather systems can be applied in product weather applications, weather themes, weather wallpapers, etc.

[0005] In the prior art, the weather presentation effect of the system has evolved from a simple static effect to a realistic dynamic visual effect, including cloud, rain, snow, fog, haze, and sunny weather scenes. However, the presentation effect of the weather special effect in the prior art does not change with the change of the display page, resulting in a poor presentation effect of the weather special effect. SUMMARY

[0006] In a first aspect, the present application provides an interface display method, the method comprising:

[0007] obtaining a weather condition; determining a dynamic special effect to be displayed according to the weather condition; the dynamic special effect comprises a weather element, a display element, and an interactive special effect, the weather element indicates the weather condition, the weather element and the display element have a position interaction that satisfies a physical rule constraint, the interactive special effect comprises a special effect generated after the position interaction; the display element comprises a combination of one or more of the following: a control, an icon, a text, a window, or a card; and displaying the dynamic special effect.

[0008] In the embodiments of the present application, in order to improve the display effect of the display special effect of the weather, the weather element and some display elements on the display interface can be interacted, and the special effect after the interaction is displayed. Specifically, when the weather element moves to the display element on the display interface (that is, there is a position interaction, or it can be described as there is a collision or contact), a position interaction special effect that meets the physical rule constraint is displayed. The special effect is the effect that occurs when the weather element and the display element have a position interaction, and is displayed in real time based on the position of the display element. Thus, the display special effect of the weather can be made realistic, thereby improving the presentation effect of the special effect of the weather.

[0009] Here, the dynamic special effect is not limited to the display effect that always changes (for example, the display effects of adjacent frames are all different), but refers to a special effect that is not fixed.

[0010] Here, meeting the physical rule constraint can be understood as a real situation that occurs when two objects interact (for example, contact, collision, or light propagation) in the real world.

[0011] In one possible implementation, the weather element and the display element have a position interaction that meets the physical rule constraint, including that the weather element has a position interaction that meets the physical rule constraint after moving along a path that meets the physical rule constraint.

[0012] In one possible implementation, the display element is an element on the desktop or in the application program.

[0013] The display element can be an element on the desktop or in the application program. That is, the display element that can have a position interaction with the weather element can be an element at multiple levels of the operating system, such as a control (for example, a window, a card, a desktop icon, etc.) at the system level, or an object (for example, an icon, text, etc.) at the application level. The information of the display element can be position, shape (for example, outline, size), and the like.

[0014] That is, push at each level of the operating system can be implemented, and the weather element can interact with the control elements at each level of the system.

[0015] In one possible implementation, the weather element includes light, the position interaction is light propagation onto the display element, and the interaction special effect is reflection, penetration, or change in brightness of the light.

[0016] In one possible implementation, the weather element includes gas, the position interaction is gas propagation onto the display element, and the interaction special effect is penetration of the gas or floating outside the display element.

[0017] In a possible implementation, the weather element includes a solid or a liquid, the position interaction is a collision between the solid or the liquid and the display element, and the interaction special effect is a collision special effect or a pile-up after the collision.

[0018] In a possible implementation, after the display of the dynamic special effect, the method further includes:

[0019] obtaining a gesture operation for the interaction special effect;

[0020] displaying a new interaction special effect (for example, a collision special effect) formed after the position where the gesture operation is located interacts (for example, collides) with the interaction special effect.

[0021] In a possible implementation, the method further includes:

[0022] obtaining a gesture operation for the display element, where the gesture operation is used to move the display element;

[0023] displaying a new position interaction corresponding interaction special effect formed after the interaction special effect moves with the display element, where the new position interaction satisfies a physical rule constraint.

[0024] The gesture operation is a slide (or can be referred to as a drag) for the display element, and the interaction special effect can be a pile-up of the weather element. The piled-up weather element can produce a scattering special effect (which is a new interaction special effect) as the display element moves.

[0025] In a possible implementation, the method further includes:

[0026] obtaining information of the display element, where the information of the display element includes a display position and a display shape of the display element;

[0027] The determining the display dynamic special effect according to the weather condition includes:

[0028] determining the display dynamic special effect according to the weather condition and the information of the display element.

[0029] In a possible implementation, the method further includes:

[0030] obtaining configuration information of a rendering engine or a physics engine;

[0031] The determining the display dynamic special effect according to the weather condition includes:

[0032] determining the display dynamic special effect according to the weather condition and the configuration information of the rendering engine or the physics engine, by using the rendering engine and the physics engine.

[0033] In a second aspect, the present application provides an interface display device, the device comprising:

[0034] an obtaining module, configured to obtain a weather condition;

[0035] a rendering module, configured to determine a dynamic special effect according to the weather condition, the dynamic special effect comprising a weather element, a display element and an interactive special effect, the weather element indicating the weather condition, the weather element and the display element having a position interaction meeting a physical rule constraint, the interactive special effect comprising a special effect generated after the position interaction, the display element comprising a combination of one or more of the following: a control, an icon, a text, a window or a card;

[0036] a display module, configured to display the dynamic special effect.

[0037] In a possible implementation, the weather element and the display element have the position interaction meeting the physical rule constraint, comprising that the weather element has the position interaction with the display element after moving along a path meeting the physical rule constraint.

[0038] In a possible implementation, the display element is an element on a desktop or in an application program.

[0039] In a possible implementation, the weather element comprises light, the position interaction comprises light propagation onto the display element, and the interactive special effect comprises reflection, penetration or brightness change of the light.

[0040] In a possible implementation, the weather element comprises gas, the position interaction comprises gas propagation onto the display element, and the interactive special effect comprises penetration of the gas or floating outside the display element.

[0041] In a possible implementation, the weather element comprises solid or liquid, the position interaction comprises collision of the solid or liquid with the display element, and the interactive special effect comprises a collision special effect or a pile-up after the collision.

[0042] In a possible implementation, after the display of the dynamic special effect, the obtaining module is further configured to:

[0043] obtain a gesture operation on the interactive special effect;

[0044] the display module is further configured to display a collision special effect formed after a position where the gesture operation is located collides with the interactive special effect.

[0045] In a possible implementation, the obtaining module is further configured to:

[0046] acquire a gesture operation for the display element; the gesture operation is used to move the display element;

[0047] The display module is further configured to display an interaction special effect corresponding to a new position interaction formed after the movement of the display element, the new position interaction satisfying a physical rule constraint.

[0048] In a possible implementation, the acquisition module is further configured to:

[0049] acquire information of the display element, the information of the display element including a display position and a display shape of the display element;

[0050] The rendering module is specifically configured to:

[0051] determine the dynamic special effect to be displayed according to the weather condition and the information of the display element.

[0052] In a possible implementation, the acquisition module is further configured to:

[0053] acquire configuration information of a rendering engine or a physics engine;

[0054] The rendering module is specifically configured to:

[0055] determine the dynamic special effect to be displayed according to the weather condition and the configuration information of the rendering engine or the physics engine, by using the rendering engine and the physics engine.

[0056] In a third aspect, an interface display apparatus is provided, which can include a memory, a processor, and a bus system. The memory is configured to store a program, and the processor is configured to execute the program in the memory to perform the method of the first aspect and any optional method.

[0057] In a fourth aspect, a computer readable storage medium is provided, which stores a computer program. When the computer program is run on a computer, the computer is caused to perform the method of the first aspect and any optional method.

[0058] In a fifth aspect, a computer program product including instructions is provided. When the computer program product is run on a computer, the computer is caused to perform the method of the first aspect and any optional method.

[0059] Sixthly, this application provides a chip system including a processor for supporting an interface display device in implementing some or all of the functions involved in the above aspects, such as transmitting or processing data or information involved in the above methods. In one possible design, the chip system further includes a memory for storing program instructions and data necessary for the execution device or training device. This chip system may be composed of chips or may include chips and other discrete devices. Attached Figure Description

[0060] Figure 1 shows a schematic diagram of an application architecture;

[0061] Figure 2 shows a schematic diagram of an application architecture;

[0062] Figure 3 is a schematic diagram of an embodiment of an interface display method provided in this application;

[0063] Figure 4 is a schematic diagram of an interface in an embodiment of this application;

[0064] Figure 5 is a schematic diagram of an interface in an embodiment of this application;

[0065] Figure 6 is a schematic diagram of an interface in an embodiment of this application;

[0066] Figure 7 is a schematic diagram of an interface in an embodiment of this application;

[0067] Figure 8 is a schematic diagram of an interface in an embodiment of this application;

[0068] Figure 9 is a schematic diagram of an interface in an embodiment of this application;

[0069] Figure 10 is a schematic diagram of an interface in an embodiment of this application;

[0070] Figures 11A to 11E are schematic diagrams of an interface in an embodiment of this application;

[0071] Figure 12A is a schematic diagram of an interface in an embodiment of this application;

[0072] Figure 12B is a schematic diagram of an interface in an embodiment of this application;

[0073] Figure 12C illustrates an embodiment of an interface display method provided in this application;

[0074] Figure 13 is a schematic diagram of an embodiment of an interface display device provided in this application;

[0075] Figure 14 is a schematic diagram of an execution device provided in an embodiment of this application. Detailed Implementation

[0076] Embodiments of the present application will be described herein below with reference to the accompanying drawings. The terminology used in the description of the embodiments of the present application herein below is for the purpose of describing particular embodiments only and is not intended to be limiting of the present application.

[0077] Embodiments of the present application will be described herein below with reference to the accompanying drawings. The terminology used in the description of the embodiments of the present application herein below is for the purpose of describing particular embodiments only and is not intended to be limiting of the present application.

[0078] The terms "first", "second", and the like, as used in the description of embodiments of this application, are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the terms so used are interchangeable under appropriate circumstances such that the embodiments of the application described herein are, for example, capable of use in either order. It is also to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting.

[0079] It will be understood that when an element or layer is referred to as being "on", "connected to", or "coupled to" another element or layer, it can be directly on, directly connected to, or directly coupled to the other element or layer, or one or more intervening elements or layers can be present. In addition, it will be understood that when an element or layer is referred to as being between two elements or layers, it can be the only element or layer between the two elements or layers or one or more intervening elements or layers can be present.

[0080] The terms "substantially", "about", and the like are used as terms of approximation and not as terms of degree, unless otherwise indicated, and are intended to account for the inherent deviations in measured or calculated values that would be recognized by those of ordinary skill in the art. Further, the use of "may" when describing embodiments of the present application is intended to mean that one or more embodiments of the present application. The terms "use", "using", and "used" as used herein can be taken in their broadest context as synonymous with the terms "utilize", "utilizing", and "utilized", respectively. Additionally, the term "exemplary" is intended to refer to an instance or illustration.

[0081] Referring to FIG. 1, a structural schematic diagram of an electronic device 100 provided by an embodiment of the present application is shown.

[0082] The electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 can include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0083] It can be understood that the structure shown in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can include more or fewer components than shown, or combine certain components, or split certain components, or different arrangement of components. The components shown can be implemented in hardware, software, or a combination of software and hardware.

[0084] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices, or can be integrated in one or more processors.

[0085] The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions.

[0086] The processor 110 can also have a memory that stores instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can hold instructions or data that the processor 110 has just used or is using repeatedly. If the processor 110 needs to use the instructions or data again, it can call them directly from the memory. This avoids repeated access and reduces the latency of the processor 110, thus improving the efficiency of the system.

[0087] In some embodiments, the processor 110 can include one or more interfaces. The interfaces can include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0088] The I2C interface is a bidirectional synchronous serial bus that includes a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 can include multiple sets of I2C buses. The processor 110 can be coupled to the touch sensor 180K, the charger, the flash, the camera 193, etc. through different I2C bus interfaces. For example, the processor 110 can be coupled to the touch sensor 180K through an I2C interface, so that the processor 110 and the touch sensor 180K communicate through the I2C bus interface to realize the touch function of the electronic device 100.

[0089] The I2S interface can be used for audio communication. In some embodiments, the processor 110 can include multiple sets of I2S buses. The processor 110 can be coupled with the audio module 170 through the I2S buses to enable communication between the processor 110 and the audio module 170. In some embodiments, the audio module 170 can deliver audio signals to the wireless communication module 160 through the I2S interface to enable the function of answering a phone call through a Bluetooth earphone.

[0090] The PCM interface can also be used for audio communication to sample, quantize, and encode analog signals. In some embodiments, the audio module 170 can be coupled with the wireless communication module 160 through a PCM bus interface. In some embodiments, the audio module 170 can also deliver audio signals to the wireless communication module 160 through the PCM interface to enable the function of playing music through a Bluetooth earphone. Both the I2S interface and the PCM interface can be used for audio communication.

[0091] The UART interface is a universal serial bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is usually used to connect the processor 120 and the wireless communication module 160. For example, the processor 120 communicates with the Bluetooth module in the wireless communication module 160 through the UART interface to enable Bluetooth functionality. In some embodiments, the audio module 170 can deliver audio signals to the wireless communication module 160 through the UART interface to enable the function of playing music through a Bluetooth earphone.

[0092] The MIPI interface can be used to connect the processor 110 and peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), and the like. In some embodiments, the processor 110 and the camera 193 communicate through the CSI interface to enable the camera function of the electronic device 100. The processor 120 and the display screen 194 communicate through the DSI interface to enable the display function of the electronic device 100.

[0093] The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 and the camera 193, the display screen 194, the wireless communication module 160, the audio module 170, the sensor module 180, and the like. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, and the like.

[0094] The USB interface 130 is an interface conforming to the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used to transmit data between the electronic device 100 and a peripheral device. It can also be used to connect a headset to play audio through the headset. The interface can also be used to connect other electronic devices, such as AR devices, etc.

[0095] It can be understood that the interface connection relationship between the modules shown in the embodiments of the present application is only illustrative and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 can also use different interface connection methods or combinations of multiple interface connection methods in the above embodiments.

[0096] The charging management module 140 is used to receive charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input through a wireless charging coil of the electronic device 100. The charging management module 140 can charge the battery 142 while also supplying power to the electronic device through the power management module 141.

[0097] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to supply power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. In other embodiments, the power management module 141 can also be provided in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be provided in the same device.

[0098] The wireless communication function of the electronic device 100 can be realized through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc.

[0099] The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in combination with a tuning switch.

[0100] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic waves, and transfer the same to the modem processor for demodulation. The mobile communication module 150 can also amplify signals modulated by the modem processor, and radiate the same as electromagnetic waves through the antenna 1. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least part of the functional modules of the mobile communication module 150 can be disposed in the same device as at least part of the modules of the processor 110.

[0101] The modem processor can include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low-frequency baseband signal processed by the baseband processor is transmitted to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the microphone 170B, etc.), or displays an image or a video through the display screen 194. In some embodiments, the modem processor can be a separate device. In other embodiments, the modem processor can be independent of the processor 110, and disposed in the same device as the mobile communication module 150 or other functional modules.

[0102] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives an electromagnetic wave via the antenna 2, frequency-modulates and filters the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 160 can also receive a signal to be transmitted from the processor 110, frequency-modulate it, amplify it, and radiate it as an electromagnetic wave via the antenna 2.

[0103] In some embodiments, the antenna 1 and the mobile communication module 150 of the electronic device 100 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include a global positioning system (GPS), a global navigation satellite system (GLONASS), a beidou navigation satellite system (BDS), a quasi-zenith satellite system (QZSS), and / or a satellite based augmentation systems (SBAS).

[0104] The electronic device 100 implements a display function through a GPU, a display screen 194, and an application processor, etc. The GPU is a microprocessor for image processing, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 can include one or more GPUs, which execute program instructions to generate or change display information.

[0105] The display screen 194 is configured to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), or the like. In some embodiments, the electronic device 100 can include one or N display screens 194, where N is a positive integer greater than 1.

[0106] The electronic device 100 can implement the photographing function through the ISP, the camera 193, the video codec, the GPU, the display screen 194, and the application processor.

[0107] The ISP is configured to process the data fed back by the camera 193. For example, when taking a photo, the shutter is opened, the light is transmitted to the camera photosensitive element through the lens, the light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing to convert it into an image visible to the naked eye. The ISP can also optimize the noise, brightness, and skin color of the image. The ISP can also optimize the exposure, color temperature, and other parameters of the shooting scene. In some embodiments, the ISP can be disposed in the camera 193.

[0108] The camera 193 is configured to capture still images or videos. An object generates an optical image through a lens and projects it onto a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then transmitted to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, the electronic device 100 can include one or N cameras 193, where N is a positive integer greater than 1.

[0109] The digital signal processor is used to process digital signals, in addition to being able to process digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy, etc.

[0110] The video codec is used to compress or decompress digital video. The electronic device 100 can support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG 2, MPEG 3, MPEG 4, etc.

[0111] The NPU is a neural-network (NN) calculation processor, which can quickly process input information by drawing on the structure of a biological neural network, such as drawing on the transmission mode between human brain neurons, and can also constantly self-learn. Through the NPU, the electronic device 100 can realize intelligent cognition applications such as image recognition, face recognition, voice recognition, text understanding, etc.

[0112] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize data storage functions. For example, music, video, etc. Files are saved in the external memory card.

[0113] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.), etc. The data storage area can store data created during the use of the electronic device 100 (such as audio data, a phonebook, etc.), etc. In addition, the internal memory 121 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various function applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in the memory disposed in the processor.

[0114] The electronic device 100 can realize audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor, etc. For example, music playing, recording, etc.

[0115] The keys 190 include a power key, a volume key, and the like. The keys 190 can be mechanical keys. The keys 190 can also be touch keys. The electronic device 100 can receive a key input, and generate a key signal input related to a user setting and a function control of the electronic device 100.

[0116] The motor 191 can generate a vibration prompt. The motor 191 can be used for a call vibration prompt, and can also be used for a touch vibration feedback. For example, a touch operation applied to different applications (e.g., a photograph, audio playback, and the like) can correspond to different vibration feedback effects. A touch operation applied to different regions of the display screen 194 can also correspond to different vibration feedback effects. Different application scenarios (e.g., a time reminder, a received message, an alarm, a game, and the like) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0117] The indicator 192 can be an indicator light, and can be used to indicate a charging state, a power change, and can also be used to indicate a message, a missed call, a notification, and the like.

[0118] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or pulled out of the SIM card interface 195 to realize contact and separation with the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, and N is a positive integer greater than 1. The SIM card interface 195 can support a Nano SIM card, a Micro SIM card, a SIM card, and the like. The same SIM card interface 195 can simultaneously insert multiple cards. The types of the multiple cards can be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 can also be compatible with an external storage card. The electronic device 100 interacts with a network through a SIM card to realize a call and data communication function, and the like. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0119] The software system of the electronic device 100 can use a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. Embodiments of the present application exemplarily illustrate the software structure of the electronic device 100 by taking an Android system with a layered architecture as an example.

[0120] FIG. 2 is a software structure block diagram of the electronic device 100 according to an embodiment of the present application.

[0121] A layered architecture divides software into several layers, each with a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0122] The application layer can include a series of application packages.

[0123] As shown in FIG. 2, the application packages can include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0124] The application framework layer provides application programming interfaces (APIs) and programming frameworks for the applications of the application layer. The application framework layer includes some pre-defined functions.

[0125] As shown in FIG. 2, the application framework layer can include window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0126] The window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, and take screenshots, etc.

[0127] The content provider is used to store and obtain data, and make the data accessible to the applications. The data can include videos, images, audios, dialed and received calls, browsing history and bookmarks, phonebook, etc.

[0128] The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.

[0129] The phone manager is used to provide the communication function of the electronic device 100. For example, the management of the call state (including call connection, call hang-up, etc.).

[0130] The resource manager provides various resources for the applications, such as localized strings, icons, pictures, layout files, video files, etc.

[0131] The notification manager enables applications to display notification information in the status bar, which can be used to convey alert-type messages that can automatically disappear after a brief stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the form of a figure or a scroll bar text in the top status bar of the system, such as a notification of an application running in the background, and can also be a notification that appears in the form of a dialog window on the screen. For example, the status bar prompts text information, issues a prompt sound, the electronic device vibrates, the indicator light flashes, etc.

[0132] The Android Runtime includes a core library and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0133] The core library contains two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.

[0134] The application layer and the application framework layer run in the virtual machine. The virtual machine executes the java file of the application layer and the application framework layer into a binary file. The virtual machine is used to perform the management of the object life cycle, the management of the stack, the management of the thread, the management of the security and the exception, and the garbage collection, etc.

[0135] The system library can include multiple functional modules. For example: surface manager, media library, three-dimensional graphics processing library (such as: OpenGL ES), etc.

[0136] The surface manager is used to manage the display subsystem, and provides 2D and 3D layer fusion for multiple applications.

[0137] The media library supports multiple commonly used audio, video format playback and recording, and static image files, etc. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0138] The three-dimensional graphics processing library is used to realize three-dimensional graphics drawing, image rendering, synthesis, and layer processing, etc.

[0139] The kernel layer is the layer between hardware and software. The kernel layer at least contains display driver, camera driver, audio driver, sensor driver.

[0140] The application scenario of the embodiment of the present application can be located in a mobile terminal device, which can include a mobile phone, a tablet, a PC, a vehicle-mounted system, etc., and be applied to the push of dynamic effects in a weather system. The capability of an operating system is divided into two parts: a large desktop process and system capability. The capability scheduling between APPs, desktops, icon controls, card controls, and text controls in a system application (large desktop process) is completed. System API is used to encapsulate the user capability supported by the northbound of the operating system. The physical engine key capability is laid out in the graphics subsystem, which can fully mobilize the advantages of the underlying hardware.

[0141] There are a system basic capability subsystem set, a basic software service subsystem set, an enhanced software service subsystem set, and a hardware service subsystem set in the operating system.

[0142] The actual product form is an operating system, which can run on various types of terminals, including smart phones, tablets, PCs, car systems, etc. The current typical product form is a smart phone. The physical engine is a key root technology capability of the operating system, which will be landed in weather applications, wallpaper, and other scenarios. The technology carried in the present patent is mainly reflected in the graphics stack structure of the operating system. Key features will be deployed on the ETS API, physical engine, rendering engine, and graphics driver.

[0143] An operating system (OS) is a set of interrelated system software programs that govern and control computer operations, utilize and run hardware, software resources, and provide common services to organize user interactions, and is also the kernel and cornerstone of a computer system. The operating system needs to handle basic transactions such as managing and configuring memory, determining the priority order of system resource supply and demand, controlling input and output devices, operating networks, and managing file systems. A mobile operating system (OS) is a dedicated software platform that supports the operation of smart phones, tablets, and other mobile devices. It aims to meet the needs of mobile devices, provide a rich user experience, optimized performance, and efficient power management. In the context of mobile application development, a mobile operating system is a key component that provides developers with the necessary infrastructure, framework, and application programming interface (API) to build, test, deploy, and maintain native mobile applications.

[0144] Weather is a topic that users pay close attention to in daily life, and it is close to human production and life. An excellent mobile operating system will also provide clear and beautiful visual weather data, and will display weather as a very important feature. Further, the push of weather data can use impressive 3D effects to present a better system presentation. The weather theme has always been the most frequently used theme, and the next generation of operating system version will further promote the evolution of weather effects. 3D weather system can be applied to product weather application, weather theme, weather wallpaper, etc.

[0145] In the prior art, the weather presentation effect of the system has evolved from a simple static effect to a realistic dynamic visual effect, including cloud, rain, snow, fog, haze, sunny weather scenes, etc. However, the presentation effect of the weather special effect in the prior art does not change with the change of the display page, resulting in poor presentation effect of the weather special effect.

[0146] To solve the above problems, referring to FIG. 3, FIG. 3 is a flowchart of an interface display method provided by an embodiment of the present application, as shown in FIG. 3, an interface display method provided by an embodiment of the present application includes:

[0147] 301, obtaining weather conditions.

[0148] 302, determining a dynamic special effect according to the weather conditions; the dynamic special effect includes weather elements, display elements, and interactive special effects, the weather elements indicate the weather conditions, the weather elements and the display elements have a position interaction that meets a physical rule constraint, and the interactive special effects include special effects generated after the position interaction; the display elements include one or a combination of the following: controls, icons, text, windows, or cards.

[0149] Among them, the execution subject of steps 301 and 302 can be a desktop process.

[0150] In one possible implementation, city information can be obtained (for example, the city where the user is located can be obtained by GPS, or the user selects the city on the operating system interface), and according to the city information, the associated weather conditions can be obtained through a remote server. Here, the weather conditions can refer to cloudy, sunny, rainy, snowy, wind level, temperature, etc.

[0151] Among them, the display special effect of the weather can include weather elements, such as raindrops, snowflakes, light, etc. The weather elements can indicate the weather conditions, wherein the weather elements can move along a trajectory and manner that meets a physical rule constraint, for example, raindrops and snowflakes can move according to the action of gravity, and light can propagate along the direction of light propagation.

[0152] In the embodiments of the present application, in order to improve the display effect of the display special effect of the weather, the weather element and some display elements on the display interface can be interacted, and the special effect after the interaction is displayed. Specifically, when the weather element moves to the display element on the display interface (that is, there is a position interaction, or it can be described as there is a collision or contact), a position interaction special effect that meets the physical rule constraint is displayed. The special effect is the effect that occurs when the weather element and the display element have a position interaction, and is displayed in real time based on the position of the display element. Thus, the display special effect of the weather can be made realistic, thereby improving the presentation effect of the special effect of the weather.

[0153] In a possible implementation, information of a visual element (which can also be referred to as a display element in the embodiments of the present application) that needs to be displayed on the current display interface can be acquired. The display element can be an element on the desktop or in an application. That is, the display element that can have a position interaction with the weather element can be an element at each level of the operating system, for example, a control (for example, a window, a card, a desktop icon, etc.) at the system level, or an object (for example, an icon, text, etc.) at the application level. The information of the display element can include position, shape (for example, contour, size), and the like.

[0154] That is, push at each level of the operating system can be implemented, and the weather element can interact with the control elements at each level of the system.

[0155] For example, referring to FIG. 4, the display area of the dynamic effect can be on display elements at multiple levels, for example, wallpaper, icons, objects in an APP, and the like. For example, referring to FIG. 5, the special effect can be displayed on text, windows, icons, and APP controls on the desktop.

[0156] When the weather element is displayed, a moving path based on a physical external force can be simulated, including falling under gravity, wind field influence simulation, randomness, and the like. For example, referring to FIGS. 11A to 11E, the raindrops or snowflakes can fall along the gravity, and the moving path and manner can be affected by the wind field.

[0157] FIGS. 11A to 11C are schematic diagrams of the snowflakes being piled up on the numbers after moving down along the gravity and the wind field. FIG. 11D is a schematic diagram of raindrops splashing after colliding with the numbers after moving down along the gravity and the wind field. FIG. 11E is a schematic diagram of raindrops splashing after colliding with the numbers, and the raindrops on the lower left are intercepted due to the collision with the numbers.

[0158] In a possible implementation, the weather element includes a light ray, the position interaction is that the light ray propagates to the display element, and the interaction special effect is reflection, penetration, or change in brightness of the light ray.

[0159] For example, referring to the leftmost display page of FIG. 12B, a special effect of light reflection can be formed on a number top, a card top, or a number surface. For example, referring to the third display page from the left of FIG. 12B, a special effect of a card being illuminated by lightning to form reflection can be displayed.

[0160] In a possible implementation, the weather element includes a gas, the position interaction is that the gas spreads on the display element, and the interaction special effect is that the gas penetrates and drifts outside the display element.

[0161] For example, referring to the second display page from the left of FIG. 12B, a special effect of a cloud passing through a number can be displayed. For example, referring to the rightmost display page of FIG. 12B, a special effect of fog drifting in front of a number can be displayed.

[0162] In a possible implementation, the weather element includes a solid or a liquid, the position interaction is that the solid or the liquid collides with the display element, and the interaction special effect is a collision special effect or a pile-up after collision.

[0163] For example, referring to FIG. 12A, a special effect of snowflakes piling up on a number can be displayed. For example, referring to the third display page from the left of FIG. 12B, a special effect of rain falling on a number top to collide can be displayed. For example, referring to the second display page from the right of FIG. 12B, a special effect of snowflakes piling up on a number can be displayed.

[0164] Next, how to determine a dynamic special effect is introduced. In an embodiment of the present application, information of a weather condition and a display element to be displayed (for example, a position, a shape, and the like) can be acquired, and then a dynamic special effect to be displayed can be determined according to the weather condition and the information of the display element.

[0165] For example, referring to FIG. 6, a 2D information collection service obtains a series of 2D control position, 2D window position, control attribute animation, window animation information, and outputs a texture and the like information by 2D drawing; a 3D information collection service collects 3D physics and rendering related information; and the collected information is exchanged by an API to an interactive computing module of an operating system to respectively calculate a physical state of each 2D and 3D object at a next time.

[0166] Referring to FIG. 7, each level of control computing module can calculate a physical state of each 2D and 3D object at a next time; a 3D physics and rendering engine controls display drawing according to an output of the computing module; and a 2D engine controls 2D control, window, animation related display drawing according to an output of the computing module.

[0167] In a possible implementation, configuration information of a rendering engine or a physics engine can also be acquired; and a dynamic special effect to be displayed can be determined by the rendering engine and the physics engine according to the weather condition and the configuration information of the rendering engine or the physics engine.

[0168] In the above, the rendering engine or the physics engine can be self-provided by the operating system, that is, the user (for example, an application developer) can directly use the physical simulation capability of the operating system, and obtain a realistic and unified weather dynamic effect with a lower development cost.

[0169] For example, the operating system internally constructs a physical simulation and rendering capability, and the interaction between weather elements (such as clouds, rain, snow, etc.) and control information is completed through physical simulation, and the rendering capability completes the presentation function of dynamic weather elements.

[0170] Specifically, a large number of physical objects can be simulated in real time in the system-level physics engine, and parallel simulation of physical microelements and pixel-level parallel display of display results are required. The physical engine embedded in the operating system can adapt to the parallel computing capability of the GPU, and transmit task scheduling information adapted to the capacity and specifications of the GPU hardware to the GPU hardware. The results of GPU parallel computing (including dynamic effect process at each time step, rendering results, etc.) will be returned from the hardware to the subsequent process. The operating system API can return the dynamic effect process (position, speed, etc.) and the rendering result (display image) to the desktop system. Then, the desktop system can complete the pushing of the obtained weather dynamic effect information at each level.

[0171] In a possible implementation, the display function of the weather special effect can be provided to the developer through the API. The logical link of the technical solution involves the interaction processes of the UI interface, the UI interface and the 3D pipeline, the 3D pipeline and the physics engine, and the rendering pipeline back end. The detailed process diagram of the scheme can be as shown in FIG. 8.

[0172] Specifically, the weather dynamic effect API can open the basic capability of the physical engine to the developer in a simple and easy-to-use manner.

[0173] API interface input: support the position, outline, size, and other control information of all visual elements (such as many APPs, desktop controls, icon controls, card controls, text controls, etc.) on the large desktop, and the city weather information input by the user.

[0174] API interface output: the operating system API returns the dynamic effect process (position, speed, etc.) and the rendering result (display image) to the large desktop system.

[0175] Through the API, the developer can configure the generation parameters (for example, the configuration of the rendering engine, the configuration of the physics engine, and the configuration of the UI) of the weather special effect. The function diagram of the API can be as follows:

[0176] Referring to FIG. 9, the physical engine can be used to achieve the realistic effect of weather dynamic effects. For example, the physical simulation technology can be used to simulate the effect of rain, snow and meteor in the weather system. The external force is simulated, such as falling under gravity, dancing with the wind. The interaction between the collision object is simulated, such as water splashing, snow accumulation, meteor falling, etc.

[0177] For example, the following main steps can be included:

[0178] 1) Collision body construction: the scene collision body object is constructed according to the external input data, which can be expressed in the form of a table.

[0179] 2) Generate rain and snow: generate rain and snow microelements according to the type of emitter, generation range and physical properties.

[0180] 3) Attribute update: update the position change and volume, age and other attributes of rain and snow caused by external force (gravity, wind force).

[0181] 4) Collision detection: the purpose of collision detection is to find the penetration in the motion process of the previous and next frames.

[0182] 5) Collision response: collision response is based on the collision detected in the previous step, which corrects the position of rain and snow to ensure no penetration behavior.

[0183] In addition, referring to FIG. 10, the physical and rendering engine can also be adapted to the GPU, and the task arrangement is combined with the characteristics of the GPU to achieve vertical optimization and efficient parallel computing; the power consumption optimization realized in the system-level physical and rendering engine can also obtain system-level benefits. A typical use method is that the physical engine uses the ComputeShader parallelization technology, and each operation unit uses a ComputeShader thread; the rendering engine uses the FragmentShader parallelization technology.

[0184] In a possible implementation, the Compute Shader determines the number of GPU threads by setting the size of the work group, each thread corresponds to each simulation microelement, and the initial value of the simulation microelement is initialized and its life cycle is managed through the thread ID. The threads are calculated in parallel to achieve the purpose of acceleration. Each microelement is generated, collides, and its attributes are updated until its life cycle ends, wherein the GPU parallel part can be run in the form of a Compute Shader kernel function. The system-level physical engine completes the parallel computing (task arrangement combined with the characteristics of the GPU) of the self-developed GPU and performs vertical optimization.

[0185] 303, display the dynamic special effect.

[0186] In a possible implementation, after the dynamic special effect is displayed, a gesture operation on the interactive special effect can be acquired; and a collision special effect formed after a position where the gesture operation is located collides with the interactive special effect is displayed.

[0187] For example, the dynamic special effect can include snow accumulation, the gesture operation can be a sliding operation performed on the accumulated snow, and the collision special effect can be shaking off of the snow.

[0188] In a possible implementation, the following can also be performed:

[0189] A gesture operation on the display element is acquired.

[0190] Movement of the display element based on the gesture operation is displayed, and a new interactive special effect formed after the interactive special effect moves with the display element is displayed.

[0191] The gesture operation is a sliding operation (or can be referred to as a dragging operation) on the display element, the interactive special effect can be accumulation of weather elements, and the accumulated weather elements can shake off (the shaking off is the new interactive special effect) as the display element moves. For details, refer to FIG. 9.

[0192] Next, a method for displaying an interface according to an embodiment of the present application is described in combination with a specific implementation. Referring to FIG. 12C, the method includes the following steps.

[0193] S1: The large desktop first acquires city information (the city where the user is located can be acquired by a GPS, or the user selects the city on an operating system interface), and according to the city information, weather information associated with the city can be acquired from a remote server. The weather information refers to weather such as sunshine, rain, snow, wind level, and temperature.

[0194] S2: The large desktop process can acquire position, contour, size, and other control information of all visual elements (such as many APPs, desktop controls, icon controls, card controls, and text controls) on the operating system, and in combination with weather information of the current city, weather special effects of the operating system can be called by using API capabilities provided by the operating system.

[0195] S3: The operating system internally constructs physical simulation and rendering capabilities. The physical simulation completes interaction between weather elements (such as clouds, rain, and snow) and control information, and the rendering capability completes a presentation function of dynamic weather elements.

[0196] S4: A large number of physical objects can be simulated in real time in a system-level physical engine, parallel simulation of physical microelements needs to be performed, and pixel-level parallel display of display results needs to be performed. The physical engine embedded in the operating system can completely adapt to parallel computing capabilities of a self-developed GPU, and task scheduling information adapted to a capacity and a specification of the GPU hardware is transmitted to the GPU hardware.

[0197] S5: The result of GPU parallel computing (including dynamic effect process at each time step, rendering result, etc.) will be returned to the subsequent process from the hardware.

[0198] S6: The operating system API returns the dynamic effect process (position, speed, etc.) and the rendering result (display image) to the large desktop system.

[0199] S7: The large desktop system can complete the push of the obtained weather dynamic effect information at each level.

[0200] Referring to FIG. 13, FIG. 13 is a structural schematic of an interface display device provided by an embodiment of the present application. The device 1300 comprises:

[0201] An obtaining module 1301 is configured to obtain a weather condition.

[0202] A rendering module 1302 is configured to determine a dynamic special effect to be displayed according to the weather condition. The dynamic special effect comprises a weather element, a display element, and an interactive special effect. The weather element indicates the weather condition. The weather element and the display element have a position interaction that satisfies a physical rule constraint. The interactive special effect comprises a special effect generated after the position interaction. The display element comprises one or more combinations of the following: a control, an icon, a text, a window, or a card.

[0203] A display module 1303 is configured to display the dynamic special effect.

[0204] In a possible implementation, the display element is an element on a desktop or in an application program.

[0205] In a possible implementation, the weather element comprises light, the position interaction is that the light propagates onto the display element, and the interactive special effect is reflection, penetration, or change in brightness of the light.

[0206] In a possible implementation, the weather element comprises gas, the position interaction is that the gas propagates onto the display element, and the interactive special effect is penetration of the gas or floating outside the display element.

[0207] In a possible implementation, the weather element comprises solid or liquid, the position interaction is collision of the solid or liquid with the display element, and the interactive special effect is a collision special effect or accumulation after collision.

[0208] In a possible implementation, after the dynamic special effect is displayed, the obtaining module is further configured to:

[0209] obtain a gesture operation on the interactive special effect.

[0210] The display module is further configured to display a new interaction special effect formed after the position where the gesture operation is located interacts with the interaction special effect.

[0211] In a possible implementation, the obtaining module is further configured to:

[0212] obtain a gesture operation directed to the display element;

[0213] The display module is further configured to display movement of the display element based on the gesture operation, and display a new interaction special effect formed after the interaction special effect moves with the display element.

[0214] In a possible implementation, the obtaining module is further configured to:

[0215] obtain information of the display element, the information of the display element including a display position and a display shape of the display element;

[0216] The rendering module is specifically configured to:

[0217] determine the dynamic special effect to be displayed according to the weather condition and the information of the display element.

[0218] In a possible implementation, the obtaining module is further configured to:

[0219] obtain configuration information of a rendering engine or a physics engine;

[0220] The rendering module is specifically configured to:

[0221] determine the dynamic special effect to be displayed according to the weather condition and the configuration information of the rendering engine or the physics engine, by using the rendering engine and the physics engine.

[0222] Next, an execution device provided in an embodiment of the present application is introduced. Referring to FIG. 14, FIG. 14 is a structural schematic diagram of an execution device provided in the embodiment of the present application. The execution device 1400 can be specifically a mobile phone, a tablet computer, a notebook computer, a smart wearable device, etc., which is not limited herein. Specifically, the execution device 1400 includes a receiver 1401, a transmitter 1402, a processor 1403 and a memory 1404 (wherein the number of the processor 1403 in the execution device 1400 can be one or more, and one processor is taken as an example in FIG. 14). The processor 1403 can include an application processor 14031 and a communication processor 14032. In some embodiments of the present application, the receiver 1401, the transmitter 1402, the processor 1403 and the memory 1404 can be connected through a bus or other manners.

[0223] The memory 1404 can include read-only memory and random access memory, and provides instructions and data to the processor 1403. A portion of the memory 1404 can also include non-volatile random access memory (NVRAM). The memory 1404 stores processor and operating instructions, executable modules, or data structures, or a subset thereof, or an extended set thereof, wherein the operating instructions can include various operating instructions for implementing various operations.

[0224] The processor 1403 controls the operation of the execution device. In a specific application, various components of the execution device are coupled together through a bus system, which can include a data bus, a power bus, a control bus, and a state signal bus, etc. However, for the sake of clarity, all the buses are referred to as a bus system in the figure.

[0225] The method disclosed in the above embodiments of the present application can be applied in the processor 1403 or implemented by the processor 1403. The processor 1403 can be an integrated circuit chip with a processing capability of signals. In the implementation process, each step of the above method can be completed by integrated logic circuits or instructions in the form of software in the processor 1403. The processor 1403 described above can be a general processor, a digital signal processor (DSP), a microprocessor or a microcontroller, and can further include an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The processor 1403 can implement or execute the methods, steps and logic block diagrams disclosed in the embodiments of the present application. The general processor can be a microprocessor or the processor can also be any conventional processor. The steps of the method disclosed in combination with the embodiments of the present application can be directly embodied as a hardware code processor for execution, or a combination of hardware and software modules in the code processor for execution. The software module can be located in a random access memory, a flash memory, a read-only memory, a programmable read-only memory or an electrically erasable programmable memory, a register, or other mature storage media in the art. The storage medium is located in the memory 1404, and the processor 1403 reads the information in the memory 1404 and combines the hardware to complete the steps of the above method.

[0226] The receiver 1401 can be configured to receive inputted digital or character information, and to generate signal input related to relevant settings and function control of the execution device. The transmitter 1402 can be configured to output digital or character information; the transmitter 1402 can also be configured to send instructions to the disk set to modify data in the disk set.

[0227] In an embodiment of the present application, in one case, the processor 1403 is configured to execute the steps of the interface display method in the corresponding embodiment of FIG. 3.

[0228] In an embodiment of the present application, a computer program product including computer readable instructions is also provided, which, when running on a computer, causes the computer to execute the steps performed by the aforementioned execution device, or causes the computer to execute the steps performed by the aforementioned training device.

[0229] In an embodiment of the present application, a computer readable storage medium is also provided, which stores a program for signal processing, and when running on a computer, causes the computer to execute the steps performed by the aforementioned execution device, or causes the computer to execute the steps performed by the aforementioned training device.

[0230] In addition, it should be noted that the apparatus embodiments described above are merely illustrative, wherein the units described as separate components can or can not be physically separate, and the components displayed as units can or can not be physical units, i.e., they can be located in one place, or distributed on multiple network units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the embodiment scheme. In addition, the connection relationship between the modules in the apparatus embodiment provided by the present application indicates that there is a communication connection between them, which can be implemented as one or more communication buses or signal lines.

[0231] Those skilled in the art can clearly understand that the application can be implemented by means of software plus necessary universal hardware, and of course can also be implemented by means of dedicated hardware including special integrated circuit, special CPU, special memory, special component, etc. Generally, any function completed by computer program can be easily implemented by corresponding hardware, and the specific hardware structure for implementing the same function can also be various, such as analog circuit, digital circuit or special circuit, etc. However, for the application, software program implementation is a better embodiment. Based on such understanding, the technical solution of the application or the part of the application which makes contribution to the prior art can be embodied in the form of software product, which is stored in readable storage medium, such as computer floppy disk, U disk, mobile hard disk, ROM, RAM, magnetic disk or optical disk, etc., and includes a plurality of instructions for making a computer device (which can be personal computer, training device or network device, etc.) execute the method described in various embodiments of the application.

[0232] In the above embodiments, the implementation can be achieved by software, hardware, firmware or any combination thereof, entirely or partially. When implemented by software, the implementation can be achieved in the form of a computer program product, entirely or partially.

[0233] The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the flow or function described in the embodiments of the application is generated entirely or partially. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another, for example, the computer instructions can be transmitted from one website, computer, training device or data center to another website, computer, training device or data center through wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) mode. The computer-readable storage medium can be any available medium that can be stored by the computer or a data storage device such as training device, data center, etc. integrated with one or more available media sets. The available medium can be magnetic medium (such as floppy disk, hard disk, magnetic tape), optical medium (such as DVD) or semiconductor medium (such as solid state disk (SSD)) etc.

Claims

1. An interface display method characterized by, The method comprises: acquiring weather conditions; determining a dynamic effect to be displayed according to the weather conditions; the dynamic effect comprises a weather element, a display element, and an interactive effect; the weather element indicates the weather conditions; the weather element and the display element have a position interaction that meets a physical rule constraint; the interactive effect comprises an effect generated after the position interaction; the display element comprises a combination of one or more of the following: a control, an icon, text, a window, or a card; displaying the dynamic effect.

2. The method of claim 1, wherein, The weather element and the display element have a position interaction that meets a physical rule constraint, which comprises that the weather element has a movement along a path that meets a physical rule constraint, and then has a position interaction with the display element that meets a physical rule constraint.

3. The method according to claim 1 or 2, characterized in that, The display element is an element on a desktop or in an application.

4. The method according to any one of claims 1 to 3, characterized in that, The weather element comprises light, the position interaction is that the light propagates onto the display element, and the interactive effect is a change in reflection, penetration, or brightness of the light.

5. The method according to any one of claims 1 to 4, characterized in that, The weather element comprises gas, the position interaction is that the gas propagates onto the display element, and the interactive effect is that the gas penetrates and flows outside the display element.

6. The method according to any one of claims 1 to 5, characterized in that, The weather element comprises a solid or a liquid, the position interaction is that the solid or liquid collides with the display element, and the interactive effect is a collision effect or a pile-up after the collision.

7. The method according to any one of claims 1 to 6, characterized in that, The method further comprises: acquiring a gesture operation on the interactive effect; displaying an interactive effect corresponding to a new position interaction between a position where the gesture operation is located and the interactive effect, the new position interaction meeting a physical rule constraint.

8. The method according to any one of claims 1 to 6, characterized in that, The method further comprises: acquiring a gesture operation on the display element; the gesture operation is used to move the display element; displaying an interactive effect corresponding to a new position interaction between the display element and the interactive effect after the movement of the display element, the new position interaction meeting a physical rule constraint.

9. The method according to any one of claims 1 to 8, characterized in that, The method further comprises: acquiring information of the display element, the information of the display element comprising a display position and a display shape of the display element; The method further comprises: determining the dynamic effect to be displayed according to the weather conditions and the information of the display element.

10. The method according to any one of claims 1 to 9, characterized in that, The method further comprises: acquiring configuration information of a rendering engine or a physics engine; The method further comprises: determining the dynamic effect to be displayed according to the weather conditions and the configuration information of the rendering engine or the physics engine, by using the rendering engine and the physics engine.

11. An interface display device, characterized by The apparatus comprises: an acquisition module, configured to acquire weather conditions; a rendering module, configured to determine a dynamic effect to be displayed according to the weather conditions; the dynamic effect comprises a weather element, a display element, and an interactive effect; the weather element indicates the weather conditions; the weather element and the display element have a position interaction that meets a physical rule constraint; the interactive effect comprises an effect generated after the position interaction; the display element comprises a combination of one or more of the following: a control, an icon, text, a window, or a card. a display module configured to display the dynamic special effect.

12. The apparatus of claim 11, wherein, The weather element interacts with the display element at a position that satisfies a physical rule constraint, including that the weather element interacts with the display element at a position that satisfies a physical rule constraint after moving along a path that satisfies a physical rule constraint.

13. The apparatus of claim 11 or 12, wherein, The display element is an element on a desktop or in an application.

14. The apparatus of any one of claims 11 to 13, wherein, The weather element includes light, and the position interaction is that the light propagates onto the display element, and the interaction special effect is reflection, penetration, or change in brightness of the light.

15. The apparatus of any one of claims 11 to 14, wherein, The weather element includes gas, and the position interaction is that the gas propagates onto the display element, and the interaction special effect is penetration of the gas or floating outside the display element.

16. The apparatus of any one of claims 11 to 15, wherein, The weather element includes a solid or liquid, and the position interaction is collision of the solid or liquid with the display element, and the interaction special effect is a collision special effect or accumulation after collision.

17. The apparatus of any one of claims 11 to 16, wherein, The obtaining module is further configured to: obtain a gesture operation directed at the interaction special effect; The display module is further configured to display a new interaction special effect formed by the position at which the gesture operation is located interacting with the interaction special effect.

18. The apparatus of any one of claims 11 to 17, wherein, The obtaining module is further configured to: obtain a gesture operation directed at the display element, the gesture operation being used to move the display element; The display module is further configured to display a new position interaction corresponding interaction special effect formed by the interaction special effect moving with the display element, the new position interaction satisfying a physical rule constraint.

19. The apparatus of any of claims 11 to 18, wherein, The obtaining module is further configured to: obtain information of the display element, the information of the display element including a display position and a display shape of the display element; The rendering module is specifically configured to: determine the dynamic special effect to be displayed according to the weather condition and the information of the display element.

20. The apparatus of any one of claims 11 to 19, wherein, The obtaining module is further configured to: obtain configuration information of a rendering engine or a physics engine; The rendering module is specifically configured to: determine the dynamic special effect to be displayed by the rendering engine and the physics engine according to the weather condition and the configuration information of the rendering engine or the physics engine.

21. An interface display device, comprising: The apparatus includes a memory and a processor; the memory stores code, and the processor is configured to obtain the code and perform the method of any one of claims 1 to 10.

22. A computer-readable storage medium, characterized in that, The computer readable instructions, when executed on a computer device, cause the computer device to perform the method of any one of claims 1 to 10.

23. A computer program product, characterised in that, The computer readable instructions, when executed on a computer device, cause the computer device to perform the method of any one of claims 1 to 10.