Wallpaper display method and electronic device
By controlling the animation video playback of dynamic wallpaper in multi-screen collaborative scenarios, and using the state of multi-screen collaborative connection to determine whether to display the animation effect of wallpaper changes, the problem of flashing black screen caused by insufficient processor processing capabilities is solved, and the user experience is improved.
Patent Information
- Application Number
- PCT/CN2023/118833
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2023-09-14
- Publication Date
- 2025-03-20
AI Technical Summary
In multi-screen collaboration scenarios, the insufficient processor processing capability of the dynamic wallpaper APP leads to the restart of the dynamic wallpaper APP, causing the flashing of the black screen, affecting the user experience.
By implementing a wallpaper display method in the first electronic device, the state of multi-screen collaborative connection is used to determine whether to display the animation effect of wallpaper changes. When the first electronic device establishes a multi-screen collaborative connection with the second electronic device, the playback of the dynamic wallpaper's animation video is stopped; when the multi-screen collaborative connection is disconnected, the playback of the dynamic wallpaper's animation video is resumed.
It effectively avoids the flashing black screen caused by playing animation videos by the dynamic wallpaper APP in multi-screen collaborative scenarios, improving the user experience.
Smart Images

Figure CN2023118833_20032025_PF_FP_ABST
Abstract
Description
Wallpaper display method and electronic device Technical Field
[0001] The embodiments of the present application relate to the field of electronic technology, and in particular to a wallpaper display method and electronic device. Background Art
[0002] In the scenario where two electronic devices perform multi-screen collaboration, the first electronic device needs to record the screen and encode the recorded video, and then send the recorded video to the second electronic device performing multi-screen collaboration for playback, thereby realizing multi-screen collaboration between the two electronic devices. At this time, if the dynamic wallpaper application (application, APP) in the first electronic device plays the dynamic wallpaper's dynamic effect video, the first electronic device needs to decode the dynamic effect video. If the processing power of the processor in the first electronic device is low, the dynamic wallpaper APP will be restarted, causing a flickering black screen and affecting the user experience.
[0003] Summary of the Invention
[0004] The embodiments of the present application provide a wallpaper display method and electronic device, which relate to the field of electronic technology and are used to avoid a flickering black screen caused by a dynamic wallpaper APP playing an animated video in a multi-screen collaboration scenario.
[0005] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:
[0006] In a first aspect, a wallpaper display method is provided, which is applied to a first electronic device, which is a folding screen device; the method includes: at a first time point, the first electronic device establishes a multi-screen collaborative connection with the second electronic device, and the folding angle of the first electronic device is a first angle; at a second time point, the folding angle of the first electronic device changes from the first angle to the second angle, and in the process of the folding angle of the first electronic device changing from the first angle to the second angle, based on the establishment of a multi-screen collaborative connection between the first electronic device and the second electronic device, the first electronic device does not display an animation effect of wallpaper change, and the second time point is later than the first time point; at a third time point, the first electronic device disconnects the multi-screen collaborative connection with the second electronic device; at the third time point, the folding angle of the first electronic device is the first angle; at a fourth time point, the folding angle of the first electronic device changes from the first angle to the second angle, and in the process of the folding angle of the first electronic device changing from the first angle to the second angle, based on the fact that the first electronic device has not established a multi-screen collaborative connection with other electronic devices, the first electronic device displays an animation effect of wallpaper change, and the fourth time point is later than the third time point.
[0007] The animation effect of wallpaper changes can be achieved through the dynamic effect video of the dynamic wallpaper, or it can be achieved through the vector change of the static wallpaper. For example, when the electronic device gradually changes from the unfolded state to the folded state, the wallpaper gradually moves to the left, and the display screen coordinate (0,0) point gradually changes from the corresponding wallpaper coordinate (0,0) to the corresponding wallpaper coordinate (B,0). The left side of the display screen is the display area of the main screen, and the right side of the display screen is the display area of the secondary screen. A black screen begins to appear in the display area of the secondary screen, and the range of the black screen gradually becomes larger.
[0008] The wallpaper display method provided by the embodiment of the present application is that, in a multi-screen collaborative scenario, the first electronic device establishes a multi-screen collaborative connection with the second electronic device. When the folding angle of the first electronic device changes, the display screen of the first electronic device does not display the animation effect of the wallpaper change. The first electronic device disconnects the multi-screen collaborative connection with the second electronic device. When the folding angle of the display screen of the first electronic device changes, the first electronic device displays the animation effect of the wallpaper change. That is, the playback of the motion effect video of the multi-screen collaboration and the dynamic wallpaper is mutually exclusive, and the multi-screen collaboration has a higher priority, thereby avoiding the flickering black screen caused by the dynamic wallpaper APP playing the motion effect video in the multi-screen collaborative scenario.
[0009] In a possible implementation, it also includes: when the first electronic device establishes a multi-screen collaborative connection with the second electronic device, the multi-screen collaborative application in the first electronic device sends a first indication message to the dynamic wallpaper application in the first electronic device, and the first indication message is used to indicate that the multi-screen collaborative connection has been established; the dynamic wallpaper application sets the multi-screen collaborative flag to be valid based on the first indication message, and when the multi-screen collaborative flag is valid, it is used to indicate that the multi-screen collaborative connection has been established.
[0010] The multi-screen collaboration application notifies the dynamic wallpaper application that the electronic device has established a multi-screen collaboration connection. The dynamic wallpaper application updates the multi-screen collaboration flag to record the establishment of the multi-screen collaboration connection, thereby determining not to display the wallpaper change animation effect.
[0011] In a possible implementation, the multi-screen collaborative application in the first electronic device sends the first indication information to the dynamic wallpaper application in the first electronic device, including: the multi-screen collaborative application sends the first indication information to the dynamic wallpaper application via a broadcast message.
[0012] Different applications can transmit information through broadcast messages. Since the dynamic wallpaper application playing the dynamic wallpaper's dynamic effect video and the multi-screen collaboration application performing multi-screen collaboration are two independent processes, when the multi-screen collaboration application establishes a multi-screen collaboration connection, the dynamic wallpaper application can be notified in time to establish a multi-screen collaboration connection.
[0013] In a possible implementation, it also includes: when the first electronic device disconnects the multi-screen collaborative connection from the second electronic device, the multi-screen collaborative application sends a second indication message to the dynamic wallpaper application, and the second indication message is used to indicate that the multi-screen collaborative connection has been disconnected; the dynamic wallpaper application sets the multi-screen collaborative flag to invalid based on the second indication message, and when the multi-screen collaborative flag is invalid, it is used to indicate that the multi-screen collaborative connection has been disconnected.
[0014] The multi-screen collaboration application notifies the dynamic wallpaper application: the electronic device disconnects the multi-screen collaboration connection, and the dynamic wallpaper application updates the multi-screen collaboration flag to record that the electronic device disconnects the multi-screen collaboration connection, thereby determining the animation effect of displaying the wallpaper change.
[0015] In a possible implementation, the multi-screen collaborative application sends the second indication information to the dynamic wallpaper application, including: the multi-screen collaborative application sends the second indication information to the dynamic wallpaper application through a broadcast message.
[0016] Different applications can transmit information through broadcast messages. Since the dynamic wallpaper application playing the dynamic wallpaper's dynamic effect video and the multi-screen collaboration application performing multi-screen collaboration are two independent processes, when the multi-screen collaboration application disconnects the multi-screen collaboration connection, the dynamic wallpaper application can be notified in time to disconnect the multi-screen collaboration connection.
[0017] In one possible implementation, based on a multi-screen collaborative connection established between the first electronic device and the second electronic device, the first electronic device displays an animation effect of wallpaper changes, including: the first electronic device determines that the multi-screen collaborative flag is invalid, and the change in the folding angle of the first electronic device is greater than or equal to a threshold value, the display screen of the first electronic device plays an animation video of the dynamic wallpaper, and the change in the folding angle is equal to the absolute value of the difference between the first angle and the second angle.
[0018] When the folding angle of the electronic device changes slightly, the dynamic wallpaper's animation video changes little, eliminating the need for subsequent calculations and reducing power consumption. When the folding angle of the electronic device changes significantly, the dynamic wallpaper's animation video changes significantly.
[0019] In one possible implementation, the display screen of a first electronic device plays a dynamic wallpaper's motion effect video, including: the dynamic wallpaper application calculates the timestamp of the motion effect video corresponding to the second angle based on the second angle and the total duration of the motion effect video; the dynamic wallpaper application sends the motion effect video and the timestamp corresponding to the second angle to the media codec in the first electronic device; the media codec decodes the motion effect video to obtain all image frames, and sends target image frames to a drawing and rendering service, the target image frames including image frames from the played timestamp to the timestamp corresponding to the second angle in all image frames; the drawing and rendering service renders the received target image frames, and controls the display screen in the first electronic device to display the target image frames in ascending order of timestamps through the display screen driver. This implementation discloses a specific implementation of the first electronic device's display screen playing a dynamic wallpaper's motion effect video.
[0020] In one possible implementation, based on the establishment of a multi-screen collaborative connection between the first electronic device and the second electronic device, the first electronic device does not display the animation effect of the wallpaper change, including: the first electronic device determines that the multi-screen collaborative flag is valid, and the first electronic device displays a static image on the display screen. In other words, no matter how the folding angle of the first electronic device changes, the wallpaper displayed on the display screen of the first electronic device is static, for example, the last image frame of the dynamic effect video is continuously displayed, or if the display screen has played the 10th image frame of the dynamic effect video, the 10th image frame is continuously displayed.
[0021] In a second aspect, an electronic device is provided, including a display screen, a processor and a memory, wherein instructions are stored in the memory. When the processor executes the instructions, the method described in the first aspect and any embodiment thereof is executed to control the display screen to display the dynamic effect video of the dynamic wallpaper.
[0022] In a third aspect, a computer-readable storage medium is provided, comprising instructions, which, when executed on an electronic device, enable the electronic device to execute the method as described in the first aspect and any embodiment thereof.
[0023] In a fourth aspect, a computer program product comprising instructions is provided. When the instructions are executed on the electronic device, the electronic device executes the method as described in the first aspect and any embodiment thereof.
[0024] In a fifth aspect, a chip system is provided, which includes a processor for supporting an electronic device in implementing the functions described in the first aspect. In one possible design, the device further includes an interface circuit, which can be used to receive signals from other devices (such as a memory) or send signals to other devices (such as a communication interface). The chip system may include a chip and may also include other discrete components.
[0025] The technical effects of the second to fifth aspects refer to the technical effects of the first aspect and any of its embodiments and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0026] FIG1 is a schematic diagram of a multi-screen collaboration system provided in an embodiment of the present application;
[0027] FIG2 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0028] FIG3 is a schematic diagram of an electronic device provided by an embodiment of the present application, which is a foldable screen mobile phone;
[0029] FIG4 is a schematic diagram of another electronic device provided in an embodiment of the present application, which is a foldable screen mobile phone;
[0030] FIG5 is a schematic diagram of a dynamic wallpaper according to an embodiment of the present application that changes with the folding angle of the first electronic device;
[0031] FIG6 is a schematic diagram of a software architecture for running an electronic device provided in an embodiment of the present application;
[0032] FIG7 is a schematic diagram of a flowchart of a wallpaper display method provided in an embodiment of the present application;
[0033] FIG8 is a flow chart of another wallpaper display method provided in an embodiment of the present application;
[0034] FIG9 is a schematic flow chart of another wallpaper display method provided in an embodiment of the present application;
[0035] FIG10 is a schematic diagram of establishing a multi-screen collaborative connection according to an embodiment of the present application;
[0036] FIG11 is a schematic diagram of disconnecting a multi-screen collaborative connection provided by an embodiment of the present application;
[0037] FIG12 is a flow chart of another wallpaper display method provided in an embodiment of the present application. DETAILED DESCRIPTION
[0038] First, some concepts involved in this application are described.
[0039] The terms "first", "second", etc. involved in the embodiments of the present application are only used to distinguish features of the same type and cannot be understood as indicating relative importance, quantity, order, etc.
[0040] The terms "exemplary" or "for example" in the embodiments of this application are used to indicate examples, illustrations, or descriptions. Any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0041] The terms "coupling" and "connection" involved in the embodiments of this application should be understood in a broad sense. For example, they may refer to a physical direct connection, or an indirect connection achieved through electronic devices, such as a connection achieved through resistors, inductors, capacitors or other electronic devices.
[0042] As shown in Figure 1, an embodiment of the present application provides a multi-screen collaboration system, including at least two electronic devices, such as a mobile phone 110 and a personal computer (PC) 120. Multi-screen collaboration can be performed between the two electronic devices in a wired manner (for example, through a universal serial bus (USB) interface) or a wireless manner (for example, through wireless fidelity (WiFi), Bluetooth (BT)). Optionally, a connection for multi-screen collaboration is established between the two electronic devices. Optionally, the multi-screen collaboration connection may include at least one of a USB connection, a WiFi connection, and a Bluetooth connection.
[0043] The basic principle of multi-screen collaboration between two electronic devices is: when the first electronic device and the second electronic device establish a multi-screen collaborative connection through a wired or wireless method, the first electronic device (such as a mobile phone 110) records the screen and encodes the recorded video, and then sends the recorded video to the second electronic device (such as a PC 120) for multi-screen collaboration for playback. For example, the mobile phone 110 records the screen and encodes the recorded video, sends the recorded video to the PC 120 for playback, and the display interface of the mobile phone 110 can be displayed in the PC 120. In addition, when the user operates the display interface of the first electronic device on the second electronic device, the second electronic device will send the user's operation to the first electronic device, and the first electronic device will respond based on the user's operation. For example, when the user clicks the "OK" button in the mobile phone 110 displayed in the PC 120, the PC 120 will send the user's operation to the mobile phone 110, and the mobile phone 110 will respond to the user's operation, which is equivalent to the "OK" button in the mobile phone 110 being clicked.
[0044] In a multi-screen collaboration scenario between two electronic devices, if a dynamic wallpaper application (APP) in the first electronic device plays the dynamic wallpaper's motion video, the first electronic device needs to not only encode the screen recording video, but also decode the dynamic wallpaper's motion video. If the processing power of the processor in the first electronic device is low, for example, the number of allocated macroblocks is less than the number of macroblocks required for video encoding and decoding, the dynamic wallpaper APP will be restarted, resulting in a flickering black screen and affecting the user experience.
[0045] Macroblocks are a fundamental concept in video encoding and decoding technology. By dividing a video frame into multiple macroblocks, each macroblock can be independently encoded and decoded, improving encoding and decoding efficiency. The size of a macroblock depends on the encoding type. For example, the macroblock size for H.264 encoding is 16*16, while the macroblock size for H.265 encoding is 32*32.
[0046] The wallpaper display method and electronic device provided in the embodiments of the present application prevent flickering black screens by prohibiting the first electronic device from playing the dynamic wallpaper's animation video in a multi-screen collaboration scenario between two electronic devices. In particular, when the first electronic device is a foldable screen device, if the user opens and closes the first electronic device, causing the folding angle of the first electronic device to change, the first electronic device will not play the dynamic wallpaper's animation video until the two electronic devices disconnect from the multi-screen collaboration.
[0047] The electronic device provided in the embodiments of the present application can be mobile or fixed. The electronic device can be deployed on land (for example, indoors or outdoors, handheld or vehicle-mounted, etc.), on water (for example, ships, etc.), or in the air (for example, airplanes, balloons, and satellites, etc.). The electronic device can be referred to as user equipment (UE), access terminal, terminal unit, subscriber unit, terminal station, mobile station (MS), mobile station, terminal agent, or terminal device, etc. For example, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a smart bracelet, a smart screen, a smart watch, a headset, a smart speaker, a virtual reality (VR) device, an augmented reality (AR) device, a terminal in industrial control, a terminal in self-driving, a terminal in remote medical, a terminal in smart grid, a terminal in transportation safety, a terminal in smart city, a terminal in smart home, etc. The embodiments of the present application do not limit the specific type and structure of the electronic device. A possible structure of the electronic device is described below.
[0048] Taking a mobile phone as an example, FIG2 shows a possible structure of an electronic device 101. The electronic device 101 may include a processor 210, an external memory interface 220, an internal memory 221, a universal serial bus (USB) interface 230, a power management module 240, a battery 241, a wireless charging coil 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 270A, a receiver 270B, a microphone 270C, an earphone interface 270D, a sensor module 280, a button 290, a motor 291, an indicator 292, a camera 293, a display 294, and a subscriber identification module (SIM) card interface 295. Optionally, in some embodiments, an audio digital signal processor (ADSP) 243 is also included.
[0049] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the electronic device 101. In other embodiments of the present application, the electronic device 101 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0050] The processor 210 may include one or more processing units, for example: the processor 210 may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processing unit (CPU), an application processor (AP), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a baseband processor, and a neural-network processing unit (NPU). Among them, different processing units may be independent devices or integrated into one or more processors. For example, the processor 210 may be an application processor AP. Alternatively, the processor 210 may be integrated into a system on chip (SoC). Alternatively, the processor 210 may be integrated into an integrated circuit (IC) chip. The processor 210 may include an analog front end (AFE) and a micro-controller unit (MCU) in an IC chip.
[0051] The controller may be the nerve center and command center of the electronic device 101. The controller may generate an operation control signal based on the instruction operation code and the timing signal to complete the control of instruction fetching and execution.
[0052] Processor 210 may also include a memory for storing computer instructions and data. In some embodiments, the memory in processor 210 is a cache memory. This memory can store computer instructions or data that have just been used or are being recycled by processor 210. If processor 210 needs to use the computer instructions or data again, it can directly access the memory. This avoids repeated accesses, reduces processor 210 latency, and thus improves system efficiency.
[0053] In some embodiments, the processor 210 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a USB interface.
[0054] The ADSP 243 can be coupled to the audio module 270 and the sensor module 280. The ADSP 243 can be used to process the audio signal and process the sensor data. When the processor is in a dormant state, the ADSP 243 can still keep working, thereby reducing the power consumption of the electronic device.
[0055] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative illustration and does not constitute a structural limitation on the electronic device 101. In other embodiments of the present application, the electronic device 101 may also adopt a different interface connection method from the above embodiments, or a combination of multiple interface connection methods.
[0056] The wireless communication function of the electronic device 101 can be implemented through the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, the modem processor, and the baseband processor.
[0057] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 101 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0058] The mobile communication module 250 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 101. The wireless communication module 260 can provide solutions for wireless communications including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., applied to the electronic device 101. In some embodiments, the antenna 1 of the electronic device 101 is coupled to the mobile communication module 250, and the antenna 2 is coupled to the wireless communication module 260, so that the electronic device 101 can communicate with the network and other devices through wireless communication technology.
[0059] The external memory interface 220 can be used to connect an external memory card, such as a micro SanDisk (Micro SD) card, to expand the storage capacity of the electronic device 101. The external memory card communicates with the processor 210 via the external memory interface 220 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.
[0060] The internal memory 221 can be used to store computer executable program code, which includes computer instructions. The processor 210 executes various functional applications and data processing of the electronic device 101 by running the computer instructions stored in the internal memory 221. In addition, the internal memory 221 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0061] The memory involved in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct RAM bus RAM (DR RAM). It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0062] The electronic device 101 can implement audio functions such as music playback and recording through the audio module 270 , the speaker 270A, the receiver 270B, the microphone 270C, the headphone jack 270D, and the application processor.
[0063] The audio module 270 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. In some embodiments, the audio module 270 can be set in the processor 210, or some functional modules of the audio module 270 can be set in the processor 210. The speaker 270A, also known as the "speaker", is used to convert audio electrical signals into sound signals. The receiver 270B, also known as the "earpiece", is used to convert audio electrical signals into sound signals. The microphone 270C, also known as the "microphone" or "microphone", is used to convert sound signals into electrical signals. The electronic device 101 can be provided with at least one microphone 270C. The headphone jack 270D is used to connect wired headphones. The headphone jack 270D can be a USB interface 230, or it can be a 3.5mm open mobile terminal platform (OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
[0064] The buttons 290 include a power button, a volume button, and the like. The buttons 290 may be mechanical buttons or touch buttons. The electronic device 101 may receive button inputs and generate key signal inputs related to the user settings and function control of the electronic device 101. The motor 291 may generate vibration prompts. The motor 291 may be used for vibration prompts for incoming calls or for touch vibration feedback. The indicator 292 may be an indicator light that may be used to indicate the charging status, power level changes, messages, missed calls, notifications, and the like. The SIM card interface 295 is used to connect a SIM card. The SIM card may be connected to or disconnected from the electronic device 101 by inserting or removing the SIM card interface 295. The electronic device 101 may support one or N SIM card interfaces, where N is a positive integer greater than one. The SIM card interface 295 may support nano SIM cards, micro SIM cards, SIM cards, and the like. In some embodiments, the electronic device 101 uses an embedded SIM (eSIM) card. The eSIM card can be embedded in the electronic device 101 and cannot be separated from the electronic device 101.
[0065] The electronic device 101 can implement a camera function using an ISP, a camera 293, a video codec, a GPU, a display 294, and an application processor. The ISP is used to process data fed back by the camera 293. In some embodiments, the ISP can be provided within the camera 293. The camera 293 is used to capture still images or videos. In some embodiments, the electronic device 101 can include one or N cameras 293, where N is a positive integer greater than one.
[0066] Electronic device 101 can implement display functions through a GPU, display screen 294, and an application processor. A GPU is a microprocessor for image processing that connects display screen 294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute computer instructions to generate or modify display information.
[0067] The display screen 294 is used to display images, videos, etc. The display screen 294 includes a display panel. In some embodiments, the electronic device 101 may include one or more display screens 294. In particular, the display screen 294 may be a folding screen. Exemplarily, as shown in Figures 3 and 4, the display panel of the display screen 294 may include a first display area 31 and a second display area 32. When the display screen 294 is folded, the first display area 31 and the second display area 32 may be located in different planes. The display screen 294 in Figure 3 folds outward so that the first display area 31 and the second display area 32 are visible to the user after folding, and the user can still perform touch operations on the display screen 294. The display screen 294 in Figure 4 folds inward so that the first display area 31 and the second display area 32 are opposite to each other after being fully folded, which is beneficial to protecting the display panel of the display screen 294. The display screen 294 provided in the embodiment of the present application can be an outward-folding folding screen as shown in Figure 3, and can also be applied to an inward-folding folding screen as shown in Figure 4.
[0068] When the electronic device is a folding screen device, the display screen 294 can display a dynamic wallpaper that changes (for example, position, image content) as the folding angle changes. In an embodiment of the present application, the folding angle of the first electronic device refers to the angle between the two display planes of the display screen of the first electronic device. For example, as shown in Figures 3 and 4, the folding angle of the first electronic device refers to the angle between the plane where the display area of the main screen (i.e., the first display area 31) is located and the plane where the display area of the secondary screen (i.e., the second display area 32) is located. For example, as shown in Figure 5, when the electronic device gradually changes from an unfolded state to a folded state, the dynamic wallpaper gradually moves to the left, and the display screen coordinate (0,0) point gradually changes from the corresponding wallpaper coordinate (0,0) to the corresponding wallpaper coordinate (B,0). The left side of the display screen is the display area of the main screen, and the right side of the display screen is the display area of the secondary screen. A black screen begins to appear in the display area of the secondary screen, and the range of the black screen gradually increases.
[0069] The sensor module 280 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, an angle sensor, etc. When the display screen 294 is a foldable screen, the angle sensor can detect the folding angle of the display screen 294, and the folding angle range is 0-180 degrees.
[0070] The battery 241 may include one or more batteries to power the load.
[0071] The power management module 240 is configured to receive charging input from a charger. The charger can be a wireless charger, such as a wireless charging dock or another electronic device 101 with reverse wireless charging functionality. The power management module 240 can receive wireless charging input via the electronic device's wireless charging coil 242. Alternatively, the charger can be a wired charger, for example, via the USB port 230. The power management module 240 is also referred to as a charging chip.
[0072] The power management module 240 can not only charge the battery 241 but also power the electronic device. The power management module 240 receives input from the battery 241 and provides power to the processor 210, the internal memory 221, the external memory interface 220, the display 294, the camera 293, and the wireless communication module 260. The power management module 240 can also be used to monitor parameters such as the capacity, voltage, battery cycle count, and battery health status (leakage, impedance) of the battery 241. In other embodiments, the power management module 240 can also be provided in the processor 210.
[0073] The processor 210 executes the wallpaper display method provided by the embodiment of the present application by executing the program and computer instructions stored in the internal memory 221. The program run by the processor 210 can be based on an operating system, such as Windows operating system, etc.
[0074] As shown in FIG6 , the program executed by the processor 210 is based on For example, the programs run by the processor 210 are layered according to their functions, and may include a kernel layer, a hardware abstraction layer (HAL), a framework layer, and an application layer.
[0075] The kernel layer includes the operating system (OS) kernel and hardware drivers for driving hardware resources, such as the angle sensor driver and display driver. The OS kernel manages the system's processes, memory, drivers, file system, and network system. The angle sensor driver is used to obtain the electronic device's folding angle, and the display driver drives the display to display images.
[0076] HAL is used to provide a virtual hardware platform to abstract the hardware, hide the hardware interface details, make the code hardware-independent, and can be ported on multiple platforms. For example, HAL includes a drawing rendering service (SurfaceFlinger) and a sensor manager (SensorManager). Among them, the drawing rendering service (SurfaceFlinger) is used to periodically render the video data and refresh the view tree (a tree data structure formed by multiple views) in the graphical user interface (GUI). The sensor manager (SensorManager) is used to manage various sensors, and in this application it is used to manage angle sensors.
[0077] The framework layer provides application programming interfaces (APIs) and system resource services to applications in the application layer. For example, the framework layer includes system services (SystemServer) and media codecs (MediaCodec). System Server is used to start various system services, such as sensor-related services to transmit sensor data. Media Codec is used to encode and decode video.
[0078] The application layer can include a multi-screen collaboration app and a dynamic wallpaper app. The dynamic wallpaper app is used to display dynamic wallpapers with motion effects, and the multi-screen collaboration app is used to collaborate with multiple electronic devices. The multi-screen collaboration app is also used to send a broadcast message to the dynamic wallpaper app to inform it of the current establishment or disconnection of the multi-screen collaboration connection.
[0079] As shown in FIG7 , an embodiment of the present application provides a wallpaper display method. The electronic device may display a dynamic wallpaper's motion effect video based on the folding angle of the first electronic device as described in FIG5 . The wallpaper display method includes S101 - S110 .
[0080] S101. The dynamic wallpaper APP registers to monitor angle sensor events with the sensor manager (SensorManager) through the sensor event listener (SensorEventListener).
[0081] When the electronic device is started, the dynamic wallpaper APP is started, and the dynamic wallpaper APP registers with the sensor manager (SensorManager) to monitor angle sensor events through the sensor event listener (SensorEventListener).
[0082] The sensor event listener (SensorEventListener) can monitor data from various sensors. When registering to monitor angle sensor events, the dynamic wallpaper app can instruct the sensor event listener (SensorEventListener) to register to monitor angle sensor events with the sensor manager (SensorManager) to monitor the folding angle of the first electronic device detected by the angle sensor.
[0083] S102: When the folding angle of the first electronic device changes (for example, from a first angle to a second angle), the angle sensor driver sends the folding angle of the first electronic device (ie, the second angle) to the sensor manager (SensorManager).
[0084] The angle sensor periodically sends the measured folding angle of the first electronic device to the ADSP. When the ADSP determines that the folding angle of the first electronic device has not changed, the ADSP does not send the folding angle of the first electronic device (i.e., the second angle) to the sensor driver to reduce power consumption. When the ADSP determines that the angle of the display screen has changed, the ADSP sends the folding angle of the first electronic device (i.e., the second angle) to the sensor driver, and then the angle sensor driver sends the folding angle of the first electronic device (i.e., the second angle) to the sensor manager (SensorManager).
[0085] Regarding the folding angle of the first electronic device, please refer to the relevant description of Figures 3 and 4 and will not be repeated here.
[0086] S103. The sensor manager (SensorManager) sends the folding angle (ie, the second angle) of the first electronic device to the dynamic wallpaper APP through the sensor data change (onSensorChanged) function.
[0087] The sensor data change (onSensorChanged) function is used to feedback sensor data when the sensor data changes.
[0088] S104. When the change in the folding angle of the first electronic device (the absolute value of the difference between the first angle and the second angle) is less than a threshold (e.g., 2 degrees), the dynamic wallpaper APP discards the folding angle of the first electronic device (i.e., the second angle) detected this time.
[0089] The change in the folding angle of the first electronic device refers to the absolute value of the difference between the folding angle of the first electronic device detected this time (ie, the second angle) and the stored folding angle of the first electronic device detected last time (ie, the first angle).
[0090] When the change in the folding angle of the first electronic device is too small, the dynamic effect video of the dynamic wallpaper does not change significantly, and there is no need for subsequent calculations, that is, there is no need to execute subsequent steps S105-S110, thereby reducing power consumption.
[0091] S105. When the change in the folding angle of the first electronic device is greater than or equal to a threshold, the dynamic wallpaper APP calculates a timestamp of the dynamic effect video corresponding to the second angle based on the second angle and the total duration of the dynamic wallpaper's dynamic effect video.
[0092] Each image frame in the dynamic effect video corresponds to a timestamp. When playing the dynamic effect video, it will be played in the order of the timestamps. In addition, the dynamic wallpaper app will also store the folding angle (second angle) of the first electronic device detected this time, so that the change in the folding angle of the first electronic device can be recalculated next time. That is, the second angle detected this time will be used as the first angle when recalculating the change in the folding angle of the first electronic device next time.
[0093] Exemplarily, in one possible implementation, the dynamic wallpaper APP can obtain the timestamp of the motion effect video corresponding to the second angle by calling the callback function - the animation update (onAnimationUpdate) function. Assuming that the total duration of the motion effect video is T, when the folding angle of the first electronic device is Δ degrees (for example, Δ=6), the image frame with the timestamp of the corresponding motion effect video is 0, and when the folding angle of the first electronic device is 180-Δ degrees, the image frame with the timestamp of the corresponding motion effect video is T. Then, when the folding angle (second angle) of the first electronic device detected this time is α (Δ≤α≤180-Δ), the corresponding timestamp is T*(α-Δ) / (180-2Δ). This implementation can achieve: the playback progress of the motion effect video changes linearly with the folding angle of the first electronic device.
[0094] S106. The dynamic wallpaper APP initializes the media codec (MediaCodec) and sends the dynamic effect video to the media codec (MediaCodec) by setting the data source (setDataSource) function.
[0095] The dynamic wallpaper app initializes the media codec (MediaCodec), including: creating a media codec (MediaCodec) object, configuring the video resolution, encoding method, etc. for the media codec (MediaCodec) object.
[0096] The Live Wallpaper app can send the animated video to the Media Codec (MediaCodec) all at once by setting the data source (setDataSource) function, rather than sending it in segments. To reduce power consumption, if no new folding angle data is obtained within a preset time (e.g., 2 seconds) after the Live Wallpaper app initializes the Media Codec (MediaCodec), the Media Codec (MediaCodec) memory will be released.
[0097] S107. The media codec (MediaCodec) decodes the motion effect video to obtain all image frames.
[0098] When decoding animated videos, the Media Codec (MediaCodec) divides a frame into multiple macroblocks and decodes each macroblock independently. Adjacent frames in a video often have minimal changes, with some areas changing while others remain unchanged. These areas can be joined together using macroblocks. Therefore, unchanged macroblocks can be compressed and encoded, while the image data for those that do change is retained, reducing the overall video size. Decoding is the reverse process of compression encoding.
[0099] S108. The dynamic wallpaper APP sends the timestamp of the dynamic effect video corresponding to the second angle to the media codec (MediaCodec) by calling the seekTo function of the media codec (MediaCodec).
[0100] S109. The media codec (MediaCodec) sends the target image frame to the rendering service (SurfaceFlinger) through the surface texture (SurfaceTexture).
[0101] The target image frames include image frames from the played timestamp to the timestamp corresponding to the second angle among all the image frames obtained by decoding.
[0102] The MediaCodec doesn't need to send all decoded frames of the animation video, as some of them have already been played. It only needs to send frames from the played timestamp to the timestamp corresponding to the second angle. The played timestamp refers to the timestamp corresponding to the frames of the animation video that have already been played.
[0103] S110. The drawing rendering service (SurfaceFlinger) renders the received target image frame, and controls the display screen to display the target image frames in ascending order of timestamps through the display screen driver, thereby displaying the dynamic effect video of the dynamic wallpaper.
[0104] It should be noted that for S107, a flickering black screen may occur in a multi-screen collaborative scenario. As shown in Figure 8, when decoding the dynamic effect video in a multi-screen collaborative scenario, insufficient macroblocks are allocated, causing a flickering black screen. The process is as follows:
[0105] S201. When the folding angle of the electronic device changes in the screen-on state, or when the electronic device rotates between the horizontal screen and the vertical screen in the screen-on state, or when the electronic device changes from the screen-off state to the screen-on state, the dynamic wallpaper APP initializes the media codec and occupies the macroblock.
[0106] For example, assuming that the number of macroblocks allocated by the first electronic device system is 1,224,000, the resolution of the dynamic wallpaper is 2016*2016, and the frame rate is 50, then the number of macroblocks occupied by the dynamic wallpaper app when initializing the media codec is 2016*2016*50 / 256=793,800.
[0107] S202. Multi-screen collaborative APP occupies macro blocks.
[0108] For example, assuming that the resolution of the screen recording during multi-screen collaboration is 2346*2016 and the frame rate is 45, the number of macroblocks occupied by the multi-screen collaboration APP when initializing the media codec is 2346*2016*45 / 256=832,072.5.
[0109] S203. The sum of the number of macroblocks occupied by the dynamic wallpaper and the number of macroblocks occupied by multiple screens exceeds the number of macroblocks allocated by the first electronic device system, causing a flickering black screen.
[0110] Therefore, the total number of macroblocks occupied by the dynamic wallpaper app and the multi-screen collaboration app is 793,800 + 832,072.5 = 1,625,872.5, which is greater than 1,224,000. This means that the number of macroblocks actually occupied by the video codec is much greater than the number of macroblocks allocated by the electronic device for video codec. Because multi-screen collaboration has a higher priority than dynamic wallpaper, the dynamic wallpaper app will be restarted due to insufficient macroblocks, causing a flickering black screen and affecting the user experience.
[0111] To this end, an embodiment of the present application provides a wallpaper display method and an electronic device, in which a multi-screen collaborative connection is established between a first electronic device and a second electronic device, and the first electronic device is a folding screen device: when the first electronic device establishes a multi-screen collaborative connection with the second electronic device, the multi-screen collaborative APP in the first electronic device will notify the dynamic wallpaper APP in a broadcast form-the first electronic device establishes a multi-screen collaborative connection. When the folding angle of the first electronic device changes (for example, from a first angle to a second angle), the display screen of the first electronic device stops playing the dynamic wallpaper's motion video, that is, statically displays the last image frame played in the motion video. When the first electronic device disconnects the multi-screen collaborative connection with the second electronic device, the multi-screen collaborative APP in the first electronic device will notify the dynamic wallpaper APP in a broadcast form-the first electronic device disconnects the multi-screen collaborative connection. When the folding angle of the first electronic device changes (for example, from a first angle to a second angle), the display screen of the first electronic device plays the dynamic wallpaper's motion video.
[0112] Specifically, the wallpaper display method provided in the embodiment of the present application is executed by a first electronic device (such as a mobile phone) that performs multi-screen collaboration with a second electronic device (such as a PC). As shown in Figure 9, the method includes: S301-S315. Among them, S301-S311 is the display process of the dynamic effect video of the dynamic wallpaper, and S312-S315 is the update process of the multi-screen collaboration flag. The execution of S301-S311 and the execution of S312-S315 are independent of each other, and there is no requirement for the order of sequence in terms of timing. For example, S301-S311 can be executed first, and then S312-S315, or S312-S315 can be executed first, and then S301-S311.
[0113] S301. The dynamic wallpaper APP registers with the sensor manager (SensorManager) to monitor angle sensor events through the sensor event listener (SensorEventListener).
[0114] This step refers to step S101 and will not be described again here.
[0115] S302. When the angle sensor detects that the folding angle of the first electronic device changes (for example, from the first angle to the second angle), the angle sensor drives the sensor manager (SensorManager) to send the folding angle of the first electronic device (ie, the second angle).
[0116] This step refers to step S102 and will not be described again here.
[0117] S303. The sensor manager (SensorManager) sends the folding angle (ie, the second angle) of the first electronic device to the dynamic wallpaper APP through the sensor data change (onSensorChanged) function.
[0118] S304. When the multi-screen collaboration flag is invalid (i.e., the multi-screen collaboration flag indicates that the multi-screen collaboration connection has been disconnected), execute S305-S311. When the multi-screen collaboration flag is valid (i.e., the multi-screen collaboration flag indicates that the multi-screen collaboration connection has been established), do not execute S305-S311, that is, the first electronic device does not play the dynamic wallpaper's dynamic effect video on the display screen, but displays a static image.
[0119] The multi-screen collaboration flag is used to indicate that the first electronic device establishes or disconnects a multi-screen collaboration connection. Exemplarily, the multi-screen collaboration flag is valid (for example, the multi-screen collaboration flag is TRUE to indicate validity, exemplarily, IsRecording = TRUE), indicating that the first electronic device establishes a multi-screen collaboration connection, and the multi-screen collaboration flag is invalid (for example, the multi-screen collaboration flag is FALSE to indicate validity, exemplarily, IsRecording = FALSE), indicating that the first electronic device disconnects the multi-screen collaboration connection. By default, the multi-screen collaboration flag is invalid. For updates to the multi-screen collaboration flag, refer to steps S312-S314.
[0120] The first electronic device displays a static image on the display screen, which means that no matter how the folding angle of the first electronic device changes, the wallpaper displayed on the display screen of the first electronic device is static. For example, the last image frame of the dynamic effect video is continuously displayed, or if the display screen has played the 10th image frame of the dynamic effect video, the 10th image frame is continuously displayed. In this way, the media codec will not be initialized and the macroblocks will not be occupied, which will not lead to the situation of insufficient macroblocks, and avoid the flickering black screen caused by the dynamic wallpaper APP playing the dynamic effect video in the multi-screen collaboration scenario.
[0121] S305: When the change in the folding angle of the first electronic device is less than a threshold value (eg, 2 degrees), the dynamic wallpaper APP discards the folding angle of the first electronic device detected this time (ie, the second angle).
[0122] This step refers to step S104 and will not be described again here.
[0123] S306. When the change in the folding angle of the first electronic device is greater than or equal to the threshold, the dynamic wallpaper APP calculates the timestamp of the dynamic effect video corresponding to the folding angle based on the second angle of the display screen and the total duration of the dynamic wallpaper's dynamic effect video.
[0124] That is to say, when the multi-screen collaboration flag is invalid and the change in the folding angle of the first electronic device is greater than or equal to the threshold, the display screen of the first electronic device plays the dynamic wallpaper's motion effect video.
[0125] The rest of the steps are referred to step S105 and will not be described again here.
[0126] S307. The dynamic wallpaper APP initializes the media codec (MediaCodec) and sends the dynamic effect video to the media codec (MediaCodec) by setting the data source (setDataSource) function.
[0127] This step refers to step S106 and will not be described again here.
[0128] S308. The media codec (MediaCodec) decodes the motion effect video to obtain all image frames.
[0129] This step refers to step S107 and will not be described again here.
[0130] S309. The dynamic wallpaper APP sends the timestamp of the dynamic effect video corresponding to the second angle to the media codec (MediaCodec) by calling the seekTo function of the media codec (MediaCodec).
[0131] S310 , the media codec (MediaCodec) sends the target image frame to the rendering service (SurfaceFlinger) through the surface texture (SurfaceTexture).
[0132] This step refers to step S109 and will not be described again here.
[0133] S311. The drawing rendering service (SurfaceFlinger) renders the received target image frame, and controls the display screen to display the target image frames in ascending order of timestamps through the display screen driver, thereby displaying the dynamic effect video of the dynamic wallpaper.
[0134] Optionally, when the first electronic device establishes and disconnects a multi-screen collaborative connection with the second electronic device, a process for setting a multi-screen collaborative flag is described as follows:
[0135] S312. When the first electronic device establishes a multi-screen collaborative connection with the second electronic device, the multi-screen collaborative APP of the first electronic device sends a first indication message to the dynamic wallpaper APP of the first electronic device, where the first indication message is used to indicate that the multi-screen collaborative connection has been established.
[0136] When the first electronic device establishes a multi-screen collaborative connection with the second electronic device, the multi-screen collaborative APP can send the first indication information to the dynamic wallpaper APP in the form of a broadcast message by calling the sendBroadcast function.
[0137] The triggering method for the first electronic device and the second electronic device to establish a multi-screen collaborative connection may include: the first electronic device and the second electronic device both turn on Bluetooth or WiFi, and the first electronic device and the second electronic device establish a communication connection via Bluetooth or WiFi. As shown in FIG10 , the first electronic device and the second electronic device both pop up a dialog box prompting whether to perform multi-screen collaboration, and the user clicks confirmation in the dialog boxes of the first electronic device (such as mobile phone 110) and the second electronic device (such as PC 120), and the first electronic device and the second electronic device can establish a multi-screen collaborative connection. Alternatively, the first electronic device and the second electronic device are connected via a USB cable. As shown in FIG10 , the first electronic device and the second electronic device both pop up a dialog box prompting whether to perform multi-screen collaboration, and the user clicks the confirmation button in the dialog boxes of the first electronic device and the second electronic device, and the first electronic device and the second electronic device can establish a multi-screen collaborative connection.
[0138] S313. After receiving the first indication information, the dynamic wallpaper APP sets the multi-screen collaboration flag to be valid based on the first indication information (that is, the multi-screen collaboration flag indicates that a multi-screen collaboration connection has been established).
[0139] The dynamic wallpaper app can receive broadcast messages from the multi-screen collaboration app through the BroadcastReceiver function.
[0140] S314. When the first electronic device disconnects the multi-screen collaborative connection from the second electronic device, the multi-screen collaborative APP of the first electronic device sends a second indication message to the dynamic wallpaper APP of the first electronic device, where the second indication message is used to indicate that the multi-screen collaborative connection has been disconnected.
[0141] When the first electronic device disconnects the multi-screen collaborative connection with the second electronic device, the multi-screen collaborative APP can send the second indication information to the dynamic wallpaper APP in the form of a broadcast message by using the sendBroadcast function.
[0142] The triggering method for the first electronic device to disconnect the multi-screen collaborative connection with the second electronic device may include: as shown in Figure 11, the user clicks the stop collaboration button in the first electronic device (such as mobile phone 110) or the second electronic device (such as PC 120).
[0143] S315. After receiving the second indication information, the dynamic wallpaper APP sets the multi-screen collaboration flag to invalid based on the second indication information (that is, the multi-screen collaboration flag indicates that the multi-screen collaboration connection has been disconnected).
[0144] In summary, as shown in FIG12 , the present embodiment provides another wallpaper display method, including S401-S404. The execution of S401-S402 is independent of the execution of S403-S404, and there is no requirement for the timing sequence. For example, S401-S404 can be executed first, followed by S403-S404, or S403-S404 can be executed first, followed by S401-S402.
[0145] S401. At a first time point, a first electronic device establishes a multi-screen collaborative connection with a second electronic device, and the folding angle of the first electronic device is a first angle.
[0146] For example, the first angle is 0 degrees. Regarding the establishment of a multi-screen collaborative connection between the first electronic device and the second electronic device, refer to the relevant description of steps S312 and S313 in Figures 1 and 9. Regarding how to obtain the folding angle of the first electronic device, refer to the relevant description of steps S301-S303 in Figure 9, which will not be repeated here.
[0147] The description about the folding angle of the first electronic device is made with reference to FIG3 , which will not be repeated here.
[0148] S402. At a second time point later than the first time point, the folding angle of the electronic device changes from the first angle to the second angle. During the process of the folding angle of the first electronic device changing from the first angle to the second angle, a multi-screen collaborative connection is established between the first electronic device and the second electronic device, and the first electronic device does not display the animation effect of the wallpaper change.
[0149] For example, the second angle is 180 degrees. The animation effect of wallpaper change can be achieved through the dynamic effect video of the dynamic wallpaper as described above, or can be achieved through the vector change of the static wallpaper.
[0150] Regarding the fact that a multi-screen collaborative connection is established between the first electronic device and the second electronic device and the animation effect of wallpaper change is not displayed, please refer to the relevant description of step S304 in Figure 9 and will not be repeated here.
[0151] S403: At a third time point, the first electronic device disconnects the multi-screen collaborative connection from the second electronic device, and the folding angle of the first electronic device is the first angle.
[0152] Regarding the disconnection of the multi-screen collaborative connection between the first electronic device and the second electronic device, please refer to the relevant description of steps S314 and S315 in Figure 9, which will not be repeated here.
[0153] S404. At a fourth time point later than the third time point, the folding angle of the first electronic device changes from the first angle to the second angle. During the process of the folding angle of the first electronic device changing from the first angle to the second angle, based on the fact that the first electronic device has not established a multi-screen collaborative connection with other electronic devices, the first electronic device displays an animation effect of wallpaper change.
[0154] Regarding the animation effect of the first electronic device displaying the wallpaper change based on the fact that the first electronic device has not established a multi-screen collaborative connection with other electronic devices, please refer to the relevant description of steps S304-S311 in Figure 9 and will not be repeated here.
[0155] The wallpaper display method and electronic device provided in the embodiments of the present application are such that a first electronic device establishes a multi-screen collaborative connection with a second electronic device. When the folding angle of the first electronic device changes, the display screen of the first electronic device does not display the animation effect of the wallpaper change. The first electronic device disconnects the multi-screen collaborative connection from the second electronic device. When the folding angle of the display screen of the first electronic device changes, the first electronic device displays the animation effect of the wallpaper change. That is, the playback of the motion effect video of the multi-screen collaboration and the dynamic wallpaper are mutually exclusive, and the multi-screen collaboration has a higher priority, thereby avoiding the flickering black screen caused by the dynamic wallpaper APP playing the motion effect video in the multi-screen collaboration scenario.
[0156] An embodiment of the present application also provides a computer-readable storage medium, which includes instructions. When the instructions are executed on the above-mentioned electronic device, the electronic device executes each step in the above-mentioned method embodiment, such as executing the method shown in Figures 7-9 and 12.
[0157] An embodiment of the present application also provides a computer program product including instructions. When the instructions are executed on the above-mentioned electronic device, the electronic device executes each step in the above-mentioned method embodiment, for example, executes the method shown in Figures 7-9 and 12.
[0158] Regarding the technical effects of the chip system, computer-readable storage medium, and computer program product, refer to the technical effects of the previous method embodiments.
[0159] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0160] Those skilled in the art will appreciate that the modules and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0161] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and modules described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0162] In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the modules is merely a logical function division. In actual implementation, there may be other division methods, such as multiple modules or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.
[0163] The modules described as separate components may or may not be physically separate, and the components shown as modules may or may not be physical modules, that is, they may be located on a single device or distributed across multiple devices. Some or all of the modules may be selected to achieve the purpose of this embodiment based on actual needs.
[0164] In addition, the functional modules in the various embodiments of the present application may be integrated into one device, or each module may exist physically separately, or two or more modules may be integrated into one device.
[0165] In the above embodiments, all or part of the embodiments may be implemented by software, hardware, firmware, or any combination thereof. When implemented using a software program, all or part of the embodiments may be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more media integrated therein. The available medium may be a magnetic medium (eg, a floppy disk, a hard disk, a magnetic tape), an optical medium (eg, a DVD), or a semiconductor medium (eg, a solid state disk (SSD)).
[0166] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. A wallpaper display method, characterized in that: Applied to a first electronic device, where the first electronic device is a folding screen device; the method includes: At a first time point, the first electronic device establishes a multi-screen collaborative connection with the second electronic device, and the folding angle of the first electronic device is a first angle; At a second time point, the folding angle of the first electronic device changes from the first angle to a second angle. During the process of the folding angle of the first electronic device changing from the first angle to the second angle, based on the establishment of a multi-screen collaborative connection between the first electronic device and the second electronic device, the first electronic device does not display an animation effect of wallpaper change. The second time point is later than the first time point. At a third time point, the first electronic device disconnects the multi-screen collaborative connection with the second electronic device; at the third time point, the folding angle of the first electronic device is the first angle; At a fourth time point, the folding angle of the first electronic device changes from the first angle to the second angle. During the process of the folding angle of the first electronic device changing from the first angle to the second angle, based on the fact that the first electronic device has not established a multi-screen collaborative connection with other electronic devices, the first electronic device displays an animation effect of wallpaper change. The fourth time point is later than the third time point.
2. The method according to claim 1, characterized in that Also includes: When the first electronic device establishes a multi-screen collaborative connection with the second electronic device, the multi-screen collaborative application in the first electronic device sends first indication information to the dynamic wallpaper application in the first electronic device, where the first indication information is used to indicate that the multi-screen collaborative connection has been established; The dynamic wallpaper application sets the multi-screen collaboration flag to be valid based on the first indication information, and when the multi-screen collaboration flag is valid, it is used to indicate that a multi-screen collaboration connection has been established.
3. The method according to claim 2, characterized in that The multi-screen collaborative application in the first electronic device sends first indication information to the dynamic wallpaper application in the first electronic device, including: The multi-screen collaborative application sends the first indication information to the dynamic wallpaper application via a broadcast message.
4. The method according to claim 2 or 3, characterized in that: Also includes: When the first electronic device disconnects the multi-screen collaborative connection from the second electronic device, the multi-screen collaborative application sends second indication information to the dynamic wallpaper application, where the second indication information is used to indicate that the multi-screen collaborative connection has been disconnected; The dynamic wallpaper application sets the multi-screen collaboration flag to invalid based on the second indication information, and when the multi-screen collaboration flag is invalid, it is used to instruct the first electronic device to disconnect the multi-screen collaboration connection.
5. The method according to claim 4, characterized in that The multi-screen collaborative application sends second indication information to the dynamic wallpaper application, including: The multi-screen collaborative application sends the second indication information to the dynamic wallpaper application via a broadcast message.
6. The method according to claim 4 or 5, characterized in that: The method of establishing a multi-screen collaborative connection between the first electronic device and the second electronic device, wherein the first electronic device displays an animation effect of wallpaper change, includes: The first electronic device determines that the multi-screen collaboration flag is invalid, and the change in the folding angle of the first electronic device is greater than or equal to a threshold, the display screen of the first electronic device plays a dynamic wallpaper's motion effect video, and the change in the folding angle is equal to the absolute value of the difference between the first angle and the second angle.
7. The method according to claim 6, characterized in that The display screen of the first electronic device plays a dynamic effect video of a dynamic wallpaper, including: The dynamic wallpaper application calculates a timestamp of the motion effect video corresponding to the second angle based on the second angle and the total duration of the motion effect video; The dynamic wallpaper application sends the dynamic effect video and the timestamp corresponding to the second angle to the media codec in the first electronic device; The media codec decodes the motion effect video to obtain all image frames, and sends target image frames to the drawing rendering service, where the target image frames include image frames from the played timestamp to the timestamp corresponding to the second angle among all the image frames; The drawing and rendering service renders and draws the received target image frames, and controls the display screen to display the target image frames in ascending order of timestamps through a display screen driver in the first electronic device.
8. The method according to claim 2 or 3, characterized in that: The method of establishing a multi-screen collaborative connection between the first electronic device and the second electronic device, wherein the first electronic device does not display an animation effect of wallpaper change, includes: The first electronic device determines that the multi-screen collaboration flag is valid, and the first electronic device displays a static image on the display screen.
9. An electronic device, characterized in that: It includes a display screen, a processor and a memory, wherein the memory stores instructions. When the processor executes the instructions, it executes the method described in any one of claims 1 to 8 to control the display screen to display the dynamic effect video of the dynamic wallpaper.
10. A computer-readable storage medium, characterized in that: The method comprises instructions, which, when executed on an electronic device, cause the electronic device to execute the method according to any one of claims 1 to 8.
Citation Information
Patent Citations
Display control method and device
CN110515576A
Display method, intelligent terminal and storage medium
CN114706549A
Dynamic wallpaper display method and related equipment
CN116414328A
Tent installation device for vehicle
KR102452498B1
Method for displaying linkage animation, and related apparatus
WO2023093664A1