Method of displaying dynamic wallpaper and electronic device
By responding to user operations and actions on the external screen of the small foldable phone and utilizing heat dissipation and gravity sensing technologies, rich dynamic wallpapers can be displayed, solving the problem of poor wallpaper display effects on the external screen and improving the user experience and fun.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- HONOR DEVICE CO LTD
- Filing Date
- 2024-06-12
- Publication Date
- 2026-07-14
AI Technical Summary
The wallpaper display on the outer screen of the small folding phone is not good, resulting in a poor user experience.
By responding to user interactions and actions, it achieves rich dynamic wallpaper display effects and plays multiple videos related to the same target object using heat zone and gravity sensing technology.
It improves the user experience and increases the fun and interactivity of electronic devices.
Smart Images

Figure CN122387347A_ABST
Abstract
Description
[0001] This application is a divisional application of Chinese patent application filed on June 12, 2024, with application number 202410761010.0 and title "Method and Electronic Device for Displaying Live Wallpaper". Technical Field
[0002] This application relates to the field of terminals, and more specifically, to a method and electronic device for displaying live wallpapers. Background Technology
[0003] Wallpapers on electronic devices often reflect the user's aesthetic preferences; different users can set different wallpapers based on their interests to meet their individual needs for wallpaper display effects. Currently, electronic devices offer static wallpapers, live wallpapers, and other options for users to choose from, and users can also use custom images such as photos as wallpapers.
[0004] However, taking a small foldable phone as an example, the wallpaper display on the outer screen is not good, resulting in a poor user experience. Summary of the Invention
[0005] This application provides a method and electronic device for displaying live wallpapers, which can achieve rich live wallpaper display effects through user interaction and improve the user experience.
[0006] In a first aspect, a method for displaying a live wallpaper is provided, applied to an electronic device, comprising: in response to a first operation, applying a first theme, the first theme having corresponding video resources, the video resources including a lock screen wallpaper and multiple video segments; After applying the first theme, a lock screen is displayed, which includes the lock screen wallpaper; In response to a second operation performed on the lock screen interface, the first video among the multiple video segments is displayed; In response to a third operation applied to the lock screen interface, a second video among the multiple video segments is displayed. The third operation is in a different position than the second operation, the second video is different from the first video, and the second video, the lock screen wallpaper, and the first video all share the same target object.
[0007] For example, the target object can be Figure 12 The cat shown is an example. For instance, performing an action on the lock screen can play a first video related to the cat, and performing a second action on the lock screen can play a second video related to the same cat. The cat's actions are different in the first and second videos.
[0008] In this embodiment, by performing two operations on different locations on the lock screen, the user can trigger the electronic device to play two different videos related to the same target object, thereby achieving rich display effects and increasing the fun of using the electronic device.
[0009] It should be understood that the third operation can be in the same location as the second operation. This is equivalent to a user performing two operations on the same location, but playing different videos.
[0010] In conjunction with the first aspect, in some implementations of the first aspect, the video resource further includes at least one hot zone and a first correspondence between the at least one hot zone and the video. After responding to a second operation applied to the lock screen interface, the method further includes: determining that the second operation triggers a fall into the first hot zone; and, based on the first correspondence, determining the first video corresponding to the first hot zone from the video resource.
[0011] It should be understood that a hot zone is a localized area of the screen of an electronic device.
[0012] In this embodiment of the application, the screen of the electronic device is equivalent to having at least one hot zone. At this time, the video resource, by including at least one hot zone and a first correspondence between at least one hot zone and the video, can determine the video corresponding to the hot zone for playback when the user operates on the hot zone. In other words, the user can play the video corresponding to the hot zone by triggering the hot zone.
[0013] In conjunction with the first aspect, in some implementations of the first aspect, determining that the second operation triggers falling into the first hot zone includes: determining the first coordinates corresponding to the second operation; and determining that the first coordinates belong to the coordinate range of the first hot zone, then determining that the second operation triggers falling into the first hot zone.
[0014] In this embodiment of the application, the user-triggered hot zone can be determined by determining the range of hot zone coordinates in which the user's operation falls.
[0015] In conjunction with the first aspect, in some implementations of the first aspect, after responding to the third operation acting on the screen lock, the method further includes: determining that the third operation trigger falls into the second hot zone; and, based on the first correspondence, determining the second video corresponding to the second hot zone from the video resources, wherein the second hot zone is the same as or different from the first hot zone.
[0016] It should be understood that the first and second hot zones can be the same, indicating that the second and third operations click on different positions within the same hot zone, playing different video segments each time. Conversely, if the first and second hot zones are different, it means that the second and third operations click on different hot zones, playing different video segments each time.
[0017] In this embodiment, for the same hotspot, a user can operate it twice, playing a different video each time. This is equivalent to a one-to-many correspondence between one hotspot and two videos. Similarly, for two different hotspots, a user can also operate it twice, playing a different video each time. This is equivalent to a one-to-one correspondence between the two hotspots and two videos.
[0018] In conjunction with the first aspect, in some implementations of the first aspect, the lock screen wallpaper includes one or more local areas of the target object corresponding to one or more hot zones.
[0019] In this embodiment of the application, the target object can be Figure 13 The cat shown is, as Figure 13 As shown, a local area of a cat can correspond to one or more hot zones, or multiple local areas can correspond to one or more hot zones.
[0020] In conjunction with the first aspect, in some implementations of the first aspect, the target object included in the lock screen wallpaper is a grid image, and each grid in the grid image corresponds to a hot zone.
[0021] In this embodiment of the application, the target object can be Figure 14 The nine-square grid image shown is as follows: Figure 14 As shown, a local area of a cat can correspond to one or more hot zones, or multiple local areas can correspond to one or more hot zones.
[0022] In conjunction with the first aspect, in some implementations of the first aspect, the first correspondence relationship includes at least a hot zone identifier, a first video segment identifier, and a correspondence relationship between the hot zone identifier and the first video segment identifier; wherein, the hot zone identifier is used to indicate the hot zone, and the first video segment identifier is used to indicate a portion of the multiple video segments.
[0023] For example, the first correspondence is shown in Table 1.
[0024] In this embodiment of the application, by querying the first correspondence shown in Table 1, the corresponding first video segment identifier can be found based on the hot zone identifier of the hot zone, and then the associated video can be determined based on the first video segment identifier.
[0025] In conjunction with the first aspect, in some implementations of the first aspect, after displaying the lock screen interface, the method further includes: in response to a first action of the electronic device, displaying a third video among the multiple video segments; in response to a second action of the electronic device, displaying a fourth video among the multiple video segments, wherein the first action is different from the second action, the fourth video is different from the third video, and both the fourth video and the third video include the target object.
[0026] Actions of electronic devices may include: tilting left, tilting right, shaking to the upper left, shaking to the upper right, shaking to the lower left, shaking to the lower right, moving forward or backward in a direction perpendicular to the screen.
[0027] The first action and the second action are either of the aforementioned actions of the electronic device.
[0028] For example, the target object can Figure 16 The dial shown is Figure 17 The cluster of bubbles shown in the image, or, for Figure 18 The polar bear shown in the picture.
[0029] In this embodiment of the application, the electronic device can trigger the playback of two different videos related to the same target object by performing two actions, so as to achieve rich display effects and increase the fun of using the electronic device.
[0030] In conjunction with the first aspect, in some implementations of the first aspect, the video resource further includes at least one gravity sensing type, and a second correspondence between the at least one gravity sensing type and the video; in response to the first action of the electronic device, the method further includes: determining that the gravity sensing type corresponding to the first action of the electronic device is a first gravity sensing type; and based on the second correspondence, determining a third video corresponding to the first gravity sensing type from the video resource.
[0031] In this embodiment, the gravity sensing type corresponds one-to-one with the electronic device's action. The gravity sensing type may include: tilting left, tilting right, rocking to the upper left, rocking to the upper right, rocking to the lower left, rocking to the lower right, moving forward in a direction perpendicular to the screen, or moving backward in a direction perpendicular to the screen.
[0032] In this embodiment of the application, the video resource includes at least one gravity sensing type and at least one second correspondence between the gravity sensing type and the video. When the electronic device performs an action, the video corresponding to the gravity sensing type corresponding to the action of the electronic device can be determined and played. In other words, the action of the electronic device can realize the playback of the video corresponding to the corresponding gravity sensing.
[0033] In conjunction with the first aspect, in some implementations of the first aspect, the electronic device includes a sensor; determining the gravity sensing type corresponding to the first action of the electronic device as a first gravity sensing type includes: determining the first sensor data corresponding to the first action of the electronic device; determining that the first sensor data belongs to the sensor data range of the first gravity sensing type, then determining the gravity sensing type corresponding to the first action of the electronic device as the first gravity sensing type.
[0034] In this embodiment of the application, by determining the range of sensor data that the sensor data falls into when the electronic device is in motion, the gravity sensing type of the electronic device can be determined.
[0035] In conjunction with the first aspect, in some implementations of the first aspect, the gravity sensing type includes at least one of: tilting left, tilting right, rocking to the upper left, rocking to the upper right, rocking to the lower left, rocking to the lower right, moving forward in a direction perpendicular to the screen, or moving backward in a direction perpendicular to the screen.
[0036] In conjunction with the first aspect, in some implementations of the first aspect, when the first operation is received during the process of displaying the third video on the lock screen interface, the method further includes: continuing to display the third video and not displaying the first video; or, stopping the display of the third video and switching to displaying the first video.
[0037] In this embodiment of the application, when a user's operation on the lock screen is received during the playback of the corresponding video based on the action of the electronic device, the user can choose not to interrupt and continue playing the currently playing video according to the preset playback rules, or the user can choose to interrupt the current video and play the video determined according to the user's operation.
[0038] In conjunction with the first aspect, in some implementations of the first aspect, when the electronic device performs the first action while displaying the first video on the lock screen interface, the method further includes: continuing to display the first video and not displaying the third video; or, stopping the display of the first video and switching to displaying the third video.
[0039] In this embodiment of the application, when a user's operation on the lock screen is received and the electronic device switches actions during the playback of the corresponding video, it can choose not to interrupt and continue playing the currently playing video according to preset playback rules, or it can choose to interrupt the current video and play the video determined according to the actions of the electronic device.
[0040] In conjunction with the first aspect, in some implementations of the first aspect, when the first operation is received and the electronic device performs an action, the method further includes: selecting one video from the first video and the third video and displaying it on the lock screen interface based on a preset display priority.
[0041] In this embodiment of the application, when both user operations on the lock screen and actions generated by the electronic device are received simultaneously, either of the two corresponding videos can be selected for playback based on a preset playback priority.
[0042] In conjunction with the first aspect, in some implementations of the first aspect, the second correspondence includes at least a gravity sensing type, a second video segment identifier, and a correspondence between the gravity sensing type and the second video segment identifier; wherein the second video segment identifier is used to indicate a portion of the multiple video segments.
[0043] For example, the second correspondence is shown in Table 2.
[0044] In this embodiment of the application, by querying the second correspondence shown in Table 2, the corresponding second video segment identifier can be found according to the gravity sensing type corresponding to the action of the electronic device, and then the associated video can be determined according to the second video segment identifier.
[0045] In conjunction with the first aspect, in some implementations of the first aspect, the method further includes: the display order of the first video and the second video is the same as the order in which the first video and the second video are set in the video resource, or the display order of the first video and the second video is random.
[0046] In this embodiment of the application, the positions of the third operation and the second operation can be different or the same. Therefore, when the positions of the third operation and the second operation are different or the same, the display order of the first video and the second video can also be the same as the order in which the first video and the second video are set in the video resource, or the display order of the first video and the second video can be randomized.
[0047] In conjunction with the first aspect, in some implementations of the first aspect, where the third operation is in a different or the same position as the second operation, and the second hot zone is the same as the first hot zone, the method further includes: the display order of the first video and the second video is the same as the order in which the first video and the second video are set in the video resource, or the display order of the first video and the second video is random.
[0048] In this embodiment of the application, without configuring hot zones, when a user performs two operations on the lock screen interface at different locations, or performs two operations on the lock screen interface at the same location, the electronic device can be triggered to play two different videos related to the same target object. The playback order of the two videos can be sequential or random.
[0049] When hotspots are configured, if a user performs two actions on the same hotspot on the lock screen—either at different locations or at the same location—it can trigger the electronic device to play two different videos related to the same target object. The playback order of these two videos can be sequential or random. Here, regardless of whether the locations are the same, it's equivalent to both actions triggering the same hotspot. This hotspot corresponds to both videos.
[0050] In conjunction with the first aspect, in some implementations of the first aspect, responding to a third operation applied to the lock screen interface and playing the second video among the multiple video segments includes: responding to a third operation applied to the lock screen interface and playing the second video among the multiple video segments; after playing the second video, continuing to play the fifth video among the multiple video segments; The fifth video is different from the first video and the second video, and the fifth video includes the target object.
[0051] In this embodiment of the application, regardless of whether a hot zone is configured, triggering an operation on the lock screen interface or triggering an operation on a hot zone can play multiple video segments that include the same target object.
[0052] In conjunction with the first aspect, in some implementations of the first aspect, the playback order of the second video and the fifth video is the same as the order in which the second video and the fifth video are set in the video resource; or, the playback order of the second video and the fifth video is random playback.
[0053] In this embodiment, regardless of whether a hotspot is configured, triggering an operation on the lock screen or a hotspot can play multiple video segments containing the same target object. In this case, the playback order of the multiple video segments can be sequential or random.
[0054] In conjunction with the first aspect, in some implementations of the first aspect, the first operation, the second operation, and the third operation are all click operations.
[0055] In the embodiments of this application, all user actions that trigger the lock screen interface are click operations.
[0056] In conjunction with the first aspect, in some implementations of the first aspect, the multiple video segments belong to the same file, and the last frame of the preceding video segment and the first frame of the following video segment are adjacent to each other.
[0057] In this embodiment of the application, multiple video segments are different segments of a single video, and the multiple video segments are connected sequentially from beginning to end.
[0058] The file containing multiple video segments can be in MOV format.
[0059] In conjunction with the first aspect, in some implementations of the first aspect, the lock screen interface includes: the interface displayed by the electronic device when the screen is locked and on, and the interface that remains after the screen is on and unlocked but before entering the desktop.
[0060] In this embodiment of the application, the lock screen interface can be Figure 4 (b) and Figure 4 The interface shown in (c) is shown in the image.
[0061] In conjunction with the first aspect, in some implementations of the first aspect, the electronic device is a foldable screen, the screen of the electronic device is the outer screen of the foldable screen, and the above-mentioned display steps are performed on the outer screen of the foldable screen.
[0062] In the embodiments of this application, the methods for displaying live wallpapers can all be applied to the outer screen of small foldable phones to improve the user's interactive experience.
[0063] Secondly, an electronic device is provided, comprising one or more processors and a memory; the memory is coupled to the one or more processors, the memory storing computer program code including computer instructions, and the one or more processors calling the computer instructions to cause the electronic device to perform: in response to a first operation, applying a first theme, the first theme having corresponding video resources, the video resources including a lock screen wallpaper and multiple video segments; after applying the first theme, displaying a lock screen interface including a lock screen wallpaper; in response to a second operation acting on the lock screen interface, playing a first video among the multiple video segments; in response to a third operation acting on the lock screen interface, playing a second video among the multiple video segments, the third operation being in a different position than the second operation, the second video being different from the first video, and the second video, the lock screen wallpaper, and the first video all belonging to the same target object. This application can achieve rich dynamic wallpaper display effects through user interaction, improving the user experience.
[0064] Thirdly, an electronic device is provided, including a module / unit for performing the method of displaying a live wallpaper in the first aspect or any implementation thereof.
[0065] Fourthly, an electronic device is provided, the electronic device including one or more processors and a memory; the memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, and the one or more processors calling the computer instructions to cause the electronic device to perform the method of displaying a live wallpaper in the first aspect or any implementation thereof.
[0066] Fifthly, a chip system is provided, the chip system being applied to an electronic device, the chip system including one or more processors, the processors being configured to invoke computer instructions to cause the electronic device to perform the method of displaying a live wallpaper as described in the first aspect or any of the first aspects.
[0067] In a sixth aspect, a computer-readable storage medium is provided, the computer-readable storage medium storing computer program code, which, when executed by an electronic device, causes the electronic device to perform the method of displaying a live wallpaper as described in the first aspect or any implementation thereof.
[0068] In a seventh aspect, a computer program product is provided, the computer program product comprising: computer program code, which, when executed by an electronic device, causes the electronic device to perform the method of displaying a live wallpaper as described in the first aspect or any implementation thereof. Attached Figure Description
[0069] Figure 1 This is a schematic diagram of a hardware system for an electronic device applicable to this application; Figure 2 A schematic diagram of a small foldable screen phone is shown; Figure 3 A schematic diagram of the display area of the outer screen of the small folding mobile phone provided in an embodiment of this application is shown; Figure 4 This application illustrates the display interface related to the outer screen of the small folding phone provided in an embodiment of the present application; Figure 5 This is a schematic diagram of a software system applicable to an electronic device of this application; Figure 6 This is a schematic diagram of the structure of another software system provided in an embodiment of this application; Figure 7 This is a schematic flowchart illustrating a method for displaying a live wallpaper according to an embodiment of this application; Figure 8 This is a schematic flowchart illustrating another method for displaying live wallpapers provided in an embodiment of this application; Figure 9This is a schematic diagram of an interface that plays video segments in response to click operations without the configuration of a hot zone and gravity sensor. Figure 10 yes Figure 9 Example of a video segment being played; Figure 11 This is a schematic flowchart illustrating another method for displaying live wallpapers provided in an embodiment of this application; Figure 12 This is a schematic diagram of an interface that plays video segments in response to click operations when a hot zone is configured but a gravity sensor is not configured. Figure 13 This is a diagram showing the correspondence between hot zones and video segments; Figure 14 This is another diagram showing the correspondence between hot zones and video segments.
[0070] Figure 15 This is a schematic flowchart illustrating a method for displaying a live wallpaper according to an embodiment of this application; Figure 16 This is a schematic diagram of a video segment playback interface that responds to tilt operations when a gravity sensor is configured but a hot zone is not configured. Figure 17 This is a schematic diagram of a video segment playback interface that responds to shaking operations when a gravity sensor is configured but a hot zone is not configured. Figure 18 This is a schematic diagram of a video segment playback interface in response to vertical movement, provided that a gravity sensor is configured but a hot zone is not configured. Figures 19A to 19E These are schematic interactive diagrams illustrating various methods for displaying live wallpapers provided in embodiments of this application; Figure 20 and Figure 21 This is a schematic diagram of a setting for the screen to remain on the lock screen after the external screen is unlocked, provided in an embodiment of this application. Figure 22 and Figure 23 This is a schematic diagram of the interface for switching lock screen themes provided in an embodiment of this application; Figure 24 This application provides another display interface related to the outer screen of a small folding mobile phone. Figure 25 This is a schematic flowchart illustrating a method for displaying a live wallpaper according to an embodiment of this application. Detailed Implementation
[0071] In the embodiments of this application, the terms "first," "second," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this embodiment, unless otherwise stated, "multiple" means two or more.
[0072] It should also be understood that the term “comprising” (also referred to as “inlockudes”, “inlockuding”, “comprises” and / or “comprising”) as used in this specification specifies the presence of the stated features, integers, steps, operations, elements, and / or components, but does not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.
[0073] To facilitate understanding of the embodiments of this application, the relevant terms involved in the embodiments of this application will be briefly explained first.
[0074] 1. System applications and third-party applications: System applications refer to applications directly provided by the operating system of an electronic device to achieve specific functions. Third-party applications refer to applications provided by other developers and obtained by the electronic device via the Internet to achieve specific functions. In the embodiments of this application, the application providing the user interface can be either a system application or a third-party application.
[0075] 2. Widgets: A widget is an information carrier that provides important or user-relevant information in a concise and intuitive way. Widgets can be displayed on the screen of an electronic device, such as the desktop or lock screen. Widgets can include weather information, sports information, health information, date, clock indicators, artistic fonts, etc.
[0076] For example, a clock indicator can be displayed on both the lock screen and the home screen to show time information. When the clock indicator is displayed on the home screen, clicking it will switch the electronic device to the main interface of the corresponding clock application. Of course, a widget can provide information related to one application or combine information from multiple applications. For instance, a widget combining the date and clock indicator can be displayed on the lock screen; a widget combining the date, clock indicator, and weather can be displayed on the home screen.
[0077] Widgets can be displayed in the form of cards, plain text, or other forms. For example, a clock indicator can be displayed in the form of cards, plain text, or a clock face. This application does not limit this.
[0078] The content displayed in the widget includes, but is not limited to, text, numbers, images, music, and videos. This application embodiment does not limit the content displayed in the widget.
[0079] 3. Wallpaper: 1) According to the application scenario, wallpapers can include always-on wallpapers, lock screen wallpapers, and desktop wallpapers. Always-on wallpapers refer to the wallpapers displayed on the always-on screen, lock screen wallpapers refer to the wallpapers displayed on the lock screen, and desktop wallpapers refer to the wallpapers displayed on the desktop.
[0080] Always-on display (AOD) can be understood as a low-power display state when the screen is off. Normally, when the user turns off the power button, AOD can enter a doze state and display an AOD animation, also known as video. If the user does not activate the display for a period of time, AOD can be hidden.
[0081] In this application embodiment, the main focus is on lock screen wallpapers applied to the lock screen interface.
[0082] 2) Based on visual effects, wallpapers can be categorized into flat wallpapers and depth-of-field wallpapers. Flat wallpapers are also known as two-dimensional (2D) wallpapers, while depth-of-field wallpapers are also known as three-dimensional (3D) wallpapers. Compared to flat wallpapers, depth-of-field wallpapers can include foreground and background objects, which can make the image appear more three-dimensional and realistic, providing users with a cooler visual experience. Specifically, when a depth-of-field wallpaper is applied to a lock screen, the foreground object refers to an object or layer in front of the main subject and relatively close to it, such as a person or the layer containing the person; the background object refers to an object or layer behind the main subject and relatively far away, such as trees, buildings, or the layers containing trees and / or buildings.
[0083] 3) Based on the motion effect of the wallpaper, wallpapers can be divided into static wallpapers and live wallpapers. Static wallpapers are static images, while live wallpapers are dynamic videos, dynamic video frame intervals, or animations.
[0084] In this application embodiment, the main focus is on live wallpapers.
[0085] 4. Hot Zone: A hot zone refers to a touch area on the screen with a fixed shape and size.
[0086] The above is a brief introduction to the terms used in the embodiments of this application, and will not be repeated below.
[0087] The method and electronic device for displaying live wallpapers provided in the embodiments of this application will now be described with reference to the accompanying drawings.
[0088] Figure 1 A hardware system for an electronic device applicable to this application is shown.
[0089] Electronic device 100 can be a mobile phone, smart screen, tablet computer, wearable electronic device, in-vehicle electronic device, augmented reality (AR) device, virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA), projector, etc. This application embodiment does not limit the specific type of electronic device 100. For example, electronic device 100 is a foldable screen phone.
[0090] Electronic device 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0091] It should be noted that, Figure 1 The structure shown does not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include... Figure 1 The components shown may include more or fewer components, or the electronic device 100 may include... Figure 1 The components shown may be a combination of certain components, or the electronic device 100 may include... Figure 1 Sub-components of some of the components shown. Figure 1 The components shown can be implemented in hardware, software, or a combination of software and hardware.
[0092] Processor 110 may include one or more processing units. For example, processor 110 may include at least one of the following processing units: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and neural network processing unit (NPU). These different processing units may be independent devices or integrated devices. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution.
[0093] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0094] In some embodiments, processor 110 may include one or more interfaces. For example, processor 110 may include at least one of the following interfaces: an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM interface, and a USB interface.
[0095] For example, in an embodiment of this application, the processor 110 can be used to execute the method for displaying a live wallpaper provided in the embodiment of this application; for example, in response to a first operation, a first theme is applied, the first theme has corresponding video resources, the video resources include a lock screen wallpaper and multiple video segments; after applying the first theme, a lock screen interface is displayed, the lock screen interface includes a lock screen wallpaper; in response to a second operation applied to the lock screen interface, a first video among the multiple video segments is played; in response to a third operation applied to the lock screen interface, a second video among the multiple video segments is played, the third operation is in a different position than the second operation, the second video is different from the first video, and the second video, the lock screen wallpaper, and the first video include the same target object.
[0096] Figure 1 The connection relationships between the modules shown are merely illustrative and do not constitute a limitation on the connection relationships between the modules of the electronic device 100. Optionally, the modules of the electronic device 100 may also adopt a combination of various connection methods described in the above embodiments.
[0097] The wireless communication function of electronic device 100 can be realized through devices such as antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.
[0098] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0099] Electronic device 100 can implement display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0100] Display screen 194 can be used to display images or videos.
[0101] Optionally, the display screen 194 can be used to display images or videos. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a mini light-emitting diode (Mini LED), a micro light-emitting diode (Micro LED), a micro OLED, or a quantum dot light-emitting diode (QLED). In some embodiments, the electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.
[0102] For example, in an embodiment of this application, the display screen 194 can display a lock screen wallpaper and a desktop wallpaper. The lock screen wallpaper displayed on the display screen can be a flat wallpaper or a depth-of-field wallpaper.
[0103] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display screen 194 and application processor.
[0104] The ISP is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is sent through the camera to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element sends the electrical signal to the ISP for processing, converting it into an image visible to the naked eye. The ISP can perform algorithmic optimization of image noise, brightness, and color. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.
[0105] The camera 193 (also known as a lens) is used to capture still images or videos. It can be activated via application commands to enable photo-taking, such as capturing images of any scene. The camera may include components such as an imaging lens, filters, and an image sensor. Light emitted or reflected by an object enters the imaging lens, passes through the filter, and finally converges onto the image sensor. The imaging lens is primarily used to converge and image the light emitted or reflected by all objects within the shooting field of view (also known as the scene to be captured, the target scene, or the scene image the user expects to capture). The filter is primarily used to filter out excess light waves (such as infrared light waves other than visible light). The image sensor can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The image sensor is primarily used to perform photoelectric conversion on the received light signal, converting it into an electrical signal, and then sending the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into standard RGB, YUV, and other image signal formats.
[0106] For example, a digital signal processor is used to process digital signals, including digital image signals and other digital signals. For instance, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform a Fourier transform on the frequency point energy, etc.
[0107] For example, a video codec is used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record video in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.
[0108] For example, the gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 around three axes (i.e., the x-axis, y-axis, and z-axis). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in scenarios such as navigation and motion-sensing games.
[0109] For example, the accelerometer 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (typically the x-axis, y-axis, and z-axis). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. The accelerometer 180E can also be used to identify the attitude of the electronic device 100 as input parameters for applications such as screen orientation switching and pedometers.
[0110] For example, distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, such as in a shooting scenario, electronic device 100 can utilize distance sensor 180F for distance measurement to achieve fast focusing.
[0111] For example, the ambient light sensor 180L is used to sense the ambient light intensity. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the sensed ambient light intensity. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking a picture. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.
[0112] For example, fingerprint sensor 180H is used to collect fingerprints. Electronic device 100 can utilize the collected fingerprint characteristics to perform functions such as unlocking, accessing app locks, taking photos, and answering calls.
[0113] For example, a touch sensor 180K, also known as a touch device, may be disposed on a display screen 194. The touch sensor 180K and the display screen 194 together form a touchscreen, also known as a touch screen. The touch sensor 180K is used to detect touch operations performed on or near it. The touch sensor 180K can send the detected touch operation to an application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 and in a different location from the display screen 194.
[0114] The hardware system of electronic device 100 has been described in detail above.
[0115] Taking an electronic device with the aforementioned hardware system as an example, the electronic device can be a foldable screen device. Specifically, a foldable screen device can be an inward-folding screen device, an outward-folding screen device, or other types of multi-folding devices (such as Z-shaped folding devices). An inward-folding screen device can include two screens, one of which is a foldable screen. When in the unfolded state, this foldable screen is used for display, and when in the folded state, the other screen is used for display. An outward-folding screen device can include one foldable screen. When in the unfolded state, the entire screen is used for display, and when in the folded state, a portion of the screen is used for display.
[0116] The foldable screen device can be either vertically folding or horizontally folding. In a vertically folding device, the folding axis is vertical relative to the device, while in a horizontally folding device, the folding axis is horizontal relative to the device. The specific structure of the foldable screen can be configured as needed, and this application embodiment does not impose any limitations on this.
[0117] In this embodiment of the application, taking a small folding phone that folds inward as an example, the flexible display screen that can fold inward can be referred to as the first display screen; in addition, on the other side opposite to the first display screen, the small folding phone also includes a second display screen.
[0118] The embodiments provided in this application can be applied to inward folding devices or outward folding devices; they can be applied to vertically folding devices or horizontally folding devices; and they can be applied to any screen of a folding device, without limitation by this application. The following embodiments use a second display screen (outer screen) applied to an inwardly folding, horizontally folding device as an example for illustration.
[0119] For example, Figure 2 A schematic diagram of a small folding phone is shown.
[0120] like Figure 2 As shown in (a), the small folding phone is in the unfolded state, with the first display screen 201 unfolded along the horizontal folding axis; this first display screen 201 can also be referred to as the inner screen, and the full-screen area or a partial area of the inner screen can be used for display. Additionally, as... Figure 2 As shown in (b), the small folding phone is in a folded state, with the first display screen 201 attached to each other along the horizontal folding axis; on the side opposite to the first display screen 201, the small folding phone also includes a second display screen 202, which can be referred to as the outer screen, and the full-screen area or a partial area of the outer screen can be used for display.
[0121] like Figure 2 As shown, for either the inner or outer screen, it can be used to display the lock screen when the screen is locked; and for the desktop when the screen is unlocked.
[0122] Optionally, the size of the second display screen is less than or equal to half the size of the inner screen.
[0123] Optionally, when the camera 193 is not an under-display camera, the display area corresponding to the second display screen may not include the area where the camera is located; when the camera 193 is an under-display camera, the display area corresponding to the second display screen may include the area corresponding to the under-display camera.
[0124] Based on the above Figure 2 Taking the small foldable phone introduced as an example, Figure 3 A schematic diagram of the display area of the outer screen of a small foldable phone is shown; Figure 4 The display interface related to the outer screen of the small folding phone is shown.
[0125] Among them, such as Figure 3 As shown in (a), the full-screen area of the outer screen can indicate area A. For example... Figure 3 As shown in (b), the left half of the outer screen can indicate area C, and the right half can indicate area B.
[0126] When an electronic device displays an always-on display (AOD) screen, information such as live wallpapers and the date can be displayed in the full-screen area or a partial area of the outer screen. For example... Figure 4 As shown in (a), a dynamic, swimming fish and a static date can be displayed in the middle of the always-on display 203.
[0127] When an electronic device receives a press of the power button or a double-click on the external screen, the following can be displayed in the full-screen area of the external screen: Figure 4 The lock screen interface 204 shown in (b) is in a locked state, where the lock screen icon is displayed. When the user unlocks the device using fingerprint, password, or facial recognition, and the unlock is successful, the external screen can switch from the lock screen interface to the external screen. Figure 4 As shown in (d) of the diagram, desktop 206 may include a clock, a date widget, multiple application icons, etc.
[0128] Optionally, the full-screen area (Area A) of the outer screen can be used to display the desktop wallpaper, while the desktop content can be divided into two parts. For example, the left half (Area C) can be used to display widgets, and the right half (Area B) can be used to display application icons for multiple applications. Of course, the full-screen area (Area A) of the outer screen can also be used to display desktop content, for example, with the widget centered and near the top edge of the outer screen, and multiple application icons located below the widget. This embodiment of the application does not limit this approach.
[0129] Electronic devices can detect a click on any application icon on the desktop. In response to the click, the content displayed in the left half of the outer screen can remain unchanged or change, while the right half can be used to display the application's running interface; or, the full-screen area of the outer screen can be used to display the application's running interface.
[0130] For example, for system applications, electronic devices can display the relevant interface using the full-screen area; for third-party applications, electronic devices can partition the screen and display the relevant interface using the right half of the screen area. The content displayed in the left half of the screen area can remain unchanged or be changed. This application embodiment does not limit this.
[0131] For example, for a weather application that is part of the system applications, the electronic device can detect a click on the application icon indicating the weather application on the desktop 206, such as... Figure 4 As shown in (d); in response to this click operation, the electronic device displays the weather application's launched interface 207 in full-screen area, as shown in Figure (d). Figure 4 As shown in (e) in the diagram.
[0132] For example, regarding WeChat, which is a third-party application, electronic devices can detect clicks on the WeChat application icon on the desktop 206, such as... Figure 24 As shown in (a); in response to this click operation, the content displayed in the left half of the outer screen can remain unchanged, while the right half can be used to display the main interface of WeChat, as shown in (a). Figure 24 Interface 208 as shown in (b) of the diagram; or, the content displayed in the left half of the outer screen can be changed, for example, the font size, the background color of the left half, the pattern, etc. can be changed, while the right half is used to display the main interface of WeChat, such as... Figure 24 Interface 209 is shown in (c).
[0133] In the above Figure 4 Based on the example, combined with Figure 4 As shown in (b), the lock screen 204 displayed on the outer screen of a small folding phone can typically display either a static wallpaper or a live wallpaper. A static wallpaper is just a static image, which is rather boring; while ordinary live wallpapers can bring a certain sense of liveliness, they are limited by the playback effect of the dynamic video and lack interactivity with the user, making the user experience less enjoyable.
[0134] In view of this, this application provides a new method for displaying live wallpapers, which can be applied to the outer screen of the aforementioned small foldable phone. When the outer screen displays the lock screen interface, it can respond to the user's click operation and play one or more videos corresponding to the theme package in a preset or random order to increase the user's enjoyment when using the electronic device.
[0135] Optionally, when the lock screen is displayed on the external screen, it can also respond to user clicks on different hot zones, displaying one or more different video clips at the corresponding hot zone positions. In this case, the video playing and the playback area on the lock screen change accordingly with the user's click position.
[0136] Optionally, when the lock screen is displayed on the external screen, data from sensors can be acquired and identified to determine if the electronic device is tilted, and different video segments can be played depending on the tilt direction. In this case, the video on the lock screen changes according to the user's tilting motion; specifically, the main subject displayed on the lock screen can move with the tilt.
[0137] Optionally, when the external screen displays the lock screen interface, it can also acquire and identify sensor data to determine that the electronic device is being shaken, and then play one or more different video segments depending on the direction of the shake. In this case, the video on the lock screen interface changes accordingly with the user's shaking motion; specifically, the main subject displayed on the lock screen interface can achieve a gravity-sensing effect as it is shaken.
[0138] Optionally, when the lock screen is displayed on the external screen, data from sensors can be acquired and identified to determine whether the electronic device is moving in a direction perpendicular to the screen. Based on the relative distance of the movement, one or more video segments can be played. In this case, the video on the lock screen changes according to the user's movement; specifically, the main subject displayed on the lock screen can move in a direction perpendicular to the screen, creating a visual effect of approaching or receding.
[0139] It should be understood that the above are merely several examples provided in the embodiments of this application, and these examples can be combined and modified as needed, which is not limited in this application. When the above display methods are combined, the dynamic wallpaper's changing effects are richer, thereby increasing the interactivity and fun of using electronic devices.
[0140] In addition, the methods for displaying live wallpapers in tilted, shaken, and vertically moving states can also be adapted to off-screen interfaces and desktops on external screens.
[0141] Optionally, the method for displaying live wallpapers provided in this application can also be applied to the lock screen, always-on screen, or desktop of the inner screen of a foldable screen. For specific procedures, please refer to the embodiments provided later, which will not be repeated here.
[0142] The following section, with reference to the accompanying drawings, provides a detailed description of the lock screen interface and the software system of the electronic device involved in this application.
[0143] Optionally, in one embodiment of this application, the lock screen interface may indicate Figure 4 The lock screen interface 204 shown in (b) is shown in the figure; Figure 4 In the lock screen interface 204 shown in (b), the lock screen icon is in a locked state.
[0144] Alternatively, in another embodiment of this application, for Figure 4 As shown in (b) of the image, when the "Stay on lock screen after unlocking external screen" switch is turned on in the settings application, if the user successfully unlocks the screen but does not switch to the desktop, the screen will switch to and remain on the lock screen. Figure 4 When the interface shown in (c) is displayed, the interface that remains after unlocking can also be called lock screen interface 205, that is, the lock screen interface can include lock screen interface 204 and lock screen interface 205. Among them, in Figure 4 In the lock screen interface 205 shown in (c), the lock screen icon is in an unlocked state.
[0145] Among them, targeting Figure 4 The lock screen interface 204 shown in (b) can be unlocked using methods such as facial recognition or fingerprint unlocking. After unlocking, it can be switched to... Figure 4 The lock screen interface 205 is shown in (c).
[0146] against Figure 4 The lock screen interface 205 shown in (c) continues to respond to the user's swipe-up operation, and can be accessed from... Figure 4 The lock screen interface 205 shown in (c) switches to Figure 4 Desktop 206 is shown in (d) above. Additionally, with the "Stay on lock screen after unlocking external screen" switch off in the settings app, the external screen can remain on the lock screen after successful unlocking. Figure 4 The lock screen interface 204 shown in (b) is switched to Figure 4 Desktop 206 is shown in (d) in the image.
[0147] For instructions on turning the "remain on lock screen after unlocking external screen" switch on or off, please refer to the following section. Figure 20 and Figure 21 The details of this will not be elaborated here.
[0148] Figure 5This is a schematic diagram of the software system of the electronic device provided in the embodiments of this application.
[0149] The layered architecture of the electronic device 100 divides the software into several layers, each with a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.
[0150] The application layer can include a series of application packages.
[0151] like Figure 5 As shown, the application package may include a lock screen, and may also include applications such as camera, gallery, call, navigation, Bluetooth, video, and SMS.
[0152] In this embodiment, the application layer may further include a live wallpaper service. The live wallpaper service can receive external input events sent from the lock screen (such as the first operation event, second operation event, third operation event, etc., as described below), and / or acquire sensor data, and play different videos according to different operation control logic to achieve interactive live wallpapers.
[0153] In addition, users can create and modify their own live wallpapers through the live wallpaper service, and... Figure 4 The display and interaction are performed on the external screen shown. The specific methods of creation and modification are not limited in this embodiment.
[0154] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0155] like Figure 5 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0156] The Android Runtime consists of core libraries and a virtual machine. The Android Runtime is responsible for the scheduling and management of the Android system.
[0157] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.
[0158] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0159] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0160] The kernel layer is the layer between hardware and software. The kernel layer includes at least display drivers, camera drivers, audio drivers, sensor drivers, Wi-Fi drivers, etc.
[0161] exist Figure 5 On this basis, Figure 6 This is a schematic diagram of the structure of another software system provided in an embodiment of this application.
[0162] like Figure 6 As shown, in the application layer 210, the lock screen application may include a lock screen operation recognition module and a lock screen hot zone recognition module; the dynamic wallpaper service may include a parsing module, an algorithm module, and a video playback service, etc.
[0163] The lock screen operation recognition module is used to determine the operation type, the triggered button type, and the trigger coordinates, etc. The operation type indicates the type of different user-input operations. For example, in response to a first operation event, when the electronic device displays a lock screen interface, the lock screen operation recognition module can determine whether the user has performed one of the following operations: a click operation, a double-click operation, a long-press operation, or a swipe operation. When it is a click operation, the lock screen operation recognition module can also determine the coordinate information corresponding to the click operation. Of course, user operations can also include other operations, and correspondingly, operation types can also include other operation types; this embodiment does not limit this.
[0164] The lock screen hotspot recognition module is used to determine whether the theme package (or live wallpaper) has hotspots configured, and if hotspots are configured, to determine the hotspot identifier of the corresponding hotspot based on the coordinates triggered by the user. Different hotspots have different hotspot identifiers.
[0165] In this embodiment, the full-screen area of the outer screen may include one or more hot zones. When the full-screen area of the outer screen includes one hot zone, that hot zone occupies only a partial area of the full-screen area; when the full-screen area of the outer screen includes multiple hot zones, those hot zones may fill the entire screen area, or they may occupy only a partial area of the full-screen area. The hot zones may be regular or irregular in shape. The sizes of different hot zones may be the same or different.
[0166] Optionally, the algorithm module may include a first video adaptation module, a second video adaptation module, and a video selection algorithm module. The algorithm module is used to determine the appropriate video segment for different user interactions. Specifically, the first video adaptation module determines the appropriate video segment based on external input operation events; the second video adaptation module determines the appropriate video segment based on sensor data; and the video selection algorithm module selects the final appropriate video segment for playback from the video segments determined by the first video adaptation module and the video segments determined by the gravity sensor recognition algorithm, based on a preset selection strategy.
[0167] The parsing module is used to parse the XML configuration file corresponding to the theme package.
[0168] The video playback service module is used to play the selected adapted video segments based on system resources.
[0169] The application framework layer 220 may include system services and sensor services. System services are used to transmit external input events generated by user operations received by the electronic device to the lock screen application. Sensor services are used to transmit sensor data generated by sensors, or to process sensor data to calculate acceleration, angle, or attitude before transmitting it to the live wallpaper service.
[0170] Hardware layer 230 includes memory and sensors.
[0171] The memory is used to store the first information, video resources and configuration files corresponding to multiple theme packages, and the first information, video resources and configuration files have a one-to-one correspondence.
[0172] The sensors may include accelerometers, gyroscopes, attitude sensors, etc., and of course, other sensors may also be included, but this application does not limit them.
[0173] It should be noted that the electronic device mentioned in the embodiments of this application may include more or fewer modules of the above-mentioned electronic device.
[0174] Next, combine Figure 6 The software system shown provides a module that describes in detail the method for displaying live wallpapers.
[0175] I. Example of loading or switching live wallpapers on startup Figure 7 This is a schematic flowchart illustrating a method for displaying a live wallpaper according to an embodiment of this application. The method 300 includes steps S301 to S313, which are described in detail below.
[0176] In this embodiment of the application, the method 300 can be provided by Figure 2 The electronic device shown executes the lock screen interface. Figure 4 The lock screen interface 204 shown in (b) is either Figure 4 The lock screen interface 205 is shown in (c).
[0177] S301, the lock screen application receives the user's first operation.
[0178] Optionally, the first operation can be a power-on operation or a theme switching operation. The power-on operation indicates a long press of the power button; in response to the power-on operation, the electronic device switches from a powered-off state to a powered-on state, during which a preset theme or the theme displayed before powering off is loaded, and the loaded theme is the target theme. The theme switching operation indicates a click operation on the application controls included in the preview interface of a new theme; in response to this click operation, the electronic device's theme can be switched from the old theme to the new theme. The new theme is the target theme.
[0179] For example, the topic switching process can be referred to in the following text. Figure 22 and Figure 23 Detailed introduction, application controls are Figure 22 (d) and Figure 23 The interface shown in (a) includes the application controls; other details will not be elaborated here.
[0180] S302, In response to the first operation, the lock screen application sends a first read instruction to the memory.
[0181] Optionally, in response to the first operation, the system service generates and transmits a first operation event to the lock screen application; the lock screen application sends a first read instruction to the memory based on the first operation event. It should be understood that the first operation event may indicate an event corresponding to a power-on operation or a theme switching operation.
[0182] Optionally, the first read instruction may carry source information, which indicates which screen the first read instruction is used on and from which application. For example, the source information in the first read instruction may include an inner or outer screen identifier, or an application identifier for the lock screen application.
[0183] Optionally, the first read instruction may also carry a user ID.
[0184] Optionally, when the first operation event is a power-on operation, the first read instruction may carry a target theme identifier, which is used to indicate the theme displayed before power-off. When the first operation event is a theme switching operation, the first read instruction may also carry a target theme identifier, which is used to indicate the theme to be displayed after switching.
[0185] In addition, in the embodiments of this application, the memory can be a read-only memory (ROM).
[0186] S303. After receiving the first read instruction, the memory returns the first information to the lock screen application.
[0187] The first read instruction is used to instruct the reading of first information. The first information includes a directory corresponding to the screen identifier and application identifier included in the first read instruction; in this embodiment, the directory can also be referred to as an address.
[0188] When the first read instruction also carries a user ID, the first information returned by the memory to the lock screen application may include the directory corresponding to the screen identifier, application identifier, and user ID included in the first read instruction. For example, the directory may be: inner screen data / theme / 0; outer screen data / theme / external / 0; where 0 is used to represent the user ID, that is, to identify the user as the main user.
[0189] In addition, the first piece of information also includes some basic information. For example, this basic information may include: whether the target topic is static or dynamic, and some adaptation identifiers that can be obtained from the configuration file.
[0190] It should be understood that the storage device is used to store theme packages corresponding to multiple themes. These multiple themes may include preset themes as well as user-defined and saved themes. Theme packages may include video resources and configuration files. The video resources for a theme may consist of multiple video segments arranged sequentially, and the configuration file may be an XML file.
[0191] When the first operation event is a power-on operation, the storage has already copied and saved the video resources and configuration files of the theme displayed before powering off in the fixed directory "data / theme / external / userID". At this time, in response to receiving the first read command, the storage can return the directory "data / theme / external / userID", the type of the target theme corresponding to the target theme in that directory, and some adaptation identifiers obtained from the configuration file to the lock screen application.
[0192] When the first operation event is a theme switching operation, in response to the received first read command, the memory can find the video resources and configuration files of the target theme based on the target theme identifier it carries, and copy and save the video resources and configuration files of the target theme to the directory "data / theme / external / user ID". Then, the memory returns the directory and the type of the target theme corresponding to the target theme in the directory, as well as some adaptation identifiers obtained from the configuration file, to the lock screen application.
[0193] It should be noted that in this embodiment, the storage device copies and saves the video resources and configuration files corresponding to the target theme in a fixed directory. Therefore, when returning the first information, the target theme identifier is no longer included. If the storage device directly returns the directory corresponding to the target theme in response to the received first read instruction, the directory includes the target theme identifier. For example, if the storage device directly returns the directory of the target theme as "data / theme1 / external / userID", then theme1 is the target theme identifier.
[0194] S304: The lock screen application loads the video resources of the theme package based on the first information and launches the live wallpaper service.
[0195] In this embodiment, a live wallpaper needs to be displayed on the lock screen. Since the target theme type included in the first information is live, the lock screen application can activate the live wallpaper service based on the first information. If the target theme type included in the first information is static, the lock screen application will not activate the live wallpaper service, but will instead display the static wallpaper from the theme package.
[0196] It should be understood that, based on the fact that the target theme type included in the first information is dynamic, the process of loading the theme may include: loading the target theme from a fixed directory. The directory corresponding to loading the target theme can be: data / theme / external / 0. Here, 0 represents the user ID. Assuming the user ID is 100, the directory for loading the target theme applied to the external screen could be: data / theme / external / 100.
[0197] Optionally, the theme's video resources may include a first set of video segments from the screen off to the lock screen interface and a second set of video segments from the lock screen to the desktop, and the theme's video resources are composed in the order of the first set of video segments first and the second set of video segments last, wherein the last frame of the first set of video segments is adjacent to the first frame of the second set of video segments.
[0198] For example, the first set of video segments from the screen off to the lock screen could be from... Figure 4 (a) in the middle switch Figure 4 The video segments played between the interfaces shown in (b) are shown in the diagram; the second set of video segments from the lock screen to the desktop can be from... Figure 4 (b) in Figure 4 The video segments played between the interfaces shown in (d) are shown in the figure.
[0199] Optionally, the theme's video resources may further include a third set of video segments adapted to click operations, and / or a fourth set of video segments adapted to gravity sensing, and / or a fifth set of video segments adapted to vertical screen movement. Of course, the theme's video resources may also include other video segments, and this embodiment does not limit this. Video segments adapted to different operation types such as click and gravity sensing have their own corresponding adaptation identifiers in the configuration file.
[0200] Specifically, when the video resources for a given topic include video segments from group one to group five, these video segments can be arranged in the order of first to fifth. Furthermore, each of these video groups can include one or more video segments.
[0201] Optionally, the spliced video resource can be in MP4 format, or it can be in mov, avi, mkv, or other formats. Of course, it can also be in other video formats, but this application embodiment does not limit this.
[0202] S305. After receiving the first read instruction, the memory can also send the configuration file corresponding to the target theme in the directory to the live wallpaper service.
[0203] It should be understood that S304 and S305 can be executed sequentially or simultaneously, and this application embodiment does not limit this.
[0204] The configuration file for the target topic may also include information such as the number of video segments, the number of hot zones and the coordinate range of each hot zone, the correspondence between each video segment and gravity sensing (or the second correspondence table), the correspondence between each video segment and hot zones (or the first correspondence table), and the video playback order type. The video playback order type can include random playback and playback in a preset order.
[0205] For example, when the video resources for a theme include video segments from the first group to the third group, the corresponding configuration file can include three groups of video resources, a total of five segments, and the correspondence between video segments and different playback scenarios, as well as the correspondence between each video segment and a hot zone. For instance, the first group of video segments might be the video segments played when switching from the always-on screen to the lock screen and contain only one video; the second group might be the video segments played when switching from the lock screen to the home screen and contain only one video; and the third group might be the video segments adapted to the hot zones and contain three video segments. The above is merely an example of a configuration file corresponding to one type of video resource.
[0206] The configuration file for the target theme can include some adaptation identification information corresponding to the target theme. This adaptation identification information is used to indicate that the video segment belongs to a video group in the video resource that is adapted to different playback scenarios.
[0207] For example, the first adapter identifier<aod_lock_section> It can be used to indicate the adaptation of one or more video segments to the lock screen interface when the screen is off; second adaptation identifier<lock_launcher_section> It can be used to indicate whether one or more video clips are adapted to the lock screen interface and desktop; third adaptation identifier<tap_video_section> It can be used to indicate the adaptation click operation of one or more video segments; fourth adaptation identifier<hotzone_video_section> It can be used to indicate one or more video adaptation hotspots; the fifth adaptation identifier.<sensor_video_section> It can be used to indicate that one or more video segments are adapted to gravity sensing; sixth adaptation identifier<tap_video_section_tap> It can be used to indicate the order in which video is played by assigning a value.
[0208] S306, The live wallpaper service parses and stores the parsed configuration file.
[0209] The configuration file corresponding to the target topic can be called the target configuration file.
[0210] It should be understood that the lock screen application launches the live wallpaper service and creates a parsing module to parse the target configuration file corresponding to the target theme.
[0211] S307. The lock screen application determines whether the theme has configured hot zones based on the first information of the target theme. If yes, proceed to step S308; if no, proceed to step S310. In addition, after executing S308 and S309, continue to execute S310.
[0212] Optionally, the lock screen hotspot recognition module included in the lock screen application can determine whether the target theme is configured with hotspots based on the first information of the target theme returned from the memory.
[0213] For example, whether a target topic has configured a hotzone can be determined based on whether the first information of the target topic includes the adaptation identifier hotzone_video_section. For instance, if the first information includes hotzone_video_section, it indicates that the target topic has configured a hotzone; if it does not include hotzone_video_section, it indicates that the target topic has not configured a hotzone.
[0214] S308, the lock screen application determines that the theme has configured hot zones and sends a second read command to the live wallpaper service.
[0215] Optionally, since the parsing module parses and stores the configuration file of the target theme, the lock screen application can send a second read command to the parsing module in the live wallpaper service. The second read command is used to instruct the reading of the parsed second mapping table.
[0216] S309, The live wallpaper service returns a second message to the lock screen application.
[0217] Optionally, the live wallpaper service can return the parsed second information to the lock screen hotspot recognition module in the lock screen application; the lock screen hotspot recognition module can receive and store the returned second information.
[0218] The second information regarding the target topic may include a first correspondence table representing the relationship between each video segment and a hotspot. For example, the first correspondence table may include: the number of hotspots, hotspot identifiers, the coordinate range of each hotspot, and identifiers of the video segments associated with each hotspot.<hotzone_video_section> And the correspondence between the hot zone identifier indicating the hot zone and the first video segment identifier indicating the video segment, etc.
[0219] For example, the second information of the target topic includes the number of hot zones, the hot zone identifiers of different hot zones, the coordinate range of each hot zone, and the correspondence between each video segment identifier and the hot zone, as shown in Table 1:
[0220] Table 1 It should be understood that the above is merely an example of secondary information.
[0221] It should be noted that the first coordinate value in the coordinate range is used to indicate the coordinate of the upper left corner of the hot zone, and the second coordinate value is used to indicate the coordinate of the lower right corner of the hot zone. The rectangular area formed between the upper left corner and the lower right corner is a hot zone, and the coordinates that belong to the coordinate range or the rectangular area belong to the same hot zone.
[0222] In addition, since the number of hot zones, the coordinate range, and the hot zone identifier also have a corresponding relationship, Table 1 is equivalent to storing the correspondence between the number of hot zones, the hot zone identifier, the coordinate range, and the first video segment identifier. Subsequently, based on the first correspondence table, the other three corresponding pieces of information can be found based on any one of them.
[0223] S310, the algorithm module in the live wallpaper service sends a third read command to the parsing module.
[0224] Optionally, since the parsing module parses and stores the configuration file of the target topic, the second video adaptation module included in the algorithm module can send a third read instruction to the parsing module. The third read instruction is used to instruct the reading of the parsed third information of the target topic, which can also be called gravity sensing information.
[0225] S311, The parsing module returns third-party information to the live wallpaper service.
[0226] Optionally, the parsing module returns the parsed third information to the second video adaptation module in the algorithm module; the second video adaptation module can receive and store the returned third information.
[0227] The third information of the target topic may include a second correspondence table representing the relationship between each video segment and gravity sensing. For example, the second correspondence table may include: the type of gravity sensing, such as tilt, sway, or vertical movement; and the adaptation identifiers of the sensor data range and the gravity sensing-related video segments under different gravity sensing types.<sensor_video_section> The correspondence between them, etc.
[0228] Optionally, different sensors can be configured for different gravity sensing types. For example, when the gravity sensing type is tilt, only the attitude sensor and gyroscope sensor can be configured; when the gravity sensing type is swaying, the accelerometer, attitude sensor, and gyroscope sensor can be configured; and when the gravity sensing type is vertical movement, the accelerometer and gyroscope data can be configured. Specific settings and modifications can be made as needed, and this application embodiment does not limit this.
[0229] For example, in the gravity sensing information of the target subject, different gravity sensing types are configured with data from three sensors: accelerometer, attitude sensor and gyroscope.
[0230] This includes the gravity sensing type and the second correspondence between the second video segment identifier and the sensor data, as shown in Table 2:
[0231] Table 2 It should be understood that the above is merely an example of third-party information.
[0232] It should be noted that the sensor data range refers to a range of acceleration, angle, and attitude, rather than a fixed value.
[0233] S312. The live wallpaper service determines whether the theme is configured with gravity sensing based on the third information. If yes, it executes the subsequent step S313; otherwise, it waits to receive subsequent instructions.
[0234] Optionally, the second video adaptation module included in the algorithm module can determine whether the target subject is configured with gravity sensing based on the third information returned from the parsing module.
[0235] For example, whether a target topic is configured with gravity sensing can be determined based on whether the third information of the target topic includes the adapter identifier sensor_video_section. For example, when the second information includes...<sensor_video_section> When the target subject is equipped with a gravity sensor, it indicates that the target subject is configured with a gravity sensor; when it is not included...<sensor_video_section> This indicates that the target subject does not have gravity sensors or similar features configured.
[0236] S313, Live Wallpaper service registration sensor monitoring data.
[0237] Optionally, the second video adaptation module within the algorithm module of the live wallpaper service registers sensors for data monitoring. For example, one or more different types of sensors can be registered to monitor sensor data timestamps, sensor data values, etc. Specifically, an accelerometer can be registered using `type_accelerometer_sensor`, a gyroscope sensor using `type_gyro_sensor`, and an attitude sensor using `type_attitude_sensor`, etc.
[0238] S314, The sensor monitors data in real time.
[0239] It should be noted that in this embodiment, the sensor can be registered when the outer screen of the electronic device is locked. When switching from the locked screen to the off screen, or from the locked screen to the desktop, the sensor can be automatically unregistered and will no longer listen to sensor data for the display of the live wallpaper on the lock screen, thereby reducing power consumption.
[0240] The above is a schematic diagram of the interactive process of loading or switching live wallpapers upon system startup.
[0241] It should be understood that Figure 7 The steps included can be rearranged in order, added, or deleted as needed, and this application embodiment does not show this.
[0242] Optionally, as another example, in step S303, the first information returned by the memory to the lock screen may include information such as the target theme being a dynamic type, but not some adaptation identifiers obtained from the configuration file. Accordingly, after step S306 and before S310, the live wallpaper service can be used to perform the above-described S307 to S309.
[0243] Specifically, the algorithm module in the live wallpaper service can be used to execute S307 to S309 as described above.
[0244] For example, the algorithm module in the live wallpaper service sends a fourth read instruction to the parsing module, which instructs the reading of fourth information. This fourth information may include the adaptation identifier hotzone_video_section.
[0245] Based on the returned fourth information, the algorithm module in the live wallpaper service can determine that the target theme has configured hot zones; then, the algorithm module sends a fifth read instruction to the parsing module. The fifth read instruction is used to instruct the reading of the parsed fifth information, which can be the same as the second information described above, and will not be repeated here.
[0246] Optionally, as another example, in step S303, the first information returned by the memory to the lock screen may include information such as the target theme being of a dynamic type, but not some adaptation identifiers obtained from the configuration file. Accordingly, after step S306 and before S310, the live wallpaper service can be used to perform the following steps.
[0247] For example, the algorithm module in the live wallpaper service sends a sixth read instruction to the parsing module. This sixth read instruction instructs the reading of sixth information. This sixth information may include the adaptation identifier hotzone_video_section and the second information mentioned above.
[0248] Based on the returned sixth piece of information, the algorithm module in the live wallpaper service can determine that the target theme has configured hot zones.
[0249] Optionally, as another example, in step S303, the first information returned by the memory to the lock screen may include information such as the target theme being of a dynamic type, but not some adaptation identifiers obtained from the configuration file. Accordingly, after step S306, the live wallpaper service can be used to perform the following steps.
[0250] For example, the algorithm module in the live wallpaper service sends a seventh read instruction to the parsing module. This seventh read instruction is used to read seventh information. This seventh information may include all adaptation identifiers, the second information mentioned above, and the third information mentioned above.
[0251] Based on the returned seventh piece of information, the algorithm module in the live wallpaper service can simultaneously determine that the target theme is configured with hot zones and gravity sensing. Then, the algorithm module in the live wallpaper service can continue to execute S313 and S314.
[0252] II. Example of a live wallpaper displayed after clicking the lock screen, where the target theme does not have hotspots and gravity sensors configured. Figure 8 This is a schematic flowchart illustrating another method for displaying live wallpapers provided in an embodiment of this application.
[0253] If the target subject is not configured with a heat zone and gravity sensor, the method 400 may include steps S301 to S307 and S310 to S312, as well as steps S401 to S405. Steps S301 to S307 and S310 to S312 can refer to the above-described method for... Figure 7 The description of steps S401 to S405 will not be repeated here. The following sections will provide a detailed description of each step.
[0254] In this embodiment of the application, the method 400 can be provided by Figure 2 The electronic device shown executes the lock screen interface. Figure 4 The lock screen interface 204 shown in (b) is either Figure 4 The lock screen interface 205 is shown in (c).
[0255] S401, The lock screen application receives the user's second operation.
[0256] Optionally, the second operation can be a user operation at any location on the lock screen. The user operation can include any of the following: tap, double-tap, long-press, swipe, etc.
[0257] For example, the second operation can be for targeting Figure 4 The lock screen interface 204 shown in (b) is either Figure 4 Click operations at any location in the lock screen interface 205 shown in (c).
[0258] Optionally, the lock screen application includes a lock screen operation recognition module to determine the operation type, the number of operations, the type of button triggered, the coordinates of the trigger, and other information. See the following for details. Figure 6 This section introduces the lock screen operation recognition module.
[0259] S402, The lock screen application sends a second operation event to the live wallpaper service.
[0260] Optionally, the lock screen application includes a lock screen operation recognition module that transmits a second operation event to the algorithm module in the live wallpaper service. This second operation event may carry information such as the operation type determined by the lock screen operation recognition module, the number of operations, and the coordinates of the trigger point. These details can be configured as needed, and this embodiment does not impose any limitations on them.
[0261] For example, when the second operation is a click operation, the second operation event can be a tap event, which can carry information such as: the operation type is a click operation, the coordinates of the click location, etc.
[0262] Optionally, during the user's click operation, when the user presses their finger (touchstart), the lock screen application can be triggered to send a second operation event to the live wallpaper service; or, when the user lifts their finger (touchend), the lock screen application can be triggered to send a second operation event to the live wallpaper service. This application embodiment does not limit this.
[0263] S403, The algorithm module in the live wallpaper service determines the corresponding first playback information based on the second operation event.
[0264] Optionally, the first playback information may include an adaptation identifier corresponding to the second operation event, a video segment identifier corresponding to the adaptation identifier, a video frame range, and a playback type.
[0265] For example, assuming the user's input is a click, the lock screen transmits the click event to the first video adaptation module included in the algorithm module of the live wallpaper service. The first video adaptation module, combining the operation type (click or tap) information carried by the click event, can find and determine the adaptation identifier corresponding to the click event from the parsed configuration file.<tap_video_section> and<tap_video_section_type> Furthermore, based on these two adaptation identifiers, the corresponding video segment identifiers and playback types of the video segments can be further determined from the parsed configuration file.
[0266] For example, the video segment corresponding to the click operation is identified as follows:<tap_video_section_A1> ,<tap_video_section_A2> ,<tap_video_section_A3> Each video segment identifier corresponds to a range of video frames;<tap_video_section_type> The value of 1 indicates that the playback type of the three video identifiers is sequential playback.
[0267] S404, The algorithm module in the live wallpaper service sends the first playback command to the video playback service module.
[0268] The first playback instruction is used to instruct the playback of the corresponding video frame range according to the determined video segment identifier and playback type assignment. The first playback instruction may carry the first playback information determined based on the second operation event.
[0269] Optionally, in response to a single click, one or more video segments can be played sequentially or randomly, depending on the playback type assignment.
[0270] S405, The video playback service module plays the video according to the first playback instruction.
[0271] Figure 9 This is a schematic diagram of a video interface that plays a video segment in response to a click operation without the configuration of a heatsink or gravity sensor. Figure 10 This is an example of a video segment being played.
[0272] For example, in the lock screen interface of the outer screen, such as Figure 9 As shown in (a), the electronic device can receive a click operation at any location on the display screen; in response to the click operation, the methods shown in S401 to S405 above can be executed to play the video segment corresponding to the click operation.
[0273] Here, we assume that the video segment corresponding to the click operation is identified as follows:<tap_video_section_A1> ,<tap_video_section_A2> ,<tap_video_section_A3> Each video segment identifier corresponds to a range of video frames;<tap_video_section_tap> A value of 1 indicates that the playback type of the three video identifiers is sequential playback. Therefore, according to the first playback instruction, they can be played sequentially.<tap_video_section_A1> The corresponding video frame range, such as N1, is shown in the lock screen interface. Figure 9 As shown in (b) above; continue playing.<tap_video_section_A2> The corresponding second video frame interval, such as N2, is shown on the lock screen interface. Figure 9 As shown in (c); then, continue playing.<tap_video_section_A3> The corresponding third video frame interval, such as N3, is shown on the lock screen interface. Figure 9 As shown in (d) in the diagram. The playback order is as follows. Figure 10 As shown in (a) of the diagram.
[0274] Optionally, the number of video frames included in the first, second, and third video frame intervals may be the same or different; correspondingly, the playback duration may be the same or different.
[0275] Optionally, when<tap_video_section_tap> When the value is 0, the playback order of the first, second, and third video frame intervals is randomized. For example, the playback order could be as follows: Figure 10 As shown in (b) of the diagram.
[0276] The above is an example of displaying a live wallpaper when the lock screen is clicked, without configuring a heatsink or gravity sensor.
[0277] It should be noted that when the live wallpaper is displayed in response to a click, such as Figure 9 As shown in the lock screen interface, the displayed lock screen icon can be in a locked state or an unlocked state.
[0278] Alternatively, as another example, if, after S405, during the playback of a video segment according to the first playback instruction, the electronic device receives another click operation from the user, playback can be stopped. Furthermore, an index identifier can be created, and by assigning a value to the index identifier, the number of video segments and frames currently being played can be recorded. Subsequently, if the electronic device receives a third click operation from the user, it can continue playing subsequent video frames and segments based on the video segment and frame number recorded in the index identifier.
[0279] In this way, during the execution of S405, in response to one or more clicks by the user, the video playing on the lock screen will pause or resume playback until all the video segments indicated by the first playback command have been played.
[0280] Optionally, as another example, in response to the first click operation, in S403, the first playback command can instruct the playback of the video corresponding to the first video segment identifier according to the determined video segment identifier and playback type. Furthermore, an index identifier can be created to record the current video segment number being played. After the first video segment finishes playing, the screen can switch back to the original lock screen. Then, in response to the second click operation, in S403, the first playback command can instruct the playback of the video corresponding to the second video segment identifier according to the determined video segment identifier, playback type, and index identifier. Furthermore, the value of the index identifier can be updated to record the second video segment number being played. After the second video segment finishes playing, the screen can switch back to the original lock screen. The display process for subsequent click operations follows the same logic and will not be elaborated further here.
[0281] This means that in response to each user click, the lock screen only plays one segment of the video corresponding to that click, and then switches back to the original lock screen. In response to the next click, another segment of the video corresponding to that click is played. In other words, each click plays only one video segment, requiring multiple manual clicks to play multiple different video segments; it does not play automatically and continuously.
[0282] Optionally, in step S405, the multiple video segments indicated by the first playback command can be played repeatedly until unlocking is successful. The number of playbacks can be preset as needed, and this embodiment does not limit this.
[0283] For example, assuming there are 3 video segments that the click operation is compatible with, and the playback type is random playback, then in response to the first click operation, video segment A1 can be played, and the index identifier is assigned a value of 1; in response to the second click operation, video segment A3 can be played, and the index identifier is assigned a value of 3; in response to the third click operation, video segment A2 can be played, and the index identifier is assigned a value of 2; subsequently, in response to the fourth click operation, random playback can continue, for example, playing video segment A3, and the index identifier is assigned a value of 3.
[0284] 3. Example of a target theme with hotspots configured but no gravity sensor configured, where clicking on a hotspot displays a live wallpaper.
[0285] Figure 11 This is a schematic flowchart illustrating another method for displaying live wallpapers provided in this application embodiment.
[0286] When the target subject is configured with a hotspot but not with a gravity sensor, method 500 may include the above. Figure 7 The steps S301 to S312 shown may further include steps S501 to S506. Steps S301 to S312 can be referenced from the above-described steps... Figure 7 The description of steps S501 to S506 will not be repeated here; the following sections will describe steps S501 to S506 in detail.
[0287] In this embodiment of the application, the method 500 can be... Figure 2 The electronic device shown executes the lock screen interface. Figure 4 The lock screen interface 204 shown in (b) is either Figure 4 The lock screen interface 205 is shown in (c).
[0288] S501, The lock screen application receives the user's third operation.
[0289] The third operation is similar to the second operation. For the description of S501, please refer to S401 above, and it will not be repeated here.
[0290] For example, the third operation can be for targeting Figure 4 The lock screen interface 204 shown in (b) is either Figure 4 The click operation at any position on the lock screen interface 205 shown in (c) is shown.
[0291] S502, the lock screen application determines the hot zone corresponding to the third operation based on the second information returned in S309.
[0292] Optionally, the lock screen application includes a lock screen hotspot recognition module to determine the hotspot corresponding to the third operation based on the received second information. The hotspot triggered by the third operation can also be referred to as the current hotspot.
[0293] For example, if the third operation is a click, after the lock screen operation recognition module receives the user's click, it sends the coordinates corresponding to the third operation to the lock screen hotspot recognition module. The lock screen hotspot recognition module can compare these coordinates with the coordinate ranges of hotspots included in the second information (as shown in Table 1) to determine which hotspot range the coordinates belong to. Then, through the first correspondence between the coordinate ranges of hotspots and the hotspot identifiers shown in Table 1, the hotspot identifier corresponding to the coordinates can be determined. The hotspot indicated by this hotspot identifier is the hotspot corresponding to the third operation.
[0294] For example, when the coordinates fall within the range of (x1, y1) and (x2, y2), the hot zone corresponding to the coordinates can be identified as R1 through the first correspondence. In other words, the lock screen hot zone recognition module can determine that the user has clicked on the hot zone identified as R1, and subsequently instruct the video segment corresponding to the hot zone to be played.
[0295] S503, Lock screen applications transmit third-party operation events to the live wallpaper service.
[0296] Optionally, the lock screen application includes a lock screen hotspot recognition module that transmits a third operation event to the first video adaptation module in the algorithm module. This third operation event may carry a hotspot identifier determined by the lock screen hotspot recognition module.
[0297] In addition, the third operation event can also carry information such as the operation type determined by the lock screen operation recognition module and the number of operations. The specific settings can be configured as needed, and this application embodiment does not limit this.
[0298] For example, when the third operation is a click operation, the information that the third operation event can carry includes: the operation type is a click operation, and the hot zone identifier is R1.
[0299] S504, the algorithm module in the live wallpaper service determines the corresponding second playback information based on the third operation event.
[0300] Optionally, the second playback information may include a video segment identifier corresponding to the hotspot identifier carried by the third operation event, and a video frame interval corresponding to the video segment identifier.
[0301] For example, assuming the user's input is a click, the lock screen transmits the click event to the first video adaptation module included in the algorithm module of the live wallpaper service. The first video adaptation module, combining the information carried by the click event and the parsed configuration file, can determine the first video segment identifier corresponding to the hotspot identifier. The video frame range indicated by this first video segment identifier is the video corresponding to the hotspot.
[0302] For example, when the target hot zone is identified as R1, the first video segment identifier corresponding to R1 can be determined by querying the configuration file.<hotzone_video_section_R1> Therefore, the video to be played is the identifier of the first video segment.<hotzone_video_section_R1> The corresponding video frame range.
[0303] Optionally, assuming the first video segment identifier corresponds to multiple video frame intervals, multiple video segments can be played in a configured order. That is, for a hotspot, one or more video segments can be played in response to a user's click operation. The playback type of these multiple video segments can be sequential or random playback, which can be set as needed, and this application embodiment does not limit this.
[0304] Optionally, assuming that different hot zone identifiers correspond to different first video segment identifiers, which may correspond to the same video frame interval or different video frame intervals, the same video segment or different video segments can be played according to the configuration. That is, for different hot zones, in response to the user's click operation, the same video segment or different video segments can be played.
[0305] S505, the algorithm module in the live wallpaper service sends a second playback command to the video playback service module.
[0306] The second playback instruction is used to instruct the playback of the corresponding video frame range according to the determined first video segment identifier and playback type assignment. The first playback instruction may carry the second playback information determined based on the third operation event.
[0307] S506, The video playback service module plays videos according to the second playback command.
[0308] Figure 12This is a schematic diagram of an interface that plays a video segment in response to a click operation, provided that a hot zone is configured but a gravity sensor is not configured. Figure 13 This is a schematic diagram showing the correspondence between a hot zone and a video segment. Figure 14 This is a schematic diagram showing another type of hot zone corresponding to a video segment.
[0309] For example, regarding the theme displayed on the lock screen of the outer screen, such as Figure 12 As shown in (a), the electronic device can receive a click operation on the displayed cat ears a1 or a2; in response to the click operation, the methods shown in S501 to S506 above can be executed to play the video segment corresponding to the hot zone triggered by the click operation, such as... Figure 12 As shown in (b) of the diagram. Figure 12 As shown in (c), the electronic device can receive a click operation on the displayed cat eye a3 or cat eye a4; in response to the click operation, it executes the methods shown in S501 to S506 above, playing the video segment corresponding to the hot zone triggered by the click operation, such as... Figure 12 As shown in (d) in the diagram. Similarly, as... Figure 12 As shown in (e), the electronic device can receive a click operation on the displayed cat mouth a5; in response to the click operation, it executes the methods shown in S501 to S506 above, playing the video segment corresponding to the hot zone triggered by the click operation, such as... Figure 12 As shown in (f) in the figure.
[0310] like Figure 13 As shown, the first sub-hotspot b1 corresponding to cat ear a1 and the second sub-hotspot b2 corresponding to cat ear a2 both belong to the first hotspot. When the user clicks on any cat ear, the lock screen can determine that the triggered hotspot is the first hotspot; assuming the hotspot identifier of the first hotspot is C1, and the corresponding first video segment identifier is...<topzone_video_section_C1> Therefore, in response to this click, the video segment identifier must be played.<topzone_video_section_C1> The corresponding video frame interval, namely video C1.
[0311] Furthermore, the third sub-hotspot corresponding to cat eye a3 and the fourth sub-hotspot b4 corresponding to cat eye a4 both belong to the second hotspot. When a user clicks on any cat eye, the lock screen can determine that the triggered hotspot is the second hotspot; assuming the hotspot identifier of the second hotspot is C2, the corresponding first video segment identifier is...<topzone_video_section_C2> Therefore, in response to this click, the video segment identifier needs to be played.<topzone_video_section_C2> The corresponding video frame interval, namely video C2.
[0312] Similarly, area b5, where the cat's mouth a5 is located, belongs to the third hot zone. When the user clicks the cat's mouth, the lock screen can determine that the triggered hot zone is the third hot zone; assuming the identifier of the third hot zone is C3, the corresponding first video segment identifier is...<topzone_video_section_C3> Therefore, in response to this click, the video segment identifier must be played.<topzone_video_section_C3> The corresponding video frame interval, namely video C3.
[0313] Optionally, such as Figure 13 As shown, video C1 has M1 frames, video C2 has M2 frames, and video C3 has M3 frames. The number of video frames included in different video segments can be the same or different, that is, the sizes of M1, M2, and M3 can be the same or different; correspondingly, the playback duration of different video segments can be the same or different.
[0314] The above is an example of a live wallpaper being displayed when a hot zone is configured but a gravity sensor is not configured.
[0315] It should be noted that when the live wallpaper is displayed in response to a click, such as Figure 12 or Figure 13 As shown in the lock screen interface, the displayed lock screen icon can be in a locked state or an unlocked state.
[0316] Optionally, the hot zone can be as follows Figure 12 or Figure 13 The shown area does not fill the entire outer screen; or, it could also be as follows: Figure 14 The area shown is the full-screen area that fills the outer screen.
[0317] For example, such as Figure 14As shown, the lock screen currently displays a theme with 9 hot zones. These 9 hot zones indicate 9 local areas on the screen. These 9 hot zones do not overlap and together can fill the entire screen area. When the user clicks on any hot zone, the lock screen can determine the hot zone identifier and the corresponding first video segment identifier. Assuming the triggered hot zone is identified as the first hot zone c1, its hot zone identifier is D1, and the corresponding first video segment identifier is...<topzone_video_section_D1> Therefore, in response to this click, the video segment identifier must be played.<topzone_video_section_D1> The corresponding video frame interval, i.e., video D1. Assume the triggered hotspot is determined to be the ninth hotspot c9, the hotspot identifier of the ninth hotspot is D9, and the corresponding first video segment identifier is...<topzone_video_section_D9> Therefore, in response to this click, the video segment identifier must be played.<topzone_video_section_D9> The corresponding video frame range is video D9. The triggering process for the second to eighth hot zones is similar to the above description, and will not be repeated here.
[0318] Optionally, such as Figure 14 As shown, video D1 has 1 frame, video D2 has 2 frames, and so on, with video D9 having 9 frames. The number of video frames in different video segments can be the same or different, meaning that the sizes of P1, P2, and P3 can be the same or different; correspondingly, the playback duration of different video segments can be the same or different.
[0319] Optionally, in Figure 14 Since the area on the outer screen containing the non-under-screen camera is inconvenient for users to click, hotspot configuration can be omitted. In other words, the seventh hotspot can be omitted, and only eight hotspots can be configured.
[0320] IV. An example of how to display a live wallpaper when the target theme is tilted, shaken, or moved vertically, provided that no hotspots are configured and only gravity sensing is configured.
[0321] In one example, if the target subject does not have a hotspot configured but has a gravity sensor configured, method 600 may include the above. Figure 7 The steps S301 to S307 and S310 to S314 shown are included; in addition, steps S601 to S607 may also be included.
[0322] In another example, where the target subject is configured with hotspots and gravity sensing, but no user actions are received for the hotspots, the method may include the above. Figure 7The steps S301 to S314 are shown; in addition, steps S601 to S607 may also be included.
[0323] Regarding the first example above, Figure 15 This is a schematic flowchart illustrating a method for displaying a live wallpaper according to an embodiment of this application. Steps S301 to S307 and S310 to S314 can be referred to the above-described method for... Figure 7 The description of steps S601 to S607 will not be repeated here; the following sections will describe steps S601 to S607 in detail.
[0324] S601, The electronic device displays a lock screen interface and is in motion.
[0325] When an electronic device receives a press of the power button, the screen lights up and may display something like this. Figure 4 The lock screen interface 204 shown in (b) is either Figure 4 The lock screen interface 205 is shown in (c).
[0326] When a user changes the physical state of an electronic device, such as tilting, shaking, or moving it perpendicular to the screen, the electronic device is in motion. Accordingly, motion can include tilting, shaking, or moving perpendicular to the screen.
[0327] In this embodiment of the application, the order in which the electronic device is triggered to light up and to move is not limited.
[0328] S602. When the sensor detects a change in sensor data, it reports the change to the algorithm module in the live wallpaper service.
[0329] Optionally, the sensor can report changes in sensor data to the second video adaptation module in the algorithm module through the sensor service.
[0330] It should be understood that when sensor data changes, it indicates that the state of the electronic device in physical space has changed. At this point, the type of gravity sensing can be further determined, and then, appropriate video segments can be played adaptively for different types of gravity sensing to achieve the gravity sensing effect of the main object in the target subject.
[0331] Optionally, the gravity sensing type may include tilting left, tilting right, rocking to the upper left, rocking to the upper right, rocking to the lower left, or rocking to the lower right; moving forward vertically or moving backward vertically.
[0332] S603, the algorithm module in the live wallpaper service sends an acquisition command to the sensor.
[0333] Optionally, after receiving a report of a change in sensor data, the second video adaptation module in the algorithm module can issue an acquisition command. The acquisition command is used to acquire the sensor data.
[0334] S604, The sensor returns sensor data to the live wallpaper service.
[0335] Optionally, the sensor can return sensor data to the second video adaptation module in real time through the sensor service, or return sensor data collected within a preset time period at intervals.
[0336] Optionally, the sensor data may include information such as sensor type, sensor timestamp and value, and of course, other information may also be included, which is not limited in this embodiment.
[0337] S605, the live wallpaper service determines the corresponding third playback information based on the returned sensor data.
[0338] Optionally, after receiving the sensor data, the second video adaptation module in the algorithm module determines the third playback information based on the sensor data. The third playback information may include the gravity sensing type corresponding to the sensor data, the second video segment identifier, and the video frame interval corresponding to the second video segment identifier.
[0339] For example, the second video adaptation module can first determine the corresponding acceleration, angle, and attitude based on the sensor data returned by the sensor, such as sensor type, sensor timestamp, and values; then compare the acceleration, angle, and attitude with the sensor data range included in the gravity sensing information (as shown in Table 2) to determine which sensor data range the sensor data belongs to; then, based on the second correspondence between the sensor data range and gravity sensing type and the second video segment identifier in Table 2, the gravity sensing type and the second video segment identifier corresponding to the sensor data can be determined, and the video frame interval indicated by the second video segment identifier is the video corresponding to the gravity sensing.
[0340] For example, when the sensor data range is determined to belong to the fourth acceleration range, the fourth angle range, and the fourth attitude range, the corresponding gravity sensing type can be determined to be a rightward and upward sway, that is, the electronic device is currently in a swaying state; and the adapted second video segment is identified as...<sensor_video_section_F3> ,<sensor_video_section_F4> Therefore, the video to be played is the identifier for the second video segment.<sensor_video_section_F3> ,<sensor_video_section_F4> The corresponding video frame intervals.
[0341] S606, the algorithm module in the live wallpaper service sends a third playback command to the video playback service module.
[0342] The third playback instruction instructs the playback of the corresponding video frame interval according to the determined second video segment identifier. The second playback instruction carries the video segment identifier determined based on sensor data.
[0343] S607, The video playback service module plays the video according to the third playback instruction.
[0344] Figure 16 This is a schematic diagram of a video interface that plays in response to tilting operations when a gravity sensor is configured but a hot zone is not configured.
[0345] For example, when the electronic device is tilted, the methods shown in S601 to S607 above can be executed to play a video segment corresponding to the tilted state, for the theme displayed on the lock screen interface of the outer screen.
[0346] like Figure 16 As shown in (a), assuming the user tilts the electronic device to the left and the gravity sensor type is left tilt, the second video segment identifier determined based on the sensor data is:<sensor_video_section_E1> ,<sensor_video_section_E2> Therefore, the electronic device needs to play the video segment identifier that corresponds to the second video segment.<sensor_video_section_E1> ,<sensor_video_section_E2> The corresponding video frame intervals are video E1 and video E2. After playback, the scroll bar on the lock screen can scroll from right to center and from center to left.
[0347] like Figure 16 As shown in (b), assuming the user tilts the electronic device to the right and the gravity sensor type is right tilt, the second video segment identifier determined based on the sensor data is:<sensor_video_section_E3> ,<sensor_video_section_E3> Therefore, the electronic device needs to play the video segment identifier that corresponds to the second video segment.<sensor_video_section_E3> ,<sensor_video_section_E4> The corresponding video frame intervals are video E3 and video E4. After playback, the scroll bar on the lock screen can scroll from the left to the middle and from the middle to the right.
[0348] Figure 17 This is a schematic diagram of a video interface that responds to shaking operations when a gravity sensor is configured but a hot zone is not set.
[0349] For example, when the electronic device is in a shaking state, the methods shown in S601 to S607 above can be executed to play a video segment corresponding to the shaking state, for the theme displayed on the lock screen interface of the outer screen.
[0350] like Figure 17 As shown in (a), assuming the user shakes the electronic device to the upper left, and the gravity sensor type is set to upper left, the second video segment identified based on the sensor data is:<sensor_video_section_F1> ,<sensor_video_section_F2> Therefore, the electronic device needs to play the video segment identifier that corresponds to the second video segment.<sensor_video_section_F1> ,<sensor_video_section_F2> The corresponding video frame intervals are video F1 and video F2. After playback, the bubble on the lock screen can scroll from the bottom right back to the center and from the center to the top left.
[0351] Figure 17 (b) Figure 17 (c) and Figure 17 The process in (d) is similar to that described above, and will not be repeated here.
[0352] Figure 18 This is a schematic diagram of a video interface that plays video segments in response to vertical movement, even when a gravity sensor is configured but a hot zone is not set.
[0353] For example, when the electronic device is in a state of moving along a direction perpendicular to the screen, the methods shown in S601 to S607 above can be executed to play the video segment corresponding to the state of moving along a direction perpendicular to the screen, for the theme displayed on the lock screen interface of the outer screen.
[0354] like Figure 18 As shown in (a), assuming the user moves the electronic device forward in a direction perpendicular to the screen, and the gravity sensing type is forward vertical movement, the second video segment identifier determined based on the sensor data is:<sensor_video_section_G1> ,<sensor_video_section_G2> Therefore, the electronic device needs to play the video segment identifier that corresponds to the second video segment.<sensor_video_section_G1> ,<sensor_video_section_G2> The corresponding video frame intervals are video G1 and video G2. After playback, the polar bear on the lock screen appears to swim from a distance to closer, with the visual effect of it getting larger.
[0355] Conversely, such as Figure 18As shown in (b), assuming the user moves the electronic device backward in a direction perpendicular to the screen, and the gravity sensing type is backward vertical movement, the second video segment identifier determined based on the sensor data is:<sensor_video_section_G3> ,<sensor_video_section_G4> Therefore, the electronic device needs to play the video segment identifier that corresponds to the second video segment.<sensor_video_section_G3> ,<sensor_video_section_G4> The corresponding video frame intervals are video G3 and video G4. After playback, the polar bear on the lock screen can appear to swim from near to far, with the visual effect changing from large to small.
[0356] Optionally, such as Figure 16 , Figure 17 and Figure 18 As shown, the number of video frames included in different video frame intervals can be the same or different; correspondingly, the playback duration can be the same or different.
[0357] The above is an example of a live wallpaper being displayed when an electronic device is tilted, shaken, or moved vertically, provided it is equipped with a gravity sensor.
[0358] It should be noted that when an electronic device is in motion and displays a live wallpaper, such as Figure 16 , Figure 17 , Figure 18 As shown in the lock screen interface, the displayed lock screen icon can be in a locked state or an unlocked state.
[0359] It should be understood that when a user performs multiple tilting, shaking, or vertical movement operations, multiple consecutive video frame intervals can be played based on different second video segment identifiers determined by sensor data. The process of playing different video frame intervals is similar to S601 to S607 described above, and will not be repeated here.
[0360] V. An example of a live wallpaper displayed when the target theme is configured with both hot zones and gravity sensors.
[0361] Figures 19A to 19D This is a schematic flowchart illustrating another method for displaying live wallpapers provided in this application embodiment.
[0362] When the target subject is configured with both a hot zone and a gravity sensor, the method 700 may include the above. Figure 7 The steps S301 to S314, S501 to S504 and S601 to S607 are shown.
[0363] When the device boots up or switches themes, it can execute S301 to S304. S301 to S314 can be referenced above for... Figure 7 The description.
[0364] As one embodiment, when both a hot zone and a gravity sensor are configured, and the electronic device does not receive any user operation targeting the hot zone, but only displays the lock screen and is in motion, steps S601 to S607 can be executed. Steps S601 to S607 can refer to the above-described actions targeting the hot zone. Figure 15 The description will not be repeated here. That is, in the embodiments of this application, even if a hot zone is configured, when no click operation is received on the hot zone, the electronic device plays the corresponding video segment according to the detected gravity sensing type.
[0365] As another embodiment, when both a hot zone and a gravity sensor are configured, the electronic device displays a lock screen and is in a non-moving state (or stationary state). When a click operation is received on the hot zone, steps S501 to S506 can be executed. Steps S501 to S506 can refer to the above-described actions on the hot zone. Figure 11 The description will not be repeated here. That is, in the embodiments of this application, even if gravity sensing and hot zones are configured, when no change in sensor data is detected and only a click operation is received for the hot zone, the electronic device plays the corresponding video segment based on the determined hot zone identifier.
[0366] As another embodiment, such as Figure 19A As shown, when both a hot zone and a gravity sensor are configured, the electronic device displays a lock screen and is in motion, and can execute steps S601 to S607. During the playback of a video segment corresponding to the gravity sensor type, if a user operation targeting the hot zone is received, based on the configured playback rule of not interrupting the currently playing video, a second playback command can be omitted, and step S607 can continue playing the video segment corresponding to the gravity sensor type until it finishes playing. Alternatively, as... Figure 19B As shown, based on the configured playback rules of interrupting the currently playing video and playing a new video, it is also possible to stop playing the video segment corresponding to the gravity sensor type and execute S505 to S506 to play the video segment corresponding to the hot zone.
[0367] That is, in the embodiments of this application, when the electronic device receives a click operation on the hot zone while playing the corresponding video segment based on the detected gravity sensing type, it can continue playing the video segment corresponding to the gravity sensing type, or it can stop playing the video segment corresponding to the gravity sensing type and switch to playing the video segment corresponding to the hot zone.
[0368] As another embodiment, such as Figure 19CAs shown, when both a hot zone and a gravity sensor are configured, the electronic device's lock screen is in a non-motion state. When a tap on the hot zone is received, steps S501 to S506 can be executed. During playback of the video segment corresponding to the hot zone, if the electronic device is detected to be in motion and the sensor data changes, based on the configured rule of not interrupting the currently playing video, a third playback command can be omitted, and step S506 can continue playing the video segment corresponding to the hot zone until it finishes playing. Alternatively, as... Figure 19D As shown, based on the configured playback rules of interrupting the currently playing video and playing a new video, it is also possible to stop playing the video segment corresponding to the hot zone and execute S606 and S607 to play the video segment corresponding to the gravity sensing type.
[0369] That is, in the embodiments of this application, when the electronic device plays the corresponding video segment according to the determined hot zone identifier, if gravity sensing is detected, it can continue to play the video segment corresponding to the hot zone, or it can stop playing the video segment corresponding to the hot zone and switch to playing the video segment corresponding to the gravity sensing type.
[0370] As another embodiment, such as Figure 19E As shown, when both a hot zone and a gravity sensor are configured, the electronic device displays a lock screen interface. When the electronic device receives both an operation event of clicking the hot zone and a sensor data change reported by the sensor, it can execute the following steps S701 to S703.
[0371] S701 When the live wallpaper service determines both the second and third playback information, it selects the target playback information from the second and third playback information according to the preset playback priority.
[0372] Optionally, after the first video adaptation module in the algorithm module determines the second playback information that matches the hotspot identifier, it can send the second playback information to the video selection algorithm module; after the second video adaptation module in the algorithm module determines the third playback information that matches the sensor data, it can send the third playback information to the video selection algorithm module. Then, the video selection algorithm module can select the information that actually needs to be played subsequently from the second and third playback information according to a preset playback priority.
[0373] For example, the priority of the second playback information can be preset to be higher than that of the third playback information. In other words, the video segment corresponding to the playback hot zone has a higher priority than the video segment corresponding to the gravity sensing type.
[0374] S702, the algorithm module in the live wallpaper service sends the target playback command to the video playback service module.
[0375] The target playback instruction instructs the playback of the corresponding video frame range according to the video segment identifier in the determined target playback information. The target playback instruction carries the video segment identifier selected based on the second and third playback information.
[0376] S703, the video playback service module plays the video according to the third playback instruction.
[0377] For example, if a user shakes their electronic device while it is currently clicking a hotspot, the first video adaptation module can determine the second playback information based on the click event and send it to the video selection algorithm module. The second video adaptation module can determine the third playback information based on sensor data and send it to the video selection algorithm module. After receiving the second and third playback information, the video selection algorithm module filters the data according to a preset playback priority (e.g., the second playback information has a higher priority than the third playback information) and instructs the video playback service to play the video according to the video frame range indicated by the second playback information.
[0378] The above is an example of a live wallpaper being displayed when the electronic device is in motion and the device is equipped with both a hot zone and a gravity sensor.
[0379] Figure 20 and Figure 21 This is a schematic diagram illustrating a setting for the external screen to remain on the lock screen after unlocking, as provided in an embodiment of this application.
[0380] like Figure 20 As shown in (a), the electronic device can detect a user's click on the Settings app on the desktop; in response to the click, the electronic device can switch to displaying the main interface of the Settings app, such as... Figure 20 As shown in (b); the main interface of the settings application includes a search bar, as well as multiple options such as WLAN, Bluetooth, more connections, foldable screen zone, desktop and personalization, display and brightness. Among these, the electronic device can receive user clicks on the foldable screen zone options, such as... Figure 20 As shown in (b); in response to a click on the foldable screen zone option, the electronic device can switch from the main screen to... Figure 21 The foldable screen zone interface shown in (a) is shown in the image.
[0381] In such Figure 21 The foldable screen zone interface shown in (a) displays settings options for the desktop, lock screen, and screen-off. For example, the desktop settings include two options: desktop applications and desktop cards; the lock screen and screen-off settings include a toggle option for "stay on lock screen after unlocking the external screen" and a setting for displaying the external screen when it is off.
[0382] In such Figure 21In the foldable screen zone interface shown in (a), the switch option for "Staying on lock screen after unlocking external screen" is turned off. Correspondingly, the external screen of the electronic device can be switched from an off screen or a screen-off screen to a lock screen as shown in (a). Figure 4 The lock screen interface shown in (b) then, in response to the user's unlocking operation, the external screen of the electronic device will... Figure 4 The lock screen interface shown in (b) is switched to Figure 4 The desktop shown in (d) is shown in the image.
[0383] In such Figure 21 In the foldable screen zone interface shown in (a), in response to the user's click or swipe operation, the "Staying on the lock screen after unlocking the outer screen" switch option changes from off to on, as shown in (a). Figure 21 As shown in (b); correspondingly, the external screen of the electronic device can switch from an off-screen or screen-off interface to, as shown in, Figure 4 The lock screen interface shown in (b) then, in response to the user's unlocking operation, the external screen of the electronic device will... Figure 4 The lock screen interface shown in (b) remains in Figure 4 On the lock screen interface shown in (c); subsequently, after receiving the user's swipe operation, from... Figure 4 The lock screen interface shown in (c) is switched to Figure 4 The desktop shown in (d) is shown in the image.
[0384] The above is an example of setting the external screen to remain on the lock screen after unlocking, as provided in the embodiments of this application.
[0385] Figure 22 and Figure 23 This is a schematic diagram of an interface for switching lock screen themes provided in an embodiment of this application.
[0386] In response to a tap on the foldable screen section of the main settings screen, the electronic device can display... Figure 22 The foldable screen zone interface shown in (a) is similar to... Figure 21 The interface shown in (b) is the same. This foldable screen zone interface includes controls for changing styles.
[0387] Electronic devices can receive click actions for changing the style of controls, such as... Figure 22 As shown in (a); in response to this click operation, the electronic device can switch to Figure 22The style change interface is shown in (b) above. The upper half of the style change interface displays the user's past styles, known as "My Styles," which includes the currently used theme and previously used themes. The lower half of the style change interface also displays theme icons for several preset themes, such as two theme icons for the "Healing Cute Pets" theme.
[0388] Based on this, the electronic device can receive a click action on the first theme icon, such as Figure 22 As shown in (c); in response to this click operation, the electronic device can display a preview interface of the topic indicated by the first topic icon, as shown in (c). Figure 22 As shown in (d) in the image. The upper half of the preview interface displays the preview content, while the lower half displays the theme icons corresponding to the two "Healing Pets" themes. At this time, the first theme icon is selected, as indicated by its thickened border.
[0389] like Figure 22 As shown in (d), the upper right corner of the preview interface also includes application controls; the electronic device can detect clicks on the application controls, such as... Figure 23 As shown in (a); in response to a click on an application control, the previewed theme content can be applied to the lock screen of the outer screen.
[0390] The above is an example of switching the lock screen theme of the outer screen provided in the embodiments of this application.
[0391] Figure 25 This is a flowchart illustrating a method for displaying a live wallpaper, as provided in an embodiment of this application.
[0392] like Figure 25 As shown, the method 2500 may include steps S2501 to S2504. Steps S2501 to S2504 will be described in detail below.
[0393] S2501. In response to the first operation, apply the first theme, which has corresponding video resources, including lock screen wallpaper and multiple videos.
[0394] The first action can be a click, or it can be any other action.
[0395] like Figure 23 As shown, the first operation can be for... Figure 24 The first topic can be the click operation of the application controls included in the interface shown in (a). Figure 24 The preview content included in the interface shown in (a) is shown. In response to a first action on the application controls, the electronic device can apply a first theme.
[0396] It should be noted that the application theme and the method for displaying dynamic wallpapers that play multiple video segments provided in this application embodiment are implemented by code.
[0397] S2502. After applying the first theme, the lock screen is displayed, which includes the lock screen wallpaper.
[0398] In this embodiment of the application, the lock screen interface can be Figure 4 (b) and Figure 4 The interface shown in (c) is shown in the image.
[0399] S2503, responding to a second operation on the lock screen, displays the first video among multiple videos.
[0400] The second action can be a click, or it can be any other action.
[0401] S2504. In response to a third operation applied to the lock screen interface, the second video among multiple video segments is displayed. The third operation is in a different position than the second operation, the second video is different from the first video, and the second video, the lock screen wallpaper, and the first video all share the same target object. This application can achieve rich dynamic wallpaper display effects through user interaction, improving the user experience.
[0402] The third action can be a click, or it can be any other action.
[0403] For example, the target object can be Figure 12 The cat shown is an example. For instance, clicking on the lock screen for the first time will play a first video related to the cat, and clicking on the lock screen for the second time will play a second video related to the same cat. The cat's actions are different in the first and second videos.
[0404] In this embodiment, by performing two operations on different locations on the lock screen, the user can trigger the electronic device to play two different videos related to the same target object, thereby achieving rich display effects and increasing the fun of using the electronic device.
[0405] It should be understood that the third operation can be in the same location as the second operation. This is equivalent to a user performing two operations on the same location, but playing different videos.
[0406] It should be understood that the above examples are provided to help those skilled in the art understand the embodiments of this application, and are not intended to limit the embodiments of this application to the specific values or scenarios illustrated. Those skilled in the art can obviously make various equivalent modifications or changes based on the above examples, and such modifications or changes also fall within the scope of the embodiments of this application.
[0407] Optionally, this application also provides a computer program product that, when executed by a processor, implements the method for displaying a live wallpaper in any of the method embodiments of this application.
[0408] For example, the computer program product can be stored in memory, such as a program, which is eventually converted into an executable object file that can be executed by a processor after processes such as preprocessing, compilation, assembly and linking.
[0409] Optionally, this application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a computer, implements the method for displaying dynamic wallpapers as described in any of the method embodiments of this application. The computer program may be a high-level language program or an executable object program.
[0410] For example, the computer-readable storage medium is, for instance, memory. Memory can be volatile or non-volatile, or it can include both volatile and non-volatile memory. Non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), which serves as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM).
[0411] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0412] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.
[0413] In the embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the embodiments of the electronic devices described above are merely illustrative. For instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interfaces, devices, or units, and may be electrical, mechanical, or other forms.
[0414] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0415] In addition, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.
[0416] It should be understood that in the various embodiments of this application, the sequence number of each process does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0417] Furthermore, the term "and / or" in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.
[0418] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0419] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of protection of the claims. In conclusion, the above description is merely a preferred embodiment of the technical solution of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application.
Claims
1. A method for displaying live wallpapers, characterized in that, The method is applied to an electronic device, specifically a foldable screen device, which includes a first display screen and a second display screen. The first display screen is larger than the second display screen, and the first display screen is foldable while the second display screen is not foldable. After the first lock screen wallpaper is applied to the second display screen, the first lock screen interface is displayed on the second display screen, wherein the first lock screen wallpaper includes multiple video segments, each of which includes a first target object; Receive a first operation applied to the first lock screen interface; The touch area where the first operation is located is determined based on the position of the first operation on the second display screen; When the location of the first operation is within the first touch area, the video identifier of the first video corresponding to the first touch area is obtained from the multiple video segments based on the area identifier of the first touch area, and the first video is determined based on the video identifier of the first video, wherein the first video is displayed on the second display screen, and the video identifier of the first video includes at least the area identifier of the first touch area. When the location of the first operation belongs to the second touch area, the video identifier of the second video corresponding to the second touch area is obtained according to the area identifier of the second touch area. The second video is determined according to the video identifier of the second video, wherein the second video is displayed on the second display screen, and the video identifier of the second video includes at least the area identifier of the second touch area. The first touch area and the second touch area are different, and the first video and the second video are different.
2. The method as described in claim 1, characterized in that, After determining the first video based on its video identifier, the method further includes: Receive the second operation; The touch area where the second operation is located is determined based on the position of the second operation; When the location of the second operation is within the first touch area, a third video corresponding to the first touch area is displayed among the multiple video segments. The third video may be the same as or different from the first video, and the third video may be different from the second video.
3. The method as described in claim 1, characterized in that, The first touch area and the second touch area also satisfy any one or more of the following conditions: The first touch area and the second touch area fill the entire screen area of the second display screen; Both the first touch area and the second touch area are irregularly shaped; The first touch area and the second touch area have different sizes.
4. The method as described in claim 1, characterized in that, The method further includes: A second lock screen wallpaper is applied to the first display screen. The second lock screen wallpaper includes multiple videos, each of which includes a second target object but does not include the first target object. After the second lock screen wallpaper is applied to the second display screen, the second lock screen interface is displayed; The third operation is received on any position of the second display screen in the second lock screen interface; In response to the third operation, one of the multiple videos in the second lock screen wallpaper is displayed in a preset order.
5. The method according to any one of claims 1 to 4, characterized in that, The step of setting a first lock screen wallpaper on the first display screen for the second display screen includes: A settings interface is displayed on the first display screen. The settings interface includes a first control, which is used to set the second display screen of the electronic device. In response to a selection operation on the first control, preview images of multiple lock screen wallpapers to be selected are displayed, including the preview image of the first lock screen wallpaper; After selecting a preview image of the first lock screen wallpaper, the first lock screen wallpaper is applied to the second display screen.
6. The method as described in claim 1, characterized in that, The first touch area has a corresponding first coordinate range, and the second touch area has a corresponding second coordinate range. Determining the touch area where the first operation is located based on the position of the first operation includes: Obtain the first coordinates of the position of the first operation; If the first coordinates are within the range of the first coordinates, the area where the first operation is located is determined to be the first touch area; If the first coordinate falls within the range of the second coordinate, the area where the first operation is located is determined to be the second touch area.
7. The method as described in claim 1, characterized in that, The lock screen wallpaper includes multiple local areas of the first target object that correspond to the same touch area.
8. The method according to any one of claims 1 to 3, characterized in that, The electronic device includes a first camera and a second camera. The first camera and the second camera are disposed on the same side of the hinge of the electronic device along with the second display screen. The first camera and the second camera are arranged close to the long side of the unfolded electronic device, and the first camera and the second camera are not under-display cameras. The second display screen includes a first display area and a second display area. The first display area surrounds the first camera and the second camera, but does not include the area where the first camera and the second camera are located. The first display area and the second display area are arranged along the short side of the unfolded electronic device.
9. The method as described in claim 8, characterized in that, The first display screen area overlaps with at least one first touch area or one second touch area, and the second display screen area overlaps with at least one first touch area or one second touch area. The method further includes: The second display screen shows the interface of a desktop application, wherein the interface of the desktop application includes widgets and multiple application icons, the widgets are displayed in the area of the first display screen, and the application icons are displayed in the area of the second display screen; In response to a trigger operation on the first application icon among the plurality of application icons, the display area of the second display screen switches from displaying the application icon to displaying the application interface of the first application, while the first display screen area continues to display the widget.
10. The method as described in claim 9, characterized in that, The method further includes: In response to a trigger operation on the second application icon among the plurality of application icons, the application interface of the second application is displayed in the full-screen area of the second display screen.
11. The method as described in claim 9, characterized in that, The widgets include one or more of the following: weather information, sports information, health information, date and clock indicators.
12. The method as described in claim 1, characterized in that, The electronic device is a vertically folding device or a horizontally folding device.
13. An electronic device, characterized in that, include: One or more processors, and memory; The memory is coupled to the one or more processors, the memory being used to store computer program code, the computer program code including computer instructions, the one or more processors invoking the computer instructions to cause the electronic device to perform the method as described in any one of claims 1 to 12.
14. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes instructions that, when executed on an electronic device, cause the electronic device to perform the method as described in any one of claims 1 to 12.