Display method and electronic device

Abstract

The present application relates to the technical field of display. Provided are a display method and an electronic device. In response to a sliding operation of a user, an electronic device in an always-on state can display, on a target always-on interface, a sliding trajectory corresponding to the sliding operation. The user can arbitrarily slide on a display screen, and the electronic device can display the sliding trajectory corresponding to the sliding operation, so as to present a doodling effect formed by means of the user sliding on the screen. Thus, the user can perceive a corresponding operation result. Therefore, the interactivity between the electronic device in the always-on state and the user is improved, and the interest of always-on display is enhanced.

Description

A display method and electronic device

[0001] This application claims priority to Chinese Patent Application No. 202411496672.6, filed on October 24, 2024, entitled “A Display Method and Electronic Device”, the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of display technology, and more particularly to a display method and electronic device. Background Technology

[0003] Always-on display (AOD) is a feature of electronic devices that relies on the screen display. It refers to the ability of an electronic device to display the time and date on the screen even when it is off, after the user triggers a screen-off operation (e.g., pressing the power button).

[0004] Taking a mobile phone as an example, when the always-on display function is enabled, the phone can display information such as the time and date on the screen. Typically, when the screen is off, the phone can display a preset always-on image or animation. However, since the phone cannot interact with the user when the screen is off, it reduces the user's interactivity and thus diminishes the user experience. Summary of the Invention

[0005] This application provides a display method and an electronic device. When the electronic device is in a screen-off state, it can respond to a user's swiping operation and display the swiping trajectory corresponding to the swiping operation on the target screen-off interface. This improves the interactivity of the electronic device with the user when the screen is off and enhances the fun of the screen-off display.

[0006] To achieve the above objectives, this application adopts the following technical solution:

[0007] In a first aspect, this application provides a display method applied to an electronic device, the method comprising:

[0008] Electronic devices can receive swipe gestures while in Always-On Display (AOD) mode. The electronic device can also respond to the swipe gesture by displaying the corresponding swipe trajectory on the target always-on display screen.

[0009] Thus, in this embodiment of the application, the electronic device can respond to the user's swiping operation in the screen-off state, displaying the swiping trajectory corresponding to the swiping operation on the target screen-off interface. The user can swipe freely on the display screen, and the electronic device can display the swiping trajectory corresponding to the swiping operation, presenting a doodle effect formed by the user's swiping on the screen. This allows the user to perceive the corresponding operation result.

[0010] This allows electronic devices to interact with users and display the results of those interactions even when the screen is off. This improves the interactivity of electronic devices when the screen is off, enhances the fun of the always-on display, and improves the user experience.

[0011] In one feasible approach, electronic devices can display a sliding trajectory with a target dynamic effect.

[0012] The target dynamic effects include: the swiping trajectory in the target always-on display changes with the position of the operation area corresponding to the swiping operation, and the display style of the swiping trajectory is different from the display style of other areas in the target always-on display; the display style includes at least one of color, fill effect and brightness.

[0013] Thus, in this embodiment, the electronic device can not only display the corresponding sliding trajectory in real time following the user's operation, but also highlight the sliding trajectory. Simultaneously, the user can freely slide on the screen to create different drawing effects. This enhances the interactivity between the device and the user, and also increases the diversity of the sliding trajectory display. Furthermore, it allows users to more intuitively perceive the interaction results with the device and enjoy a better visual experience.

[0014] In one feasible approach, when the target image is displayed in the target always-on display, the brightness of the image area corresponding to the sliding trajectory in the target image is greater than the brightness of other areas in the target image.

[0015] Thus, in the embodiment of this application, the electronic device can display a target image, such as a darkened lock screen wallpaper image, when the screen is off. Responding to the user's swiping operation, the electronic device adjusts the brightness of the image area corresponding to the swiping trajectory in the lock screen wallpaper image to be greater than the brightness of other areas in the lock screen wallpaper image. This allows adjustment of the image brightness of certain image areas in the lock screen wallpaper image, creating the effect of the image appearing to be lit up. When lit up, the lock screen wallpaper image can be seen through this image area, satisfying the user's interactive needs in screen-off scenarios and providing an engaging interactive experience.

[0016] In one feasible approach, the electronic device can enter an interactive mode in response to a trigger operation. The interactive mode is used by the electronic device to perform interactions with the user in AOD state and display the interaction results on the target always-on display.

[0017] Thus, this application provides an interactive mode corresponding to when the electronic device is in AOD (Away From Home) mode. Users can trigger the electronic device to enter this interactive mode and then interact with it. This avoids accidental interaction with the electronic device due to accidental touches on the display screen, improving the user experience.

[0018] In one feasible approach, the electronic device can save the target always-on screen displaying the swipe trajectory after a preset time has elapsed since the contactless operation against the electronic device was detected.

[0019] Thus, this embodiment of the application can save the target always-on display when a preset time has elapsed since a contactless operation on the electronic device was detected. For example, the target always-on display can be saved to a gallery application. This allows the user to view the target always-on display showing the swipe trajectory at any time in the gallery application, thereby improving the user experience.

[0020] In one feasible approach, the electronic device can store position information of the area corresponding to the swipe operation. The electronic device can also, in response to a playback operation on a target always-on display screen, display the swipe trajectory on the target always-on display screen based on the position information. The playback operation includes at least one of a gaze operation or a touch operation.

[0021] Thus, this application embodiment can also provide users with a playback function. The electronic device can directly utilize the saved position information of the corresponding operation area of ​​the historical swipe operation to generate and display multiple frames of target always-on display images. This further enhances the fun of the always-on display and the flexibility and diversity of the display trajectory, thereby improving the user experience.

[0022] In one feasible approach, the electronic device can receive a screen-off event, which triggers the device to enter an Always-On Display (AOD) state. The electronic device can also respond to the screen-off event by displaying an initial always-on display interface. This initial always-on display interface is generated based on a first darkening layer and a target image, where the first darkening layer reduces the brightness of the target image.

[0023] Therefore, in order to enhance the user experience and consider the power consumption of the electronic device, this embodiment of the application can display an initial always-on display image in the initial always-on display interface, and the initial always-on display image is a darkened image. This facilitates subsequent user interaction with the electronic device and effectively displays the interaction results (such as swipe trajectories) to the user intuitively and clearly. This enhances the fun of the always-on display and improves the user experience.

[0024] In one feasible approach, during the process of displaying the swipe trajectory corresponding to a swipe operation on the target always-on display screen, the electronic device can detect the swipe operation and determine the position information of the operation area corresponding to the swipe operation. Based on this position information, the electronic device can determine an adjustment area in a first darkening layer, the position of which corresponds to the position of the operation area. The electronic device can also adjust the transparency of the adjustment area to obtain a second darkening layer; the transparency of the area corresponding to the adjustment area in the second darkening layer is greater than the transparency of other areas in the second darkening layer. Then, the electronic device overlays the second darkening layer onto the target image to generate the target always-on display image, and displays the target always-on display screen.

[0025] Thus, this embodiment of the application can use the method described above, adjusting the transparency of the image area corresponding to the operation area, to display the sliding trajectory. Simultaneously, it can also present a clearer portion of the target image through this sliding trajectory, achieving a display style for the sliding trajectory that differs from the display style of other areas in the target always-on display. This further enhances the fun of the always-on display and the flexibility and diversity of the displayed trajectory, thereby improving the user experience.

[0026] In one feasible approach, the electronic device can also adjust the adjustment area to a transparent area during the process of adjusting the transparency of the adjustment area.

[0027] Thus, this embodiment of the application can use the method described above to adjust the transparency of the image area corresponding to the operation area, making the adjustment area completely transparent to display the sliding trajectory. Simultaneously, it can also present a clearer portion of the target image through this sliding trajectory, achieving a display style for the sliding trajectory that differs from the display style of other areas in the target always-on display. This further enhances the fun of the always-on display and the flexibility and diversity of the displayed trajectory, thereby improving the user experience.

[0028] In one feasible approach, after the electronic device displays the swipe trajectory corresponding to the swipe operation on the target always-on display screen, the initial always-on display screen can be displayed if a preset time is reached when the contactless operation against the electronic device is detected.

[0029] In this way, after a user stops swiping and removes their contact from the display screen for a preset period of time, the electronic device can trigger the restoration of the initial always-on display. This eliminates the need for manual restoration by the user, improving the user experience.

[0030] In one possible implementation, the electronic device includes a touch sensor, a smart sensor hub, and a neural network processor (NPU). The smart sensor hub processes data acquired by the touch sensor, and the NPU processes the image based on the processing results of the smart sensor hub.

[0031] Smart sensor hubs can detect swiping operations on electronic devices and acquire target data, including touch data collected by touch sensors.

[0032] The intelligent sensor hub can also determine the location information of the corresponding operation area based on the target data.

[0033] The smart sensor hub can also determine the adjustment area in the first darkening layer based on location information.

[0034] During the process of adjusting the transparency of the adjustment area to obtain the second darkened layer, the NPU can also adjust the transparency of the adjustment area to obtain the second darkened layer.

[0035] Thus, in this embodiment, image processing can be achieved through the intelligent sensor hub. Simultaneously, even when the CPU is in sleep mode, the sensor hub can be used to control the sensors in real time, process sensor data, and work with the NPU to render the target always-on display image, supporting user interaction in Always-On Display (AOD) mode. This achieves a more interactive and engaging experience for users in always-on display scenarios with low power consumption.

[0036] Secondly, embodiments of this application provide an electronic device, which includes a memory, one or more processors, and a display screen; the memory is coupled to the processor; wherein the display screen is used to display an always-on image, and the memory stores computer program code, which includes computer instructions, and when the computer instructions are executed by the processor, the electronic device performs the display method as described in the first aspect above.

[0037] Thirdly, embodiments of this application provide a computer-readable storage medium storing instructions that, when executed on an electronic device, cause the electronic device to perform the display method described in the first aspect above.

[0038] Fourthly, embodiments of this application provide a computer program product containing instructions that, when executed on a computer or processor, cause the computer or processor to perform the display method described in the first aspect above. Attached Figure Description

[0039] Figure 1 is a schematic diagram of a screen-off image in a related art according to an embodiment of this application;

[0040] Figure 2 is a schematic diagram of the hardware structure of a mobile phone provided in an embodiment of this application;

[0041] Figure 3 is a schematic diagram of the software structure of a mobile phone provided in an embodiment of this application;

[0042] Figure 4 is a flowchart illustrating a display method provided in an embodiment of this application;

[0043] Figure 5 is a schematic diagram of the interface of a first darkening layer provided in an embodiment of this application;

[0044] Figure 6 is a schematic diagram of an interface for a sliding trajectory provided in an embodiment of this application;

[0045] Figure 7 is a schematic diagram of an interface for a sliding trajectory provided in an embodiment of this application;

[0046] Figure 8 is a schematic diagram of an interface for a sliding trajectory provided in an embodiment of this application;

[0047] Figure 9 is a schematic diagram of a target image provided in an embodiment of this application;

[0048] Figure 10 is a flowchart of generating a target always-on image according to an embodiment of this application;

[0049] Figure 11 is a schematic diagram of the interface for the transparency of a first darkened layer provided in an embodiment of this application;

[0050] Figure 12 is an interactive schematic diagram of generating a target always-on display image provided in an embodiment of this application;

[0051] Figure 13 is a schematic diagram of the structure of a mobile phone provided in an embodiment of this application. Detailed Implementation

[0052] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of this application, unless otherwise stated, " / " indicates that the objects before and after are in an "or" relationship. For example, A / B can represent A or B. "And / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone, where A and B can be singular or plural. Furthermore, in the description of this application, unless otherwise stated, "multiple" refers to two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple. In addition, in order to clearly describe the technical solutions of the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish the same or similar items with basically the same function and effect.

[0053] Those skilled in the art will understand that the terms "first," "second," etc., do not limit the quantity or order of execution, and that "first," "second," etc., are not necessarily different. Furthermore, in some embodiments of this application, words such as "exemplary" or "for example" are used to indicate that something is being described as an example, illustration, or description. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner for ease of understanding.

[0054] Furthermore, the device architecture and business scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the evolution of device architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0055] In related technologies, the always-on display function automatically displays a preset always-on image after the electronic device is turned off.

[0056] For example, referring to Figure 1(A), the always-on display image can be a time image. The electronic device can automatically display the time image after the screen is turned off, allowing the user to obtain current time information, such as date and time. Alternatively, referring to Figure 1(B), the always-on display image can also be a preset animation, i.e., a dynamic image. It can be seen that, on the one hand, this display method is relatively simple, resulting in low engagement with the always-on display content. On the other hand, it only allows for fixed triggers to display the always-on display image, lacking interaction between the user and the electronic device. Therefore, it reduces the user experience.

[0057] Based on the above, this application provides a display method that can be applied to an electronic device. The method includes: the electronic device receiving a swipe operation in an Always-On Display (AOD) state; and the electronic device also responding to the swipe operation by displaying the swipe trajectory corresponding to the swipe operation on a target always-on display screen.

[0058] Thus, in the display method provided in this application embodiment, the electronic device can respond to the user's swiping operation in the screen-off state and display the swiping trajectory corresponding to the swiping operation on the target screen-off interface. In this way, the user can swipe freely on the display screen, and the electronic device can display the swiping trajectory corresponding to the swiping operation, presenting a doodle effect formed by the user swiping on the screen. Therefore, the user can perceive the corresponding operation result.

[0059] This allows electronic devices to interact with users and display the results of those interactions even when the screen is off. This improves the interactivity of electronic devices when the screen is off, enhances the fun of the always-on display, and improves the user experience.

[0060] For example, the display method provided in this application embodiment can be applied to electronic devices with always-on display functions, such as mobile phones, smartwatches, tablets, foldable electronic devices, desktop computers, laptops, handheld computers, laptops, Ultra-Mobile Personal Computers (UMPCs), netbooks, cellular phones, Personal Digital Assistants (PDAs), Augmented Reality (AR) devices, Virtual Reality (VR) devices, Artificial Intelligence (AI) devices, wearable devices, and in-vehicle devices. This application embodiment does not impose any special limitations on the specific type of electronic device.

[0061] Furthermore, the operating system installed on the electronic device provided in this application embodiment includes, but is not limited to, those that... Or other operating systems. This application does not limit the specific type of electronic device or the type of operating system installed thereon.

[0062] For example, taking a mobile phone as an example, Figure 2 is a schematic diagram of the hardware structure of a mobile phone provided in an embodiment of this application. As shown in Figure 2, the mobile phone 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0063] The aforementioned sensor module 180 may include sensors such as a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, and a bone conduction sensor 180M. In some embodiments, the sensor module 180 may also include an image sensor, which can collect user gaze data on the electronic device. The intelligent sensor hub determines the location information of the user's corresponding operating area, such as the gaze area, based on the gaze data. In other embodiments, the aforementioned sensor module 180 may be a sensor hub.

[0064] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the mobile phone 100. In other embodiments of this application, the mobile phone 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0065] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0066] The controller can serve as the central nervous system and command center of the mobile phone 100. Based on the instruction operation code and timing signals, the controller generates operation control signals to control the fetching and execution of instructions.

[0067] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0068] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0069] The wireless communication function of mobile phone 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0070] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in mobile phone 100 can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0071] The mobile phone 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0072] Display screen 194 is used to display the always-on display interface, etc., when the always-on display (AOD) state is in progress.

[0073] The display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a minimized display, a microLED, a micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the mobile phone 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0074] The mobile phone 100 can achieve shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0075] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization on image noise and brightness. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0076] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, mobile phone 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0077] The mobile phone 100 can use its camera function to capture an image when it detects that a user is looking at the display screen 194 or receives a photo capture command, thereby obtaining a first image. The first image is then sent to the processor 110, so that the processor 110 can execute the gaze region recognition method provided in this application to determine the location information corresponding to the gaze region.

[0078] The mobile phone 100 can achieve audio functions such as music playback and recording through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0079] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Mobile phone 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, mobile phone 100 detects the touch operation intensity based on pressure sensor 180A. Mobile phone 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example: when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0080] The gyroscope sensor 180B can be used to determine the motion posture of the mobile phone 100. The barometric pressure sensor 180C is used to measure air pressure. The magnetic sensor 180D includes a Hall sensor. The mobile phone 100 can use the magnetic sensor 180D to detect the opening and closing of the flip case. The accelerometer sensor 180E can detect the magnitude of the acceleration of the mobile phone 100 in various directions (generally three axes). When the mobile phone 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.

[0081] A distance sensor 180F is used to measure distance. The mobile phone 100 can measure distance via infrared or laser. In some embodiments, during a shooting scenario, the mobile phone 100 can utilize the distance sensor 180F to measure distance for fast focusing.

[0082] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The mobile phone 100 emits infrared light outward through the LED. The mobile phone 100 uses the photodiode to detect infrared reflected light from nearby objects. The ambient light sensor 180L is used to sense the ambient light intensity. The fingerprint sensor 180H is used to collect fingerprints. The mobile phone 100 can utilize the collected fingerprint characteristics to achieve fingerprint unlocking, app access lock, fingerprint photography, fingerprint answering of calls, etc.

[0083] Temperature sensor 180J is used to detect temperature. In some embodiments, mobile phone 100 uses the temperature detected by temperature sensor 180J to execute a temperature processing strategy. Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K is used to detect touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In some examples, touch sensor 180K can collect touch data from the user on the electronic device, and the smart sensor hub can determine the location information of the corresponding user operation area based on the touch data.

[0084] In other embodiments, the touch sensor 180K may also be located on the surface of the mobile phone 100, in a different position than the display screen 194.

[0085] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords.

[0086] In some embodiments, the smart sensor hub determines the adjustment area in the image based on location information to adjust the brightness of a portion of the always-on display.

[0087] The software system of mobile phone 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses the layered architecture Android system as an example to illustrate the software structure of mobile phone 100.

[0088] Figure 3 is a schematic diagram of the software structure of a mobile phone according to an embodiment of this application.

[0089] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0090] The application layer can include a series of application packages.

[0091] As shown in Figure 3, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0092] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0093] As shown in Figure 3, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0094] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0095] Content providers store and retrieve data, making that data accessible to applications. This data can include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, and more.

[0096] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0097] The phone manager is used to provide communication functions for the mobile phone 100. For example, it manages call status (including connection, hang-up, etc.).

[0098] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0099] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0100] The Android Runtime consists of core libraries and a virtual machine. The Android Runtime is responsible for the scheduling and management of the Android system.

[0101] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0102] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0103] The system library can include multiple functional modules, such as a display module, an acquisition module, a processing module, and an image generation module.

[0104] In some embodiments, the display module is used to display a target always-on display interface with a target dynamic effect. The acquisition module is used to detect swiping operations, touch operations, or gaze operations on the mobile phone, and acquire target data, which includes at least one of gaze data collected by an image sensor or touch data collected by a touch sensor. The processing module is used to determine the position information of the operation area corresponding to the user operation based on the target data, and to determine the adjustment area in the first darkening layer based on the position information. The image generation module is used to adjust the transparency of the adjustment area to obtain a second darkening layer.

[0105] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0106] The following will describe in detail a display method provided by an embodiment of this application with reference to the accompanying drawings. All embodiments described below use an electronic device with an always-on display function as an example.

[0107] In some embodiments of this application, the electronic device can enter an AOD state, as shown in Figure 4(A).

[0108] S401. The electronic device receives a screen-off event, which is used to trigger the electronic device to enter AOD state.

[0109] In some embodiments of this application, the electronic device can receive a screen-off event input by the user, which can be used to trigger the electronic device to enter the AOD state.

[0110] For example, a screen-off event could be an event where a user presses the power button when the screen of an electronic device is on.

[0111] For example, a screen-off event can be an event that occurs when no user interaction is detected for a certain period of time while the screen of an electronic device is on.

[0112] It should be noted that the embodiments of this application do not specifically limit the screen-off events input by the user.

[0113] S402. The electronic device responds to the screen-off event and displays the initial screen-off interface.

[0114] For example, the initial always-on display may show an initial always-on image. For instance, the initial always-on image may be a target image that has been darkened. It is understood that the image brightness after darkening is lower than the image brightness of the undarkened image.

[0115] In one feasible approach, the electronic device can respond to a screen-off event by darkening the target image according to preset darkening parameters, generating an initial screen-off image, and displaying the initial screen-off image on the initial screen-off interface.

[0116] In one possible implementation, the initial always-on display can be generated based on a first darkening layer and a target image. For example, the electronic device can overlay the first darkening layer onto the target image to generate the initial always-on display image. The first darkening layer is used to reduce the image brightness of the target image.

[0117] For example, the target image can be the wallpaper image corresponding to the lock screen interface of an electronic device. Typically, the darkening layer is a black layer. The electronic device can control the transparency value of the pixels in the first darkening layer according to preset darkening parameters. Thus, it controls whether the initial always-on display image shows the content of the original target image layer or the black content of the first darkening layer.

[0118] In some examples, the transparency data of pixels in a layer can characterize the transparency of pixel colors, indicating how many pixel values ​​should be displayed. For instance, when two layers, a first layer and a second layer, are overlaid, the transparency of pixels in the first layer can control whether the display shows the image colors of the first layer or the second layer, or the proportion by which the first and second layers are mixed to display a new color. The transparency of pixel colors can also be represented numerically, and this value can be called the pixel's transparency value, typically represented by 0-255. When the transparency value of a pixel area is 0, the transparency of that pixel area is 100%, meaning that area is transparent. When the transparency value of a pixel area is 255, the transparency of that pixel area is either 0% or 100%, meaning that area is opaque.

[0119] It should be noted that transparency refers to the visibility of an element or color, and can be expressed as a percentage (%) or a decimal (between 0 and 1). A transparency of 1 or 100% indicates that the element or color is completely opaque, while a transparency of 0 or 0% indicates that the element or color is completely transparent, i.e., invisible. This application does not specifically limit the way transparency is represented.

[0120] When the transparency value of the pixels in the first layer is less than or equal to the first transparency threshold, and the first and second layers are superimposed, the human eye cannot distinguish the difference between the color displayed on the screen and the second layer (it can be assumed that the screen does not display the image color of the first layer). Therefore, the pixels in the first layer can be considered transparent, and such pixels can also be called transparent pixels.

[0121] When the transparency value of the pixels in the first layer is greater than or equal to the second transparency threshold, and the first and second layers are superimposed, the human eye cannot distinguish the difference between the color displayed on the screen and the first layer (it can be assumed that the screen does not display the color of the second layer). Therefore, the pixels in the first layer can be considered to be opaque, and such pixels can be called opaque pixels. A transparency value between the first and second transparency thresholds can be considered to indicate that the pixel is semi-transparent, that is, between transparent and opaque.

[0122] For example, the first transparency threshold can be 0, and the second transparency threshold can be 255. It should be noted that this application does not limit the specific values ​​corresponding to the first and second transparency thresholds. When the transparency value of the first layer is 0, the pixels of the first layer are transparent, i.e., transparent pixels. Thus, when the first and second layers are superimposed, the display screen does not show the image color of the first layer, but the user's eye can perceive that the color displayed on the screen is the image color of the second layer.

[0123] For example, when the opacity value of the first layer is 255, the pixels of the first layer are opaque. Therefore, when the first and second layers are overlaid, the screen does not display the image colors of the second layer; the user's eye will perceive the colors displayed as those of the first layer.

[0124] In some embodiments of this application, the first darkening layer can be the first layer described above, and the layer containing the target image can be the second layer described above. During the process of darkening the target image according to preset darkening parameters, the preset darkening parameters may include the transparency values ​​of the pixels in the first darkening layer, which are determined according to a preset ratio.

[0125] Of course, the preset darkening parameters can also include the transparency values ​​of the pixels in the layer containing the target image, and the transparency values ​​of the pixels in the layer containing the target image can also be determined according to the preset ratio.

[0126] For example, the preset ratio can be 100%. The preset darkening parameters include the transparency value of the pixels in the first darkening layer, which is set to 255. Thus, referring to Figure 5(A), the pixels of the first darkening layer are opaque, i.e., opaque pixels. In this way, when the first darkening layer and the target image are superimposed, the display screen does not show the image color of the target image, and the user's eye can see that the color displayed on the screen is the black of the first darkening layer.

[0127] For another example, the preset ratio can be 60%. The preset darkening parameters include the transparency value of the pixels in the first darkening layer, which is set to 163. Thus, referring to Figure 5(B), the pixels of the first darkening layer are semi-transparent pixels. In this way, when the first darkening layer and the target image are superimposed, the display shows the new image color after the first darkening layer and the target image are mixed, that is, the brightness of the target image is reduced and the color is darkened.

[0128] For another example, the preset ratio can be 40%. The preset darkening parameters include the transparency value of the pixels in the first darkening layer, which is set to 102. Thus, referring to Figure 5(C), the pixels in the first darkening layer are semi-transparent pixels. When the first darkening layer and the target image are superimposed, the display shows the new image color after the first darkening layer and the target image are mixed; that is, the brightness of the target image is further reduced, and the color becomes darker. In other words, compared to Figure 5(C), a larger preset ratio results in a higher degree of darkening, and a smaller preset ratio results in a higher degree of transparency.

[0129] In some embodiments of this application, the target image can be a static image or a dynamic image. The target image can also be an animation, such as a video of a certain duration. Similarly, the initial always-on display image can be a static image or a dynamic image. It should be noted that the embodiments of this application do not limit the implementation form of the target image or the initial always-on display image.

[0130] Therefore, in order to enhance the user experience and consider the power consumption of the electronic device, this embodiment of the application can display an initial always-on display image in the initial always-on display interface, and the initial always-on display image is a darkened image. This facilitates subsequent user interaction with the electronic device and effectively displays the interaction results (such as swipe trajectories) to the user intuitively and clearly. This enhances the fun of the always-on display and improves the user experience.

[0131] In another possible implementation, the electronic device can respond to a screen-off event, generate a timed screen-off image, and display the timed screen-off image on the initial screen-off interface.

[0132] For example, the time-based always-on display image can be seen in Figure 1(A). The time-based always-on display image can be generated based on a first darkening layer, time information, and a target image. For instance, the target image is a pure white image, and the first darkening layer corresponds to a darkening ratio of 60% in the preset darkening parameters. In this case, most areas of the time-based always-on display image appear gray, meaning the color is darker than black. This allows users to swipe on the time-based always-on display image to interact with the electronic device.

[0133] It should be noted that the embodiments of this application do not limit the number or display format of the images displayed on the initial always-on display screen.

[0134] Thus, the electronic device in this embodiment can display an initial always-on display image, such as a time-based always-on display image, on the initial always-on display screen. This facilitates subsequent user interaction with the electronic device and effectively displays the interaction results (such as swipe trajectories) to the user. This enhances the appeal of the always-on display and improves the user experience.

[0135] In some embodiments of this application, after the electronic device enters the AOD state, it can interact with the user and display the sliding trajectory corresponding to the sliding operation, as shown in Figure 4(B).

[0136] S410. When the electronic device is in Always-On Display (AOD) mode, it receives a swipe operation on the electronic device.

[0137] S411. In response to a swipe operation, the electronic device displays the swipe trajectory corresponding to the swipe operation on the target always-on display.

[0138] In some embodiments of this application, the electronic device can receive and detect user-input swipe operations, and display the corresponding swipe trajectory on the target always-on display. That is, the swipe trajectory on the target always-on display corresponds to the area operated by the user. In this way, the user can interact with the electronic device and freely control the display effect of the always-on display.

[0139] In some examples, a swipe operation can be a user's finger sliding across the display screen. It should be noted that users can also input other operations on the electronic device; this application does not specifically limit the user's input operations.

[0140] In one possible implementation, referring to (A) in Figure 6, the electronic device responds to the swipe operation by displaying the swipe trajectory corresponding to the swipe operation in real time on the target always-on display.

[0141] In another possible implementation, referring to Figure 6(B), the electronic device can also detect the user's action of removing themselves from the electronic device, i.e., the user swiping on the display screen and then removing themselves from the display screen. In response to this action, the electronic device displays the swipe trajectory corresponding to the swipe action on the target always-on display.

[0142] In other words, this embodiment of the application can display the corresponding sliding trajectory in real time as the user slides. It can also display the corresponding sliding trajectory only after the user stops sliding and removes their contact with the display screen.

[0143] Thus, the embodiments of this application provide different implementations of the display sliding trajectory, which not only enhances the interactivity between the device and the user, but also increases the diversity of display effects in AOD mode. This, in turn, improves the user experience.

[0144] In some embodiments of this application, during the process of displaying the sliding trajectory corresponding to the sliding operation in the target always-on display interface, the electronic device can display the sliding trajectory with the target dynamic effect.

[0145] The target dynamic effect includes: the swiping trajectory in the target always-on display changes with the position of the corresponding operation area as the swiping operation changes, and the display style of the swiping trajectory is different from the display style of other areas in the target always-on display. The display style includes at least one of color, fill effect, and brightness.

[0146] In other words, the area where a user's finger slides changes gradually during the swipe operation. Thus, when the electronic device displays the swipe trajectory in real time, the swipe trajectory on the target always-on screen changes according to the position of the corresponding operation area.

[0147] For example, referring to Figure 7(A), when the finger slides to the first position, the corresponding operation area is the first region. At this time, the operation area can be located at the first target position on the display screen, and the electronic device can display the first trajectory. Referring to Figure 7(B), when the finger slides to the second position, the corresponding operation area is the second region. At this time, the operation area can be located at the second target position on the display screen, and the electronic device can display the second trajectory. The area of ​​the second region is larger than that of the first region, and the second trajectory is longer than the first trajectory.

[0148] Furthermore, the display style of the swipe trajectory differs from the display style of other areas in the target always-on display. This display style includes at least one of color, fill effect, and brightness.

[0149] In other words, to display the sliding trajectory clearly, it's necessary to differentiate its display from that of other areas of the interface. The sliding trajectory should be highlighted so that users can clearly and intuitively see it.

[0150] In one possible implementation, the color of the swipe trajectory is different from the area color of other areas in the target always-on display.

[0151] For example, continuing to refer to Figure 7, the trajectory color of the sliding path can be white, and the area color of other areas in the target always-on display can be gray. Of course, the trajectory color and the area color can be different colors, or they can be colors of the same color family. This embodiment of the application only needs to enable the trajectory to be highlighted, and does not specifically limit the display color of the sliding path.

[0152] In one possible implementation, the trajectory filling effect of the swipe path differs from the area filling effect of other areas in the target always-on display.

[0153] For example, the fill effect of the sliding trajectory can be a pattern fill effect, such as a rectangular fill effect, while the fill effect of other areas in the target always-on display can be a gray fill effect. In other words, during the display of the sliding trajectory, the electronic device can display the sliding trajectory with a pattern fill to give it a pattern fill effect. Meanwhile, other areas of the target always-on display can remain darkened with the initial always-on image to present a gray fill effect.

[0154] Of course, the fill effect of the sliding trajectory and the fill effect of the area can be different or similar. This embodiment only needs to ensure the trajectory is highlighted; it does not specifically limit the fill effect of the sliding trajectory.

[0155] In another possible implementation, the brightness of the area where the swipe trajectory is located is different from the brightness of other areas in the target always-on display.

[0156] For example, the brightness of the area where the sliding trajectory is located can be a first brightness, and the brightness of other areas in the target always-on display can be a second brightness. The first brightness is greater than the second brightness. For example, the regional brightness can be achieved using the pixel values ​​corresponding to the region. That is, the area where the sliding trajectory is located and other areas in the target always-on display both correspond to the image areas of the image displayed in the target always-on display. During the display of the target always-on display, the first image area of ​​the image displayed in the target always-on display can be the area where the sliding trajectory is located, and the second image area is the area where the other areas mentioned above are located.

[0157] The second image region is the image region other than the first image region. In this way, the pixel values ​​of the first image region can be higher than those of the second image region to highlight the sliding trajectory.

[0158] It should be noted that the embodiments of this application only need to make the trajectory stand out, and do not specifically limit the brightness of the area where the sliding trajectory is located.

[0159] In some embodiments of this application, the brightness of the area where the sliding trajectory is located is different from the brightness of other areas in the target always-on display. Specifically, the sliding trajectory may also include multiple target areas. The target areas change with the position of the operation area corresponding to the sliding operation, and the brightness of the target areas is greater than the brightness of other areas in the target always-on display during the process from the start to the end of the sliding operation.

[0160] In other words, the swipe trajectory can also be divided into multiple target areas. These target areas change position according to the corresponding operation area during the swipe, and the brightness of multiple target areas is greater than the brightness of other areas in the target always-on display during the entire swipe process. This creates the effect of lighting up a portion of the target always-on display (the area where the swipe trajectory is located), enhancing the visual appeal of the always-on display and improving the user experience.

[0161] Thus, in this embodiment, during the display of the sliding trajectory, it not only follows the user's operation and displays the corresponding sliding trajectory in real time, but also highlights the sliding trajectory. Simultaneously, the user can freely slide on the screen to create different drawing effects. This enhances the interactivity between the device and the user, and also increases the diversity of the sliding trajectory display. Furthermore, it allows users to more intuitively perceive the interaction results with the device and enjoy a better visual experience.

[0162] In some embodiments of this application, when a target image is displayed in a target always-on display, the brightness of the image area corresponding to the sliding trajectory in the target image is greater than the brightness of other areas in the target image.

[0163] For example, referring to Figure 8(A), the initial always-on display can show a darkened target image, i.e., a darkened lock screen wallpaper image. As the user slides their finger, they can draw a circle. Referring to Figure 8(B), the brightness of the area where the sliding trajectory occurs in the target always-on display increases, so the brightness of the image area corresponding to the sliding trajectory in the lock screen wallpaper image is greater than the brightness of other areas in the lock screen wallpaper. For example, the image area corresponding to the sliding trajectory in the lock screen wallpaper image is displayed without darkening, while other areas of the lock screen wallpaper image remain darkened. In this way, the user can see part of the image in the lock screen wallpaper image through the sliding trajectory.

[0164] Thus, in this embodiment of the application, the user can interact with the electronic device, which can display a darkened lock screen wallpaper image when the screen is off. Responding to the user's swipe operation, the electronic device can adjust the brightness of a portion of the lock screen wallpaper image, creating the effect of the image appearing lit up. Once lit, the lock screen wallpaper image can be seen through this area, satisfying the user's interactive needs in screen-off scenarios and providing an engaging interactive experience.

[0165] In other embodiments of this application, referring to Figures 9(A)-9(B), the target image can be, for example, a pure white image. In this way, during a user's swiping operation, the electronic device can also present an effect as if the image is lit up, satisfying the user's interactive needs in screen-off scenarios.

[0166] It should be noted that the embodiments of this application do not specifically limit the target image.

[0167] In some embodiments of this application, the user can also perform a trigger operation while the electronic device is in AOD (Away From Home) mode to trigger entry into the corresponding interactive mode of the electronic device. After the electronic device enters the interactive mode in AOD mode, the user can then input a swipe operation on the display screen.

[0168] Specifically, the electronic device can enter an interactive mode in response to a trigger operation. The interactive mode is used by the electronic device to perform interaction with the user in AOD state and display the interaction results on the target always-on display.

[0169] The triggering operation can include user touch operations on the display screen, such as single-click and double-click operations. The triggering operation can also include user swipe operations on the display screen, such as swiping up, swiping down, swiping left, and swiping right. The triggering operation can also include voice operations for interactive modes. It should be noted that this application embodiment does not limit the specific implementation method of the triggering operation.

[0170] In this way, the electronic device can respond to the trigger operation and enter the interactive mode corresponding to the AOD state. Only after the electronic device activates the interactive mode can it provide interactive functions to the user, that is, perform interactions with the user and display the interaction results on the target always-on display screen.

[0171] Therefore, this application also provides an interactive mode corresponding to when the electronic device is in AOD (Away From Home) state. Users can trigger the electronic device to enter this interactive mode and then interact with it. This avoids accidental interaction with the electronic device due to accidental touches on the display screen, thus improving the user experience.

[0172] In some embodiments of this application, when the electronic device detects that a disengagement operation against the electronic device has reached a preset time, it saves the target always-on screen displaying the sliding trajectory.

[0173] After a user stops swiping and removes their contact from the display screen for a preset period of time, the electronic device can trigger the termination of the interaction process. After the user stops interacting with the electronic device, the device can save the result of the interaction.

[0174] For example, the preset time can be 3 seconds. If the electronic device detects that the contact has been disconnected for more than 3 seconds, it can save the target always-on display with the sliding trajectory. It should be noted that this application embodiment does not specifically limit the value corresponding to the preset time.

[0175] In one possible implementation, the target always-on display can show a target always-on image, which may include a sliding trajectory, and the electronic device can directly save the target always-on display image shown in the target always-on display.

[0176] In another possible approach, the electronic device can also take a screenshot of the target always-on display and save the screenshot. The screenshot includes the swipe gesture. The electronic device can then save the screenshot or the target always-on display image to its gallery application.

[0177] In this way, by saving the target always-on display screen showing the swipe trajectory, users can later open the Gallery app to view the target always-on display screen showing the swipe trajectory at any time, thereby improving the user experience.

[0178] Simultaneously, users can also utilize the aforementioned interactive functions in AOD (Always-On Display) mode to save text. For example, if a user wants to record a phone number, they can swipe on the screen. The electronic device will then save the target always-on display showing the swipe path corresponding to the phone number. This enhances the diversity of user scenarios and provides a more convenient user experience.

[0179] In some embodiments of this application, after the electronic device displays the sliding trajectory corresponding to the sliding operation in the target always-on display, it can also display the initial always-on display when a preset time is reached after detecting that the contactless operation against the electronic device has been completed.

[0180] In this way, after a user stops swiping and removes their contact from the display screen for a preset period of time, the electronic device can not only save the interaction with the user, but also trigger the restoration of the initial always-on display. This eliminates the need for the user to manually restore the display, improving the user experience.

[0181] For example, the preset time can be 3 seconds. If the electronic device detects that the contactless operation has been off for more than 3 seconds, it can restore the initial always-on display screen in the AOD state.

[0182] In some embodiments of this application, during the process of the electronic device displaying the sliding trajectory corresponding to the sliding operation on the target always-on display screen, the electronic device can detect the sliding operation on the electronic device and determine the position information of the operation area corresponding to the sliding operation. The electronic device can also determine the adjustment area in the first darkening layer based on the position information, and the position of the adjustment area corresponds to the position of the operation area. Then, the electronic device can adjust the transparency of the adjustment area to obtain a second darkening layer; the transparency of the area corresponding to the adjustment area in the second darkening layer is less than the transparency of other areas in the second darkening layer. Finally, the electronic device can overlay the second darkening layer with the target image to generate the target always-on display image and display the target always-on display screen.

[0183] Specifically, referring to Figure 10, the electronic device can collect target data such as screen capacitance data, which is used to characterize the user's contact with the display screen. The electronic device can determine the position information of the operation area corresponding to the sliding operation based on the screen capacitance data (S1001), that is, the position information of multiple contact points during the sliding process. It should be noted that the target data may also include screen resistance value data, etc., and this embodiment does not limit the specific form of the target data.

[0184] The screen capacitance data can be detected and collected by the touchscreen of the electronic device. When a user touches the touchscreen, a contact area is formed between the touchscreen and the user. The touch sensor in the touchscreen can then detect and collect the corresponding screen capacitance data. For example, the touchscreen of the electronic device can be a capacitive touchscreen, a resistive touchscreen, or an inductive touchscreen.

[0185] It should be noted that the touchscreen can detect and collect target data in real time or periodically.

[0186] In some embodiments of this application, when an electronic device determines the location information of the operating area based on the screen capacitance data, it can extract the corresponding coordinate data from the screen capacitance data to determine the location information of the operating area.

[0187] For example, using a 480×800 screen as an example, a screen coordinate system can be established, with the top-left corner at (0, 0), the top-right corner at (480, 0), the bottom-left corner at (0, 800), and the bottom-right corner at (480, 800). The electronic device can determine the position of the coordinate data in the collected screen capacitance data within the screen coordinate system, thus determining the position information of the operation area corresponding to the sliding operation. It is understood that the collected screen capacitance data may include a large amount of coordinate data. This large amount of coordinate data can be processed to determine the center point position information corresponding to each contact point. Then, based on the center point position information of each contact point, the position information of the operation area corresponding to the sliding operation is determined.

[0188] Referring again to Figure 10, to make the subsequent sliding trajectory display smoother, the electronic device can utilize the Bezier curve principle when determining the position information of the operation area corresponding to the sliding operation based on the center point position information of each contact point. Specifically, the electronic device can perform curve fitting and segmented adjustment processing on the position information of the operation area corresponding to the sliding operation (the center point position information corresponding to multiple contact points) (S1002), thereby making the operation area change more smoothly and evenly.

[0189] In some examples, as the sliding trajectory is displayed in real time, the adjustment area of ​​the first darkening layer continuously changes as the position of the operation area changes. For instance, if the first operation area is from point A to point B, and the second operation area is from point B to point C, then the adjustment area will change from the area from point A to point B to the area from point B to point C. In this way, by changing the transparency of the adjustment area and overlaying the target image, multiple frames of the target always-on display image are generated, thus presenting the process of displaying the sliding trajectory in real time.

[0190] Referring again to Figure 10, after determining the position information of the operation area corresponding to the sliding operation, the electronic device determines the adjustment area in the first darkening layer based on the position information and adjusts the transparency of the adjustment area to obtain the second darkening layer (S1003). The position of the adjustment area corresponds to the position of the operation area. Then, the electronic device can overlay the second darkening layer with the target image to generate the target always-on display image (S1004) and display the target always-on display image on the target always-on display screen.

[0191] In one possible implementation, the electronic device can reduce the transparency of the adjustment area during the process of adjusting the transparency of the adjustment area, so that the transparency of the adjustment area is lower than the transparency of the areas other than the adjustment area in the first darkening layer.

[0192] For example, referring to Figure 11(A), when the opacity of the first darkening layer is 163, the opacity of the adjustment area can be set to 100. The opacity of the areas other than the adjustment area in the first darkening layer remains 163, and the opacity of the adjustment area is lower than that of the areas other than the adjustment area in the first darkening layer. In this way, the second darkening layer can show the change in brightness of different areas, increasing the brightness of the adjustment area, that is, the color becomes brighter.

[0193] In another possible approach, the electronic device can directly adjust the adjustment area to a transparent area during the process of adjusting the transparency of the adjustment area.

[0194] For example, see Figure 11(B), when the opacity of the first darkening layer is 163. The opacity of the adjustment area can be set to 0, making it transparent. The opacity of the areas outside the adjustment area in the first darkening layer remains 163. This allows the second darkening layer to show more pronounced changes in different areas, with the adjustment area becoming brighter.

[0195] Referring to (C) in Figure 11, the electronic device can overlay the second darkening layer onto the target image to generate a target always-on display image. The electronic device can then display this target always-on display image, allowing the user to see a portion of the target image in the corresponding adjusted area, such as a portion of the lock screen wallpaper image.

[0196] Thus, this embodiment of the application can use the method described above, adjusting the transparency of the image area corresponding to the operation area, to display the sliding trajectory. Simultaneously, it can also present a clearer portion of the target image through this sliding trajectory, achieving a display style for the sliding trajectory that differs from the display style of other areas in the target always-on display. This further enhances the fun of the always-on display and the flexibility and diversity of the displayed trajectory, thereby improving the user experience.

[0197] In some embodiments of this application, in order to display the sliding trajectory and to make the display style of the sliding trajectory different from the display style of other areas in the target always-on display interface, the display process of the sliding trajectory can be implemented by combining a brush as the trajectory input tool with an image processing process.

[0198] Among them, the brush is a tool in image editing software. It can be used directly in the form of a paintbrush. Using the brush, you can change the display effect of image areas, such as adding some preset patterns to the image.

[0199] Electronic devices can have multiple preset brush templates, each producing different trails. For example, if the brush template is a rose, the trail will also be formed by roses. As another example, if the brush template is a pink line, the trail will also be formed by pink lines. As yet another example, if the brush template is a sand art type brush, the trail will have a sand art effect. As yet another example, if the brush template is a crayon type brush, the trail will have a crayon effect.

[0200] In some examples, the brush template corresponds to brush information, which includes animation configuration information for configuring the animation effect corresponding to the trajectory, so as to achieve a specific animation effect through the animation configuration information. Furthermore, the brush information may also include configuration information for configuring the shape, size, scaling, offset, and rotation angle of the target area in the sliding trajectory. It should be noted that this application embodiment does not specifically limit the implementation method of the sliding trajectory display style.

[0201] In one possible implementation, the target area in the sliding trajectory can correspond to the user's sliding operation area. The electronic device can combine brush information and target data to determine the position information of the operation area corresponding to the sliding operation. This allows subsequent processes such as adjusting the opacity of the first darkened layer and overlaying the target image to proceed.

[0202] Thus, in this embodiment of the application, a brush tool can be used to make the display style of the above-mentioned sliding trajectory different from the display style of other areas in the target always-on display interface.

[0203] Specifically, electronic devices can display the user's swipe trajectory in corresponding strokes based on the currently used brush template and the read brush information. Since the aforementioned animation configuration information is used to configure the animation effects of the trajectory, the displayed swipe trajectory has corresponding animation effects to highlight it in the target always-on display. This provides users with a more vivid interactive experience.

[0204] In some embodiments of this application, the electronic device may also provide the user with a playback function for the sliding trajectory, that is, the user can review the sliding trajectory.

[0205] Specifically, the electronic device can also store the position information of the operation area corresponding to the swipe operation. In response to a playback operation on a target always-on display screen, the electronic device can display the swipe trajectory on the target always-on display screen based on the position information. The playback operation includes at least one of a gaze operation or a touch operation.

[0206] For example, electronic devices can collect touch data corresponding to touch operations through touch sensors, or image data collected through cameras or image sensors.

[0207] After collecting contact data or determining the user's eye gaze based on image data, the electronic device directly performs the process of adjusting the transparency of the first darkened layer and overlaying the target image based on the position information of the operation area corresponding to the saved swipe operation.

[0208] This displays the sliding trajectory. It should be noted that the process of adjusting the opacity of the first darkened layer and overlaying the target image is similar to the above embodiment, and will not be repeated here.

[0209] Thus, this application embodiment can also provide users with a playback function. The electronic device can directly utilize the saved position information of the corresponding operation area of ​​the historical swipe operation to generate and display multiple frames of target always-on display images. This further enhances the fun of the always-on display and the flexibility and diversity of the display trajectory, thereby improving the user experience.

[0210] Always-on display (SOHD) functionality in related technologies typically reduces power consumption by lowering the frame rate when displaying the always-on image, partially displaying the always-on image, reducing data transmission, or disconnecting circuits in areas where no image is displayed. However, displaying a fixed image for extended periods during SOHD can lead to screen aging issues.

[0211] In this application, the target always-on display (AOD) interface can be displayed via a smart sensor hub in the electronic device. The electronic device includes a touch sensor, a smart sensor hub, and a neural network processor (NPU). The smart sensor hub can be coupled to the NPU. The smart sensor hub processes data acquired by the touch sensor, and the NPU processes the image based on the processing results of the smart sensor hub. The smart sensor hub may also include an image processing module, such as a Graphic Lite module. Alternatively, the electronic device may include an image sensor, and the smart sensor hub can also process data acquired by the image sensor.

[0212] In some embodiments of this application, referring to FIG12, the image processing module can detect a sliding operation on an electronic device and acquire target data (S1201). The target data includes touch data collected by a touch sensor. Then, the image processing module can determine the position information of the operation area corresponding to the sliding operation based on the target data (S1202). The image processing module can also determine the adjustment area in the first darkening layer based on the position information (S1203). The image processing module can also send the adjustment area in the first darkening layer to the NPU (S1204), and the NPU adjusts the transparency of the adjustment area to obtain a second darkening layer (S1205). The NPU can also send the second darkening layer to the image processing module (S1206), and the image processing module receives the second darkening layer and overlays it with the target image to generate a target always-on image (S1207).

[0213] Thus, by adding an image processing module to the smart sensor hub in this embodiment, image processing can be achieved. Simultaneously, even when the CPU is in sleep mode, the sensor hub can be used to control the sensors in real time, process sensor data, and work with the NPU to draw the target always-on display image, supporting user interaction in Always-On Display (AOD) mode. This provides users with a more interactive and engaging experience in always-on display scenarios with low power consumption.

[0214] In some embodiments of this application, the electronic device can also interact with the user in other ways while in an AOD (Away From Home) state. For example, it can be presented as a game, allowing the user to interact with the electronic device by playing games. Games can include puzzle games, building block games, and coloring games, etc. It should be noted that the embodiments of this application do not specifically limit the interaction methods provided by the electronic device.

[0215] In some solutions, multiple embodiments of this application can be combined, and the combined solution can be implemented. Optionally, some operations in the process of each method embodiment may be combined, and / or the order of some operations may be changed. Furthermore, the execution order between the steps of each process is merely exemplary and does not constitute a limitation on the execution order between steps; other execution orders are also possible. It is not intended to indicate that the execution order is the only possible order in which these operations can be performed.

[0216] Those skilled in the art will conceive of various ways to reorder the operations described in the embodiments of this application. Furthermore, it should be noted that process details involved in one embodiment of this application are similarly applicable to other embodiments, or different embodiments can be combined.

[0217] Furthermore, some steps in the method embodiments can be equivalently replaced with other possible steps. Alternatively, some steps in the method embodiments may be optional and can be deleted in certain use cases. Or, other possible steps may be added to the method embodiments.

[0218] Furthermore, the various method embodiments can be implemented individually or in combination.

[0219] This application also provides an electronic device, such as the mobile phone described above, as shown in FIG13. The mobile phone may include one or more processors 1310, memory 1320 and communication interface 1330.

[0220] The memory 1320, communication interface 1330, and processor 1310 are coupled together. For example, the memory 1320, communication interface 1330, and processor 1310 can be coupled together via bus 1340.

[0221] The communication interface 1330 is used for data transmission with other devices. The memory 1320 stores computer program code. The computer program code includes computer instructions, which, when executed by the processor 1310, cause the electronic device to perform the relevant method steps in the embodiments of this application.

[0222] Processor 1310 may be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with this disclosure. The processor may also be a combination that implements computational functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0223] Bus 1340 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The aforementioned bus 1340 can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used in Figure 13, but this does not indicate that there is only one bus or one type of bus.

[0224] This application also provides an electronic device, which includes a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, which includes computer instructions, and when the computer instructions are executed by the processor, the electronic device performs the relevant method steps in the above method embodiments.

[0225] This application also provides a communication device, which includes a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, which includes computer instructions, and when the computer instructions are executed by the processor, the communication device performs the relevant method steps in the above method embodiments.

[0226] This application also provides a computer-readable storage medium storing computer program code. When the processor executes the computer program code, the electronic device executes the relevant method steps in the above method embodiments.

[0227] This application also provides a computer program product containing instructions that, when executed on a computer or processor, cause the computer or processor to perform the relevant method steps as described in the above method embodiments.

[0228] This application also provides a chip system, including: a processor coupled to a memory, the memory being used to store programs or instructions, and when the program or instructions are executed by the processor, the chip system enables the methods in any of the above method embodiments.

[0229] Optionally, the chip system may contain one or more processors. These processors can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.

[0230] Optionally, the chip system may contain one or more memories. The memory may be integrated with the processor or disposed separately from it; this application embodiment does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed separately on different chips. This application embodiment does not specifically limit the type of memory or the arrangement of the memory and processor.

[0231] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0232] The electronic devices, computer storage media, or computer program products provided in this application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0233] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0234] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0235] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units, located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs. Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated units described above can be implemented in hardware or as software functional units.

[0236] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the contributing parts, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0237] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A display method, characterized in that, Applied to electronic devices, the method includes: In Always-On Display (AOD) mode, receive swipe gestures for the electronic device; In response to the swipe operation, the swipe trajectory corresponding to the swipe operation is displayed on the target always-on display.

2. The method according to claim 1, characterized in that, Displaying the swipe trajectory corresponding to the swipe operation in the target always-on display includes: The sliding trajectory is displayed with a target dynamic effect; The target dynamic effect includes: the sliding trajectory in the target always-on display changes with the position of the operation area corresponding to the sliding operation, and the display style of the sliding trajectory is different from the display style of other areas in the target always-on display; the display style includes at least one of color, fill effect and brightness.

3. The method according to claim 2, characterized in that, When the target image is displayed in the target always-on display, the brightness of the image area corresponding to the sliding trajectory in the target image is greater than the brightness of other areas in the target image.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: In response to a trigger operation, the device enters an interactive mode, which is used by the electronic device to interact with the user in the AOD state and display the interaction results on the target always-on display screen.

5. The method according to any one of claims 1-4, characterized in that, The method further includes: If a preset time is reached when a disengagement operation against the electronic device is detected, the target always-on screen displaying the sliding trajectory is saved.

6. The method according to any one of claims 1-5, characterized in that, The method further includes: Save the position information of the operation area corresponding to the sliding operation; In response to a playback operation on the target always-on display screen, the sliding trajectory is displayed on the target always-on display screen according to the location information; The playback operation includes at least one of a gaze operation or a touch operation.

7. The method according to any one of claims 1-6, characterized in that, Prior to receiving the sliding operation on the electronic device, the method further includes: Receive a screen-off event, the screen-off event being used to trigger the electronic device to enter the AOD state; In response to the screen-off event, the initial screen-off interface is displayed; The initial always-on display is generated based on a first darkening layer and a target image, wherein the first darkening layer is used to reduce the image brightness of the target image.

8. The method according to claim 7, characterized in that, Displaying the swipe trajectory corresponding to the swipe operation in the target always-on display includes: A sliding operation is detected on the electronic device, and the position information of the operation area corresponding to the sliding operation is determined; Based on the location information, an adjustment area is determined in the first darkened layer, and the position of the adjustment area corresponds to the position of the operation area. The transparency of the adjustment area is adjusted to obtain a second darkened layer; the transparency of the area corresponding to the adjustment area in the second darkened layer is greater than the transparency of other areas in the second darkened layer. The second darkened layer is overlaid on the target image to generate the target always-on image; The target always-on display image is displayed on the target always-on display screen.

9. The method according to claim 8, characterized in that, The process of adjusting the transparency of the adjustment area includes: Adjust the area to be transparent.

10. The method according to any one of claims 7-9, characterized in that, After displaying the swipe trajectory corresponding to the swipe operation in the target always-on display, the method further includes: If a preset time is reached when a disengagement operation against the electronic device is detected, the initial screen-off interface is displayed.

11. The method according to claim 8 or 9, characterized in that, The electronic device includes a touch sensor, a smart sensor hub, and a neural network processor (NPU). The smart sensor hub is used to process the data collected by the touch sensor, and the NPU is used to process the image based on the processing result of the smart sensor hub. The step of detecting a sliding operation on the electronic device and determining the position information of the operation area corresponding to the sliding operation includes: The smart sensor hub detects a sliding operation on the electronic device and acquires target data, which includes touch data collected by the touch sensor. The intelligent sensor hub determines the position information of the operation area corresponding to the sliding operation based on the target data; Determining the adjustment area in the first darkened layer based on the location information includes: The intelligent sensor hub determines the adjustment area in the first darkened layer based on the location information; The process of adjusting the transparency of the adjustment area to obtain a second darkened layer includes: The NPU adjusts the transparency of the adjustment area to obtain a second darkened layer.

12. An electronic device, characterized in that, The electronic device includes a memory, one or more processors, and a display screen; the memory is coupled to the processor; wherein the display screen is used to display an always-on image, the memory stores computer program code, the computer program code including computer instructions, and when the computer instructions are executed by the processor, the electronic device performs the display method as described in any one of claims 1-11.

13. A computer-readable storage medium storing instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the display method as described in any one of claims 1-11.

14. A computer program product, characterized in that, The computer program product includes instructions that, when executed on a computer or processor, cause the computer or processor to perform the display method as described in any one of claims 1-11.

Images