Display method and electronic device

Abstract

A display method and an electronic device, relating to the technical field of terminals. The method comprises: an electronic device can receive an always-on event, wherein the always-on event is used for enabling an always-on display function, and in response to the always-on event, the electronic device displays a first always-on interface. Upon detecting a first event for the electronic device, the electronic device displays a second always-on interface, wherein the second always-on interface is an interface obtained by adjusting the interface brightness of the first always-on interface, and the interface brightness of a first area in the second always-on interface is greater than the interface brightness of other areas in the second always-on interface. The first event comprises at least one of a gaze event or a touch event, and the first area corresponds to an operation area of the first event. The electronic device detects the touch event of a user, so that the interface brightness of a partial area in an always-on interface is increased, and the partial area corresponds to an operation area touched by the user.

Description

A display method and electronic device

[0001] This application claims priority to Chinese Patent Application No. 202410783660.5, filed on June 17, 2024, entitled "A Display Method and Electronic Device", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal technology, and in particular to a display method and an electronic device. Background Technology

[0003] Always-on display (AOD) is a feature of electronic devices that relies on the screen display. It refers to the ability of an electronic device to display the time and date on the screen even when it is off, after the user triggers a screen-off operation (e.g., pressing the power button).

[0004] Taking a mobile phone as an example, when the always-on display function is enabled, the phone can still display information such as the time and date even when the screen is off. This allows users to access this information. The phone can also display preset always-on display images, usually static images. However, the content and display methods are relatively simple, resulting in low engagement and a diminished user experience. Summary of the Invention

[0005] This application provides a display method and an electronic device. When the electronic device detects a user's touch event, it can increase the brightness of a portion of the always-on display area, which corresponds to the area the user touched. This enhances the visual appeal of the always-on display and improves the user experience.

[0006] To achieve the above objectives, this application adopts the following technical solution:

[0007] In a first aspect, this application provides a display method applied to an electronic device. The method includes: the electronic device receiving a screen-off event, the screen-off event being used to activate a screen-off display function, and in response to the screen-off event, displaying a first screen-off interface. The electronic device detects a first event related to the electronic device and displays a second screen-off interface, the second screen-off interface being an interface with adjusted brightness of the first screen-off interface, wherein the brightness of a first area in the second screen-off interface is greater than the brightness of other areas in the second screen-off interface. The first event includes at least one of a gaze event or a touch event, and the first area corresponds to the operation area of ​​the first event.

[0008] The electronic device can display a first always-on display when the screen is off. The electronic device can also detect a first event, such as a touch event and / or gaze event, and display a second always-on display. For example, the first always-on display can be a low-brightness interface. When a user touches the display screen, and the electronic device detects this touch event, it can increase the brightness of a portion of the first always-on display, corresponding to the area the user is touching. Thus, the user can touch any area of ​​the display screen to brighten it, while other areas remain low-brightness.

[0009] In this way, electronic devices can interact with users even when the screen is off. This not only increases the fun of interacting with users, but also allows users to adjust the brightness of certain areas of the interface, enhancing the fun of the always-on display and improving the user experience.

[0010] In some feasible implementations, when an electronic device detects a first event for the electronic device and displays a second always-on display, the first event for the electronic device is detected, and as the position of the operation area corresponding to the first event changes, the second always-on display is displayed, and the first area in the second always-on display changes as the position of the operation area corresponding to the first event changes.

[0011] Thus, in this embodiment, as the position of the operation area corresponding to the first event changes, the first area in the second always-on display also changes accordingly. In this way, as the operation area touched by the user changes, the area touching the display screen also brightens. This enhances the fun of the always-on display and improves the user experience.

[0012] In some feasible implementations, during the process of displaying a first always-on display in response to a screen-off event, the electronic device can also overlay a darkened layer onto the target image to generate a first always-on display image. The darkened layer is used to reduce the brightness of the target image and is displayed on the first always-on display. During the process of displaying a second always-on display, the electronic device can display a second always-on display image, which is generated based on the target image.

[0013] In some feasible implementations, the electronic device detects a first event targeting it. During the display of the second always-on display image on the second always-on display screen, the first event can be detected, the location information of the operation area of ​​the first event can be determined, and a target mask can be set based on the location information. The position of the target mask corresponds to the position of the operation area. The electronic device overlays the target mask with a darkening layer to generate an intermediate layer. The transparency of the masked area corresponding to the target mask in the intermediate layer is greater than the transparency of other areas in the intermediate layer. The electronic device can also overlay the intermediate layer with the target image to generate the second always-on display image. The transparency of the masked area corresponding to the target image in the second always-on display image is less than the transparency of other areas in the second always-on display image. Then, the electronic device can display the second always-on display image on the second always-on display screen.

[0014] Specifically, in the process of overlaying the target mask and the darkening layer to generate an intermediate layer, the transparency of the overlapping area between the target mask and the darkening layer can be adjusted to generate an intermediate layer.

[0015] In other words, the phone can first overlay a target mask and a darkened layer to generate an intermediate layer. In this intermediate layer, the transparency of the masked area corresponding to the target mask can be greater than the transparency of other areas. For example, the masked area is transparent (i.e., in a cutout state), while other areas are darkened. Next, the phone can overlay this intermediate layer with the target image to generate a second always-on display image. Thus, because the masked area corresponding to the target mask is transparent, the area corresponding to the masked area in the second always-on display image can display the target image with higher brightness, while other areas remain darkened.

[0016] Thus, in this embodiment of the application, the user can interact with the mobile phone. When the screen is off, the mobile phone can display a first always-on display image with a dimmed effect, such as a lock screen wallpaper image. After the user touches the mobile phone display screen and / or looks at the first always-on display image, the mobile phone generates and displays the aforementioned second always-on display image. This allows the user to adjust the image brightness of the image area corresponding to the area touched and / or looked at in the first always-on display image, creating an effect similar to illuminating the lock screen wallpaper image with a flashlight. Once illuminated, the lock screen wallpaper image can be seen through this image area, satisfying the user's interactive needs in always-on display scenarios and providing an interesting interactive experience.

[0017] In some feasible implementations, the target mask includes a feathered transition area, which is the outline of the target mask. During the process of adjusting the opacity of the overlapping area between the target mask and the darkening layer, areas outside the transition area within this overlap can be made transparent. The phone can also adjust the opacity of the transition area within the target mask to create a gradient effect.

[0018] Therefore, to make the second always-on display image more aesthetically pleasing, the target mask includes a feathered transition area, which is the outline of the target mask. Areas overlapping between the target mask and the darkened layer, excluding the transition area, can be adjusted to be transparent. The transparency of the transition area can also be adjusted to create a gradient effect. The masking parameters of the target mask can be further adjusted to enhance the aesthetics of the second always-on display image. This increases the fun of the always-on display and improves the user experience.

[0019] In some implementable methods, after the electronic device detects a first event for the electronic device and displays a second always-on display, the method further includes: detecting a second event for the electronic device and displaying a third always-on display, wherein the third always-on display is an interface after adjusting the interface brightness of the second always-on display, and the interface brightness of the second area corresponding to the first area in the third always-on display is consistent with the interface brightness of other areas in the third always-on display, and the second event includes at least one of a gaze-off event or a detachment from contact with the electronic device event.

[0020] When a user removes their contact with the electronic device and / or takes their gaze away from the phone, it indicates that further interaction with the phone is no longer necessary. Upon detecting this second event, the phone displays a third always-on display. The brightness of all areas in this third always-on display is consistent, restoring the brightness of the first area in the second always-on display to match the brightness of the other areas. This maintains a dimmed state in the always-on display scenario when the user has not activated any areas, enhancing the user's interactive enjoyment and overall experience.

[0021] In some implementable methods, after the electronic device detects a first event for the electronic device and displays a second always-on display, the method further includes: the electronic device detecting a second event for the electronic device and displaying a first always-on display, the second event including at least one of a gaze-off event or a detachment from contact event with the electronic device.

[0022] When a user removes their contact with the electronic device and / or takes their gaze away from the phone, it indicates that further interaction with the phone is no longer necessary. Upon detecting this second event, the phone can restore the brightness of the first area of ​​the second always-on display to match the brightness of the other areas, thus improving the user's visual experience.

[0023] In some feasible implementations, the electronic device includes an image sensor, a touch sensor, and a smart sensor hub, the smart sensor hub being used to process data acquired by the image sensor and the touch sensor. During the process of the electronic device detecting a first event targeting the electronic device and determining the location information of the operating area, the smart sensor hub detects the first event targeting the electronic device and acquires target data, which includes at least one of gaze data acquired by the image sensor or touch data acquired by the touch sensor. Based on the target data, the smart sensor hub determines the location information of the operating area. During the process of the electronic device setting a target mask based on the location information, the smart sensor hub sets the target mask based on the location information.

[0024] Thus, in this embodiment, the mobile phone can utilize the sensor hub to control the sensors in real time and process the sensor data while the processor is in sleep mode, determining the location information of the operating area and setting a target mask to adjust the brightness of certain areas of the interface. This achieves a more interactive and fun experience for users in a low-power manner during screen-off display scenarios.

[0025] Secondly, embodiments of this application also provide an electronic device, which includes a memory, one or more processors, and a display screen; the memory is coupled to the processor; wherein the display screen is used to display an always-on image, and the memory stores computer program code, which includes computer instructions, and when the computer instructions are executed by the processor, the electronic device performs the display method as described in the first aspect.

[0026] Thirdly, embodiments of this application also provide a computer-readable storage medium storing instructions that, when executed on an electronic device, cause the electronic device to perform the display method as described in the first aspect.

[0027] Fourthly, embodiments of this application also provide a computer program product containing instructions that, when executed on a computer or processor, cause the computer or processor to perform the display method as described in the first aspect. Attached Figure Description

[0028] Figure 1 is a schematic diagram of the application scenario of always-on display function in related technologies;

[0029] Figure 2 is a schematic diagram of the hardware structure of a mobile phone provided in an embodiment of this application;

[0030] Figure 3 is a schematic diagram of the software structure of a mobile phone provided in an embodiment of this application;

[0031] Figure 4 is a flowchart illustrating a display method provided in an embodiment of this application;

[0032] Figure 5 is a schematic diagram of the interface of a darkening layer provided in an embodiment of this application;

[0033] Figure 6 is a schematic diagram of a scenario of a first event provided in an embodiment of this application;

[0034] Figure 7 is a schematic diagram of a process for generating a second always-on display image according to an embodiment of this application;

[0035] Figure 8 is a schematic diagram of an interface for generating a second always-on display image provided in an embodiment of this application;

[0036] Figure 9 is a schematic diagram of an interface of a transition area provided in an embodiment of this application;

[0037] Figure 10 is a schematic diagram of an interface for a target always-on display image provided in an embodiment of this application;

[0038] Figure 11 is a schematic diagram of an interface showing the change of the position of the operating area according to an embodiment of this application;

[0039] Figure 12 is a structural schematic diagram of an intelligent sensor hub provided in an embodiment of this application;

[0040] Figure 13 is a schematic diagram of the structure of a mobile phone provided in an embodiment of this application. Detailed Implementation

[0041] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of this application, unless otherwise stated, " / " indicates that the objects before and after are in an "or" relationship. For example, A / B can represent A or B. "And / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone, where A and B can be singular or plural. Furthermore, in the description of this application, unless otherwise stated, "multiple" refers to two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple. In addition, in order to clearly describe the technical solutions of the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish the same or similar items with basically the same function and effect.

[0042] Those skilled in the art will understand that the terms "first," "second," etc., do not limit the quantity or order of execution, and that "first," "second," etc., are not necessarily different. Furthermore, in some embodiments of this application, words such as "exemplary" or "for example" are used to indicate that something is being described as an example, illustration, or description. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner for ease of understanding.

[0043] Furthermore, the device architecture and business scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided in the embodiments of this application. As those skilled in the art will know, with the evolution of device architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0044] In related technologies, the always-on display function automatically displays a preset always-on image after the electronic device's screen is turned off, as shown in Figure 1(A). The always-on image can be a time image, allowing the user to obtain current time information such as date and time. Alternatively, as shown in Figure 1(B), the always-on image can be a wallpaper image, allowing the user to set a wallpaper image or an image selected from a photo album application as the always-on image. Or, as shown in Figure 1(C), the always-on image can also be a preset animation, i.e., a dynamic image. It can be seen that this display method is relatively simple, resulting in low engagement with the always-on display content and a lack of interaction between the user and the electronic device. This reduces the user experience.

[0045] Based on the above, this application provides a display method applicable to electronic devices. The method includes: the electronic device receiving a screen-off event, which is used to activate a screen-off display function. The electronic device responds to the screen-off event by displaying a first screen-off interface. The electronic device can also detect a first event related to the electronic device and display a second screen-off interface, where the second screen-off interface is an interface with adjusted brightness compared to the first screen-off interface. The brightness of a first area in the second screen-off interface is greater than the brightness of other areas in the second screen-off interface. The first event includes at least one of a gaze event or a touch event, and the first area corresponds to the operation area of ​​the first event.

[0046] In the display method provided in this application embodiment, the electronic device can display a first always-on display interface when the screen is off. The electronic device can also detect a first event, such as a touch event and / or gaze event, and display a second always-on display interface. For example, the first always-on display interface can be a low-brightness interface. A user can touch the display screen; when the electronic device detects the user's touch event, it can increase the brightness of a portion of the first always-on display interface, which corresponds to the area the user is touching. Thus, the user can touch any area of ​​the display screen to brighten it, while other areas remain in a low-brightness state.

[0047] In this way, electronic devices can interact with users even when the screen is off. This not only increases the fun of interacting with users, but also allows users to adjust the brightness of certain areas of the interface, enhancing the fun of the always-on display and improving the user experience.

[0048] For example, the display method provided in this application embodiment can be applied to electronic devices with always-on display functions, such as mobile phones, smartwatches, tablets, foldable electronic devices, desktop computers, laptops, handheld computers, laptops, Ultra-Mobile Personal Computers (UMPCs), netbooks, cellular phones, Personal Digital Assistants (PDAs), Augmented Reality (AR) devices, Virtual Reality (VR) devices, Artificial Intelligence (AI) devices, wearable devices, and in-vehicle devices. This application embodiment does not impose any special limitations on the specific type of electronic device.

[0049] Furthermore, the operating system installed on the electronic device provided in this application embodiment includes, but is not limited to, those that... Or other operating systems. This application does not limit the specific type of electronic device or the type of operating system installed thereon.

[0050] For example, taking a mobile phone as an example, Figure 2 is a schematic diagram of the hardware structure of a mobile phone provided in an embodiment of this application. As shown in Figure 2, the mobile phone 100 may include: a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0051] The aforementioned sensor module 180 may include sensors such as a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, and a bone conduction sensor 180M. In some embodiments, the sensor module 180 may also include an image sensor, which can collect user gaze data on the electronic device. The intelligent sensor hub determines the location information of the user's corresponding operating area, such as the gaze area, based on the gaze data. In other embodiments, the aforementioned sensor module 180 may be a sensor hub.

[0052] It is understood that the structures illustrated in the embodiments of the present invention do not constitute a specific limitation on the mobile phone 100. In other embodiments of this application, the mobile phone 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0053] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0054] The controller can serve as the central nervous system and command center of the mobile phone 100. Based on the instruction operation code and timing signals, the controller generates operation control signals to control the fetching and execution of instructions.

[0055] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0056] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0057] The wireless communication function of mobile phone 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0058] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in mobile phone 100 can be used to cover one or more communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with a tuning switch.

[0059] The mobile phone 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0060] The display screen 194 is used to display always-on images, always-on videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the mobile phone 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0061] The mobile phone 100 can achieve shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0062] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0063] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, mobile phone 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0064] The mobile phone 100 can use its camera function to capture an image when it detects that a user is looking at the display screen 194 or receives a photo capture command, thereby obtaining a first image. The first image is then sent to the processor 110, so that the processor 110 can execute the gaze region recognition method provided in this application to determine the location information corresponding to the gaze region.

[0065] The mobile phone 100 can achieve audio functions such as music playback and recording through the audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0066] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Mobile phone 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, mobile phone 100 detects the touch operation intensity based on pressure sensor 180A. Mobile phone 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example: when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0067] The gyroscope sensor 180B can be used to determine the motion posture of the mobile phone 100. The barometric pressure sensor 180C is used to measure air pressure. The magnetic sensor 180D includes a Hall sensor. The mobile phone 100 can use the magnetic sensor 180D to detect the opening and closing of the flip case. The accelerometer sensor 180E can detect the magnitude of the acceleration of the mobile phone 100 in various directions (generally three axes). When the mobile phone 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.

[0068] A distance sensor 180F is used to measure distance. The mobile phone 100 can measure distance via infrared or laser. In some embodiments, during a shooting scenario, the mobile phone 100 can utilize the distance sensor 180F to measure distance for fast focusing.

[0069] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The mobile phone 100 emits infrared light outward through the LED. The mobile phone 100 uses the photodiode to detect infrared reflected light from nearby objects. The ambient light sensor 180L is used to sense the ambient light intensity. The fingerprint sensor 180H is used to collect fingerprints. The mobile phone 100 can utilize the collected fingerprint characteristics to achieve fingerprint unlocking, app access lock, fingerprint photography, fingerprint answering of calls, etc.

[0070] Temperature sensor 180J is used to detect temperature. In some embodiments, mobile phone 100 uses the temperature detected by temperature sensor 180J to execute a temperature processing strategy. Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K is used to detect touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In some examples, touch sensor 180K can collect touch data from the user on the electronic device, and the smart sensor hub can determine the location information of the corresponding user operation area based on the touch data.

[0071] In other embodiments, the touch sensor 180K may also be located on the surface of the mobile phone 100, in a different position than the display screen 194.

[0072] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords.

[0073] In some embodiments, the smart sensor hub sets a target mask based on location information and uses the target mask to adjust the brightness of a portion of the first always-on display.

[0074] The software system of mobile phone 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses the layered architecture Android system as an example to illustrate the software structure of mobile phone 100.

[0075] Figure 3 is a schematic diagram of the software structure of a mobile phone according to an embodiment of this application.

[0076] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0077] The application layer can include a series of application packages.

[0078] As shown in Figure 3, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0079] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0080] As shown in Figure 3, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0081] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0082] Content providers are used to store and retrieve data, making that data accessible to applications. This data can include videos, images, audio, phone calls made and received, browsing history and bookmarks, phone books, and more.

[0083] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0084] The phone manager is used to provide communication functions for the mobile phone 100. For example, it manages call status (including connection, hang-up, etc.).

[0085] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0086] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of download completion or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0087] The Android Runtime consists of core libraries and a virtual machine. The Android Runtime is responsible for the scheduling and management of the Android system.

[0088] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0089] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0090] A system library can include multiple functional modules, such as a display module, an acquisition module, a processing module, and a drawing module.

[0091] In some embodiments, the display module is used to display a first always-on display image on a first always-on display screen, and can also be used to display a second always-on display image on a second always-on display screen. The acquisition module is used to detect a first event targeting the mobile phone and acquire target data, which includes at least one of gaze data collected by an image sensor or touch data collected by a touch sensor. The processing module is used to determine the location information of the operating area based on the target data. The drawing module is used to set a target mask based on the location information. The drawing module is also used to generate a second always-on display image based on the target mask, the darkening layer, and the target image.

[0092] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0093] The following will describe in detail a display method provided by an embodiment of this application with reference to the accompanying drawings. In the following embodiments, a mobile phone is used as an example of an electronic device with an always-on display function. Referring to Figure 4, the method may include:

[0094] S401. The mobile phone receives a screen-off event, which is used to activate the screen-off display function.

[0095] In some embodiments of this application, the mobile phone can receive a screen-off event input by the user, which can be used to trigger the phone to enter a screen-off state. For example, a screen-off event could be an event where the user presses the power button when the phone screen is on. Another example is an event where no user interaction is detected for a certain period of time while the phone screen is on.

[0096] It should be noted that the embodiments of this application do not specifically limit the screen-off events input by the user.

[0097] S402: The phone responds to the screen-off event and displays the first screen-off interface.

[0098] In some embodiments of this application, the mobile phone can display a first always-on display in response to a screen-off event.

[0099] When a phone enters a screen-off state, it indicates that the user is not currently using the phone. To improve the user experience and reduce power consumption, the phone can display a darkened version of the initial screen-off image. For example, the initial screen-off image might be a darkened target image. It's understood that the brightness of the darkened image will be lower than the brightness of the undarkened image.

[0100] In one feasible approach, the mobile phone can respond to a screen-off event, darken the target image according to preset darkening parameters, generate a first screen-off image, and display the first screen-off image on the first screen-off interface.

[0101] Specifically, the phone can overlay a darkening layer onto the target image to generate the first always-on display image. The darkening layer is used to reduce the brightness of the target image.

[0102] For example, the target image can be the wallpaper image corresponding to the phone's lock screen. The darkening layer is generally a black layer. By controlling the transparency value of the pixels in the darkening layer according to the preset darkening parameters, it is possible to control whether the first always-on display image shows the content of the original target image layer or the black content of the darkening layer.

[0103] In some examples, the color data of pixels in a layer is used to characterize the color displayed by the pixels. This can include various chromaticity components, such as red (R value), blue (B value), green (G value), or white (W value). Each chromaticity component can be represented by a numerical value, usually 0-255. Different values ​​of chromaticity components can represent different brightness, and different values ​​of chromaticity components can be mixed to create various colors.

[0104] The transparency data of pixels in a layer can characterize the transparency of pixel colors, indicating how many pixel values ​​should be displayed. For example, when two layers, a first layer and a second layer, are overlaid, the transparency of pixels in the first layer can control whether the display shows the image colors of the first layer or the second layer, or the proportion by which the first and second layers are mixed to display a new color. The transparency of pixel colors can also be represented numerically, and this value is called the pixel transparency value, usually represented by 0-255. When the transparency value of a pixel area is 0, the transparency of that pixel area is 100%, meaning that area is transparent. When the transparency value of a pixel area is 255, the transparency of that pixel area is either 0% or 100%, meaning that area is opaque.

[0105] It should be noted that transparency refers to the visibility of an element or color, and can be expressed as a percentage (%) or a decimal (between 0 and 1). A transparency of 1 or 100% indicates that the element or color is completely opaque, while a transparency of 0 or 0% indicates that the element or color is completely transparent, i.e., invisible. This application does not specifically limit the way transparency is represented.

[0106] When the transparency value of the pixels in the first layer is less than or equal to the first transparency threshold, and the first and second layers are superimposed, the human eye cannot distinguish the difference between the color displayed on the screen and the second layer (it can be assumed that the screen does not display the image color of the first layer). Therefore, the pixels in the first layer can be considered transparent, and such pixels can also be called transparent pixels.

[0107] When the transparency value of the pixels in the first layer is greater than or equal to the second transparency threshold, and the first and second layers are superimposed, the human eye cannot distinguish the difference between the color displayed on the screen and the first layer (it can be assumed that the screen does not display the color of the second layer). Therefore, the pixels in the first layer can be considered to be opaque, and such pixels can be called opaque pixels. A transparency value between the first and second transparency thresholds can be considered to indicate that the pixel is semi-transparent, that is, between transparent and opaque.

[0108] For example, the first transparency threshold can be 0, and the second transparency threshold can be 255. It should be noted that this application does not limit the specific values ​​corresponding to the first and second transparency thresholds. When the transparency value of the first layer is 0, the pixels of the first layer are transparent, i.e., transparent pixels. Thus, when the first and second layers are superimposed, the display screen does not show the image color of the first layer, but the user's eye can perceive that the color displayed on the screen is the image color of the second layer.

[0109] For example, when the opacity value of the first layer is 255, the pixels of the first layer are opaque. Therefore, when the first and second layers are overlaid, the screen does not display the image colors of the second layer; the user's eye will perceive the colors displayed as those of the first layer.

[0110] In some embodiments of this application, the darkening layer can be the first layer described above, and the layer containing the target image can be the second layer described above. During the process of darkening the target image according to preset darkening parameters, the preset darkening parameters can include the transparency values ​​of pixels in the darkening layer, which are determined according to a preset ratio. Alternatively, the preset darkening parameters can also include the transparency values ​​of pixels in the layer containing the target image, which can also be determined according to a preset ratio.

[0111] For example, the preset ratio can be 100%. The preset darkening parameters include the transparency value of the pixels in the darkening layer, which is set to 255. Thus, referring to Figure 5(A), the pixels of the darkening layer are opaque, i.e., opaque pixels. In this way, when the darkening layer and the target image are superimposed, the display screen does not show the image color of the target image, and the user's eye can see that the color displayed on the screen is the black of the darkening layer.

[0112] For another example, the preset ratio can be 60%. The preset darkening parameters include the transparency value of the pixels in the darkening layer, which is set to 163. Thus, referring to Figure 5(B), the pixels of the darkening layer are semi-transparent pixels. In this way, when the darkening layer and the target image are overlaid, the display shows the new image color after the darkening layer and the target image are mixed, that is, the brightness of the target image is reduced and the color is darkened.

[0113] For another example, the preset ratio can be 40%. The preset darkening parameters include the transparency value of the pixels in the darkened layer, which is set to 102. Thus, referring to Figure 5(C), the pixels in the darkened layer are semi-transparent pixels. When the darkened layer and the target image are overlaid, the display shows the new image color resulting from the mixture of the darkened layer and the target image; that is, the brightness of the target image is further reduced, and the color becomes darker. In other words, compared to Figure 5(C), a larger preset ratio results in a higher degree of darkening, while a smaller preset ratio results in a higher degree of transparency.

[0114] In some embodiments of this application, the target image can be a static image or a dynamic image. The target image can also be an animation, such as a video of a certain duration. Similarly, the first always-on display image can be a static image or a dynamic image. It can also be an animation, such as a video of a certain duration. It should be noted that the embodiments of this application do not limit the implementation form of the target image or the first always-on display image.

[0115] Therefore, in order to improve the user experience and consider the power consumption of the mobile phone, the mobile phone can display a first always-on display image in the first always-on display interface, and the first always-on display image is a darkened image. This facilitates subsequent user interaction with the mobile phone and effectively displays a portion of the darkened wallpaper image to the user intuitively and clearly. This enhances the fun of the always-on display and improves the user experience.

[0116] In another possible implementation, the phone can respond to a screen-off event, generate a time-based screen-off image, and display the time-based screen-off image on the first screen-off interface. For example, see Figure 1(A). The time-based screen-off image can be generated based on a black layer and time information, with most of the image appearing black. This allows the user to interact with the phone by touching the black areas of the time-based screen-off image.

[0117] It should be noted that the embodiments of this application do not limit the number or display format of images displayed on the first always-on display screen.

[0118] Thus, in this embodiment of the application, the mobile phone can display a first always-on display image, such as a time-based always-on display image, on the first always-on display screen. This facilitates subsequent user interaction with the phone and allows for the illumination of specific areas within the time-based always-on display image. This enhances the visual appeal of the always-on display and improves the user experience.

[0119] S403: The phone detects a first event targeting the phone and displays a second always-on display.

[0120] The second always-on display is an interface created by adjusting the brightness of the first always-on display. The brightness of a first area within the second always-on display is greater than the brightness of other areas within the same display. The first event includes at least one of a touch event or a gaze event. The first area corresponds to the operation area of ​​the first event. It can be understood that the operation area of ​​the first event can be a region on the display screen, and the first area can be the image area displaying an image in the second always-on display.

[0121] In some embodiments of this application, the mobile phone can receive user input and detect the event corresponding to the user input, adjust the brightness of the first always-on display, and display a second always-on display. That is, the brightness of some areas in the second always-on display is greater than the brightness of other areas, and this portion corresponds to the area operated by the user. In this way, the user can interact with the mobile phone and freely control the display effect of the always-on display in the always-on state.

[0122] In some examples, user input operations may include touch operations and / or gaze operations. For example, a touch operation may be a user's finger touching the display screen, and a gaze operation may be a user's gaze fixed on the display screen, or a user's gaze fixed on an image displayed on the display screen. It should be noted that the embodiments of this application do not specifically limit the user input operations.

[0123] In one feasible approach, the mobile phone can display a second always-on display image on a second always-on display screen, which is generated based on a target image.

[0124] Specifically, the phone can detect user input. After detecting the first event, it can determine the location information of the corresponding operation area. Then, based on the location information of the operation area, the phone can trigger adjustments to the first always-on display image to generate and display a second always-on display image.

[0125] In one possible implementation, referring to (A) in Figure 6, when the user input is a touch operation, i.e., the first event is a touch event, the mobile phone can detect the touch event and trigger an adjustment to the first always-on display image.

[0126] Specifically, the mobile phone can collect contact data such as screen capacitance data, which characterizes the user's contact with the display screen. Based on the screen capacitance data, the mobile phone can determine the location information of the operation area corresponding to the contact event, i.e., the contact point location information. Then, based on the contact point location information, the mobile phone can generate and display a second always-on display image.

[0127] It should be noted that contact data may also include screen resistance values, etc., and this application does not limit the specific form of contact data.

[0128] The following embodiments of this application specifically describe the screen capacitance data collected using a capacitive touchscreen in a mobile phone. The capacitive touchscreen includes horizontal and vertical electrode arrays, which constitute several test points uniformly distributed on the screen surface. Self-capacitance can be generated between adjacent electrodes. By collecting the changes in self-capacitance values ​​at each test point through a self-capacitance scanning method, single-point touch detection can be achieved. Additionally, mutual capacitance can also be generated between adjacent electrodes. By collecting the changes in mutual capacitance values ​​at each test point through a mutual capacitance scanning method, multi-point touch detection can also be achieved.

[0129] The screen capacitance data can be detected and collected by the phone's touchscreen. When a user touches the touchscreen, a contact area is formed between the touchscreen and the user. The touch sensors in the touchscreen can then detect and collect the corresponding screen capacitance data. For example, a phone's touchscreen can be capacitive, resistive, or inductive.

[0130] In some embodiments of this application, during the process of determining the location information of the operation area based on the screen capacitance data, the mobile phone can extract the corresponding coordinate data from the screen capacitance data to determine the location information of the operation area.

[0131] For example, taking a 480×800 screen as an example, a screen coordinate system can be established, with the top-left corner at (0, 0), the top-right corner at (480, 0), the bottom-left corner at (0, 800), and the bottom-right corner at (480, 800). The mobile phone can determine the position of the coordinate data in the collected screen capacitance data on the screen coordinate system, thus determining the location information of the operation area corresponding to the first event, i.e., the contact point location information. It is understood that the collected screen capacitance data may include a large amount of coordinate data, which can be processed to determine the center point location information corresponding to the contact point. Of course, the contact area information corresponding to the contact point can also be determined. This application embodiment does not specifically limit the implementation form of the location information of the operation area corresponding to the contact event.

[0132] In another possible implementation, see Figure 6(B), when the user input is a gaze operation, i.e., the first event is a gaze event, the mobile phone can detect the gaze event and trigger the adjustment of the first always-on display image to generate and display the second always-on display image.

[0133] Specifically, the mobile phone can collect gaze data, such as captured images. Based on the captured images, it can determine the location information of the operation area corresponding to the gaze event, i.e., the gaze point location information. Then, the mobile phone can generate and display a second always-on display image based on the gaze point location information.

[0134] In some examples, the phone can capture a first image using a camera or image sensor and perform face detection on the first image. If a face is detected, eye feature detection continues. If no face is detected, an anomaly is handled, and the subsequent steps of adjusting the first always-on display image are skipped. If eye features are detected, eye feature information is extracted, and the gaze point position information is determined based on the eye feature information. If no eye features are detected, an anomaly is handled, and the subsequent steps of generating and displaying a second always-on display image are skipped.

[0135] The mobile phone can capture the first image in real time using its camera or image sensor, or it can capture the first image periodically at a preset time interval. The first image may include the user's face, such as the entire face, or a partial face. A partial face could be due to the user's entire face being partially obscured by an object, or only part of the user's face entering the camera's shooting area, resulting in only a partial face being captured. The first image may also not include the user's face. In this case, eye feature information cannot be extracted from the first image, and the phone will handle the anomaly and will not proceed with the subsequent steps of adjusting the first always-on display image. Eye feature information can be information representing the user's gaze characteristics, including the size of the sclera, iris, and pupil of the user's eyes, and the relative positional relationship of the sclera, iris, and pupil relative to the eye sockets.

[0136] In determining the gaze point location based on eye feature information, the mobile phone can input this information into a trained gaze model to obtain the gaze point coordinates corresponding to the first image. These gaze point coordinates represent the coordinates of the intersection of the gaze lines of both eyes. Essentially, when a user gazes at a display screen, the gaze lines of both eyes focus on the screen, forming a gaze point. The gaze point coordinates are the coordinates of the gaze point on the display screen. Since there is a mapping relationship between the first image and the display screen size, the coordinates of the gaze point on the first image can be used to determine the coordinates of the gaze point on the display screen based on this mapping relationship.

[0137] It should be noted that those skilled in the art can set the implementation method for extracting eye feature data and determining the gaze point location information according to actual needs, and this application does not impose any restrictions on this.

[0138] In another possible implementation, when the first event is a gaze event and a touch event, the mobile phone can detect the touch event and the gaze event, triggering an adjustment to the first always-on display image to generate and display a second always-on display image. The operation areas corresponding to the gaze event and the touch event can be the same or different; that is, the number of operation areas can be one or two.

[0139] For example, the mobile phone can determine the location information of the operation area corresponding to the gaze event and the contact event based on the collected gaze point location information and contact point location information. For instance, it can determine whether the operation areas corresponding to the gaze event and the contact event are the same based on the aforementioned gaze point location information and contact point location information. When the operation areas are the same, one image area in the first always-on display image can be adjusted. When the operation areas are different, two image areas in the first always-on display image can be adjusted.

[0140] As another example, the mobile phone can also fuse the collected gaze data and contact data, and determine the location information of the operation area corresponding to the gaze event and contact event based on the fused data. It is understood that, based on data fusion, the operation area corresponding to the gaze event and contact event is a single area, and the mobile phone can adjust an image area in the first always-on display image. During the data fusion process, the mobile phone can set different weights for the gaze data and contact data, and can also take the average value of the gaze data and contact data. This application embodiment does not specifically limit the determination of the location information of the operation area corresponding to the first event.

[0141] In some embodiments of this application, the mobile phone can detect a first event and determine the location information of the operating area. After determining the location information of the operating area, the mobile phone can use a target mask to overlay it with the darkening layer and the target image, the position of which corresponds to the position of the operating area. In this way, by adjusting the first always-on display image through the target mask, a second always-on display image is generated and displayed.

[0142] Specifically, referring to Figure 7, the mobile phone can set a target mask based on the location information of the operation area, and the position of the target mask corresponds to the position of the operation area (as in step S701). The mobile phone can also overlay the target mask with a darkening layer to generate an intermediate layer, in which the transparency of the masked area corresponding to the target mask in the intermediate layer is greater than the transparency of other areas in the intermediate layer (as in step S702). The mobile phone overlays the intermediate layer with the target image to generate a second always-on display image, in which the transparency of the masked area corresponding to the target mask in the second always-on display image is less than the transparency of other areas in the second always-on display image (as in step S703).

[0143] In one feasible approach, the phone overlays an intermediate layer onto the target image to generate a second always-on display image. The area corresponding to the masked region in the second always-on display image is used to display the target image, and the brightness of the masked region is greater than the brightness of other image areas in the second always-on display image. The phone then displays the second always-on display image.

[0144] In other words, the phone can first overlay a target mask and a darkened layer to generate an intermediate layer. In this intermediate layer, the transparency of the masked area corresponding to the target mask can be greater than the transparency of other areas. For example, the masked area is transparent (i.e., in a cutout state), while other areas are darkened. Next, the phone can overlay this intermediate layer with the target image to generate a second always-on display image. Thus, because the masked area corresponding to the target mask is transparent, the area corresponding to the masked area in the second always-on display image can display the target image with higher brightness, while other areas remain darkened.

[0145] In some embodiments of this application, a mask layer may be pre-set in the mobile phone, and the mask layer includes a target mask. The mobile phone may also pre-store a mask layer, in which the target mask corresponds to a mask identifier and mask parameters. In this way, the mobile phone can directly obtain the pre-set mask layer and the target mask within it.

[0146] For example, the mask identifier can be a circular mask, and the mask parameters can include a circle radius of 160vp. When the transparency value of the circular mask is 255, the pixels in the circular mask are opaque pixels. As another example, the mask identifier can be a square mask, and the mask parameters can include a square side length of 320vp. When the transparency value of the square mask is 255, the pixels in the square mask are opaque pixels.

[0147] In other embodiments of this application, the mobile phone can also set parameters for the area outside the target mask in the mask layer. For example, the transparency value of the area outside the target mask can be set to 0, and the transparency value of the area within the target mask can be set to 255, meaning the pixels outside the target mask are transparent pixels. Thus, the pixel change from the target mask to the area outside the target mask is from opaque pixels to transparent pixels, i.e., the transparency change is from 0 to 100%. It should be noted that the embodiments of this application do not specifically limit the implementation of the mask layer, the target mask, and the area outside the target mask.

[0148] To facilitate understanding, the process of adjusting the image region in the first always-on display image using target masking will be explained below with reference to Figure 8.

[0149] Referring to Figure 8(A), taking a circular mask as an example, the pixels within the entire circular mask are opaque, while the outer edges are transparent. The target mask can be positioned at the same location as the operation area. Next, the phone can overlay the target mask with the darkening layer to generate an intermediate layer, making the masked area corresponding to the target mask transparent within the intermediate layer. Specifically, the opacity of the overlapping area between the target mask and the darkening layer can be adjusted to generate the intermediate layer.

[0150] For example, the following formula A can be used for processing: DST_OUT=[Da×(1-Sa), Dc×(1-Sa)];

[0151] Where Da represents the alpha channel of the darkened layer, Dc represents the RGB channel of the darkened layer, and Sa represents the alpha channel of the target mask.

[0152] Thus, using formula A above, the transparency value inside the circular mask can be inverted to obtain the transparency value of the overlapping area in the middle layer. The transparency value outside the circular mask can be inverted or the transparency value of the darkened layer can be retained to obtain the transparency value of the area in the middle layer excluding the overlapping area. For example, the transparency value inside the circular mask is 255, and the transparency value of the overlapping area is 255-255=0. The transparency value outside the circular mask is 0, and the transparency value of the area in the middle layer excluding the overlapping area is 255-0=255. This results in a middle layer with a hollow center and darkened edges; that is, the overlapping area between the target mask and the darkened layer in the middle layer is transparent, while other areas remain dark.

[0153] Referring again to Figure 8(B), the phone can overlay the intermediate layer with the target image to generate a second always-on display image. For example, this can be achieved using the following formula B: C = (1-alpha) × B + alpha × A;

[0154] Where A is the alpha channel of the intermediate layer, B is the alpha channel of the target image, and C is the alpha channel of the second always-on display image.

[0155] Thus, using formula B above, the intermediate layer and the target image can be directly overlaid. The area corresponding to the masked region in the generated second always-on display image can display the target image, and the image brightness of the masked region is greater than the image brightness of other image areas in the second always-on display image. It should be noted that in the scenario where the second always-on display image is displayed within the second always-on display interface, the area corresponding to the masked region in the second always-on display image is the same area as the first region in the second always-on display interface.

[0156] Referring again to Figure 8(C), the phone can display a second always-on display image. In the second always-on display image, the area corresponding to the masked area can display the normal image brightness of the target image, while other areas are darkened.

[0157] Thus, in this embodiment of the application, the user can interact with the mobile phone. When the screen is off, the mobile phone can display a first always-on display image with a dimmed effect, such as a lock screen wallpaper image. After the user touches the mobile phone display screen and / or looks at the first always-on display image, the mobile phone can adjust the image brightness of the image area corresponding to the area touched and / or looked at in the first always-on display image, creating an effect similar to illuminating the lock screen wallpaper image with a flashlight. After being illuminated, the lock screen wallpaper image can be seen through this image area, satisfying the user's interactive needs in always-on display scenarios and providing an interesting interactive experience.

[0158] In some embodiments of this application, to make the second always-on display image more aesthetically pleasing, the target mask includes a feathered transition region, which is the outline region of the target mask. That is, the masking parameters for setting the target mask in embodiments of this application may also include feathering parameters.

[0159] Continuing with the example of a circular mask, the mask parameters can include a radius of 160vp and an opacity value of 255, meaning the pixels within the circular mask are opaque. The mask parameters can also include a feathering parameter, specifically a 40vp feathering from the edge inwards, meaning the outline of the target mask is a feathered transition area between transparent and opaque areas. Alternatively, the transition area can lie between two transparent areas.

[0160] The transparency value of the pixels in this transition region can be between the first transparency threshold and the second transparency threshold, such as between 0 and 255. For example, intermediate values ​​such as 100, 110, and 120. Pixels in the transition region can be called transition zone pixels, and the transparency value of the transition zone pixels changes gradually.

[0161] Thus, in this embodiment of the application, the transparency of the inner region of the target mask is 0, the transparency of the outline region is between 0 and 1, and the transparency of the region outside the target mask is 1, meaning that the pixels outside the target mask are transparent pixels. Therefore, the pixel change from the target mask to the region outside the target mask is from opaque to transparent, i.e., the transparency change is from 0 to 1.

[0162] For another example, the mask identifier can be a square mask, and the mask parameters can include a square side length of 320vp, and a square mask transparency value of 255, which means that the pixels in the square mask are opaque pixels.

[0163] In other embodiments of this application, the mobile phone can also set parameters for the area outside the target mask in the mask layer. For example, the transparency of the area outside the target mask can be set to 1. In this way, the pixel change from the target mask to the area outside the target mask is still from opaque pixels to transparent pixels, that is, the transparency change from 0 to 1% from the inside out.

[0164] In some embodiments of this application, during the process of adjusting the transparency of the overlapping area between the target mask and the darkening layer, the area outside the transition area in the overlapping area between the target mask and the darkening layer can be adjusted to a transparent area.

[0165] For example, referring to Figure 9(A), continuing with the example of a circular mask as the target mask, the circular mask includes a feathered transition area. The position of the target mask can be set to the same position as the operation area. Next, the phone can overlay the target mask with the darkening layer to generate an intermediate layer. Specifically, the area outside the transition area in the overlapping region between the target mask and the darkening layer can be adjusted to be transparent to generate the intermediate layer. For example, the transparency value of the area outside the transition area in the overlapping region is 255, and the adjusted transparency value is 0. Of course, the transparency adjustment process can still be processed using the above formula A, which will not be elaborated here.

[0166] In some embodiments of this application, the mobile phone can also adjust the transparency of the transition area in the target mask to create a gradient transparency effect. Specifically, the transparency value of the transition area can be processed by image color inversion. For example, if the transparency value of the transition area is 110, the adjusted transparency value of the transition area is 255-110=145. Image color inversion processing can be understood as changing the color value of pixels in the image, making dark pixels brighter and bright pixels darker, thereby creating a color inversion effect in the image.

[0167] In other words, during the process of creating an intermediate layer by overlaying the target mask with the darkening layer, the opacity of the target mask changes from 0 to 1% from the inside out. The opacity of the overlapping areas in the intermediate layer changes from 0 to 1% from the outside in.

[0168] Similarly, referring to Figure 9(B), the phone can overlay the intermediate layer with the target image to generate a second always-on display image. This can also be achieved using formula B mentioned above, which will not be elaborated further here. In this way, the area corresponding to the masked region in the generated second always-on display image can display the target image, and the outline of the masked region has a feathered effect.

[0169] Thus, the embodiments of this application can further adjust the masking parameters of the target mask, improving the aesthetics of the second always-on display image. This enhances the fun of the always-on display and improves the user experience.

[0170] In some other embodiments, the shape of the mask can also be other shapes, such as irregular shapes or text shapes.

[0171] In some embodiments, the mask can be preset or user-defined. For example, an interface can be provided for users to set the mask shape. Users can draw a custom mask shape by selection input, key input or handwriting input. Then the system saves the shape as a mask and applies it to the always-on display using the method provided in the foregoing embodiments (e.g., Figure 8) to present an interesting effect.

[0172] In another possible implementation, the aforementioned mobile phone can display a second always-on display image on the second always-on display screen. Furthermore, while displaying a time-based always-on display image on the first screen, the phone can also display a target always-on display image on the second screen. The target always-on display image can be generated based on the time-based always-on display image. Specifically, the mobile phone can also overlay the target mask and the time-based always-on display image to generate the target always-on display image. The transparency of the masked area in the target always-on display image can be less than the transparency of other areas, so that the image brightness corresponding to the masked area is greater than the image brightness of other areas. It should be noted that the embodiments of this application do not specifically limit the generation process of the target always-on display image.

[0173] Continuing with the example of a circular mask, the entire circular mask consists of opaque pixels, while the outermost pixels are transparent. The color of the entire circular mask can be set to white. The target mask can be positioned at the same location as the operation area. Next, the phone can overlay the target mask onto the always-on display image, so that the masked area corresponding to the target mask in the always-on display image is a white, opaque area, while the areas outside the masked area are the darkened areas corresponding to the always-on display image. For example, during the layer overlay process, the phone can also directly overlay the target mask and the always-on display image using formula B mentioned above to obtain the target always-on display image. Referring to Figure 10, the image brightness of the masked area corresponding to the target mask in the target always-on display image is greater than other areas. This allows users to illuminate the operation area, enhancing the user's interactive experience and overall enjoyment.

[0174] In some embodiments of this application, after detecting a first event for the mobile phone and adjusting the image brightness of a first area in the first always-on display image, the mobile phone can also detect a second event and display a third always-on display interface. The third always-on display interface is an interface after adjusting the interface brightness of the second always-on display interface. The interface brightness of the second area corresponding to the first area in the third always-on display interface is consistent with the interface brightness of other areas in the third always-on display interface. The second event includes at least one of a gaze-off event or a detachment from contact with an electronic device event.

[0175] In some examples, the user input operation may include a detachment operation from the electronic device and / or a look-away operation. For example, a detachment operation could be the user removing their finger from the display screen, and a look-away operation could be the user looking away from the display screen or away from an image displayed on the screen. It should be noted that the embodiments of this application do not specifically limit the user input operation.

[0176] When a user removes their contact with the electronic device and / or takes their gaze away from the phone, it indicates that further interaction with the phone is no longer necessary. Upon detecting this second event, the phone can restore the brightness of the first area of ​​the second always-on display to match the brightness of the other areas.

[0177] In one possible implementation, the phone detects a second event related to the phone and directly displays the first always-on display. For example, the phone can directly display the first always-on display, which includes the aforementioned first always-on image.

[0178] In another possible implementation, the mobile phone can display a third always-on display image in a third always-on display interface. This third always-on display image can be generated based on either the second always-on display image or a target image. For example, the mobile phone can generate the third always-on display image using a target image and a darkened layer. It should be noted that the process of generating the third always-on display image is similar to the process of generating the first always-on display image, and will not be described again here. As another example, the mobile phone can also generate the third always-on display image based on a target mask and a second always-on display image. The brightness of the masked area in the third always-on display image can be made consistent with the brightness of other areas by changing the transparency of the corresponding masked area. It should be noted that the embodiments of this application do not specifically limit the generation process of the third always-on display image.

[0179] Thus, this embodiment of the application can restore the brightness of the interface area operated by the user after the user stops interacting with the mobile phone. The user can arbitrarily control the interface area in the first always-on display to achieve the lighting effect. At the same time, after the user stops operating, the lit area returns to its original effect. This enhances the fun of the always-on display and improves the user experience.

[0180] The above scenarios involve a user touching and / or looking at the phone, and then removing their contact and / or no longer looking at the phone; for example, a user tapping the screen once or long-pressing to tap the screen. This application also provides a scenario where a user can swipe and / or move their gaze on the phone, and the screen lights up as the user's actions change.

[0181] Specifically, the phone can detect a first event, and as the position of the operation area corresponding to the first event changes, a second always-on display is shown. In the second always-on display, the first area changes as the position of the operation area corresponding to the first event changes.

[0182] Similarly, after detecting the first event, the phone can determine the location information of the corresponding operation area. Then, based on the location information of the operation area of ​​the first event, the phone can generate a second always-on display image and display it on the second always-on display screen. In other words, as the location of the operation area corresponding to the first event changes, the location of the area corresponding to the masked area in the second always-on display image continuously changes.

[0183] It is understood that the process of generating the second always-on display image based on the position information of the operation area is similar to the process of generating the second always-on display image in the above embodiment, and will not be described again here. At the same time, as the position of the operation area corresponding to the first event changes, the position information of each operation area may be the same or different, and the areas corresponding to the masking area in the second always-on display image may be the same or different.

[0184] For example, referring to Figure 11(A), the mobile phone can detect a first event and determine the location information of the operation area 1 of the first event. After determining the location information of the operation area 1, the mobile phone can use a target mask to align the position of the target mask with the position 1 of the operation area 1. Then, it is overlaid with the aforementioned darkening layer and target image to generate a second always-on display image corresponding to the operation area 1.

[0185] As another example, referring to Figure 11(B), the position information of the operation area changes, and the mobile phone can detect the first event and determine the position information of operation area 2. After determining the position information of operation area 2, the mobile phone changes the position of the target mask to correspond to position 2 of operation area 2. Then, it overlays it with the aforementioned darkening layer and target image to generate the second always-on display image corresponding to operation area 2.

[0186] As another example, referring to Figure 11(C), the position information of the operation area changes again, and the mobile phone can detect the first event and determine the position information of operation area 3. After determining the position information of operation area 3, the mobile phone changes the position of the target mask to correspond to the position of operation area 3. Then, it overlays it with the darkening layer and the target image to generate the second always-on display image corresponding to operation area 3. Finally, the mobile phone can display the corresponding second always-on display image sequentially as the position of the operation area corresponding to the first event changes, so as to achieve a gradual lighting effect. Similarly, referring to Figure 11(D), when the mobile phone detects the second event, it directly displays the first always-on display image to restore the original always-on display effect.

[0187] In other words, the phone can gradually light up the interface area as the finger slides, allowing the user to view the original display effect of the target image. Thus, this embodiment of the application can gradually adjust the interface brightness as the user continuously operates the phone. This further meets the user's interactive needs in screen-off scenarios, improving interactive flexibility and ultimately enhancing the user experience.

[0188] In some embodiments of this application, the above-described display method can be executed via a smart sensor hub in a mobile phone. An application processor is coupled to the smart sensor hub, which processes data acquired by the image sensor and touch sensor.

[0189] In one feasible approach, the smart sensor hub detects a first event targeting the mobile phone and acquires target data, including at least one of gaze data collected by an image sensor or touch data collected by a touch sensor. Based on the target data, the smart sensor hub determines the location information of the operating area. The smart sensor hub can also set a target mask based on the location information. Furthermore, the smart sensor hub can overlay the target mask with a darkening layer to generate an intermediate layer, where the transparency of the masked area is greater than the transparency of other areas in the intermediate layer. The smart sensor hub can also overlay the intermediate layer with a target image to generate a second always-on display image, where the transparency of the masked area is less than the transparency of other areas in the second always-on display image. Finally, the smart sensor hub can control the display screen to show the second always-on display image.

[0190] In another possible implementation, a smart sensor hub can implement the aforementioned method. For example, referring to Figure 12, the smart sensor hub may include an acquisition module 1210, a processing module 1220, and a drawing module 1230. The acquisition module 1210 detects a first event targeting the mobile phone and acquires target data, which includes at least one of gaze data collected by an image sensor or touch data collected by a touch sensor. The processing module 1220 determines the location information of the operating area based on the target data. The drawing module 1230 sets a target mask based on the location information. The drawing module 1230 also overlays the target mask with a darkening layer to generate an intermediate layer, where the transparency of the masked area corresponding to the target mask in the intermediate layer is greater than the transparency of other areas in the intermediate layer. The drawing module 1230 further overlays the intermediate layer with a target image to generate a second always-on display image, where the transparency of the masked area corresponding to the target mask in the second always-on display image is less than the transparency of other areas in the second always-on display image. Then, the drawing module 1230 also controls the display screen to display the second always-on display image on the second always-on display screen.

[0191] Thus, in this embodiment, the mobile phone can utilize the sensor hub to control the sensors in real time and process the sensor data while the processor is in sleep mode, as well as to draw the aforementioned second always-on display image, thereby adjusting the brightness of certain areas of the interface. This achieves a more interactive and engaging experience for the user in a low-power manner during always-on display scenarios.

[0192] In some solutions, multiple embodiments of this application can be combined, and the combined solution can be implemented. Optionally, some operations in the process of each method embodiment may be combined, and / or the order of some operations may be changed. Furthermore, the execution order between the steps of each process is merely exemplary and does not constitute a limitation on the execution order between steps; other execution orders are also possible. It is not intended to indicate that the execution order is the only possible order in which these operations can be performed.

[0193] Those skilled in the art will conceive of various ways to reorder the operations described in the embodiments of this application. Furthermore, it should be noted that process details involved in one embodiment of this application are similarly applicable to other embodiments, or different embodiments can be combined.

[0194] Furthermore, some steps in the method embodiments can be equivalently replaced with other possible steps. Alternatively, some steps in the method embodiments may be optional and can be deleted in certain use cases. Or, other possible steps may be added to the method embodiments.

[0195] Furthermore, the various method embodiments can be implemented individually or in combination.

[0196] This application also provides an electronic device, such as the mobile phone described above, as shown in FIG13. The mobile phone may include one or more processors 1310, memory 1320 and communication interface 1330.

[0197] The memory 1320, communication interface 1330, and processor 1310 are coupled together. For example, the memory 1320, communication interface 1330, and processor 1310 can be coupled together via bus 1340.

[0198] The communication interface 1330 is used for data transmission with other devices. The memory 1320 stores computer program code. The computer program code includes computer instructions, which, when executed by the processor 1310, cause the electronic device to perform the relevant method steps in the embodiments of this application.

[0199] Processor 1310 may be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It may implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with this disclosure. The processor may also be a combination that implements computational functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0200] Bus 1340 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The aforementioned bus 1340 can be divided into address bus, data bus, control bus, etc. For ease of illustration, only one thick line is used in Figure 13, but this does not indicate that there is only one bus or one type of bus.

[0201] This application also provides an electronic device, which includes a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, which includes computer instructions, and when the computer instructions are executed by the processor, the electronic device performs the relevant method steps in the above method embodiments.

[0202] This application also provides a communication device, which includes a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, which includes computer instructions, and when the computer instructions are executed by the processor, the communication device performs the relevant method steps in the above method embodiments.

[0203] This application also provides a computer-readable storage medium storing computer program code. When the processor executes the computer program code, the electronic device executes the relevant method steps in the above method embodiments.

[0204] This application also provides a computer program product containing instructions that, when executed on a computer or processor, cause the computer or processor to perform the relevant method steps as described in the above method embodiments.

[0205] This application also provides a chip system, including: a processor coupled to a memory, the memory being used to store programs or instructions, and when the program or instructions are executed by the processor, the chip system enables the methods in any of the above method embodiments.

[0206] Optionally, the chip system may contain one or more processors. These processors can be implemented in hardware or software. When implemented in hardware, the processor can be a logic circuit, an integrated circuit, etc. When implemented in software, the processor can be a general-purpose processor, implemented by reading software code stored in memory.

[0207] Optionally, the chip system may contain one or more memories. The memory may be integrated with the processor or disposed separately from it; this application embodiment does not limit this. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or disposed separately on different chips. This application embodiment does not specifically limit the type of memory or the arrangement of the memory and processor.

[0208] For example, the chip system may be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a micro controller unit (MCU), a programmable logic device (PLD), or other integrated chips.

[0209] The electronic devices, computer storage media, or computer program products provided in this application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0210] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0211] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.

[0212] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units, located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0213] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0214] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the contributing parts, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0215] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A display method, characterized in that, Applied to electronic devices, the method includes: Receive a screen-off event; the screen-off event is used to activate the screen-off display function. In response to the screen-off event, the first screen-off interface is displayed; Upon detecting a first event for the electronic device, a second always-on display is shown. The second always-on display is an interface after adjusting the brightness of the first always-on display, and the brightness of the first area in the second always-on display is greater than the brightness of other areas in the second always-on display. The first event includes at least one of a gaze event or a contact event, and the first area corresponds to the operation area of ​​the first event.

2. The method according to claim 1, characterized in that, The step of detecting a first event for the electronic device and displaying a second always-on display includes: Upon detecting a first event for the electronic device, as the position of the operation area corresponding to the first event changes, a second always-on display is shown, wherein the first area in the second always-on display changes as the position of the operation area corresponding to the first event changes.

3. The method according to claim 1 or 2, characterized in that, The step of displaying a first always-on display in response to the always-on event includes: In response to the screen-off event, a darkening layer is overlaid on the target image to generate a first screen-off image; the darkening layer is used to reduce the image brightness of the target image. The first always-on display image is displayed on the first always-on display screen. The second always-on display includes: A second always-on display image is shown on the second always-on display screen, and the second always-on display image is generated based on the target image.

4. The method according to claim 3, characterized in that, The step of detecting a first event for the electronic device and displaying a second always-on display image on the second always-on display screen includes: A first event is detected targeting the electronic device, and the location information of the operating area of ​​the first event is determined; Based on the location information, a target mask is set, and the position of the target mask corresponds to the position of the operation area; The target mask is superimposed on the darkened layer to generate an intermediate layer, wherein the transparency of the mask area corresponding to the target mask in the intermediate layer is greater than the transparency of other areas in the intermediate layer; The intermediate layer is overlaid with the target image to generate the second always-on display image, wherein the transparency of the masked area in the second always-on display image is less than the transparency of other areas in the second always-on display image; The second always-on display image is displayed on the second always-on display screen.

5. The method according to claim 4, characterized in that, The step of overlaying the target mask with the darkened layer to generate an intermediate layer includes: The transparency of the overlapping area between the target mask and the darkened layer is adjusted to generate an intermediate layer.

6. The method according to claim 5, characterized in that, The target mask includes a feathered transition region, which is the outline region of the target mask; Adjusting the transparency of the overlapping area between the target mask and the darkened layer includes: In the overlapping area between the target mask and the darkened layer, the area other than the transition area is adjusted to be a transparent area.

7. The method according to any one of claims 1-6, characterized in that, After detecting a first event for the electronic device and displaying a second always-on display, the method further includes: Upon detecting a second event related to the electronic device, a third always-on display is shown. The third always-on display is an interface after adjusting the brightness of the second always-on display. The brightness of the second area corresponding to the first area in the third always-on display is consistent with the brightness of other areas in the third always-on display. The second event includes at least one of a gaze-off event or a detachment from contact with the electronic device event.

8. The method according to any one of claims 1-6, characterized in that, After detecting a first event for the electronic device and displaying a second always-on display, the method further includes: A second event is detected for the electronic device, and the first always-on display is shown; the second event includes at least one of an event where the view leaves the device or an event where the view is no longer in contact with the electronic device.

9. The method according to any one of claims 4-6, characterized in that, The electronic device includes an image sensor, a touch sensor, and a smart sensor hub, wherein the smart sensor hub is used to process the data collected by the image sensor and the touch sensor; The step of detecting a first event targeting the electronic device and determining the location information of the operating area includes: The smart sensor hub detects a first event for the electronic device and acquires target data, the target data including at least one of gaze data collected by the image sensor or touch data collected by the touch sensor; The intelligent sensor hub determines the location information of the operating area based on the target data; The step of setting a target mask based on the location information includes: The intelligent sensor hub sets a target mask based on the location information.

10. An electronic device, characterized in that, The electronic device includes a memory, one or more processors, and a display screen; the memory is coupled to the processor; wherein the display screen is used to display an always-on image, the memory stores computer program code, the computer program code including computer instructions, and when the computer instructions are executed by the processor, the electronic device performs the display method as described in any one of claims 1-9.

11. A computer-readable storage medium storing instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the display method as described in any one of claims 1-9.

12. A computer program product, characterized in that, The computer program product includes instructions that, when executed on a computer or processor, cause the computer or processor to perform the display method as described in any one of claims 1-9.

Images