Display control method and electronic equipment
By deploying multiple light sensors in different display areas of the foldable screen and switching the light sensors according to changes in screen posture, the problem of insufficient dimming requirements in traditional designs is solved, thus improving the user's visual experience.
Patent Information
- Application Number
- CN202411008640.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-25
- Publication Date
- 2026-01-27
AI Technical Summary
The design of light sensors in traditional electronic devices cannot meet the dimming requirements of foldable screens in different postures, resulting in a poor visual experience for users.
At least two light sensors are deployed in different display areas of the foldable screen. The light sensors are switched according to the screen's orientation to detect ambient light information and control the display brightness.
It enables flexible switching of light sensors based on changes in the posture of electronic devices, meeting the dimming needs of different display states and enhancing the user's visual experience.
Smart Images

Figure CN121415696A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of electronic equipment technology, and in particular to a display control method and an electronic device. Background Technology
[0002] Currently, many electronic devices are equipped with ambient light sensors (or light sensors) to detect the intensity of light in the external environment (illuminance). This allows them to adjust the brightness of the electronic device's display screen based on the ambient light level, ensuring user comfort when viewing the screen content under different illuminance conditions. In traditional designs, typically one light sensor is placed on a single screen.
[0003] As the physical form of electronic devices evolves, such as mobile phones, from a single flat screen to a foldable screen, new demands are placed on the design and use of light-sensing devices. Summary of the Invention
[0004] This application provides a display control method and an electronic device for switching light sensors according to changes in the posture of the electronic device, so as to control the display brightness of the foldable screen of the electronic device by utilizing the ambient light information detected by the corresponding light sensors, thereby meeting the dimming requirements under different postures.
[0005] In a first aspect, embodiments of this application provide a display control method applied to an electronic device with a foldable screen, wherein the foldable screen is a tri-fold screen, and at least two photosensitive devices of the electronic device are deployed on different display areas of the tri-fold screen. The method may include: when the tri-fold screen is in a first posture, controlling the display brightness of the tri-fold screen using ambient light information detected by a first photosensitive device among the at least two photosensitive devices; determining that the tri-fold screen changes from the first posture to a second posture, the second posture being associated with a second photosensitive device among the at least two photosensitive devices; and when the tri-fold screen is in the second posture, controlling the display brightness of the tri-fold screen using ambient light information detected by the second photosensitive device.
[0006] Using the above method, the light-sensing devices can be flexibly switched according to the changes in the orientation of the foldable screen of the electronic device, so as to meet the different dimming requirements of different display states of the electronic device and ensure the user's visual experience.
[0007] In one possible implementation, the tri-fold screen may include a first display area, a second display area, and a third display area. The first display area and the third display area are connected by a first folding axis, and the second display area and the third display area are connected by a second folding axis. At least two light sensors are deployed on the first display area and the second display area, and no light sensors are provided on the third display area. The first posture and the second posture correspond to different display postures of the tri-fold screen relative to the user's viewing angle under the same physical posture; or, the first posture and the second posture correspond to different physical postures of the tri-fold screen.
[0008] As an example, the device attitude angle of an electronic device can be used to represent the different display attitude information of the electronic device relative to the user's viewpoint under the same physical attitude. The device attitude angle may include at least one of the following: pitch angle, roll angle, or yaw angle.
[0009] In one example, when the tri-fold screen is fully unfolded, the first posture and the second posture can correspond to different display postures of the tri-fold screen at different flip angles relative to the user's viewing angle when it is fully unfolded. Specifically, the first posture can be associated with the landscape display posture of the tri-fold screen in the fully unfolded position, and the first light sensor is a light sensor located in the second display area. The landscape display posture of the tri-fold screen rotates clockwise based on the flip angle to the first portrait display posture of the tri-fold screen. The second posture can be associated with the first portrait display posture, and the second light sensor is a light sensor located in the first display area. In other words, when the tri-fold screen changes from a landscape display posture to the first portrait display posture in the fully unfolded position, the light sensor can be switched to the one located in the first display area to ensure the corresponding dimming requirements.
[0010] In one possible implementation, the landscape display posture of the tri-fold screen is adjusted by rotating the flip angle counterclockwise to a second portrait display posture. The method may further include: determining that the tri-fold screen changes from the first portrait display posture to the second portrait display posture; and, when the tri-fold screen is in the second portrait display posture, controlling the display brightness of the tri-fold screen using ambient light information detected by the second light sensor. In other words, when the second light sensor is located in the first display area, it is less affected by factors such as right-hand obstruction, and therefore does not need to switch the light sensor based on the landscape / portrait posture change, thus ensuring dimming stability.
[0011] In another example, in the fully unfolded state of the tri-fold screen, the first and second postures correspond to different display postures of the tri-fold screen at different rotation angles relative to the user's viewing angle in the fully unfolded state. The first posture is associated with the landscape display posture of the tri-fold screen in the fully unfolded state, and the first light sensor is a light sensor located in the first display area. The landscape display posture of the tri-fold screen rotates counterclockwise based on the rotation angle to the third portrait display posture of the tri-fold screen. The second posture is associated with the third portrait display posture, and the second light sensor is a light sensor located in the second display area. That is, when the tri-fold screen changes from a landscape display posture to the third portrait display posture in the fully unfolded state, the light sensor can be switched to the light sensor in the second display area to ensure the corresponding dimming requirements.
[0012] In one possible implementation, the landscape display posture of the tri-fold screen is changed to a fourth portrait display posture based on a clockwise rotation of the flip angle. The method may further include: determining that the tri-fold screen changes from the third portrait display posture to the fourth portrait display posture; and, when the tri-fold screen is in the fourth portrait display posture, controlling the display brightness of the tri-fold screen using ambient light information detected by the second light sensor. That is, when the second light sensor is located in the second display area, it is less affected by factors such as left-hand obstruction, and the light sensor does not need to be switched based on the landscape / portrait posture change, thus ensuring dimming stability.
[0013] In another example, when the first posture and the second posture correspond to different physical postures of the tri-fold screen, the first light sensor is a light sensor disposed in the first display area, and the second light sensor is a light sensor disposed in the second display area.
[0014] In one possible implementation, the first posture is associated with a first display state or a second display state of the tri-fold screen. In the first display state and the second display state, the displayable area of the tri-fold screen includes the first display area but excludes the second display area. The second posture is associated with a third display state of the tri-fold screen. In the third display state, the displayable area of the tri-fold screen includes the second display area but excludes the first display area. Alternatively, the second posture is associated with a fourth display state of the tri-fold screen. In the fourth display state, the displayable area of the tri-fold screen includes both the first display area and the second display area.
[0015] In one possible implementation, in the first display state, the first display area and the third display area are folded backward along the first folding axis, and the second display area and the third display area are folded forward along the second folding axis, and the displayable area of the tri-fold screen does not yet include the third display area; in the second display state, the second display area and the third display area are folded forward along the second folding axis, the first display area and the third display area are not folded, and the displayable area of the tri-fold screen does not yet include the third display area; in the third display state, the first display area and the third display area are folded backward along the first folding axis, the second display area and the third display area are not folded, and the displayable area of the tri-fold screen still includes the third display area; in the fourth display state, the first display area and the third display area are not folded, the second display area and the third display area are not folded, and the displayable area of the tri-fold screen still includes the third display area.
[0016] A second aspect provides an electronic device comprising a plurality of functional modules; the plurality of functional modules interact to implement the methods performed by the electronic device in the first aspect and its embodiments described above. The plurality of functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the plurality of functional modules can be arbitrarily combined or divided based on specific implementations.
[0017] A third aspect provides an apparatus comprising at least one processor and at least one memory, wherein the at least one memory stores computer program instructions, and when the apparatus is in operation, the at least one processor executes the methods performed by electronic devices described in the first aspect and its embodiments.
[0018] The fourth aspect also provides a program product that, when run on a device, causes the device to perform the method executed by the electronic device in any of the above aspects and embodiments.
[0019] The fifth aspect also provides a readable storage medium storing a program that, when executed by a device, causes the device to perform the method executed by the electronic device in any of the above aspects and embodiments.
[0020] The sixth aspect also provides a chip for reading a program stored in a memory and executing the method performed by the electronic device in any of the above aspects and embodiments.
[0021] A seventh aspect also provides a chip system including a processor for supporting devices in performing methods of electronic devices according to any of the above aspects and embodiments. In one possible design, the chip system further includes a memory for storing the necessary programs and data. The chip system may be composed of chips or may include chips and other discrete devices.
[0022] It should be noted that the beneficial effects of the various designs of the electronic devices provided in the second to seventh aspects of the embodiments of this application can be referred to the beneficial effects of any possible design in the first aspect, and will not be repeated here. Attached Figure Description
[0023] Figure 1 This is a schematic diagram of the hardware structure of a possible electronic device according to an embodiment of this application;
[0024] Figure 2 A software architecture block diagram of an electronic device provided in an embodiment of this application;
[0025] Figure 3 This is a schematic diagram of a system architecture that may be applicable to a display control method provided in an embodiment of this application;
[0026] Figure 4 A flowchart illustrating a display control method provided in an embodiment of this application;
[0027] Figures 5a-5b This is a schematic diagram illustrating a possible tri-fold screen example according to an embodiment of this application;
[0028] Figure 6 This is a schematic diagram illustrating the folding methods supported by the tri-fold screen provided in an embodiment of this application;
[0029] Figures 7a-7d This is a schematic diagram showing the display states corresponding to different physical orientations of the tri-fold screen in an embodiment of this application;
[0030] Figure 8a This is a schematic diagram from the user's perspective, representing an embodiment of this application.
[0031] Figure 8b This is a schematic diagram illustrating the change in the attitude angle of an electronic device relative to the user's viewpoint, according to an embodiment of this application.
[0032] Figure 9 This is a schematic diagram of the electronic device relative to the user's viewing angle based on the change in flip angle, according to an embodiment of this application.
[0033] Figure 10 This is a schematic diagram of the electronic device according to an embodiment of this application, showing the change in the flip angle when the tri-fold screen is in a fully folded posture;
[0034] Figure 11 This is a schematic diagram illustrating the change in the flip angle of an electronic device according to an embodiment of this application with its tri-fold screen in a semi-folded posture;
[0035] Figure 12 This is a schematic diagram illustrating the change in the flip angle of an electronic device according to an embodiment of this application when the tri-fold screen is in another semi-folded posture;
[0036] Figures 13a-13d This is a schematic diagram of the electronic device according to an embodiment of the present application with the tri-fold screen in a fully unfolded position, based on the change in the flip angle.
[0037] Figure 13e This is a schematic diagram illustrating the vertical screen display posture of the electronic device according to an embodiment of this application as the tri-fold screen changes from the M state to the G state. Detailed Implementation
[0038] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the embodiments of this application will be further described in detail below with reference to the accompanying drawings. In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined with "first" and "second" may explicitly or implicitly include one or more of that feature.
[0039] It should be understood that in the embodiments of this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c can be single or multiple.
[0040] First, the technical solutions in this application can be applied to electronic devices, which can be any device with a foldable screen or associated with a foldable screen. For example, electronic devices can be mobile phones, foldable phones, tablets, wearable devices (e.g., watches, bracelets, glasses, etc.), in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), smart home devices (e.g., smart TVs, etc.). This application does not limit the specific type of electronic device.
[0041] The electronic devices to which this application can be applied can also be portable terminal devices that include other functions such as personal digital assistants and / or music players. Or electronic devices with other operating systems.
[0042] Figure 1 A schematic diagram of the hardware structure of a possible electronic device is shown. (See attached image.) Figure 1 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0043] Processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors. The controller may serve as the central nervous system and command center of the electronic device 100. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. Processor 110 may also include memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that processor 110 has recently used or is repeatedly used. If processor 110 needs to reuse an instruction or data, it can directly retrieve it from the memory. This avoids repeated access, reduces the waiting time of processor 110, and thus improves system efficiency.
[0044] USB interface 130 is a USB standard compliant interface, specifically a Mini USB interface, Micro USB interface, USB Type-C interface, etc. USB interface 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. Charging management module 140 receives charging input from the charger. Power management module 141 connects battery 142, charging management module 140, and processor 110. Power management module 141 receives input from battery 142 and / or charging management module 140, providing power to processor 110, internal memory 121, external memory, display 194, camera 193, and wireless communication module 160, etc.
[0045] The wireless communication function of electronic device 100 can be implemented through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor, and baseband processor. Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0046] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0047] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0048] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0049] Display screen 194 is used to display the application's interface, such as the desktop of electronic device 100. The desktop may include icons of applications installed on electronic device 100 and created shortcut icons. For example, display screen 194 can change with the posture of the electronic device, displaying different image frames in different postures, providing the user with a dynamic visual effect that blends with reality. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays screens 194, where N is a positive integer greater than 1.
[0050] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0051] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. For example, processor 110 executes the instructions stored in internal memory 121, causing electronic device 100 to perform the methods described in the embodiments of this application. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system and software code of at least one application (APP). The data storage area may store data generated during the use of electronic device 100 (e.g., captured images, recorded videos, etc.). In addition, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0052] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, images, videos, and other files can be saved on the external memory card.
[0053] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0054] The sensor module 180 may include, but is not limited to, a pressure sensor 180A, an acceleration sensor 180B, a touch sensor 180C, a gyroscope sensor 180D, a hinge 180E, a rotation vector sensor 180F, a distance sensor 180G, and a light sensor 180H.
[0055] The pressure sensor 180A is used to sense pressure signals and can convert the pressure signals into electrical signals. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194.
[0056] Touch sensor 180C, also known as a "touch panel," can be disposed on display screen 194. The touch sensor 180C and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180C is used to detect touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180C may also be disposed on the surface of electronic device 100, in a different location than display screen 194. The form of touch sensor 180C is not limited in this embodiment.
[0057] Accelerometer 180B, gyroscope 180D, hinge 180E, rotation vector sensor 180F, distance sensor 180G, etc., can be used to detect attitude changes of electronic device 100. For example, the accelerometer can measure the gravitational acceleration of the electronic device, the gyroscope can measure the yaw rate, the hinge can measure the folded or unfolded state, the rotation vector sensor can measure the angle of rotation of the electronic device about a fixed axis, and the distance sensor can measure the distance of the electronic device relative to the user's face (or eyes). The different sensors of the electronic device can communicate with the processor of the electronic device and provide the processor with the collected sensor data as input information. The processor can process the acquired sensor data to obtain the attitude information of the electronic device at the current moment. When a change in the attitude of the electronic device 100 is detected, the processor dynamically controls the display on the display screen 194 according to the attitude change. For example, the processor can switch the light sensor 180H and adjust the display brightness of the screen based on the ambient light information collected by the light sensor 180H to improve the user's visual experience. The following will provide a detailed description in conjunction with the accompanying drawings and embodiments, which will not be repeated here.
[0058] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch buttons. Electronic device 100 can receive button inputs and generate key signal inputs related to user settings and function control. Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, touch operations applied to different applications (such as taking photos, audio playback, etc.) can correspond to different vibration feedback effects. Touch vibration feedback effects can also be customized. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, or to indicate messages, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with electronic device 100.
[0059] Understandable, Figure 1 The components shown do not constitute a specific limitation on the electronic device 100. The electronic device may also include more or fewer components than shown, or combine some components, or separate some components, or have different component arrangements. Furthermore, Figure 1 The combination / connection relationships between the components can also be adjusted and modified.
[0060] Figure 2 This is a software structure block diagram of an electronic device provided in an embodiment of this application. For example... Figure 2 As shown, the software architecture of an electronic device can be a layered architecture. For example, the software can be divided into several layers, each with a clear role and division of labor. Layers communicate with each other through software interfaces. In some embodiments, the operating system is divided into four layers, from top to bottom: the application layer, the application framework layer (framework, FWK), the runtime and system libraries, and the kernel layer. In other embodiments, the operating system may also be divided into other layers; this application does not limit this.
[0061] The application layer can include a series of application packages. For example... Figure 2 As shown, the application layer can include camera, settings, skin modules, user interface (UI), third-party applications, etc. Third-party applications can include gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, SMS, etc.
[0062] The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer can include some predefined functions. For example... Figure 2As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.
[0063] A window manager is used to manage window programs. The window manager can obtain the screen size, determine if a status bar exists, lock the screen, and capture the screen, etc. It is understood that, in this embodiment, when multiple windows are displayed on the screen, the window manager can be used to manage multiple windows simultaneously, such as managing the position and size of multiple windows.
[0064] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.
[0065] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0066] A phone manager is used to provide communication functions for electronic devices. For example, it manages call status (including connection and disconnection).
[0067] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0068] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.
[0069] The runtime includes the core libraries and the virtual machine. The runtime is responsible for the scheduling and management of the operating system.
[0070] The core library consists of two parts: one part contains the functionalities that the Java language needs to call, and the other part contains the core libraries of the operating system. The application layer and application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0071] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0072] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.
[0073] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.
[0074] 3D graphics processing libraries are used to implement 3D graphics drawing, image rendering, compositing, and layer processing. 2D graphics engines are drawing engines for 2D graphics.
[0075] In some embodiments, a 3D graphics processing library can be used to draw 3D motion trajectory images, and a 2D graphics engine can be used to draw 2D motion trajectory images. In some embodiments, the 3D graphics processing library and the 2D graphics processing engine can be integrated into a single graphics processor; this application does not limit this approach.
[0076] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0077] The hardware layer can include various sensors, such as accelerometers, gyroscopes, and rotation vector sensors, which can be used to detect the posture of electronic devices (such as motion posture or physical posture). In order to combine the posture of electronic devices, the appropriate light-sensing device should be selected, and the ambient light information should be detected by the light-sensing device to control the brightness of the display screen, thereby ensuring the user's comfort in seeing the screen display content under different illuminance.
[0078] It should be noted that, Figure 1 and Figure 2 The structure shown is merely an example of an electronic device provided in this application embodiment and is not intended to limit the electronic device provided in this application embodiment in any way. In specific implementations, the electronic device may have more than Figure 1 or Figure 2 The structures shown may contain more or fewer devices or modules, or devices or modules used to achieve the same function may have other names, and this application does not limit this.
[0079] Figure 3 This is a system architecture diagram applicable to a display control method provided in an embodiment of this application. (See also...) Figure 3 As shown, the operating system of an electronic device can adopt a five-layer structure. Between the framework layer and the kernel layer, a Hardware Abstraction Layer (HAL) can be included to abstract the hardware, thereby hiding the hardware interface details of a specific platform. This provides the operating system with a virtual hardware platform, giving it hardware-insensitive characteristics and allowing it to be ported to multiple platforms. In simpler terms, actions that control the hardware can be executed by the Hardware Abstraction Layer.
[0080] For example, the HAL (Hardware Access Layer) can include drivers and interface libraries for processors, peripherals, sensors, etc. The HAL can include the processor's display engine, sensor drivers, and ambient light sensor drivers. The sensor drivers can obtain the electronic device's posture information from hardware-level sensors. The ambient light sensor drivers can obtain ambient light information about the electronic device's environment from hardware-level ambient light sensors. The display engine can obtain the electronic device's posture information from the sensor drivers, thus understanding the changes in the electronic device's posture, and using this information to control the display. For example, the display engine can switch the ambient light sensor currently in use based on the electronic device's posture changes, and use the ambient light information collected by the currently used ambient light sensor to control the display brightness of the electronic device's foldable screen.
[0081] In practical implementation, the hardware layer of electronic devices may include related hardware such as a sensor hub, for example, a sensor for detecting device posture (or posture sensor) and an ambient light sensor (or light sensor) for detecting ambient light information.
[0082] The sensor can be, for example, Figure 1 The gyroscope sensor, accelerometer, hinge, distance sensor, or other sensors (such as a Hall sensor, not shown in the figure) shown can be used to detect the usage posture of the electronic device and provide posture information of the electronic device to the upper-level driver. The electronic device may include at least two light sensors, which can be set on different display areas of the foldable screen to detect ambient light in the environment in which the electronic device is located and provide ambient light information to the upper-level driver.
[0083] For example, a hinge sensor can be used to provide hinge angles, which are the folding angles of different display areas of the foldable screen of an electronic device. These hinge angles can be used to determine the physical attitude of the foldable screen, including but not limited to: fully unfolded attitude, fully folded attitude, and at least one semi-folded attitude. Alternatively, gyroscope sensors, accelerometers, and distance sensors can be used to provide information on the different display attitudes of the electronic device relative to the user's viewing angle under the same physical attitude. Taking the device attitude angle of the electronic device as an example to represent the different display attitudes of the electronic device relative to the user's viewing angle under the same physical attitude, this device attitude angle can include at least one of the following: pitch angle, tilt angle, or yaw angle. Taking the tilt angle as an example, when the foldable screen of the electronic device is in a fully unfolded attitude, the display attitude of the electronic device can include a landscape display attitude and a portrait display attitude, which can be obtained by rotating the electronic device based on the tilt angle. Similarly, when the foldable screen of the electronic device is in a fully folded attitude or any semi-folded attitude, the display attitude of the electronic device can also include a landscape display attitude and a portrait display attitude, which can be obtained by rotating the electronic device based on the tilt angle. Based on the different postures of the electronic device, the display engine can control the operation of the corresponding light sensors to collect ambient light information, and use the ambient light information collected by the corresponding ambient light sensors to control the display brightness of the foldable screen of the electronic device. The following will describe various device postures according to embodiments of this application, as well as the correspondence between different device postures and light sensors, with reference to the accompanying drawings; these details will not be elaborated upon here.
[0084] The kernel layer of an electronic device can be the implementation layer of the software development kit (SDK) for the relevant hardware of the DSS, or it can include the DDIC driver, which provides necessary support and services for the display engine of the hardware abstraction layer, thus providing a stable, secure, and efficient operating environment for upper-layer applications. The kernel layer can also include an input hub, which can obtain information from the DDIC driver, ambient light sensor, and other sources during operation.
[0085] The framework layer of electronic devices may also include the framework for display engine services, the framework for optical services, and the sensor network inspection framework (SNIF) for sensor hubs.
[0086] The upper layer of an electronic device's framework layer can be an application layer, such as an app (APP) for implementing various business functions, or an ambient light sensor app. The ambient light sensor app can make relevant calls through the APIs or functions provided by the sensor hub (SNIF) of the framework layer to obtain relevant information from the sensor driver or ambient light sensor driver, and can provide the obtained information to the processor through the input hub so that the processor can implement display engine services or light services based on this information. Alternatively, the upper layer of the electronic device's framework layer can provide input information, such as ambient light information, obtained via a communication interface. Alternatively, the upper layer of the electronic device's framework layer can also include a backlight for a foldable screen, which can be controlled by a DDIC driver to control the display brightness of the foldable screen.
[0087] When the processor's display engine implements the display control method of this application embodiment, it can call the relevant display engine services through APIs or functions provided by the framework layer. Simultaneously, the display engine can also send corresponding control commands to the DDIC driver to implement the display control functions of this application embodiment. For example, the display engine can use ambient light information collected by the currently used ambient light sensor to send corresponding control commands to the DDIC driver, causing the DDIC driver to enhance or reduce the display brightness of the foldable screen. When the DDIC driver executes the control commands, it can call the relevant display light services through APIs or functions provided by the framework layer, and control the display brightness of the foldable screen in conjunction with the ambient light information. For example, controlling the display brightness of the foldable screen's backlight.
[0088] It should be understood that Figure 3 This is merely an illustrative example of a system architecture diagram applicable to the display control method of this application and is not intended to limit the scope of the invention. In other embodiments, the electronic device may have a more advanced design. Figure 3 The structures shown may contain more or fewer devices or modules, or devices or modules used to achieve the same function may have other names, and this application does not limit this.
[0089] The following uses a foldable screen of an electronic device implemented as a tri-fold screen as an example to introduce the display control method of this application embodiment. Here, a photosensitive device represents the ambient light sensor described above, used to detect ambient light information of the environment in which the electronic device is located. At least two photosensitive devices of the electronic device are deployed on different display areas of the tri-fold screen. Based on changes in the user's posture when using the electronic device, the processor can switch between photosensitive devices to control the display brightness of the tri-fold screen using the ambient light information detected by the corresponding photosensitive device, thereby meeting the dimming requirements under different postures. Figure 4 As shown, the display control method may include the following steps:
[0090] S410: When the tri-fold screen is in its first orientation, the processor uses the ambient light information detected by the first of at least two light sensors to control the display brightness of the tri-fold screen.
[0091] S420: The processor determines that the tri-fold screen changes from a first posture to a second posture, and the second posture is associated with the second of at least two light sensors.
[0092] S420: When the tri-fold screen is in its second orientation, the processor uses the ambient light information detected by the second light sensor to control the display brightness of the tri-fold screen.
[0093] In this embodiment, the first posture and the second posture represent two postures of the tri-fold screen before and after a posture change. This posture change can refer to a change in the physical posture of the tri-fold screen, or it can refer to different display postures of the tri-fold screen relative to the user's viewing angle under the same physical posture. The various postures of the tri-fold screen can correspond one-to-one with its various display states. In different display states, the displayable area of the tri-fold screen can be different, and the available light-sensing devices can also be different. The processor can control the display brightness of the tri-fold screen by switching the required light-sensing devices based on the actual posture changes and the correspondence between different postures and different display states.
[0094] To make it easier to understand, we will use examples below.
[0095] In this embodiment, the foldable screen of the electronic device can be displayed as a complete display area when fully unfolded. The user can fold the screen along one or more folding axes (or folding lines). The positions of the folding axes can be preset or arbitrarily selected by the user within the foldable screen. After the user folds the screen along the folding axes, the foldable screen can be divided into multiple display areas along the folding axes.
[0096] Taking a foldable screen as an example, such as a tri-fold screen, in one example... Figure 5a As shown, the folding axis of the electronic device may include folding axis 1 and folding axis 2. The foldable screen of the electronic device may be divided into three display areas along folding axis 1 and folding axis 2, respectively denoted as area A, area B, and area C. The areas of area A, area B, and area C are equal or approximately equal. In another example, such as... Figure 5b As shown, the folding axis of the electronic device may include folding axis 3 and folding axis 4. The foldable screen of the electronic device may be divided into three display areas along folding axis 3 and folding axis 4, respectively referred to as area A, area B and area C. The area of area A is similar to the area of area C, and the sum of the areas of area A and area C is approximately equal to the area of area B.
[0097] It should be noted that, Figure 5a and Figure 5b In this embodiment, areas A, B, or C can physically be the same screen or three screens. Alternatively, a combination of two areas from areas A, B, or C can be the same screen, with the remaining screen being another screen. This application does not limit this. In other embodiments, the foldable screen of the electronic device can also be a two-fold screen, a four-fold screen, or more folded screens. In different examples, the implementation method of dividing the foldable screen into several display areas can also be different, and this application does not limit this.
[0098] The following is based on Figure 5a Taking the tri-fold screen shown as an example, this paper introduces the posture changes of the foldable screen of electronic devices and the changes of the light-sensing devices involved in the corresponding postures.
[0099] by Figure 5a Taking the tri-fold screen example, in one example, folding axis 1 supports folding the corresponding display area to the back, and folding axis 2 supports folding the corresponding display area to the front. The back (or rear) described here refers to the side of each display area of the foldable screen facing away from the user, and the front refers to the side of each display area facing the user. In the embodiments of this application, it is generally assumed that the front of each display area has a display function. In specific implementations, it is not limited whether the back of each display area has a display function.
[0100] The folding mechanism supported by folding axis 1 can be described as follows: with area B fixed, rotate area A 0-180° away from area B; or with area A fixed, rotate area B 0-180° away from area A. The folding mechanism supported by folding axis 2 can be described as follows: with area B fixed, rotate area C 0-180° towards area B; or with area C fixed, rotate area B 0-180° towards area A. The top-down view of the electronic device is used as the perspective. Figure 6 The top view shown uses dashed arrows to indicate screen rotation directions. When area A is fixed, rotation direction 1 indicates rotating area B away from area A. When area B is fixed, rotation direction 2 indicates rotating area A away from area B. When area B is fixed, rotation direction 3 indicates rotating area C towards area B. When area C is fixed, rotation direction 4 indicates rotating area B towards area C.
[0101] In another example, the folding methods supported by folding axis 1 and folding axis 2 can be interchanged. For example, folding axis 2 supports folding the corresponding display area to the back, while folding axis 1 supports folding the corresponding display area to the front. Accordingly, the folding method supported by folding axis 1 can be described as: with area B fixed, rotating area A 0-180° towards area B; or as: with area A fixed, rotating area B 0-180° towards area A. The folding method supported by folding axis 2 can be described as: with area B fixed, rotating area C 0-180° away from area B; or as: with area C fixed, rotating area B 0-180° away from area A. In this example, the folding methods supported by folding axis 1 and folding axis 2 are... Figure 6 The folding methods shown are similar and will not be described again here.
[0102] based on Figure 6 The folding axis setup shown, along with the folding methods supported by the folding axis, indicates that the various physical postures of a tri-fold screen on an electronic device can include a fully unfolded posture, a fully folded posture, and at least one semi-folded posture, such as... Figures 7a-7d As shown, the display states of the tri-fold screen under different physical orientations can be represented as display state 1, display state 2, display state 3, and display state 4, respectively. In each display state, the displayable area of the tri-fold screen differs, and the light-sensing devices used may also differ.
[0103] (1) Fully extended posture and display state 1:
[0104] In the embodiments of this application, such as Figure 7a As shown in the front view on the left, in its fully unfolded state, the displayable area of the tri-fold screen includes areas A, B, and C, meaning that areas A, B, and C are displayed simultaneously. For example... Figure 7a As shown in the rear view on the right, the back of the electronic device includes three sections: C, B, and A. Some components of the electronic device may be located in only one of the three display areas of the tri-fold screen. For example, the light sensor 1 is located in the upper left of section A, the front-facing camera is located in the center of the top of the screen in section A, the light sensor 2 is located in the upper right of section C, and the rear camera is located on the back of section C. Considering the folding mechanism of the folding axis 1, components may not be located on the back of sections A and B.
[0105] Display state 1 corresponds to the fully unfolded posture of the tri-fold screen; display state 1 can also be called G state. In display state 1, the light-sensing devices that the tri-fold screen can use can include light-sensing device 1 located in area A or light-sensing device 2 located in area C.
[0106] (2) Half-folded posture 1 and display status 2:
[0107] In this embodiment of the application, based on Figure 7a The fully unfolded posture shown, with areas A and B fixed and different (areas A and B not folded), rotates area C 180° along folding axis 2 towards the direction facing area B, so that the front of area B is flush with the front of area C, which can be converted into a semi-folded posture. For easy distinction, this semi-folded posture can be represented as semi-folded posture 1.
[0108] In this semi-folded posture, such as Figure 7b As shown in the front view on the left, the front of area B is obscured by the back of area C. The displayable area of the tri-fold screen only includes area A, excluding areas B and C; that is, only area A is displayed. Figure 7b As shown in the rear view on the right, the back of the electronic device includes section A and section B. (Compared to...) Figure 7a Similarly, the light sensor 1 is located in the upper left corner of area A, the front camera is located in the center of the top of the screen in area A, and the rear camera is located on the back of area C. No components may be placed on the back of areas A and B.
[0109] Display state 2 corresponds to the half-folded posture 1 of the tri-fold screen. Display state 2 can also be called N state. In display state 2, the light sensor that can be used by the tri-fold screen is light sensor 1 located in area A.
[0110] (3) Half-folded posture 2 and display status 3:
[0111] In this embodiment of the application, based on Figure 7a The fully unfolded posture shown, keeping sections B and C fixed and different (sections B and C are not folded), rotate section A 180° away from section B along folding axis 1, so that the back of section A fits against the back of section B, which can be converted into another semi-folded posture. Or based on Figure 7b The half-folded posture transformation shown can also be converted into another half-folded posture. For ease of distinction, this other half-folded posture can be represented as half-folded posture 2.
[0112] In the semi-folded posture 2, as Figure 7c As shown in the front view on the left, the displayable area of the tri-fold screen includes areas B and C, meaning that areas B and C can be displayed simultaneously. Figure 7c In the rear view on the right, the back of the electronic device includes the C-section back and the A-section front. (Compared to...) Figure 7a Similarly, light sensor 1 is located at the upper left of area A, the front camera is located at the top center of the screen in area A, light sensor 2 is located at the upper right of area C, and the rear camera is located on the back of area C. No components may be placed on the back of areas A and B.
[0113] Display state 3 corresponds to the half-folded posture 2 of the tri-fold screen; display state 3 can also be called M state. In display state 3, the light sensor that can be used on the tri-fold screen is the light sensor 2 located in area C.
[0114] (4) Fully folded posture and display status 4:
[0115] In this embodiment of the application, based on Figure 7a The fully unfolded posture shown is maintained with area A fixed. Rotate area C 180° along folding axis 2 towards the direction facing area B, so that the front of area B aligns with the front of area C. Then, rotate area B 180° along folding axis 1 away from area A, so that the back of area A aligns with the back of area B. This can be converted to a fully folded posture. Alternatively, based on... Figure 7b or Figure 7c The half-folded posture transformation can also be converted into a fully folded posture.
[0116] In a fully folded posture, such as Figure 7d As shown in the front view on the left, the displayable area of the tri-fold screen only includes area A; that is, only area A is displayed, while areas B and C are not displayed. Figure 7d In the rear view on the right, the back of the electronic device includes the C-section back. (Compared to...) Figure 7a Similarly, the light sensor 1 is located at the upper left of area A, the front-facing camera is located at the top center of the screen in area A, and the rear camera is located on the back of area C. No components are required on the back of areas A and B. Since the front of area B and area C are flush, the light sensor 2 located in area C is not shown.
[0117] Display state 4 corresponds to the fully folded posture of the tri-fold screen; display state 4 can also be called F state. In display state 4, the light sensor that can be used on the tri-fold screen is light sensor 1 located in area A.
[0118] Understandable. Figures 7a-7d Only with tri-folding phones and Figure 5a The device form shown is an example illustrating different display states of an electronic device and not a limitation thereof. In other embodiments, if the electronic device is implemented in other product forms, the folding method of the foldable screen and the display state of the electronic device may also be different, which will not be elaborated here.
[0119] Figures 7a-7d The different physical postures shown correspond to the dimming strategies, as shown in Table 1 below:
[0120] Table 1
[0121]
[0122] Therefore, in implementation Figure 4When the display control method shown involves a change in posture and the light-sensing devices used before and after the posture change are different, the processor can switch the light-sensing devices according to the posture change, so as to use the ambient light information detected by the corresponding light-sensing devices to control the display brightness of the tri-fold screen.
[0123] For example, when the first posture and the second posture correspond to different physical postures of the tri-fold screen, the first photosensitive device can be a photosensitive device disposed in the first display area, and the second photosensitive device can be a photosensitive device disposed in the second display area. The display state associated with the first posture can be represented as either a first display state or a second display state. In both the first and second display states, the displayable area of the tri-fold screen includes the first display area but excludes the second display area. The display state associated with the second posture can be represented as a third display state, in which the displayable area of the tri-fold screen can include the second display area but exclude the first display area. Alternatively, the display state associated with the second posture can be represented as a fourth display state, in which the displayable area of the tri-fold screen can include both the first and second display areas.
[0124] by Figures 7a-7d Taking the example shown, area A can be represented as the first display area, area B as the third display area, area C as the second display area, folding axis 1 as the first folding axis, and folding axis 2 as the second folding axis. The first display state, or F state, corresponds to the fully folded posture. In the first display state, the first and third display areas are folded backwards along the first folding axis, and the second and third display areas are folded forwards along the second folding axis. The displayable area of the tri-fold screen does not include the third display area. The second display state, or N state, corresponds to half-folding posture 1, representing the first half-folding posture. In the second display state, the second and third display areas are folded forwards along the second folding axis, while the first and third display areas are not folded. The displayable area of the tri-fold screen does not include the third display area. The third display state, or M state, corresponds to half-folding posture 2, representing the second half-folding posture. In the third display state, the first and third display areas are folded backwards along the first folding axis, while the second and third display areas are not folded. The displayable area of the tri-fold screen also includes the third display area. The fourth display state, or G state, corresponds to the fully unfolded posture. In the fourth display state, the first and third display areas are not folded, the second and third display areas are not folded, and the displayable area of the tri-fold screen also includes the third display area.
[0125] It should be understood that the above description is merely illustrative and not in any way limiting. In other embodiments, if the posture change involves different physical postures of the tri-fold screen, the first light sensor may also be a light sensor disposed in the second display area, and the second light sensor may also be a light sensor disposed in the first display area. Accordingly, the first posture may be associated with the third or fourth display state described above, and the second posture may be associated with the first or second display state described above.
[0126] In other words, in the above display control method, the processor can analyze whether the physical posture of the tri-fold screen has changed based on the sensor data detected by various sensors, and switch to using the light sensor associated with the current physical posture to detect ambient light information when different light sensors are used for different physical postures, so as to meet the different dimming requirements under different physical postures.
[0127] In reality, due to the individualized usage habits of users, such as the different positions of the electronic device's display screen relative to the user (e.g., standing, sitting, or lying down), and whether the electronic device is held diagonally upwards or downwards towards the user's face, or rotated, all these factors affect the recognition result of the electronic device's posture. In this embodiment, the sensor is used not only to detect whether the physical posture of the tri-fold screen changes, but also to detect whether the display posture of the tri-fold screen relative to the user's viewing angle changes under the same physical posture. The processor can decide whether to switch the light-sensing device based on the change in display posture, thereby meeting the dimming requirements of the electronic device under different display states as much as possible.
[0128] In the embodiments of this application, such as Figure 8a As shown, the angle of the user's face when looking straight ahead can be predefined as 0 degrees, called the eye-level viewing angle. When the user's head remains still while their eyes move downwards, or when the user's head moves downwards, this is the user's top-down viewing angle. When the user's head remains still while their eyes move upwards, or when the user's head moves upwards, this is the user's bottom-up viewing angle. Taking the user's eye-level viewing angle as an example... Figure 8b The diagram shows the attitude angles of the electronic device, or attitude angles relative to the user's viewing angle, including pitch, roll, and yaw. When implementing S420, the electronic device (or its processor) can determine whether the tri-fold screen represents a change in display posture relative to the user's viewing angle within the same physical orientation.
[0129] by Figures 7a-7d Taking the different physical postures shown as examples, the dimming strategies involved based on changes in device posture angle can include the contents shown in Table 2 below:
[0130] Table 2
[0131]
[0132]
[0133] like Figure 9 As shown, taking the display posture change of an electronic device (such as a fully folded mobile phone) relative to the user's viewing angle based on the pitch angle as an example, it can be predefined that when the electronic device is in a horizontal position with the screen facing upwards, the pitch angle corresponds to 0 degrees; when the electronic device changes to a vertical position with the screen facing the user's face based on the pitch angle, the pitch angle corresponds to 90 degrees; and when the electronic device is in a horizontal position with the screen facing downwards, the pitch angle corresponds to 180 degrees. It can be seen that during this display posture change process, the displayable area always includes area A. According to the strategy shown in Table 2, the light sensor 1 set on area A can be used to implement dimming control without switching the light sensor.
[0134] like Figure 10 As shown, taking the display posture change of an electronic device (such as a mobile phone in a fully folded posture) relative to the user's viewing angle based on the flip angle as an example, in the fully folded posture, the displayable area of the tri-fold screen only includes area A, where a light sensor 1 is installed. Conventional display postures can include portrait display postures. In the portrait display posture, the tri-fold screen can rotate clockwise based on the flip angle to a landscape display posture, and in the portrait display posture, it can rotate counterclockwise based on the flip angle to another landscape display posture. It can be seen that during this display posture change process, the displayable area always includes area A. According to the strategy shown in Table 2, dimming control can be implemented using the light sensor 1 installed on area A without switching the light sensor.
[0135] like Figure 11 As shown, taking the display posture change of an electronic device (such as a mobile phone in a semi-folded posture 2) relative to the user's viewing angle based on the flip angle as an example, in the semi-folded posture 2, the displayable area of the tri-fold screen includes area B and area C, with a light sensor 2 installed in area C. Conventional display postures can include portrait display postures. In the portrait display posture, the tri-fold screen can rotate clockwise based on the flip angle to a landscape display posture, and in the portrait display posture, it can rotate counterclockwise based on the flip angle to another landscape display posture. It can be seen that during this display posture change process, the displayable area always includes area C. According to the strategy shown in Table 2, dimming control can be implemented using the light sensor 2 installed in area C, without the need to switch the light sensor.
[0136] like Figure 12As shown, taking the display posture change of an electronic device (such as a mobile phone in a semi-folded posture 1) relative to the user's viewing angle based on the flip angle as an example, in the semi-folded posture 1, the displayable area of the tri-fold screen includes area A, and area A is equipped with a light sensor 1. Conventional display postures can include a portrait display posture. In the portrait display posture, the tri-fold screen can rotate clockwise based on the flip angle to a landscape display posture, and in the portrait display posture, it can rotate counterclockwise based on the flip angle to another landscape display posture. It can be seen that during this display posture change process, the displayable area always includes area A. According to the strategy shown in Table 2, dimming control can be implemented using the light sensor 1 installed on area A, and there is no need to switch the light sensor.
[0137] like Figures 13a-13d As shown, taking the display posture change of an electronic device (such as a fully unfolded mobile phone) relative to the user's viewing angle based on the flip angle as an example, in the fully unfolded posture, the displayable area of the tri-fold screen includes area A, area B, and area C. Area A and area C are equipped with light sensors 1. Conventional display postures can include a landscape display posture. In the landscape display posture, the tri-fold screen can rotate clockwise based on the flip angle to a portrait display posture, denoted as Portrait 1. In the landscape display posture or in the portrait 1 posture, it can rotate counterclockwise based on the flip angle to another portrait display posture, denoted as Portrait 2. Alternatively, in the portrait 1 posture, it can rotate clockwise based on the flip angle to the portrait 2 posture.
[0138] In landscape mode, the processor can control the display brightness of the tri-fold screen based on the ambient light information detected by either photosensitive device 1 or photosensitive device 2, according to the dimming strategy shown in Table 1.
[0139] When a tri-fold screen changes relative to the user's viewing angle based on the flip angle, in one implementation, the processor can keep the light sensor unchanged and continue to control the display brightness of the tri-fold screen based on the ambient light information detected by light sensor 1 or light sensor 2. For example... Figure 13a In both landscape and two portrait display modes, the processor can control the display brightness of the tri-fold screen based on the light sensor detected by light sensor 1. Or, as... Figure 13b In both landscape and two portrait display modes, the processor can control the display brightness of the tri-fold screen based on the light sensor detected by the light sensor 2.
[0140] In another implementation, when the tri-fold screen changes its display posture relative to the user's viewing angle under the same physical posture, the processor can also switch the corresponding light sensor according to the strategy shown in Table 2, and use the ambient light information detected by the switched light sensor to control the display brightness of the tri-fold screen, so as to reduce the problem of inaccurate dimming caused by factors such as the user's hand blocking the light.
[0141] Taking a user whose dominant hand is their right hand as an example, such as Figure 13c As shown, when the flip angle changes in the fully unfolded position, the first posture can be associated with the landscape display posture of the tri-fold screen in the fully unfolded position, and the first light sensor is light sensor 2 located in the second display area (area C). The posture of the vertical screen 1 can be represented as the first vertical display posture of the tri-fold screen, and the posture of the vertical screen 2 can be represented as the second vertical display posture of the tri-fold screen. The second posture can be associated with the first vertical display posture, and the second light sensor is light sensor 1 located in the first display area (area A). Therefore, after the tri-fold screen changes from the first posture to the second posture, the processor can use the ambient light information detected by light sensor 1 to control the display brightness of the tri-fold screen. Conversely, if the tri-fold screen changes from the second posture to the first posture, the processor can also switch light sensor 1 to light sensor 2 and use the ambient light information detected by light sensor 2 to control the display brightness of the tri-fold screen.
[0142] Therefore, switching the light sensor when the screen orientation changes between landscape and portrait can reduce the problem of dimming accuracy caused by the user's hand (e.g., right hand) obstructing the light sensor 2 when holding the electronic device. Subsequently, if the user holds the electronic device and changes the tri-fold screen from the first portrait orientation to the second portrait orientation, the dimming control in the second portrait orientation is less affected by the hand (e.g., right hand) obstruction. In this case, the light sensor does not need to be switched, and the ambient light information detected by the light sensor 1 located in the first display area (Area A) can continue to be used to control the display brightness of the tri-fold screen.
[0143] In other embodiments, some users are left-handed, and based on considerations of the user's dominant hand, such as... Figure 13d As shown, when the flip angle changes in the fully unfolded position, the first posture can be associated with the landscape display posture of the tri-fold screen in the fully unfolded position, and the first light sensor is light sensor 1 located in the first display area (area A). The portrait posture 2 can be represented as the third portrait display posture of the tri-fold screen, and the posture of the portrait posture 1 can be represented as the fourth portrait display posture of the tri-fold screen. The second posture can be associated with the third portrait display posture, and the second light sensor is light sensor 2 located in the second display area (area C). Therefore, after the tri-fold screen changes from the first posture to the second posture, the processor can use the ambient light information detected by light sensor 2 to control the display brightness of the tri-fold screen. Conversely, if the tri-fold screen changes from the second posture to the first posture, the processor can also switch light sensor 2 to light sensor 1 and use the ambient light information detected by light sensor 1 to control the display brightness of the tri-fold screen.
[0144] Therefore, switching the light sensor when the screen orientation changes between landscape and portrait can reduce the problem of dimming accuracy caused by the user's hand (e.g., left hand) obstructing the light sensor 1 when holding the electronic device. Subsequently, if the user holds the electronic device and changes the tri-fold screen from the third portrait orientation to the fourth portrait orientation, the dimming control in the fourth portrait orientation is less affected by the hand (e.g., left hand) obstruction. Therefore, the light sensor does not need to be switched, and the ambient light information detected by the light sensor 2 located in the second display area (area C) can continue to be used to control the display brightness of the tri-fold screen.
[0145] When different physical orientations are involved, such as changing from M state to G state, the display area A is flipped from the back to the plane where areas B and C are located. The lighting environment of the light sensor 1 set in area A is not in the same plane as the final screen lighting environment. Therefore, if the light sensor 1 set in area A is directly used for dimming, there may be a jump, which will bring a poor user experience.
[0146] Therefore, in this embodiment of the application, when the tri-fold screen switches from M state to G state, the following strategy 1 or strategy 2 can be implemented according to the contents shown in Table 2:
[0147] Strategy 1: Switch the light sensor used from light sensor 2 to light sensor 1. The switch can be made after the ambient light in area A has stabilized, and conservative dimming can be used during this period. Stable ambient light in area A means that the ambient light intensity detected by light sensor 1 in area A remains within a relatively small illuminance range. Conservative dimming could mean, for example, not dimming the light.
[0148] Strategy 2: Do not switch the light sensor; continue using light sensor 2 set in area C. When the screen is detected to rotate from landscape to portrait mode (including portrait mode 1 or portrait mode 2), switch the light sensor used from light sensor 2 to light sensor 1 to reduce the impact of factors such as hand obstruction on dimming accuracy.
[0149] In the above scenario, if a user uses an electronic device to change the tri-fold screen from portrait to landscape orientation, the processor can switch the used light sensor from light sensor 1 to light sensor 2, as shown in Table 2. Each time the user rotates the electronic device, for example, changing from landscape to portrait or vice versa, the light sensor switching is triggered to reduce the impact of factors such as hand obstruction on dimming accuracy. Alternatively, if the user's dominant hand is right-handed and light sensor 1 is currently being used, the probability of light sensor 1 being obstructed is relatively low, and the light sensor will not be switched again during subsequent landscape / portrait orientation changes to ensure dimming stability. If the user's dominant hand is left-handed and light sensor 2 is currently being used, the probability of light sensor 2 being obstructed is relatively low, and the light sensor will not be switched again during subsequent landscape / portrait orientation changes to ensure dimming stability.
[0150] Taking a user whose dominant hand is their right hand as an example, such as Figure 13e As shown, when the tri-fold screen is in state M, the display area includes areas B and C, and the available light sensor is light sensor 2 located in area C. When the tri-fold screen changes from state M to state G, the available light sensors include light sensor 1 located in area A and light sensor 2 located in area C. To reduce dimming jumps, the light sensor can be temporarily not switched, and light sensor 1 can continue to detect ambient light information to achieve dimming control. When the tri-fold screen changes from landscape display to portrait display 1 or portrait display 2 in its fully unfolded position, to reduce the impact of factors such as the user's right hand blocking the screen, light sensor 1 can be switched accordingly, and the display brightness of the tri-fold screen can be controlled using the ambient light information detected by light sensor 1. Currently, light sensor 1 is being used, and the probability of light sensor 1 being blocked is relatively low. The light sensor will not be switched again when switching between landscape and portrait modes to ensure dimming stability.
[0151] Therefore, combining the above... Figures 5a-13e This application describes the posture change scenarios and corresponding dimming strategies involved in the display control method of the embodiment of the present application. The method can flexibly switch the light sensing devices used according to the posture change of the foldable screen of the electronic device, so as to meet the different dimming requirements of different display states of the electronic device and ensure the user's visual experience.
[0152] Based on the above embodiments, this application also provides an electronic device, which includes multiple functional modules; the multiple functional modules interact to realize the functions performed by the electronic device in the methods described in the embodiments of this application. For example, [the following is an example of implementation]. Figure 4The electronic device in the illustrated embodiment executes S410-S430. The plurality of functional modules can be implemented based on software, hardware, or a combination of both, and these modules can be arbitrarily combined or divided based on specific implementations.
[0153] Based on the above embodiments, this application also provides an electronic device, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions. When the electronic device is running, the at least one processor executes the functions performed by the electronic device in the various methods described in the embodiments of this application. For example, when executing... Figure 4 S410-S430 are executed by the electronic device in the illustrated embodiment.
[0154] Based on the above embodiments, this application also provides a computer program product containing instructions, which, when run on a computer, causes the computer to execute the methods described in the embodiments of this application.
[0155] Based on the above embodiments, this application also provides a computer-readable storage medium storing a computer program, which, when executed by a computer, causes the computer to perform the methods described in the embodiments of this application.
[0156] Based on the above embodiments, this application also provides a chip for reading computer programs stored in a memory to implement the methods described in the embodiments of this application.
[0157] Based on the above embodiments, this application provides a chip system including a processor for supporting a computer device in implementing the methods described in the embodiments of this application. In one possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. This chip system may be composed of chips or may include chips and other discrete devices.
[0158] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0159] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0160] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0161] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0162] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of protection of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.
Claims
1. A display control method, characterized in that, A method applicable to an electronic device having a foldable screen, wherein the foldable screen is a tri-fold screen, and at least two photosensitive devices of the electronic device are deployed on different display areas of the tri-fold screen, the method comprising: When the tri-fold screen is in the first posture, the display brightness of the tri-fold screen is controlled by using the ambient light information detected by the first of the at least two photosensitive devices; Determine that the tri-fold screen changes from the first posture to the second posture, and the second posture is associated with the second of the at least two photosensitive devices; When the tri-fold screen is in the second posture, the display brightness of the tri-fold screen is controlled by using the ambient light information detected by the second light sensor.
2. The method according to claim 1, characterized in that, The tri-fold screen includes a first display area, a second display area, and a third display area. The first display area and the third display area are connected by a first folding axis, and the second display area and the third display area are connected by a second folding axis. At least two photosensitive devices are deployed in the first display area and the second display area, while no photosensitive devices are disposed on the third display area. The first posture and the second posture correspond to different display postures of the tri-fold screen relative to the user's viewing angle under the same physical posture; or, The first posture and the second posture correspond to different physical postures of the tri-fold screen.
3. The method according to claim 2, characterized in that, In the fully unfolded state of the tri-fold screen, the first and second postures correspond to different display postures of the tri-fold screen at different flip angles relative to the user's viewing angle in the fully unfolded state, wherein, The first posture is associated with the landscape display posture of the tri-fold screen in the fully unfolded posture, and the first light sensor is a light sensor disposed in the second display area. The landscape display posture of the tri-fold screen is rotated clockwise based on the flip angle to the first portrait display posture of the tri-fold screen. The second posture is associated with the first portrait display posture, and the second light sensor is a light sensor disposed in the first display area.
4. The method according to claim 3, characterized in that, The landscape display posture of the tri-fold screen is based on the counterclockwise rotation of the flip angle to the second portrait display posture of the tri-fold screen, and the method further includes: It is determined that the tri-fold screen changes from the first portrait display posture to the second portrait display posture; When the tri-fold screen is in the second vertical display posture, the display brightness of the tri-fold screen is controlled by using the ambient light information detected by the second light sensor.
5. The method according to claim 2, characterized in that, In the fully unfolded state of the tri-fold screen, the first and second postures correspond to different display postures of the tri-fold screen at different flip angles relative to the user's viewing angle in the fully unfolded state, wherein, The first posture is associated with the landscape display posture of the tri-fold screen in the fully unfolded posture, and the first light sensor is a light sensor disposed in the first display area. The landscape display posture of the tri-fold screen is rotated counterclockwise based on the flip angle to the third vertical display posture of the tri-fold screen. The second posture is associated with the third vertical display posture, and the second light sensor is a light sensor disposed in the second display area.
6. The method according to claim 5, characterized in that, The landscape display orientation of the tri-fold screen is based on the rotation of the flip angle clockwise to the fourth portrait display orientation of the tri-fold screen, and the method further includes: It is determined that the tri-fold screen changes from the third vertical screen display posture to the fourth vertical screen display posture; When the tri-fold screen is in the fourth vertical display posture, the display brightness of the tri-fold screen is controlled by using the ambient light information detected by the second light sensor.
7. The method according to claim 2, characterized in that, When the first posture and the second posture correspond to different physical postures of the tri-fold screen, the first light sensor is a light sensor disposed in the first display area, and the second light sensor is a light sensor disposed in the second display area.
8. The method according to claim 7, characterized in that, The first posture is associated with either a first display state or a second display state of the tri-fold screen. In both the first and second display states, the displayable area of the tri-fold screen includes the first display area but excludes the second display area. The second posture is associated with a third display state of the tri-fold screen, in which the displayable area of the tri-fold screen includes the second display area but excludes the first display area; or, The second posture is associated with the fourth display state of the tri-fold screen, in which the displayable area of the tri-fold screen includes the first display area and the second display area.
9. The method according to claim 8, characterized in that, In the first display state, the first display area and the third display area are folded back along the first folding axis, and the second display area and the third display area are folded front along the second folding axis. The displayable area of the tri-fold screen does not yet include the third display area. In the second display state, the second display area and the third display area are folded in the front via the second folding axis, while the first display area and the third display area are not folded, and the displayable area of the tri-fold screen does not yet include the third display area; In the third display state, the first display area and the third display area are folded back along the first folding axis, while the second display area and the third display area are not folded. The displayable area of the tri-fold screen also includes the third display area. In the fourth display state, the first display area and the third display area are not folded, the second display area and the third display area are not folded, and the displayable area of the tri-fold screen also includes the third display area.
10. An electronic device, characterized in that, Includes a foldable screen, a processor, and memory, wherein the foldable screen is a tri-fold screen; The memory is used to store one or more computer programs; When one or more computer programs stored in the memory are executed by the processor, the electronic device performs the method as described in any one of claims 1-9.
11. A computer-readable storage medium, characterized in that, The computer-readable storage medium includes a computer program that, when run on an electronic device, causes the electronic device to perform the method as described in any one of claims 1 to 9.
12. A chip, characterized in that, The chip is coupled to a memory for executing a computer program stored in the memory to perform the method as described in any one of claims 1 to 9.