Display control method and electronic device
By deploying multiple light sensors in different display areas of the foldable screen and switching the light sensors according to changes in screen posture, the problem of insufficient dimming requirements in traditional designs is solved, thus improving the user's visual experience.
Patent Information
- Application Number
- PCT/CN2025/106204
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-07-25
- Filing Date
- 2025-06-30
- Publication Date
- 2026-01-29
AI Technical Summary
The design of light sensors in traditional electronic devices cannot meet the dimming requirements of foldable screens in different postures, resulting in a poor visual experience for users.
At least two light sensors are deployed in different display areas of the foldable screen. The light sensors are switched according to the screen's orientation to detect ambient light information and control the display brightness.
It enables flexible switching of light sensors based on changes in the posture of electronic devices, meeting the dimming needs of different display states and enhancing the user's visual experience.
Smart Images

Figure CN2025106204_29012026_PF_FP_ABST
Abstract
Description
Display control method and electronic device
[0001] Cross-reference to related applications
[0002] The present application claims priority to the Chinese patent application No. 202411008640.7, filed on July 25, 2024, and entitled "A display control method and electronic device", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD
[0003] The present application relates to the technical field of electronic devices, and in particular to a display control method and electronic device. BACKGROUND
[0004] Currently, many electronic devices are provided with ambient light sensors (or light sensing devices) for detecting the light intensity (referred to as illuminance) of the external environment, so as to adjust the brightness of the display screen of the electronic device using the ambient light illuminance, and to ensure the comfort of the user in viewing the display content of the screen under different illuminance. In the traditional design scheme, one light sensing device is generally provided on one screen.
[0005] With the evolution of the physical form of electronic devices, for example, mobile phones, from a straight single screen to a foldable screen, new requirements are put forward for the design and use of light sensing devices. SUMMARY
[0006] The present application provides a display control method and electronic device for switching light sensing devices according to the attitude change of the electronic device, so as to control the display brightness of the foldable screen of the electronic device using the ambient light information detected by the corresponding light sensing device, thereby meeting the dimming requirements under different attitudes.
[0007] In a first aspect, the embodiments of the present application provide a display control method applied to an electronic device with a foldable screen, the foldable screen being a three-fold screen, and at least two light sensing devices of the electronic device being disposed on different display areas of the three-fold screen. The method can include: in a case where the three-fold screen is in a first attitude, controlling the display brightness of the three-fold screen using ambient light information detected by a first light sensing device of the at least two light sensing devices; determining that the three-fold screen changes from the first attitude to a second attitude, the second attitude being associated with a second light sensing device of the at least two light sensing devices; and in a case where the three-fold screen is in the second attitude, controlling the display brightness of the three-fold screen using ambient light information detected by the second light sensing device.
[0008] By the above method, the light sensing device used can be flexibly switched according to the change of the posture of the foldable screen of the electronic device, so as to meet the different light adjustment requirements of different display states of the electronic device and guarantee the visual experience of the user.
[0009] In a possible implementation, the tri-fold screen can include a first display area, a second display area, and a third display area, the first display area and the third display area are connected through a first folding axis, the second display area and the third display area are connected through a second folding axis, the at least two light sensing devices are arranged in the first display area and the second display area, and no light sensing device is arranged on the third display area, wherein the first posture and the second posture correspond to different display postures of the tri-fold screen relative to the user's visual angle in the same physical posture; or the first posture and the second posture correspond to different physical postures of the tri-fold screen.
[0010] As an example, the device posture angle of the electronic device can be used to represent the different display posture information of the electronic device relative to the user's visual angle in the same physical posture, which can include at least one of the following: a pitch angle, a roll angle, or a yaw angle.
[0011] In one example, in a fully unfolded posture of the tri-fold screen, the first posture and the second posture can correspond to different display postures of the tri-fold screen relative to the user's visual angle in different roll angles in the fully unfolded posture. The first posture can be associated with a landscape display posture of the tri-fold screen in the fully unfolded posture, and the first light sensing device is the light sensing device arranged in the second display area, and the landscape display posture of the tri-fold screen is rotated clockwise to the first portrait display posture of the tri-fold screen based on the roll angle, and the second posture can be associated with the first portrait display posture, and the second light sensing device is the light sensing device arranged in the first display area. That is, when the tri-fold screen changes from the landscape display posture to the first portrait display posture in the fully unfolded posture, the light sensing device can be switched to the light sensing device arranged in the first display area to meet the corresponding light adjustment requirement.
[0012] In a possible implementation, the landscape display posture of the tri-fold screen is rotated counterclockwise based on the flip angle to a second portrait display posture of the tri-fold screen, and the method further can include: determining that the tri-fold screen changes from the first portrait display posture to the second portrait display posture; and controlling the display brightness of the tri-fold screen by using the ambient light information detected by the second light sensing device when the tri-fold screen is in the second portrait display posture. That is, when the second light sensing device is the light sensing device arranged in the first display area, the second light sensing device is less disturbed by factors such as right-hand blocking, and the light sensing device can no longer be switched based on the posture change of the landscape / portrait posture, to ensure the stability of the dimming.
[0013] In another example, in the fully unfolded posture of the tri-fold screen, the first posture and the second posture correspond to different display postures of the tri-fold screen at different flip angles relative to the user's visual angle in the fully unfolded posture, where the first posture is associated with a landscape display posture of the tri-fold screen in the fully unfolded posture, and the first light sensing device is the light sensing device arranged in the first display area, the landscape display posture of the tri-fold screen is rotated counterclockwise based on the flip angle to a third portrait display posture of the tri-fold screen, the second posture is associated with the third portrait display posture, and the second light sensing device is the light sensing device arranged in the second display area. That is, when the tri-fold screen changes from the landscape display posture to the third portrait display posture in the fully unfolded posture, the light sensing device can be switched to the light sensing device in the second display area to meet the corresponding dimming requirement.
[0014] In a possible implementation, the landscape display posture of the tri-fold screen is rotated counterclockwise based on the flip angle to a second portrait display posture of the tri-fold screen, and the method further can include: determining that the tri-fold screen changes from the first portrait display posture to the second portrait display posture; and controlling the display brightness of the tri-fold screen by using the ambient light information detected by the second light sensing device when the tri-fold screen is in the second portrait display posture. That is, when the second light sensing device is the light sensing device arranged in the first display area, the second light sensing device is less disturbed by factors such as right-hand blocking, and the light sensing device can no longer be switched based on the posture change of the landscape / portrait posture, to ensure the stability of the dimming.
[0015] In another example, when the first posture and the second posture correspond to different physical postures of the tri-fold screen, the first light sensing device is the light sensing device arranged in the first display area, and the second light sensing device is the light sensing device arranged in the second display area.
[0016] In a possible implementation, the first posture is associated with a first display state or a second display state of the tri-fold screen, in the first display state and the second display state, the displayable area of the tri-fold screen includes the first display area and does not include the second display area, wherein the second posture is associated with a third display state of the tri-fold screen, in the third display state, the displayable area of the tri-fold screen includes the second display area and does not include the first display area; or the second posture is associated with a fourth display state of the tri-fold screen, in the fourth display state, the displayable area of the tri-fold screen includes the first display area and the second display area.
[0017] In a possible implementation, in the first display state, the first display area and the third display area are folded towards the back through the first folding axis, the second display area and the third display area are folded towards the front through the second folding axis, and the displayable area of the tri-fold screen does not include the third display area; in the second display state, the second display area and the third display area are folded towards the front through the second folding axis, the first display area and the third display area are not folded, and the displayable area of the tri-fold screen does not include the third display area; in the third display state, the first display area and the third display area are folded towards the back through the first folding axis, the second display area and the third display area are not folded, and the displayable area of the tri-fold screen includes the third display area; in the fourth display state, the first display area and the third display area are not folded, the second display area and the third display area are not folded, and the displayable area of the tri-fold screen includes the third display area.
[0018] The second aspect provides an electronic device, the device including a plurality of functional modules; the plurality of functional modules interact to implement the method performed by the electronic device in the first aspect and each implementation thereof. The plurality of functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the plurality of functional modules can be combined or divided based on specific implementation.
[0019] The third aspect provides a device including at least one processor and at least one memory, the at least one memory storing computer program instructions, when the device is running, the at least one processor executes the method performed by the electronic device in the first aspect and each implementation thereof.
[0020] The fourth aspect also provides a program product, when the program product is running on a device, the device is caused to perform the method performed by the electronic device in any aspect and each implementation thereof.
[0021] The fifth aspect further provides a readable storage medium, in which a program is stored, and when the program is executed by a device, the device is caused to execute the method performed by the electronic device in any of the above aspects and embodiments.
[0022] The sixth aspect further provides a chip for reading a program stored in a memory, and executing the method performed by the electronic device in any of the above aspects and embodiments.
[0023] The seventh aspect further provides a chip system including a processor for supporting a device to implement the method performed by the electronic device in any of the above aspects and embodiments. In a possible design, the chip system further includes a memory for storing the necessary program and data. The chip system can be composed of a chip, or include a chip and other discrete devices.
[0024] It should be noted that the beneficial effects of the various designs of the electronic device provided by the second aspect to the seventh aspect of the present application can refer to the beneficial effects of any of the possible designs of the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS
[0025] FIG. 1 is a schematic diagram of a possible hardware structure of an electronic device according to an embodiment of the present application;
[0026] FIG. 2 is a software architecture block diagram of an electronic device according to an embodiment of the present application;
[0027] FIG. 3 is a schematic diagram of a system architecture to which a display control method according to an embodiment of the present application can be applied;
[0028] FIG. 4 is a flowchart of a display control method according to an embodiment of the present application;
[0029] FIGS. 5a-5b are schematic diagrams of possible three-fold screens according to an embodiment of the present application;
[0030] FIG. 6 is a schematic diagram of folding modes supported by a three-fold screen according to an embodiment of the present application;
[0031] FIGS. 7a-7d are schematic diagrams of display states corresponding to different physical postures of a three-fold screen according to an embodiment of the present application;
[0032] FIG. 8a is a schematic diagram of a user's perspective according to an embodiment of the present application;
[0033] FIG. 8b is a schematic diagram of changes in a posture angle of an electronic device relative to a user's perspective according to an embodiment of the present application;
[0034] FIG. 9 is a schematic diagram of changes in a flip angle of an electronic device relative to a user's perspective according to an embodiment of the present application;
[0035] FIG. 10 is a schematic diagram of the electronic device of the embodiments of the present application based on the change of the flip angle when the three-fold screen is in a fully folded posture;
[0036] FIG. 11 is a schematic diagram of the electronic device of the embodiments of the present application based on the change of the flip angle when the three-fold screen is in a half-folded posture;
[0037] FIG. 12 is a schematic diagram of the electronic device of the embodiments of the present application based on the change of the flip angle when the three-fold screen is in another half-folded posture;
[0038] FIGS. 13a-13d are schematic diagrams of the electronic device of the embodiments of the present application based on the change of the flip angle when the three-fold screen is in a fully unfolded posture;
[0039] FIG. 13e is a schematic diagram of the electronic device of the embodiments of the present application in a portrait display posture when the three-fold screen changes from the M state to the G state. DETAILED DESCRIPTION
[0040] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the embodiments of the present application will be further described in detail below with reference to the drawings. In the description of the embodiments of the present application, the terms “first” and “second” are used only for the purpose of description, and cannot be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined with “first” and “second” can explicitly or implicitly include one or more of the features.
[0041] It should be understood that “at least one” in the embodiments of the present application means one or more, and “multiple” means two or more. “And / or” describes the association relationship of the associated objects, which means that there can be three relationships, for example, A and / or B, which can mean that A exists alone, A and B exist together, and B exists alone, where A and B can be singular or plural. The character “ / ” generally represents an “or” relationship between the associated objects before and after it. “At least one of the following” or similar expressions means any combination of these items, including any combination of single item or multiple items. For example, at least one of a, b or c, which can mean a, b, c, a and b, a and c, b and c, or a, b and c, where a, b and c can be single or multiple.
[0042] First, the technical solutions in the embodiments of the present application can be applied to an electronic device, which can be any device with or associated with a foldable screen. For example, the electronic device can be an electronic device such as a mobile phone, a foldable screen mobile phone, a tablet computer, a wearable device (for example, a watch, a bracelet, glasses, etc.), a vehicle-mounted device, an augmented reality (AR) / virtual reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a smart home device (for example, a smart television, etc.), and the like. The embodiments of the present application do not make any limitation on the specific type of the electronic device.
[0043] The electronic device to which the embodiments of the present application can be applied can also be a portable terminal device that further includes other functions such as a personal digital assistant and / or a music player function. Exemplary embodiments of the portable terminal device include, but are not limited to, an electronic device equipped with an operating system such as Android, iOS, Windows, or other operating systems. or other operating systems.
[0044] FIG. 1 shows a possible hardware structure schematic diagram of an electronic device. Referring to FIG. 1, the electronic device 100 can include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headset interface 170D, a sensor module 180, a key 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, and the like.
[0045] The processor 110 can include one or more processing units, for example: the processor 110 can include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units can be independent devices or integrated in one or more processors. The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to instruction operation codes and timing signals, and complete the control of fetching and executing instructions. A memory can also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can save instructions or data that the processor 110 has just used or repeatedly uses. If the processor 110 needs to use the instructions or data again, it can directly call from the memory. This avoids repeated access and reduces the waiting time of the processor 110, thereby improving the efficiency of the system.
[0046] The USB interface 130 is an interface conforming to the USB standard specification, and can be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 100, or to transmit data between the electronic device 100 and a peripheral device. The charging management module 140 is configured to receive charging input from the charger. The power management module 141 is configured to connect the battery 142 and the charging management module 140 to the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160, etc.
[0047] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor, etc. The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization rate of the antennas. For example, the antenna 1 can be multiplexed as a diversity antenna of a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.
[0048] The mobile communication module 150 can provide a solution for wireless communication including 2G / 3G / 4G / 5G, etc. applied to the electronic device 100. The mobile communication module 150 can include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive an electromagnetic wave by the antenna 1, and perform filtering, amplification, etc. on the received electromagnetic wave, and transfer the processed signal to the modem processor to be demodulated. The mobile communication module 150 can also amplify a signal modulated by the modem processor, and radiate the signal as an electromagnetic wave through the antenna 1. In some embodiments, at least part of the function modules of the mobile communication module 150 can be disposed in the processor 110. In some embodiments, at least part of the function modules of the mobile communication module 150 can be disposed in the same device as at least part of the modules of the processor 110.
[0049] The wireless communication module 160 can provide a solution for wireless communication including wireless local area networks (WLAN) (e.g., wireless fidelity (Wi-Fi) network), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, etc. applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrated with at least one communication processing module. The wireless communication module 160 receives an electromagnetic wave via the antenna 2, performs frequency modulation and filtering on the electromagnetic wave signal, and transmits the processed signal to the processor 110. The wireless communication module 160 can also receive a signal to be transmitted from the processor 110, perform frequency modulation and amplification on the signal, and radiate the signal as an electromagnetic wave through the antenna 2.
[0050] In some embodiments, the antenna 1 and the mobile communication module 150 of the electronic device 100 are coupled, and the antenna 2 and the wireless communication module 160 are coupled, so that the electronic device 100 can communicate with a network and other devices through wireless communication technology. The wireless communication technology can include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS can include global positioning system (GPS), global navigation satellite system (GLONASS), beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS), and / or satellite based augmentation systems (SBAS).
[0051] The display screen 194 is configured to display a display interface of an application, for example, a desktop of the electronic device 100, which can include icons of applications installed on the electronic device 100 and shortcut icons created, and the like. For another example, the display screen 194 can display different image frames with the change of the posture of the electronic device, giving a user a dynamic visual effect of a kind of mixed reality. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flex light-emitting diode (FLED), a Miniled, a MicroLed, a Micro-oLed, a quantum dot light emitting diodes (QLED), and the like. In some embodiments, the electronic device 100 can include 1 or N display screens 194, N being a positive integer greater than 1.
[0052] The camera 193 is configured to capture a still image or a video. An object generates an optical image through a lens and projects the optical image to a photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts an optical signal into an electrical signal, and then transmits the electrical signal to an ISP to convert the electrical signal into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into an image signal in a standard format, such as RGB, YUV, and the like. In some embodiments, the electronic device 100 can include 1 or N cameras 193, N being a positive integer greater than 1.
[0053] The internal memory 121 can be used to store computer executable program codes including instructions. The processor 110 performs various functional applications and data processing of the electronic device 100 by running the instructions stored in the internal memory 121. For example, the processor 110 executes the instructions stored in the internal memory 121, so that the electronic device 100 performs the method described in the embodiments of the present application. The internal memory 121 can include a program storage area and a data storage area. The program storage area can store an operating system and software codes of at least one application program (APP), etc. The data storage area can store data generated during the use of the electronic device 100 (e.g., images taken, videos recorded, etc.). In addition, the internal memory 121 can include a high-speed random access memory, and can further include a non-volatile memory such as at least one of a magnetic disk storage device, a flash memory device, a universal flash storage (UFS), etc.
[0054] The external memory interface 120 can be used to connect an external memory card such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to realize data storage functions. For example, files such as pictures and videos are saved in the external memory card.
[0055] The electronic device 100 can realize audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, and an application processor, etc. For example, music playing, recording, etc.
[0056] The sensor module 180 can include, but is not limited to, a pressure sensor 180A, an acceleration sensor 180B, a touch sensor 180C, a gyroscope sensor 180D, a hinge 180E, a rotation vector sensor 180F, a distance sensor 180G, a light sensor 180H, etc.
[0057] The pressure sensor 180A is used to sense a pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194.
[0058] Touch sensor 180C, also referred to as a "touch panel". The touch sensor 180C can be disposed on the display screen 194, and the touch sensor 180C and the display screen 194 together form a touch screen, also referred to as a "touch screen". The touch sensor 180C is configured to detect a touch operation acting on or near the touch sensor 180C. The touch sensor 180C can transmit the detected touch operation to the processor to determine the type of touch event. The display screen 194 can provide visual output related to the touch operation. In other embodiments, the touch sensor 180C can also be disposed on the surface of the electronic device 100, which is different from the position of the display screen 194. The embodiments of the present application do not limit the form of the touch sensor 180C.
[0059] The acceleration sensor 180B, the gyroscope sensor 180D, the hinge 180E, the rotation vector sensor 180F, the distance sensor 180G, etc. can be used to detect the attitude change of the electronic device 100. For example, based on the acceleration sensor, the gravity acceleration of the electronic device can be measured, based on the gyroscope sensor, the yaw angular velocity of the electronic device can be measured, based on the hinge sensor, the folding or unfolding state of the electronic device can be measured, based on the rotation vector sensor, the angle of rotation of the electronic device around a certain fixed axis can be measured, and based on the distance sensor, the distance between the electronic device and the user's face (or eyes) can be measured. Different sensors of the electronic device can communicate with the processor of the electronic device and can provide the collected sensor data as input information to the processor. The processor can process the obtained sensor data to obtain the attitude information of the electronic device at the current time. When detecting that the attitude of the electronic device 100 changes, the processor dynamically controls the display of the display screen 194 according to the attitude change of the electronic device. For example, the processor can switch the light sensor 180H used, and adjust the display brightness of the screen based on the ambient light information collected by the light sensor 180H to improve the user's visual experience. The details will be described below in conjunction with the drawings and embodiments, which will not be described here.
[0060] The keys 190 include a power key, a volume key, and the like. The keys 190 can be mechanical keys. Alternatively, the keys 190 can be touch keys. The electronic device 100 can receive key input, and generate key signal input related to user settings and function control of the electronic device 100. The motor 191 can generate a vibration cue. The motor 191 can be used for incoming call vibration cues, and can be used for touch vibration feedback. For example, touch operations for different applications (e.g., photographing, audio playback, and the like) can correspond to different vibration feedback effects. The touch vibration feedback effects can also support customization. The indicator 192 can be an indicator light, and can be used to indicate a charging state, a power change, and can be used to indicate a message, a missed call, a notification, and the like. The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to achieve contact and separation with the electronic device 100.
[0061] It can be understood that the components shown in FIG. 1 do not constitute a specific limitation on the electronic device 100, and the electronic device can further include more or fewer components than shown, or combine certain components, or split certain components, or different component arrangements. In addition, the combination / connection relationship between the components in FIG. 1 can also be adjusted and modified.
[0062] FIG. 2 is a software structure block diagram of an electronic device according to an embodiment of the present application. As shown in FIG. 2, the software structure of the electronic device can be a layered architecture, for example, the software can be divided into several layers, each layer has a clear role and division of labor. The layers communicate with each other through a software interface. In some embodiments, the operating system is divided into four layers, from top to bottom, the application layer, the application framework layer (FWK), the runtime and system library, and the kernel layer. In other embodiments, the operating system can also be divided into other layers, which are not limited in the embodiments of the present application.
[0063] The application layer can include a series of application packages. As shown in FIG. 2, the application layer can include a camera, a setting, a skin module, a user interface (UI), a third-party application, and the like. Among them, the third-party application can include a gallery, a calendar, a call, a map, a navigation, a WLAN, a Bluetooth, music, a video, a short message, and the like.
[0064] The application framework layer provides an application programming interface (API) and a programming framework for the applications of the application layer. The application framework layer can include some pre-defined functions. As shown in FIG. 2, the application framework layer can include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.
[0065] The window manager is used to manage windows. The window manager can acquire the size of the display screen, determine whether there is a status bar, lock the screen, and intercept the screen. It can be understood that in the embodiments of the present application, when multiple windows are displayed in the display screen, the window manager can be used to simultaneously manage the multiple windows, for example, manage the positions and sizes of the multiple windows.
[0066] The content provider is used to store and acquire data, and make the data accessible to the application program. The data can include videos, images, audios, dialed and received calls, browsing history and bookmarks, phone books, and the like.
[0067] The view system includes visual controls, for example, controls for displaying text, controls for displaying pictures, and the like. The view system can be used to build an application program. A display interface can be composed of one or more views. For example, a display interface including a short message notification icon can include a view for displaying text and a view for displaying pictures.
[0068] The telephony manager is used to provide the communication function of the electronic device. For example, the management of the call state (including call connection, call hang-up, and the like).
[0069] The resource manager provides various resources for the application program, such as localized strings, icons, pictures, layout files, video files, and the like.
[0070] The notification manager makes the application program capable of displaying notification information in the status bar, and can be used to convey a message of the notification type, which can automatically disappear after a short stay without user interaction. For example, the notification manager is used to notify the completion of downloading, message reminders, and the like. The notification manager can also be a notification in the form of a chart or a scroll bar text appearing in the top status bar of the system, for example, a notification of an application program running in the background, and can also be a notification in the form of a dialogue window appearing on the screen. For example, the text information is prompted in the status bar, a prompt sound is emitted, the electronic device vibrates, the indicator light flashes, and the like.
[0071] The runtime includes a core library and a virtual machine. The runtime is responsible for the scheduling and management of the operating system.
[0072] The core library includes two parts: one part is the function function required to be called by the java language, and the other part is the core library of the operating system. The application program layer and the application program framework layer run in the virtual machine. The virtual machine executes the java files of the application program layer and the application program framework layer into binary files. The virtual machine is used to perform the management of the object life cycle, the management of the stack, the management of the thread, the management of the security and exception, and the garbage collection, and the like.
[0073] The system library can include a plurality of functional modules. For example, a surface manager, media libraries, a three-dimensional graphics processing library (e.g., OpenGL ES), a 2D graphics engine (e.g., SGL), etc.
[0074] The surface manager is used to manage the display subsystem and provides a plurality of applications with a fusion of 2D and 3D layers.
[0075] The media libraries support a plurality of commonly used audio, video format playback and recording, and static image files, etc. The media libraries can support a plurality of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0076] The three-dimensional (3D) graphics processing library is used to implement three-dimensional graphics drawing, image rendering, composition, and layer processing, etc. The two-dimensional (2D) graphics engine is a drawing engine for 2D drawing.
[0077] In some embodiments, the three-dimensional graphics processing library can be used to draw a three-dimensional motion trajectory image, and the 2D graphics engine can be used to draw a two-dimensional motion trajectory image. In some embodiments, the three-dimensional graphics processing library and the two-dimensional graphics processing engine can be integrated into one graphics processor, which is not limited in the embodiments of the present application.
[0078] The kernel layer is a layer between hardware and software. The kernel layer at least includes a display driver, a camera driver, an audio driver, and a sensor driver.
[0079] The hardware layer can include various sensors, such as an acceleration sensor, a gyroscope sensor, a rotation vector sensor, etc., which can be used to detect the posture (e.g., including a motion posture or a physical posture, etc.) of the electronic device, so as to select the light sensing device to be used in combination with the posture of the electronic device, and use the light sensing device to detect the ambient light (Ambient Light) information to control the brightness of the display screen, thereby ensuring the comfort of the user to see the screen display content under different illuminations.
[0080] It should be noted that the structure shown in FIG. 1 and FIG. 2 is only an example of the electronic device provided by the embodiments of the present application, and cannot limit the electronic device provided by the embodiments of the present application in any way. In specific implementations, the electronic device can have more or fewer devices or modules than the structure shown in FIG. 1 or FIG. 2, or devices or modules for implementing the same function can have other names, which are not limited in the embodiments of the present application.
[0081] FIG. 3 is a system architecture diagram to which a display control method provided in an embodiment of the present application is applicable. Referring to FIG. 3, the operating system of the electronic device can adopt a five-layer hierarchical structure, and a hardware abstraction layer (HAL) can be further included between the framework layer and the kernel layer to abstract hardware, thereby hiding hardware interface details of a specific platform, providing a virtual hardware platform for the operating system, and enabling the operating system to be hardware-independent and thus portable on multiple platforms. In a colloquial sense, the hardware abstraction layer can perform actions to control hardware.
[0082] For example, the HAL can include a driver and an interface library of a processor, a peripheral, a sensor, etc. The HAL can include a display engine of the processor, a sensor driver, and an ambient light sensor driver. The sensor driver can acquire posture information of the electronic device from a sensor of the hardware layer. The ambient light sensor driver can acquire ambient light information of an environment in which the electronic device is located from an ambient light sensor of the hardware layer. The display engine can acquire posture information of the electronic device from the sensor driver, thereby recognizing a posture change of the electronic device, and perform display control of the electronic device in combination with the posture change of the electronic device. For example, the display engine can switch an ambient light sensor to be used at a current time in combination with the posture change of the electronic device, and control display brightness of a foldable screen of the electronic device using ambient light information acquired by the currently used ambient light sensor.
[0083] In a specific implementation, the hardware layer of the electronic device can include related hardware of a sensor hub, such as a sensor (or posture sensor) for detecting a device posture and an ambient light sensor (or light sensing device) for detecting ambient light information.
[0084] The sensor, such as a gyroscope sensor, an acceleration sensor, a hinge, a distance sensor, etc. shown in FIG. 1, or other sensors (such as a HALL sensor, not shown in the figure), can be used to detect a use posture of the electronic device and provide posture information of the electronic device to an upper-layer driver. The electronic device can include at least two light sensing devices, which can be disposed on different display areas of the foldable screen, and used to detect ambient light of an environment in which the electronic device is located and provide ambient light information to an upper-layer driver.
[0085] For example, the hinge sensor can be used to provide a hinge angle, which is a folding angle of different display regions of the foldable screen of the electronic device, and the hinge angle can be used to determine a physical posture of the foldable screen of the electronic device, including but not limited to: a fully unfolded posture, a fully folded posture, at least one half-folded posture, and the like. Or for example, the gyroscope sensor, the acceleration sensor, the distance sensor, and the like can be used to provide different display posture information of the electronic device relative to the user's visual angle in the same physical posture. Taking an example of representing the different display posture information of the electronic device relative to the user's visual angle in the same physical posture by a device posture angle of the electronic device, the device posture angle may, for example, include at least one of: a pitch angle, a roll angle, or a yaw angle. Taking the roll angle as an example, when the foldable screen of the electronic device is in a fully unfolded posture, the display posture of the electronic device can include a landscape display posture and a portrait display posture, which can be obtained by rotating the electronic device based on the roll angle. Similarly, when the foldable screen of the electronic device is in a fully folded posture or any one of a half-folded posture, the display posture of the electronic device can also include a landscape display posture and a portrait display posture, which can be obtained by rotating the electronic device based on the roll angle. Based on different postures of the electronic device, the display engine can control the corresponding light sensing device to work to collect ambient light information, and control the display brightness of the foldable screen of the electronic device by using the ambient light information collected by the corresponding ambient light sensor. In the following, various device postures of the embodiments of the present application and the corresponding manner of different device postures and light sensing devices will be introduced with reference to the accompanying drawings, which will not be described here.
[0086] The kernel layer of the electronic device can be an implementation layer of a software development kit (SDK) of related hardware of the DSS, and can also include a DDIC driver, which is used to provide necessary support and services for the display engine of the hardware abstraction layer, to provide a stable, safe, and efficient running environment for the upper-layer application. The kernel layer can also include an input hub, which can obtain information from the DDIC driver, the ambient light sensor APP, and the like when in operation.
[0087] The framework layer of the electronic device can also include a framework of the display engine service, a framework of the light service, and a sensor network inspection framework (SNIF) of the sensor hub.
[0088] The upper layer of the framework layer of the electronic device can be an application layer, for example, including APPs of the electronic device for implementing various services, or an ambient light sensor APP. The ambient light sensor APP can implement relevant calls through an API or a function provided by the sensor hub SNIF of the framework layer, to obtain relevant information from a sensor driver or an ambient light sensor driver, and can provide the obtained information to the processor through the input hub, so that the processor implements a display engine service or a light service based on the information. Alternatively, the upper layer of the framework layer of the electronic device can provide input information, for example, ambient light information, obtained via a communication interface. Alternatively, the upper layer of the framework layer of the electronic device can also include a backlight source of the foldable screen, which can be driven and controlled by the DDIC to control the display brightness of the foldable screen.
[0089] When the display engine of the processor implements the display control method of the embodiments of the present application, it can implement relevant calls of the display engine service through an API or a function provided by the framework layer. At the same time, the display engine can also send corresponding control instructions to the DDIC driver to implement the display control function of the embodiments of the present application. For example, the display engine can send corresponding control instructions to the DDIC driver using ambient light information collected by the currently used ambient light sensor, so that the DDIC driver enhances or reduces the display brightness of the foldable screen. When the DDIC driver executes the control instructions, it can implement relevant calls of the display light service through an API or a function provided by the framework layer, and control the display brightness of the foldable screen in combination with the ambient light information. For example, the display brightness of the backlight source of the foldable screen.
[0090] It should be understood that FIG. 3 is only an example of a system architecture diagram to which the display control method of the embodiments of the present application is applicable, and is not any limitation. In other embodiments, the electronic device can have more or fewer devices or modules than those in the structure shown in FIG. 3, or devices or modules for implementing the same functions can have other names, which are not limited by the embodiments of the present application.
[0091] The display control method of the embodiments of the present application will be described below taking the foldable screen of the electronic device as an example, which is implemented as a three-fold screen. Among them, the light sensing device represents the ambient light sensor described in the foregoing, which is used to detect ambient light information of the environment in which the electronic device is located. At least two light sensing devices of the electronic device are deployed on different display areas of the three-fold screen of the electronic device, and according to the posture change of the user using the electronic device, the processor can switch the light sensing devices to control the display brightness of the three-fold screen of the electronic device using the ambient light information detected by the corresponding light sensing devices, thereby meeting the dimming requirements in different postures. As shown in FIG. 4, the display control method can include the following steps:
[0092] S410: When the tri-fold screen is in its first orientation, the processor uses the ambient light information detected by the first of at least two light sensors to control the display brightness of the tri-fold screen.
[0093] S420: The processor determines that the tri-fold screen changes from a first posture to a second posture, and the second posture is associated with the second of at least two light sensors.
[0094] S420: When the tri-fold screen is in its second orientation, the processor uses the ambient light information detected by the second light sensor to control the display brightness of the tri-fold screen.
[0095] In this embodiment, the first posture and the second posture represent two postures of the tri-fold screen before and after a posture change. This posture change can refer to a change in the physical posture of the tri-fold screen, or it can refer to different display postures of the tri-fold screen relative to the user's viewing angle under the same physical posture. The various postures of the tri-fold screen can correspond one-to-one with its various display states. In different display states, the displayable area of the tri-fold screen can be different, and the available light-sensing devices can also be different. The processor can control the display brightness of the tri-fold screen by switching the required light-sensing devices based on the actual posture changes and the correspondence between different postures and different display states.
[0096] To make it easier to understand, we will use examples below.
[0097] In this embodiment, the foldable screen of the electronic device can be displayed as a complete display area when fully unfolded. The user can fold the screen along one or more folding axes (or folding lines). The positions of the folding axes can be preset or arbitrarily selected by the user within the foldable screen. After the user folds the screen along the folding axes, the foldable screen can be divided into multiple display areas along the folding axes.
[0098] Taking a tri-fold screen as an example, in one example, as shown in Figure 5a, the folding axis of the electronic device may include folding axis 1 and folding axis 2. The foldable screen of the electronic device can be equally divided into three display areas along folding axis 1 and folding axis 2, denoted as area A, area B, and area C, respectively. The areas of area A, area B, and area C are equal or approximately equal. In another example, as shown in Figure 5b, the folding axis of the electronic device may include folding axis 3 and folding axis 4. The foldable screen of the electronic device can be unequally divided into three display areas along folding axis 3 and folding axis 4, denoted as area A, area B, and area C, respectively. The area of area A is similar to the area of area C, and the sum of the areas of area A and area C is approximately equal to the area of area B.
[0099] It should be noted that in Figures 5a and 5b, areas A, B, or C can physically be the same screen or three screens. Alternatively, a combination of two areas from A, B, or C can be the same screen, with the remaining screen being another screen. This application does not limit this. In other embodiments, the foldable screen of the electronic device can also be a two-fold screen, a four-fold screen, or more folded screens. In different examples, the implementation method of dividing the foldable screen into several display areas can also be different, and this application does not limit this.
[0100] The following section uses the tri-fold screen shown in Figure 5a as an example to introduce the posture changes of the foldable screen of electronic devices and the changes of the light-sensing devices involved in the corresponding postures.
[0101] Taking the tri-fold screen shown in Figure 5a as an example, in one example, folding axis 1 supports folding the corresponding display area to the back, and folding axis 2 supports folding the corresponding display area to the front. The back (or rear) described here refers to the side of each display area of the foldable screen facing away from the user, and the front refers to the side of each display area facing the user. In the embodiments of this application, it is generally assumed that the front of each display area has a display function. In specific implementations, it is not limited whether the back of each display area has a display function.
[0102] The folding methods supported by folding axis 1 can be described as follows: with area B fixed, rotate area A 0-180° away from area B; or with area A fixed, rotate area B 0-180° away from area A. The folding methods supported by folding axis 2 can be described as follows: with area B fixed, rotate area C 0-180° towards area B; or with area C fixed, rotate area B 0-180° towards area A. Using a top-down view from the top of the electronic device, as shown in Figure 6, dashed arrows indicate the screen rotation direction. When area A is fixed, rotation direction 1 indicates rotating area B away from area A. When area B is fixed, rotation direction 2 indicates rotating area A away from area B. When area B is fixed, rotation direction 3 indicates rotating area C towards area B. When area C is fixed, rotation direction 4 indicates rotating area B towards area C.
[0103] In another example, the folding methods supported by folding axis 1 and folding axis 2 can be interchanged. For example, folding axis 2 supports folding the corresponding display area to the back, while folding axis 1 supports folding the corresponding display area to the front. Accordingly, the folding method supported by folding axis 1 can be described as: with area B fixed, rotating area A 0-180° in the direction facing area B; or as: with area A fixed, rotating area B 0-180° in the direction facing area A. The folding method supported by folding axis 2 can be described as: with area B fixed, rotating area C 0-180° in the direction away from area B; or as: with area C fixed, rotating area B 0-180° in the direction away from area A. In this example, the folding methods supported by folding axis 1 and folding axis 2 are similar to those shown in Figure 6, and will not be described again here.
[0104] Based on the folding axis arrangement shown in Figure 6 and the folding methods supported by the folding axis, the three-fold screen of the electronic device can have multiple physical postures, including a fully unfolded posture, a fully folded posture, and at least one half-folded posture, as shown in Figures 7a-7d. Under different physical postures, the display state of the three-fold screen can be represented as display state 1, display state 2, display state 3, and display state 4, respectively. In different display states, the displayable area of the three-fold screen is different, and the light-sensing devices used may also be different.
[0105] (1) Fully extended posture and display state 1:
[0106] In this embodiment of the application, as shown in the front view on the left side of Figure 7a, in the fully unfolded state, the displayable area of the tri-fold screen includes areas A, B, and C, meaning that areas A, B, and C are displayed simultaneously. As shown in the rear view on the right side of Figure 7a, the back of the electronic device includes the back of area C, the back of area B, and the back of area A. Some components of the electronic device may be located in only one of the three display areas of the tri-fold screen. For example, the light sensor 1 is located in the upper left of area A, the front camera is located in the middle of the upper part of the screen in area A, the light sensor 2 is located in the upper right of area C, and the rear camera is located on the back of area C. Considering the folding method of the folding axis 1, components may not be provided on the back of areas A and B.
[0107] Display state 1 corresponds to the fully unfolded posture of the tri-fold screen; display state 1 can also be called G state. In display state 1, the light-sensing devices that the tri-fold screen can use can include light-sensing device 1 located in area A or light-sensing device 2 located in area C.
[0108] (2) Half-folded posture 1 and display status 2:
[0109] In this embodiment, based on the fully unfolded posture shown in Figure 7a, while keeping areas A and B fixed and different (areas A and B are not folded), area C is rotated 180° along the folding axis 2 towards the direction facing area B, so that the front of area B is in contact with the front of area C, which can be converted into a semi-folded posture. For ease of distinction, this semi-folded posture can be represented as semi-folded posture 1.
[0110] In this semi-folded posture, as shown in the front view on the left side of Figure 7b, the front of area B is obscured by the back of area C. The displayable area of the tri-fold screen only includes area A, excluding areas B and C; that is, only area A is displayed. As shown in the rear view on the right side of Figure 7b, the back of the electronic device includes the back of area A and the back of area B. Similar to Figure 7a, the light sensor 1 is located at the upper left of area A, the front camera is located at the center of the top of the screen in area A, and the rear camera is located on the back of area C. No components may be placed on the back of areas A and B.
[0111] Display state 2 corresponds to the half-folded posture 1 of the tri-fold screen. Display state 2 can also be called N state. In display state 2, the light sensor that can be used by the tri-fold screen is light sensor 1 located in area A.
[0112] (3) Half-folded posture 2 and display status 3:
[0113] In this embodiment, based on the fully unfolded posture shown in Figure 7a, while keeping regions B and C fixed and different (regions B and C are not folded), region A is rotated 180° away from region B along the folding axis 1, so that the back of region A is in contact with the back of region B, thus converting it into another semi-folded posture. Alternatively, based on the semi-folded posture transformation shown in Figure 7b, it can also be converted into another semi-folded posture. For ease of distinction, this other semi-folded posture can be represented as semi-folded posture 2.
[0114] In the semi-folded posture 2, as shown in the front view on the left side of Figure 7c, the displayable area of the tri-fold screen includes areas B and C, meaning that areas B and C can be displayed simultaneously. In the rear view on the right side of Figure 7c, the back of the electronic device includes the back of area C and the front of area A. Similar to Figure 7a, the light sensor 1 is located at the upper left of area A, the front camera is located at the center of the top of the screen in area A, the light sensor 2 is located at the upper right of area C, and the rear camera is located at the back of area C. No components may be placed on the back of areas A and B.
[0115] Display state 3 corresponds to the half-folded posture 2 of the tri-fold screen; display state 3 can also be called M state. In display state 3, the light sensor that can be used on the tri-fold screen is the light sensor 2 located in area C.
[0116] (4) Fully folded posture and display status 4:
[0117] In this embodiment, based on the fully unfolded posture shown in Figure 7a, while keeping area A fixed, area C is rotated 180° along folding axis 2 towards the direction facing area B, so that the front of area B is in contact with the front of area C. Then, area B is rotated 180° along folding axis 1 away from area A, so that the back of area A is in contact with the back of area B, thus converting it into a fully folded posture. Alternatively, based on the half-folded posture transformation shown in Figure 7b or Figure 7c, it can also be converted into a fully folded posture.
[0118] In its fully folded position, as shown in the front view on the left side of Figure 7d, the displayable area of the tri-fold screen only includes area A; that is, only area A is displayed, while areas B and C are not. In the rear view on the right side of Figure 7d, the back of the electronic device includes the back of area C. Similar to Figure 7a, the light sensor 1 is located at the upper left of area A, the front camera is located at the center of the top of the screen in area A, and the rear camera is located on the back of area C. The backs of areas A and B may be left un-displayed. Since the front of area B and the front of area C are flush, the light sensor 2 located in area C is not displayed.
[0119] Display state 4 corresponds to the fully folded posture of the tri-fold screen; display state 4 can also be called F state. In display state 4, the light sensor that can be used on the tri-fold screen is light sensor 1 located in area A.
[0120] It is understood that Figures 7a-7d are merely illustrative examples of different display states of electronic devices, using the tri-fold mobile phone and the device form shown in Figure 5a as examples, and are not intended to limit the scope of the device. In other embodiments, if the electronic device is implemented in other product forms, the folding method of the foldable screen and the display state of the electronic device may also be different, which will not be elaborated here.
[0121] The different physical postures shown in Figures 7a-7d correspond to the dimming strategies shown in Table 1 below:
[0122] Table 1
[0123] Therefore, when implementing the display control method shown in Figure 4, if the posture change is involved and the light sensing device used before and after the posture change is different, the processor can switch the light sensing device according to the posture change, so as to use the ambient light information detected by the corresponding light sensing device to control the display brightness of the tri-fold screen.
[0124] For example, when the first posture and the second posture correspond to different physical postures of the tri-fold screen, the first photosensitive device can be a photosensitive device disposed in the first display area, and the second photosensitive device can be a photosensitive device disposed in the second display area. The display state associated with the first posture can be represented as either a first display state or a second display state. In both the first and second display states, the displayable area of the tri-fold screen includes the first display area but excludes the second display area. The display state associated with the second posture can be represented as a third display state, in which the displayable area of the tri-fold screen can include the second display area but exclude the first display area. Alternatively, the display state associated with the second posture can be represented as a fourth display state, in which the displayable area of the tri-fold screen can include both the first and second display areas.
[0125] Taking Figures 7a-7d as an example, area A can be represented as the first display area, area B as the third display area, and area C as the second display area. Folding axis 1 can be represented as the first folding axis, and folding axis 2 as the second folding axis. The first display state, or F state, corresponds to the fully folded posture. In the first display state, the first and third display areas are folded backwards along the first folding axis, and the second and third display areas are folded forwards along the second folding axis. The displayable area of the tri-fold screen does not include the third display area. The second display state, or N state, corresponds to half-folding posture 1 and is represented as the first half-folding posture. In the second display state, the second and third display areas are folded forwards along the second folding axis, while the first and third display areas are not folded. The displayable area of the tri-fold screen does not include the third display area. The third display state, or M state, corresponds to half-folding posture 2 and is represented as the second half-folding posture. In the third display state, the first and third display areas are folded backwards along the first folding axis, while the second and third display areas are not folded. The displayable area of the tri-fold screen also includes the third display area. The fourth display state, or G state, corresponds to the fully unfolded posture. In the fourth display state, the first and third display areas are not folded, the second and third display areas are not folded, and the displayable area of the tri-fold screen also includes the third display area.
[0126] It should be understood that the above description is merely illustrative and not in any way limiting. In other embodiments, if the posture change involves different physical postures of the tri-fold screen, the first light sensor may also be a light sensor disposed in the second display area, and the second light sensor may also be a light sensor disposed in the first display area. Accordingly, the first posture may be associated with the third or fourth display state described above, and the second posture may be associated with the first or second display state described above.
[0127] In other words, in the above display control method, the processor can analyze whether the physical posture of the tri-fold screen has changed based on the sensor data detected by various sensors, and switch to using the light sensor associated with the current physical posture to detect ambient light information when different light sensors are used for different physical postures, so as to meet the different dimming requirements under different physical postures.
[0128] In reality, due to the individualized usage habits of users, such as the different positions of the electronic device's display screen relative to the user (e.g., standing, sitting, or lying down), and whether the electronic device is held diagonally upwards or downwards towards the user's face, or rotated, all these factors affect the recognition result of the electronic device's posture. In this embodiment, the sensor is used not only to detect whether the physical posture of the tri-fold screen changes, but also to detect whether the display posture of the tri-fold screen relative to the user's viewing angle changes under the same physical posture. The processor can decide whether to switch the light-sensing device based on the change in display posture, thereby meeting the dimming requirements of the electronic device under different display states as much as possible.
[0129] In this embodiment of the application, as shown in Figure 8a, the angle of the user's face when looking straight ahead can be predefined as a reference of 0 degrees, referred to as the eye-level viewing angle. When the user's head remains stationary while their eyes turn downwards, or when the user's head turns downwards, this is the user's top-down viewing angle. When the user's head remains stationary while their eyes turn upwards, or when the user's head turns upwards, this is the user's bottom-up viewing angle. Taking the user's eye-level viewing angle as an example, Figure 8b shows the attitude angles of the electronic device or the attitude angles relative to the user's viewing angle, including pitch, roll, and yaw. When implementing S420, the electronic device (or its processor) can determine whether the tri-fold screen represents a change in display posture relative to the user's viewing angle under the same physical posture.
[0130] Taking the different physical postures shown in Figures 7a-7d as examples, the dimming strategies involved in the changes in device posture angle can include the contents shown in Table 2 below:
[0131] Table 2
[0132] As shown in Figure 9, taking the display posture change of an electronic device (such as a fully folded mobile phone) relative to the user's viewing angle based on the pitch angle as an example, it can be predefined that when the electronic device is placed horizontally with the screen facing upwards, the pitch angle corresponds to 0 degrees; when the electronic device changes to a vertical position with the screen facing the user's face, the pitch angle corresponds to 90 degrees; and when the electronic device is placed horizontally with the screen facing downwards, the pitch angle corresponds to 180 degrees. It can be seen that during this display posture change process, the displayable area always includes area A. According to the strategy shown in Table 2, the light sensor 1 set on area A can be used to implement dimming control without switching the light sensor.
[0133] As shown in Figure 10, taking the display posture change of an electronic device (such as a mobile phone in a fully folded posture) relative to the user's viewing angle based on the flip angle as an example, in the fully folded posture, the displayable area of the tri-fold screen only includes area A, where a light sensor 1 is installed. Conventional display postures can include portrait display postures. In the portrait display posture, the tri-fold screen can rotate clockwise based on the flip angle to a landscape display posture, and in the portrait display posture, it can rotate counterclockwise based on the flip angle to another landscape display posture. It can be seen that during this display posture change process, the displayable area always includes area A. According to the strategy shown in Table 2, dimming control can be implemented using the light sensor 1 installed on area A without switching the light sensor.
[0134] As shown in Figure 11, taking the display posture change of an electronic device (e.g., a mobile phone in a semi-folded posture 2) relative to the user's viewing angle based on the flip angle as an example, in the semi-folded posture 2, the displayable area of the tri-fold screen includes area B and area C, with a light sensor 2 installed in area C. Conventional display postures can include portrait display postures. In the portrait display posture, the tri-fold screen can rotate clockwise based on the flip angle to a landscape display posture, and in the portrait display posture, it can rotate counterclockwise based on the flip angle to another landscape display posture. It can be seen that during this display posture change process, the displayable area always includes area C. According to the strategy shown in Table 2, dimming control can be implemented using the light sensor 2 installed in area C, without the need to switch the light sensor.
[0135] As shown in Figure 12, taking the display posture change of an electronic device (e.g., a mobile phone in a semi-folded posture 1) relative to the user's viewing angle based on the flip angle as an example, in the semi-folded posture 1, the displayable area of the tri-fold screen includes area A, where a light sensor 1 is installed. Conventional display postures can include a portrait display posture. In the portrait display posture, the tri-fold screen can rotate clockwise based on the flip angle to a landscape display posture, and in the portrait display posture, it can rotate counterclockwise based on the flip angle to another landscape display posture. It can be seen that during this display posture change process, the displayable area always includes area A. According to the strategy shown in Table 2, dimming control can be implemented using the light sensor 1 installed on area A, without the need to switch the light sensor.
[0136] As shown in Figures 13a-13d, taking the display posture change of an electronic device (e.g., a fully unfolded mobile phone) relative to the user's viewing angle based on the flip angle as an example, in the fully unfolded posture, the displayable area of the tri-fold screen includes areas A, B, and C. Area A and area C are equipped with light sensors 1. Conventional display postures can include a landscape display posture. In the landscape display posture, the tri-fold screen can rotate clockwise based on the flip angle to a portrait display posture, denoted as Portrait 1. In the landscape display posture or in the portrait 1 posture, it can rotate counterclockwise based on the flip angle to another portrait display posture, denoted as Portrait 2. Alternatively, in the portrait 1 posture, it can rotate clockwise based on the flip angle to the portrait 2 posture.
[0137] In landscape mode, the processor can control the display brightness of the tri-fold screen based on the ambient light information detected by either photosensitive device 1 or photosensitive device 2, according to the dimming strategy shown in Table 1.
[0138] When the tri-fold screen changes relative to the user's viewing angle based on the flip angle, in one implementation, the processor can keep the light sensor unchanged and continue to control the display brightness of the tri-fold screen based on the ambient light information detected by light sensor 1 or light sensor 2. As shown in Figure 13a, in both landscape and two portrait display orientations, the processor can control the display brightness of the tri-fold screen based on the light sensor detected by light sensor 1. Alternatively, as shown in Figure 13b, in both landscape and two portrait display orientations, the processor can control the display brightness of the tri-fold screen based on the light sensor detected by light sensor 2.
[0139] In another implementation, when the tri-fold screen changes its display posture relative to the user's viewing angle under the same physical posture, the processor can also switch the corresponding light sensor according to the strategy shown in Table 2, and use the ambient light information detected by the switched light sensor to control the display brightness of the tri-fold screen, so as to reduce the problem of inaccurate dimming caused by factors such as the user's hand blocking the light.
[0140] Taking a user's right hand as an example, as shown in Figure 13c, when the flip angle changes in the fully unfolded position, the first posture can be associated with the landscape display posture of the tri-fold screen in the fully unfolded position, and the first light sensor is light sensor 2 located in the second display area (area C). The posture of the vertical screen 1 can be represented as the first vertical display posture of the tri-fold screen, and the posture of the vertical screen 2 can be represented as the second vertical display posture of the tri-fold screen. The second posture can be associated with the first vertical display posture, and the second light sensor is light sensor 1 located in the first display area (area A). Therefore, after the tri-fold screen changes from the first posture to the second posture, the processor can use the ambient light information detected by light sensor 1 to control the display brightness of the tri-fold screen. Conversely, if the tri-fold screen changes from the second posture to the first posture, the processor can also switch light sensor 1 to light sensor 2 and use the ambient light information detected by light sensor 2 to control the display brightness of the tri-fold screen.
[0141] Therefore, switching the light sensor when the screen orientation changes between landscape and portrait can reduce the problem of dimming accuracy caused by the user's hand (e.g., right hand) obstructing the light sensor 2 when holding the electronic device. Subsequently, if the user holds the electronic device and changes the tri-fold screen from the first portrait orientation to the second portrait orientation, the dimming control in the second portrait orientation is less affected by the hand (e.g., right hand) obstruction. In this case, the light sensor does not need to be switched, and the ambient light information detected by the light sensor 1 located in the first display area (Area A) can continue to be used to control the display brightness of the tri-fold screen.
[0142] In other embodiments, some users have their left hand as their dominant hand. Based on this consideration, as shown in Figure 13d, when the flip angle changes in the fully unfolded position, the first posture can be associated with the landscape display posture of the tri-fold screen in the fully unfolded position, and the first light sensor is light sensor 1 located in the first display area (area A). The portrait posture 2 can be represented as the third portrait display posture of the tri-fold screen, and the posture of the portrait posture 1 can be represented as the fourth portrait display posture of the tri-fold screen. The second posture can be associated with the third portrait display posture, and the second light sensor is light sensor 2 located in the second display area (area C). Therefore, after the tri-fold screen changes from the first posture to the second posture, the processor can use the ambient light information detected by light sensor 2 to control the display brightness of the tri-fold screen. Conversely, if the tri-fold screen changes from the second posture to the first posture, the processor can also switch light sensor 2 to light sensor 1 and use the ambient light information detected by light sensor 1 to control the display brightness of the tri-fold screen.
[0143] Therefore, switching the light sensor when the screen orientation changes between landscape and portrait can reduce the problem of dimming accuracy caused by the user's hand (e.g., left hand) obstructing the light sensor 1 when holding the electronic device. Subsequently, if the user holds the electronic device and changes the tri-fold screen from the third portrait orientation to the fourth portrait orientation, the dimming control in the fourth portrait orientation is less affected by the hand (e.g., left hand) obstruction. Therefore, the light sensor does not need to be switched, and the ambient light information detected by the light sensor 2 located in the second display area (area C) can continue to be used to control the display brightness of the tri-fold screen.
[0144] When different physical orientations are involved, such as changing from M state to G state, the display area A is flipped from the back to the plane where areas B and C are located. The lighting environment of the light sensor 1 set in area A is not in the same plane as the final screen lighting environment. Therefore, if the light sensor 1 set in area A is directly used for dimming, there may be a jump, which will bring a poor user experience.
[0145] Therefore, in this embodiment of the application, when the tri-fold screen switches from M state to G state, the following strategy 1 or strategy 2 can be implemented according to the contents shown in Table 2:
[0146] Strategy 1: Switch the light sensor used from light sensor 2 to light sensor 1. The switch can be made after the ambient light in area A has stabilized, and conservative dimming can be used during this period. Stable ambient light in area A means that the ambient light intensity detected by light sensor 1 in area A remains within a relatively small illuminance range. Conservative dimming could mean, for example, not dimming the light.
[0147] Strategy 2: Do not switch the light sensor; continue using light sensor 2 set in area C. When the screen is detected to rotate from landscape to portrait mode (including portrait mode 1 or portrait mode 2), switch the light sensor used from light sensor 2 to light sensor 1 to reduce the impact of factors such as hand obstruction on dimming accuracy.
[0148] In the above scenario, if a user uses an electronic device to change the tri-fold screen from portrait to landscape orientation, the processor can switch the used light sensor from light sensor 1 to light sensor 2, as shown in Table 2. Each time the user rotates the electronic device, for example, changing from landscape to portrait or vice versa, the light sensor switching is triggered to reduce the impact of factors such as hand obstruction on dimming accuracy. Alternatively, if the user's dominant hand is right-handed and light sensor 1 is currently being used, the probability of light sensor 1 being obstructed is relatively low, and the light sensor will not be switched again during subsequent landscape / portrait orientation changes to ensure dimming stability. If the user's dominant hand is left-handed and light sensor 2 is currently being used, the probability of light sensor 2 being obstructed is relatively low, and the light sensor will not be switched again during subsequent landscape / portrait orientation changes to ensure dimming stability.
[0149] Taking a user's right hand as an example, as shown in Figure 13e, when the tri-fold screen is in state M, the display area includes areas B and C, and the available light sensor is light sensor 2 located in area C. When the tri-fold screen changes from state M to state G, the available light sensors include light sensor 1 located in area A and light sensor 2 located in area C. To reduce dimming jumps, the light sensor can be temporarily not switched, and light sensor 1 can continue to detect ambient light information to achieve dimming control. When the tri-fold screen changes from a horizontal display posture to a vertical display posture 1 or a vertical display posture 2 in a fully unfolded position, to reduce the impact of factors such as the user's right hand blocking the view, light sensor 1 can be switched accordingly, and the display brightness of the tri-fold screen can be controlled using the ambient light information detected by light sensor 1. Currently, light sensor 1 is being used, and the probability of light sensor 1 being blocked is relatively low. The light sensor will not be switched again when switching between horizontal and vertical postures to ensure dimming stability.
[0150] Therefore, the above description, in conjunction with Figures 5a-13e, introduces the posture change scenarios and corresponding dimming strategies involved in the display control method of this application. This method can flexibly switch the light-sensing devices used according to the posture changes of the foldable screen of the electronic device, so as to meet the different dimming requirements of different display states of the electronic device and ensure the user's visual experience.
[0151] Based on the above embodiments, this application also provides an electronic device, which includes multiple functional modules; the multiple functional modules interact with each other to realize the functions performed by the electronic device in the various methods described in the embodiments of this application. For example, S410-S430 are executed by the electronic device in the embodiment shown in FIG4. The multiple functional modules can be implemented based on software, hardware, or a combination of software and hardware, and the multiple functional modules can be arbitrarily combined or divided based on specific implementations.
[0152] Based on the above embodiments, this application also provides an electronic device, which includes at least one processor and at least one memory, wherein the at least one memory stores computer program instructions. When the electronic device is running, the at least one processor performs the functions performed by the electronic device in the various methods described in the embodiments of this application. For example, S410-S430 are performed by the electronic device in the embodiment shown in FIG4.
[0153] Based on the above embodiments, this application also provides a computer program product containing instructions, which, when run on a computer, causes the computer to execute the methods described in the embodiments of this application.
[0154] Based on the above embodiments, this application also provides a computer-readable storage medium storing a computer program, which, when executed by a computer, causes the computer to perform the methods described in the embodiments of this application.
[0155] Based on the above embodiments, this application also provides a chip for reading computer programs stored in a memory to implement the methods described in the embodiments of this application.
[0156] Based on the above embodiments, this application provides a chip system including a processor for supporting a computer device in implementing the methods described in the embodiments of this application. In one possible design, the chip system further includes a memory for storing necessary programs and data of the computer device. This chip system may be composed of chips or may include chips and other discrete devices.
[0157] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0158] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to this application. It should be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in one or more blocks of the flowchart illustrations and / or one or more blocks of the block diagrams.
[0159] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts and / or one or more block diagrams.
[0160] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.
[0161] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the scope of protection of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.
Claims
1. A display control method characterized by comprising: The method is applied to an electronic device with a foldable screen, the foldable screen is a three-fold screen, at least two light sensing devices of the electronic device are arranged on different display areas of the three-fold screen, and the method comprises the following steps: In a case where the three-fold screen is in a first posture, the display brightness of the three-fold screen is controlled by using ambient light information detected by a first light sensing device in the at least two light sensing devices; It is determined that the three-fold screen changes from the first posture to a second posture, and the second posture is associated with a second light sensing device in the at least two light sensing devices; In a case where the three-fold screen is in the second posture, the display brightness of the three-fold screen is controlled by using ambient light information detected by the second light sensing device.
2. The method of claim 1, wherein, The three-fold screen comprises a first display area, a second display area and a third display area, the first display area and the third display area are connected through a first folding axis, the second display area and the third display area are connected through a second folding axis, the at least two light sensing devices are arranged on the first display area and the second display area, and no light sensing device is arranged on the third display area, wherein The first posture and the second posture correspond to different display postures of the three-fold screen in the same physical posture relative to the user's visual angle; or The first posture and the second posture correspond to different physical postures of the three-fold screen.
3. The method of claim 2, wherein, In a fully unfolded posture of the three-fold screen, the first posture and the second posture correspond to different display postures of the three-fold screen in different flip angles relative to the user's visual angle in the fully unfolded posture, wherein The first posture is associated with a landscape display posture of the three-fold screen in the fully unfolded posture, and the first light sensing device is a light sensing device arranged on the second display area, the landscape display posture of the three-fold screen is rotated clockwise to a first portrait display posture of the three-fold screen based on the flip angle, the second posture is associated with the first portrait display posture, and the second light sensing device is a light sensing device arranged on the first display area.
4. The method of claim 3, wherein, The landscape display posture of the three-fold screen is rotated counterclockwise to a second portrait display posture of the three-fold screen based on the flip angle, and the method further comprises: It is determined that the three-fold screen changes from the first portrait display posture to the second portrait display posture; In a case where the three-fold screen is in the second portrait display posture, the display brightness of the three-fold screen is controlled by using ambient light information detected by the second light sensing device.
5. The method of claim 2, wherein, In a fully unfolded posture of the three-fold screen, the first posture and the second posture correspond to different display postures of the three-fold screen in different flip angles relative to the user's visual angle in the fully unfolded posture, wherein The first posture is associated with a landscape display posture of the tri-fold screen in the fully unfolded posture, and the first light sensor device is a light sensor device arranged in the first display area; the landscape display posture of the tri-fold screen is rotated counterclockwise based on the flip angle to a third portrait display posture of the tri-fold screen, the second posture is associated with the third portrait display posture, and the second light sensor device is a light sensor device arranged in the second display area.
6. The method of claim 5, wherein, The landscape display posture of the tri-fold screen is rotated clockwise based on the flip angle to a fourth portrait display posture of the tri-fold screen, and the method further comprises: determining that the tri-fold screen changes from the third portrait display posture to the fourth portrait display posture; when the tri-fold screen is in the fourth portrait display posture, controlling the display brightness of the tri-fold screen by using the ambient light information detected by the second light sensor device.
7. The method of claim 2, wherein, When the first posture and the second posture correspond to different physical postures of the tri-fold screen, the first light sensor device is a light sensor device arranged in the first display area, and the second light sensor device is a light sensor device arranged in the second display area.
8. The method of claim 7, wherein, The first posture is associated with a first display state or a second display state of the tri-fold screen, in the first display state and the second display state, the displayable area of the tri-fold screen includes the first display area and does not include the second display area, wherein, The second posture is associated with a third display state of the tri-fold screen, in the third display state, the displayable area of the tri-fold screen includes the second display area and does not include the first display area; or The second posture is associated with a fourth display state of the tri-fold screen, in the fourth display state, the displayable area of the tri-fold screen includes the first display area and the second display area.
9. The method of claim 8, wherein, in the first display state, the first display area and the third display area are folded towards the back through a first folding axis, the second display area and the third display area are folded towards the front through the second folding axis, and the displayable area of the tri-fold screen does not include the third display area; in the second display state, the second display area and the third display area are folded towards the front through the second folding axis, the first display area and the third display area are not folded, and the displayable area of the tri-fold screen does not include the third display area; in the third display state, the first display area and the third display area are folded towards the back through a first folding axis, the second display area and the third display area are not folded, and the displayable area of the tri-fold screen includes the third display area; in the fourth display state, the first display area and the third display area are not folded, the second display area and the third display area are not folded, and the displayable area of the tri-fold screen includes the third display area.
10. An electronic device, comprising: The electronic device comprises a foldable screen, a processor and a memory, the foldable screen is a three-fold screen; The memory is configured to store one or more computer programs; When the one or more computer programs stored in the memory are executed by the processor, the electronic device is caused to perform the method of any one of claims 1-9.
11. A computer readable storage medium, characterized in that, The computer readable storage medium comprises a computer program, when the computer program is run on the electronic device, the electronic device is caused to perform the method of any one of claims 1-9.
12. A chip, characterized by The chip is coupled with the memory, and is configured to execute the computer program stored in the memory to perform the method of any one of claims 1-9.
Citation Information
Patent Citations
Foldable display device and method of controlling therefor
CN105324807A
Screen brightness regulation method, mobile terminal and storage medium
CN107547734A
Electronic equipment
CN109119044A
Ambient light detection circuit and terminal device
CN110926606A
Electronic device
CN112565490A