Method for controlling screen display and electronic device
By switching interfaces between the first area and the second area of the foldable electronic device, using the second area to display the associated content, the problem of low screen utilization rate of large-screen electronic devices in the folded state is solved, and the user experience and Portability.
Patent Information
- Application Number
- CN202080015660.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-02-22
- Filing Date
- 2020-02-13
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2040-02-13
AI Technical Summary
Large-screen electronic devices fail to maximize the use of the screen in the folded state, resulting in low screen utilization and poor user experience.
By switching interfaces between the first area and the second area of the foldable touch display screen, the content associated with the first area is displayed using the second area, thereby improving the utilization rate of the screen and user experience, especially in the folded form Detect user operations to dynamically adjust the screen status.
It improves the screen utilization and user experience in folding mode, saves power consumption, and provides more flexible interface display in different application scenarios to enhance portability.
Smart Images

Figure CN113518967B_ABST
Abstract
Description
[0001] This application claims priority to Chinese Patent Application No. 201910134248.X, filed on February 22, 2019, entitled "A Method and Electronic Device for Controlling Screen Display", the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to the field of electronic devices, and more specifically, to a method for controlling a screen display and an electronic device. Background Technology
[0003] With more and more users pursuing superior visual effects on their phones, screens are getting larger and larger. However, large-screen devices also bring certain problems, such as being less portable. Therefore, foldable electronic devices are emerging as a necessity. When in use, they can be switched between unfolded and folded states; when carrying them, the foldable screen can be folded to reduce space usage.
[0004] However, when folded, only the screen facing you is usually lit up, while the screens on the back and sides are off, thus not maximizing screen utilization. Summary of the Invention
[0005] This application provides a method and electronic device for controlling screen display, which helps to improve screen utilization.
[0006] In a first aspect, a method for controlling a screen display is provided, the method being applied to an electronic device configured with a foldable touch display screen, the touch display screen including a first area and a second area, the method comprising: the electronic device displaying a first interface in the first area; the electronic device detecting a first operation on the first interface; and in response to the first operation, displaying a second interface in the second area, the second interface being associated with the content displayed on the first interface.
[0007] In this embodiment, when the electronic device detects a user's operation in the first area, it can display content associated with the second area in the second area, which helps to improve screen utilization and enhance user experience.
[0008] In some possible implementations, the electronic device can be in a folded state, in which case the electronic device displays a first interface on a first area, while the second area is turned off and not displayed; when the electronic device detects a first operation in the first area, the electronic device lights up the second area and displays the second interface on the second area.
[0009] In some possible implementations, the electronic device can be in an unfolded or semi-folded state. In this state, the electronic device can display a first interface on the first area and turn off the second area, or the second area can display a third interface. When the electronic device detects a first operation in the first area, the electronic device can turn on the second area and display the second interface on the second area, or the electronic device can switch the third interface displayed on the second area to the second interface.
[0010] In conjunction with the first aspect, in some possible implementations of the first aspect, the electronic device displays a first interface in the first area, including: the electronic device determining that it is in a folded state; in response to being in the folded state, the electronic device displays the first interface in the first area, and the electronic device turns off the second area.
[0011] In this embodiment, when the electronic device is determined to be in a folded state, content can be displayed in the first area while the second area is turned off. When the user's operation is detected in the first area, the second area is turned on and the second interface is displayed in the second area. This helps to improve the utilization rate of the screen in the folded state and also improves the user experience.
[0012] In conjunction with the first aspect, in some possible implementations of the first aspect, after the electronic device displays the second interface on the second area, the method further includes: the electronic device detecting a second operation on the first interface; and in response to the second operation, the electronic device turning off the second area.
[0013] In this embodiment, when a user wishes to exit the collaborative operation of the first and second regions, they can perform corresponding operations on the first region to exit the collaborative operation of the first and second regions and turn off the second region. This helps to save power consumption of electronic devices and also helps to improve the user experience.
[0014] In some possible implementations, after the electronic device displays a second interface on the second area, the method further includes: the electronic device detecting a second operation on the second interface; and in response to the second operation, the electronic device turning off the second area.
[0015] In this embodiment, the user's operation can also be detected on the second interface, after which the user exits the first area and the second area work together, and the second area is turned off.
[0016] In conjunction with the first aspect, in some possible implementations of the first aspect, the second interface displays at least partially the same content as the first interface.
[0017] In conjunction with the first aspect, in some possible implementations of the first aspect, the first interface is a camera interface, the camera interface includes a first preview window, the second interface includes a second preview window, and the images displayed in the first preview window and the second preview window are at least partially the same.
[0018] The method for controlling screen display in this application embodiment can be applied to shooting scenarios. When the electronic device detects the user's operation on the camera interface, a second preview window can be displayed in the second area. This allows the subject to adjust their posture in a timely manner, improving screen utilization and enabling users to take satisfactory photos or videos, thus enhancing the user experience.
[0019] In conjunction with the first aspect, in some possible implementations of the first aspect, the first interface is a user's payment interface, which includes a payment code, and the second interface includes the payment code.
[0020] The method for controlling screen display in this application embodiment can be applied to payment scenarios. When a user pays via barcode or QR code, the barcode or QR code can be displayed on a second area, which helps improve screen utilization. At the same time, the user does not need to flip the electronic device, which is convenient for merchants to scan and helps improve the user experience.
[0021] In conjunction with the first aspect, in some possible implementations of the first aspect, the first interface is a translation interface, which includes the content to be translated, and the second interface includes the translation result of the content to be translated.
[0022] The screen display control method of this application embodiment can be applied to translation scenarios. When the user finishes translating the content to be translated, the translated content can be displayed on a second area, which helps improve screen utilization. At the same time, this improves the efficiency of users communicating in foreign languages and enhances the user experience.
[0023] In conjunction with the first aspect, in some possible implementations of the first aspect, the first interface includes the translation result, and the method further includes: the electronic device detecting a user's modification operation on the translation result on the first interface; and in response to the modification operation, the electronic device displaying the modified translation result on the second interface.
[0024] The method for controlling screen display in this application embodiment allows the user to adjust the translation content in the first area and display the accurate translation result in the second area when the user determines that the translation app is not translating the content accurately, thereby improving the user experience.
[0025] Secondly, this technical solution provides a device for controlling screen display. This device is included in an electronic device and has the function of implementing the behaviors of the electronic device in the above-mentioned aspects and possible implementations thereof. The functions can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above functions. For example, a display module or unit, a detection module or unit, etc.
[0026] Thirdly, this technical solution provides an electronic device, including: a foldable touch display screen; one or more processors; a memory; multiple applications; and one or more computer programs. The one or more computer programs are stored in the memory, and each computer program includes instructions. When the instructions are executed by the electronic device, the electronic device performs a method for controlling the screen display in any possible implementation of any of the above aspects.
[0027] Fourthly, this technical solution provides an electronic device including one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, including computer instructions. When the one or more processors execute the computer instructions, the electronic device performs a method for controlling screen display in any possible implementation of any of the above aspects.
[0028] Fifthly, this technical solution provides a computer storage medium, including computer instructions, which, when executed on an electronic device, cause the electronic device to perform a method for controlling screen display in any possible implementation of any of the above aspects.
[0029] Sixthly, this technical solution provides a computer program product that, when run on an electronic device, causes the electronic device to execute a method for controlling screen display in any of the possible designs described above. Attached Figure Description
[0030] Figure 1 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application.
[0031] Figure 2 This is a schematic diagram of the software structure of an electronic device provided in an embodiment of this application.
[0032] Figure 3 This is a schematic diagram of a foldable electronic device provided in an embodiment of this application.
[0033] Figure 4 This is a schematic diagram illustrating the physical form of the foldable electronic device provided in the embodiments of this application.
[0034] Figure 5 This is a schematic diagram of a set of display interfaces provided in an embodiment of this application.
[0035] Figure 6 This is another set of display interface schematic diagrams provided in the embodiments of this application.
[0036] Figure 7 This is another set of display interface schematic diagrams provided in the embodiments of this application.
[0037] Figure 8 This is another set of display interface schematic diagrams provided in the embodiments of this application.
[0038] Figure 9 This is another set of display interface schematic diagrams provided in the embodiments of this application.
[0039] Figure 10 This is a schematic diagram of the main screen and secondary screen of the electronic device provided in the embodiments of this application in the unfolded and folded states.
[0040] Figure 11 This is a schematic diagram of the main screen and secondary screen display of the electronic device provided in the embodiments of this application in the folded state.
[0041] Figure 12 This is another schematic diagram of the main screen and secondary screen display of the electronic device provided in the embodiments of this application in the folded state.
[0042] Figure 13 This is another schematic diagram of the foldable electronic device provided in the embodiments of this application.
[0043] Figure 14 This is another schematic diagram of the foldable electronic device provided in the embodiments of this application.
[0044] Figure 15 This is a schematic flowchart of a method for controlling screen display provided in an embodiment of this application.
[0045] Figure 16 This is a schematic block diagram of the electronic device provided in the application embodiments. Detailed Implementation
[0046] The terminology used in the following embodiments is for the purpose of describing particular embodiments only and is not intended to be limiting of this application. As used in the specification and appended claims of this application, the singular expressions “a,” “an,” “the,” “the,” “the,” and “this” are intended to also include expressions such as “one or more,” unless the context clearly indicates otherwise. It should also be understood that in the following embodiments of this application, “at least one” and “one or more” refer to one, two, or more than two. The term “and / or” is used to describe the relationship between related objects, indicating that three relationships may exist; for example, A and / or B can indicate: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. The character “ / ” generally indicates that the preceding and following related objects are in an “or” relationship.
[0047] References to "one embodiment" or "some embodiments" as described in this specification mean that one or more embodiments of this application include a specific feature, structure, or characteristic described in connection with that embodiment. Therefore, the phrases "in one embodiment," "in some embodiments," "in other embodiments," "in still other embodiments," etc., appearing in different parts of this specification do not necessarily refer to the same embodiment, but rather mean "one or more, but not all, embodiments," unless otherwise specifically emphasized. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless otherwise specifically emphasized.
[0048] The following describes an electronic device with NFC functionality, a user interface for such an electronic device, and embodiments for using such an electronic device. In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and / or music player, such as a mobile phone, tablet computer, wearable electronic device with wireless communication capabilities (such as a smartwatch), etc. Exemplary embodiments of the portable electronic device include, but are not limited to, carrying... Alternatively, it could be a portable electronic device with another operating system. The aforementioned portable electronic device could also be other portable electronic devices, such as laptops. It should also be understood that in some other embodiments, the aforementioned electronic device may not be a portable electronic device, but rather a desktop computer.
[0049] For example, Figure 1A schematic diagram of the structure of electronic device 100 is shown. Electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, antenna 1, antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.
[0050] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0051] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). Different processing units may be independent components or integrated into one or more processors. In some embodiments, electronic device 101 may also include one or more processors 110. The controller can generate operation control signals based on instruction opcodes and timing signals to control instruction fetching and execution. In other embodiments, processor 110 may also include a memory for storing instructions and data. For example, the memory in processor 110 may be a cache memory. This memory can store instructions or data that processor 110 has just used or is reusing. If processor 110 needs to reuse the instruction or data, it can directly retrieve it from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the electronic device 101 in processing data or executing instructions.
[0052] In some embodiments, the processor 110 may include one or more interfaces. These interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM card interface, and / or a USB interface, etc. The USB interface 130 is a USB standard-compliant interface, specifically a Mini USB interface, a Micro USB interface, a USB Type-C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 101, and can also be used for data transfer between the electronic device 101 and peripheral devices. The USB interface 130 can also be used to connect headphones for audio playback.
[0053] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0054] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.
[0055] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and provides power to the processor 110, the internal memory 121, the external memory, the display 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage, impedance). In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.
[0056] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0057] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.
[0058] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0059] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After being processed by the baseband processor, the low-frequency baseband signal is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.) or displays an image or video through the display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.
[0060] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.
[0061] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0062] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or more display screens 194.
[0063] In some embodiments of this application, when the display panel uses materials such as OLED, AMOLED, and FLED, the above-mentioned Figure 1 The display screen 194 in the document can be bent. Here, "the display screen 194 can be bent" means that the display screen can be bent to any angle at any location and held at that angle. For example, the display screen 194 can be folded in half horizontally from the middle, or vertically from the middle. In this application, the bendable display screen is referred to as a foldable display screen. The foldable display screen can be a single screen or a display screen composed of multiple screens pieced together; no limitation is made here.
[0064] The display screen 194 of electronic device 100 can be a flexible screen. Currently, flexible screens are attracting much attention due to their unique characteristics and enormous potential. Compared to traditional screens, flexible screens are highly flexible and bendable, providing users with new interaction methods based on their bendability and meeting more user needs for electronic devices. For electronic devices equipped with foldable displays, the foldable display can switch between a small screen in a folded state and a large screen in an unfolded state at any time. Therefore, users are increasingly using split-screen functionality on electronic devices equipped with foldable displays.
[0065] Because the display screen 194 is foldable, the physical form of the electronic device can also change accordingly; for example, when the display screen is fully unfolded, the physical form of the electronic device can be called the unfolded form, and when a portion of the touch screen is folded, the physical form of the electronic device can be called the folded form. It is understood that in the following embodiments of this application, the physical form of the electronic device may refer to the physical form of the touch screen.
[0066] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0067] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.
[0068] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.
[0069] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the electronic device 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.
[0070] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. This allows electronic device 100 to play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, and MPEG4.
[0071] The NPU is a neural network (NN) computing processor. Drawing on the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it rapidly processes input information and can continuously self-learn. The NPU can enable intelligent cognitive applications in electronic device 100, such as image recognition, face recognition, speech recognition, and text comprehension.
[0072] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored on the external memory card.
[0073] The internal memory 121 can be used to store one or more computer programs, which include instructions. The processor 110 can execute the instructions stored in the internal memory 121, thereby causing the electronic device 101 to perform the always-on display method provided in some embodiments of this application, as well as various applications and data processing. The internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system; it may also store one or more applications (such as a gallery, contacts, etc.). The data storage area may store data created during the use of the electronic device 101 (such as photos, contacts, etc.). Furthermore, the internal memory 121 may include high-speed random access memory and non-volatile memory, such as one or more disk storage components, flash memory components, universal flash storage (UFS), etc. In some embodiments, the processor 110 can execute instructions stored in the internal memory 121 and / or instructions stored in memory disposed in the processor 110, thereby causing the electronic device 101 to perform the always-on display method provided in the embodiments of this application, as well as other applications and data processing.
[0074] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0075] The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0076] The pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor 180A can be disposed on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive materials. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to the display screen 194, the electronic device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The electronic device 100 can also calculate the touch position based on the detection signal from the pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS message is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS message is executed.
[0077] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.
[0078] In this embodiment of the application, the angle between the displays can also be determined after the electronic device is folded by using the gyroscope sensor 180B on each screen.
[0079] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover based on the magnetic sensor 180D. Based on the detected opening and closing status of the case or flip cover, features such as automatic unlocking of the flip cover can be configured.
[0080] Accelerometer 180E can detect the magnitude of acceleration of electronic device 100 in all directions (generally three axes). It can also detect the magnitude and direction of gravity when electronic device 100 is stationary. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.
[0081] The distance sensor 180F is used to measure distance. The electronic device 100 can measure distance using infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure distance to achieve fast focusing.
[0082] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user is holding the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.
[0083] Ambient light sensor 180L is used to sense ambient light brightness. Electronic device 100 can adaptively adjust the brightness of display screen 194 based on the perceived ambient light. Ambient light sensor 180L can also be used to automatically adjust white balance when taking photos. Ambient light sensor 180L can also work with proximity light sensor 180G to detect whether electronic device 100 is in a pocket to prevent accidental touches.
[0084] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.
[0085] The touch sensor 180K is also called a "touch panel." The touch sensor 180K can be disposed on the display screen 194. The touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen." The touch sensor 180K is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180K can also be disposed on the surface of the electronic device 100, in a location different from that of the display screen 194.
[0086] It should be understood that the above only illustrates some sensors in the electronic device 100 and their functions; the electronic device may include more or fewer sensors. For example, the electronic device 100 may also include a gravity sensor. In this embodiment, for a foldable electronic device, in its folded state, it may include a first region and a second region at a certain angle. The electronic device can determine the folding direction of the electronic device and the angle between the first and second regions after folding using an acceleration sensor and a gravity sensor.
[0087] The buttons 190 include a power button, a volume button, and the like. The buttons 190 may be mechanical buttons or touch buttons. The electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the electronic device 100.
[0088] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.
[0089] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100.
[0090] Figure 2 This is a software structure block diagram of an electronic device 100 according to an embodiment of this application. The layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer. The application layer may include a series of application packages.
[0091] like Figure 2 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.
[0092] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0093] like Figure 2 As shown, the application framework layer may include display managerservice, activity managerservice, and window managerservice, etc.
[0094] For foldable electronic devices, when a user folds the touchscreen display (assuming it can be folded once), the screen can be divided into screen A and screen B. Assume the electronic device controls screen A to remain lit and operational, while screen B remains off. When the user holds the electronic device, screen A can be lit, allowing the user to perform corresponding operations on it; screen B is off, so the user cannot perform any operations on it.
[0095] The display management service is used to adjust the actual display area of the screen to the size of screens A and B when the electronic device detects that the user has triggered a collaborative working mode for screens A and B, so that other application interfaces can be displayed on screen B.
[0096] The activity management service is used to launch the application interface on screen B when screens A and B enter collaborative working mode.
[0097] The window management service is used to adjust the display position of application interfaces on screens A and B on the same expanded screen when screens A and B enter collaborative working mode.
[0098] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
[0099] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.
[0100] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0101] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.
[0102] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications.
[0103] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
[0104] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.
[0105] A 2D graphics engine is a drawing engine for 2D drawings.
[0106] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.
[0107] In the embodiments of this application, the physical components involved in the electronic device 100 mainly include hardware components such as sensors, decision support systems (DSS) display chips, and touch screens; as well as application framework layer functions such as display management services, activity management services, and window management services.
[0108] The following describes the workflow of the software and hardware of the electronic device 100 by way of controlling the screen display according to an embodiment of this application.
[0109] The method for controlling screen display provided in this application embodiment is mainly achieved through the cooperation between the touch panel (TP) module and one or more physical components and the various layers of the software architecture layer of the electronic device 100.
[0110] In this embodiment, the foldable electronic device may include a main screen, a side screen, and a secondary screen, wherein the main screen and the secondary screen can be folded with the side screen as an axis. When the electronic device is in a folded state, and this folded state can be when the main screen and the secondary screen are folded in opposite directions, if the electronic device is in an unlocked state, the electronic device controls the main screen to light up, while controlling the secondary screen to turn off and not display.
[0111] For example, the total resolution of a foldable electronic device can be 2480*2200. In its folded form, the electronic device can be divided into a main screen and a secondary screen. The resolution of the main screen can be 2480*1144 (19.5:9), the resolution of the secondary screen can be 2480*892 (25:9), and the resolution of the side screen can be 2480*160.
[0112] When the electronic device is in unfolded mode, the display management service can notify the LCD module of the area that needs to be lit (e.g., 2480*2200), and the LCD module can then control the entire touch screen to be lit.
[0113] When the electronic device is in a folded state, the display management service can notify the LCD module of the area that needs to be lit (e.g., 2480*1144), and the LCD module controls the main screen to be lit; while the secondary screen is off and does not work.
[0114] In this embodiment, when the electronic device is in a folded state, the TP module can receive user clicks on the main screen and pass them to the display management service of the application framework layer. The display management service can then notify the LCD module of the area that needs to be illuminated. The LCD module adjusts the actual display area of the touch screen to the size of the entire touch screen, allowing the application interface to be displayed on the secondary screen as well. The activity management service launches the application interface on the secondary screen. The window management service adjusts the display positions of the application interfaces on the main screen and the secondary screen on the same unfoldable touch screen. This enables the main screen and the secondary screen to enter a collaborative working mode.
[0115] For ease of understanding, the following embodiments of this application will be described using the following methods: Figure 1 and Figure 2 Taking the electronic device with the structure shown as an example, and in conjunction with the accompanying drawings and application scenarios, the method for controlling the screen display provided in this application embodiment will be specifically described.
[0116] As described in the background section, touchscreen displays on electronic devices are becoming increasingly larger. To fully leverage the application value of touchscreens, various screen display technologies have been developed. For example, when the touchscreen is in its unfolded state, users can simultaneously handle multiple applications on the same touchscreen. Furthermore, to improve the portability of large-screen mobile phones, flexible screens are being widely used in electronic devices. Compared to traditional screens, flexible screens are highly flexible and bendable, providing users with new interaction methods based on their bendability, thus meeting more user needs for electronic devices. For electronic devices equipped with touchscreens, the touchscreen can switch between a small screen in a folded state and a large screen in an unfolded state at any time. Therefore, users are increasingly using split-screen functionality on electronic devices with touchscreens.
[0117] Figure 3 This is a schematic diagram of an example of a foldable electronic device provided in this application. Figure 4 This is a schematic diagram illustrating the physical form of a foldable electronic device provided in an embodiment of this application. First, let's consider... Figure 3 and Figure 4 This section introduces the touchscreen display of the electronic device.
[0118] In one embodiment of this application, the display area of the touch display screen 300 in its folded state can be divided into three areas: a first area 301, a second area 302, and a third area 303. For example, Figure 3 Figures (a), (b), (c), and (d) illustrate at least three physical forms that the touchscreen display 300 of the electronic device may include: a folded form, a semi-folded form folded at a certain angle, and an unfolded form. As shown in Figure (a), the middle bending portion indicated by the dashed boundary of the touchscreen display 300 is the aforementioned third region 303. Using this third region 303 (or, more accurately, a folded side screen) as an axis, the touchscreen display 300 can be divided into a first region 301 (e.g., Figure 3 The area to the right of the middle region 303) and the second region 302 (for example, Figure 3 (The area to the left of central area 303).
[0119] When the touch screen 300 of the electronic device 100 is in a folded state, it can be as follows: Figure 3 As shown in Figure (d) above. Specifically, Figure 3 In the folded state shown in Figure (d), the angle between the first region 301 and the second region 302 can be a first angle α, where 0°≤α≤a1, a1 is less than or equal to 90 degrees and greater than or equal to 0 degrees, for example a1 can be 25 degrees.
[0120] When the touch screen 300 of the electronic device 100 is in a semi-folded state at a certain angle, it can be as follows: Figure 3 As shown in Figure (c). Specifically, Figure 3 In the semi-folded state shown in Figure (c), the angle between the first region 301 and the second region 302 is the second angle β, where a1 ≤ β ≤ a4, a1 is less than or equal to 90 degrees and greater than or equal to 0 degrees, and a4 is greater than or equal to 90 degrees and less than 180 degrees. For example, a1 can be 25 degrees and a4 can be 155 degrees. Furthermore, corresponding to... Figure 4The physical form of the foldable electronic device 100 is categorized as follows: the semi-folding form of the touch display screen 300 can also include an unstable support state and a stable support state. In the stable support state, the angle between the first region 301 and the second region 302 is a second angle β, and the range of the second angle β is a2≤β≤a3, where a2 is less than or equal to 90 degrees, and a3 is greater than or equal to 90 degrees and less than 180 degrees. In the semi-folding form of the electronic device 100, any form other than the stable support state constitutes the unstable support state of the electronic device 100. It should be understood that the classification of the physical form of the touch display screen 300 and the definition of each physical form are not limited in this application.
[0121] When the touch screen 300 of the electronic device is in an unfolded state, it can be as follows: Figure 3 As shown in Figure (a) or (b) in the diagram. Specifically, when the touch display screen 300 is in its unfolded state, the angle between the first region 301 and the second region 302 is a third angle ε, where a4 ≤ ε ≤ 180 degrees, a4 is greater than or equal to 90 degrees and less than 180 degrees, for example, a4 can be 90 degrees. Figure 3 Figure (a) shows the shape when the third angle ε is 180 degrees. Figure 3 Figure (b) shows the shape when the third angle ε is greater than a4 and less than 180 degrees.
[0122] It should be understood that the above is merely an example of classifying an electronic device into unfolded, semi-folded, and folded states. For instance, when the electronic device is in unfolded or semi-folded states, the entire touchscreen display is illuminated. When the electronic device is in folded state, the display management service can instruct the LCD module to illuminate only the main screen. This application does not limit the method by which the electronic device determines it is in folded state; other methods can also be used to determine if the electronic device is in folded state.
[0123] It should be understood that the bending part can also be distributed horizontally in Figure (a). The folding display screen can be folded vertically, that is, the first area 301 and the second area 302 of the touch display screen can correspond to the upper and lower ends of the middle bending part. This application will take the first area 301 and the second area 302 distributed horizontally as shown in Figure (a) as an example for introduction. The method of controlling the screen display provided by this application is also applicable to the vertical folding method. This application does not limit it.
[0124] The physical form of electronic device 100 has been described above. For different physical forms or different application types of electronic devices, users may want the foldable display screen 300 to have different display modes. Here, display mode can be understood as the display method of the foldable display screen 300, such as full-screen display, display in the first area 301 while the second area 302 is off, display in the second area 302 while the first area 301 is off, or display different interfaces in the first area 301 and the second area 302 at the same time, etc.
[0125] Figure 5 A schematic diagram of a set of graphical user interfaces (GUIs) provided in an embodiment of this application is shown.
[0126] See also Figure 5 As shown in (a), when the foldable electronic device is in its folded state, the desktop of the electronic device can be displayed in the first area 301, while the second area 302 is off. When the electronic device detects a user clicking the camera icon 501 in the first area 301, it displays as shown in (a). Figure 5 The GUI shown in (b) is shown in the image.
[0127] See also Figure 5 As shown in (b), when the phone detects that the user has clicked the camera application (APP) icon 302 on the desktop, it can launch the camera application and display the following: Figure 5 The GUI displayed in the first area 301 shown in (b) can be called a shooting interface (or camera interface). This shooting interface may include a preview window 503. In preview mode, the preview window 503 can display the image captured by the camera in real time. The electronic device displays this shooting interface in the first area 301, while the second area 302 is off. When the electronic device detects a user click on the control 502 in the first area 301, it displays as shown... Figure 5 The GUI shown in (c) is shown in the image.
[0128] See also Figure 5 As shown in (c), the electronic device displays the shooting interface in the first area 301 and the preview window 504 in the second area 302. The preview window 504 can also display the image captured by the camera in real time, so that the subject can easily adjust their posture in real time according to the image in the preview window 504 in the second area 302.
[0129] For example, the electronic device can also detect a long press operation by the user in the preview window 503 on the shooting interface and then display the preview window 504 in the second area 302.
[0130] For example, after the electronic device detects a pressure press operation (the pressure is greater than or equal to a preset value) by the user in the preview window 503 on the shooting interface, it displays the preview window 504 in the second area 302.
[0131] For example, after the electronic device displays the shooting interface, if the electronic device detects a user's voice instruction, a preview window 504 is displayed in the second area 302.
[0132] In one embodiment of this application, when the electronic device detects the user's click on the control 502 on the shooting interface (or camera interface), it can remind the user through text on the shooting interface that "the main screen and the secondary screen can display the preview window at the same time", and light up the second area 302, displaying the preview window 504 on the second area 302.
[0133] In another embodiment of this application, see Figure 5 As shown in (d), when the electronic device detects a user's click on control 502 on the shooting interface (or camera interface), it can prompt the user with the text "Do you want the preview window to be displayed on both the main screen and the secondary screen simultaneously?" on the shooting interface, and display controls 505 and 506. When the electronic device detects a user's click on control 505, it illuminates the second area 302 and displays the preview window 504 on the second area 302.
[0134] In this embodiment, the electronic device enters a collaborative mode when taking a photo, allowing the photo preview window to be displayed on multiple screens, thus improving screen utilization. Simultaneously, this allows the subject to adjust their shooting posture in a timely manner, enhancing the user experience.
[0135] In another embodiment of this application, such as Figure 5 As shown in (b), when the electronic device detects that the user clicks the "record" control on the shooting interface (or camera interface), it can enter the video shooting interface, which may include a preview window and shooting controls; at this time, the second area 302 is turned off and not displayed. When the electronic device detects that the user clicks the control 502, it can display the video shooting interface on the first area and the preview window of the video shooting interface on the second area.
[0136] In another embodiment of this application, when the electronic device is in a folded state, the electronic device can light up the first area 301 and display the desktop of the electronic device on the first area 301, while the second area 302 is turned off and not displayed. When the electronic device detects a user clicking the camera icon 501 on the first area 301, it can directly display the shooting interface on the first area 301 and display the preview window on the second area 302.
[0137] In this embodiment, when the electronic device enters the camera application in a folded state, the shooting interface can be displayed in the first area and the preview window can be displayed in the second area at the same time, which helps to improve the utilization of the screen and does not require manual operation by the user, thus improving the user experience.
[0138] In another embodiment of this application, when the electronic device is in a folded state, it displays a camera interface on the first area 301, while the second area 302 remains off. When the electronic device detects a user's click on the control 502 on the first area 301, it can display the camera interface on the first area and play an animation on the second area. This way, when taking photos of children, it can attract their attention, resulting in photos or videos that satisfy the user.
[0139] The above combination Figure 5 This application introduces a set of GUIs in its embodiments, which mainly demonstrate the process by which a user enters the first area 301 and the second area 302 to work together by clicking on controls. The following is a combination of... Figure 6 Another set of GUIs shown illustrates the process of an electronic device exiting the cooperative operation of the first region 301 and the second region 302.
[0140] See also Figure 6 As shown in (a) of the GUI, after the user finishes taking a picture, they can click on control 502 in the first area 301. When the electronic device detects the user's click on control 402, it displays as shown in the image. Figure 6 The GUI shown in (b) is shown in the image.
[0141] join Figure 6 As shown in (b) of the diagram, the electronic device displays the shooting interface in the first area 301, while the second area 302 is off and not displayed.
[0142] Figure 7 This application illustrates a set of GUIs for another scenario provided by an embodiment of the present application.
[0143] See also Figure 7As shown in (a) of the diagram, when the foldable electronic device is in its folded state, the translation interface of a translation app is displayed in the first area 301. The user can enter the Chinese text to be translated in the input box 701 of the first area 301. For example, the user enters "Excuse me, how can I get to hotel A?" in the input box 701. When the phone detects that the user has clicked the "translate" control, the corresponding English translation can be displayed in the output box 702 (for example, "Excuse me, how can I get to hotel A?"). At this time, the second area 302 is off and not displayed.
[0144] When the electronic device detects that the user clicks on control 703, it displays as follows: Figure 7 The GUI shown in (b) is shown in the image.
[0145] See also Figure 7 The GUI shown in (b) continues to display the translation interface in the first area 301, while the corresponding English translation can be displayed in the second area 302.
[0146] In another embodiment of this application, the translation interface of the translation app may also include a control 704. When the user sees that the translation result is inaccurate, he / she can click on the control 704 and then modify the translation result in the output box 703.
[0147] For example, such as Figure 7 As shown in (c), when the electronic device detects that the user has entered "Do you know the new wireless technology?" in input box 701 and clicks the "Translate" control, it can display the corresponding English translation in output box 702 (for example, the translation result of the translation app is "Do you know the new wireless technology"). Since "new wireless technology" is a technical term in fifth-generation mobile communication technology (5G), it should be translated as "new radio". The user can modify the translation result. When the electronic device detects the user's operation of clicking control 704 and modifies the corresponding translation result in output box 702, it can display the translation result that the user considers accurate in the second area. For example, the second area 302 can display "Do you know new radio?".
[0148] In this embodiment, when the user completes the translation of the content to be translated, they enter collaborative mode, and the translated content is displayed on the second area, which helps improve screen utilization. Simultaneously, this improves the efficiency of foreign language communication for the user, thus enhancing the user experience.
[0149] Figure 8 Another set of GUIs provided in the embodiments of this application is shown.
[0150] See also Figure 8 As shown in GUI (a), when the foldable electronic device is in its folded state, it displays the barcode and QR code used for payment to the merchant on the first area 301, while the second area 302 remains off. When the electronic device detects a user's click on control 801, it can display... Figure 8 The GUI shown in (b) is shown in the image.
[0151] See also Figure 8 As shown in (b) of the GUI, the electronic device can simultaneously display barcodes and QR codes on the first area 301 and the second area 302.
[0152] In this embodiment, when a user pays via barcode or QR code, the barcode or QR code can be displayed on the second area, which helps improve screen utilization. At the same time, the user does not need to flip the electronic device, making it convenient for merchants to scan and improving the user experience.
[0153] Figure 9 Another set of GUIs provided in the embodiments of this application is shown.
[0154] See also Figure 9 As shown in (a) of the GUI, when the foldable electronic device is in its folded state, the device displays a chat interface between user A and user B on the first area 301, while the second area 302 is off. User A sends the message "Where are you?" to user B, and the electronic device receives the location information sent by user B.
[0155] When the electronic device detects that the user clicks on control 901, it can display something like this. Figure 9 The GUI shown in (b) is shown in the image.
[0156] See also Figure 9 As shown in (b) of the GUI, the electronic device can display a chat interface between the user and another user on the first area 301, and open a map app to display the location information on the second area 302.
[0157] In one embodiment, the user can also navigate in the map app displayed in the second area 302, thereby chatting with another user on the chat app displayed in the first area 301, while viewing the route from the current location to the destination location on the map app displayed in the second area 302.
[0158] In this embodiment, when the electronic device is in a foldable form, by detecting the user's operation in the first area, different applications are displayed in the first and second areas, which helps to improve screen utilization and meet different user needs, thereby enhancing the user experience.
[0159] The technical solutions of this application embodiment are described below through a set of two-dimensional electronic device interfaces.
[0160] This application applies to foldable electronic devices. In the folded state, the touchscreen display of the foldable electronic device may include a main screen, a side screen, and a secondary screen. The screen resolution of the main screen may be greater than or equal to the screen resolution of the secondary screen. Figure 10 The diagram shows the main screen and secondary screen of an electronic device in an unfolded and folded state.
[0161] Figure 10 (a) shows a schematic diagram of the main screen and secondary screen of the electronic device in the unfolded state.
[0162] Figure 10 (b) shows a schematic diagram of the main screen and secondary screen of the electronic device in the folded state.
[0163] Figure 11 A schematic diagram of an electronic device displaying its main screen and secondary screen in a folded state is shown.
[0164] Figure 11 (a) shows that in the folded state, application A can be displayed on the main screen, while the secondary screen is off and not displayed.
[0165] Figure 11 (b) shows a schematic diagram of the main screen and secondary screen as seen from the unfolded angle of the electronic device in the folded state.
[0166] Application A is displayed on the main screen. At this time, the available area of the screen is the size occupied by the main screen, and the secondary screen is turned off and not displayed.
[0167] When an electronic device actively enters collaborative mode by calling the API provided by the system, or when the electronic device detects that the user clicks on a control on the interface of application A on the main screen, the electronic device enters collaborative mode in response to the click operation and displays application B on the secondary screen.
[0168] Figure 12 This diagram illustrates another electronic device with its main screen and secondary screen displayed in a folded state.
[0169] Figure 12 (a) shows a schematic diagram of the main screen and secondary screen as seen from the unfolded angle of the electronic device in its folded state. When the electronic device enters collaboration mode, application A is displayed on the main screen and application B is displayed on the secondary screen. At this time, the available area of the screen is the size of the unfolded screen. The electronic device needs to adjust the position of application A to the right side of the screen in its unfolded state, and the newly launched application B is displayed in a position on the screen other than the main screen and the side screen.
[0170] It should be understood that when the electronic device is in an unfolded or semi-folded state, the display service management module can notify the LCD module of the area that needs to be lit, and the actual display area of the touch screen is the entire touch screen.
[0171] When the electronic device is in a folded state, the display management module can notify the LCD module of the area that needs to be lit, and the LCD module will adjust the actual display area of the touch screen to the size of the main screen.
[0172] When the electronic device is in a folded state, if it detects a user tap on the main screen to enable collaborative operation between the main and secondary screens, the display management module can notify the LCD module of the area that needs to be illuminated. The LCD module then adjusts the actual display area of the touchscreen to the size of the entire touchscreen. Meanwhile, the side screen can be active but not displayed. Methods for controlling the side screen to be active but not displayed include, but are not limited to: the window management service covering the side screen with a black background. Optionally, controls (or shortcuts, etc.) can be set on the side screen, and when the electronic device detects a user tapping a control in this third area, it illuminates that third area (or the side screen).
[0173] It should also be understood that before entering collaborative mode, the available area of the electronic device's screen is screen B. After entering collaborative mode, the available screen size of the electronic device becomes the size of the entire expanded screen. At this time, the window management service can adjust the display position of screen B on the same expanded screen.
[0174] For example, before entering collaboration mode, since screen A is off and not working, the coordinates of the top left corner of screen B in the entire screen can be (0, 0); however, when the electronic device enters collaboration mode, since application A is displayed on screen A, the coordinates of the top left corner of screen B in the entire screen can be (k, 0), where k can be the width of screen A. Similarly, the x-coordinates of all points on screen B are increased by k.
[0175] Figure 12 (b) shows a schematic diagram of the displays of screens A and B as seen from the unfolded angle of the electronic device in its folded state.
[0176] When an electronic device exits collaborative mode via a system-provided API, or when the electronic device detects that the user has clicked on a control and then exits collaborative mode, application B can be removed from the secondary screen, and the secondary screen will be turned off and not displayed.
[0177] In this embodiment, the screen utilization can be improved in the folded state, more content can be displayed, additional interface content can be displayed without covering the current screen content, and the user experience can be improved.
[0178] The above, combined with Figures 3 to 12 The GUI for the collaborative operation of the first and second regions of an electronic device in a folded state is introduced. The process of measuring the included angle between the first and second regions in the embodiments of this application is described below.
[0179] In one possible implementation, a gyroscope sensor can be deployed in both the first region and the second region, and the electronic device can measure the angle between the first region and the second region using the gyroscope sensors deployed in the first region and the second region.
[0180] Figure 13 A schematic diagram of another foldable electronic device provided in an embodiment of this application is shown, such as... Figure 13 As shown, the electronic device detects that the user folds the electronic device in the direction where screens A and B face each other, where the orientations of screens A and B are z1 and z2 respectively, and the folding angle θ of the foldable electronic device is the angle between z1 and z2.
[0181] In this embodiment of the application, the orientation of z1 can be determined by a gyroscope sensor deployed on screen A, the orientation of z2 can be determined by a gyroscope sensor deployed on screen B, and finally the included angle θ between z1 and z2 can be obtained.
[0182] It should be understood that the coordinate system of the gyroscope sensor is a geographic coordinate system: with the gyroscope sensor as the origin, the direction due east is the X-axis, the direction due north is the Y-axis, and the direction perpendicular to the Earth is the Z-axis.
[0183] Figure 14 The diagram illustrates another example of a foldable electronic device provided in this application embodiment, where the coordinate systems of the gyroscope sensors on screens A and B are X1-Y1-Z1 and X2-Y2-Z2, respectively. Although the origins of the gyroscope sensors on screens A and B do not overlap, the X, Y, and Z axes of these two coordinate systems can be considered parallel, thus the coordinate systems of the gyroscope sensors on screens A and B can be considered parallel.
[0184] The folding angle θ of a foldable electronic device can be determined as follows:
[0185] Step 1: Obtain the vector data of the orientation of screen A and screen B. The orientation of screen A is represented by vector z1, and the orientation of screen B can be represented by vector z2.
[0186] For example, such as Figure 14 As shown, the data of vector z1 is (0, 0, a), and the data of vector z2 is (0, b, c).
[0187] It should be understood that the data for vectors z1 and z2 can be acquired by the gyroscope sensor.
[0188] Step 2: Calculate the angle θ between the orientations of screens A and B.
[0189] The angle between z1 and z2 is θ. Although z1 and z2 are not in the same coordinate system, since the axes of the coordinate systems containing z1 and z2 are parallel, the angle θ can be calculated using formula (1):
[0190] z1·z2=|z1|·|z2|cosθ (1)
[0191] The formula for calculating the included angle θ is formula (2):
[0192]
[0193] In one possible implementation, an accelerometer and a gravity sensor can be deployed in the first region, and an accelerometer and a gravity sensor can be deployed in the second region. The electronic device can determine whether the first region and the second region are folded back to back or face to face by the accelerometer and gravity sensor deployed in the first region and the second region, and can also measure the angle between the first region and the second region.
[0194] In this application, the electronic device can be folded either in a way that the first region and the second region are facing away from each other, or it can be folded in a way that the first region and the second region are facing away from each other, or it can be folded in a way that the first region and the second region are facing each other.
[0195] When the electronic device can be folded either in a way that is opposite to the first and second regions or in a way that is facing the first and second regions, an angle sensor can be deployed in the third region (side screen). When the user folds the device, the angle sensor can detect the folding direction of the electronic device.
[0196] In conjunction with the above embodiments and related drawings, this application provides a method for controlling screen display, which can be used in situations such as... Figure 1 , Figure 2 This is implemented in the electronic device (e.g., mobile phone, tablet, etc.) with a foldable touch display shown. Figure 15 As shown, the method may include the following steps:
[0197] S1501, the electronic device displays a first interface in the first area.
[0198] For example, such as Figure 5 As shown in (b), the electronic device displays a shooting interface (or camera interface) on region 301.
[0199] For example, such as Figure 7 As shown in (a), the electronic device displays a translation interface on region 301.
[0200] For example, such as Figure 8 As shown in (a), the electronic device displays a payment interface in area 301.
[0201] For example, such as Figure 9 As shown in (a), the electronic device displays a chat interface with user B on area 301.
[0202] S1502, on the first interface, the electronic device detects the first operation.
[0203] For example, such as Figure 5 As shown in (b), the first operation can be the electronic device detecting a user click on control 502 on the camera interface.
[0204] For example, such as Figure 7 As shown in (a), the first operation can be the electronic device detecting a user click on control 703 on the translation interface.
[0205] For example, such as Figure 8 As shown in (a), the first operation can be the electronic device detecting a user's click on control 801 on the payment interface.
[0206] For example, such as Figure 9 As shown in (a), the first operation can be the electronic device detecting a user's click on control 901 on the chat interface.
[0207] For example, the first operation can also be a long press operation, pressure press operation, or voice instruction operation detected by the electronic device on the above interface, etc.
[0208] S1503, in response to the first operation, a second interface is displayed on the second area, the second interface being associated with the content displayed on the first interface.
[0209] For example, such as Figure 5 As shown in (c), the electronic device can display a preview window 504 on the second region 302, wherein the content displayed in the preview window 504 can be the same as the image information displayed in the preview window 503 on the first region 503; or, the preview window 504 can display a portion of the image information in the preview window 503.
[0210] For example, the shooting ratio displayed in preview window 503 is 4:3; the shooting ratio displayed in preview window 504 is 4:3, or the shooting ratio displayed in preview window 504 is 3:3.
[0211] For example, such as Figure 7 As shown in (b), the electronic device can display the translation result of the content to be translated in area 301 on area 302.
[0212] For example, such as Figure 8 As shown in (b), the electronic device can display the payment code on area 301 on area 302. For example, the payment code may include a barcode and / or a QR code.
[0213] For example, such as Figure 9 As shown in (b), the electronic device can display the map display interface of the map app on the area 302, and the map display interface can display detailed location information on the area 301.
[0214] Optionally, the electronic device displays a first interface on the first area, including:
[0215] The electronic device is confirmed to be in a folded state;
[0216] In response to being in a folded state, the electronic device displays the first area in the first region and turns off the second region.
[0217] It should be understood that the process by which the electronic device detects the angle between the first region and the second region and determines that it is in a folded state can be referred to the description in the above embodiments, and will not be repeated here for the sake of brevity.
[0218] For example, such as Figure 5 As shown in (b), when the electronic device is in a folded state, the electronic device displays the camera interface in area 301, and area 302 is turned off and not displayed.
[0219] For example, such as Figure 7 As shown in (a), when the electronic device is in a folded state, the electronic device displays a translation interface in area 301 and turns off and does not display in area 302.
[0220] For example, such as Figure 8 As shown in (a), when the electronic device is in a folded state, the electronic device displays the payment interface in area 301 and turns off and does not display in area 302.
[0221] For example, such as Figure 9 As shown in (a), when the electronic device is in a folded state, the electronic device displays a chat interface in area 301 and turns off and does not display in area 302.
[0222] Optionally, after the electronic device displays the second interface on the second area, the method further includes:
[0223] On the first interface, the electronic device detects the second operation;
[0224] In response to the second operation, the electronic device turns off the second area.
[0225] For example, such as Figure 6 As shown in (a), the second operation can be an operation detected by the electronic device that involves a user clicking the control 502. After detecting the user clicking the control 502, the electronic device displays as shown in (a). Figure 6 (b) In this context, the electronic device is in the off region 302.
[0226] It is understood that, in order to achieve the above-mentioned functions, electronic devices include hardware and / or software modules that perform the respective functions. Based on the algorithmic steps of the examples described in the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of this application.
[0227] This embodiment can divide the electronic device into functional modules according to the above method example. For example, each function can be divided into its own functional modules, or two or more functions can be integrated into one processing module. The integrated modules can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.
[0228] When dividing each function into modules according to its corresponding function. Figure 16 A schematic diagram of a possible composition of the electronic device 1600 involved in the above embodiments is shown, such as... Figure 16 As shown, the electronic device 1600 may include a display unit 1601 and a detection unit 1602.
[0229] The display unit 1601 can be used to support the electronic device 1600 in performing the above steps 1501 and 1503, and / or other processes used in the technology described herein.
[0230] The detection unit 1602 can be used to support the electronic device 1600 in performing the above-described steps 1502, and / or other processes used in the techniques described herein.
[0231] It should be noted that all relevant content of each step involved in the above method embodiments can be referenced from the functional description of the corresponding functional module, and will not be repeated here.
[0232] The electronic device provided in this embodiment is used to execute the above-described method for controlling screen display, and therefore can achieve the same effect as the above-described implementation method.
[0233] When using integrated units, the electronic device may include a processing module, a storage module, and a communication module. The processing module can be used to control and manage the actions of the electronic device; for example, it can support the electronic device in executing the steps performed by the display unit 1601 and the detection unit 1603. The storage module can support the electronic device in executing stored program code and data. The communication module can support communication between the electronic device and other devices.
[0234] The processing module can be a processor or a controller. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination of functions that implement computing capabilities, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module can be a memory. The communication module can specifically be a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, or other devices that interact with other electronic devices.
[0235] In one embodiment, when the processing module is a processor and the storage module is a memory, the electronic device involved in this embodiment can be a device having... Figure 1 The device with the structure shown.
[0236] This embodiment also provides a computer storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the method for controlling the screen display in the above embodiment.
[0237] This embodiment also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the method for controlling screen display in the above embodiment.
[0238] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component, or module. The apparatus may include a connected processor and a memory; wherein the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the methods for controlling screen display in the above-described method embodiments.
[0239] In this embodiment, the electronic device, computer storage medium, computer program product or chip are all used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects of the corresponding method provided above, and will not be repeated here.
[0240] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0241] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0242] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0243] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0244] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0245] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. A method for controlling screen display, characterized in that: Applied to an electronic device equipped with a main screen and a secondary screen, the method includes: The electronic device displays a desktop on the main screen, wherein the secondary screen is in an off state, and the desktop includes an icon of a camera application; When the electronic device detects an operation on the icon of the camera application, the electronic device starts the camera application and displays a first interface on the main screen, where the first interface is a camera interface of the camera application, and the camera interface includes a first preview window and a shooting control, and the secondary screen remains in an off state; The electronic device detects a first operation on the first interface; In response to the first operation, the electronic device lights up the secondary screen and displays a second interface on the secondary screen, the second interface includes a second preview window but does not include a shooting control, the images displayed in the first preview window and the second preview window are at least partially identical, and the electronic device continues to display the first preview window and the shooting control in the first interface of the main screen when the secondary screen displays the second interface.
2. The method according to claim 1, characterized in that After the electronic device displays the second interface on the secondary screen, the method further includes: On the first interface, the electronic device detects a second operation; In response to the second operation, the electronic device turns off the secondary screen.
3. The method according to claim 1 or 2, characterized in that: The first operation is an operation of clicking a first control on the first interface.
4. The method according to claim 3, characterized in that In response to the first operation, the electronic device lights up the secondary screen and displays the second interface on the secondary screen, including: in response to the first operation, the electronic device displays reminder text and a second control, the reminder text is used to remind the user whether the main screen and the secondary screen want to display the preview window at the same time, and lights up the secondary screen and displays the second interface on the secondary screen when an operation of clicking the second control is detected.
5. The method according to claim 1 or 2, characterized in that: The first operation is a long press operation in the first preview window.
6. The method according to claim 1 or 2, characterized in that: The first operation is a pressing operation in the first preview window with a force greater than or equal to a preset value.
7. The method according to claim 1 or 2, characterized in that: The electronic device further comprises, before the main screen displays the first interface: The electronic device displays a desktop on the main screen, wherein the desktop includes an icon of a camera application; The electronic device detects a third operation, where the third operation is an operation of clicking an icon of the camera application; In response to the third operation, the electronic device starts a camera application, and the first interface is specifically a camera interface of the camera application.
8. The method according to claim 7, characterized in that The sub-screen of the electronic device is in an off state before the third operation is detected, and the sub-screen of the electronic device remains off after the camera application is started and before the first operation is detected.
9. The method according to claim 1 or 2, characterized in that: The images displayed in the first preview window and the second preview window are images captured by the same camera.
10. The method according to claim 1 or 2, characterized in that: The method also includes that the electronic device displays a reminder text on the camera interface after detecting the first operation, and the reminder text is used to remind the user that the main screen and the sub-screen display the preview window at the same time.
11. The method according to claim 1 or 2, characterized in that: The image displayed in the second preview window is a portion of the image displayed in the first preview window.
12. The method according to claim 1 or 2, characterized in that: The electronic device is a portable electronic device.
13. The method according to claim 1 or 2, characterized in that: The electronic device is a mobile phone, a tablet computer or a smart watch.
14. An electronic device, characterized in that: include: Main screen and secondary screen; one or more processors; one or more memories; The one or more memories store one or more computer programs, and the one or more computer programs include instructions, which, when executed by the one or more processors, enable the electronic device to execute the method for controlling screen display as described in any one of claims 1 to 13.
15. A computer storage medium, characterized in that The method comprises computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method for controlling screen display as claimed in any one of claims 1 to 13.
