Method for controlling screen display and electronic equipment

Abstract

The embodiment of the invention provides a method for controlling screen display and electronic equipment, the method can be applied to the electronic equipment provided with a foldable touch display screen, the touch display screen comprises a first area and a second area, and the method comprises the steps that the electronic equipment displays a first interface in the first area; on the first interface, the electronic equipment detects a first operation; in response to the first operation, the electronic equipment displays a second interface on the second area, and the second interface is associated with the content displayed by the first interface. The method for controlling screen display provided by the embodiment of the invention is beneficial to improving the utilization rate of the screen.

Description

[0001] This application is a divisional application. The application number of the original application is 202080015660.0, and the original application date is February 13, 2020. The entire contents of the original application are incorporated into this application by reference. Technical Field

[0002] The present application relates to the field of electronic devices, and more specifically, to a method for controlling screen display and an electronic device. Background Art

[0003] At present, more and more users are pursuing the visual effects of mobile phones, so the screens of mobile phones will become larger and larger. However, large-screen devices also bring certain problems, such as difficulty in carrying. Therefore, foldable electronic devices are coming out. When in use, they can be switched to the unfolded state and the folded state; when carrying, the folding screen switches to the folded state to reduce space occupation.

[0004] However, when folded, generally only the screen facing you is lit, while the screens on the back and sides are off, failing to maximize screen usage. Summary of the invention

[0005] The embodiments of the present application provide a method for controlling screen display and an electronic device, which are helpful to improve screen utilization.

[0006] In a first aspect, a method for controlling screen display is provided, which is applied to an electronic device equipped with a foldable touch display screen, the touch display screen including a first area and a second area, the method comprising: the electronic device displays a first interface in the first area; on the first interface, the electronic device detects a first operation; in response to the first operation, displays a second interface on the second area, the second interface being associated with the content displayed on the first interface.

[0007] In an embodiment of the present application, when the electronic device detects a user operation on the first area, content associated with the second area can be displayed in the second area, which helps to improve screen utilization and also improves user experience.

[0008] In some possible implementations, the electronic device may be in a folded form, in which case the electronic device displays a first interface on a first area, while the second area is off and not displayed; when the electronic device detects a first operation in the first area, the electronic device lights up the second area and displays the second interface on the second area.

[0009] In some possible implementations, the electronic device may be in an unfolded form or a semi-folded form, in which case the electronic device may display a first interface on the first area, while the second area is turned off and not displayed, or the second area displays a third interface; when the electronic device detects a first operation in the first area, the electronic device lights up the second area and displays the second interface on the second area, or the electronic device switches the third interface displayed on the second area to the second interface.

[0010] In combination with the first aspect, in some possible implementations of the first aspect, the electronic device displays the first interface in the first area, including: the electronic device determines that it is in a folded form; in response to being in the folded form, the electronic device displays the first interface in the first area, and the electronic device turns off the second area.

[0011] In an embodiment of the present application, when the electronic device is determined to be in a folded form, content can be displayed in the first area while the second area is turned off. After the user's operation is detected in the first area, the second area is lit and the second interface is displayed on the second area. This helps to improve the utilization of the screen in the folded form and can also improve the user experience.

[0012] In combination with the first aspect, in some possible implementations of the first aspect, after the electronic device displays the second interface on the second area, the method also includes: on the first interface, the electronic device detects a second operation; in response to the second operation, the electronic device turns off the second area.

[0013] In an embodiment of the present application, when the user wishes to exit the collaborative operation between the first area and the second area, the user can perform corresponding operations on the first area to exit the collaborative operation between the first area and the second area and turn off the second area, which helps save power consumption of the electronic device and also helps improve user experience.

[0014] In some possible implementations, after the electronic device displays the second interface on the second area, the method further includes: on the second interface, the electronic device detects a second operation; and in response to the second operation, the electronic device turns off the second area.

[0015] In the embodiment of the present application, after the user's operation is detected on the second interface, the first area and the second area can be exited from working together and the second area can be turned off.

[0016] In combination with the first aspect, in some possible implementations of the first aspect, the content displayed on the second interface is at least partially the same as that displayed on the first interface.

[0017] In combination with the first aspect, in some possible implementations of the first aspect, the first interface is a camera interface, the camera interface includes a first preview window, the second interface includes a second preview window, and the images displayed in the first preview window and the second preview window are at least partially identical.

[0018] The method for controlling screen display in the embodiment of the present application can be applied to shooting scenarios. When the electronic device detects the user's operation in the camera interface, the second preview window can be displayed in the second area. This can facilitate the person being photographed to adjust his or her posture in time. While improving the screen utilization rate, it can also allow the user to take satisfactory photos or videos, which helps to improve the user experience.

[0019] In combination with the first aspect, in some possible implementations of the first aspect, the first interface is a payment interface of the user, the payment interface includes a payment code, and the second interface includes the payment code.

[0020] The method for controlling screen display of the embodiment of the present application can be applied to payment scenarios. When a user pays via a barcode or a QR code, the barcode or the QR code can be displayed on the second area, which helps to improve the utilization rate of the screen. At the same time, the user does not need to flip the electronic device, which is convenient for the merchant to scan and helps to improve the user experience.

[0021] In combination with the first aspect, in some possible implementations of the first aspect, the first interface is a translation interface, the translation interface includes content to be translated, and the second interface includes a translation result of the content to be translated.

[0022] The method for controlling screen display in the embodiment of the present application can be applied to the translation scenario. When the user completes the translation of the content to be translated, the translated content can be displayed in the second area, which helps to improve the utilization rate of the screen. At the same time, this can improve the efficiency of users' communication in foreign languages ​​and help improve the user experience.

[0023] In combination with the first aspect, in some possible implementations of the first aspect, the first interface includes the translation result, and the method also includes: the electronic device detects a user's modification operation on the translation result on the first interface; in response to the modification operation, the electronic device displays the modified translation result on the second interface.

[0024] The method for controlling screen display in an embodiment of the present application can adjust the translation content in the first area and display the accurate translation result in the second area when the user determines that the translation App has translated the content inaccurately, which helps to improve the user experience.

[0025] In a second aspect, the technical solution provides a device for controlling screen display, which is included in an electronic device, and has the function of realizing the behavior of the electronic device in the above aspects and possible implementation methods of the above aspects. The functions can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules or units corresponding to the above functions. For example, a display module or unit, a detection module or unit, etc.

[0026] In a third aspect, the technical solution provides an electronic device, comprising: a foldable touch display screen; one or more processors; a memory; multiple applications; and one or more computer programs. Among them, the one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instructions are executed by the electronic device, the electronic device executes the method for controlling screen display in any possible implementation of any of the above aspects.

[0027] In a fourth aspect, the technical solution provides an electronic device, comprising one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program codes, and the computer program codes include computer instructions. When the one or more processors execute the computer instructions, the electronic device executes the method for controlling screen display in any possible implementation of any of the above aspects.

[0028] In a fifth aspect, the present technical solution provides a computer storage medium, including computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes a method for controlling screen display in any possible implementation of any of the above aspects.

[0029] In a sixth aspect, the present technical solution provides a computer program product, which, when executed on an electronic device, enables the electronic device to execute a method for controlling screen display in any possible design of any of the above aspects. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 It is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.

[0031] Figure 2 It is a schematic diagram of the software structure of an electronic device provided in an embodiment of the present application.

[0032] Figure 3 It is a schematic diagram of a foldable electronic device provided in an embodiment of the present application.

[0033] Figure 4 This is a schematic diagram of the division of the physical form of the foldable electronic device provided in an embodiment of the present application.

[0034] Figure 5 It is a schematic diagram of a group of display interfaces provided in an embodiment of the present application.

[0035] Figure 6 This is another set of display interface schematic diagrams provided in an embodiment of the present application.

[0036] Figure 7 This is another set of display interface schematic diagrams provided in an embodiment of the present application.

[0037] Figure 8 This is another set of display interface schematic diagrams provided in an embodiment of the present application.

[0038] Fig. 9 This is another set of display interface schematic diagrams provided in an embodiment of the present application.

[0039] Fig.10 It is a schematic diagram of the main screen and the sub-screen of the electronic device provided in the embodiment of the present application in the unfolded state and the folded state.

[0040] Fig.11 It is a schematic diagram of the main screen and sub-screen display of the electronic device provided in an embodiment of the present application in a folded state.

[0041] Fig.12 This is another schematic diagram of the main screen and sub-screen display of the electronic device provided in an embodiment of the present application in a folded state.

[0042] Fig.13 This is another schematic diagram of a foldable electronic device provided in an embodiment of the present application.

[0043] Fig.14 This is another schematic diagram of a foldable electronic device provided in an embodiment of the present application.

[0044] Fig.15 It is a schematic flowchart of a method for controlling screen display provided in an embodiment of the present application.

[0045] Fig.16 It is a schematic block diagram of an electronic device provided in an embodiment of the application. DETAILED DESCRIPTION

[0046] The terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind of", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one, two or more. The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0047] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear at different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0048] The following describes an electronic device with NFC function, a user interface for such an electronic device, and an embodiment for using such an electronic device. In some embodiments, the electronic device may be a portable electronic device that also includes other functions such as a personal digital assistant and / or a music player function, such as a mobile phone, a tablet computer, a wearable electronic device with wireless communication function (such as a smart watch), etc. Exemplary embodiments of portable electronic devices include but are not limited to a portable electronic device equipped with a NFC function. Or a portable electronic device with other operating systems. The portable electronic device may also be other portable electronic devices, such as a laptop computer, etc. It should also be understood that in some other embodiments, the electronic device may not be a portable electronic device, but a desktop computer.

[0049] For example, Figure 11 shows a schematic diagram of the structure of the electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195.

[0050] It is to be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0051] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural-network processing unit (neural-network processing unit, NPU), etc. Among them, different processing units may be independent components or integrated into one or more processors. In some embodiments, the electronic device 101 may also include one or more processors 110. Among them, the controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions. In some other embodiments, a memory may also be set in the processor 110 for storing instructions and data. Exemplarily, the memory in the processor 110 may be a high-speed cache memory. The memory may store instructions or data that the processor 110 has just used or circulated. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the electronic device 101 in processing data or executing instructions.

[0052] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM card interface, and / or a USB interface, etc. Among them, the USB interface 130 is an interface that complies with the USB standard specification, and can specifically be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 130 can be used to connect a charger to charge the electronic device 101, and can also be used to transmit data between the electronic device 101 and a peripheral device. The USB interface 130 can also be used to connect headphones to play audio through the headphones.

[0053] It is understandable that the interface connection relationship between the modules illustrated in the embodiment of the present application is only a schematic illustration and does not constitute a structural limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0054] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0055] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0056] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0057] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0058] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0059] The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 150 or other functional modules.

[0060] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0061] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0062] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or more display screens 194.

[0063] In some embodiments of the present application, when the display panel is made of materials such as OLED, AMOLED, FLED, etc., the above Figure 1 The display screen 194 in the embodiment can be bent. Here, the display screen 194 can be bent means that the display screen can be bent to any angle at any position and can be maintained at the angle. For example, the display screen 194 can be folded in half from the middle to the left and right. It can also be folded in half from the middle to the top and bottom. In this application, a display screen that can be bent is referred to as a foldable display screen. The foldable display screen can be a single screen or a display screen composed of multiple screens pieced together, which is not limited here.

[0064] The display screen 194 of the electronic device 100 can be a flexible screen. At present, the flexible screen has attracted much attention for its unique characteristics and huge potential. Compared with traditional screens, flexible screens have the characteristics of strong flexibility and bendability, which can provide users with a new interaction method based on bendable characteristics, and can meet users' more needs for electronic devices. For electronic devices equipped with a foldable display screen, the foldable display screen on the electronic device can be switched between a small screen in a folded form and a large screen in an unfolded form at any time. Therefore, users use the split-screen function on electronic devices equipped with a foldable display screen more and more frequently.

[0065] Since the display screen 194 can be folded, the physical form of the electronic device can also change accordingly; for example, when the display screen is fully unfolded, the physical form of the electronic device can be referred to as an unfolded form, and when a portion of the touch display screen is folded, the physical form of the electronic device can be referred to as a folded form. It can be understood that in the following embodiments of the present application, the physical form of the electronic device can refer to the physical form of the touch display screen.

[0066] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0067] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0068] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0069] The digital signal processor is used to process digital signals, and can process not only digital image signals but also other digital signals. For example, when the electronic device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0070] Video codecs are used to compress or decompress digital videos. The electronic device 100 may support one or more video codecs. Thus, the electronic device 100 may play or record videos in a variety of coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0071] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0072] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0073] The internal memory 121 can be used to store one or more computer programs, which include instructions. The processor 110 can execute the above instructions stored in the internal memory 121, so that the electronic device 101 performs the screen-off display method provided in some embodiments of the present application, as well as various applications and data processing. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system; the program storage area can also store one or more applications (such as a gallery, contacts, etc.). The data storage area can store data (such as photos, contacts, etc.) created during the use of the electronic device 101. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage components, flash memory components, universal flash storage (UFS), etc. In some embodiments, the processor 110 can execute the screen-off display method provided in the embodiment of the present application, as well as other applications and data processing by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor 110.

[0074] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0075] The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.

[0076] Among them, the pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0077] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

[0078] In the embodiment of the present application, the gyroscope sensor 180B on each screen can also be used to determine the angle between the display screens after the electronic device is folded.

[0079] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover can be automatically unlocked.

[0080] The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device and is applied to applications such as horizontal and vertical screen switching and pedometers.

[0081] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0082] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0083] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0084] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0085] The touch sensor 180K is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194.

[0086] It should be understood that the above only shows some sensors in the electronic device 100 and their functions, and the electronic device may include more or fewer sensors. Exemplarily, the electronic device 100 may also include a gravity sensor. In the embodiment of the present application, for a foldable electronic device, it may include a first area and a second area at a certain angle in the folded state, and the electronic device may determine the folding direction of the electronic device and the angle between the first area and the second area after folding through an acceleration sensor and a gravity sensor.

[0087] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0088] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0089] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device 100.

[0090] Figure 2 1 is a software structure diagram of the electronic device 100 of the embodiment of the present application. The layered architecture divides the software into several layers, each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom, namely, the application layer, the application framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer. The application layer can include a series of application packages.

[0091] like Figure 2 As shown, the application package may include camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0092] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0093] like Figure 2 As shown, the application framework layer may include a display management service (display manager service), an activity management service (activity manager service) and a window management service (window manager service) and the like.

[0094] For a foldable electronic device, when the user folds the touch screen of the electronic device (assuming it can be folded once), the screen can be divided into screen A and screen B. Assume that the electronic device controls screen A to light up and continue to work, while screen B is turned off and does not work. When the user holds the electronic device, screen A can be lit, and the user can perform corresponding operations on screen A; screen B is turned off, so the user can not perform any operations on screen B.

[0095] The display management service is used to adjust the actual display area of ​​the screen to the size of screen A and screen B when the electronic device detects that the user triggers screen A and screen B to enter a collaborative working mode, so that other application interfaces can be displayed on screen B.

[0096] The activity management service is used to start the application interface on screen B when screen A and screen B enter collaborative working mode.

[0097] The window management service is used to adjust the display positions of the application interfaces on screens A and B on the same expanded screen when screens A and B enter a collaborative working mode.

[0098] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0099] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0100] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0101] The system library may include multiple functional modules, such as surface manager, media libraries, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0102] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0103] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0104] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0105] A 2D graphics engine is a drawing engine for 2D drawings.

[0106] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0107] In the embodiment of the present application, the physical components involved in the electronic device 100 mainly include hardware components such as sensors, decision support systems (DSS), display chips, touch screens, and application framework layer functions such as display management services, activity management services, and window management services.

[0108] The following is an illustrative description of the workflow of the software and hardware of the electronic device 100 in conjunction with the method for controlling screen display in an embodiment of the present application.

[0109] The method for controlling screen display provided in the embodiment of the present application is mainly implemented by the mutual cooperation between the touch panel (TP) module and the above-mentioned one or more physical components and each layer of the software architecture layer of the electronic device 100.

[0110] In an embodiment of the present application, a foldable electronic device may include a main screen, a side screen and a secondary screen, wherein the main screen and the secondary screen may be folded with the side screen as an axis. When the electronic device is in a folded state, and the folded state may be that the main screen and the secondary screen are folded in opposite directions, if the electronic device is in a non-locked screen state, the electronic device controls the main screen to light up, and controls the secondary screen to turn off and not display.

[0111] Exemplarily, the total resolution of the foldable electronic device can be 2480*2200. The electronic device can be divided into a main screen and a secondary screen in the folded form. The resolution of the main screen can be 2480*1144 (19.5:9), the resolution of the secondary screen can be 2480*892 (25:9), and the resolution of the side screen can be 2480*160.

[0112] When the electronic device is in the unfolded state, the display management service can notify the LCD module of the area that currently needs to be lit (for example, 2480*2200), and the LCD module controls the lighting of the entire touch display screen.

[0113] When the electronic device is in a folded form, the display management service can notify the LCD module of the area that currently needs to be lit (for example, 2480*1144), and the LCD module controls the lighting of the main screen; while the secondary screen is turned off and does not work.

[0114] In an embodiment of the present application, when the electronic device is in a folded form, the TP module can receive a user's click operation on the main screen, and pass the user's click operation to the display management service of the application framework layer. The display management service can notify the LCD module of the area that needs to be lit, and the LCD module adjusts the actual display area of ​​the touch screen to the size of the entire touch screen, so that the application interface can also be displayed on the secondary screen. The activity management service starts the application interface on the secondary screen. The window management service adjusts the display position of the application interface on the main screen and the secondary screen on the same unfolded touch display screen. This allows the main screen and the secondary screen to enter a collaborative working mode.

[0115] For ease of understanding, the following embodiments of the present application will be described in detail with Figure 1 and Figure 2 Taking the electronic device with the shown structure as an example, the method for controlling screen display provided in the embodiment of the present application is specifically explained in combination with the accompanying drawings and application scenarios.

[0116] As introduced in the background technology, the touch screens of electronic devices are getting bigger and bigger. In order to give full play to the application value of touch screens, different screen display technologies have been developed accordingly. For example, when the touch screen is in the unfolded form, the user can process multiple applications on the same touch screen at the same time. In addition, in order to improve the portability of large-screen mobile phones, flexible screens have begun to be widely used in electronic devices. Compared with traditional screens, flexible screens have the characteristics of strong flexibility and bendability, which can provide users with new interaction methods based on bendable characteristics, and can meet users' more needs for electronic devices. For electronic devices equipped with touch screens, the touch screen on the electronic device can be switched between a small screen in a folded form and a large screen in an unfolded form at any time. Therefore, users use the split-screen function on electronic devices equipped with touch screens more and more frequently.

[0117] Figure 3 is a schematic diagram of an example of a foldable electronic device provided by the present application, Figure 4 FIG. 1 is a schematic diagram of the physical form of a foldable electronic device provided in an embodiment of the present application. Figure 3 and Figure 4 A touch display screen of the electronic device is introduced.

[0118] In one embodiment of the present application, the display area of ​​the touch display screen 300 in the folded state can be divided into three areas, namely a first area 301, a second area 302 and a third area 303. For example, Figure 3 Figures (a), (b), (c) and (d) in the figure show at least three physical forms that the touch screen 300 of the electronic device can include: a folded form, a semi-folded form folded at a certain angle, and an unfolded form. As shown in Figure (a), the middle bending part of the touch screen 300 shown by the dotted line boundary is the aforementioned third area 303. With the third area 303 (or, it can also be called the folding side screen) as the axis, the touch screen 300 can be divided into a first area 301 (for example, Figure 3 the area to the right of the middle area 303) and the second area 302 (e.g., Figure 3 the area to the left of the middle area 303).

[0119] When the touch display screen 300 of the electronic device 100 is in a folded state, Figure 3 As shown in Figure (d) in the figure. Specifically, Figure 3 In the folded state in FIG. (d), the angle between the first region 301 and the second region 302 can be a first angle α, wherein 0°≤α≤a1, a1 is less than or equal to 90 degrees and greater than or equal to 0 degrees, for example, a1 can be 25 degrees.

[0120] When the touch display screen 300 of the electronic device 100 is in a semi-folded state folded at a certain angle, the touch display screen 300 can be Figure 3 As shown in Figure (c) in the figure. Specifically, Figure 3 In the half-folded state in (c) of FIG. 1 , the angle between the first region 301 and the second region 302 is a second angle β, wherein a1≤β≤a4, a1 is less than or equal to 90 degrees and greater than or equal to 0 degrees, and a4 is greater than or equal to 90 degrees and less than 180 degrees. For example, a1 can be 25 degrees, and a4 can be 155 degrees. In addition, corresponding to Figure 4In the division of the physical form of the foldable electronic device, the semi-folded form of the touch display screen 300 can also include an unstable support state and a stable support state. Wherein, in the stable support state, the angle between the first area 301 and the second area 302 is a second angle β, and the range of the second angle β is a2≤β≤a3, a2 is less than or equal to 90 degrees, and a3 is greater than or equal to 90 degrees and less than 180 degrees. In the semi-folded form of the electronic device 100, the form other than the stable support state is the unstable support state of the electronic device 100. It should be understood that the division of the physical form of the touch display screen 300 and the definition of each physical form in this application are not limited.

[0121] When the touch screen display 300 of the electronic device is in the unfolded state, Figure 3 Specifically, when the touch display screen 300 is unfolded, the angle between the first area 301 and the second area 302 is a third angle ε, where a4≤ε≤180 degrees, a4 is greater than or equal to 90 degrees and less than 180 degrees, for example, a4 can be 90 degrees. For example, Figure 3 Figure (a) shows the state when the third angle ε is 180 degrees. Figure 3 Figure (b) shows the state when the third angle ε is greater than a4 and less than 180 degrees.

[0122] It should be understood that the above only gives an example of dividing an electronic device into an unfolded state, a semi-folded state, and a folded state. For example, when the electronic device is in an unfolded state and a semi-folded state, the entire touch screen of the electronic device is in a lighted working state; when the electronic device is in a folded state, the display management service can notify the LCD module to light up only the main screen. The embodiment of the present application does not limit the way in which the electronic device determines that it is in a folded state, and it can also be determined that the electronic device is in a folded state by other means.

[0123] It should be understood that the bending portion can also be distributed horizontally in Figure (a), and the foldable display screen can be folded up and down, that is, the first area 301 and the second area 302 of the touch display screen can correspond to the upper and lower ends of the middle bending portion. This application will be introduced by taking the first area 301 and the second area 302 distributed left and right as shown in Figure (a) as an example. The method for controlling the screen display provided in this application is also applicable to the up and down folding method, and this application does not limit this.

[0124] The physical form of the electronic device 100 is introduced above. For different physical forms, or for different types of applications running on the electronic device, the user may want the foldable display screen 300 to have different display modes. The display mode here can be understood as a display method of the foldable display screen 300, such as full screen display, the first area 301 displays while the second area 302 is off, the second area 302 displays while the first area 301 is off, or the first area 301 and the second area 302 simultaneously display different interfaces, and other display modes.

[0125] Figure 5 A schematic diagram of a group of graphical user interfaces (GUIs) provided in an embodiment of the present application is shown.

[0126] See Figure 5 As shown in (a) of FIG. 1 , when the foldable electronic device is in the folded state, the first area 301 can display the desktop of the electronic device, while the second area 302 is off and does not display. When the electronic device detects that the user clicks the camera icon 501 on the first area 301, the display is as shown in FIG. Figure 5 GUI shown in (b) in .

[0127] See also Figure 5 As shown in (b) of FIG. 1 , when the mobile phone detects that the user clicks the icon 302 of the camera application (application, APP) on the desktop, the camera application can be started and the following display can be displayed: Figure 5 The GUI displayed in the first area 301 shown in (b) of FIG. 1 can be called a shooting interface (or a camera interface). The shooting interface can include a preview window 503. In the preview state, the preview window 503 can display the image captured by the camera in real time. The electronic device displays the shooting interface in the first area 301, while the second area 302 is turned off and not displayed. When the electronic device detects that the user clicks the control 502 in the first area 301, the following is displayed: Figure 5 GUI shown in (c) in FIG.

[0128] See also Figure 5 As shown in (c), the electronic device displays a shooting interface in the first area 301, displays a preview window 504 in the second area 302, and can also display the image captured by the preview camera in real time in the preview window 504. In this way, it is convenient for the person being photographed to adjust his or her posture in real time according to the image in the preview window 504 in the second area 302.

[0129] Exemplarily, the electronic device may also detect a long press operation by the user in the preview window 503 on the shooting interface and then display a preview window 504 in the second area 302 .

[0130] Exemplarily, after the electronic device detects a pressure pressing operation (the pressing force is greater than or equal to a preset value) performed by the user in the preview window 503 on the shooting interface, the preview window 504 is displayed in the second area 302 .

[0131] Exemplarily, after the electronic device displays the shooting interface, if the electronic device detects a user voice instruction, a preview window 504 is displayed in the second area 302 .

[0132] In one embodiment of the present application, when the electronic device detects that a user clicks on a control 502 on a shooting interface (or a camera interface), the electronic device can remind the user through text on the shooting interface that "the preview window is displayed on both the main screen and the secondary screen at the same time", light up the second area 302, and display a preview window 504 on the second area 302.

[0133] In another embodiment of the present application, see Figure 5 As shown in (d) in FIG. 1 , when the electronic device detects that the user clicks the control 502 on the shooting interface (or the camera interface), the electronic device can remind the user through text on the shooting interface “Do you want the main screen and the secondary screen to display the preview window at the same time?” and display the control 505 and the control 506. When the electronic device detects that the user clicks the control 505, the electronic device lights up the second area 302 and displays the preview window 504 on the second area 302.

[0134] In the embodiment of the present application, when the electronic device enters the collaborative mode when taking photos, the photo preview window can be displayed on multiple screens, which helps to improve the utilization rate of the screen. At the same time, this can facilitate the subject to adjust the shooting posture in time, which helps to improve the user experience.

[0135] In another embodiment of the present application, Figure 5 As shown in (b) of FIG. 1 , when the electronic device detects that the user clicks the "record" control in the shooting interface (or camera interface), the video shooting interface can be entered, and the video shooting interface can include a preview window and shooting controls; at this time, the second area 302 is turned off and not displayed. After the electronic device detects that the user clicks the control 502, the video shooting interface can be displayed in the first area, and the preview window of the video shooting interface can be displayed in the second area.

[0136] In another embodiment of the present application, when the electronic device is in a folded state, the electronic device can light up the first area 301 and display the desktop of the electronic device on the first area 301, while the second area 302 is turned off and not displayed. When the electronic device detects that the user clicks the camera icon 501 on the first area 301, the shooting interface can be directly displayed in the first area 301, and the preview window can be displayed on the second area 302.

[0137] In an embodiment of the present application, when the electronic device enters the camera application in the folded form, the shooting interface can be displayed in the first area and the preview window can be displayed in the second area at the same time, which helps to improve the utilization of the screen and does not require manual operation by the user, thereby helping to improve the user experience.

[0138] In another embodiment of the present application, when the electronic device is in a folded state, the electronic device displays a camera interface on the first area 301, while the second area 302 is off and does not display. When the electronic device detects that the user clicks the control 502 on the first area 301, the camera interface can be displayed on the first area and a cartoon can be played on the second area. In this way, when taking pictures of children, the attention of the children can be attracted, so that photos or videos that satisfy the user can be taken.

[0139] Combination of the above Figure 5 A set of GUIs in the embodiment of the present application is introduced, which mainly shows the process of a user entering the first area 301 and the second area 300 working together by clicking a control. Figure 6 Another set of GUIs shown introduces the process of the electronic device exiting the cooperative operation between the first area 301 and the second area 302 .

[0140] See also Figure 6 In the GUI shown in (a) of FIG. 1 , after the user has finished shooting, the user can click the control 502 on the first area 301. When the electronic device detects that the user has clicked the control 402, the following is displayed: Figure 6 GUI shown in (b) in .

[0141] join Figure 6 In the GUI shown in (b), the electronic device displays a shooting interface in the first area 301, while the second area 302 is turned off and not displayed.

[0142] Figure 7 A set of GUIs in another scenario provided by an embodiment of the present application is shown.

[0143] See also Figure 7In the GUI shown in (a), when the foldable electronic device is in the folded state, the translation interface of a translation app is displayed in the first area 301, and the user can enter the Chinese to be translated in the input box 701 of the first area 301. For example, the user enters "Excuse me, how can I get to hotel A?" in the input box 701. When the mobile phone detects that the user clicks the "Translate" control, the corresponding English translation (for example, "Excuse me, how can I get to hotel A?") can be displayed in the output box 702. At this time, the second area 302 is turned off and not displayed.

[0144] When the electronic device detects that the user clicks the control 703, the following is displayed: Figure 7 GUI shown in (b) in .

[0145] See also Figure 7 In the GUI shown in (b), the translation interface continues to be displayed in the first area 301, while the corresponding English translation can be displayed in the second area 302.

[0146] In another embodiment of the present application, the translation interface of the translation App may further include a control 704 . When the user sees that the translation result is inaccurate, the user may click the control 704 and then modify the translation result in the output box 703 .

[0147] For example, Figure 7 As shown in (c) in FIG. 7 , when the electronic device detects that the user enters “Do you know the new wireless technology?” in the input box 701 and detects that the user clicks the “Translate” control, the corresponding English translation can be displayed in the output box 702 (for example, the translation result of the translation app is “Do you know the new wireless technology”). Since “new wireless technology” is a professional term in the fifth generation mobile communication technology (5G), it should be translated as “new radio”.

[0148] The user can modify the translation result. When the electronic device detects the user clicking the control 704 and modifies the corresponding translation result in the output box 702, the translation result that the user considers accurate can be displayed in the second area. For example, the second area 302 can display “Do you know new radio?”.

[0149] In the embodiment of the present application, when the user completes the translation of the content to be translated, the collaborative mode is entered, and the translated content can be displayed in the second area, which helps to improve the utilization rate of the screen. At the same time, this can improve the efficiency of the user's communication in foreign languages ​​and help improve the user experience.

[0150] Figure 8 Another set of GUIs provided by an embodiment of the present application is shown.

[0151] See also Figure 8 In the GUI shown in (a) of FIG. 1 , when the foldable electronic device is in the folded state, the electronic device displays the barcode and QR code for paying the merchant on the first area 301, and the second area 302 is turned off and does not display. When the electronic device detects that the user clicks the control 801, it can display the following Figure 8 GUI shown in (b) in .

[0152] See also Figure 8 In the GUI shown in (b), the electronic device can display a barcode and a QR code on the first area 301 and the second area 302 at the same time.

[0153] In an embodiment of the present application, when a user pays by barcode or QR code, the barcode or QR code can be displayed on the second area, which helps to improve the utilization rate of the screen. At the same time, the user does not need to flip the electronic device, which is convenient for the merchant to scan and helps to improve the user experience.

[0154] Fig. 9 Another set of GUIs provided by an embodiment of the present application is shown.

[0155] See also Fig. 9 In the GUI shown in (a), when the foldable electronic device is in the folded state, the electronic device displays the chat interface of user A and user B on the first area 301, and the second area 302 is turned off and not displayed. User A sends a message "Where are you?" to user B, and the electronic device receives the location information sent by user B.

[0156] When the electronic device detects that the user clicks the control 901, it can display the following Fig. 9 GUI shown in (b) in .

[0157] See also Fig. 9 In the GUI shown in (b), the electronic device can display a chat interface between a user and another user in the first area 301, and open a map app in the second area 302 to display the location information.

[0158] In one embodiment, the user can also navigate in the map app displayed in the second area 302, so that he can chat with another user on the chat app displayed in the first area 301, and view the route from the current location to the destination location on the map app displayed in the second area 302.

[0159] In an embodiment of the present application, when the electronic device is in a foldable form, by detecting the user's operation in the first area, different applications are displayed in the first area and the second area, which helps to improve the utilization of the screen, while meeting the different needs of users and helping to improve the user experience.

[0160] The technical solution of the embodiment of the present application is introduced below through a set of two-dimensional electronic device interfaces.

[0161] The embodiments of the present application are applicable to a foldable electronic device, wherein the foldable electronic device, when in a folded state, may include a main screen, a side screen, and a secondary screen, and the screen resolution of the main screen may be greater than or equal to the screen resolution of the secondary screen. Fig.10 A schematic diagram of a main screen and a secondary screen of an electronic device in an unfolded state and a folded state is shown.

[0162] Fig.10 (a) shows a schematic diagram of the main screen and the secondary screen of the electronic device in the unfolded state.

[0163] Fig.10 (b) shows a schematic diagram of the main screen and the secondary screen of the electronic device in a folded state.

[0164] Fig.11 A schematic diagram showing the main screen and secondary screen display of an electronic device in a folded state is shown.

[0165] Fig.11 (a) in the figure shows that in the folded state, application A can be displayed on the main screen; while the secondary screen is turned off and not displayed.

[0166] Fig.11 (b) shows a schematic diagram of the display of the main screen and the sub-screen when the electronic device is in a folded state, as seen from the unfolded angle.

[0167] Application A is displayed on the main screen. At this time, the available area of ​​the screen is the size occupied by the main screen, and the secondary screen is turned off and not displayed.

[0168] When an electronic device actively enters collaborative mode by calling an API provided by the system, or when an electronic device detects that a user clicks on a control on the interface of application A on the main screen, in response to the click operation, the electronic device enters collaborative mode and displays application B on the secondary screen.

[0169] Fig.12 A schematic diagram showing the main screen and secondary screen display of another electronic device in a folded state is shown.

[0170] Fig.12(a) in the figure shows a schematic diagram of the display of the main screen and the secondary screen from the unfolded angle of the electronic device in the folded state. When the electronic device enters the collaborative mode, application A is displayed on the main screen and application B is displayed on the secondary screen. At this time, the available area of ​​the screen is the size of the unfolded screen. The electronic device needs to adjust the position of application A to the right side of the screen in the unfolded state, and the newly launched application B is displayed on the screen other than the main screen and the side screen.

[0171] It should be understood that when the electronic device is in an unfolded state or a semi-folded state, the display service management module can notify the LCD module of the area that needs to be illuminated, and the actual display area of ​​the touch display screen is the entire touch display screen.

[0172] When the electronic device is in a folded state, the display management module can notify the LCD module of the area that needs to be illuminated, and the LCD module adjusts the actual display area of ​​the touch screen to the size of the main screen.

[0173] When the electronic device is in a folded form, when the electronic device detects on the main screen that the user clicks on the main screen and the secondary screen works together, the display management module can notify the LCD module of the area that needs to be lit, and the LCD module adjusts the actual display area of ​​the touch screen to the size of the entire touch screen. At this time, the side screen may be working but not displayed. The method for the electronic device to control the side screen to work but not display includes but is not limited to: the window management service covers the side screen with a black background. Optionally, controls (or shortcuts, etc.) can also be set on the side screen, and when the electronic device detects that the user clicks on the control in the third area, the third area (or side screen) is lit.

[0174] It should also be understood that before entering the collaborative mode, the available area of ​​the screen of the electronic device is screen B, and when entering the collaborative mode, the available screen size of the electronic device is the size of the entire screen after expansion. At this time, the window management service can adjust the display position of screen B on the same expanded screen.

[0175] For example, before entering the collaborative mode, since screen A is off and not working, the coordinates of the upper left corner of screen B in the entire screen may be (0, 0); and after the electronic device enters the collaborative mode, since application A is displayed on screen A, the coordinates of the upper left corner of screen B in the entire screen may be (k, 0), where k may be the width of screen A. Similarly, the horizontal coordinates of all points on screen B increase by k.

[0176] Fig.12 (b) shows a schematic diagram of the display of screen A and screen B seen from the unfolded angle of the electronic device in the folded state.

[0177] When the electronic device exits the collaborative mode through the API provided by the system, or when the electronic device detects that the user clicks on a certain control to exit the collaborative mode, application B can be removed from the secondary screen and the secondary screen is turned off.

[0178] In the embodiment of the present application, the utilization rate of the screen can be improved in the folded state to display more content. Additional interface content can be displayed without covering the current screen content, which helps to improve the user experience.

[0179] Above, combined Figures 3 to 12 A GUI in which a first area and a second area of ​​an electronic device work together in a folded state is introduced. The following describes a process of measuring the angle between the first area and the second area in an embodiment of the present application.

[0180] In a possible implementation, a gyroscope sensor may be deployed in the first area and the second area respectively, and the electronic device may measure the angle between the first area and the second area through the gyroscope sensors deployed in the first area and the second area.

[0181] Fig.13 A schematic diagram of another foldable electronic device provided by an embodiment of the present application is shown. Fig.13 As shown, the electronic device detects that the user folds the electronic device in a direction where screen A and screen B face each other, wherein the orientations of screen A and screen B are z1 and z2 respectively, and the folding angle θ of the foldable electronic device is the angle between z1 and z2.

[0182] In the embodiment of the present application, the direction of z1 can be determined by a gyroscope sensor deployed on screen A, and the direction of z2 can be determined by a gyroscope sensor deployed on screen B, and finally the angle θ between z1 and z2 can be obtained.

[0183] It should be understood that the coordinate system of the gyro sensor is a geographic coordinate system: the gyro sensor is taken as the origin, the east direction is the X-axis direction, the north direction is the Y-axis direction, and the opposite direction of the earth's vertical line is the Z-axis direction.

[0184] Fig.14 A schematic diagram of another foldable electronic device provided by an embodiment of the present application is shown, and the coordinate systems of the gyro sensors of screen A and screen B are X1-Y1-Z1 and X2-Y2-Z2 respectively. Although the origins of the gyro sensors in screen A and screen B do not overlap, the X, Y, and Z axes of the two coordinate systems can be considered to be parallel, so that the gyro coordinate systems in screen A and screen B can be considered to be parallel.

[0185] The angle θ of the foldable electronic device can be determined as:

[0186] Step 1: Obtain vector data of the orientation of screen A and screen B, wherein the orientation of screen A is represented by vector z1, and the orientation of screen B can be represented by vector z2.

[0187] For example, Fig.14 As shown, the data of vector z1 is (0, 0, a), and the data of vector z2 is (0, b, c).

[0188] It should be understood that the data of the vector z1 and the vector z2 can be acquired by the gyro sensor.

[0189] Step 2: Calculate the angle θ between the orientations of screen A and screen B.

[0190] The angle formed by z1 and z2 is θ. Although z1 and z2 are not in the same coordinate system, because the axes of the coordinate systems of z1 and z2 are parallel, the angle θ can be calculated using formula (1):

[0191] z1·z2=|z1|·|z2|cosθ (1)

[0192] Then the calculation formula of the angle θ is formula (2):

[0193]

[0194] In one possible implementation, an acceleration sensor and a gravity sensor can be deployed in the first area, and an acceleration sensor and a gravity sensor can be deployed in the second area. The electronic device can determine whether the first area and the second area are folded back to back or facing each other through the acceleration sensor and gravity sensor deployed in the first area and the second area, and can also measure the angle between the first area and the second area.

[0195] In the present application, the electronic device can be folded only in a direction in which the first area and the second area are opposite to each other, or can be folded in a direction in which the first area and the second area are opposite to each other, or can be folded in a direction in which the first area and the second area are facing each other.

[0196] When the electronic device can be folded in a direction where the first area and the second area are opposite to each other, or can be folded in a direction where the first area and the second area are facing each other, an angle sensor can be deployed in the third area (side screen). When the user folds it, the angle sensor can detect the folding direction of the electronic device.

[0197] In combination with the above embodiments and related drawings, the present application embodiment provides a method for controlling screen display. The method can be used in Figure 1 , Figure 2The electronic device (such as a mobile phone, tablet computer, etc.) with a foldable touch display screen is implemented as shown. Fig.15 As shown, the method may include the following steps:

[0198] S1501, the electronic device displays a first interface in the first area.

[0199] For example, Figure 5 As shown in (b) , the electronic device displays a shooting interface (or a camera interface) on area 301 .

[0200] For example, Figure 7 As shown in (a) in FIG. 8 , the electronic device displays a translation interface in area 301 .

[0201] For example, Figure 8 As shown in (a) in FIG. 8 , the electronic device displays a payment interface in area 301 .

[0202] For example, Fig. 9 As shown in (a) in FIG. 8 , the electronic device displays a chat interface with user B in area 301 .

[0203] S1502: On the first interface, the electronic device detects a first operation.

[0204] For example, Figure 5 As shown in (b), the first operation may be that the electronic device detects that a user clicks on a control 502 on the camera interface.

[0205] For example, Figure 7 As shown in (a), the first operation may be that the electronic device detects that a user clicks on a control 703 on the translation interface.

[0206] For example, Figure 8 As shown in (a), the first operation may be that the electronic device detects that a user clicks on a control 801 on the payment interface.

[0207] For example, Fig. 9 As shown in (a), the first operation may be that the electronic device detects that a user clicks on the control 901 on the chat interface.

[0208] Exemplarily, the first operation may also be a long press operation, a pressure press operation, a voice instruction operation, etc. detected by the electronic device on the above interface.

[0209] S1503: In response to the first operation, display a second interface on the second area, where the second interface is associated with the content displayed on the first interface.

[0210] For example, Figure 5 As shown in (c) in the figure, the electronic device can display a preview window 504 on the second area 302, wherein the content displayed in the preview window 504 can be the same as the image information displayed in the preview window 503 on the first area 503; or, a portion of the image information in the preview window 503 can be displayed in the preview window 504.

[0211] Exemplarily, the shooting ratio displayed in the preview window 503 is 4:3; the shooting ratio displayed in the preview window 504 is 4:3, or the shooting ratio displayed in the preview window 504 is 3:3.

[0212] For example, Figure 7 As shown in (b) in FIG. 3 , the electronic device may display the translation result of the content to be translated in area 301 in area 302 .

[0213] For example, Figure 8 As shown in (b) in FIG. 3 , the electronic device may display the payment code in area 301 in area 302. Exemplarily, the payment code may include a barcode and / or a QR code.

[0214] For example, Fig. 9 As shown in (b) in FIG. 3 , the electronic device may display a map display interface of a map app in the area 302 , and the map display interface may display detailed location information in the area 301 .

[0215] Optionally, the electronic device displays a first interface on the first area, including:

[0216] The electronic device is determined to be in a folded configuration;

[0217] In response to being in the folded state, the electronic device displays the first area in the first area, and turns off the second area.

[0218] It should be understood that the process of the electronic device detecting the angle between the first area and the second area and determining that it is in a folded state can refer to the description in the above embodiment, and for the sake of brevity, it will not be repeated here.

[0219] For example, Figure 5 As shown in (b) in FIG. 1 , when the electronic device is in a folded state, the electronic device displays a camera interface in area 301 and area 302 is off and does not display.

[0220] For example, Figure 7 As shown in (a) in FIG. 1 , when the electronic device is in a folded state, the electronic device displays a translation interface in area 301 and area 302 is off.

[0221] For example, Figure 8 As shown in (a) in the figure, when the electronic device is in a folded state, the electronic device displays a payment interface in area 301 and area 302 is turned off and not displayed.

[0222] For example, Fig. 9 As shown in (a), when the electronic device is in a folded form, the electronic device displays a chat interface in area 301 and area 302 is off.

[0223] Optionally, after the electronic device displays the second interface on the second area, the method further includes:

[0224] On the first interface, the electronic device detects a second operation;

[0225] In response to the second operation, the electronic device turns off the second area.

[0226] For example, Figure 6 As shown in (a) of FIG. 1 , the second operation may be an operation detected by the electronic device where the user clicks the control 502. After the electronic device detects the operation where the user clicks the control 502, the following is displayed: Figure 6 In (b), the electronic device turns off area 302.

[0227] It is understandable that, in order to realize the above functions, the electronic device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to be beyond the scope of the present application.

[0228] In this embodiment, the electronic device can be divided into functional modules according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0229] In the case of dividing each functional module into corresponding functional modules, Fig.16 A possible schematic diagram of the composition of the electronic device 1600 involved in the above embodiment is shown. Fig.16 As shown, the electronic device 1600 may include: a display unit 1601 and a detection unit 1602 .

[0230] The display unit 1601 may be used to support the electronic device 1600 in executing the above-mentioned steps 1501 and 1503, etc., and / or other processes of the technology described herein.

[0231] The detection unit 1602 may be used to support the electronic device 1600 in executing the above-mentioned step 1502 and / or other processes for the technology described herein.

[0232] It should be noted that all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0233] The electronic device provided in this embodiment is used to execute the above-mentioned method for controlling screen display, and thus can achieve the same effect as the above-mentioned implementation method.

[0234] In the case of an integrated unit, the electronic device may include a processing module, a storage module and a communication module. The processing module may be used to control and manage the actions of the electronic device, for example, it may be used to support the electronic device to execute the steps performed by the display unit 1601 and the detection unit 1603. The storage module may be used to support the electronic device to execute stored program codes and data, etc. The communication module may be used to support the communication between the electronic device and other devices.

[0235] Among them, the processing module can be a processor or a controller. It can implement or execute various exemplary logic boxes, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module can be a memory. The communication module can specifically be a device that interacts with other electronic devices, such as a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, etc.

[0236] In one embodiment, when the processing module is a processor and the storage module is a memory, the electronic device involved in this embodiment may be a Figure 1 Device of the structure shown.

[0237] This embodiment also provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the method for controlling screen display in the above-mentioned embodiment.

[0238] This embodiment also provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the method for controlling screen display in the above-mentioned embodiment.

[0239] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer execution instructions, and when the device is running, the processor can execute the computer execution instructions stored in the memory so that the chip executes the method of controlling screen display in the above-mentioned method embodiments.

[0240] Among them, the electronic device, computer storage medium, computer program product or chip provided in this embodiment is used to execute the corresponding method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding method provided above and will not be repeated here.

[0241] Through the description of the above implementation methods, technical personnel in the relevant field can understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0242] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0243] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0244] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0245] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program code.

[0246] The above contents are only specific implementation methods of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A method for controlling screen display, characterized in that: Applied to an electronic device equipped with a foldable touch display screen, the touch display screen includes a first area and a second area, and the method includes: The electronic device displays a first interface in the first area; On the first interface, the electronic device detects a first operation; In response to the first operation, a second interface is displayed on the second area, where the second interface is associated with the content displayed on the first interface.

2. The method according to claim 1, characterized in that The electronic device displays a first interface in the first area, including: The electronic device is determined to be in a folded configuration; In response to being in the folded state, the electronic device displays a first interface in the first area, and turns off the second area.

3. The method according to claim 1 or 2, characterized in that: After the electronic device displays the second interface on the second area, the method further includes: On the first interface, the electronic device detects a second operation; In response to the second operation, the electronic device turns off the second area.

4. The method according to any one of claims 1 to 3, characterized in that The content displayed on the second interface is at least partially the same as that displayed on the first interface.

5. The method according to any one of claims 1 to 4, characterized in that The first interface is a camera interface, the camera interface includes a first preview window, the second interface includes a second preview window, and the images displayed in the first preview window and the second preview window are at least partially the same.

6. The method according to claim 5, characterized in that The camera interface also includes shooting controls, and the second interface does not include shooting controls.

7. The method according to any one of claims 1 to 6, characterized in that The first interface is a payment interface for the user, the payment interface includes a payment code, and the second interface also includes the payment code.

8. The method according to any one of claims 1 to 4, characterized in that The first interface is a translation interface, the translation interface includes content to be translated, and the second interface includes a translation result of the content to be translated.

9. The method according to claim 8, characterized in that The first interface includes the translation result, and the method further includes: The electronic device detects a user's modification operation on the translation result on the first interface; In response to the modification operation, the electronic device displays the modified translation result on the second interface.

10. The method according to any one of claims 1 to 9, characterized in that The second area is in an off state before the first operation is detected; The method further includes, in response to the first operation, the electronic device lighting up the second area.

11. The method according to any one of claims 1 to 10, characterized in that The electronic device is in a folded state, and the first area and the second area are located on both sides of a bent portion.

12. The method according to claim 11, characterized in that The first area is a main screen, and the second area is a sub-screen.

13. The method according to claim 11 or 12, characterized in that: The first region and the second region are folded toward opposite directions.

14. An electronic device, characterized in that: include: Foldable touch display; one or more processors; one or more memories; The one or more memories store one or more computer programs, and the one or more computer programs include instructions, which, when executed by the one or more processors, enable the electronic device to execute the method for controlling screen display as described in any one of claims 1 to 13.

15. A computer storage medium, characterized in that The method comprises computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the method for controlling screen display as claimed in any one of claims 1 to 13.

16. A computer program product, characterized in that When the computer program product is executed on a computer, the computer is caused to execute the method for controlling screen display according to any one of claims 1 to 13.

Images