Split-screen display method, and electronic device

Abstract

Provided in the present application is a split-screen display method. The method is applied to an electronic device comprising a display screen, and the display screen includes at least two screen states. In the method, when a screen state changes, an electronic device can adaptively adjust the area of each split-screen window on the basis of the degree of attention of a user with respect to each split-screen window, such that a split-screen window having a higher degree of attention of the user occupies a larger display area on a display screen, and a split-screen window having a lower degree of attention of the user occupies a smaller display area on the display screen, thereby meeting the requirements of the user for a split-screen display function in different scenarios, and improving the overall user experience.

Description

Split-screen display methods and electronic devices Technical Field

[0001] The embodiments of the present invention relate to the field of terminal technology, and in particular to a method and electronic device for split-screen display. Background Technology

[0002] With the rapid development of communication technology, the forms of terminal products are becoming increasingly diverse. Foldable screen devices, as a type of device that can flexibly switch between folded and unfolded states, can adapt to the needs of users in different usage scenarios and have gained popularity among many people.

[0003] Because foldable devices typically boast large screens, split-screen display has become a frequently used feature. Currently, the area ratio of each split-screen window on a foldable device's display is fixed, which challenges the practicality and adaptability of the split-screen function, limiting the user's split-screen experience. Therefore, improving the split-screen display functionality of foldable devices to meet users' needs in different scenarios is a pressing issue that needs to be addressed in this field. Summary of the Invention

[0004] This invention provides a method and electronic device for split-screen display. In this method, when the screen state changes, the electronic device can adaptively adjust the size of each split-screen window based on the user's attention level, ensuring that the split-screen window with higher user attention occupies a larger display area and the split-screen window with lower user attention occupies a smaller display area. This satisfies the user's needs for split-screen display functionality in different scenarios and improves the overall user experience.

[0005] In a first aspect, embodiments of the present invention provide a method for split-screen display. This method is applied to an electronic device, which includes a display screen containing at least two screen states. The method includes: when the screen state of the electronic device is a first state, displaying a first split-screen window and a second split-screen window; when the screen state of the electronic device changes from the first state to a second state, adjusting the display size of the first split-screen window and the second split-screen window on the display screen in the second state according to the user's attention to the first and second split-screen windows.

[0006] Through the above strategies, electronic devices can flexibly adjust the size of each split-screen window according to the user's historical usage habits when the screen state changes. This avoids the problem of the split-screen window that the user is interested in not being fully displayed or having too small a display area after the screen state is adjusted, which affects normal viewing. It also reduces the redundant operation steps caused by the user manually adjusting the display ratio of the split-screen window, meets the user's needs for split-screen display function in different scenarios, and improves the overall user experience.

[0007] In conjunction with the first aspect, in some implementations, the display size of the first and second split-screen windows on the screen in the second state is adjusted according to the user's attention to the first and second split-screen windows, specifically including:

[0008] If the user's attention to the first split-screen window is greater than or equal to their attention to the second split-screen window, then the display size of the first split-screen window in the second state of the display screen is greater than or equal to the display size of the second split-screen window in the second state of the display screen; or, if the user's attention to the first split-screen window is less than their attention to the second split-screen window, then the display size of the first split-screen window in the second state of the display screen is less than the display size of the second split-screen window in the second state of the display screen.

[0009] In conjunction with the first aspect, in some implementations, the user's attention to the first split-screen window and the second split-screen window is positively correlated with the frequency of user operations on the first split-screen window and the second split-screen window and / or the duration of gaze over a historical period.

[0010] In conjunction with the first aspect, in some implementations, the display size of the first and second split-screen windows on the screen in the second state is adjusted according to the user's attention to the first and second split-screen windows, specifically including:

[0011] The ratio of the frequency of user operations on the first split-screen window and the second split-screen window over a historical period, or the ratio of the duration of user gaze, is determined as the area ratio of the first split-screen window and the second split-screen window on the display screen.

[0012] In conjunction with the first aspect, in some implementations, the first state is an unfolded state and the second state is a folded state.

[0013] Secondly, embodiments of the present invention provide a method for split-screen display, which is applied to an electronic device including a display screen containing at least two screen states. The method includes: when the screen state of the electronic device is a first state, displaying a first split-screen window and a second split-screen window; when the screen state of the electronic device is adjusted from the first state to the second state, displaying the first split-screen window in full screen, wherein the user's attention to the first split-screen window is greater than the user's attention to the second split-screen window.

[0014] In conjunction with the second aspect, in some implementations, the above method further includes: displaying a second split-screen window in a small window.

[0015] In conjunction with the second aspect, in some implementations, the user's attention to the first split-screen window and the second split-screen window is positively correlated with the frequency of user operations on the first split-screen window and the second split-screen window and / or the duration of gaze over a historical period.

[0016] In conjunction with the second aspect, in some implementations, the first state is an unfolded state and the second state is a folded state.

[0017] Thirdly, embodiments of the present invention provide an electronic device including a memory, a processor, and a sensor. The memory is used to store a computer program, and the processor is used to invoke the computer program to cause the electronic device to perform the methods described in the first and / or second aspects.

[0018] Fourthly, embodiments of the present invention provide a computer program product containing instructions that, when run on an electronic device, cause the electronic device to perform the methods described in the first and / or second aspects described above.

[0019] Fifthly, embodiments of the present invention provide a computer-readable storage medium including instructions that, when executed on an electronic device, cause the electronic device to perform the methods described in the first and / or second aspects. Attached Figure Description

[0020] Figure 1 is a schematic diagram of a scenario where an electronic device 100 performs split-screen display according to an embodiment of the present invention;

[0021] Figures 2A and 2B are schematic diagrams of a scenario where another electronic device 100 provided in an embodiment of the present invention performs split-screen display;

[0022] Figure 3A is a schematic diagram of the structure of an electronic device 100 provided in an embodiment of the present invention;

[0023] Figure 3B is a software structure block diagram of an electronic device 100 provided in an embodiment of the present invention;

[0024] Figures 4A to 4D are schematic diagrams of the user interface involved in the split-screen display of an electronic device 100 according to an embodiment of the present invention;

[0025] Figure 5 is a flowchart of a split-screen display method provided by an embodiment of the present invention. Detailed Implementation

[0026] The technical solutions of the embodiments of the present invention will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are merely some embodiments of the present invention, and not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention are within the scope of protection of the present invention.

[0027] A foldable screen device is a device that can be folded to form at least two screens. In some implementations, the foldable screen device can be folded along a folding edge or folding axis to form a first screen and a second screen. In other implementations, the foldable screen device can also be folded along a folding edge or folding axis to form a first screen, a second screen, and a third screen. In practical applications, foldable screen devices can be divided into two categories: one is an electronic device whose folding screen folds outwards, and the other is an electronic device whose folding screen folds inwards. Taking the electronic device folded to form a first screen and a second screen as an example, when an outward-folding electronic device is folded, the first screen and the second screen face away from each other. When an inward-folding electronic device is folded, the first screen and the second screen face each other. This application does not specifically limit the screen folding method of the foldable screen device.

[0028] The screen states of a foldable device include a folded state and an unfolded state. The folded state is when the screen remains bent. In this state, the device is more portable and better suited for one-handed operation. The unfolded state is when the screen remains unfolded. In this state, the device provides a larger display and operation area for the user. The display area of ​​a foldable device in the folded state is smaller than that in the unfolded state. For example, taking an electronic device folded to form a first screen and a second screen, when the electronic device is in the folded state, the interface can be displayed on either the first or second screen. When the electronic device is in the unfolded state, the interface can be displayed on both the first and second screens. Furthermore, during the transition of the foldable device from the folded state to the unfolded state, or vice versa, the screen state can be either folded or unfolded. This application does not specifically limit this.

[0029] Because foldable devices typically have the hardware advantage of large screens, split-screen display has become one of their most frequently used features. Split-screen display allows electronic devices to divide the display screen into multiple windows, each displaying the same or different user interfaces. This feature improves multitasking efficiency, allowing users to simultaneously view and interact with content from multiple user interfaces through different windows on the screen.

[0030] For example, as shown in Figure 1, in a scenario where split-screen display is enabled, the electronic device's screen can display multiple split-screen windows, such as split-screen window A1 and split-screen window A2. Split-screen window A1 includes the user interface for a video application, while split-screen window A2 includes the user interface for a document application. Through these two split-screen windows, users can watch videos and view documents simultaneously, effectively enhancing the device's user experience.

[0031] Currently, in split-screen display, the area ratio of each split-screen window on the foldable device's screen is fixed and does not change with screen state. For example, as shown in Figure 2A, when the foldable device is in its unfolded state, its display includes two split-screen windows: window A1 and window A2. Window A1 contains the user interface for a video application, and window A2 contains the user interface for a document application. The area ratio of the two split-screen windows is 1:1. If the foldable device switches from its unfolded state to its folded state, as shown in Figure 2B, the display includes two split-screen windows: window B1 and window B2. Window B1 contains the user interface for a video application, and window B2 contains the user interface for a document application. The area ratio of the two split-screen windows remains 1:1. Because the display area of ​​the foldable device in its folded state is smaller than its display area in its unfolded state—specifically, in Figure 2B, the display area of ​​the foldable device in its folded state is only half of its display area in its unfolded state—this is a significant difference. Therefore, the display area of ​​split-screen window B1 is only half the display area of ​​split-screen window A1, and the display area of ​​split-screen window B2 is also only half the display area of ​​split-screen window A2. This may cause the video in split-screen window B1 to be incompletely displayed, or the video to be too small to affect normal viewing, resulting in a poor user experience with split-screen display. It should be understood that the aforementioned display area is only for illustrative purposes.

[0032] This application provides a method and electronic device for split-screen display. By implementing this method, in response to changes in its own screen state, the foldable screen device can adaptively adjust the size of each split-screen window according to the user's attention to each split-screen window, so that the split-screen window with higher user attention occupies more display area on the screen, and the split-screen window with lower user attention occupies less display area on the screen, thereby meeting the user's needs for split-screen display function in different scenarios and improving the overall user experience.

[0033] Figure 3A shows a schematic diagram of the structure of the electronic device 100.

[0034] Electronic device 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0035] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0036] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0037] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0038] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0039] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0040] The charging management module 140 receives charging input from a charger. The charger can be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 receives charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 receives wireless charging input via the wireless charging coil of the electronic device 100. While charging the battery 142, the charging management module 140 can also supply power to the electronic device via the power management module 141.

[0041] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.

[0042] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0043] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0044] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.

[0045] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.

[0046] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0047] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. The wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. The GNSS may include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).

[0048] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0049] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD). The display panel can also be manufactured using organic light-emitting diodes (OLEDs), active-matrix organic light-emitting diodes (AMOLEDs), flexible light-emitting diodes (FLEDs), miniled, microled, micro-oled, quantum dot light-emitting diodes (QLEDs), etc. The state of display screen 194 can include a folded state and an unfolded state. For a description of the folded and unfolded states, please refer to the relevant descriptions in the foregoing embodiments; they will not be repeated here. In some embodiments, the electronic device may include one or N display screens 194, where N is a positive integer greater than 1.

[0050] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0051] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.

[0052] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0053] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0054] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0055] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0056] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0057] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0058] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0059] Pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, pressure sensor 180A can be disposed on display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, and capacitive pressure sensors. A capacitive pressure sensor may include at least two parallel plates with conductive material. When force is applied to pressure sensor 180A, the capacitance between the electrodes changes. Electronic device 100 determines the pressure intensity based on the change in capacitance. When a touch operation is applied to display screen 194, electronic device 100 detects the intensity of the touch operation based on pressure sensor 180A. Electronic device 100 can also calculate the touch position based on the detection signal from pressure sensor 180A. In some embodiments, touch operations applied to the same touch position but with different touch operation intensities can correspond to different operation commands. For example, when a touch operation with an intensity less than a first pressure threshold is applied to the SMS application icon, a command to view an SMS is executed. When a touch operation with an intensity greater than or equal to the first pressure threshold is applied to the SMS application icon, a command to create a new SMS is executed.

[0060] The gyroscope sensor 180B can be used to determine the motion attitude of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 about three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 by moving in the opposite direction, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios.

[0061] The barometric pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates altitude using the air pressure value measured by the barometric pressure sensor 180C to assist in positioning and navigation.

[0062] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0063] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.

[0064] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.

[0065] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device 100 emits infrared light outward through the LED. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 may use the proximity sensor 180G to detect when a user holds the electronic device 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.

[0066] The ambient light sensor 180L is used to sense the brightness of ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0067] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.

[0068] Temperature sensor 180J is used to detect temperature. In some embodiments, electronic device 100 uses the temperature detected by temperature sensor 180J to execute a temperature handling strategy. For example, when the temperature reported by temperature sensor 180J exceeds a threshold, electronic device 100 performs thermal protection by reducing the performance of a processor located near temperature sensor 180J to reduce power consumption. In other embodiments, when the temperature is below another threshold, electronic device 100 heats battery 142 to prevent abnormal shutdown of electronic device 100 due to low temperature. In still other embodiments, when the temperature is below yet another threshold, electronic device 100 boosts the output voltage of battery 142 to prevent abnormal shutdown due to low temperature.

[0069] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0070] The bone conduction sensor 180M can acquire vibration signals. In some embodiments, the bone conduction sensor 180M can acquire vibration signals from the vibrating bone segments of the human vocal cords. The bone conduction sensor 180M can also contact the human pulse to receive blood pressure signals. In some embodiments, the bone conduction sensor 180M can also be incorporated into headphones to form bone conduction headphones. The audio module 170 can parse the voice signals from the vibrating bone segments of the vocal cords acquired by the bone conduction sensor 180M to realize voice functionality. The application processor can parse heart rate information from the blood pressure signals acquired by the bone conduction sensor 180M to realize heart rate detection functionality.

[0071] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.

[0072] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.

[0073] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0074] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0075] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses the layered architecture Android system as an example to exemplify the software structure of electronic device 100. It should be understood that this application embodiment can also be applied to other types of operating systems such as iOS operating system architecture and HarmonyOS operating system architecture.

[0076] Figure 3B is a software structure block diagram of an electronic device 100 according to an embodiment of this application.

[0077] A layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system libraries, and the kernel layer.

[0078] The application layer can include a series of application packages.

[0079] As shown in Figure 3B, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0080] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0081] As shown in Figure 3B, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0082] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0083] Content providers store and retrieve data, making that data accessible to applications. This data may include videos, images, audio, made and received phone calls, browsing history and bookmarks, phone books, etc.

[0084] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0085] The phone manager is used to provide communication functions for electronic device 100. For example, it manages call status (including connection and disconnection).

[0086] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0087] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating electronic devices, and flashing indicator lights.

[0088] The Android Runtime consists of core libraries and a virtual machine. The Android runtime is responsible for scheduling and managing the Android system.

[0089] The core library consists of two parts: one part is the functionalities that need to be called by the Java language, and the other part is the Android core library.

[0090] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.

[0091] System libraries can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0092] The Surface Manager is used to manage the display subsystem and provides the blending of 2D and 3D layers for multiple applications.

[0093] The media library supports playback and recording of various common audio and video formats, as well as still image files. It supports multiple audio and video encoding formats, such as MPEG4, H.264, MP3, AAC, AMR, JPG, and PNG.

[0094] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0095] A 2D graphics engine is a graphics engine for 2D drawing.

[0096] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0097] The following example, using a scene of capturing a photograph, illustrates the workflow of the software and hardware of the electronic device 100.

[0098] When touch sensor 180K receives a touch operation, a corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into a raw input event (including touch coordinates, timestamp of the touch operation, etc.). The raw input event is stored in the kernel layer. The application framework layer retrieves the raw input event from the kernel layer and identifies the control corresponding to the input event. Taking a touch click as an example, where the corresponding control is the camera application icon, the camera application calls the application framework layer's interface to launch the camera application, and then calls the kernel layer to launch the camera driver, capturing still images or videos through camera 193.

[0099] The following is an exemplary description of the user interface involved in split-screen display of the electronic device 100.

[0100] Figure 4A exemplarily illustrates a user interface 410, which is the user interface displayed when the electronic device 100 is in an unfolded state and the split-screen display function is enabled. As shown in Figure 4A, the user interface 410 may include a split-screen window 411 and a split-screen window 412. Split-screen window 411 includes the user interface for a video application. Split-screen window 412 includes the user interface for a document application. Split-screen windows 411 and 412 are located on the left and right sides of the user interface 410, respectively, with an area ratio of 1:1. It should be understood that this ratio is only illustrative; in some embodiments, the user can change the display ratio of the two split-screen windows as needed, so that the display ratio of the two split-screen windows is other than 1:1.

[0101] Upon detecting a user's folding action on the screen, the electronic device 100 can switch from an unfolded state to a folded state in response to the action.

[0102] The electronic device 100 can determine the user's attention level to each split-screen window in Figure 4A. The user's attention level to each split-screen window can be characterized by parameters such as the user's operation frequency and gaze duration. The above process will be described in detail later in this application embodiment, and will not be specifically described here. In some implementations, the electronic device 100 can determine the size of each split-screen window based on the user's attention level. Specifically, the electronic device 100 can display the user interface 420 shown in Figure 4B. The user interface 420 includes split-screen windows 421 and 422. Split-screen window 421 includes the user interface for a video application. Split-screen window 422 includes the user interface for a document application. Split-screen windows 421 and 422 are located on the top and bottom sides of the user interface 420, respectively. If the user's attention level to split-screen window 411 in Figure 4A is higher than their attention level to split-screen window 412 in Figure 4A, then the display area of ​​split-screen window 421 in Figure 4B can be larger than the display area of ​​split-screen window 422 in Figure 4B. For example, the area ratio of the two split-screen windows can be 3:1.

[0103] In some implementations, when switching from an expanded state to a collapsed state, the electronic device 100 can exit the split-screen display and only display the user interface of the split-screen window with higher attention. Specifically, as shown in Figure 4C, if the user's attention to split-screen window 411 in Figure 4A is higher than that to split-screen window 412 in Figure 4A, then the electronic device 100 can only display the user interface of the video application in split-screen window 411.

[0104] In some implementations, when switching from an expanded state to a collapsed state, the electronic device 100 can display the user interface of the more popular split-screen window in full screen, while displaying the user interface of the less popular split-screen window in a small window. Specifically, as shown in Figure 4D, if the user's attention to split-screen window 411 in Figure 4A is higher than their attention to split-screen window 412 in Figure 4A, then the electronic device 100 can display the user interface of the video application in split-screen window 411 in full screen, and display the user interface of the document application in split-screen window 412 in a small window in the lower left corner of the display screen.

[0105] Figure 5 is a flowchart of a split-screen display method provided by an embodiment of the present invention.

[0106] This method is applied to electronic device 100. As shown in the figure, the method includes:

[0107] Step S501: Display the first split-screen window and the second split-screen window.

[0108] The electronic device 100 supports split-screen display functionality. For a description of the split-screen display functionality, please refer to the relevant descriptions in the foregoing embodiments; they will not be repeated here. When the split-screen display functionality is enabled, the display screen of the electronic device 100 can display a first split-screen window and a second split-screen window. This application embodiment does not specifically limit the content of the first and second split-screen windows.

[0109] Step S502: When the screen state of the electronic device 100 changes, adjust the size of each split-screen window according to the user's attention to each split-screen window over a historical period.

[0110] As previously mentioned, the screen states of electronic device 100 include a folded state and an unfolded state. For a description of the folded and unfolded states, please refer to the relevant descriptions in the foregoing embodiments; they will not be repeated here. Changes in the screen state of electronic device 100 include: electronic device 100 switching from a folded state to an unfolded state, and electronic device 100 switching from an unfolded state to a folded state. Electronic device 100 can perform the action of switching screen states in response to a received user operation to fold or unfold the screen.

[0111] Electronic device 100 can determine the user's attention to each split-screen window over a historical period. The user's attention to each split-screen window can be characterized by parameters such as the frequency of user operations on each split-screen window and the duration of gaze.

[0112] The aforementioned historical time can be a period of time from a certain point in the past to the present. In this embodiment, the duration of this period of time can be preset, such as 1 minute, 5 minutes, or 10 minutes.

[0113] In terms of operation frequency, the higher the frequency of user operations on the split-screen window, the higher the user's attention to the split-screen window; the lower the operation frequency, the lower the user's attention to the split-screen window.

[0114] Regarding gaze duration, the longer a user gazes at a split-screen window, the higher their attention level to that window; conversely, the shorter the gaze duration, the lower their attention level. For example, the electronic device 100 can determine the user's gaze duration for each split-screen window using facial capture or eye-tracking technology. It can continuously monitor the display area the user is gazing at, determine the corresponding split-screen window based on that area, and then determine the user's gaze duration for each split-screen window by accumulating the time. The electronic device 100 can then determine the user's attention level to each split-screen window based on its gaze duration.

[0115] In some implementations, if the screen state is adjusted while the split-screen display function is enabled, the electronic device 100 can still maintain the split-screen display. The electronic device 100 can adjust the size of each split-screen window based on the user's attention to each split-screen window over a historical period, so that the split-screen windows with higher user attention over a historical period occupy a larger display area on the screen, while the split-screen windows with lower user attention over a historical period occupy a smaller display area.

[0116] In some examples, electronic device 100 can determine the area ratio of each split-screen window by the numerical ratio of the frequency or duration of user operations on each split-screen window over a historical period. For example, if the ratio of the frequency of user operations on split-screen window 1 to the frequency of user operations on split-screen window 2 in the past 10 minutes is 1:3, then, in response to adjusting the screen state, electronic device 100 can determine that the area ratio of split-screen window 1 to split-screen window 2 is also 1:3.

[0117] In other examples, the electronic device 100 can first determine the numerical range into which the ratio of the user's operation frequency or gaze duration on each split-screen window falls. Then, the electronic device 100 can determine the minimum or maximum value of the numerical range as the area ratio of each split-screen window. Specifically, the preset numerical range may include, for example: less than 1 / 3, greater than or equal to 1 / 3 and less than 1 / 2, greater than or equal to 1 / 2 and less than 2, greater than or equal to 2 and less than 3, and greater than or equal to 3. This application embodiment does not specifically limit the preset numerical range. For example, if the ratio of the user's operation frequency on split-screen window 1 to the operation frequency on split-screen window 2 in the past 10 minutes is 1 / 4, since 1 / 4 falls into the numerical range of "less than 1 / 3", the maximum value of this numerical range, 1 / 3 (i.e., 1:3), can be determined as the area ratio of split-screen window 1 and split-screen window 2.

[0118] Through the above strategy, the electronic device 100 can flexibly adjust the size of each split-screen window according to the user's historical usage habits when the screen state changes. This avoids the problem that the split-screen window that the user is concerned about may not be fully displayed or the display area may be too small to affect normal viewing after the screen state is adjusted. It also reduces the redundant operation steps caused by the user adjusting the display ratio of the split-screen window, meets the user's needs for split-screen display function in different scenarios, and improves the overall user experience.

[0119] In other implementations, if the screen state is adjusted while the split-screen display function is enabled, the electronic device 100 can also exit the split-screen display and only display the user interface of the split-screen window that the user is most interested in. Thus, the split-screen window that the user is interested in can be displayed full-screen on the display screen, providing the user with a better viewing experience.

[0120] In other implementations, if the screen state is adjusted when the split-screen display function is enabled, and the ratio of the user's operation frequency or gaze duration for each split-screen window is less than a first preset value or greater than a second preset value, the electronic device 100 can exit the split-screen display and only display the user interface of the split-screen window with higher user attention. The first preset value can be, for example, 1 / 5, and the second preset value can be 5. This application embodiment does not specifically limit this. Since the ratio of the user's operation frequency or gaze duration for each split-screen window is less than the first preset value or greater than the second preset value, it indicates that the user has high attention to some split-screen windows and low attention to others. Exiting the split-screen display at this time allows the user to focus more on the user interface they are interested in, avoids low-frequency user interfaces occupying display controls, fully utilizes the display area of ​​the screen, and improves the user experience.

[0121] In other implementations, if the screen state is adjusted when the split-screen display function is enabled, the electronic device 100 can also display the user interface of the more important split-screen window in full screen, while displaying the user interface of the less important split-screen window in a smaller window. This ensures that adjusting the screen state of the electronic device 100 does not affect the user's viewing experience of the split-screen window they are interested in, while also enabling multitasking and improving the overall user experience.

Claims

1. A method for split-screen display, characterized by, The method is applied to an electronic device including a display screen containing at least two screen states, and the method comprises: displaying a first split-screen window and a second split-screen window when the screen state of the electronic device is a first state; adjusting the display size of the first split-screen window and the second split-screen window in the display screen in the second state according to the attention of the user to the first split-screen window and the second split-screen window when the screen state of the electronic device is adjusted from the first state to a second state.

2. The method of claim 1, wherein, The adjustment of the display size of the first split-screen window and the second split-screen window in the display screen in the second state according to the attention of the user to the first split-screen window and the second split-screen window specifically comprises: if the attention of the user to the first split-screen window is greater than or equal to the attention of the user to the second split-screen window, the display size of the first split-screen window in the display screen in the second state is greater than or equal to the display size of the second split-screen window in the display screen in the second state; or if the attention of the user to the first split-screen window is less than the attention of the user to the second split-screen window, the display size of the first split-screen window in the display screen in the second state is less than the display size of the second split-screen window in the display screen in the second state.

3. The method of claim 1 or 2, wherein the attention of the user to the first split-screen window and the second split-screen window is positively correlated with the frequency of operation and / or the gaze duration of the user to the first split-screen window and the second split-screen window within a historical time. The adjustment of the display size of the first split-screen window and the second split-screen window in the display screen in the second state according to the attention of the user to the first split-screen window and the second split-screen window specifically comprises:

4. The method of claim 3, wherein, determining the value ratio of the frequency of operation or the value ratio of the gaze duration of the user to the first split-screen window and the second split-screen window within a historical time as the area ratio of the first split-screen window and the second split-screen window in the display screen. The first state is an unfolded state, and the second state is a folded state.

5. The method according to any one of claims 1 to 4, characterized in that, The method is applied to an electronic device including a display screen containing at least two screen states, and the method comprises:

6. A method for split screen display, characterized by, displaying a first split-screen window and a second split-screen window when the screen state of the electronic device is a first state; full-screen displaying the first split-screen window when the screen state of the electronic device is adjusted from the first state to a second state, wherein the attention of the user to the first split-screen window is greater than the attention of the user to the second split-screen window. The method further comprises:

7. The method of claim 6, wherein, displaying the second split-screen window in a small window.

8. The method of claim 6 or 7, wherein the attention of the user to the first split-screen window and the second split-screen window is positively correlated with the frequency of operation and / or the gaze duration of the user to the first split-screen window and the second split-screen window within a historical time. ​ ​ 9. The method according to any one of claims 6-8, characterized in that, The first state is an unfolded state, and the second state is a folded state.

10. An electronic device, comprising: The electronic device comprises a memory for storing a computer program, a processor for invoking the computer program, so that the electronic device executes the method in any one of claims 1-9.

11. A computer program product comprising instructions, characterized in that, The computer program product, when running on the electronic device, causes the electronic device to execute the method in any one of claims 1-9.

12. A computer-readable storage medium comprising instructions, wherein: The instructions, when running on the electronic device, cause the electronic device to execute the method in any one of claims 1-9.

Images