A collaborative display method, device and medium

Abstract

The present application provides a collaborative display method, device and medium, which relates to the technical field of folding screen terminals, and is applied to an electronic device including a first display screen and a second display screen, wherein the second display screen is foldable, and the method includes: when the first display screen of the electronic device is in a locked screen state, and the electronic device is in a folded state, a lock screen image is displayed in a first display frame of the first display screen; in response to a user's unfolding operation of the electronic device, a lock screen image is displayed in a second display frame of the second display screen, and the second display frame is moved toward the center of the second display screen, and the position of the first display frame on the first display screen corresponds to the starting position of the second display frame on the second display screen. Thus, when switching from using an external screen to using an internal screen, or when switching from using an internal screen to using an external screen, the content displayed on the external screen and the content displayed on the internal screen can be linked and coordinated to enhance the fun of user use.

Description

Technical Field

[0001] The present application relates to the technical field of folding screen terminals, and in particular to a collaborative display method, device and medium. Background Art

[0002] With the continuous development of flexible display technology, the shape of display screens of electronic devices has also undergone tremendous changes. Folding screens have become an emerging display form and are used in many electronic devices such as mobile phones.

[0003] At present, foldable screen mobile phones with both inner and outer screens are gradually becoming the development direction of future mobile phones. For foldable screen electronic devices, there are two forms: folded state and unfolded state. When the foldable screen electronic device is in the folded state, the outer screen mainly works, and when it is in the unfolded state, the foldable inner screen mainly works.

[0004] However, when switching between the folded and unfolded states, the content displayed on the outer screen cannot be coordinated with the content displayed on the inner screen, resulting in low user interest. Summary of the invention

[0005] The purpose of this application is to provide a collaborative display method, device and medium, which can enable the inner and outer screens to achieve a one-shot motion effect design, thereby improving the fun of user use.

[0006] In the first aspect, the present application discloses a collaborative display method, which is applied to an electronic device including a first display screen and a second display screen, wherein the second display screen is foldable, and the method comprises: when the first display screen of the electronic device is in a locked screen state, and the electronic device is in a folded state, displaying a lock screen image in a first display frame of the first display screen; in response to the user's unfolding operation of the electronic device, displaying the lock screen image in a second display frame of the second display screen, and moving the second display frame toward the center of the second display screen, and the position of the first display frame on the first display screen corresponds to the starting position of the second display frame on the second display screen. Thus, when switching from using an external screen to using an internal screen, or when switching from using an internal screen to using an external screen, the content displayed on the external screen and the content displayed on the internal screen can be linked and coordinated to enhance the fun of user use.

[0007] In some possible implementations, the speed at which the second display frame moves toward the center of the second display screen is positively correlated with the speed at which the user unfolds the electronic device. Thus, when switching from using the external screen to using the internal screen, or when switching from using the internal screen to using the external screen, the content displayed on the external screen and the content displayed on the internal screen can be linked and coordinated to enhance the fun of user use.

[0008] In some possible embodiments, the second display screen includes a first surface and a second surface; the position of the first display frame on the first display screen corresponds to the starting position of the second display frame on the second display screen, including: the position of the first display frame on the first display screen is the same as the starting position of the second display frame on the first surface.

[0009] In some possible implementations, after moving the second display frame toward the center of the second display screen, the method further includes: when the second display frame reaches the center position of the second display screen, using the lock screen image as a lock screen wallpaper of the electronic device.

[0010] In some possible implementations, after the second display frame is moved toward the center of the second display screen, the method further includes: when the second display frame reaches the center of the second display screen, using the lock screen image as the desktop wallpaper of the electronic device. Thus, when switching from using the external screen to using the internal screen, or when switching from using the internal screen to using the external screen, the lock screen image can be directly used as the lock screen wallpaper or desktop wallpaper, thereby enhancing the fun of user use.

[0011] In some possible embodiments, the lock screen image is a dynamic image; displaying the lock screen image in the first display frame of the first display screen includes: displaying the starting image frame of the dynamic image in the first display frame of the first display screen; displaying the lock screen image in the second display frame of the second display screen includes: displaying the dynamic image in the second display frame of the second display screen.

[0012] In some possible implementations, using the lock screen image as the desktop wallpaper of the electronic device includes: using the last image frame of the dynamic image as the desktop wallpaper of the electronic device. In this way, the dynamic image can be used as the lock screen image, and the lock screen image can be directly used as the lock screen wallpaper or desktop wallpaper, which enhances the fun of user use.

[0013] In some possible implementations, after responding to the user's unfolding operation on the electronic device, the method further includes: obtaining the opening and closing angle of the electronic device; displaying a lock screen image in the second display frame of the second display screen, including: determining whether the opening and closing angle is greater than or equal to an angle threshold; if so, displaying the lock screen image in the second display frame of the second display screen. Thus, when switching from using the external screen to using the internal screen, or when switching from using the internal screen to using the external screen, the content displayed on the external screen and the content displayed on the internal screen can be linked and coordinated to enhance the fun of user use.

[0014] In some possible implementations, after the lock screen image is displayed in the second display frame of the second display screen, the method further includes: turning the first display screen off. Thus, when switching from using the external screen to using the internal screen, or when switching from using the internal screen to using the external screen, the content displayed on the external screen and the content displayed on the internal screen can be linked and coordinated to enhance the fun of user use.

[0015] In the second aspect, the present application discloses an electronic device, including a first display screen, a second display screen, a processor and a memory; the first display screen and the second display screen are both used to display images; the memory is used to store computer execution commands; the processor is used to execute the computer execution commands stored in the memory, so that the processor executes the collaborative display method as in the first aspect.

[0016] In a third aspect, the present application discloses a computer-readable storage medium, in which a computer program or instruction is stored. When the computer program or instruction is executed, the collaborative display method in the first aspect is implemented.

[0017] In a fourth aspect, the present application provides a computer program product. When the computer program product is run on a computer, the computer executes the collaborative display method in the first aspect.

[0018] In the fifth aspect, the present application discloses a collaborative display device, including a display module and a mobile module. It should be noted that the collaborative display device is applied to an electronic device including a first display screen and a second display screen, wherein the second display screen is foldable. Wherein, the display module is used to display a lock screen image in a first display frame of the first display screen when the first display screen of the electronic device is in a lock screen state, and when the electronic device is in a folded state. The mobile module is used to display the lock screen image in the second display frame of the second display screen in response to the user's unfolding operation of the electronic device, and move the second display frame toward the center of the second display screen, and the position of the first display frame on the first display screen corresponds to the starting position of the second display frame on the second display screen. Thus, when switching from using an external screen to using an internal screen, or when switching from using an internal screen to using an external screen, the content displayed on the external screen and the content displayed on the internal screen can be linked and coordinated to enhance the fun of user use.

[0019] Based on the above technical solution, this application has the following beneficial effects:

[0020] The present application discloses a collaborative display method, device and medium. When the first display screen of an electronic device is in a locked screen state and the electronic device is in a folded state, a lock screen image is displayed in a first display frame of the first display screen; in response to a user's unfolding operation of the electronic device, a lock screen image is displayed in a second display frame of the second display screen, and the second display frame is moved toward the center of the second display screen, wherein the position of the first display frame on the first display screen corresponds to the starting position of the second display frame on the second display screen. Thus, when switching from using an external screen to using an internal screen, or when switching from using an internal screen to using an external screen, the content displayed on the external screen and the content displayed on the internal screen can be linked and coordinated to enhance the fun of user use.

[0021] It should be understood that the description of technical features, technical solutions, beneficial effects or similar language in this application does not imply that all features and advantages can be realized in any single embodiment. On the contrary, it is understood that the description of features or beneficial effects means that specific technical features, technical solutions or beneficial effects are included in at least one embodiment. Therefore, the description of technical features, technical solutions or beneficial effects in this specification does not necessarily refer to the same embodiment. Furthermore, the technical features, technical solutions and beneficial effects described in the present embodiment can also be combined in any appropriate manner. Those skilled in the art will understand that the embodiment can be realized without one or more specific technical features, technical solutions or beneficial effects of a specific embodiment. In other embodiments, additional technical features and beneficial effects can also be identified in a specific embodiment that does not embody all embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0023] Figure 2 A schematic diagram of the software structure of an electronic device provided in an embodiment of the present application;

[0024] Figure 3 A schematic diagram of a horizontal folding screen electronic device provided in an embodiment of the present application;

[0025] Figure 4 A schematic diagram of a vertical folding screen electronic device provided in an embodiment of the present application;

[0026] Figure 5 A flowchart of a collaborative display method provided in an embodiment of the present application;

[0027] Fig. 6A A schematic diagram of a horizontal folding screen with an opening and closing angle of 0 degrees provided in an embodiment of the present application;

[0028] Figure 6B A schematic diagram of a horizontal folding screen with an opening and closing angle less than 45 degrees provided in an embodiment of the present application;

[0029] Figure 6C A schematic diagram of a horizontal folding screen with an opening and closing angle greater than 45 degrees provided in an embodiment of the present application;

[0030] Fig.6D A schematic diagram of a horizontal folding screen with an opening and closing angle of 45 degrees to 90 degrees provided in an embodiment of the present application;

[0031] Fig. 6E A schematic diagram of a horizontal folding screen with an opening and closing angle of 90 degrees provided in an embodiment of the present application;

[0032] Fig. 6F A schematic diagram of a horizontal folding screen with an opening and closing angle of 180 degrees provided in an embodiment of the present application;

[0033] Fig. 7A A schematic diagram of a vertical folding screen with an opening and closing angle of 0 degrees provided in an embodiment of the present application;

[0034] Figure 7B A schematic diagram of a longitudinal folding screen with an opening and closing angle less than 45 degrees provided in an embodiment of the present application;

[0035] Figure 7C A schematic diagram of a longitudinal folding screen with an opening and closing angle greater than 45 degrees provided in an embodiment of the present application;

[0036] Fig.7D A schematic diagram of a longitudinal folding screen with an opening and closing angle of 45 degrees to 90 degrees provided in an embodiment of the present application;

[0037] Fig. 7E A schematic diagram of a longitudinal folding screen with an opening and closing angle of 90 degrees provided in an embodiment of the present application;

[0038] Figure 7F A schematic diagram of a longitudinal folding screen with an opening and closing angle of 180 degrees provided in an embodiment of the present application;

[0039] Figure 8 A flowchart of another collaborative display method provided in an embodiment of the present application;

[0040] Fig. 9 A schematic diagram of an unfolded folding screen electronic device provided in an embodiment of the present application;

[0041] Fig.10 A schematic diagram of a collaborative display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0042] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "one", "a kind", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear contrary indication in the context. It should also be understood that in the embodiments of the present application, "one or more" refers to one, two or more; "and / or" describes the association relationship of the associated objects, indicating that three relationships may exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship.

[0043] References to "one embodiment" or "some embodiments" etc. described in this specification mean that a particular feature, structure or characteristic described in conjunction with the embodiment is included in one or more embodiments of the present application. Thus, the phrases "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear at different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.

[0044] The multiple involved in the embodiments of the present application means greater than or equal to two. It should be noted that in the description of the embodiments of the present application, the words "first", "second", etc. are only used for the purpose of distinguishing the description, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.

[0045] With the continuous development of flexible display technology, the form of electronic device displays has also undergone tremendous changes. Folding screens have become an emerging display form and are used in many electronic devices such as mobile phones. At present, in order to provide users with a more convenient viewing experience, dual-folding screen electronic devices with both inner and outer screens have gradually become the development direction of future electronic devices. For folding screen terminals, there are two forms: folded and unfolded.

[0046] Specifically, the folded state refers to the state when the opening and closing angle of the electronic device is 0 degrees or close to 0 degrees. In the folded state, the inner screen (i.e., the second display screen) of the electronic device is closed inward and cannot be directly seen by the user. The electronic device provides the display function to the user through the outer screen (i.e., the first display screen). When the user does not need to use the electronic device, the folding screen electronic device can be in the folded state, thereby reducing the size of the electronic device and making it easier for the user to carry.

[0047] The unfolded state refers to the state in which the opening and closing angle of the electronic device is 180 degrees or close to 180 degrees. In the unfolded state, the inner screen (i.e., the second display screen) of the electronic device is flattened and presented to the user as an appearance of the electronic device. The electronic device provides display functions to the user through the inner screen. At this time, the outer screen (i.e., the first display screen) of the electronic device usually displays a black screen. When the user needs to use the screen of the electronic device for operations such as reading and entertainment, the folding screen can be in the unfolded state, thereby increasing the area of ​​the display interface and providing the user with a more comfortable user experience.

[0048] It should be noted that between the folded state and the unfolded state, there may also be a semi-folded state. The semi-folded state refers to a state where the opening and closing angle of the electronic device is between 0 degrees and 180 degrees. When the electronic device is in the semi-folded state, the display screen that provides the display function to the user may be an external screen or an internal screen.

[0049] In some examples, when the folding angle is less than 45 degrees, the electronic device can provide a display function to the user through the outer screen. In other examples, when the folding angle is greater than 90 degrees, the electronic device can provide a display function to the user through the inner screen.

[0050] That is to say, the process of switching the folding screen electronic device from the unfolded state to the folded state is the process of switching from using the inner screen to using the outer screen. Similarly, the process of switching the folding screen electronic device from the folded state to the unfolded state is the process of switching from using the outer screen to using the inner screen.

[0051] However, when switching from using the external screen to using the internal screen, or when switching from using the internal screen to using the external screen, the content displayed on the external screen cannot be linked to the content displayed on the internal screen, resulting in lower user interest.

[0052] In view of this, the present application provides a method, device and medium for coordinated display of internal and external screens. When the first display screen of the electronic device is in a locked screen state and the electronic device is in a folded state, a lock screen image is displayed in the first display frame of the first display screen; in response to the user's unfolding operation of the electronic device, the lock screen image is displayed in the second display frame of the second display screen, and the second display frame is moved toward the center of the second display screen, wherein the position of the first display frame on the first display screen corresponds to the starting position of the second display frame on the second display screen. Thus, when switching from using the external screen to using the internal screen, or when switching from using the internal screen to using the external screen, the content displayed on the external screen and the content displayed on the internal screen can be linked and coordinated to enhance the fun of user use.

[0053] It should be noted that the above description of the inner screen and the outer screen is only an example and does not constitute a specific limitation on the foldable electronic device involved in the embodiments of the present application. For example, the inner screen of the foldable screen electronic device can also be spliced ​​with two or more non-foldable screens, and / or the outer screen can be a foldable screen, etc.

[0054] For ease of understanding, the following text will take the inner screen (second display screen) as the folding screen, and the foldable electronic device is also provided with an outer screen (first display screen) as an example.

[0055] See also Figure 1 , which is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. It should be noted that the electronic device may be a mobile phone powered by multiple batteries, a laptop computer, a wearable electronic device (such as a smart watch), a tablet computer, an augmented reality (AR) device, a virtual reality (VR) device, and a vehicle-mounted device.

[0056] like Figure 1 As shown, the electronic device 100 may include a processor 110, an internal memory 120, an antenna 1, an antenna 2, a mobile communication module 130, a wireless communication module 140, a display screen 150, a sensor module 160, a button 170, etc. The sensor module 160 may include a distance sensor 160A, a proximity light sensor 160B, an ambient light sensor 160C, an angle sensor 160D, etc.

[0057] It is to be understood that the structure illustrated in this embodiment does not constitute a specific limitation on the electronic device. In other embodiments, the electronic device may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0058] The processor 110 may include one or more processing units, for example: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and / or a neural network processor (neural-network processing unit, NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors. For example, in the present application, when the first display screen of the electronic device is in a lock screen state, and the electronic device is in a folded state, a lock screen image is displayed in a first display frame of the first display screen; in response to the user's unfolding operation of the electronic device, the lock screen image is displayed in a second display frame of the second display screen, and the second display frame is moved toward the center of the second display screen, wherein the position of the first display frame on the first display screen corresponds to the starting position of the second display frame on the second display screen. Thus, when switching from using an external screen to using an internal screen, or when switching from using an internal screen to using an external screen, the content displayed on the external screen and the content displayed on the internal screen can be linked and coordinated to enhance the fun of user use.

[0059] The controller can be the nerve center and command center of the electronic device. The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.

[0060] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0061] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0062] The UART interface is a universal serial data bus for asynchronous communication. The bus can be a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 110 and the wireless communication module 140.

[0063] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 150. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 110 and the display screen 150 communicate via the DSI interface to implement the display function of the electronic device. Exemplarily, the electronic device can display a related interface based on the display function.

[0064] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 110 with the display screen 150, the wireless communication module 140, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0065] It is understandable that the interface connection relationship between the modules illustrated in this embodiment is only a schematic illustration and does not constitute a structural limitation of the electronic device. In other embodiments of the present application, the electronic device may also adopt different interface connection methods in the above embodiments, or a combination of multiple interface connection methods.

[0066] The wireless communication function of the electronic device can be implemented through antenna 1, antenna 2, mobile communication module 130, wireless communication module 140, modem processor and baseband processor.

[0067] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the electronic device can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of the antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0068] The internal memory 120 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 120. The internal memory 120 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device (such as audio data, a phone book, etc.), etc. In addition, the internal memory 120 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device by running the instructions stored in the internal memory 120, and / or the instructions stored in the memory provided in the processor.

[0069] The mobile communication module 130 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to electronic devices. The mobile communication module 130 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 130 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 130 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 130 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 130 can be set in the same device as at least some of the modules of the processor 110.

[0070] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor displays an image or video through the display screen 150. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and be set in the same device as the mobile communication module 130 or other functional modules.

[0071] The wireless communication module 140 can provide wireless communication solutions for electronic devices, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 140 can be one or more devices integrating at least one communication processing module. The wireless communication module 140 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 140 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0072] In some embodiments, the antenna 1 of the electronic device is coupled to the mobile communication module 130, and the antenna 2 is coupled to the wireless communication module 140, so that the electronic device can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).

[0073] The electronic device implements the display function through a GPU, a display screen 150, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 150 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0074] The display screen 150 is used to display images, videos, etc. The display screen 150 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oled, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device may include N display screens 150, where N is a positive integer greater than 1. Exemplarily, the display screen 150 includes a foldable inner screen and a non-foldable outer screen, the inner screen is located on the first side of the electronic device 100, the outer screen is located on the second side of the electronic device 100, and the inner screen can be folded inward or outward.

[0075] A series of graphical user interfaces (GUIs) can be displayed on the display screen 150 of the electronic device, and these GUIs are the main screens of the electronic device. Generally speaking, the size of the display screen 150 of the electronic device is fixed, and only limited controls can be displayed on the display screen 150 of the electronic device. A control is a GUI element, which is a software component included in an application program, and controls all data processed by the application program and interactive operations on the data. Users can interact with the control through direct manipulation to read or edit relevant information of the application program. Generally speaking, a control can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.

[0076] Distance sensor 160A, used to measure distance. The electronic device 100 can measure distance by infrared or laser. In some embodiments, the electronic device 100 can use the distance sensor 160A to measure distance to distinguish whether the electronic device is in an unfolded state or a folded state, and can determine the degree of opening and closing of the display screen 150 of the electronic device, so that the mobile phone wallpaper application moves the position of the second display frame according to the change of the folding angle of the display screen 150.

[0077] The proximity light sensor 160B may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 160B to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 160B can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0078] The ambient light sensor 160C is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 150 according to the perceived ambient light brightness. The ambient light sensor 160C can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 160C can also cooperate with the proximity light sensor 160B to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0079] The angle sensor 160D is used to detect angles. For example, the angle sensor 160D can be used to detect the folding angle of the display screen 150 when the display screen 150 is folded, so that the mobile phone wallpaper application moves the position of the second display frame according to the change in the folding angle of the display screen 150.

[0080] The angle sensor 160D may include an acceleration sensor and a gyroscope sensor, etc. In some embodiments, the electronic device 100 may have multiple gyroscope sensors and multiple acceleration sensors, which are respectively arranged on the inner screen and the outer screen of the electronic device 100. For example, a group of sensors (a gyroscope sensor and an acceleration sensor) are arranged on the outer screen of the electronic device 100, and a group of sensors are also arranged on the inner screen of the electronic device 100. Then the electronic device 100 combines the data collected by the gyroscope sensors on the inner and outer screens and the data collected by the acceleration sensor to determine the folding angle of the inner screen of the electronic device 100.

[0081] Specifically, the electronic device 100 can obtain the three-axis (X-axis, Y-axis, Z-axis) data (in m / s2, with a sampling frequency of 100Hz) of the electronic device 100 in the camera coordinate system through the acceleration sensor, and the three-axis data (in rad / d, with a sampling frequency of 100Hz) of the gyroscope sensor after zero bias correction through the acceleration sensor. Then, the electronic device 100 can extract the acceleration sensor value (in m / s2, with a sampling frequency of 100Hz) and the system time (or timestamp) corresponding to the data from the three-axis data of the acceleration sensor of the external screen through a filtering algorithm, and then use these parameters to further calculate through a fusion algorithm to obtain the opening and closing angles of the inner and outer screens.

[0082] The button 170 includes a power button, a volume button, etc. The button 170 can be a mechanical button. It can also be a touch button. The electronic device 100 can receive the key input and generate a key signal input related to the user settings and function control of the electronic device 100. Exemplarily, in an embodiment of the present application, when the electronic device 100 is in the screen-off mode, the user clicks the power button. The electronic device 100 can enter the lock screen mode from the screen-off mode in response to the received operation of the user clicking the power button. Exemplarily, when the electronic device is in the lock screen mode or the desktop mode, if the electronic device 100 receives the operation of the user clicking the power button, the electronic device 100 enters the screen-off mode from the lock screen mode or the desktop mode.

[0083] In addition, an operating system is running on the above components, such as the iOS operating system developed by Apple, the Android open source operating system developed by Google, and the Windows operating system developed by Microsoft. Application programs can be installed and run on the operating system.

[0084] The operating system of the electronic device may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the electronic device.

[0085] See also Figure 2 , which is a schematic diagram of the software structure of an electronic device provided in an embodiment of the present application. The present application embodiment takes the Android system of layered architecture as an example to exemplarily illustrate the software structure of the electronic device 100.

[0086] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: application layer (Applications, APP), framework layer (Framework, FWK), Android runtime (Android runtime) and system library and kernel layer (Kernel).

[0087] The application layer may include a series of application packages. In some embodiments, the application layer may include applications such as mobile wallpapers and one-click lock screens. In some examples, the wallpaper application may implement the display mode of the wallpaper or transition animation in the embodiments of the present application. For example, the mobile wallpaper application may provide a user interface to enable the user to change the wallpaper or the video displayed by the transition animation.

[0088] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The framework layer may include some predefined functions. The hardware abstraction layer defines the interface of the hardware "driver" to reduce the coupling between the Android operating system and the hardware. Exemplarily, the above framework layer may include a window manager, a content provider, a view system, etc.

[0089] Specifically, the window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying pictures.

[0090] AndroidRuntime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system. The core library consists of two parts: one is the function that the Java language needs to call, and the other is the Android core library. The application layer and the application framework layer run in the virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform object life cycle management, stack management, thread management, security and exception management, and garbage collection and other functions.

[0091] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0092] Specifically, the surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of multiple commonly used audio and video formats, as well as static image files. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing. The 2D graphics engine is a drawing engine for 2D drawing.

[0093] The kernel layer is a layer between hardware and software. The kernel layer includes at least display driver, sensor driver, etc. In some examples, the kernel layer may also include an angle matching module, which is connected to the angle sensor 160D to know the opening and closing angle of the electronic device.

[0094] Understandably, Figure 2 The components included in the system framework layer, system library and runtime layer shown do not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown, or combine some components, or split some components, or arrange the components differently.

[0095] It should be noted that although the embodiment of the present application is described using the Android system as an example, its basic principles are also applicable to electronic devices 100 based on operating systems such as iOS and Windows.

[0096] It is understandable that the electronic device 100 can be a horizontal folding screen electronic device or a vertical folding screen electronic device, and the present application does not limit the opening and closing direction of the folding screen. For ease of description, the foldable electronic device is referred to as an electronic device in the following text, and the electronic device is a mobile phone as an example.

[0097] See also Figure 3 , which is a schematic diagram of a horizontal folding screen electronic device provided in an embodiment of the present application. Exemplarily, the horizontal folding screen electronic device 100 includes: an inner screen 10, an outer screen 20, a power button 30, a first body 40 and a second body 50.

[0098] Specifically, the inner screen 10 can also be called the second display screen, and the outer screen 20 can also be called the first display screen. The inner screen and the outer screen are two independent display screens. Generally speaking, the size of the inner screen 10 is larger than that of the outer screen 20. The inner screen 10 is arranged on the first surface of the first body 40 and the first surface of the second body 50, and the outer screen 20 is arranged on the second surface of the first body 40. A shell is arranged on the second surface of the second body 50. The power button 30 and the volume button can be arranged on the side of the first body 40 or the second body 50. The figure takes the power button 30 and the volume button located on the side of the second body 50 as an example for explanation.

[0099] It can be understood that the process of switching the horizontal folding screen electronic device from the unfolded state to the folded state (the process of switching from using the inner screen to using the outer screen) is Figure 2 The process of switching from A to B in the figure; the process of switching a horizontal folding screen electronic device from a folded state to an unfolded state (the process of switching from using an outer screen to using an inner screen) is Figure 2 The process of switching from B to A.

[0100] See also Figure 4 , which is a schematic diagram of a longitudinal folding screen electronic device provided in an embodiment of the present application. Exemplarily, the transverse folding screen electronic device 100 includes: an inner screen 11, an outer screen 21, a power button 31, a first body 41 and a second body 51.

[0101] Similar to the horizontal folding screen electronic device, the inner screen 11 can also be called the second display screen, and the outer screen 21 can also be called the first display screen. The inner screen and the outer screen are two independent display screens. Generally speaking, the size of the inner screen 11 is larger than that of the outer screen 21. The inner screen 11 is arranged on the first surface of the first body 41 and the first surface of the second body 51, and the outer screen 21 is arranged on the second surface of the first body 41. A shell is arranged on the second surface of the second body 51. The power button 31 and the volume button can be arranged on the side of the first body 41 or the second body 51. The figure takes the power button 31 and the volume button located on the side of the first body 41 as an example for explanation.

[0102] It can be understood that the process of switching the vertical folding screen electronic device from the unfolded state to the folded state (the process of switching from using the inner screen to using the outer screen) is Figure 3 The process of switching from A to B in the vertical folding screen electronic device from the folded state to the unfolded state (the process of switching from using the outer screen to using the inner screen) is Figure 3 The process of switching from B to A.

[0103] See also Figure 5, which is a flow chart of a collaborative display method provided in an embodiment of the present application. The method is applied to an electronic device, which can be a mobile phone, a computer or a tablet computer, as long as it includes an inner screen (second display screen) and an outer screen (first display screen).

[0104] S501: When a first display screen of the electronic device is in a locked screen state and the electronic device is in a folded state, a locked screen image is displayed in a first display frame of the first display screen.

[0105] The locked screen state refers to the state when the screen of the electronic device is locked. The folded state refers to the state when the opening and closing angle of the electronic device is 0 degrees or close to 0 degrees.

[0106] For example, a user can touch or press a button on an electronic device that is in a screen-off state to put the electronic device into a locked screen state. After the electronic device is locked in a lock screen mode, the user needs to unlock the screen using a fingerprint, password, voiceprint, or other unlocking method before entering the desktop mode.

[0107] In some specific implementations, there are several methods for determining whether the electronic device is in the folded state:

[0108] The first method: a distance sensor 160A can be set at the leftmost and rightmost ends of the electronic device, and whether the electronic device is in the folded state is determined based on the distance value obtained by the distance sensor 160A. If the distance value obtained by the distance sensor 160A is 0 or very close to 0, it can be determined that the electronic device is in the folded state.

[0109] The second method: an ambient light sensor 160C may be provided at the inner screen of the electronic device, and the electronic device may be judged whether it is in the folded state based on the ambient light value acquired by the ambient light sensor 160C. If the ambient light value acquired by the ambient light sensor 160C is 0 or very close to 0, it may be judged that the electronic device is in the folded state.

[0110] The third method: An angle sensor 160D may be provided at the inner screen and the outer screen of the electronic device respectively. The angle sensor 160D may include an acceleration sensor and a gyroscope sensor, etc. By combining the values ​​collected by the gyroscope sensor and the acceleration sensor on the inner screen and the outer screen, the opening and closing angle of the electronic device is obtained to determine whether the electronic device is in a folded state. If the opening and closing angle is 0 degrees or very close to 0 degrees, it can be determined that the electronic device is in a folded state.

[0111] It should be noted that this application does not limit the method for determining whether an electronic device is in a folded state.

[0112] When the outer screen of the electronic device is in the locked screen state and the electronic device is in the folded state, the lock screen image can be displayed in the first display frame of the outer screen. Fig. 6A and Fig. 7A , Fig. 6A A schematic diagram of a horizontal folding screen with an opening and closing angle of 0 degrees provided in an embodiment of the present application, Fig. 7A A schematic diagram of a vertical folding screen with an opening and closing angle of 0 degrees provided in an embodiment of the present application. The opening and closing angle of 0 degrees indicates that the electronic device is in a folded state, at which time the outer screen is in a bright screen state and the inner screen is in a dark screen state. As shown in the second figure, a square lock screen image is displayed in the first display frame of the outer screen.

[0113] It should be noted that the above-mentioned first display frame can be the display part of the entire external screen, or it can be a display frame of any size in the external screen. This application does not limit the size and position of the first display frame.

[0114] It is understandable that the lock screen image can be a static image or a dynamic image. If the lock screen image is a dynamic image, when the external screen of the electronic device is in the lock screen state and the electronic device is in the folded state, the first display frame of the external screen displays the starting image frame of the dynamic image.

[0115] S502: In response to the user's unfolding operation on the electronic device, displaying a lock screen image in a second display frame of the second display screen.

[0116] When the user performs an expansion operation on the electronic device, the electronic device can obtain the expansion angle of the electronic device (i.e., the opening and closing angle) of the user, and determine based on the opening and closing angle whether to display the lock screen image in the second display frame of the inner screen, or to keep the inner screen in the off state.

[0117] In some specific implementations, the mobile wallpaper apk (Android application package) of the electronic device can be connected to the angle sensor 160D, and obtain the opening and closing angle of the inner screen through the angle sensor 160D. After the mobile wallpaper apk is connected to the angle sensor 160D, once the opening and closing angle of the electronic device changes, the mobile wallpaper apk can read the opening and closing angle uploaded by the angle sensor 160D, that is, the mobile wallpaper apk can monitor the electronic device at any time to obtain the opening and closing angle of the electronic device.

[0118] Specifically, the electronic device can collect the three-axis (X-axis, Y-axis, Z-axis) data (in m / s) of the electronic device in the camera coordinate system through the acceleration sensor of the angle sensor 160D. 2), three-axis data of the gyroscope sensor after zero bias correction (in rad / d). Then, the electronic device can extract the acceleration sensor value (in m / s2) and the system time (or timestamp) corresponding to the data from the three-axis data of the acceleration sensor of the external screen through a filtering algorithm, and then use these parameters to further calculate through a fusion algorithm to obtain the opening and closing angle of the electronic device. It can be understood that the above sampling frequency can be 100Hz, 50Hz, 200Hz, etc., and this application does not limit the specific sampling frequency.

[0119] When the electronic device receives the user's unfolding operation on the electronic device, it needs to first determine whether the opening and closing angle is greater than the angle threshold. Only when the opening and closing angle reaches the angle threshold can the electronic device display the lock screen image in the second display frame of the inner screen, and the outer screen of the electronic device is in the off state; when the opening and closing angle does not reach the angle threshold, the inner screen of the electronic device cannot display the lock screen image and is in the off state, and the lock screen image is still displayed on the outer screen.

[0120] In some specific implementations, the angle threshold may be 45 degrees, that is, the lock screen image can be displayed in the second display frame of the inner screen only when the opening and closing angle is greater than or equal to 45 degrees. It should be noted that the angle threshold may be set by those skilled in the art when developing electronic devices, or may be set by users according to personal habits in actual use. The angle threshold may also be 40 degrees, 50 degrees, etc. The application does not limit the size and setting method of the specific angle threshold.

[0121] For some examples, see Figure 6B and Figure 7B , Figure 6B A schematic diagram of a horizontal folding screen with an opening and closing angle less than 45 degrees provided in an embodiment of the present application, Figure 7B A schematic diagram of a longitudinal folding screen with an opening and closing angle less than 45 degrees provided in an embodiment of the present application. At this time, since the opening and closing angle of the electronic device does not reach the angle threshold of 45 degrees, the electronic device still displays the display function to the user through the external screen.

[0122] See also Figure 6C and Figure 7C , Figure 6C A schematic diagram of a horizontal folding screen with an opening and closing angle greater than 45 degrees provided in an embodiment of the present application, Figure 7C A schematic diagram of a longitudinal folding screen with an opening and closing angle greater than 45 degrees provided in an embodiment of the present application. At this time, since the opening and closing angle of the electronic device has reached the angle threshold of 45 degrees, the electronic device changes to display the display function to the user through the inner screen. At this time, the square lock screen image begins to be displayed in the second display frame of the inner screen.

[0123] It is understandable that the position of the second display frame on the inner screen corresponds to the position of the first display frame on the outer screen. For example, if the first display frame is located in the middle of the outer screen, then the second display frame is located in the middle of the inner screen on the first body. It should be noted that this application does not limit the specific positions of the first display frame and the second display frame.

[0124] It can be understood that if the lock screen image is a dynamic image, then when the inner screen of the electronic device is in the bright screen state, that is, when the opening and closing angle of the electronic device reaches the angle threshold, the second display frame of the inner screen displays the starting image frame of the dynamic image, which is the same as the image frame displayed in the first display frame of the external screen.

[0125] S503: Based on the unfolded angle of the electronic device, move the second display frame toward the center of the second display screen.

[0126] According to the increase of the opening and closing angle obtained by the electronic device, the second display frame gradually moves toward the center of the inner screen.

[0127] For some examples, see Fig.6D , Fig. 6E and Fig. 6F , Fig.6D A schematic diagram of a horizontal folding screen with an opening and closing angle of 45 degrees to 90 degrees provided in an embodiment of the present application; Fig. 6E A schematic diagram of a horizontal folding screen with an opening and closing angle of 90 degrees provided in an embodiment of the present application; Fig. 6F A schematic diagram of a horizontal folding screen with an opening and closing angle of 180 degrees provided in an embodiment of the present application.

[0128] When the opening angle of the electronic device reaches the angle threshold, so that the lock screen image is displayed in the second display frame of the inner screen, as the opening angle of the electronic device increases, the second display frame gradually moves to the right until the opening angle reaches 180 degrees or very close to 180 degrees, that is, when the electronic device is in the unfolded state, the second display frame moves to the center of the inner screen.

[0129] For other examples, see Fig.7D , Fig. 7E and Figure 7F , Fig.7D A schematic diagram of a longitudinal folding screen with an opening and closing angle of 45 degrees to 90 degrees provided in an embodiment of the present application; Fig. 7E A schematic diagram of a longitudinal folding screen with an opening and closing angle of 90 degrees provided in an embodiment of the present application; Figure 7F A schematic diagram of a longitudinal folding screen with an opening and closing angle of 180 degrees provided in an embodiment of the present application.

[0130] When the opening and closing angle of the electronic device reaches the angle threshold, so that the lock screen image is displayed in the second display frame of the inner screen, as the opening and closing angle of the electronic device increases, the second display frame gradually moves downward until the opening and closing angle reaches 180 degrees or very close to 180 degrees, that is, when the electronic device is in the unfolded state, the second display frame moves to the center position of the inner screen.

[0131] In some specific implementations, the speed at which the second display frame moves toward the center of the inner screen may be positively correlated with the speed at which the user unfolds the electronic device. This application does not limit the specific moving speed.

[0132] It can be understood that if the lock screen image is a dynamic image, then when the opening and closing angle of the electronic device exceeds the angle threshold, the second display frame of the inner screen displays other image frames of the dynamic image except the starting image frame, that is, the electronic device will display and play the dynamic image as the lock screen image.

[0133] In some specific implementations, the lock screen image is the final effect rendered by software such as OpenGL and engine rendering. Specifically, OpenGL (Open Graphics Library) is a cross-language, cross-platform application programming interface (API) for rendering 2D and 3D vector graphics. This application does not limit the specific rendering software.

[0134] S504: When the second display frame reaches the center of the second display screen, the lock screen image in the second display frame is the lock screen wallpaper of the electronic device.

[0135] See also Fig. 6F and Figure 7F When the second display frame reaches the center of the inner screen, the lock screen image in the second display frame is the lock screen image of the electronic device. At this time, the electronic device is still in a locked screen state and the user needs to unlock it using fingerprint, password, voiceprint or other unlocking methods before entering the desktop mode.

[0136] Specifically, the desktop mode is the mode after the electronic device is unlocked. For example, the user can operate the electronic device in the desktop mode to use the corresponding functions provided by the electronic device. For example, the user can use a chat application, a video application, etc.

[0137] It is understandable that if the lock screen image is a dynamic image, then when the electronic device is in the unfolded state, the second display frame of the inner screen displays the last image frame of the dynamic image. In other words, the dynamic image is displayed as the lock screen wallpaper from the time when the opening and closing angle of the electronic device reaches the angle threshold until the opening and closing angle reaches 180 degrees or very close to 180 degrees.

[0138] It should be noted that the collaborative display method provided in the embodiment of the present application can be applied not only to the process of switching the folding screen electronic device from the folded state to the unfolded state, that is, the process of switching from using the outer screen to using the inner screen, as described above, but also to the process of switching the folding screen electronic device from the unfolded state to the folded state, that is, the process of switching from using the inner screen to using the outer screen. The present application does not limit the unfolding or folding of the folding screen.

[0139] The present application provides a collaborative display method, when the first display screen of an electronic device is in a lock screen state, and the electronic device is in a folded state, a lock screen image is displayed in a first display frame of the first display screen; in response to the user's unfolding operation of the electronic device, the lock screen image is displayed in a second display frame of the second display screen, and the second display frame is moved toward the center of the second display screen, and when the second display frame reaches the center of the second display screen, the lock screen image in the second display frame is the lock screen wallpaper of the electronic device. Wherein, the position of the first display frame on the first display screen corresponds to the starting position of the second display frame on the second display screen. Thus, when switching from using an external screen to using an internal screen, or when switching from using an internal screen to using an external screen, the content displayed on the external screen and the content displayed on the internal screen can be linked and coordinated to enhance the fun of user use.

[0140] See also Figure 8 , which is a flow chart of another collaborative display method provided by an embodiment of the present application. It should be noted that steps S801-S803 are the same as steps S501-S503, and will not be repeated here. The method includes:

[0141] S801: When the first display screen of the electronic device is in a locked screen state and the electronic device is in a folded state, displaying a locked screen image in a first display frame of the first display screen.

[0142] S802: In response to the user's unfolding operation on the electronic device, displaying a lock screen image in a second display frame on a second display screen.

[0143] S803: Based on the unfolded angle of the electronic device, move the second display frame toward the center of the second display screen.

[0144] S804: When the second display frame reaches the center of the second display screen, the lock screen image in the second display frame is the desktop wallpaper of the electronic device.

[0145] See also Fig. 9, this figure is a schematic diagram of an unfolded folding screen electronic device provided in an embodiment of the present application. When the electronic device is unfolded to 180 degrees or very close to 180 degrees, that is, when the electronic device is in the unfolded state, the second display frame reaches the center of the inner screen. Then, when the second display frame reaches the center of the inner screen, the lock screen image in the second display frame is the wallpaper image of the electronic device. In other words, the electronic device has been unlocked and entered the desktop mode at this time. Specifically, the desktop mode is the mode after the electronic device is unlocked. Exemplarily, the user can operate the electronic device in desktop mode to use the corresponding functions provided by the electronic device. For example, the user can use chat applications, video applications, and the like.

[0146] It is understandable that if the lock screen image is a dynamic image, then when the electronic device is in the expanded state, the second display frame of the inner screen displays the last image frame of the dynamic image, that is, the wallpaper image of the electronic device is the last image frame of the dynamic image.

[0147] It is understandable that the lock screen image may also be dynamically processed such as size, blur, and deformation, and the processed image may be used as the desktop wallpaper of the electronic device.

[0148] It should be noted that the collaborative display method provided in the embodiment of the present application can be applied not only to the process of switching the folding screen electronic device from the folded state to the unfolded state, that is, the process of switching from using the outer screen to using the inner screen, as described above, but also to the process of switching the folding screen electronic device from the unfolded state to the folded state, that is, the process of switching from using the inner screen to using the outer screen. The present application does not limit the unfolding or folding of the folding screen.

[0149] The present application provides a collaborative display method. The present application provides a collaborative display method. When the first display screen of an electronic device is in a lock screen state and the electronic device is in a folded state, a lock screen image is displayed in a first display frame of the first display screen; in response to the user's unfolding operation of the electronic device, the lock screen image is displayed in a second display frame of the second display screen, and the second display frame is moved toward the center of the second display screen, and when the second display frame reaches the center of the second display screen, the lock screen image in the second display frame is the desktop wallpaper of the electronic device, wherein the position of the first display frame on the first display screen corresponds to the starting position of the second display frame on the second display screen. Thus, when switching from using an external screen to using an internal screen, or when switching from using an internal screen to using an external screen, the content displayed on the external screen and the content displayed on the internal screen can be linked and coordinated to enhance the fun of user use.

[0150] An embodiment of the present application also provides a computer-readable storage medium, characterized in that a computer program or instruction is stored in the computer-readable storage medium, and when the computer program or instruction is executed, each function or step performed by the electronic device in the above method embodiment is implemented.

[0151] An embodiment of the present application also provides a computer program product, including a computer program or instructions, characterized in that when the computer program or instructions are executed by a processor, each function or step performed by the electronic device 100 in the above method embodiment is implemented.

[0152] See also Fig.10 , which is a schematic diagram of a collaborative display device provided in an embodiment of the present application. It should be noted that the collaborative display device 1000 is applied to an electronic device including a first display screen (external screen) and a second display screen (internal screen), wherein the second display screen is foldable. The collaborative display device 1000 includes: a display module 1001 and a mobile module 1002.

[0153] The display module 1001 is used to display a lock screen image in a first display frame of the first display screen when the first display screen of the electronic device is in a lock screen state and the electronic device is in a folded state. The moving module 1002 is used to display a lock screen image in a second display frame of the second display screen in response to a user's unfolding operation of the electronic device, and to move the second display frame toward the center of the second display screen, and the position of the first display frame on the first display screen corresponds to the starting position of the second display frame on the second display screen.

[0154] In some specific implementations, the speed at which the second display frame moves toward the center of the second display screen is positively correlated with the speed at which the user unfolds the electronic device.

[0155] In some specific implementations, the collaborative display device 1000 further includes a lock screen module. The lock screen module is used to use the lock screen image as a lock screen wallpaper of the electronic device when the second display frame reaches the center of the second display screen.

[0156] In some specific implementations, the collaborative display device 1000 further includes a desktop module. The desktop module is used to use the lock screen image as the desktop wallpaper of the electronic device when the second display frame reaches the center of the second display screen.

[0157] In some specific implementations, the lock screen image may be a dynamic image. Then, the display module 1001 is specifically used to display the starting image frame of the dynamic image in the first display frame of the first display screen; and the movement module 1002 is specifically used to display the dynamic image in the second display frame of the second display screen.

[0158] In some specific implementations, the desktop module may be specifically used to: use the last image frame of the dynamic image as the desktop wallpaper of the electronic device.

[0159] In some specific implementations, the collaborative display device 1000 further includes: an acquisition module. The acquisition module is used to: acquire the opening and closing angle of the electronic device. Then, the display module 1001 is specifically used to: determine whether the opening and closing angle is greater than or equal to the angle threshold; if so, display the lock screen image in the second display frame of the second display screen.

[0160] In some specific implementations, the collaborative display device 1000 further includes: a screen-off module. The screen-off module is used to: put the first display screen in a screen-off state.

[0161] The present application provides a collaborative display device, which includes a display module and a mobile module. Through the display module and the mobile module, when switching from using an external screen to using an internal screen, or when switching from using an internal screen to using an external screen, the content displayed on the external screen and the content displayed on the internal screen can be linked and coordinated to enhance the fun of user use.

[0162] Through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0163] In the several embodiments provided in this embodiment, it should be understood that the disclosed system and method can be implemented in other ways. For example, the embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0164] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0165] In addition, each functional unit in each embodiment of the present embodiment may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0166] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment. The aforementioned storage medium includes: flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk and other media that can store program codes.

[0167] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A collaborative display method, characterized in that: Applied to an electronic device, the electronic device comprises a first body and a second body, a second display screen is arranged on a first surface of the first body and a first surface of the second body, a first display screen is arranged on the second surface of the first body, the second display screen is foldable, and the second display screen comprises a first surface and a second surface, the method comprises: When the first display screen of the electronic device is in a locked screen state and the electronic device is in a folded state, a lock screen image is displayed in a first display frame of the first display screen, and the lock screen image is a dynamic image. Whether the electronic device is in the folded state is determined by the following method: Determining whether the electronic device is in the folded state by using a distance value collected by a distance sensor on the first display screen, or determining whether the electronic device is in the folded state by using an ambient light value collected by an ambient light sensor on the first display screen; In response to an unfolding operation on the electronic device and the opening and closing angle of the electronic device being greater than or equal to an angle threshold, the lock screen image is displayed in a second display frame of the second display screen, and as the opening and closing angle of the electronic device increases, the second display frame is moved toward the center of the second display screen, the position of the first display frame on the first display screen is the same as the starting position of the second display frame on the first surface, the speed at which the second display frame moves toward the center of the second display screen is positively correlated with the speed at which the opening and closing angle of the electronic device changes, and when the opening and closing angle of the electronic device reaches the angle threshold, the image frames displayed in the second display frame and the first display frame are the same and are both starting image frames of a dynamic image; When the opening and closing angle of the electronic device exceeds the angle threshold, the second display frame displays other image frames of the dynamic image except the starting image frame; When the electronic device is in the unfolded state, the second display frame displays the last image frame of the dynamic image; The opening and closing angle is obtained by: Collect the three-axis angular velocity sensor data of the electronic device in the camera coordinate system and the three-axis data of the gyroscope sensor after zero bias correction; extract the acceleration sensor value and the timestamp corresponding to the data from the three-axis data of the acceleration sensor of the external screen through a filtering algorithm; Performing a fusion algorithm calculation on the angular velocity sensor data, the three-axis data of the gyroscope sensor after zero bias correction, the extracted acceleration sensor value, and the timestamp corresponding to the data to obtain the opening and closing angle of the electronic device, where the three axes include an X-axis, a Y-axis, and a Z-axis; When the second display frame reaches the center position of the second display screen, the second display screen is unlocked, so that the last image frame of the dynamic image is used as the desktop wallpaper of the electronic device.

2. The method according to claim 1, characterized in that After moving the second display frame toward the center of the second display screen, the method further includes: When the second display frame reaches the center position of the second display screen, the lock screen image is used as the lock screen wallpaper of the electronic device.

3. The method according to claim 1, characterized in that The lock screen image is a dynamic image; The displaying of the lock screen image in the first display frame of the first display screen includes: Displaying a starting image frame of the dynamic image in a first display frame of the first display screen; The displaying the lock screen image in the second display frame of the second display screen includes: The dynamic image is displayed in a second display frame of the second display screen.

4. The method according to claim 2, characterized in that: The step of using the lock screen image as the desktop wallpaper of the electronic device comprises: The last image frame of the dynamic image is used as the desktop wallpaper of the electronic device.

5. The method according to claim 1, characterized in that After displaying the lock screen image in the second display frame of the second display screen, the method further includes: Turn off the first display screen.

6. An electronic device, characterized in that: comprising a first display screen, a second display screen, a processor and a memory; The first display screen and the second display screen are used to display images; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to any one of claims 1 to 5.

7. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program or instruction, and when the computer program or instruction is executed, the method according to any one of claims 1 to 5 is implemented.

Images