Display method of electronic device with folding screen

Abstract

A display method of an electronic device with a folding screen relates to the technical field of terminals and can solve the problem of image misplacement of inner and outer screens in the process of switching the screen state of the electronic device. The electronic device comprises an inner screen and an outer screen, and the camera of the electronic device comprises a first camera and a second camera, wherein the first camera is a front camera of the inner screen, and the second camera is a front camera of the outer screen. The display method comprises the following steps: acquiring a first image collected by the camera of the electronic device; determining whether the first image meets a first preset condition in the process of changing the folding state of the screen of the electronic device; and in the case that the first image meets the first preset condition, controlling a target display screen of the electronic device to present the first image, wherein the first preset condition comprises that the camera collecting the first image matches the target display screen, and the target display screen is a display screen currently displaying an image of the electronic device or a display screen currently to be displaying an image of the electronic device.

Description

[0001] This application is a divisional application. The original application has the application number 202210184577.7 and the original application date is February 28, 2022. The entire contents of the original application are incorporated herein by reference. Technical Field

[0002] This application relates to the field of terminal technology, and in particular to a display method for an electronic device with a foldable screen. Background Technology

[0003] With the continuous development of electronic devices and displays, and the increasing demands of people's lives, electronic devices with foldable displays have emerged. Currently, camera functionality is a common feature of electronic devices, allowing users to make video calls, take photos, or record videos. In foldable screen electronic devices, the inner and outer screen cameras dynamically switch as the screen folds and unfolds. For example, when the user uses the inner screen, it displays a preview image captured by the camera located on the inner screen; when the user uses the outer screen, it displays a preview image captured by the camera located on the outer screen. However, during the switching between the inner and outer screens, there is a possibility of image misalignment. For instance, the electronic device may have switched from displaying on the outer screen to displaying on the inner screen, but the preview image displayed on the inner screen may still be the image captured by the camera on the outer screen. Summary of the Invention

[0004] This application provides a display method for an electronic device with a foldable screen. Based on this method, after the electronic device acquires a first image captured by a camera, during the process of changing the folding state of the electronic device, when the electronic device determines that the camera and the target display screen are matched, the electronic device controls the target display screen to display the first image. Thus, the electronic device ensures that the target display screen for displaying the image matches the camera that sends the image; for example, the outer screen displays the image captured by the front-facing camera of the outer screen, and the inner screen displays the image captured by the front-facing camera of the inner screen. This solves the problem of misaligned images when switching between the inner and outer screens of a foldable screen, improving the user experience.

[0005] To achieve the above objectives, this application adopts the following technical solution:

[0006] In a first aspect, embodiments of this application provide a display method for an electronic device with a foldable screen. The electronic device includes an inner screen and an outer screen. The camera of the electronic device includes a first camera and a second camera, wherein the first camera is a front-facing camera of the inner screen and the second camera is a front-facing camera of the outer screen. The display method includes: acquiring a first image captured by the camera of the electronic device; determining whether the first image meets the first preset condition during the process of the electronic device changing the screen folding state; and controlling a target display screen of the electronic device to display the first image when the first image meets the first preset condition. The first preset condition includes that the camera that captured the first image matches the target display screen, and the target display screen is a display screen of the image currently displayed by the electronic device or a display screen of the image to be displayed by the electronic device.

[0007] The first image may be an image captured by the first camera or an image captured by the second camera.

[0008] It is understandable that the process of an electronic device changing its screen folding state can be either a gradual transition from an unfolded state to a folded state, or a gradual transition from a folded state to an unfolded state.

[0009] In one embodiment, during the process of the electronic device changing from an unfolded state to a folded state, the electronic device determines whether the first image meets a first preset condition. If the electronic device determines that the first image is an image captured by the second camera, that is, the first image is an image captured by the front-facing camera of the outer screen, then the electronic device determines that the first image meets the first preset condition, and the target display screen of the electronic device displays the first image, wherein the target display screen is the outer screen of the electronic device.

[0010] In another embodiment, during the process of the electronic device changing from a folded state to an unfolded state, the electronic device determines whether the first image meets a first preset condition. If the electronic device determines that the first image is an image captured by the first camera, that is, the first image is an image captured by the front-facing camera of the inner screen, then the electronic device determines that the first image meets the first preset condition, and the target display screen of the electronic device displays the first image, wherein the target display screen is the inner screen of the electronic device.

[0011] In this embodiment of the application, during the process of changing the screen state of the electronic device, the electronic device determines that the camera that captured the first image matches the target display screen. For example, the outer screen displays the image captured by the front camera of the outer screen, and the inner screen displays the image captured by the front camera of the inner screen. This solves the problem of misalignment of the screen image when switching between the inner and outer screens of the foldable screen, and improves the user experience.

[0012] In one possible implementation, determining whether the first image meets the first preset condition includes: if the first image is an image captured by the first camera and the target display screen is an inner screen, the first image meets the first preset condition; or, if the first image is an image captured by the second camera and the target display screen is an outer screen, the first image meets the first preset condition.

[0013] This can be understood as follows: If the electronic device determines that the first image captured by the camera is an image captured by the front-facing camera of the inner screen, and the target display screen is the inner screen, then the electronic device determines that the camera capturing the first image matches the target display screen, meaning the first image satisfies the first preset condition. If the electronic device determines that the first image captured by the camera is an image captured by the front-facing camera of the outer screen, and the target display screen is the outer screen, then the electronic device determines that the camera capturing the first image matches the target display screen, meaning the first image satisfies the first preset condition.

[0014] In another possible implementation, determining whether the first image meets the first preset condition includes: if the first image is an image captured by the first camera and the target display screen is an outer screen, the first image does not meet the first preset condition; or, if the first image is an image captured by the second camera and the target display screen is an inner screen, the first image does not meet the first preset condition.

[0015] This can be understood as follows: if the electronic device determines that the first image captured by the camera is an image captured by the front-facing camera of the inner screen, and the target display screen is the outer screen, then the electronic device determines that the camera capturing the first image does not match the target display screen, meaning the first image does not meet the first preset condition. Conversely, if the electronic device determines that the first image captured by the camera is an image captured by the front-facing camera of the outer screen, and the target display screen is the inner screen, then the electronic device determines that the camera capturing the first image does not match the target display screen, meaning the first image does not meet the first preset condition.

[0016] In another possible implementation, the above display method may further include: if the first image does not meet the first preset condition, controlling the target display screen of the electronic device to display a second image, the second image being an image captured by a camera matched with the target display screen and pre-stored in the electronic device; or, if the first image does not meet the first preset condition, controlling the target display screen of the electronic device not to display the first image.

[0017] The second image can be a historical image captured by a camera matching the target display screen and stored in advance by the electronic device. For example, if the target display screen is an outer screen, the second image can be an image captured by the front-facing camera of the outer screen and stored in advance by the electronic device; if the target display screen is an inner screen, the second image can be an image captured by the front-facing camera of the inner screen and stored in advance by the electronic device.

[0018] In some embodiments, when the first image captured by the camera obtained by the electronic device does not meet the first preset condition, the target display screen may display a pre-stored image captured by a camera that matches the target display screen.

[0019] In other embodiments, if the first image captured by the camera acquired by the electronic device does not meet a first preset condition, the target display screen of the electronic device will not display the first image. In this case, the target display screen of the electronic device will be a black screen, a white screen, or display a specific image.

[0020] In another possible implementation, after acquiring the first image captured by the camera of the electronic device, the display method may further include: if the first image is an image captured by the first camera, determining the image identifier of the first image as a first identifier; if the first image is an image captured by the second camera, determining the image identifier of the first image as a second identifier; determining whether the first image meets a first preset condition, including: determining whether the first image meets the first preset condition based on the image identifier of the first image and the target display screen.

[0021] This can be understood as the electronic device marking the first image with an identifier based on the camera that captured the first image. For example, the image identifier of the first image captured by the first camera is marked as the first identifier, and the image identifier of the first image captured by the second camera is marked as the second identifier.

[0022] In another possible implementation, determining whether the first image meets the first preset condition based on the image identifier of the first image and the target display screen includes: determining that the first image meets the first preset condition when the target display screen is an inner screen and the image identifier of the first image is a first identifier; and determining that the first image meets the first preset condition when the target display screen is an outer screen and the image identifier of the first image is a second identifier.

[0023] This can be understood as follows: the first image is identified by a first identifier, meaning the first image is captured by the first camera. When the target display screen is an inner screen, the electronic device determines that the first image meets a first preset condition. Alternatively, the first image can be identified by a second identifier, meaning the first image is captured by the second camera. When the target display screen is an outer screen, the electronic device determines that the first image meets the first preset condition.

[0024] Therefore, the electronic device can identify the camera that captured the first image based on the image identifier of the first image, and the electronic device can determine that the camera that captured the first image matches the target display screen, thereby avoiding the problem of misalignment of the image captured by the camera during the screen switching process of the electronic device.

[0025] In another possible implementation, when the first image meets the first preset condition, the target display screen of the electronic device is controlled to display the first image, including: determining the image identifier of the first image as a third identifier, the third identifier being used to indicate that the first image is directly sent for display; and controlling the target display screen of the electronic device to display the first image with the third identifier.

[0026] In one embodiment, when the electronic device determines that the camera capturing the first image matches the target display screen, the electronic device can mark the image identifier of the first image as a third identifier. Therefore, when the electronic device determines that the image identifier of the first image is the third identifier, the electronic device can directly display the first image on the target display screen, thereby ensuring that the camera capturing the first image matches the target display screen and avoiding the problem of misaligned image display during screen switching of the electronic device.

[0027] In another possible implementation, the method further includes: if the first image does not meet the first preset condition, determining the image identifier of the first image as a fourth identifier, the fourth identifier being used to indicate that the first image is discarded.

[0028] In one embodiment, if the electronic device determines that the camera capturing the first image does not match the target display screen, the electronic device can mark the image identifier of the first image as a fourth identifier. When the electronic device determines that the image identifier of the first image is the fourth identifier, the target display screen of the electronic device does not display the first image until the image identifier of the first image acquired by the electronic device is the third identifier, at which point the first image is presented on the target display screen.

[0029] When the target display screen of the electronic device does not display the first image, the target display screen of the electronic device may display a second image, wherein the second image is an image captured by a camera that matches the target display screen and is pre-stored in the electronic device.

[0030] In another possible implementation, the inner screen of the electronic device includes a first screen and a second screen, characterized in that, before determining whether the first image meets the first preset condition, the method further includes: determining that the electronic device is in the process of changing the screen folding state based on the included angle between the first screen and the second screen.

[0031] In one embodiment, when the electronic device determines that the angle between the first screen and the second screen is gradually decreasing, the electronic device determines that the screen state changes from an unfolded state to a folded state; when the electronic device determines that the angle between the first screen and the second screen is gradually increasing, the electronic device determines that the screen state changes from a folded state to an unfolded state.

[0032] During the process of changing the screen state of an electronic device, the electronic device can obtain the angle between the first screen and the second screen in real time. Then, the electronic device can determine the current screen state based on the angle, thereby improving the accuracy of the screen state determination of the electronic device.

[0033] Secondly, this application provides an electronic device including an inner screen and an outer screen, and further including a first camera and a second camera, wherein the first camera is a front-facing camera of the inner screen and the second camera is a front-facing camera of the outer screen. The electronic device has the function of implementing the method described in the first aspect. This function can be implemented by hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above function. For example, the electronic device includes a processing module for acquiring a first image captured by the camera of the electronic device; determining whether the first image meets a first preset condition during the process of the electronic device changing the screen folding state; and controlling the target display screen of the electronic device to display the first image when the first image meets the first preset condition. The first preset condition includes that the camera that acquired the first image matches the target display screen, and the target display screen is either the display screen of the image currently displayed by the electronic device or the display screen of the image to be displayed by the electronic device.

[0034] Thirdly, this application provides an electronic device, including: a touch screen, the touch screen including a touch sensor and a display screen; one or more processors; a memory; wherein the memory stores one or more computer programs, the one or more computer programs including instructions, which, when executed by the electronic device, cause the electronic device to perform the display method of the electronic device with a foldable screen as described in any of the first aspects above.

[0035] Fourthly, this application provides a computer-readable storage medium storing instructions that, when executed on an electronic device, cause the electronic device to perform the display method of an electronic device with a foldable screen as described in any one of the first aspects.

[0036] Fifthly, this application provides a computer program product, which includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the display method of the electronic device with a foldable screen as described in any one of the first aspects.

[0037] It is understood that the electronic devices described in the second and third aspects, the computer storage medium described in the fourth aspect, and the computer program product described in the fifth aspect are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here. Attached Figure Description

[0038] Figure 1 This is a schematic diagram of a foldable screen phone when folded, provided as an embodiment of this application.

[0039] Figure 2 This is a schematic diagram of a foldable screen phone unfolded according to an embodiment of this application;

[0040] Figure 3 This application provides an illustration of an application scenario for the display method provided in the embodiments of this application. Figure 1 ;

[0041] Figure 4 This application provides an illustration of an application scenario for the display method provided in the embodiments of this application. Figure 2 ;

[0042] Figure 5 This application provides an illustration of an application scenario for the display method provided in the embodiments of this application. Figure 3 ;

[0043] Figure 6 A schematic diagram of the structure of an electronic device provided in an embodiment of this application;

[0044] Figure 7 A schematic diagram illustrating the principle of calculating the angle between screen A and screen B, provided for an embodiment of this application;

[0045] Figure 8 A schematic diagram illustrating an example of a geographic coordinate system provided in this application embodiment;

[0046] Figure 9 A software structure diagram of an electronic device provided in an embodiment of this application;

[0047] Figure 10 Flowchart of the display method provided in the embodiments of this application Figure 1 ;

[0048] Figure 11 This application provides an illustration of an application scenario for the display method provided in the embodiments of this application. Figure 4 ;

[0049] Figure 12 Example diagram of the cache structure provided in the embodiments of this application;

[0050] Figure 13Flowchart of the display method provided in the embodiments of this application Figure 2 ;

[0051] Figure 14 This application provides an illustration of an application scenario for the display method provided in the embodiments of this application. Figure 5 ;

[0052] Figure 15 This application provides an illustration of an application scenario for the display method provided in the embodiments of this application. Figure 6 ;

[0053] Figure 16 This is another structural schematic diagram of the electronic device provided in the embodiments of this application. Detailed Implementation

[0054] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; the term "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone.

[0055] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of embodiments of this application, unless otherwise stated, "a plurality of" means two or more.

[0056] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.

[0057] The electronic device in this application embodiment includes a foldable screen, which can be unfolded or folded along the folding axis, and can present different display areas in different states. Taking a foldable screen mobile phone as an example, the different display areas presented by the electronic device in different states are explained.

[0058] Figure 1 This is a schematic diagram illustrating a foldable screen phone when folded, as provided in an embodiment of this application. Figure 1As shown in (a), when the foldable phone is in a fully folded state and the external front-facing camera 1 is activated, the image captured by the external front-facing camera 1 is displayed on the external screen 11. Figure 1 As shown in (b), when the foldable screen phone is in a folded state and the image is output using the rear camera 2 on the outer screen, the image captured by the rear camera 2 on the outer screen is displayed on the outer screen 11.

[0059] Figure 2 This is a schematic diagram illustrating a foldable screen phone unfolded according to an embodiment of this application. The unfolding process of the foldable screen phone is as follows: Figure 2 (a) to Figure 2 As shown in (b) in the diagram. Figure 2 As shown in (b), assuming the foldable phone is in the unfolded state and the image is output using the inner screen front camera 3, the image captured by the inner screen front camera 3 is displayed by the inner screen 21 or the inner screen 22, or by a large screen display composed of the inner screen 21 and the inner screen 22. Figure 2 When a foldable phone is fully unfolded, for example, Figure 2 As shown in (b), the screen angle θ of the mobile phone can be 180° or approximately 180°, enabling a large-screen display, providing users with richer information, and offering a better user experience. Specifically, the screen angle θ can be the angle between inner screen 21 and inner screen 22. Figure 2 As shown in (c), from the outside of the foldable phone, the foldable screen presents an outer screen 23. When the foldable phone is in the unfolded state and the image is captured by the rear camera 1 on the outer screen, the image captured by the rear camera 1 is displayed on the outer screen 23. The outer screen 23 can be located on the back of the inner screen 21 or the inner screen 22. Figure 2 The description is for illustrative purposes only and is not intended to be limiting. When the foldable phone is in the unfolded state and the image is captured by the external screen front camera 2, the image captured by the external screen front camera 2 can be displayed on the inner screen 21 and / or the inner screen 22.

[0060] It should be explained that the angle θ between inner screen 21 and inner screen 22 can range from [0°, 180°]. In this embodiment, if θ is within the range of [0°, X], the foldable phone is determined to be in a folded state; if θ is within the range of (X, 180°), the foldable phone is determined to be in an unfolded state. Here, X is a preset angle threshold. X can be set by the user in the electronic device, or it can be determined by the electronic device based on the user's usage habits. In this embodiment, the value of X is not limited. For example, X can be set to 85°, 90°, or 95°, etc. Assuming X is set to 90°, if the angle θ between inner screen 21 and inner screen 22 is less than or equal to 90°, the foldable phone is determined to be in a folded state; if the angle θ between inner screen 21 and inner screen 22 is greater than 90°, the foldable phone is determined to be in a folded state.

[0061] For example, such as Figure 1 As shown in (a), when the foldable phone is in the folded state and the user uses the front-facing camera 1 on the outer screen for video calls or photo previews, the foldable phone uses the front-facing camera 1 on the outer screen to capture images, and the images captured by the front-facing camera 1 are displayed on the outer screen 11. In response to the user manually opening the foldable screen, the foldable screen switches from the folded state to the unfolded state. For example, the unfolded state of the foldable phone is as follows: Figure 2 As shown in (b) above, the foldable phone uses the inner screen front-facing camera 3 to capture images, and the images captured by the inner screen 21 and / or inner screen 22 are displayed. It can be seen that in video or photography scenarios, the foldable phone's camera switches according to the screen state, realizing the process of switching from capturing images from the outer screen front-facing camera 1 to capturing images from the inner screen front-facing camera 3, and also realizing the process of switching from displaying images on the outer screen to displaying images on the inner screen.

[0062] Similarly, such as Figure 2 As shown in (b), when the foldable phone is in the unfolded state and the user uses the inner screen's front-facing camera 3 for video calls or photo previews, the foldable phone uses the inner screen's front-facing camera 3 to capture images, which are then displayed on the inner screen 21 and / or inner screen 22. In response to the user's manual folding operation, the foldable phone switches from the unfolded state to the folded state. For example, the folded state of the foldable phone is as follows: Figure 1 As shown in (a) above, the foldable phone uses the front-facing camera 1 on the outer screen to capture images, and the outer screen 11 displays the images captured by the front-facing camera 1. It can be seen that in video or photography scenarios, the foldable phone's camera switches according to the screen state, realizing the process of switching from capturing images with the inner screen's front-facing camera to capturing images with the outer screen's front-facing camera, and also realizing the process of switching from displaying images on the inner screen to displaying images on the outer screen.

[0063] It should be noted that the images mentioned in the embodiments of this application can refer to photographs or each frame of a video, and are not limited here. However, in related technologies, during the screen switching process of a foldable screen of an electronic device, there may be a situation where the camera corresponding to the image output has not completed the switching when the screen state switch is completed, or the screen used to display the image has not completed the switching when the camera used for image output has completed the switching, which may result in misalignment of the image when the screen sends the image.

[0064] In some embodiments, such as Figure 3As shown in (a), when the folding screen of the electronic device switches from screen 1 to screen 2, the electronic device has already completed the camera switch; that is, the camera used to capture images has switched from the camera corresponding to screen 1 to the camera corresponding to screen 2. However, screen 2 of the electronic device is not yet lit up. At this time, the image displayed on screen 1 is the image captured by the camera corresponding to screen 2. Here, screen 1 can be the outer screen of the folding screen of the electronic device, and screen 2 can be the inner screen of the folding screen of the electronic device. Of course, screen 1 can also be the outer screen of the electronic device, and the second screen can be the inner screen of the folding screen of the electronic device; this is not limited here.

[0065] In this configuration, if screen 1 is the outer screen, then the camera corresponding to screen 1 is the front-facing camera of the outer screen. If screen 1 is the inner screen, then the camera corresponding to screen 1 is the front-facing camera of the inner screen. Similarly, if screen 2 is the outer screen, then the camera corresponding to screen 2 is the front-facing camera of the outer screen. If screen 2 is the inner screen, then the camera corresponding to screen 2 is the front-facing camera of the inner screen.

[0066] As mentioned above Figure 1 and Figure 2 To illustrate, suppose screen 1 is... Figure 1 The outer screen 11 of the foldable phone shown in (a) can have a camera corresponding to the screen 1. Figure 1 The external front-facing camera 1 is shown in (a) of the image. Assume screen 2 is... Figure 2 The large screen of the foldable phone shown in (b) consists of inner screens 21 and 22. The camera corresponding to screen 2 can be... Figure 2 The inner screen front camera 3 is shown in (b) of the image.

[0067] For example, such as Figure 4 As shown, when the electronic device is in a folded state, the camera application of the electronic device captures an image in response to the user's shooting operation, and the screen 1 of the electronic device displays the image captured by the external front-facing camera 41. See [link / reference]. Figure 4 In (a) of the text, as the user switches from a folded state to an unfolded state, the camera used to capture images in the electronic device switches from the external screen's front-facing camera to the internal screen's front-facing camera. For example... Figure 4 As shown, the camera capturing images in the electronic device switches from the external screen front-facing camera 41 to the internal screen front-facing camera 42. However, when the camera switching is complete, the screen 2 of the electronic device is not yet lit. That is, the screen switching of the electronic device is not yet complete. In this case, the image captured by the internal screen front-facing camera 42 is still displayed on screen 1, and screen 2 is in a black screen state. See [reference needed]. Figure 4 (b) in the middle.

[0068] In other embodiments, such as Figure 3As shown in (b), when the electronic device switches from screen 1 to screen 2, screen 2 is already lit up, but the camera corresponding to screen 2 is not displaying an image (for example, the camera corresponding to screen 2 is still in the initialization phase). In this case, the image displayed on screen 2 is the image captured by the camera corresponding to screen 1.

[0069] For example, such as Figure 5 As shown, when the electronic device is in a folded state, the camera application of the electronic device captures images in response to the user's shooting operation, and the screen 1 of the electronic device displays the images captured by the external front-facing camera 51. See [link / reference]. Figure 5 In (a) of the text, in response to a user's action of switching from a folded state to an unfolded state, the screen displaying the image in the electronic device switches from screen 1 to screen 2. For example... Figure 5 As shown, the screen displaying the image in the electronic device switches from screen 1 to screen 2. However, when the screen switching is complete, the internal / external screen front-facing cameras of the electronic device have not yet finished switching. That is, the electronic device has not switched from the external screen front-facing camera 51 to the internal screen front-facing camera 52. In this case, the image captured by the external screen front-facing camera 51 when the folding screen is in the unfolded state is displayed on screen 2 of the electronic device (e.g., a balloon in the air). See [link to relevant documentation]. Figure 5 (b) in the middle.

[0070] It needs to be explained that the above Figures 1 to 5 The outer screen of the foldable screen displays the image sent by the front-facing camera on the outer screen, and the inner screen displays the image sent by the front-facing camera on the inner screen. This is only an illustrative description. In this embodiment, the outer screen may also display the image sent by the rear-facing camera, and the inner screen may also display the image sent by the rear-facing camera.

[0071] To address this, this application provides a display method for an electronic device with a foldable screen. This method involves the electronic device determining whether the camera capturing the image matches the target display screen, and then controlling the target display screen to display the image captured by the camera. For example, the electronic device marks the image captured by the camera based on its function, and then the target display screen displays the image captured by the camera that matches the target display screen. Alternatively, the electronic device marks the image captured by the camera based on whether the currently displayed image matches the camera capturing the image, and then determines to display the image captured by the camera that matches the currently displayed image. Thus, the electronic device ensures that the target display screen of the foldable screen matches the camera that is sending the image. For example, the outer screen displays the image captured by the front-facing camera of the outer screen, and the inner screen displays the image captured by the front-facing camera of the inner screen, solving the problem of misaligned images when the screen state of the foldable screen changes, and improving the user experience.

[0072] The foldable screen of this electronic device can be a multi-screen foldable screen. This multi-screen foldable screen can include multiple (two or more) screens. These multiple screens are multiple individual displays. These multiple screens can be connected sequentially via a folding axis. Each screen can rotate about the folding axis to which it is connected, thus achieving the folding of the multi-screen foldable screen.

[0073] For example, the display method for electronic devices provided in this application can be applied to electronic devices with displays such as mobile phones, tablets, personal computers (PCs), personal digital assistants (PDAs), smartwatches, netbooks, wearable electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, in-vehicle devices, smart cars, and smart speakers. This application does not impose any limitations on this.

[0074] like Figure 6 As shown, Figure 6 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.

[0075] Electronic device 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0076] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0077] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0078] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0079] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0080] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0081] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDA) and a serial clock line (SCL). In some embodiments, the processor 110 may include multiple I2C buses. The processor 110 can couple to the touch sensor 180K, charger, flash, camera 193, etc., through different I2C bus interfaces. For example, the processor 110 can couple to the touch sensor 180K through the I2C interface, enabling the processor 110 and the touch sensor 180K to communicate through the I2C bus interface, thereby realizing the touch function of the electronic device 100.

[0082] The I2S interface can be used for audio communication. The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. The UART interface is a universal serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication.

[0083] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. The MIPI interface includes a camera serial interface (CSI) and a display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to enable the electronic device 100 to capture images. The processor 110 and the display screen 194 communicate via the DSI interface to enable the electronic device 100 to display images.

[0084] In this embodiment, the processor 110 can control the MIPI interface switch to turn off the front-facing camera on the inner screen and turn on the image output path of the front-facing camera on the inner screen, or control the MIPI interface switch to turn off the front-facing camera on the outer screen and turn on the image output path of the front-facing camera on the inner screen, thereby achieving the purpose of switching the camera image output path.

[0085] The GPIO interface is configurable via software. It can be configured as either control or data signals. The USB interface 130 is a USB standard compliant interface, specifically a Mini USB, Micro USB, or USB Type-C interface. The USB interface 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0086] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.

[0087] The charging management module 140 is used to receive charging input from the charger. The charger can be a wireless charger or a wired charger.

[0088] The power management module 141 connects the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display screen 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance).

[0089] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0090] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.

[0091] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110.

[0092] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through audio devices (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194.

[0093] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.

[0094] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0095] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0096] In this embodiment, the display screen 194 of the electronic device 100 can be a flexible foldable screen. The flexible foldable screen includes folding edges made of a flexible material. Part or all of the flexible foldable screen is made of a flexible material. When folded, the two screens form a single, integrated structure, which can be understood as two display areas. Alternatively, the foldable screen of the electronic device can be a multi-screen foldable screen. This multi-screen foldable screen can include multiple (two or more) screens. These multiple screens are multiple individual displays. These multiple screens can be connected sequentially via folding axes. Each screen can rotate around the folding axis to which it is connected, thus achieving the folding of the multi-screen foldable screen. The electronic device 100 can implement shooting functions through an ISP, camera 193, video codec, GPU, display screen 194, and application processor, etc.

[0097] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, converting it into an image visible to the naked eye. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. The camera 193 is used to capture still images or videos. An object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP (Digital Signal Processor) for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, and other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.

[0098] In this embodiment, the camera 193 may include an external screen front camera, an internal screen front camera, and a rear camera, etc.

[0099] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.

[0100] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0101] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0102] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.

[0103] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0104] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.

[0105] The 170D headphone jack is used to connect wired headphones. The 170D headphone jack can be a USB 130 interface or a 3.5mm Open Mobile Terminal Platform (OMTP) standard interface, a CTIA (Cellular Telecommunications Industry Association of the USA) standard interface.

[0106] The pressure sensor 180A is used to sense pressure signals and can convert pressure signals into electrical signals.

[0107] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 around three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 through reverse movement, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios. In this embodiment, the foldable screen of the electronic device 100 can be folded to form multiple screens. Each screen can include a gyroscope sensor 180B for measuring the orientation (i.e., the orientation direction vector) of the corresponding screen. The electronic device 100 can determine the angle between adjacent screens based on the measured angle change of the orientation of each screen.

[0108] It should be noted that in this embodiment, the electronic device includes a foldable screen. When folded, the electronic device is divided into multiple display areas, each referred to as a screen. Each screen may include a gyroscope sensor 180B for measuring the orientation (i.e., the direction vector of the orientation) of the corresponding screen. For example, as... Figure 2 As shown in (a), the electronic device is folded to form a first screen and a second screen. Both the first and second screens are equipped with gyroscope sensors 180B, which can measure the orientation of the first and second screens respectively. The electronic device determines the angle between the first and second screens based on the measured changes in the orientation angle of each screen.

[0109] For example, electronic device 100 is folded into shape. Figure 7The diagram shows a first screen (screen A) and a second screen (screen B). Screen A has a gyroscope sensor A, and screen B has a gyroscope sensor B. This embodiment of the application explains the principle by which gyroscope sensor A measures the orientation (i.e., the direction vector of orientation) of screen A, and gyroscope sensor B measures the orientation (i.e., the direction vector of orientation) of screen B, as well as the principle by which the electronic device 100 calculates the angle θ between screens A and B based on the orientations of screens A and B.

[0110] The coordinate system of the gyroscope sensor is the geographic coordinate system. For example... Figure 8 As shown, the origin O of the geographic coordinate system is located at the point where the carrier (i.e., the device containing the gyroscope sensor, such as electronic device 100) is located. The x-axis points east (E) along the local latitude line, the y-axis points north (N) along the local meridian, and the z-axis points upward along the local geographic perpendicular, forming a right-handed rectangular coordinate system with the x-axis and y-axis. The plane formed by the x-axis and y-axis is the local horizontal plane, and the plane formed by the y-axis and z-axis is the local meridian plane. Therefore, it can be understood that the coordinate system of the gyroscope sensor is: with the gyroscope sensor as the origin O, the x-axis points east along the local latitude line, the y-axis points north along the local meridian, and the z-axis points upward (i.e., in the opposite direction of the geographic perpendicular) along the local geographic perpendicular.

[0111] Electronic device 100 can measure the orientation vector of each screen in the coordinate system of its gyroscope sensor 180B by utilizing the gyroscope sensor 180B installed in each screen. For example, refer to... Figure 7 The side view of the electronic device shown shows that the orientation vector of screen A in the coordinate system of gyroscope sensor A is vector z1, and the orientation vector of screen B in the coordinate system of gyroscope sensor B is vector z2. The electronic device 100 can calculate the angle α between vectors z1 and z2 using formula (1). Formula (1) is as follows:

[0112]

[0113] According to Figure 7 As we know, since vector z1 is perpendicular to screen A and vector z2 is perpendicular to screen B, we can obtain the angle θ between screen A and screen B as 180° - α. That is, the electronic device can determine the angle θ between screen A and screen B based on the measured direction vector of screen A in the coordinate system of gyroscope sensor A (i.e., vector z1) and the direction vector of screen B in the coordinate system of gyroscope sensor B (i.e., vector z2).

[0114] It should be noted that although the positions of the gyroscope sensors on screens A and B do not overlap (i.e., the origins of the coordinate systems of the gyroscope sensors on screens A and B do not overlap), the x-axis, y-axis, and z-axis of the two coordinate systems are parallel. Therefore, it can be considered that the coordinate systems of the gyroscope sensors on screens A and B are parallel. Thus, although vectors z1 and z2 are not in the same coordinate system, because the axes of the two coordinate systems are parallel, the angle α between vectors z1 and z2 can still be calculated using the above formula (1).

[0115] In some embodiments, one or more other sensors may be used in conjunction to measure the angle θ between screen A and screen B. For example, an accelerometer 180E may be provided in each screen of the foldable screen. The electronic device 100 (such as processor 110) may use the accelerometer to measure the motion acceleration of each screen θ when it is rotated; and then calculate the angle of rotation of one screen relative to the other screen, i.e., the angle θ between screen A and screen B, based on the measured motion acceleration.

[0116] In other embodiments, the gyroscope sensor 180B described above can be a virtual gyroscope sensor formed by the cooperation of multiple other sensors. This virtual gyroscope sensor can be used to calculate the angle between adjacent screens of the foldable screen, that is, the angle θ between screen A and screen B.

[0117] The 180C barometric pressure sensor is used to measure barometric pressure.

[0118] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover using the magnetic sensor 180D. Then, based on the detected opening and closing state of the cover or the flip cover, features such as automatic flip unlocking can be set.

[0119] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.

[0120] A distance sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. In some embodiments, during a shooting scene, electronic device 100 can utilize the distance sensor 180F to measure distance for rapid focusing.

[0121] The proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. The electronic device 100 emits infrared light outward through the LED. The electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 may use the proximity sensor 180G to detect when a user holds the electronic device 100 close to their ear for a call, so as to automatically turn off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and locking of the screen.

[0122] The ambient light sensor 180L is used to sense the brightness of ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0123] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc.

[0124] The 180J temperature sensor is used to detect temperature.

[0125] Touch sensor 180K, also known as a "touch panel," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touch screen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of electronic device 100, in a different position than display screen 194.

[0126] The bone conduction sensor 180M can acquire vibration signals.

[0127] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.

[0128] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.

[0129] The software system of an electronic device can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses the layered architecture Android system as an example to illustrate the software structure of an electronic device.

[0130] Figure 9 This is a software structure diagram of an electronic device provided in an embodiment of this application.

[0131] As is understandable, a layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system may include an application layer (referred to as the application layer), an application framework layer (referred to as the framework layer), a hardware abstraction layer (HAL), and a kernel layer.

[0132] The application layer described above may include a series of application packages.

[0133] like Figure 9 As shown, the application package may include system applications. System applications refer to applications installed on the electronic device before it leaves the factory. For example, system applications may include programs such as camera, gallery, calendar, music, SMS, and call functions.

[0134] Application packages can also include third-party applications, which are applications that users install after downloading and installing the package from an app store (or app market). For example, map applications (e.g.) (etc.), food delivery apps (e.g.) (etc.), reading applications (e.g., e-books), social applications (e.g.) ) and travel-related applications (e.g. )wait.

[0135] The application framework layer described above provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0136] like Figure 9 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, foldable screen management module, camera service module, and background service module, etc.

[0137] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.

[0138] Content providers store and retrieve data, making that data accessible to applications. This data can include videos, images, audio, phone calls made and received, browsing history and bookmarks, phone books, and more.

[0139] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.

[0140] A phone manager is used to provide communication functions for electronic devices. For example, it manages call status (including connection and disconnection).

[0141] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.

[0142] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating the phone, and flashing indicator lights.

[0143] The foldable screen management module determines the screen state of the foldable screen based on the angle between the first and second screens. For example, the foldable screen can consist of a first screen and a second screen connected by a folding axis. Figure 2As shown, the first screen can be an inner screen 21, the second screen can be an inner screen 22, and the angle between the first screen and the second screen can be the angle between the inner screen 21 and the inner screen 22.

[0144] The camera service module is used to determine the image to be displayed and send the displayed image to the application.

[0145] The background service module receives the screen status from the foldable screen management module and then sends the screen status to the camera providing module.

[0146] HAL encapsulates the underlying hardware driver, providing a generic interface for calling the driver to the application framework layer.

[0147] In this embodiment, the HAL may include a camera providing module and a tag setting module.

[0148] The camera module is used to determine the target camera for outputting the image based on the screen status.

[0149] The label setting module is used to label images captured by the target camera.

[0150] The kernel layer is the layer between hardware and software. The kernel layer includes at least the display driver, camera driver, ISP driver, and audio driver.

[0151] In some embodiments, the camera driver may include an external screen front-facing camera driver and an internal screen front-facing camera driver, wherein the external screen front-facing camera driver can be used to drive the external screen front-facing camera, and the internal screen front-facing camera driver can be used to drive the internal screen front-facing camera. Furthermore, the camera driver may also include a rear camera driver.

[0152] The ISP driver is used to acquire images captured by the camera.

[0153] All the technical solutions involved in the following embodiments can be implemented in the electronic device 100 having the above-described hardware structure and software architecture. The following description still uses a foldable screen phone as an example to illustrate this solution.

[0154] In this embodiment of the application, a camera application on the mobile phone responds to a user's shooting operation (e.g., a click or touch operation) by capturing an image using the camera; or, a social application on the mobile phone (e.g., ... (etc.) Responding to user actions, the camera is used for video calls or to capture images. When the screen state of the phone's foldable screen changes—that is, when the screen displaying the preview image switches—the camera capturing the image also switches. For example, when the phone's foldable screen switches from a folded state to an unfolded state, the screen used to display the preview image switches from the outer screen to the inner screen, and the image displayed on the screen switches from the image captured by the front-facing camera on the outer screen to the image captured by the front-facing camera on the inner screen.

[0155] When the screen state of the foldable screen changes from folded to unfolded, the camera outputting the image switches from the front-facing camera on the outer screen to the front-facing camera on the inner screen. This is only an illustrative example. In this embodiment, when the screen state of the foldable screen changes, the camera outputting the image can switch from the front-facing camera to the rear-facing camera, or from the rear-facing camera to the front-facing camera, or from rear-facing camera 1 to rear-facing camera 2; no limitation is made here.

[0156] In this embodiment of the application, when the front-facing camera of the inner / outer screen of the mobile phone dynamically switches with the screen state of the folding screen, there may be a problem that the image sent by the front-facing camera of the inner / outer screen is not synchronized with the screen state switching, resulting in misalignment of the image sent during the switching process between the inner and outer screens.

[0157] In this embodiment of the application, during the process of the application in the mobile phone requesting the display of an image, both the front-facing camera on the outer screen and the front-facing camera on the inner screen of the mobile phone may be capturing images. Therefore, the mobile phone needs to determine the target image to be finally displayed from the images captured by the front-facing camera on the outer screen and the front-facing camera on the inner screen.

[0158] In some embodiments, the tagging module of the mobile phone's hardware abstraction layer can tag images captured by the camera. For example, the tagging module tags images captured by the inner screen front-facing camera as a first identifier and images captured by the outer screen front-facing camera as a second identifier. The first and second identifiers are used to uniquely identify the images captured by the inner and outer screen front-facing cameras, respectively. After the tagging module sends the tagged images to the camera service module, the camera service module can determine the target image to be displayed from the tagged images based on the screen currently displaying the image. A specific implementation process can be exemplarily described below. Figure 10 The implementation process.

[0159] like Figure 10 As shown, the display method may include:

[0160] S11, the application sends an image output request to the ISP driver through the camera service module.

[0161] The image output request is a command to retrieve an image from the camera. Here, the application can be a system application on the phone (e.g., a camera app) or a third-party application on the phone (e.g., [example application]). (etc.), no limitation is made here.

[0162] In this embodiment of the application, when a mobile phone with a foldable screen activates the camera application's shooting function, or when a social application on the mobile phone responds to a user's operation to conduct a video call, the camera application or video recording application sends an image output request to the camera module.

[0163] Optionally, the application may first send an image output request to the camera service module, and then the camera service module will send the received image output request to the camera providing module.

[0164] For example, Figure 11 Figure (a) shows a user interface diagram of a foldable phone. When the phone detects that the user has tapped the camera app icon on the home screen and launches the camera app to take a selfie, it displays the following: Figure 11 The shooting interface is shown in (b) above. This shooting interface may include a viewfinder within which a preview image can be displayed in real time. In response to the launch of the camera application, the camera application sends an image output request to the camera module. It should be noted that the size of the viewfinder can be the same or different in photo mode and video recording mode (i.e., video shooting mode), and this is not limited here. For example, Figure 11 The viewfinder shown in (b) can be the viewfinder in photo mode. In video mode, the viewfinder can also be the entire touchscreen.

[0165] S12, the ISP driver acquires images captured by the camera.

[0166] In this embodiment, after the mobile phone receives the image output request sent by the application, the ISP driver controls the camera driver to trigger the external screen front camera and the internal screen front camera to capture images, and then the external screen front camera and the internal screen front camera send the captured images to the ISP driver. Alternatively, the ISP driver controls the camera driver to trigger the front camera or the internal screen front camera to send the captured images to the ISP driver.

[0167] It is understandable that as long as the camera can output an image, the ISP driver can acquire the image from the camera. In other words, in this embodiment, the ISP driver can acquire the image captured by the camera that is currently outputting an image.

[0168] S13, the ISP driver sends the images captured by the camera to the tag setting module through the camera providing module.

[0169] S14, the label setting module labels the images captured by the camera.

[0170] In this embodiment, when the tagging module tags the images captured by the camera, it can tag the buffer corresponding to the image frames captured by the camera. The buffer corresponding to the image frames captured by the camera is used to store image data and corresponding metadata. Metadata, also known as intermediary data or relay data, mainly describes data attributes and is used to support functions such as indicating storage location, historical data, resource lookup, and file records.

[0171] For example, Figure 12 This is an example diagram of the cache structure corresponding to the image frame provided in the embodiments of this application, such as... Figure 12 As shown, the cache structure may include frame number, camera metadata, and image data of the preview image. The frame number indicates which frame the image is. The camera metadata may store information such as the aperture, focal length, and exposure time of the target camera. In this embodiment, the tag setting module adds tags to the camera metadata to mark the camera that sent the image. Therefore, when the phone screen displays an image, it can display the corresponding image based on the tag added to the image cache, avoiding image display misalignment and improving the user experience.

[0172] In one embodiment, if the image captured by the camera obtained by the label setting module is an image captured by the front-facing camera on the external screen, the label setting module can mark a first identifier on the label in the buffer of the image frame. The first identifier is used to mark the image as an image captured by the front-facing camera on the external screen.

[0173] In another embodiment, if the image captured by the camera obtained by the label setting module is an image captured by the front-facing camera on the inner screen, the label setting module can mark the image frame in the cache with a second identifier. The second identifier is used to mark the image as an image captured by the front-facing camera on the inner screen.

[0174] It should be explained that the image captured by the camera received by the tag setting module may be one frame or multiple frames. When the image captured by the camera is multiple frames, the tag setting module labels each frame according to the camera corresponding to that frame. For example, assuming the tag setting module acquires three frames, if it determines that the first frame was captured by the external screen front-facing camera, it labels that frame with the first identifier. If it determines that the second frame was captured by the internal screen front-facing camera, it labels that frame with the second identifier. If it determines that the third frame was captured by the internal screen front-facing camera, it labels that frame with the second identifier.

[0175] S15, the tag setting module sends the tagged image captured by the camera to the camera service module.

[0176] S16, the camera service module determines the target image to be displayed based on the screen currently displaying the image.

[0177] In this embodiment, after the camera service module obtains the image captured by the camera after being marked by the tag setting module, the camera service module can determine the target image to be displayed based on the screen currently displaying the image.

[0178] For example, such as Figure 11 As shown, after the camera app on the phone is launched, the foldable screen responds to the user's unfolding operation. During the unfolding process, when the phone screen is in the unfolded state, as shown... Figure 11 In (c), the camera service module determines that the screen currently displaying the image is the inner screen, and the camera service module determines that the target image to be sent is the face image captured by the front camera of the inner screen.

[0179] This can be explained as follows: If the screen state obtained by the camera service module is folded, the camera service module determines the image marked with the first identifier from the images captured by the marked cameras as the target image. That is, when the screen currently displaying the image on the phone is the outer screen, the camera service module determines the image captured by the front-facing camera on the outer screen as the target image from the images captured by the marked cameras. If the screen state obtained by the camera service module is unfolded, the camera service module determines the image marked with the second identifier from the images captured by the marked cameras as the target image. That is, when the screen currently displaying the image on the phone is the inner screen, the camera service module determines the image captured by the front-facing camera on the inner screen as the target image from the images captured by the marked cameras. Therefore, when the phone displays images, it can display the corresponding image according to the screen state of the folded screen, avoiding the problem of image display misalignment and improving the user experience.

[0180] S17, the camera service module sends the target image to the application.

[0181] In this embodiment of the application, after the camera service module determines the target image to be displayed, it sends the target image to the application for display on the foldable screen.

[0182] As described above, the label setting module marks the images captured by the camera based on whether the camera capturing the image is the inner screen front camera or the outer screen front camera. The camera service module determines the target image to be displayed based on whether the camera corresponding to the currently displayed image on the screen matches the camera corresponding to the marked image. This ensures that the outer screen of the foldable screen displays the image captured by the outer screen front camera, and the inner screen displays the image captured by the inner screen front camera. This solves the problem of misaligned screen images when the screen state of the foldable screen is switched, and improves the user experience.

[0183] In other embodiments, when the label setting module of the phone's hardware abstraction layer determines that the screen state of the foldable screen has changed, the label setting module marks the image captured by the camera based on whether the camera corresponding to the screen of the currently displayed image matches the camera outputting the image. Based on the image identifier of the marked image, the label setting module determines which camera's image will be sent for display, thus ensuring that the screen of the currently displayed image matches the camera outputting the image, solving the problem of misaligned screen images when the foldable screen state changes. A specific implementation process can be exemplarily seen below. Figure 13 The implementation process.

[0184] like Figure 13 As shown, the display method may include:

[0185] S21, the application sends an image output request to the ISP driver through the camera service module.

[0186] S22, the ISP driver acquires images captured by the camera.

[0187] S23, the ISP driver sends the images captured by the camera to the tag setting module through the camera providing module.

[0188] In the embodiments of this application, the implementation process of S21 to S23 can be referred to the implementation process of S11 to S13 described above, and will not be repeated here.

[0189] S24, the label setting module determines that the screen state has changed and judges whether the screen currently displaying the image matches the camera capturing the image.

[0190] In this embodiment, the label setting module determines whether the screen state of the foldable screen has changed. When the label setting module determines that the screen state of the foldable screen has changed, the label setting module determines whether the screen displaying the current image matches the camera capturing the image.

[0191] This can be understood as follows: when the screen state of the foldable screen changes, the camera displaying the image switches accordingly. For example, when the foldable screen switches from a folded state to an unfolded state, the screen displaying the image switches from the outer screen to the inner screen, and the camera outputting the image also switches from the front-facing camera on the outer screen to the front-facing camera on the inner screen. However, after the screen displaying the image switches from the outer screen to the inner screen, the camera outputting the image may not have completed the switch yet. Therefore, the label setting module determines whether the screen currently displaying the image matches the target camera.

[0192] In some embodiments, the mobile phone can label the screen and the camera. For example, the mobile phone can label the outer screen and the outer screen front-facing camera with the same identifier, and label the inner screen and the inner screen front-facing camera with the same identifier. The label setting module can determine whether the screen of the currently displayed image matches the camera that captures the image based on whether the identifier of the screen displaying the image matches the identifier of the target camera.

[0193] If the label setting module determines in step S24 that the screen displaying the current image matches the camera capturing the image, then step S25 is executed; otherwise, step S26 is executed.

[0194] S25, the label setting module marks the image captured by the camera as a third identifier.

[0195] S26, the label setting module marks the image captured by the camera as the fourth identifier.

[0196] The third identifier indicates that the image captured by the camera will be directly displayed. That is, if the image captured by the camera matches the screen currently displaying the image, the phone can directly display the captured image. The fourth identifier indicates that the image captured by the camera will be discarded. That is, if the image captured by the camera does not match the screen currently displaying the image, the phone can discard the captured image.

[0197] In this embodiment, if the label setting module determines that the screen displaying the current image matches the camera capturing the image, the label setting module marks the image captured by the camera as a third identifier. If the label setting module determines that the screen displaying the current image does not match the camera capturing the image, the label setting module marks the image captured by the camera as a fourth identifier. For example, if the label setting module determines that the screen displaying the current image is an outer screen and the camera capturing the image is an outer screen front-facing camera, the label setting module marks the image captured by that camera as a third identifier. If the label setting module determines that the screen displaying the current image is an outer screen and the camera capturing the image is an inner screen front-facing camera, the label setting module marks the image captured by that camera as a fourth identifier.

[0198] For example, such as Figure 12 As shown, if the label setting module determines that the screen displaying the current image matches the camera capturing the image, the label setting module marks the cache status in the cache structure of the image captured by the camera with a third identifier. For example, the third identifier can be NORMAL. If the label setting module determines that the screen displaying the current image does not match the camera capturing the image, the label setting module marks the cache status in the cache structure of the image captured by the camera with a fourth identifier. For example, the fourth identifier can be ERROR.

[0199] S27, the tag setting module sends an image marked as a third identifier to the camera service module.

[0200] S28, the camera service module sends an image marked as a third identifier to the application.

[0201] In this embodiment, after the camera service module receives the image marked with a third identifier sent by the tag setting module, the camera service module can send the image marked with the third identifier to the application for display. After the camera service module receives the image marked with a fourth identifier sent by the tag setting module, the camera service module does not send the image marked with the fourth identifier to the application for display.

[0202] This can be understood as follows: since the image marked with the third identifier is the image captured by the camera corresponding to the screen currently displaying the image, the camera service module sends the image marked with the third identifier to the screen, ensuring that the image displayed on the current screen of the phone is the image output by the corresponding camera, thus solving the problem of image display misalignment.

[0203] As described above, the label setting module marks the image captured by the camera based on whether the screen displaying the current image matches the camera capturing the image, and determines to send the image captured by the camera that matches the screen displaying the current image. This ensures that the outer screen of the foldable screen displays the image output from the front camera of the outer screen, and the inner screen displays the image output from the front camera of the inner screen. This solves the problem of misaligned screen images when the screen state of the foldable screen is switched, and improves the user experience.

[0204] In this embodiment, when the camera service module marks the image captured by the camera according to the tag setting module, and determines the target image for display from the marked images, after the screen switching of the foldable screen is completed (i.e., the screen displaying the current image is lit up), the camera service module determines that the image captured by the camera uploaded by the hardware abstraction layer is misaligned with the screen displaying the current image. For example, the camera service module determines that the image captured by the camera uploaded by the hardware abstraction layer is marked with a second identifier or a fourth identifier. In this case, if the camera service module drops frames of the image that is misaligned with the screen displaying the current image, the screen displaying the image on the phone cannot display the corresponding image captured by the camera in time, which may cause the screen to lag or go black.

[0205] Therefore, in some embodiments, before switching between the internal and external front-facing cameras, the phone can save the last few frames captured by the new camera. For example, the phone can save the last 5 frames captured by the new camera. When the foldable screen switch is complete but the internal / external front-facing camera switch is not yet complete, the camera service module obtains the last few frames captured by the new camera before the screen switch and displays them on the screen of the currently displayed image through frame interpolation. This continues until the camera service module obtains the image displayed by the camera corresponding to the screen of the currently displayed image. The camera service module then displays the image displayed by the camera corresponding to the screen of the currently displayed image, thereby avoiding screen stuttering or black screens and improving the user experience.

[0206] For example, such as Figure 14 As shown, when the foldable screen is in the folded state, the image captured by the front-facing camera on the outer screen is displayed on the outer screen. See [link / reference]. Figure 14 (a) In this context, the phone saves the last few frames (e.g., 5 frames) captured by the front-facing camera on the outer screen when the foldable screen is in the folded state. This is done when the foldable screen switches from the folded state to the unfolded state, for example, from... Figure 14 (a) in the middle switch to Figure 14 In (b), the state is then switched from unfolded to folded, for example, from... Figure 14 Switch to (b) in the middle Figure 14(c) When the foldable screen switches from the inner screen to the outer screen, if the inner screen's front-facing camera has not yet fully switched to the outer screen's front-facing camera, the camera service module can acquire the last few frames of images captured by the outer screen's front-facing camera when the screen is folded, and display these frames on the outer screen. See [link to relevant documentation]. Figure 14 (c) in the middle.

[0207] In some embodiments, when the phone's foldable screen switches from a folded state to an unfolded state, before the foldable screen completely switches from the outer screen to the inner screen, and while the camera outputting the image is still the outer screen's front-facing camera, the phone can display the image captured by the outer screen's front-facing camera on a portion of the inner screen. Once the phone determines that the screen switch is complete and that the image is being output from the inner screen's front-facing camera, the inner screen, composed of the first and second screens, displays the image captured by the inner screen's front-facing camera. Therefore, by displaying the image captured by the outer screen's front-facing camera on a portion of the inner screen before the screen switch is complete, the phone avoids black screens or lag during use, improving the user experience.

[0208] For example, such as Figure 15 As shown, when the phone's foldable screen is in the folded state, the phone's... In response to a user's action during a video call, the phone's external front-facing camera captures the user's image information and displays it on the phone's external screen. See [link / reference]. Figure 15 (a) In the process of switching the foldable screen of the phone from the folded state to the displayed state, the second screen of the phone displays the image information captured by the front-facing camera on the outer screen, see (see also...). Figure 15 (b) In this context, the phone triggers the front-facing camera on the inner screen to capture an image, and then displays the captured image on the inner screen. The large screen, composed of the phone's first and second screens, displays the image captured by the front-facing camera on the inner screen. See also... Figure 15 (c) in the middle.

[0209] Similarly, when the phone's foldable screen switches from an unfolded state to a folded state, before the screen completely switches from the inner screen to the outer screen, and while the camera sending the image is still the inner screen's front-facing camera, the phone can display the image captured by the inner screen's front-facing camera on the outer screen. Once the phone confirms the screen switch is complete and that the image is being sent by the outer screen's front-facing camera, the phone controls the outer screen to display the image captured by the outer screen's front-facing camera. Therefore, by displaying the image captured by the inner screen's front-facing camera on the outer screen before the screen switch is complete, the phone avoids black screens or lag during use, improving the user experience.

[0210] In summary, in this embodiment, the tag setting module marks the image captured by the camera based on whether the output camera is the inner screen front camera or the outer screen front camera. The camera service module determines the target image to be displayed based on whether the camera corresponding to the screen state of the foldable screen matches the camera corresponding to the marked image. Alternatively, the tag setting module marks the image based on whether the screen of the currently displayed image matches the output camera, and then determines to send the image captured by the camera that matches the screen of the currently displayed image. Thus, the phone ensures that the outer screen of the foldable screen displays the image sent by the outer screen front camera, and the inner screen displays the image sent by the inner screen front camera, solving the problem of misaligned screen images when the screen state of the foldable screen changes, and improving the user experience.

[0211] like Figure 16 As shown in the figure, this application discloses an electronic device, which can be the aforementioned mobile phone. Specifically, the electronic device may include: a touchscreen 1601, which includes a touch sensor 1606 and a display screen 1607; the display screen 1607 may include multiple display areas; one or more processors 1602; a memory 1603; one or more application programs (not shown); and one or more computer programs 1604. All of the above devices can be connected via one or more communication buses 1605. The one or more computer programs 1604 are stored in the memory 1603 and configured to be executed by the one or more processors 1602. The one or more computer programs 1604 include instructions that can be used to perform the relevant steps in the above embodiments.

[0212] It is understood that the aforementioned electronic devices, etc., include hardware structures and / or software modules corresponding to the execution of each function in order to achieve the above-mentioned functions. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein, the embodiments of this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this invention.

[0213] This application embodiment can divide the above-mentioned electronic device into functional modules according to the method example described above. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.

[0214] When each functional module is divided according to its corresponding function, the above embodiments illustrate a possible composition of the electronic device, which may include a display unit, a transmission unit, and a processing unit. It should be noted that all relevant content regarding the steps in the above method embodiments can be referenced from the functional descriptions of the corresponding functional modules, and will not be repeated here.

[0215] This application also provides an electronic device, including one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, including computer instructions. When the one or more processors execute the computer instructions, the electronic device performs the aforementioned method steps to implement the display method of the electronic device with a foldable screen in the above embodiments.

[0216] Embodiments of this application also provide a computer-readable storage medium storing computer instructions. When the computer instructions are executed on an electronic device, the electronic device performs the aforementioned method steps to implement the display method of the electronic device with a foldable screen in the above embodiments.

[0217] Embodiments of this application also provide a computer program product, which includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the aforementioned method steps to implement the display method of the electronic device with a foldable screen in the above embodiments.

[0218] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory. The memory is used to store computer execution instructions. When the apparatus is running, the processor can execute the computer execution instructions stored in the memory to cause the apparatus to perform the display method of the electronic device with a foldable screen executed by the electronic device in the above method embodiments.

[0219] In this embodiment, the electronic device, computer-readable storage medium, computer program product or device are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0220] Through the above description of the embodiments, those skilled in the art will clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device, and unit described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.

[0221] In the embodiments of this application, the functional units can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0222] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as flash memory, portable hard disk, read-only memory, random access memory, magnetic disk, or optical disk.

[0223] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A display method for an electronic device with a foldable screen, the electronic device comprising an inner screen and an outer screen, the camera of the electronic device comprising a first camera and a second camera, wherein, The first camera is the front-facing camera of the inner screen, and the second camera is the front-facing camera of the outer screen. The method includes: Acquire the first image captured by the camera of the electronic device; When the electronic device is in a folded state and the first image is an image captured by the second camera, the external screen is controlled to display the first image; During the process of the electronic device switching from a folded state to an unfolded state, when the first image is an image captured by the first camera and the target display screen is the inner screen, the inner screen is controlled to display the first image, wherein the target display screen is the display screen of the image currently displayed by the electronic device or the display screen of the image to be displayed by the electronic device. When the electronic device is in the unfolded state and the first image is an image captured by the first camera, the inner screen is controlled to display the first image; During the process of the electronic device switching from an unfolded state to a folded state, when the first image is an image captured by the second camera and the target display screen is the outer screen, the outer screen is controlled to display the first image.

2. The method according to claim 1, characterized in that, The method further includes: During the process of the electronic device switching from an unfolded state to a folded state, when the first image is an image captured by the first camera and the target display screen is the outer screen, the outer screen is controlled to display a second image, which is an image captured by a camera that matches the target display screen and is pre-stored in the electronic device. Alternatively, during the process of the electronic device switching from an unfolded state to a folded state, if the first image is an image captured by the first camera and the target display screen is the outer screen, the outer screen is controlled not to display the first image.

3. The method according to claim 1, characterized in that, The method further includes: During the process of the electronic device switching from a folded state to an unfolded state, when the first image is an image captured by the second camera and the target display screen is the inner screen, the inner screen is controlled to display a second image, which is an image captured by a camera that matches the target display screen and is pre-stored in the electronic device. Alternatively, during the process of the electronic device switching from a folded state to an unfolded state, if the first image is an image captured by the second camera and the target display screen is the inner screen, the inner screen is controlled not to display the first image.

4. The method according to any one of claims 1-3, characterized in that, The method further includes: When the first image is an image captured by the first camera and the target display screen is the inner screen, the image identifier of the first image is determined to be the third identifier, and the third identifier is used to indicate that the first image is directly sent for display. The inner screen is controlled to display the first image with a third identifier.

5. The method according to any one of claims 1-3, characterized in that, The method further includes: When the first image is an image captured by the second camera and the target display screen is the external screen, the image identifier of the first image is determined to be the third identifier, and the third identifier is used to indicate that the first image is directly sent for display; The external screen is controlled to display the first image with a third identifier.

6. The method according to any one of claims 1-3, characterized in that, The method further includes: During the process of the electronic device switching from an unfolded state to a folded state, when the first image is an image captured by the first camera and the target display screen is the outer screen, the image identifier of the first image is determined to be a fourth identifier, which is used to indicate that the first image is discarded.

7. The method according to any one of claims 1-3, characterized in that, The method further includes: During the process of the electronic device switching from a folded state to an unfolded state, when the first image is an image captured by the second camera and the target display screen is the inner screen, the image identifier of the first image is determined to be a fourth identifier, which is used to indicate that the first image is discarded.

8. The method according to any one of claims 1-3, wherein the inner screen of the electronic device comprises a first screen and a second screen, characterized in that, The method further includes: Based on the angle between the first screen and the second screen, it is determined that the electronic device is in the process of switching from a folded state to an unfolded state.

9. The method according to any one of claims 1-3, wherein the inner screen of the electronic device comprises a first screen and a second screen, characterized in that, The method further includes: Based on the angle between the first screen and the second screen, it is determined that the electronic device is in the process of switching from an unfolded state to a folded state.

10. An electronic device, characterized in that, include: A touchscreen, comprising a touch sensor and a display screen; One or more processors; Memory; The memory stores one or more computer programs, the one or more computer programs including instructions that, when executed by the electronic device, cause the electronic device to perform the display method of the electronic device with a foldable screen as described in any one of claims 1-9.

11. A computer-readable storage medium storing instructions, characterized in that, When the instructions are executed on the electronic device, the electronic device performs the display method of the electronic device with a foldable screen as described in any one of claims 1-9.

Images