Image display method and electronic device
By directly triggering the internal and external screen cameras to capture and display images at the hardware abstraction layer or kernel layer, the problem of unsmooth camera switching in foldable electronic devices is solved, improving switching efficiency and user experience.
Patent Information
- Application Number
- CN202210806906.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-02-28
- Publication Date
- 2026-02-10
- Estimated Expiration
- 2042-02-28
AI Technical Summary
In electronic devices with foldable screens, the switching rate between the inner and outer screen cameras is slow, resulting in an unsmooth screen switching process and discontinuous images.
When the angle between the inner and outer screens reaches a preset range, determined by the hardware abstraction layer or kernel layer, the target camera is directly triggered to capture and display the image, reducing cross-service/component interaction processes, saving decision-making time, and performing camera initialization operations when the angle meets the switching preparation phase.
It improves the switching efficiency between the inner and outer screen front cameras, reduces the time it takes for the camera to display images, and enhances the user experience.
Smart Images

Figure CN116723257B_ABST
Abstract
Description
[0001] This application is a divisional application. The original application has the application number 202210185763.2 and the original application date is February 28, 2022. The entire contents of the original application are incorporated herein by reference. Technical Field
[0002] This application relates to the field of terminal technology, and in particular to an image display method and electronic device. Background Technology
[0003] With the continuous development of electronic devices and displays, and the increasing demands of people's lives, electronic devices with foldable displays have emerged. Currently, camera functionality is a common feature offered by electronic devices, allowing users to make video calls, take photos, or record videos. In foldable screen electronic devices, the internal and external screen cameras dynamically switch as the screen folds and unfolds. For example, when the internal screen displays and previews an image, the device uses the internal screen's front-facing camera; when the external screen displays and previews an image, it uses the external screen's front-facing camera. However, during the switching process between the internal and external screens, the switching rate between the cameras is slow, resulting in a choppy screen transition and discontinuous visuals. Summary of the Invention
[0004] This application provides an image display method and an electronic device. The image display method is applied to an electronic device with a foldable screen. The electronic device includes an inner screen and an outer screen. The inner screen includes a first screen and a second screen. When the hardware abstraction layer or kernel layer of the electronic device determines that the angle between the first screen and the second screen reaches a preset angle range, the hardware abstraction layer or kernel layer directly triggers the display of the image captured by the target camera. This reduces cross-service / component interaction processes, saves decision-making time, and improves the switching efficiency of the front-facing camera on the inner / outer screen. Furthermore, when the hardware abstraction layer or kernel layer determines that the angle between the first screen and the second screen meets the angle threshold of the switching preparation stage, the hardware abstraction layer or kernel layer controls the target camera to perform camera initialization operations (e.g., power-on, configuration register sequence, etc.), thereby reducing the time for the camera to display images, improving the efficiency of camera switching, and enhancing the user experience.
[0005] To achieve the above objectives, this application adopts the following technical solution:
[0006] In a first aspect, embodiments of this application provide an image display method. This method is applied to an electronic device with a foldable screen. The electronic device includes an inner screen and an outer screen. The inner screen includes a first screen and a second screen. The electronic device includes a first camera and a second camera. The first camera is disposed below the inner screen, and the second camera is disposed below the outer screen. The electronic device also includes an application framework layer and a first layer. The first layer is located between the application framework layer and the hardware unit of the electronic device. The method includes: the first layer determining the angle between the first screen and the second screen; and when the angle between the first screen and the second screen reaches a preset angle range, the first layer triggers the display of the image captured by the target camera in the first camera and the second camera.
[0007] The first layer may include a hardware abstraction layer and / or a kernel layer. Assuming the first layer is a hardware abstraction layer, it receives information from sensors sent by the kernel layer. The hardware abstraction layer determines the angle between the first screen and the second screen. When the hardware abstraction layer determines that the angle between the first screen and the second screen reaches a certain preset angle range, it triggers the display of images captured by the target camera in the first and second cameras. Alternatively, assuming the first layer is a kernel layer, the kernel layer determines the angle between the first screen and the second screen based on the sensor information. When the kernel layer determines that the angle between the first screen and the second screen reaches a certain preset angle range, it triggers the display of images captured by the target camera in the first and second cameras.
[0008] The first camera mentioned above can be the front-facing camera of the inner screen, and the second camera mentioned above can be the front-facing camera of the outer screen.
[0009] In this embodiment of the application, when the first layer determines that the angle between the first screen and the second screen is within a preset angle range, the first layer located below the application framework layer directly triggers the display of the image captured by the target camera, thereby reducing the cross-service / component interaction process and saving decision-making time.
[0010] In one possible implementation, before the first layer triggers the display of images captured by the target camera in the first and second cameras, the method further includes: the first layer acquiring a screen status identifier of the electronic device; the first layer determining a target screen for displaying the image from the inner and outer screens based on the screen status identifier; and, when the angle between the first and second screens reaches a preset angle range, the first layer triggers the display of images captured by the target camera in the first and second cameras, including: when the angle between the first and second screens reaches a preset angle range, the first layer triggers the display of images captured by the target camera in the first and second cameras on the target screen.
[0011] The screen status indicator is used to indicate whether the electronic device is currently switching from the inner screen to the outer screen, or vice versa.
[0012] In this embodiment, the electronic device determines the target screen for displaying the image through the screen status indicator, and displays the image captured by the target camera on the target screen when the angle between the first screen and the second screen meets the angle requirements. This can minimize the possibility of the image displayed by the camera not matching the target screen, and can improve the user experience to a certain extent.
[0013] In one embodiment, after the first layer obtains the screen status identifier of the electronic device, if the first layer determines that the electronic device has switched from the inner screen to the outer screen based on the screen status identifier, then when the angle between the first screen and the second screen reaches a preset angle range, the first layer triggers the image captured by the target camera to be displayed on the outer screen. If the first layer determines that the electronic device has switched from the outer screen to the inner screen based on the screen status identifier, then when the angle between the first screen and the second screen reaches a preset angle range, the first layer triggers the image captured by the target camera of the first camera and the second camera to be displayed on the inner screen. In another possible implementation, during the process of the foldable screen switching from an unfolded state to a folded state, when the angle between the first screen and the second screen reaches a preset angle range, the first layer triggers the image captured by the target camera of the first camera and the second camera to be displayed on the target screen, including: when the angle between the first screen and the second screen is less than a first preset angle and the image is displayed on the outer screen, the first layer triggers the image captured by the second camera to be displayed on the outer screen.
[0014] This can be understood as follows: during the process of switching the foldable screen from the unfolded state to the folded state, the first layer determines, based on the angle between the first screen and the second screen, that the image captured by the second camera is displayed on the outer screen before the electronic device has switched from the inner screen to the outer screen. This avoids the problem that the image captured by the second camera cannot be displayed in time when the outer screen is not lit up when the first layer triggers the image captured by the second camera to be displayed.
[0015] In another possible implementation, during the process of the foldable screen switching from a folded state to an unfolded state, if the angle between the first screen and the second screen reaches a preset angle range, the first layer triggers the target camera in the first and second cameras to display the image on the target screen, including: if the angle between the first screen and the second screen is greater than a second preset angle and the image is displayed on the inner screen, the first layer triggers the first camera to display the image on the inner screen.
[0016] This can be understood as follows: during the process of switching the folded screen from the folded state to the unfolded state, the first layer determines, based on the angle between the first screen and the second screen, that the image captured by the first camera is displayed on the inner screen before the electronic device has switched from the outer screen to the inner screen. This avoids the problem that the image captured by the first camera cannot be displayed in time when the inner screen is not lit up when the first layer triggers the image captured by the first camera to be displayed.
[0017] In another possible implementation, before the image captured by the second camera is displayed on the outer screen, the above image display method may further include: when the first layer determines that the angle between the first screen and the second screen is less than a third preset angle, the first layer triggers the second camera to perform camera initialization operation, wherein the third preset angle is greater than the first preset angle.
[0018] This can be understood as follows: during the transition from an unfolded to a folded state, the angle between the first and second screens gradually decreases. When the first layer determines that the angle between the first and second screens is less than a third preset angle, the first screen triggers the second camera to perform camera initialization operations, such as powering on and configuring register sequences. When the first layer determines that the angle between the first and second screens is less than the first preset angle, the first screen can directly trigger the image captured by the second camera to be displayed on the outer screen. Therefore, the first layer can control the display of the image captured by the initialized second camera, improving the efficiency of image display.
[0019] In another possible implementation, before the image captured by the first camera is displayed on the inner screen, the method further includes: when the first layer determines that the angle between the first screen and the second screen is greater than a fourth preset angle, the first layer triggers the first camera to perform camera initialization operation, wherein the fourth preset angle is less than a second preset angle.
[0020] This can be understood as follows: during the transition from a folded to an unfolded state, the angle between the first and second screens gradually increases. When the first layer determines that the angle between the first and second screens is greater than a fourth preset angle, the first screen triggers the first camera to perform camera initialization operations, such as powering on and configuring register sequences. When the first layer determines that the angle between the first and second screens is greater than a second preset angle, the first screen can directly trigger the image captured by the first camera to be displayed on the inner screen. Therefore, the first layer can control the direct display of the image captured by the initialized first camera, improving the efficiency of image display.
[0021] In another possible implementation, before the image captured by the second camera is displayed on the outer screen, the above image display method may further include: the application framework layer obtaining the angle between the first screen and the second screen; if the angle between the first screen and the second screen is less than a fifth preset angle, the application framework layer triggers the outer screen to perform screen initialization operations; if the angle between the first screen and the second screen is less than a sixth preset angle, the application framework triggers the electronic device to switch the inner screen to the outer screen, and determines the screen status identifier of the electronic device as a first identifier, the first identifier being used to indicate that the image is displayed on the outer screen, wherein the sixth preset angle is less than the fifth preset angle.
[0022] The screen initialization operation includes powering on the screen and adjusting display parameters.
[0023] In this embodiment of the application, during the process of switching the foldable screen from the unfolded state to the folded state, and before the outer screen displays an image, the application framework layer can trigger the outer screen to perform screen initialization operations based on the angle between the first screen and the second screen. When the application framework layer determines that the angle between the first screen and the second screen is less than a sixth preset angle, the application framework layer directly triggers the outer screen to light up, avoiding the screen initialization process and improving the efficiency of screen switching.
[0024] Furthermore, the application framework layer marks the screen state based on the foldable screen's screen state. For example, when the application framework layer determines that the image is being displayed on the outer screen, it marks the screen state identifier as a first identifier; when it determines that the image is being displayed on the inner screen, it marks the screen state identifier as a second identifier. Thus, when the first layer triggers the image captured by the target camera to be displayed on either the inner or outer screen, the first layer can obtain the screen state identifier from the application framework layer to determine the target screen from the inner or outer screen based on the screen state identifier.
[0025] In another possible implementation, before the image captured by the first camera is displayed on the inner screen, the image display method may further include: the application framework layer obtaining the angle between the first screen and the second screen; if the angle between the first screen and the second screen is greater than a seventh preset angle, the application framework layer triggers the inner screen to perform screen initialization operations; if the angle between the first screen and the second screen is greater than an eighth preset angle, the application framework triggers the electronic device to switch the outer screen to the outer screen, and determines the screen status identifier of the electronic device as a second identifier, the second identifier being used to indicate that the image is displayed on the inner screen, wherein the eighth preset angle is greater than the seventh preset angle.
[0026] In another possible implementation, the first layer is a hardware abstraction layer, and the electronic device also includes a kernel layer located between the hardware abstraction layer and the hardware units of the electronic device. The first layer determines the angle between the first screen and the second screen by: the hardware abstraction layer acquiring information collected by sensors through the kernel layer, the sensors including at least one of an angle sensor, a gyroscope sensor, and an accelerometer sensor; and the hardware abstraction layer determining the angle between the first screen and the second screen based on the information collected by the sensors.
[0027] In this embodiment, after the kernel-layer sensor driver acquires the information collected by the sensor, it sends the information to the hardware abstraction layer. The hardware abstraction layer then determines the angle between the first screen and the second screen based on the sensor information. Compared to the prior art, where the kernel layer uploads the sensor-collected information to the application framework layer via the hardware abstraction layer, and the application framework layer determines the angle between the first screen and the second screen based on the sensor-collected information, which presents a problem of cross-component information transmission, this embodiment eliminates the need for the hardware abstraction layer to upload the sensor-collected information to the application framework layer, thus reducing cross-component interaction processes.
[0028] In another possible implementation, the first layer is a kernel layer, which determines the angle between the first screen and the second screen. This includes: the kernel layer acquiring information collected by sensors, including at least one of an angle sensor, a gyroscope sensor, and an accelerometer sensor; and the kernel layer determining the angle between the first screen and the second screen based on the information collected by the sensors.
[0029] In this embodiment, after the kernel layer's sensor driver acquires the information collected by the sensor, the kernel layer directly determines the angle between the first screen and the second screen based on this information. Therefore, the kernel layer can directly calculate the angle between the first screen and the second screen without interacting with the upper layer, thus improving computational efficiency.
[0030] In another possible implementation, when the electronic device is in a video call scenario and the foldable screen is in the unfolded state, the inner screen displays the image captured by the first camera; or, when the foldable screen is in the folded state, the outer screen displays the image captured by the second camera.
[0031] Secondly, this application provides an electronic device with a foldable screen. The electronic device includes an inner screen and an outer screen. The inner screen includes a first screen and a second screen. The electronic device includes a first camera and a second camera. The first camera is disposed below the inner screen, and the second camera is disposed below the outer screen. The electronic device also includes an application framework layer and a first layer, which is located between the application framework layer and the hardware units of the electronic device. This first layer is used to determine the angle between the first screen and the second screen. When the angle between the first screen and the second screen reaches a preset angle range, the first layer triggers the display of the image captured by the target camera in the first and second cameras.
[0032] Thirdly, this application provides an electronic device, comprising: a foldable screen, the foldable screen including at least two screens; one or more processors; a memory; wherein the memory stores one or more computer programs, the one or more computer programs including instructions, which, when executed by the electronic device, cause the electronic device to perform the image display method as described in any one of the first aspects above.
[0033] Fourthly, this application provides a computer-readable storage medium storing instructions that, when executed on an electronic device, cause the electronic device to perform the image display method as described in any one of the first aspects.
[0034] Fifthly, this application provides a computer program product including computer instructions that, when executed on an electronic device, cause the electronic device to perform the image display method as described in any one of the first aspects.
[0035] It is understood that the electronic devices described in the second and third aspects, the computer storage medium described in the fourth aspect, and the computer program product described in the fifth aspect are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here. Attached Figure Description
[0036] Figure 1 This is a schematic diagram of a foldable screen phone when folded, provided as an embodiment of this application.
[0037] Figure 2 This is a schematic diagram of a foldable screen phone unfolded according to an embodiment of this application;
[0038] Figure 3 A flowchart illustrating an image display method provided in this application embodiment. Figure 1 ;
[0039] Figure 4This application provides an illustration of an image display method. Figure 1 ;
[0040] Figure 5 A schematic diagram of the structure of an electronic device provided in an embodiment of this application;
[0041] Figure 6 A schematic diagram illustrating the principle of calculating the angle between screen A and screen B, provided for an embodiment of this application;
[0042] Figure 7 A schematic diagram illustrating an example of a geographic coordinate system provided in this application embodiment;
[0043] Figure 8 Another structural schematic diagram of the electronic device provided in the embodiments of this application;
[0044] Figure 9 A flowchart illustrating an image display method provided in this application embodiment. Figure 2 ;
[0045] Figure 10 A flowchart illustrating an image display method provided in this application embodiment. Figure 3 ;
[0046] Figure 11 This application provides an illustration of an image display method. Figure 2 ;
[0047] Figure 12 A flowchart illustrating an image display method provided in this application embodiment. Figure 4 ;
[0048] Figure 13 This application provides an illustration of an image display method. Figure 3 ;
[0049] Figure 14 A flowchart illustrating an image display method provided in this application embodiment. Figure 5 ;
[0050] Figure 15 A flowchart illustrating an image display method provided in this application embodiment. Figure 6 ;
[0051] Figure 16 A flowchart illustrating an image display method provided in this application embodiment. Figure 7 ;
[0052] Figure 17 This application provides an illustration of an image display method. Figure 4 ;
[0053] Figure 18 This is another structural schematic diagram of the electronic device provided in the embodiments of this application. Detailed Implementation
[0054] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; the term "and / or" in this document is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone.
[0055] Hereinafter, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of embodiments of this application, unless otherwise stated, "a plurality of" means two or more.
[0056] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.
[0057] The electronic device in this application embodiment includes a foldable screen, which can be unfolded or folded along the folding axis, and can present different display areas in different states. Taking a foldable screen mobile phone as an example, the different display areas presented by the electronic device in different states are explained.
[0058] Figure 1 This is a schematic diagram illustrating a foldable screen phone when folded, as provided in an embodiment of this application. Figure 1 As shown in (a), when the foldable phone is in a fully folded state and the external screen camera 1 is turned on, the image captured by the external screen camera 1 is previewed and displayed on the external screen 11. Figure 1 As shown in (b), when the foldable phone is in a folded state and the external rear camera 2 is turned on, the image captured by the external rear camera 2 is previewed and displayed on the external screen 11.
[0059] Figure 2 This is a schematic diagram illustrating a foldable screen phone unfolded according to an embodiment of this application. The unfolding process of the foldable screen phone is as follows: Figure 2 (a) to Figure 2 As shown in (b) in the diagram. Figure 2 As shown in (b), assuming the foldable phone is in the unfolded state and the inner screen front camera 3 is turned on, the image captured by the inner screen front camera 3 can be previewed and displayed on a large screen composed of the first screen 21 and the second screen 22, or it can be previewed and displayed on only the first screen 21 or the second screen 22. There is no limitation here. Figure 2 When a foldable phone is fully unfolded, the screen angle θ can be 180° or approximately 180°, enabling a large-screen display that provides users with richer information and a better user experience. Specifically, the screen angle θ is the angle between the first screen 21 and the second screen 22 (or the plane containing the first screen 21 and the second screen 22). Figure 2 As shown in (c), from the outside of the foldable phone, the foldable screen presents an outer screen 23. Assuming the foldable phone is in its unfolded state and the front-facing camera 1 on the outer screen is activated, the image captured by the front-facing camera 1 is previewed and displayed on the outer screen 23. The outer screen 23 can be located on the back of either the first screen 21 or the second screen 22; this is not a limitation.
[0060] It should be explained that the angle θ between the first screen 21 and the second screen 22 can range from [0°, 180°]. In this embodiment, if θ is within the range of [0°, X], it can be determined that the foldable phone is in a folded state; if θ is within the range of (X, 180°), it can be determined that the foldable phone is in an unfolded state. Here, X is a preset angle threshold. X can be set by the user in the electronic device, or it can be determined by the electronic device based on the user's usage habits. In this embodiment, the value of X is not limited. For example, X can be set to 90°. If the angle θ between the first screen 21 and the second screen 22 is less than or equal to 90°, the foldable phone is determined to be in a folded state; if the angle θ between the first screen 21 and the second screen 22 is greater than 90°, the foldable phone is determined to be in a folded state. Of course, X can also be set to other values, such as 80°, 85°, or 95°, etc., which are not limited here.
[0061] In some embodiments, when the foldable screen of the electronic device is in a folded state and the user uses the external screen's front-facing camera for video calls or to take pictures, the electronic device uses the external screen's front-facing camera to capture images and displays the preview image captured by the external screen's front-facing camera on the external screen. If the electronic device responds to the user's manual opening of the foldable screen, switching from a folded state to an unfolded state, the electronic device uses the internal screen's front-facing camera to capture images and displays the preview image captured by the internal screen's front-facing camera on the internal screen. Therefore, in video call or photo-taking scenarios, the electronic device's camera switches according to the screen state, realizing the process of switching from capturing images with the external screen's front-facing camera to capturing images with the internal screen's front-facing camera, and also realizing the process of switching from displaying a preview image on the external screen to displaying a preview image on the internal screen.
[0062] Similarly, when the foldable screen of an electronic device is unfolded and the user uses the inner screen's front-facing camera for video calls or taking pictures, the electronic device uses the inner screen's front-facing camera to capture images, and the preview image captured by the inner screen's front-facing camera is displayed on the inner screen. If the electronic device responds to the user's manual folding of the foldable screen, switching from the unfolded state to the folded state, the electronic device uses the outer screen's front-facing camera to capture images, and the preview image captured by the outer screen's front-facing camera is displayed on the outer screen. It can be seen that in video call or photo-taking scenarios, the electronic device's camera switches according to the screen state, realizing the process of switching from capturing images with the inner screen's front-facing camera to capturing images with the outer screen's front-facing camera, and also realizing the process of switching from displaying a preview image on the inner screen to displaying a preview image on the outer screen.
[0063] The following section describes the switching process between the front-facing camera on the outer screen and the front-facing camera on the inner screen during the screen folding or unfolding process.
[0064] In related technologies, after the application framework layer of an electronic device acquires information from at least one sensor, it determines the screen state of the foldable screen based on this information. The application framework layer then determines the target camera for displaying the image based on the screen state. Finally, it sends the target camera information to the hardware abstraction layer (HAL), which triggers the display of the image captured by the target camera on the target display screen. Here, the target display screen is the display screen corresponding to the foldable screen's current state. For example, if the foldable screen is in an unfolded state, the target display screen is a large display screen composed of the first and second screens of the foldable screen when they are in the unfolded state.
[0065] For example, the following is combined with Figure 3 To adopt Taking a scenario where an application makes a video call or takes a picture as an example, this section explains the switching process between the external screen front camera and the internal screen front camera during the folding or unfolding of a foldable screen phone in related technologies. Figure 3 As shown, in the mobile phone In response to user actions, when using the front-facing camera for video calls or image capture, the sensor driver can acquire data from at least one sensor in real-time or periodically. The sensor driver sends the data from at least one sensor to the display decision module. The display decision module determines the angle between the first and second screens of the foldable screen based on the data from at least one sensor. Then, the display decision module determines the screen state of the foldable screen based on the angle between the first and second screens and an angle threshold. The display decision module transmits the screen state of the foldable screen to the camera decision module. The camera decision module determines the target camera for displaying the image based on the screen state of the foldable screen. The camera decision module sends the camera identifier of the target camera to the camera hardware abstraction module, which, based on the camera identifier of the target camera, controls the corresponding camera driver to trigger the target camera to display the image.
[0066] As an example, assuming the target camera is an in-screen front-facing camera, the camera hardware abstraction module can send the identifier of the in-screen front-facing camera to the in-screen front-facing camera driver. Then, the in-screen front-facing camera driver performs operations such as powering on the in-screen front-facing camera to start it.
[0067] Depend on Figure 3 It is known that when an electronic device switches between screens and displays images via the front-facing cameras on the inner and outer screens, the entire execution process involves the device's kernel layer, hardware abstraction layer, and application framework layer. Clearly, the entire execution process for switching cameras based on the screen's physical state is lengthy, resulting in low display efficiency during camera switching. For example, when a foldable screen switches from a folded state to an unfolded state, and the image capture changes from the outer screen's front-facing camera to the inner screen's front-facing camera, there may be situations where the inner screen displays a preview image captured by the outer screen's front-facing camera, or the inner screen remains black.
[0068] For example, such as Figure 4 As shown in (a), assuming a user makes a video call using an electronic device in its folded state, i.e., the front-facing camera 1 on the outer screen of the electronic device captures the user's image, and the outer screen displays the preview image captured by the front-facing camera 1. The foldable screen of the electronic device responds to user input by switching from a folded state to an unfolded state, i.e., the preview image displayed on the outer screen switches to the preview image displayed on the inner screen. Figure 4As shown in (b), the camera of the electronic device failed to switch successfully from the external screen front camera 1 to the internal screen front camera 3, resulting in no content being displayed on the internal screen of the electronic device.
[0069] To address this, this application provides an image display method applied to an electronic device with a foldable screen. In this method, when the angle between the first and second screens is determined by the hardware abstraction layer or kernel layer to meet an angle threshold during the switching phase, the hardware abstraction layer or kernel layer directly controls the target camera to switch and display images. This reduces cross-service / component interaction processes, saves decision-making time, and improves the switching efficiency of the front-facing cameras on the inner and outer screens. Furthermore, when the hardware abstraction layer or kernel layer determines that the angle between the first and second screens of the foldable screen reaches a preset angle range, the hardware abstraction layer or kernel layer controls the target camera to perform switching preparation work (e.g., power-on, configuration register sequence, etc.), thereby reducing the time for the camera to display images, improving the efficiency of camera switching, and thus enhancing the user experience.
[0070] For example, the display method of electronic devices provided in this application embodiment can be applied to electronic devices with foldable screens such as mobile phones, tablets, personal computers (PCs), personal digital assistants (PDAs), smartwatches, netbooks, wearable electronic devices, augmented reality (AR) devices, virtual reality (VR) devices, in-vehicle devices, smart cars, and smart speakers. This application embodiment does not impose any limitations on this.
[0071] like Figure 5 As shown, Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application.
[0072] Electronic device 100 may include processor 110, external memory interface 120, internal memory 121, universal serial bus (USB) interface 130, charging management module 140, power management module 141, battery 142, antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193, display screen 194, and subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.
[0073] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
[0074] Processor 110 may include one or more processing units, such as: application processor (AP), modem processor, graphics processing unit (GPU), image signal processor (ISP), controller, memory, video codec, digital signal processor (DSP), baseband processor, and / or neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0075] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.
[0076] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.
[0077] In some embodiments, the processor 110 may include one or more interfaces. Interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.
[0078] The I2C interface is a bidirectional synchronous serial bus, consisting of a serial data line (SDA) and a serial clock line (SCL). The I2S interface can be used for audio communication. The PCM interface can also be used for audio communication, sampling, quantizing, and encoding analog signals. The UART interface is a general-purpose serial data bus used for asynchronous communication. This bus can be a bidirectional communication bus. It converts the data to be transmitted between serial and parallel communication.
[0079] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display 194 and camera 193. MIPI interfaces include camera serial interface (CSI) and display serial interface (DSI). The GPIO interface is configurable via software. GPIO interfaces can be configured as control signals or data signals. The USB interface 130 is a USB standard compliant interface, specifically a Mini USB interface, Micro USB interface, or USB Type-C interface. The USB interface 130 can be used to connect a charger to charge the electronic device 100, and can also be used for data transfer between the electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.
[0080] In this embodiment, the processor 110 can control the MIPI interface switch to turn off the front-facing camera on the inner screen and turn on the image output path of the front-facing camera on the inner screen, or control the MIPI interface switch to turn off the front-facing camera on the outer screen and turn on the image output path of the front-facing camera on the inner screen, thereby achieving the purpose of switching the camera image output path.
[0081] It is understood that the interface connection relationships between the modules illustrated in the embodiments of this application are merely illustrative and do not constitute a structural limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may also employ different interface connection methods or combinations of multiple interface connection methods as described in the above embodiments.
[0082] The charging management module 140 receives charging input from a charger, which can be a wireless or wired charger. The power management module 141 connects to the battery 142, and the charging management module 140 connects to the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, providing power to the processor 110, internal memory 121, external memory, display 194, camera 193, and wireless communication module 160, etc. The power management module 141 can also monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management module 141 may also be located within the processor 110. In other embodiments, the power management module 141 and the charging management module 140 may be located in the same device.
[0083] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.
[0084] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover one or more communication frequency bands. Different antennas can also be multiplexed to improve antenna utilization. For example, antenna 1 can be multiplexed as a diversity antenna for a wireless local area network. In some other embodiments, the antennas can be used in conjunction with tuning switches.
[0085] The mobile communication module 150 can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1. In some embodiments, at least some functional modules of the mobile communication module 150 may be housed in the processor 110. In some embodiments, at least some functional modules of the mobile communication module 150 and at least some modules of the processor 110 may be housed in the same device.
[0086] The modem processor may include a modulator and a demodulator. The modulator modulates the low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After processing by the baseband processor, the low-frequency baseband signal is transmitted to the application processor. The application processor outputs sound signals through an audio device (not limited to speaker 170A, receiver 170B, etc.) or displays images or videos through the display screen 194. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processor 110 and may be housed in the same device as the mobile communication module 150 or other functional modules.
[0087] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via antenna 2, performs frequency modulation and filtering of the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, perform frequency modulation and amplification, and convert them into electromagnetic waves for radiation via antenna 2.
[0088] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, enabling electronic device 100 to communicate with networks and other devices via wireless communication technology. Wireless communication technology may include Global System for Mobile Communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technologies, etc. GNSS can include the Global Positioning System (GPS), the Global Navigation Satellite System (GLONASS), the BeiDou Navigation Satellite System (BDS), the Quasi-Zenith Satellite System (QZSS), and / or satellite-based augmentation systems (SBAS).
[0089] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.
[0090] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, electronic device 100 may include one or N displays 194, where N is a positive integer greater than 1.
[0091] Optionally, the display screen 194 of the electronic device 100 can be a flexible foldable screen. The flexible foldable screen includes folding edges made of a flexible material. Part or all of the flexible foldable screen is made of a flexible material. When folded, the two screens form a single, integrated structure, and can be understood as two display areas. Alternatively, the foldable screen of the electronic device 100 can be a multi-screen foldable screen. This multi-screen foldable screen can include multiple (two or more) screens. These multiple screens are multiple individual displays. These multiple screens can be connected sequentially via folding axes. Each screen can rotate about the folding axis to which it is connected, thus achieving the folding of the multi-screen foldable screen.
[0092] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.
[0093] The ISP (Image Signal Processor) is used to process data fed back from the camera 193. For example, when taking a picture, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, and the camera's photosensitive element transmits the electrical signal to the ISP for processing, transforming it into an image visible to the naked eye. The ISP can also perform algorithmic optimization of image noise, brightness, and skin tone. The ISP can also optimize parameters such as exposure and color temperature of the shooting scene. In some embodiments, the ISP can be set in the camera 193.
[0094] Camera 193 is used to capture still images or videos. An object is projected onto a photosensitive element by generating an optical image through the lens. The photosensitive element can be a charge-coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, which is then passed to an ISP for conversion into a digital image signal. The ISP outputs the digital image signal to a DSP for processing. The DSP converts the digital image signal into image signals in standard RGB, YUV, or other formats. In some embodiments, the electronic device 100 may include one or N cameras 193, where N is a positive integer greater than 1.
[0095] In this embodiment, the camera 193 may include an external screen front camera, an internal screen front camera, and a rear camera, etc.
[0096] Digital signal processors (DSPs) are used to process digital signals. Besides digital image signals, they can also process other digital signals. For example, when electronic device 100 selects a frequency, the DSP can perform Fourier transforms on the frequency energy.
[0097] Video codecs are used to compress or decompress digital video. Electronic device 100 may support one or more video codecs. Thus, electronic device 100 can play or record videos in various encoding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
[0098] An NPU (Neural Processing Unit) is a computational processor for neural networks (NNs). By borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, it can rapidly process input information and continuously learn on its own. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.
[0099] The external storage interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external storage interface 120 to perform data storage functions. For example, music, video, and other files can be saved on the external memory card.
[0100] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.
[0101] Electronic device 100 can implement audio functions, such as music playback and recording, through audio module 170, speaker 170A, receiver 170B, microphone 170C, headphone jack 170D, and application processor.
[0102] The pressure sensor 180A is used to sense pressure signals and can convert pressure signals into electrical signals.
[0103] The gyroscope sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the gyroscope sensor 180B can determine the angular velocity of the electronic device 100 around three axes (i.e., the x, y, and z axes). The gyroscope sensor 180B can be used for image stabilization. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the shake of the electronic device 100, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to counteract the shake of the electronic device 100 through reverse movement, thus achieving image stabilization. The gyroscope sensor 180B can also be used in navigation and motion-sensing game scenarios. In this embodiment, the foldable screen of the electronic device 100 can be folded to form multiple screens. Each screen can include a gyroscope sensor 180B for measuring the orientation (i.e., the orientation direction vector) of the corresponding screen. The electronic device 100 can determine the angle between adjacent screens based on the measured angle change of the orientation of each screen.
[0104] It should be noted that in this embodiment, the electronic device includes a foldable screen. When folded, the electronic device is divided into multiple display areas, each referred to as a screen. Each screen may include a gyroscope sensor 180B for measuring the orientation (i.e., the direction vector of the orientation) of the corresponding screen. For example, as... Figure 2As shown in (a), the electronic device is folded to form a first screen and a second screen. Both the first and second screens are equipped with gyroscope sensors 180B, which can measure the orientation of the first and second screens respectively. The electronic device determines the angle between the first and second screens based on the measured changes in the orientation angle of each screen.
[0105] For example, electronic device 100 is folded into shape. Figure 6 The diagram shows a first screen (screen A) and a second screen (screen B). Screen A has a gyroscope sensor A, and screen B has a gyroscope sensor B. This embodiment of the application explains the principle by which gyroscope sensor A measures the orientation (i.e., the direction vector of orientation) of screen A, and gyroscope sensor B measures the orientation (i.e., the direction vector of orientation) of screen B, as well as the principle by which the electronic device 100 calculates the angle θ between screens A and B based on the orientations of screens A and B.
[0106] The coordinate system of the gyroscope sensor is the geographic coordinate system. For example... Figure 7 As shown, the origin O of the geographic coordinate system is located at the point where the carrier (i.e., the device containing the gyroscope sensor, such as electronic device 100) is located. The x-axis points east (E) along the local latitude line, the y-axis points north (N) along the local meridian, and the z-axis points upward along the local geographic perpendicular, forming a right-handed rectangular coordinate system with the x-axis and y-axis. The plane formed by the x-axis and y-axis is the local horizontal plane, and the plane formed by the y-axis and z-axis is the local meridian plane. Therefore, it can be understood that the coordinate system of the gyroscope sensor is: with the gyroscope sensor as the origin O, the x-axis points east along the local latitude line, the y-axis points north along the local meridian, and the z-axis points upward (i.e., in the opposite direction of the geographic perpendicular) along the local geographic perpendicular.
[0107] Electronic device 100 can measure the orientation vector of each screen in the coordinate system of its gyroscope sensor 180B by utilizing the gyroscope sensor 180B installed in each screen. For example, refer to... Figure 6 The side view of the electronic device shown shows that the orientation vector of screen A in the coordinate system of gyroscope sensor A is vector z1, and the orientation vector of screen B in the coordinate system of gyroscope sensor B is vector z2. The electronic device 100 can calculate the angle α between vectors z1 and z2 using formula (1). Formula (1) is as follows:
[0108]
[0109] And according to Figure 6As we know, since vector z1 is perpendicular to screen A and vector z2 is perpendicular to screen B, we can obtain the angle θ between screen A and screen B as 180° - α. That is, the electronic device can determine the angle θ between screen A and screen B based on the measured direction vector of screen A in the coordinate system of gyroscope sensor A (i.e., vector z1) and the direction vector of screen B in the coordinate system of gyroscope sensor B (i.e., vector z2).
[0110] It should be noted that although the positions of the gyroscope sensors on screens A and B do not overlap (i.e., the origins of the coordinate systems of the gyroscope sensors on screens A and B do not overlap), the x-axis, y-axis, and z-axis of the two coordinate systems are parallel. Therefore, it can be considered that the coordinate systems of the gyroscope sensors on screens A and B are parallel. Thus, although vectors z1 and z2 are not in the same coordinate system, because the axes of the two coordinate systems are parallel, the angle α between vectors z1 and z2 can still be calculated using the above formula (1).
[0111] In some embodiments, one or more other sensors may be used in conjunction to measure the angle θ between screen A and screen B. For example, an accelerometer 180E may be provided in each screen of the foldable screen. The electronic device 100 (such as processor 110) may use the accelerometer to measure the motion acceleration of each screen when it is rotated; and then calculate the angle of rotation of one screen relative to the other screen, i.e., the angle θ between screen A and screen B, based on the measured motion acceleration.
[0112] In other embodiments, the gyroscope sensor 180B described above can be a virtual gyroscope sensor formed by the cooperation of multiple other sensors. This virtual gyroscope sensor can be used to calculate the angle between adjacent screens of the foldable screen, that is, the angle θ between screen A and screen B.
[0113] The barometric pressure sensor 180C is used to measure barometric pressure. The magnetic sensor 180D includes a Hall effect sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip cover.
[0114] The 180E accelerometer can detect the magnitude of acceleration of electronic device 100 in various directions (typically three axes). When electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the posture of electronic devices and applied to applications such as screen orientation switching and pedometers.
[0115] A proximity sensor 180F is used to measure distance. Electronic device 100 can measure distance via infrared or laser. A proximity sensor 180G may include, for example, a light-emitting diode (LED) and a light detector, such as a photodiode. The LED may be an infrared LED. Electronic device 100 emits infrared light outward through the LED. Electronic device 100 uses the photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that an object is near electronic device 100. When insufficient reflected light is detected, electronic device 100 can determine that no object is near electronic device 100. Electronic device 100 can use the proximity sensor 180G to detect when a user holds electronic device 100 close to their ear for a call, automatically turning off the screen to save power. The proximity sensor 180G can also be used in holster mode and pocket mode for automatic unlocking and screen locking.
[0116] The ambient light sensor 180L is used to sense the brightness of ambient light. The electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also work with the proximity sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.
[0117] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can utilize the characteristics of the collected fingerprints to achieve fingerprint unlocking, accessing application locks, taking photos with fingerprints, answering calls with fingerprints, etc. The temperature sensor 180J is used to detect temperature.
[0118] The touch sensor 180K, also known as the "touch panel," can be placed on the display screen 194. The touch sensor 180K and the display screen 194 together form a touch screen, also known as a "touchscreen." The bone conduction sensor 180M can acquire vibration signals.
[0119] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Electronic device 100 can receive button input and generate key signal inputs related to user settings and function control of electronic device 100.
[0120] Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. For example, different vibration feedback effects can correspond to touch operations performed on different applications (such as taking photos, playing audio, etc.). Motor 191 can also correspond to different vibration feedback effects for touch operations performed on different areas of the display screen 194. Different application scenarios (such as time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also be customized.
[0121] Indicator 192 can be an indicator light, used to indicate charging status, power changes, or to indicate messages, missed calls, notifications, etc.
[0122] The SIM card interface 195 is used to connect a SIM card. The SIM card can be inserted into or removed from the SIM card interface 195 to make contact with and separate from the electronic device 100. The electronic device 100 can support one or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface 195 simultaneously. The multiple cards can be of the same or different types. The SIM card interface 195 is also compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The electronic device 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the electronic device 100 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the electronic device 100 and cannot be separated from the electronic device 100.
[0123] The software system of an electronic device can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This embodiment of the invention uses the layered architecture Android system as an example to illustrate the software structure of an electronic device.
[0124] Figure 8 This is another structural schematic diagram of the electronic device provided in the embodiments of this application.
[0125] As is understandable, a layered architecture divides software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the Android system may include an application layer (referred to as the application layer), an application framework layer (referred to as the framework layer), a hardware abstraction layer, and a kernel layer.
[0126] The application layer described above may include a series of application packages.
[0127] like Figure 8 As shown, the application package may include system applications. System applications refer to applications installed on the electronic device before it leaves the factory. For example, system applications may include programs such as camera, gallery, calendar, music, SMS, and call functions.
[0128] Application packages can also include third-party applications, which are applications that users install after downloading and installing the package from an app store (or app market). For example, map applications (e.g.) (etc.), food delivery apps (e.g.) (etc.), reading applications (e.g., e-books), social applications (e.g.) ) and travel-related applications (e.g. )wait.
[0129] The application framework layer described above provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions.
[0130] like Figure 8 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, display decision module, camera decision module, etc.
[0131] The window manager is used to manage windowed applications. It can retrieve screen size, determine the presence of a status bar, lock the screen, and capture screenshots, among other things.
[0132] Content providers store and retrieve data, making that data accessible to applications. This data can include videos, images, audio, phone calls made and received, browsing history and bookmarks, phone books, and more.
[0133] A view system includes visual controls, such as controls for displaying text and controls for displaying images. View systems can be used to build applications. A display interface can consist of one or more views. For example, a display interface including a text notification icon could include views for displaying text and views for displaying images.
[0134] A phone manager is used to provide communication functions for electronic devices. For example, it manages call status (including connection and disconnection).
[0135] The file explorer provides applications with various resources, such as localized strings, icons, images, layout files, video files, and more.
[0136] The notification manager allows applications to display notifications in the status bar. These notifications can be used to deliver informational messages and can disappear automatically after a short pause, requiring no user interaction. For example, the notification manager can be used to notify users of completed downloads or message alerts. The notification manager can also display notifications as icons or scrolling text in the top status bar, such as notifications from background applications, or as dialog boxes on the screen. Examples include displaying text messages in the status bar, emitting sounds, vibrating the phone, and flashing indicator lights.
[0137] The display decision module is used to determine whether to switch the screen display of the electronic device based on the current screen angle.
[0138] The camera decision module is used to determine whether to switch between the internal and external screen cameras of the electronic device to capture images based on the current screen angle of the electronic device.
[0139] The application layer and application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and application framework layer as binary files. The virtual machine is used to perform functions such as object lifecycle management, stack management, thread management, security and exception management, and garbage collection.
[0140] HAL encapsulates the underlying hardware driver, providing a generic interface for the application framework layer to call the driver. In this embodiment, the hardware abstraction layer may include a sensor hardware abstraction module and a camera hardware abstraction module.
[0141] The sensor hardware abstraction module receives information collected by the sensor, determines the angle between the first screen and the second screen of the electronic device based on the information collected by the sensor, and sends the angle between the first screen and the second screen to the camera hardware abstraction module and / or the display decision module.
[0142] The camera hardware abstraction module is used to determine when the angle between the first screen and the second screen of the electronic device meets the angle threshold of the switching preparation stage, and to control the target camera to perform camera initialization operation. When the angle between the first screen and the second screen of the electronic device meets the threshold of the switching stage, the target camera that has completed the initialization operation is triggered to send an image.
[0143] The kernel layer is the layer between hardware and software. The kernel layer includes at least the display driver, camera driver, audio driver, and sensor driver.
[0144] In some embodiments, the sensor driver can be used to acquire information collected by the sensor, determine the angle between the first screen and the second screen of the electronic device based on the information collected by the sensor, and send the angle between the first screen and the second screen to the camera driver.
[0145] The camera driver can be used to determine when the angle between the first screen and the second screen of the electronic device meets the angle threshold of the switching preparation stage, and control the target camera to perform camera initialization operation. When the angle between the first screen and the second screen of the electronic device meets the threshold of the switching stage, the target camera that has completed the initialization operation is triggered to send an image.
[0146] In some embodiments, the camera driver may include an external screen front-facing camera driver and an internal screen front-facing camera driver, wherein the external screen front-facing camera driver can be used to drive the external screen front-facing camera, and the internal screen front-facing camera driver can be used to drive the internal screen front-facing camera. Furthermore, the camera driver may also include a rear camera driver.
[0147] For ease of understanding, the following embodiments of this application will be described using... Figure 5 and Figure 8 Taking the electronic device shown as an example, the following describes the display method of the electronic device provided in the embodiments of this application in detail with reference to the accompanying drawings, using a foldable screen mobile phone as an example.
[0148] In this embodiment, when the hardware abstraction layer determines that the angle between the first and second screens of the foldable screen reaches a preset angle range, the hardware abstraction layer directly triggers the display of the image captured by the target camera. Furthermore, when the hardware abstraction layer determines that the angle between the first and second screens of the foldable screen meets the angle threshold of the switching preparation phase, the hardware abstraction layer controls the target camera to perform initialization operations (e.g., power-on, configuration register sequence, etc.).
[0149] For example, such as Figure 9 As shown, camera apps on a mobile phone respond to user actions (such as clicking or touching) by using the front-facing camera to capture images, or social media apps on the phone (such as...) In response to user actions, the front-facing camera is used for video calls or image capture. The kernel-level sensor driver can acquire data from at least one sensor in real-time or periodically. The sensor driver sends the data from at least one sensor to the sensor hardware abstraction module. Based on the data from at least one sensor, the sensor hardware abstraction module determines the angle between the first and second screens of the foldable screen and sends this angle to the camera hardware abstraction module. The camera hardware abstraction module determines the target camera for displaying the image based on the angle between the first and second screens. The camera hardware abstraction module sends the target camera's identifier to the camera driver, and the camera driver, based on the target camera's identifier, controls the corresponding camera driver to trigger the display of the image captured by the target camera.
[0150] Furthermore, after obtaining the angle between the first and second screens, the camera hardware abstraction module determines that the angle meets the angle threshold for the camera switching preparation phase. At this point, the module can control the target camera to perform camera initialization operations. These initialization operations include power-on and configuring register sequences. Therefore, when the camera hardware abstraction module determines that the target camera will be used for image display, it directly triggers the display of the image acquired by the initialized target camera, saving camera preparation work and improving the camera's display rate.
[0151] In one possible scenario, when a phone responds to a user's action by using the external screen's front-facing camera to capture an image, during the process of the phone's foldable screen switching from a folded state to an unfolded state, the sensor hardware abstraction module determines the angle between the first and second screens of the foldable screen based on sensor information and then sends the current screen angle to the camera hardware abstraction module. The camera hardware abstraction module can determine the current physical state of the phone's foldable screen based on the angle between the first and second screens. For example, the camera hardware abstraction module can determine whether the phone's foldable screen has switched from a folded state to an unfolded state. When the camera hardware abstraction module determines that the angle between the first and second screens meets the angle threshold for the switching preparation phase, it can perform camera initialization operations on the internal screen's front-facing camera. For example, the camera hardware abstraction module can perform initialization operations such as powering on and configuring parameters for the internal screen camera. When the camera hardware abstraction module determines that the angle between the first and second screens meets the angle threshold for the switching phase, the internal screen's front-facing camera driver directly drives the image captured by that internal screen's front-facing camera to be displayed. A specific implementation process can be exemplified as follows: Figure 10 The implementation process.
[0152] The following is combined with Figure 10 The above process will be explained in detail. Figure 10 A flowchart illustrating an image display method provided in this application embodiment. Figure 3 .
[0153] like Figure 10 As shown, the display method may include the following steps:
[0154] Step 801: The sensor driver acquires the data collected by the sensor.
[0155] In this embodiment, the sensor driver can acquire data collected in real time from at least one sensor, such as an angle sensor, an acceleration sensor, or a gyroscope sensor.
[0156] For example, a mobile phone can use an accelerometer to measure the motion acceleration of each screen of the phone when it is rotated. A mobile phone can use a gyroscope sensor to measure the change in orientation angle of each screen.
[0157] Step 802: The sensor driver sends the data collected by the sensor to the sensor hardware abstraction module.
[0158] Step 803: The sensor hardware abstraction module determines the angle between the first screen and the second screen based on the data collected by the sensor.
[0159] The process of determining the angle between the first screen and the second screen in step 803 can be found in the above text. Figure 6 and Figure 7 The corresponding description.
[0160] In this embodiment, after receiving the sensor-collected data sent by the sensor driver, the sensor hardware abstraction module can determine the angle between the first screen and the second screen of the mobile phone based on the sensor-collected data. As an example, assuming the sensor hardware abstraction module receives data collected by an accelerometer and a gyroscope, the sensor hardware abstraction module can determine the angle between the first screen and the second screen of the mobile phone based on the data collected by the accelerometer and the gyroscope.
[0161] Step 804: The sensor hardware abstraction module sends the angle between the first screen and the second screen to the display decision module.
[0162] Step 805: The sensor hardware abstraction module sends the angle between the first screen and the second screen to the camera hardware abstraction module.
[0163] In this embodiment, after the sensor hardware abstraction module determines the angle between the first screen and the second screen, it can send the angle between the first screen and the second screen to the display decision module and the camera hardware abstraction module.
[0164] It should be explained that the sensor hardware abstraction module can simultaneously send the angle between the first screen and the second screen to the display decision module and the camera hardware abstraction module, or it can send the angle between the first screen and the second screen to the display decision module first, and then send the angle between the first screen and the second screen to the camera hardware abstraction module, or it can send the angle between the first screen and the second screen to the camera hardware abstraction module first, and then send the angle between the first screen and the second screen to the display decision module. In other words, the execution order of steps 804 and 805 is not limited in this embodiment.
[0165] Step 806: The display decision module determines that the included angle is greater than the angle threshold 1, performs screen initialization operations, and marks the screen status identifier.
[0166] Here, angle threshold 1 is the angle at which the phone begins pre-switching operations on the screen. Angle threshold 1 can be a user-preset angle threshold or an angle value determined by the phone based on the user's screen usage habits. For example, angle threshold 1 can be set to 55°, 60°, etc.
[0167] In this embodiment of the application, after receiving the angle between the first screen and the second screen, the display decision module determines whether the angle is greater than the angle threshold 1.
[0168] In some embodiments, if the display decision module determines that the angle between the first screen and the second screen is less than or equal to an angle threshold of 1, the display decision module does not perform any processing. That is, the phone continues to display the image captured by the camera on the external screen.
[0169] In other embodiments, if the display decision module determines that the angle between the first screen and the second screen is greater than an angle threshold of 1, the display decision module prepares for screen switching. The display decision module performs initialization operations such as powering on the inner screen, thereby avoiding the initialization process of the inner screen when the mobile phone displays image information on the inner screen, thus improving image display efficiency.
[0170] In this embodiment, the display decision module marks the screen state identifier to identify the screen used for displaying the image. The screen state identifier uniquely identifies the screen currently used for displaying the image. For example, if the display decision module determines that the screen state is unfolded, i.e., the screen used for displaying the image is the inner screen, then the display decision module marks the screen state identifier as 1; if the display decision module determines that the screen state is folded, i.e., the screen used for displaying the image is the outer screen, then the display decision module marks the screen state identifier as 0.
[0171] Step 807: The camera hardware abstraction module determines that the included angle is greater than the angle threshold 2 and performs a pre-switching operation on the front camera of the inner screen.
[0172] Here, angle threshold 2 is the angle at which the phone begins pre-switching the camera. Angle threshold 2 can be the same as or different from angle threshold 1; there is no limitation here. For example, angle threshold 2 can be 55°, 60°, 65°, etc.
[0173] In this embodiment, the camera hardware abstraction module determines that the angle between the first screen and the second screen is greater than an angle threshold of 2, and then triggers the inner screen front camera to prepare for switching. For example, the camera hardware abstraction module triggers the inner screen front camera to perform operations such as power-on and configuration register sequence.
[0174] In some embodiments, if angle threshold 1 and angle threshold 2 are the same, after the sensor hardware abstraction module and the camera hardware abstraction module obtain the angle between the first screen and the second screen respectively, the mobile phone can simultaneously execute the above steps 806 and 807, thereby shortening the screen switching and camera switching time and improving the efficiency of screen switching and camera switching.
[0175] Step 808: The camera hardware abstraction module determines that the included angle is greater than the angle threshold 3.
[0176] Here, angle threshold 3 is the angle at which the phone determines whether to switch from the external screen front camera to the internal screen front camera for image capture. Angle threshold 3 is greater than angle threshold 2. Angle threshold 3 can be a user-preset angle threshold or an angle value determined by the phone based on the user's screen usage habits. For example, angle threshold 3 can be set to 85°, 95°, etc.
[0177] This can be understood as follows: during the process of switching the folded screen of a mobile phone from a folded state to an unfolded state, when the angle between the first screen and the second screen of the phone is greater than the angle threshold 3, the screen used to display images can switch from the outer screen to the inner screen, and the camera used to capture images can switch from the front-facing camera on the outer screen to the front-facing camera on the inner screen, thus achieving synchronous switching of the screen and the camera.
[0178] Step 809: The camera hardware abstraction module sends a screen status identifier request to the display decision module.
[0179] Step 810: The display decision module sends a screen status identifier to the camera hardware abstraction module.
[0180] In this embodiment, the display decision module can send a screen status identifier corresponding to the screen currently used to display the image to the camera hardware abstraction module according to the screen status identifier request, so that the camera hardware abstraction module can determine the screen currently displaying the image based on the received screen status identifier.
[0181] Step 811: The camera hardware abstraction module determines that the screen status identifier is the inner screen, determines that the image is captured by the front-facing camera on the inner screen, and displays it on the inner screen.
[0182] In this embodiment, the camera hardware abstraction module determines that the angle between the first screen and the second screen is greater than an angle threshold of 3, and identifies the screen state as the inner screen. The camera hardware abstraction module determines that the image is captured by the front-facing camera on the inner screen, and determines that the image captured by the front-facing camera on the inner screen is displayed on the inner screen. The inner screen is a large screen composed of the first screen and the second screen.
[0183] Step 812: The driver controls the front-facing camera on the inner screen to capture images and send them to the display.
[0184] In this embodiment of the application, when the camera hardware abstraction module determines that the preview image captured by the front camera of the inner screen should be sent for display, and when the camera driver determines that the preview image captured by the front camera of the inner screen should be sent for display, the front camera driver of the inner screen controls the front camera of the inner screen to capture the image and displays the preview image captured by the front camera of the inner screen on the inner screen.
[0185] For example, the driver for the inner screen front camera can control the MIPI interface switch to close the image output path of the outer screen front camera and open the image output path of the inner screen front camera, thereby achieving the purpose of switching the camera image output path.
[0186] For example, when the phone's foldable screen is in a folded state, the phone's... In response to a user's action during a video call, the phone's external front-facing camera captures the user's image information and displays it on the phone's external screen. See [link / reference]. Figure 11 (a) In the process of switching the foldable screen of the phone from the folded state to the unfolded state, if the display decision module determines that the angle θ between the first screen and the second screen is less than or equal to the angle threshold 1 (e.g., 60°), then the outer screen of the phone continues to display the image information captured by the front-facing camera on the outer screen, while the inner screen of the phone does not display any image information. See [reference needed]. Figure 11 (b) If the display decision module determines that the angle θ between the first screen and the second screen is greater than angle threshold 1, the display decision module prepares for screen switching. If the camera hardware abstraction module determines that the angle θ between the first screen and the second screen is greater than angle threshold 2 (e.g., 65°), the camera hardware abstraction module triggers the internal screen front camera to prepare for switching. If the camera hardware abstraction module determines that the angle θ between the first screen and the second screen is greater than angle threshold 3 (e.g., 85°), the camera hardware abstraction module triggers the internal screen front camera to capture an image and displays the preview image captured by the internal screen front camera on the internal screen. See [link to relevant documentation]. Figure 11(c) In this way, the camera hardware abstraction module determines whether to switch between the inner and outer screen cameras based on the angle between the first screen and the second screen. This avoids the problem that the camera switching speed is slow after the phone switches from displaying an image on the outer screen to displaying a preview image on the inner screen, resulting in the inner screen front camera not sending an image. The camera hardware abstraction module triggers the inner screen camera to perform pre-initialization operations, which improves the efficiency of switching between the inner and outer screen cameras.
[0187] As described above, while the display decision module determines whether to switch screens based on the angle between the first and second screens, the camera hardware abstraction module simultaneously determines whether to prepare for switching the inner screen front-facing camera based on the angle between the first and second screens, and determines whether to switch to the inner screen front-facing camera. When the camera hardware abstraction module determines to use the inner screen front-facing camera to display images, the inner screen can directly display the image captured by the inner screen front-facing camera. This solves the problem in related technologies where the inner screen front-facing camera only begins initialization operations when the phone determines to use it, resulting in long camera switching times and low efficiency, thus improving the camera's display rate.
[0188] In another possible scenario, when the phone responds to a user's action by using the inner screen's front-facing camera to capture an image, during the process of the phone's foldable screen switching from an unfolded state to a folded state, the sensor hardware abstraction module determines the angle between the first and second screens based on sensor information and sends this angle to the camera hardware abstraction module. When the camera hardware abstraction module determines that the angle between the first and second screens meets the angle threshold for the switching preparation phase, it can perform camera initialization operations on the outer screen's front-facing camera. For example, the camera hardware abstraction module can perform initialization operations such as powering on and configuring parameters for the outer screen camera. When the camera hardware abstraction module determines that the angle between the first and second screens meets the angle threshold for the switching preparation phase, the outer screen's front-facing camera driver directly triggers the image captured by that camera for display. A specific implementation process can be exemplified as follows: Figure 12 The implementation process.
[0189] The following is combined with Figure 12 The above process will be explained in detail. Figure 12 A flowchart illustrating an image display method provided in this application embodiment. Figure 4 .
[0190] like Figure 12 As shown, the display method may include the following steps:
[0191] Step 1001: The sensor driver acquires the data collected by the sensor.
[0192] Step 1002: The sensor driver sends the data collected by the sensor to the sensor hardware abstraction module.
[0193] Step 1003: The sensor hardware abstraction module determines the angle between the first screen and the second screen based on the data collected by the sensor.
[0194] Step 1004: The sensor hardware abstraction module sends the angle between the first screen and the second screen to the display decision module.
[0195] Step 1005: The sensor hardware abstraction module sends the angle between the first screen and the second screen to the camera hardware abstraction module.
[0196] In the embodiments of this application, the implementation process of steps 1001 to 1005 can be referred to the implementation process of steps 801 to 805 above, and will not be repeated here.
[0197] Step 1006: The display decision module determines that the included angle is less than the angle threshold 4, triggers the screen to perform screen initialization operation, and marks the screen status identifier.
[0198] Here, angle threshold 4 is the angle at which the phone initiates screen initialization. Angle threshold 4 can be a user-preset angle threshold or an angle value determined by the phone based on the user's screen usage habits. For example, angle threshold 4 can be set to 85°, 90°, etc.
[0199] In this embodiment of the application, after receiving the angle between the first screen and the second screen, the display decision module determines whether the angle between the first screen and the second screen is less than the angle threshold 4.
[0200] In some embodiments, if the display decision module determines that the angle between the first screen and the second screen is greater than or equal to an angle threshold of 4, the display decision module does not perform any processing. That is, the phone continues to display the image captured by the camera on the inner screen.
[0201] In other embodiments, if the display decision module determines that the angle between the first screen and the second screen is less than an angle threshold of 4, the display decision module performs screen initialization operations. The display decision module performs initialization operations such as powering on the external screen and configuring the register sequence, thereby shortening the time for displaying images on the external screen and improving image display efficiency when the mobile phone determines to use the external screen to display image information.
[0202] In this embodiment, the display decision module marks a screen status identifier to identify the screen used for displaying an image. The screen status identifier uniquely identifies the screen currently used for displaying the image. For example, the display decision module marks the screen status identifier as the outer screen.
[0203] Step 1007: The camera hardware abstraction module determines that the included angle is less than the angle threshold of 5, and triggers the external screen front camera to perform initialization operations.
[0204] Here, angle threshold 5 is the angle at which the phone begins initializing the front-facing camera on the external screen. Angle threshold 5 can be the same as or different from angle threshold 4; there is no limitation here. For example, angle threshold 5 can be 85°, 90°, 95°, etc.
[0205] In this embodiment, the camera hardware abstraction module determines that the angle between the first screen and the second screen is less than an angle threshold of 5, and then triggers the external screen front-facing camera to perform camera initialization operations. For example, the camera hardware abstraction module triggers the external screen front-facing camera to perform operations such as power-on and configuring register sequences.
[0206] In some embodiments, if angle threshold 4 and angle threshold 5 are the same, after the sensor hardware abstraction module and the camera hardware abstraction module obtain the angle between the first screen and the second screen respectively, the mobile phone can simultaneously execute the above steps 1006 and 1007, thereby shortening the screen switching and camera switching time and improving the efficiency of screen switching and camera switching.
[0207] Step 1008: The camera hardware abstraction module determines that the included angle is less than the angle threshold of 6.
[0208] Here, angle threshold 6 is the maximum angle at which the phone switches from the inner screen front camera to the outer screen front camera for image capture. Angle threshold 6 is less than angle threshold 5. Angle threshold 6 can be a user-preset angle threshold or an angle value determined by the phone based on the user's screen usage habits. For example, angle threshold 6 can be set to 55°, 60°, 63°, etc.
[0209] This can be understood as follows: during the process of switching the foldable screen of a mobile phone from an unfolded state to a folded state, when the angle between the first screen and the second screen of the phone is less than the angle threshold of 6, the screen used to display images can switch from the inner screen to the outer screen, and the camera used to capture images can switch from the inner screen front camera to the outer screen front camera, thus achieving synchronous switching of the screen and the camera.
[0210] Step 1009: The camera hardware abstraction module sends a screen status identifier request to the display decision module.
[0211] Step 1010: The display decision module sends a screen status identifier to the camera hardware abstraction module.
[0212] Step 1011: The camera hardware abstraction module determines that the screen status identifier is the external screen, determines that the image is captured by the front-facing camera on the external screen, and displays it on the external screen.
[0213] In this embodiment, the camera hardware abstraction module determines that the angle between the first screen and the second screen is less than an angle threshold of 6, and determines that the screen state is identified as the outer screen. The camera hardware abstraction module determines that the image is captured by the front-facing camera on the outer screen, and determines that the image captured by the front-facing camera on the outer screen is displayed on the outer screen.
[0214] Step 1012: The external screen front camera driver controls the external screen front camera to capture images and send them to the display.
[0215] In this embodiment, when the camera hardware abstraction module determines that the preview image captured by the front-facing camera on the external screen should be sent for display, the front-facing camera driver controls the front-facing camera on the external screen to capture the image and displays the preview image captured by the front-facing camera on the external screen.
[0216] For example, the external screen front camera driver can control the MIPI interface switch to close the image output path of the internal screen front camera and open the image output path of the external screen front camera, thereby achieving the purpose of switching the camera image output path.
[0217] For example, when the phone's foldable screen is in the unfolded state, the phone's... When a user initiates a video call, the phone's internal front-facing camera captures the user's image information and displays it on the phone's internal screen. (See [link to relevant documentation]). Figure 13 (a) During the process of switching the phone's foldable screen from an unfolded state to a folded state, if the display decision module determines that the angle θ between the first screen and the second screen is less than an angle threshold 4 (e.g., 95°), the display decision module prepares for screen switching. If the camera hardware abstraction module determines that the angle between the first screen and the second screen is less than an angle threshold 5, the camera hardware abstraction module prepares for switching to the front-facing camera on the outer screen. At this time, the inner screen of the phone continues to display the image information captured by the inner screen camera. See [link to relevant documentation]. Figure 13 (b) In this context, the camera hardware abstraction module determines that the angle between the first and second screens of the foldable screen is less than an angle threshold of 6 (e.g., 55°). The module then determines to use the external screen's front-facing camera to capture images and to display the preview image captured by the external screen's front-facing camera on the external screen. See [link to relevant documentation]. Figure 13 (c) in the middle.
[0218] As described above, while the display decision module determines whether to switch screens based on the current screen angle, the camera hardware abstraction module simultaneously determines whether to prepare for switching to the external screen front camera based on the current screen angle, and determines whether to switch to the external screen front camera. When the camera hardware abstraction module determines to use the external screen front camera to send the image, the external screen can directly display the preview image captured by the external screen front camera. This solves the problems in related technologies where the external screen front camera only begins initialization operations when the phone determines to use it, resulting in long camera switching times and low efficiency, thus improving the camera's image transmission rate.
[0219] In this embodiment, when the kernel layer determines that the angle between the first and second screens of the foldable screen meets the angle threshold of the switching phase, the electronic device directly triggers the display of the image captured by the target camera. Furthermore, when the kernel layer determines that the angle between the first and second screens meets the angle threshold of the switching preparation phase, the kernel layer controls the target camera to perform camera initialization operations (e.g., power-on, configuration register sequence, etc.).
[0220] For example, such as Figure 14 As shown, camera apps on a mobile phone respond to user actions (such as clicking or touching) by using the front-facing camera to capture images, or social media apps on the phone (such as...) In response to user actions, the front-facing camera is used for video calls or image capture. The kernel-level sensor driver can acquire data from at least one sensor in real-time or periodically. Based on the data from at least one sensor, the sensor driver determines the angle between the first and second screens and sends this angle to the kernel layer. After determining the target camera for displaying the image based on the angle between the first and second screens, the kernel layer triggers the target camera to display the image. Thus, the electronic device can determine the target camera for displaying the image at the kernel layer, without interacting with the hardware abstraction layer and application framework layer. This reduces cross-service / component interaction processes, saves decision-making time, and improves the switching efficiency between the internal and external front-facing cameras.
[0221] Furthermore, after the kernel layer obtains the angle between the first and second screens, and determines that the angle meets the angle threshold for the camera switching preparation phase, the kernel layer can control the target camera to perform camera initialization operations. Thus, when the kernel layer determines to use the target camera to display the image, it directly controls the target camera to display the image, saving the camera's preparation work and improving the camera's display rate.
[0222] In one possible scenario, assuming the phone uses the external screen's front-facing camera to capture images, as the phone responds to user input and the folded screen switches from a folded state to an unfolded state, the sensor driver can collect information from the sensors installed in the phone in real-time or periodically. After determining the angle between the first and second screens based on the sensor information, the sensor driver can send this angle to the kernel-level camera driver in real-time or periodically. The camera driver can then determine whether to switch from the external screen's front-facing camera to the internal screen's front-facing camera based on the angle between the first and second screens. A specific implementation process can be exemplified as follows. Figure 15 The implementation process.
[0223] The following is combined with Figure 15 The above process will be explained in detail. Figure 15 A flowchart illustrating an image display method provided in this application embodiment. Figure 6 .
[0224] like Figure 15 As shown, the display method may include the following steps:
[0225] Step 1301: The sensor driver acquires the data collected by the sensor and determines the angle between the first screen and the second screen based on the data collected by the sensor.
[0226] In this embodiment, the sensor driver can acquire data from at least one sensor, such as an angle sensor, an accelerometer, or a gyroscope sensor, in real time or periodically. The sensor driver can determine the angle between the first screen and the second screen based on the acquired sensor data. For example, the sensor driver can acquire data from an accelerometer and a gyroscope sensor, and then determine the angle between the first and second screens of the foldable screen of the phone based on the accelerometer and gyroscope data. The specific implementation process of the sensor driver determining the angle between the first and second screens based on the accelerometer and gyroscope sensors can be found above. Figure 6 and Figure 7 The description process will not be repeated here.
[0227] Step 1302: The sensor driver sends the angle between the first screen and the second screen to the camera driver.
[0228] Step 1303: The camera driver determines that the angle is greater than the angle threshold 7 and triggers the internal screen front camera to perform initialization operations.
[0229] In this embodiment, after the sensor driver determines the angle between the first screen and the second screen of the foldable screen in real time or periodically, the sensor driver can send the angle between the first screen and the second screen to the camera driver in real time or periodically. After receiving the angle between the first screen and the second screen sent by the sensor driver, the camera driver determines whether the angle between the first screen and the second screen is greater than an angle threshold 7. If the camera driver determines that the received angle between the first screen and the second screen is greater than the angle threshold 7, the camera driver controls the inner screen front camera driver to trigger the inner screen front camera to perform camera initialization operations. For example, the camera driver controls the inner screen front camera to perform initialization operations such as power-on and configuration register sequence.
[0230] Step 1304: The camera driver determines that the included angle is greater than the angle threshold 8, and controls the front camera of the inner screen to send and display the image.
[0231] Here, angle threshold 8 is the angle at which the phone determines whether to switch from the external screen front camera to the internal screen front camera for image capture. Angle threshold 8 is greater than angle threshold 7. Angle threshold 8 can be a user-preset angle threshold or an angle value determined by the phone based on the user's screen usage habits. For example, angle threshold 8 can be set to 85°, 95°, etc. Angle threshold 8 can be the same as or different from angle threshold 3 mentioned above; no limitation is made here.
[0232] In this embodiment, after the camera driver receives the angle between the first screen and the second screen from the sensor driver in real time or periodically, when the camera driver determines that the angle between the first screen and the second screen is greater than an angle threshold of 8, the camera driver directly controls the inner screen front camera to trigger the inner screen front camera to display an image. For example, the inner screen front camera driver can control the MIPI interface switch to close the image output path of the outer screen front camera and open the image output path of the inner screen front camera, thereby achieving the purpose of switching the camera image output path.
[0233] This can be understood as follows: during the process of switching the folded screen of a mobile phone from the folded state to the unfolded state, when the angle between the first screen and the second screen of the mobile phone is greater than the angle threshold 8, the screen used to display images in the mobile phone can switch from the outer screen to the inner screen, and the camera used to capture images can switch from the front-facing camera on the outer screen to the front-facing camera on the inner screen, thereby realizing the synchronous switching of the screen and the camera.
[0234] Continue with Figure 11 As an example, when the phone's foldable screen is in the folded state, the phone's... In response to a user's action during a video call, the phone's external front-facing camera captures the user's image information and displays it on the phone's external screen. See [link / reference]. Figure 11(a) During the transition from a folded to a displayed state, if the camera driver determines that the angle between the first and second screens is greater than an angle threshold of 7 (e.g., 65°), the camera driver triggers the inner screen's front-facing camera to prepare for switching. The outer screen continues to display the image information captured by the outer screen's front-facing camera, while the inner screen does not display any image information. See [link to relevant documentation]. Figure 11 (b) In this section, the camera driver determines that the angle θ between the first and second screens of the phone is greater than an angle threshold 8 (e.g., 85°). The camera driver then controls the inner screen front-facing camera driver to trigger the inner screen front-facing camera to capture an image and displays the preview image captured by the inner screen front-facing camera on the inner screen. See also... Figure 11 (c) In this way, the camera driver determines whether to switch between the inner and outer screen cameras based on the current screen angle of the phone. This avoids the problem that the camera switching speed is slow after the phone switches from displaying an image on the outer screen to displaying an image on the inner screen, resulting in the inner screen front camera not sending an image. The camera driver triggers the inner screen camera to perform initialization operations in advance, which improves the efficiency of switching between the inner and outer screen cameras.
[0235] As described above, during the transition from a folded to an unfolded state of the phone's foldable screen, when the camera driver determines that the angle between the first and second screens reaches angle threshold 7, it triggers the inner screen's front-facing camera to prepare for switching, thus achieving the purpose of initializing the inner screen's front-facing camera in advance. When the camera driver determines that the angle between the first and second screens reaches angle threshold 8, it directly controls the inner screen's front-facing camera to send an image, thereby achieving the purpose of quickly switching the screen display and improving the efficiency of camera switching. Furthermore, after the sensor driver determines the angle between the first and second screens, it directly sends this angle to the camera driver, which then decides whether to switch the camera display. The sensor driver does not need to upload the information collected by the sensors to the hardware abstraction layer, reducing cross-component and cross-process interaction processes and improving the efficiency of camera switching.
[0236] In another possible scenario, assuming the phone uses the inner screen's front-facing camera to capture images, as the phone responds to user input and the folded screen switches from an unfolded state to a folded state, the sensor driver can collect information from the sensors installed in the phone in real time or periodically. After determining the angle between the first and second screens of the folded screen based on the sensor information, the sensor driver can send this angle to the camera driver in the kernel layer in real time or periodically. The camera driver can then determine whether to switch the inner screen's front-facing camera to the outer screen's front-facing camera based on the angle between the first and second screens. A specific implementation process can be exemplified as follows. Figure 16The implementation process.
[0237] The following is combined with Figure 16 The above process will be explained in detail. Figure 16 A flowchart illustrating an image display method provided in this application embodiment. Figure 7 .
[0238] like Figure 16 As shown, the display method may include the following steps:
[0239] Step 1401: The sensor driver acquires the data collected by the sensor and determines the angle between the first screen and the second screen based on the data collected by the sensor.
[0240] Step 1402: The sensor driver sends the angle between the first screen and the second screen to the camera driver.
[0241] In the embodiments of this application, the implementation process of steps 1401 to 1402 can be referred to the implementation process of steps 1301 to 1302 described above, and will not be repeated here.
[0242] Step 1403: The camera driver determines that the included angle is less than the angle threshold 9, and triggers the internal screen front camera to perform initialization operations.
[0243] In this embodiment, after the sensor driver determines the angle between the first screen and the second screen of the foldable screen in real time or periodically, the sensor driver can send the angle between the first screen and the second screen to the camera driver in real time or periodically. After receiving the angle between the first screen and the second screen sent by the sensor driver, the camera driver determines whether the angle between the first screen and the second screen is less than an angle threshold 9. If the camera driver determines that the received angle between the first screen and the second screen is less than the angle threshold 9, the camera driver controls the external screen front camera driver to trigger the external screen front camera to perform initialization operations. For example, the camera driver controls the external screen front camera to perform initialization operations such as power-on and configuration register sequence.
[0244] Step 1404: The camera driver determines that the included angle is less than the angle threshold of 10, and controls the front-facing camera on the external screen to send and display the image.
[0245] The angle threshold 10 is the angle at which the phone switches from using the inner screen front camera to using the outer screen front camera to capture images. The angle threshold 10 is less than the angle threshold 9. The angle threshold 10 can be a user-preset angle threshold or an angle value determined by the phone based on the user's screen usage habits. For example, the angle threshold 10 can be set to 85°, 95°, etc.
[0246] In this embodiment, after the camera driver receives the angle between the first screen and the second screen from the sensor driver in real time or periodically, when the camera driver determines that the angle between the first screen and the second screen is less than an angle threshold of 10, the camera driver directly controls the external screen front camera driver to trigger the external screen front camera to display an image. For example, the external screen front camera driver can control the MIPI interface switch to close the image output path of the internal screen front camera and open the image output path of the external screen front camera, thereby achieving the purpose of switching the camera image output path.
[0247] This can be understood as follows: during the process of switching the folded screen of a mobile phone from a folded state to an unfolded state, when the angle between the first screen and the second screen of the phone is less than the angle threshold of 10, the screen used to display images can switch from the inner screen to the outer screen, and the camera used to capture images can switch from the inner screen front camera to the outer screen front camera, thus achieving synchronous switching of the screen and the camera.
[0248] Continue with Figure 13 As an example, when the phone's foldable screen is in the unfolded state, the phone's... When a user initiates a video call, the phone's internal front-facing camera captures the user's image information and displays it on the phone's internal screen. (See [link to relevant documentation]). Figure 13 (a) In the process of switching the phone's foldable screen from the unfolded state to the folded state, if the camera driver determines that the angle θ between the first screen and the second screen is less than the angle threshold 9, the camera driver prepares to switch to the front-facing camera on the outer screen. At this time, the inner screen of the phone continues to display the image information captured by the inner screen camera, see [reference]. Figure 13 (b) In this context, the camera driver determines that the current screen angle is less than an angle threshold of 10 degrees (e.g., 55°), determines to use the external screen front-facing camera to capture the image, and determines to display the image captured by the external screen front-facing camera on the external screen. See [link to relevant documentation]. Figure 13 (c) in the middle.
[0249] As described above, during the transition from the unfolded to the folded state of the phone's foldable screen, when the camera driver determines that the current screen angle reaches angle threshold 9, it triggers the external screen's front-facing camera to prepare for switching, thus achieving the purpose of initializing the external screen's front-facing camera in advance. When the camera driver determines that the angle between the first and second screens reaches angle threshold 10, it directly controls the external screen's front-facing camera to send the displayed image, thereby achieving the purpose of quickly switching the screen's displayed image and improving the efficiency of camera switching. In addition, after the sensor driver determines the angle between the first and second screens, it directly sends the angle between the first and second screens to the camera driver, which then decides whether to switch the camera's display, without needing to upload to the camera hardware abstraction module. This reduces cross-component and cross-process interaction processes and improves the efficiency of camera switching.
[0250] In the above Figure 15 and Figure 16 In some cases, when the camera driver controls the switching between the inner and outer screen front cameras, the phone screen may not have completed the switching process, leading to image display errors or no display at all after the camera switch is complete. To address this, the camera driver obtains the screen status indicator when determining the image output path for switching between the inner and outer screen front cameras. The camera driver only uses the inner screen front camera to display the image when it determines that the screen status indicator is for the inner screen. Similarly, it only uses the outer screen front camera to display the image when it determines that the screen status indicator is for the outer screen. This avoids display errors or no display when the physical state of the foldable screen changes.
[0251] In this embodiment, after the sensor driver determines the angle between the first screen and the second screen, it can send the angle between the first screen and the second screen to the display decision module through the hardware abstraction module. After receiving the angle between the first screen and the second screen, the display decision module marks the screen state according to the angle between the first screen and the second screen.
[0252] In some embodiments, when the phone responds to a user's operation by capturing an image using the external screen's front-facing camera, during the process of the phone's foldable screen switching from a folded state to an unfolded state, if the phone triggers a pre-switching operation on the internal screen's front-facing camera, the phone can display the image captured by the external screen's front-facing camera on the second screen of the internal screen. When the phone triggers the internal screen's front-facing camera to display an image, the internal screen, composed of the first and second screens, displays the image captured by the internal screen's front-facing camera. Therefore, by displaying the image captured by the external screen's front-facing camera on the second screen, the phone avoids problems such as a slow screen transition after camera switching, which could lead to a black or white screen on the internal screen, thus improving the user experience.
[0253] For example, such as Figure 17 As shown, when the phone's foldable screen is in the folded state, the phone's... In response to a user's action during a video call, the phone's external front-facing camera captures the user's image information and displays it on the phone's external screen. See [link / reference]. Figure 17 (a) In the process of switching the foldable screen of the mobile phone from the folded state to the display state, when the mobile phone triggers the inner screen front camera to prepare for switching, the display decision module controls the second screen of the mobile phone to display the image information captured by the outer screen front camera. See (a). Figure 17 (b) In this context, the phone triggers the front-facing camera on the inner screen to capture an image, and then displays the captured image on the inner screen. The large screen, composed of the phone's first and second screens, displays the image captured by the front-facing camera on the inner screen. See also... Figure 17 (c) in the middle.
[0254] In summary, in this embodiment, the camera hardware abstraction module of the hardware abstraction layer triggers the camera to perform camera initialization when the angle between the first screen and the second screen meets the angle threshold of the switching preparation stage. When the camera hardware abstraction module determines that the angle between the first screen and the second screen meets the threshold of the switching stage, it triggers the camera that has completed the initialization operation to switch to displaying the image. This solves the problem in related technologies where the camera decision module in the application framework layer determines the camera to be used for displaying the image, and the mobile phone only starts the initialization operation for that camera, resulting in long camera switching time and low efficiency. This improves the camera's display rate. Furthermore, since the camera has already completed the pre-switching operation, when the camera hardware abstraction module displays the image based on the camera that has completed the pre-switching operation, it directly triggers the camera to display the image, making the camera switching smoother and more fluid.
[0255] When the angle between the first and second screens meets the angle threshold for the switching preparation phase, the kernel-level camera driver triggers the camera to perform camera initialization. Once the camera driver determines that the phone meets the angle threshold, it triggers the target camera, which has already completed initialization, to switch the displayed image. Therefore, the sensor driver does not need to upload sensor-collected information to the hardware abstraction layer and application framework layer. The kernel-level camera driver decides whether to perform switching preparation and image switching, thereby reducing cross-component and cross-process interactions and improving camera switching efficiency.
[0256] Compared to related technologies where the camera of an electronic device switches according to the physical state of the screen, the entire execution process is relatively long, resulting in low display efficiency during camera switching. In this embodiment, the camera hardware abstraction module or camera driver adds preparation work for switching the target camera, shortening the camera switching time. After the camera hardware abstraction module or camera driver determines that the current screen angle of the electronic device meets the angle threshold for the switching stage, it directly controls the target camera to switch and display, simplifying the decision-making process, reducing cross-component and cross-process interactions, improving camera switching efficiency, and thus enhancing the user experience.
[0257] like Figure 18 As shown in the illustration, this application discloses an electronic device, which can be the aforementioned mobile phone. Specifically, the electronic device may include: a touchscreen 1801, which includes a touch sensor 1806 and a display screen 1807; one or more processors 1802; a memory 1803; one or more application programs (not shown); and one or more computer programs 1804. These devices can be connected via one or more communication buses 1805. The one or more computer programs 1804 are stored in the memory 1803 and configured to be executed by the one or more processors 1802. The one or more computer programs 1804 include instructions that can be used to perform the relevant steps in the above embodiments.
[0258] It is understood that the aforementioned electronic devices, etc., include hardware structures and / or software modules corresponding to the execution of each function in order to achieve the above-mentioned functions. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein, the embodiments of this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the embodiments of this invention.
[0259] This application embodiment can divide the above-mentioned electronic device into functional modules according to the method example described above. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.
[0260] When each functional module is divided according to its corresponding function, the above embodiments illustrate a possible composition of the electronic device, which may include a display unit, a transmission unit, and a processing unit. It should be noted that all relevant content regarding the steps in the above method embodiments can be referenced from the functional descriptions of the corresponding functional modules, and will not be repeated here.
[0261] This application also provides an electronic device, including one or more processors and one or more memories. The one or more memories are coupled to the one or more processors, and the one or more memories are used to store computer program code, including computer instructions. When the one or more processors execute the computer instructions, the electronic device performs the aforementioned method steps to implement the image display method described above.
[0262] Embodiments of this application also provide a computer-readable storage medium storing computer instructions that, when executed on an electronic device, cause the electronic device to perform the aforementioned method steps to implement the image display method described above.
[0263] Embodiments of this application also provide a computer program product, which includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the aforementioned method steps to implement the image display method described above.
[0264] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory. The memory is used to store computer execution instructions. When the apparatus is running, the processor can execute the computer execution instructions stored in the memory to cause the apparatus to perform the image display method executed by the electronic device in the above-described method embodiments.
[0265] In this embodiment, the electronic device, computer-readable storage medium, computer program product or device are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0266] Through the above description of the embodiments, those skilled in the art will clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device, and unit described above can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here.
[0267] In the embodiments of this application, the functional units can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0268] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, essentially, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as flash memory, portable hard disk, read-only memory, random access memory, magnetic disk, or optical disk.
[0269] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any changes or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
Claims
1. An image display method, said method being applied to an electronic device having a foldable screen, said electronic device comprising an inner screen and an outer screen, and an inner screen front-facing camera and an outer screen front-facing camera, wherein, The inner screen includes a first screen and a second screen, and the method includes: Receive user video call requests; In response to the user's video call operation, when the electronic device is in the unfolded state, the inner screen is controlled to display the image of the user captured by the inner screen camera; During the process of the electronic device switching from an unfolded state to a folded state, in response to the angle between the first screen and the second screen being less than a third preset angle, the front-facing camera on the outer screen is controlled to perform a camera initialization operation. During the process of the electronic device switching from an unfolded state to a folded state, in response to the angle between the first screen and the second screen being less than a first preset angle, the image of the user captured by the front-facing camera on the outer screen is controlled to be displayed on the outer screen, wherein the third preset angle is greater than the first preset angle.
2. The method according to claim 1, characterized in that, The control of the external screen front camera to perform camera initialization operations includes: Control the external screen front camera to perform power-on and / or parameter configuration operations.
3. The method according to claim 1, characterized in that, The electronic device further includes an application framework layer and a first layer, the first layer being located between the application framework layer and the hardware unit of the electronic device. The step of controlling the external screen front-facing camera to perform camera initialization operations includes: The first layer triggers the external screen front camera to perform camera initialization operations; The control of displaying the user's image captured by the front-facing camera on the external screen on the external screen includes: The first layer triggers the display of the user's image captured by the front-facing camera on the outer screen.
4. The method according to claim 3, characterized in that, Before the image of the user captured by the front-facing camera on the outer screen is displayed on the outer screen, the method further includes: The first layer obtains the screen status identifier of the electronic device; The first layer determines, based on the screen status identifier, that the user's image will be displayed on the outer screen.
5. The method according to claim 3, characterized in that, Before the image of the user captured by the front-facing camera on the outer screen is displayed on the outer screen, the method further includes: The application framework layer obtains the angle between the first screen and the second screen; When the angle between the first screen and the second screen is less than a fifth preset angle, the application framework layer triggers the outer screen to perform a screen initialization operation. When the angle between the first screen and the second screen is less than a sixth preset angle, the application framework layer triggers the electronic device to switch the inner screen to the outer screen and determines the screen status identifier of the electronic device as a first identifier, the first identifier being used to indicate that the image is displayed on the outer screen, wherein the sixth preset angle is less than the fifth preset angle.
6. The method according to claim 3, characterized in that, The method further includes: The first layer determines the angle between the first screen and the second screen.
7. The method according to claim 6, characterized in that, The first layer is a hardware abstraction layer. The electronic device also includes a kernel layer, which is located between the hardware abstraction layer and the hardware units of the electronic device. The first layer determines the angle between the first screen and the second screen, including: The hardware abstraction layer obtains information collected by the sensors through the kernel layer. The sensors include at least one of an angle sensor, a gyroscope sensor, and an accelerometer sensor. The hardware abstraction layer determines the angle between the first screen and the second screen based on the information collected by the sensor.
8. The method according to claim 6, characterized in that, The first layer is the kernel layer, which determines the angle between the first screen and the second screen, including: The kernel layer acquires information collected by sensors, including at least one of an angle sensor, a gyroscope sensor, and an accelerometer sensor. The kernel layer determines the angle between the first screen and the second screen based on the information collected by the sensor.
9. An image display method, said method being applied to an electronic device having a foldable screen, said electronic device comprising an inner screen and an outer screen, and an inner screen front-facing camera and an outer screen front-facing camera, wherein, The inner screen includes a first screen and a second screen, and the method includes: Receive user video call requests; In response to the user's video call operation, when the electronic device is in a folded state, the external screen is controlled to display the image of the user captured by the external screen camera; During the process of the electronic device switching from a folded state to an unfolded state, if the angle between the first screen and the second screen is greater than a fourth preset angle, the front-facing camera of the inner screen is controlled to perform a camera initialization operation. During the process of the electronic device switching from a folded state to an unfolded state, in response to the angle between the first screen and the second screen being greater than a second preset angle, the image of the user captured by the front-facing camera on the inner screen is controlled to be displayed on the inner screen, wherein the fourth preset angle is less than the second preset angle.
10. The method according to claim 9, characterized in that, The control of the front-facing camera on the inner screen to perform camera initialization operations includes: Control the front-facing camera on the inner screen to perform power-on and / or parameter configuration operations.
11. The method according to claim 9, characterized in that, The electronic device further includes an application framework layer and a first layer, the first layer being located between the application framework layer and the hardware unit of the electronic device. The step of controlling the external screen front-facing camera to perform camera initialization operations includes: The first layer triggers the front-facing camera on the inner screen to perform camera initialization operations; The control of displaying the user's image captured by the front-facing camera on the inner screen on the inner screen includes: The first layer triggers the display of the user's image captured by the front-facing camera on the inner screen.
12. The method according to claim 11, characterized in that, Before the image of the user captured by the front-facing camera on the inner screen is displayed on the inner screen, the method further includes: The first layer obtains the screen status identifier of the electronic device; The first layer determines, based on the screen status identifier, that the user's image will be displayed on the inner screen.
13. The method according to claim 11, characterized in that, Before the image captured by the front-facing camera on the inner screen is displayed on the inner screen, triggered by the first layer, the method further includes: The application framework layer obtains the angle between the first screen and the second screen; When the angle between the first screen and the second screen is greater than a seventh preset angle, the application framework layer triggers the inner screen to perform a screen initialization operation; When the angle between the first screen and the second screen is greater than an eighth preset angle, the application framework layer triggers the electronic device to switch the outer screen to the inner screen and determines the screen status identifier of the electronic device as a second identifier, the second identifier being used to indicate that the image is displayed on the inner screen, wherein the eighth preset angle is greater than the seventh preset angle.
14. The method according to claim 11, characterized in that, The method further includes: The first layer determines the angle between the first screen and the second screen.
15. The method according to claim 14, characterized in that, The first layer is a hardware abstraction layer. The electronic device also includes a kernel layer, which is located between the hardware abstraction layer and the hardware units of the electronic device. The first layer determines the angle between the first screen and the second screen, including: The hardware abstraction layer obtains information collected by the sensors through the kernel layer. The sensors include at least one of an angle sensor, a gyroscope sensor, and an accelerometer sensor. The hardware abstraction layer determines the angle between the first screen and the second screen based on the information collected by the sensor.
16. The method according to claim 14, characterized in that, The first layer is the kernel layer, which determines the angle between the first screen and the second screen, including: The kernel layer acquires information collected by sensors, including at least one of an angle sensor, a gyroscope sensor, and an accelerometer sensor. The kernel layer determines the angle between the first screen and the second screen based on the information collected by the sensor.
17. An electronic device, characterized in that, include: A foldable screen, the foldable screen comprising at least two screens; One or more processors; Memory; The memory stores one or more computer programs, the one or more computer programs including instructions that, when executed by the electronic device, cause the electronic device to perform the image display method as described in any one of claims 1-8 or 9-16.
18. A computer-readable storage medium storing instructions, characterized in that, When the instructions are executed on an electronic device, the electronic device causes the electronic device to perform the image display method as described in any one of claims 1-8 or 9-16.
Citation Information
Patent Citations
Electronic equipment and control method for cameras thereof
CN104699391A
Image capture processing method and device
CN107623793A