Display method, medium and electronic equipment

Abstract

The invention is applied to the technical field of terminals, and provides a display method, a medium and electronic equipment, the display method is applied to folding screen equipment, the folding screen equipment comprises at least two screens, a first screen of the at least two screens comprises a first opening, and a first assembly opposite to the first opening of the first screen is arranged in the folding screen equipment. The method comprises the following steps: acquiring opening and closing states of at least two screens; according to the opening and closing state, a preset image is displayed in a display area of the first screen, the preset image and the area of the first hole form a preset area, and the center of the preset area is aligned with the center of the first assembly in the direction perpendicular to the first screen. Therefore, a larger opening is visually formed in the preset area, the opening can be aligned with the assembly, the hardware structure of the equipment does not need to be adjusted, and the hardware cost is saved.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a display method, a medium and an electronic device. Background Art

[0002] With the development of current flexible screen technology, flexible foldable touch screens have been widely used in electronic devices such as mobile phones. Users can fold or unfold the screens of these foldable screen devices to meet the user's needs for different screen sizes.

[0003] When a folding screen device is folded or unfolded, the relative position of the mainboard and the screen will be offset, resulting in the components on the mainboard and the screen openings being offset, such as the center of the camera and the opening on the screen cannot be aligned. This will reduce the aesthetics of the folding screen device and reduce the user experience. However, if the problem of the misalignment of components and openings when folded or unfolded is solved by adjusting the hinge structure of the folding screen device, it will lead to higher hardware costs. Summary of the invention

[0004] In view of this, the present application provides a display method, a medium, and an electronic device.

[0005] In a first aspect, a display method is provided, which is applied to a folding screen device, wherein the folding screen device includes at least two screens, a first screen of the at least two screens includes a first opening, and the folding screen device has a first component arranged opposite to the first opening of the first screen, the method comprising: obtaining an opening and closing state of the at least two screens; according to the opening and closing state, displaying a preset image in a display area of ​​the first screen, wherein the preset image and the area of ​​the first opening constitute a preset area, and the center of the preset area is aligned with the center of the first component in a direction perpendicular to the first screen.

[0006] In the above scheme, the preset image displayed on the screen can be determined based on the wiring in the opening, screen ink, and components, so that the preset image and the area of ​​the first opening visually form a whole, namely, the preset area. The preset area visually forms an "opening" that is larger than the original opening, and the center of this larger "opening" can be aligned with the center of the component, thereby visually improving the aesthetics. Moreover, there is no need to change the hardware of the folding screen device. By displaying the preset image, the problem of the inability to align the centers of the opening and the component can be visually solved, saving hardware costs.

[0007] In combination with the first aspect, in some implementations, a preset image is displayed in a display area of ​​a first screen, including: determining an offset of the first component according to an opening and closing state; determining a center of the preset area according to the offset and a center of the first opening; determining a range of the preset image according to the center of the preset area and a size of the first opening; and displaying the preset image.

[0008] In the above scheme, the opening and closing state can also be specifically the opening and closing angle. The offset of the first component can be determined according to the correspondence between the opening and closing state and the component offset. The center of the first opening plus the offset is the center of the preset area. Then, according to the center of the preset area and the size of the first opening, the range of the preset area is determined, and the area remaining after subtracting the first opening from the preset area is the range of the preset image. In this way, the center of the preset area constituted by the area of ​​the preset image and the first opening and the center of the first component after the offset can be aligned, which visually improves the aesthetics. In addition, there is no need to change the hardware of the folding screen device, saving hardware costs.

[0009] In combination with the first aspect, in some implementations, the radius of the preset area is greater than or equal to the sum of the radius of the first opening and the offset, and the range of the preset image is the area of ​​the preset area excluding the first opening.

[0010] In the above scheme, the preset area can be a circle with a radius equal to the radius of the first opening plus an offset, or a concentric circle with a larger radius. The preset area can also be a shape in which the center and the offset components are aligned, and its range can include the area of ​​the first opening. In this way, the center of the preset area and the center of the first component after the offset can be aligned, which visually improves the aesthetics. In addition, there is no need to change the hardware of the folding screen device, saving hardware costs.

[0011] In combination with the first aspect, in some implementations, when the folding screen device is in a preset state, the center of the first opening and the center of the first component are aligned in a direction perpendicular to the screen, and the method further includes: determining whether the folding screen device is in a preset state based on the opening and closing state; and displaying a preset image in a preset area based on the folding screen device being in a non-preset state.

[0012] In the above scheme, the folding screen device can also align the components of the mainboard and the openings by default in a preset state, that is, the preset image is not displayed, and the preset image is displayed only when it is detected that the folding screen device is in a non-preset state. For example, the preset state may be a folded state, in which the components of the folding screen device and the corresponding openings are aligned. However, in the unfolded state, the components are offset and cannot be aligned with the openings. At this time, the folding screen device displays the preset image, so that the center of the preset area formed by the preset image and the area of ​​the first opening and the center of the first component after the offset can be aligned, visually improving the aesthetics. In addition, there is no need to change the hardware of the folding screen device, saving hardware costs.

[0013] In combination with the first aspect, in some implementations, the preset state is a folded state, a semi-folded state, or an unfolded state.

[0014] In the above scheme, the folding screen device can be set so that the opening and the component are aligned in a certain state. In other states, the component may be offset, making it impossible to align the component and the opening. Furthermore, the folding screen device can display a preset image accordingly, so that the center of the preset area formed by the preset image and the area of ​​the first opening and the center of the first component after the offset can be aligned, visually improving the aesthetics. In addition, there is no need to modify the hardware of the folding screen device, saving hardware costs.

[0015] In combination with the first aspect, in some implementations, the opening and closing state includes the opening and closing angles of at least two screens, and the method also includes: based on the preset state being a folded state, when the opening and closing angle is a first angle, the range of the preset area is a first size; and, when the opening and closing angle is a second angle, the range of the preset area is a second size, and the second angle is greater than the first angle, and the second size is greater than the first size.

[0016] In the above solution, the folding screen device can also dynamically compensate according to different unfolding angles. That is to say, when the offset distance of the component below the opening gradually increases when the folding screen device is folded or unfolded, the range of the preset image can gradually increase with the increase of the offset distance.

[0017] In combination with the first aspect, in some implementations, the first component is one or more of a front camera, a rear camera, a microphone, a speaker, an infrared sensor, an ambient light sensor, and a lidar.

[0018] In the above solution, the first component can be any component that exists below the screen opening of the folding screen device, and the component will shift as the folding screen device opens and closes. Furthermore, the folding screen device can display a preset image accordingly, so that the center of the preset area formed by the preset image and the area of ​​the first opening and the center of the first component after the shift can be aligned, visually improving the aesthetics. In addition, there is no need to modify the hardware of the folding screen device, saving hardware costs.

[0019] In combination with the first aspect, in some implementations, the preset area includes one or more of a circle, an ellipse, a rounded rectangle, and a rectangle.

[0020] In the above solution, the preset area can be any shape where the center and the offset component are aligned, and its range can include the area of ​​the first opening. In this way, the center of the preset area and the center of the offset first component can be aligned, which visually improves the aesthetics. In addition, there is no need to modify the hardware of the folding screen device, saving hardware costs.

[0021] In a second aspect, the present application provides an electronic device, including a processor and a memory, wherein the memory is used to store instructions and the processor is used to execute instructions. When the processor executes the instructions, the method described in the first aspect is performed.

[0022] In a third aspect, the present application provides a computer-readable storage medium, in which instructions are stored. When the instructions are executed on an electronic device, the method described in the first aspect is executed.

[0023] In a fourth aspect, the present application provides a computer program product, which includes computer instructions. When the computer program product is executed by a computing device, the computing device performs the method described in the first aspect.

[0024] In summary, through the display method, medium, and electronic device provided by the present application, the preset area visually forms a "hole" that is larger than the original hole, and the center of this larger "hole" can be aligned with the center of the component, thereby visually improving the aesthetics. In addition, there is no need to modify the hardware of the folding screen device. By displaying a preset image, the problem of the center of the hole and the component not being aligned can be visually solved, saving hardware costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for describing the embodiments are briefly introduced below.

[0026] Figure 1 It is a structural schematic diagram of a two-fold mobile phone provided in an embodiment of the present application;

[0027] Figure 2 It is a schematic diagram of a two-fold mobile phone provided by an embodiment of the present application in different opening and closing states;

[0028] Figure 3 It is a schematic diagram of the relative positions of the camera and the opening of a two-fold mobile phone in different opening and closing states provided by an embodiment of the present application;

[0029] Figure 4 It is a schematic diagram of a compensation display for an opening provided in an embodiment of the present application;

[0030] Figure 5 is a schematic diagram of the shape of the compensation area provided in an embodiment of the present application;

[0031] Fig. 6A It is a structural schematic diagram of a tri-fold mobile phone provided in an embodiment of the present application;

[0032] Figure 6B It is a cross-sectional schematic diagram of a tri-fold mobile phone in a folded state and a flattened state provided in an embodiment of the present application;

[0033] Figure 7 It is a flow chart of a display method provided in an embodiment of the present application;

[0034] Figure 8 is another schematic diagram of compensating for openings provided in an embodiment of the present application;

[0035] Fig. 9 It is a schematic diagram of an opening including wiring and ink provided in an embodiment of the present application;

[0036] Fig.10 is a schematic diagram of a dynamic compensation display for an opening provided in an embodiment of the present application;

[0037] Fig.11 is a structural schematic diagram of a display device provided in an embodiment of the present application;

[0038] Fig.12 It is a structural schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0039] Illustrative embodiments of the present application include, but are not limited to, display methods, media, and electronic devices.

[0040] A foldable screen device, such as a foldable screen mobile phone, may have multiple frames. Figure 1 As shown, the mobile phone 10 has a frame A and a frame B, and the frame A and the frame B can rotate around the rotation axis 11 inside the mobile phone 10. The frame A and the frame B can divide the display screen 13 into an inner screen 1301 and an inner screen 1302. In addition, the frame B also includes a front camera 12.

[0041] The user can fold or unfold the screen of the mobile phone 10, so that the mobile phone 10 can be in a variety of opening and closing states such as a folded state, a semi-folded state, and an unfolded state. Figure 2 As shown in (a) of FIG. 1 , when the mobile phone 10 is in the folded state, the opening angle α of the frame A and the frame B is 0°, and the user can use the display screen 15 and the camera 14 of the mobile phone 10. When the user unfolds the mobile phone 10, the mobile phone 10 switches from the folded state to the semi-folded state, and the opening angle α is greater than 90° but less than 180°. Figure 2 As shown in (b) of FIG. 1 , when the mobile phone 10 is in a semi-folded state, the display screen 15 is flipped to the back, and the display screen 13 is lit. Further, when the user continues to perform the unfolding operation, such as Figure 2 As shown in (c) in FIG. 1 , the mobile phone 10 switches from the semi-folded state to the unfolded state, and at this time, the opening and closing angle α of the frame A and the frame B is 180°.

[0042] However, when the mobile phone 10 is folded or unfolded, the relative positions of the motherboard and the screen inside the mobile phone 10 may change, which may cause the camera and other components to be misaligned with the opening on the screen. Figure 3 As shown in (a), the camera 12 is located on the main board 17, and the inner screen 1302 has an opening 16, which is not used to display screen content. When the mobile phone 10 is in a folded state, the camera 12 and the opening 16 are aligned in a direction perpendicular to the display screen 13. When the mobile phone 10 is gradually unfolded, during the unfolding process, the screen will stretch to a certain extent from the folded state to the open state, which causes the main board 17 and the screen to move relative to each other, and the main board will be offset relative to the screen toward the direction of the rotating shaft 11, as shown in FIG. Figure 3 As shown in (b) of FIG. 1 , the mainboard 17 moves relative to the screen toward the direction of the rotating shaft 11, so that the camera 12 and the opening 16 cannot be aligned. Further, when the mobile phone 10 continues to unfold, as shown in FIG. Figure 3 As shown in (c) in FIG. 1 , as the screen is stretched to its maximum extent, the offset between the camera 12 and the opening 16 will be greater.

[0043] like Figure 2 The two-fold folding screen mobile phone with two frames shown in (a) to (c). When the multiple frames of the folding screen device rotate around the axis, the mainboard and the screen will have a certain offset, making it impossible to align the components on the mainboard and the openings on the screen.

[0044] Furthermore, the present application provides a display method, which is applied to a folding screen device 100. When the folding screen device 100 detects an unfolding or folding operation, it will determine the offset of the component below the opening according to the opening and closing state of the screen, such as whether it is open or closed, or the angle of unfolding. Then, the position and size of the preset image to be displayed in the screen opening are determined, and the area displaying the preset image and the opening area together constitute a preset area, and the center of the preset area is aligned with the center of the component below the opening. Among them, the component below the opening can be a front camera, a rear camera, a microphone, a speaker, an infrared sensor, an ambient light sensor, a lidar, etc.

[0045] In this way, the preset area visually forms a "hole" that is larger than the original hole, and the center of this larger "hole" can be aligned with the center of the component, thereby visually improving the aesthetics. In addition, there is no need to modify the hardware of the folding screen device 100. By displaying the preset image, the problem of the hole and the center of the component not being aligned can be visually solved, saving hardware costs.

[0046] Optionally, the method specifically includes that the folding screen device 100 first obtains the opening and closing state of the screen when it is unfolded or folded, and the size and center of the opening in the screen. Then, according to the opening and closing state of the screen, the offset of the component is determined, and the correspondence between the offset of the component and the opening and closing state can be obtained by actual measurement during production design. According to the offset and the position of the center of the opening, the position of the component after the offset is determined, and the determined position of the component after the offset is used as the center of the preset area. Then, according to the size and offset of the opening, the size of the preset area is determined. For example, the sum of the radius of the opening and the offset is used as the radius of the preset area. Finally, according to the center of the preset area and the size of the preset area, the range of the preset area excluding the opening area can be determined as the display range of the preset image. Finally, the preset image is displayed within the range, and the content of the preset image can also be determined based on the pattern and color of the motherboard.

[0047] Furthermore, the method can also dynamically compensate according to the different unfolding angles of the folding screen device 100. That is, when the offset distance of the component below the opening gradually increases when the folding screen device 100 is folded or unfolded, the display range of the preset image can gradually increase with the increase of the offset distance.

[0048] Optionally, in a preset state, the components and openings of the mainboard of the folding screen device 100 are aligned by default, that is, the preset image is not displayed, and the preset image is only displayed when it is detected that the folding screen device 100 is in a non-preset state.

[0049] For example, the preset state may be a folded state, such as Figure 4 As shown in (a) of FIG. 1 , taking the camera 12 of the mobile phone 10 as an example, when the mobile phone 10 is in the folded state, the center O1 of the camera 12 is aligned with the center O2 of the opening 16. When the mobile phone 10 is in the unfolded state, the center of the camera 12 shifts from the center O1 to O1′, and the center O1′ is not aligned with the center O2 of the opening 16. Figure 4 As shown in (b) of FIG. 1 , the mobile phone 10 determines the position of O1 ′ according to the preset offset distance, further determines the range of the compensation area S1 according to the position of O1 ′, and displays a preset image in the compensation area S1 on the display area 1302 .

[0050] It should be understood that for ease of explanation, Figure 4 (b) in the figure is displayed with different colors for the compensation area S1 and the motherboard corresponding to the opening 16. In actual application, the display content of the compensation area S1 is consistent with the color of the motherboard and / or components exposed by the opening 16, so that the compensation area S1 and the motherboard exposed by the opening 16 can achieve a unified viewing angle effect.

[0051] Optionally, the preset area is any shape whose center is consistent with the center of the component below the opening and whose size is larger than the size of the opening. For example, any plane figure such as a circle, an ellipse, a rounded rectangle, a rectangle, etc. The shape and size of the preset area can be preset by the folding screen device 100 or can be selected by the user.

[0052] As mentioned above Figure 4 As shown in (b) of FIG. 1 , the preset area is a circle with a center of O1′ and a radius of the radius of the opening 16 plus the offset distance of O1, and the compensation area S1 is the range of the preset area excluding the opening 16. Optionally, the preset area can also be other shapes with the center of O1′. Figure 5 As shown in (a) of FIG. 1 , the preset area is a circle with a center O1′ and a radius greater than the radius of the opening 16 plus the offset distance, and the compensation area S2 is the range of the preset area excluding the opening 16. Alternatively, Figure 5 As shown in (b), the preset area is a rounded rectangle with a center of O1′ and a length and width greater than or equal to the diameter of the opening 16, and the compensation area S3 is the range of the preset area excluding the opening 16. It should be understood that the present application does not specifically limit the specific shapes and sizes of the preset area and the compensation area.

[0053] The foldable screen device 100 may specifically be an electronic device with a foldable display screen. The foldable display screen in the foldable screen device 100 may be an integrally formed flexible display screen, or a spliced ​​display screen composed of a plurality of flexible display screens and a hinge between each two flexible display screens, or a spliced ​​display screen composed of a plurality of rigid screens and a flexible screen between each two rigid screens, or a spliced ​​display screen composed of a plurality of rigid screens and a hinge between each two rigid screens, etc., and the embodiments of the present application do not limit this.

[0054] Furthermore, the folding screen device 100 can be an inner folding device or an outer folding device. The inner folding device has a larger inner screen, and a smaller outer screen on the back of the inner screen. When the inner screen is folded, it is inside and does not display content, and the outer screen displays content, that is, Figure 2 In contrast, the external folding device has a larger external screen, and in the folded state, only a portion of the display area of ​​the external screen is used for display, while in the unfolded state, the entire external screen is used for display.

[0055] In the above embodiment, the folding screen device 100 is folded left and right. In other embodiments, the folding screen device 100 can also be folded up and down, which is not limited in the embodiment of the present application.

[0056] Furthermore, the folding screen device 100 may be as follows Figure 2The two-fold device shown in (a) to (c) may also be a three-fold device, or a folding screen device with more frames, which is not limited in the embodiments of the present application.

[0057] For example, Fig. 6A A schematic diagram of a three-folded mobile phone 20 is shown, and the mobile phone 20 has a frame C, a frame D, and a frame E. The user can fold the frame C forward through the rotating shaft 23, and fold the frame E backward through the rotating shaft 24, thereby switching the mobile phone 20 from the unfolded state to the folded state. The frame E also has a camera 21. Figure 6B (a) shows a cross-sectional view of the mobile phone 20 in a folded state. In the folded state, the camera 21 and the opening 22 on the screen of the frame E are aligned in a direction perpendicular to the screen. Figure 6B (b) shows a cross-sectional view of the mobile phone 20 in a flattened state. In the flattened state, the camera 21 is misaligned, so that the camera 21 and the opening 22 on the screen of the frame E are not aligned in a direction perpendicular to the screen.

[0058] The foldable screen device 100 can specifically be any electronic device with a foldable display screen, such as the aforementioned mobile phone 10, tablet computer, wearable device, vehicle-mounted device, augmented reality (AR) / virtual reality (VR) device, laptop computer, ultra-mobile personal computer (UMPC), netbook, personal digital assistant (PDA) or dedicated camera (such as SLR camera, card camera), etc. The present application does not impose any restrictions on the specific type of the foldable screen device 100.

[0059] For ease of understanding, the following Figure 7 The specific process of the display method provided by the present application is introduced. The method can be applied to the above-mentioned folding screen device 100, such as Figure 7 As shown, the method specifically includes:

[0060] S710: Acquire the opening and closing status of an adjacent screen.

[0061] The folding screen device 100 can sense the opening and closing state of the adjacent screen through a sensor or other device, and the opening and closing state can be a folded state, a semi-folded state, and an unfolded state. Alternatively, the opening and closing state can also be the opening and closing angle of the adjacent screen of the folding screen device 100, such as 0°, 90°, 180°, etc.

[0062] The sensor for determining the opening and closing state of the adjacent screen may be an infrared sensor, a Hall sensor, etc. Figure 1Taking the mobile phone 10 shown as an example, the frame A of the mobile phone 10 can be configured with a Hall sensor, and the frame B is configured with a magnet. The mobile phone 10 can determine the opening and closing state of the mobile phone 10 by obtaining the magnitude of the magnetic force detected by the Hall sensor in the frame A. Among them, when the Hall sensor obtains a decrease in the magnitude of the magnetic force, it means that the opening and closing angle between the frame A and the frame B is getting larger and larger, and the display screen 13 of the mobile phone 10 is gradually expanding. When the Hall sensor obtains an increase in the magnitude of the magnetic force, it means that the opening and closing angle between the frame A and the frame B is getting smaller and smaller, and the display screen 13 of the mobile phone 10 is gradually closing.

[0063] In some embodiments, when the folding screen device 100 has three or more frames, the folding screen device 100 can also determine the opening and closing state between every two adjacent screens. Alternatively, the folding screen device 100 only needs to obtain the opening and closing state between the screen with the opening and the adjacent screen.

[0064] S720: Determine the offset of the corresponding component according to the opening and closing state.

[0065] The folding screen device 100 determines the offset of the component according to the correspondence between the opening and closing state of the screen and the offset, wherein the correspondence between the opening and closing state and the offset can be obtained through a large number of measurements during the production design process.

[0066] For example, when the folding screen device 100 is in the folded state, the camera and the corresponding opening are aligned by default. When the screen of the folding screen device 100 is gradually unfolded and the opening and closing angle gradually increases, the offset of the camera gradually increases. The corresponding relationship can be that the camera offsets 0.125 mm for every 45° increase in the opening and closing angle. That is, when the opening and closing angle is 90°, the camera offsets 0.25 mm. When the opening and closing angle is 90°, that is, when the folding screen device 100 is in the unfolded state, the camera offsets 0.5 mm.

[0067] It should be understood that the correspondence between the opening and closing state and the offset can be a linear relationship or a nonlinear relationship, which can be determined through actual measurement, and the present application does not specifically limit the correspondence between the opening and closing state and the offset.

[0068] In this way, the offset of the component can be directly determined through the correspondence between the preset opening and closing state and the offset. There is no need to add other sensors or other devices to the folding screen device 100 to detect the offset of the component, saving hardware costs.

[0069] Optionally, the folding screen device 100 may be in a preset state, with the component and the opening aligned by default. When the folding screen device 100 determines that the current opening and closing state is not a preset state, the offset of the component is further determined.

[0070] For example, if Figure 2The mobile phone 10 shown in (a) has a camera 14 on the outer screen of the mobile phone 10. Figure 2 As shown in (b), the inner screen has a camera 12. When the phone 10 is in the folded state, the camera 14 and the camera 12 are aligned with the corresponding openings in the folded state, and the offset is zero. When the phone 10 is gradually unfolded, the mainboard shifts, so that the camera 14 and the camera 12 cannot be aligned with the corresponding openings. At this time, the distance of the center offset of the camera 14 and the camera 12 is the offset. For details, please refer to Figure 4 , Figure 5 The related descriptions will not be repeated here.

[0071] On the contrary, when the default state of the mobile phone 10 is the unfolded state, if the mobile phone 10 is in the folded state at this time, the center of the camera 14 on the outer screen and the opening 18 cannot be aligned, and there is an offset between the camera 14 and the opening 18. Figure 8 As shown in (a), the center of the camera 14 is O3, the center of the opening 18 is O4, and the distance between the two is the size of the offset. When the mobile phone 10 is gradually unfolded, the motherboard moves relative to the screen, so that the centers of the cameras 12 and 14 move toward the centers of their corresponding openings. Figure 8 As shown in (b), the centers of the cameras 12 and 14 can be aligned with the centers of the corresponding openings, the center of the camera 14 is O3′ and the center of the opening 18 is O4, and the offset is zero.

[0072] It should be understood that the above Figure 4 An example is given in which the camera 12 is offset to the left relative to the opening 16 when the mobile phone 10 is in the unfolded state. Figure 8 The example is taken as follows: when the mobile phone 10 is in the folded state, the camera 14 is offset to the right relative to the opening 18. In some embodiments, the folding screen device 100 can also be offset in other directions. For example, when the folding screen device 100 is a device that folds up and down, the component may also be offset upward or downward relative to the opening, so the preset image below may also be located above or below the opening. This application does not specifically limit the offset direction of the component and the position of the preset image.

[0073] Therefore, for different folding screen devices 100, although the direction of the component offset relative to the screen is different, they can all be compensated for on the screen around the opening. In this way, the center of the area after the compensation display and the center of the component can be aligned, thereby visually improving the aesthetics. In addition, there is no need to modify the hardware of the folding screen device 100, saving hardware costs.

[0074] S730: Determine the position and size of the preset area according to the offset, the hole center, and the hole size.

[0075] The folding screen device 100 determines the offset position of the component based on the offset and the position of the center of the opening, for example, the position of the center of the opening plus the offset is the offset position of the component, and uses the determined offset position of the component as the center of the preset area. The folding screen device 100 will also determine the size of the preset area based on the size of the opening and the offset, for example, using the sum of the radius of the opening and the offset as the radius of the preset area.

[0076] The preset area can be any shape whose center is aligned with the center of the component and whose size is larger than the opening size. Figure 4 and Figure 5 and its related description.

[0077] Optionally, when the folding screen device 100 has three or more frames, the folding screen device 100 also needs to determine the offset of the component by the angle between each two adjacent frames. And, when the folding screen device 100 has multiple openings, the folding screen device 100 also needs to determine the offset of the component under each opening.

[0078] S730: Displaying a preset image in a preset area.

[0079] The folding screen device 100 can determine the range of the preset area excluding the opening area as the display range of the preset image based on the center of the preset area and the size of the preset area. The content of the preset image can be determined based on the pattern and color of the motherboard. The preset image is displayed on the screen of the folding screen device 100, and the pattern and / or color of the preset image and the motherboard and / or components exposed by the opening are consistent, so that the two can achieve a unified viewing angle effect.

[0080] For example, Fig. 9 As shown, in addition to being able to see components such as the camera on the motherboard, the opening may also allow you to see the wiring on the motherboard or the ink on the display, etc. The preset image can simulate the motherboard and its wiring and ink.

[0081] Furthermore, the method can also dynamically compensate according to the different unfolding angles of the folding screen device 100. When the offset distance of the component below the opening gradually increases when the folding screen device 100 is folded or unfolded, the range of the compensation area can be gradually increased with the increase of the offset. For example, when the preset state is the folded state, as the opening and closing angle increases, the offset of the component becomes larger and larger, and the compensation area will also increase accordingly. When the preset state is the unfolded state, as the opening and closing angle becomes smaller, the offset of the component becomes larger and larger, and the compensation area also increases accordingly. Furthermore, at any opening and closing angle, the center of the preset area and the component are aligned.

[0082] For example, if Fig.10 As shown in (a) to (d) in FIG. 1 , when the offset of the camera 12 relative to the opening 16 gradually increases, the corresponding compensation area also gradually increases. Fig.10 As shown in (a) of FIG. 1 , the camera 12 and the opening 16 are aligned. Fig.10 As shown in (b), O1 moves to O 1-A ', the compensation area S1-A on the screen is displayed for compensation. Fig.10 As shown in (c), O1 moves to O 1-B ', the compensation area S1-B on the screen will be displayed for compensation. Fig.10 As shown in (d), O1 moves to O 1-C ', the compensation area S1-C on the screen is displayed for compensation. The area of ​​the compensation area S1-C is larger than the compensation area S1-B, and the area of ​​the compensation area S1-B is larger than the compensation area S1-A.

[0083] In this way, the compensation area and the opening area together constitute a preset area, which visually forms an "opening" that is larger than the original opening. The center of this larger "opening" can be aligned with the center of the lower component, thereby visually improving the aesthetics. In addition, there is no need to modify the hardware of the folding screen device 100. By displaying a preset image, the problem of the center of the opening and the component not being aligned can be visually solved, saving hardware costs.

[0084] The following first introduces the display device 1100 involved in the embodiment of the present application, which is applied to a folding screen device, the folding screen device includes at least two screens, the first screen of the at least two screens includes a first opening, and the folding screen device has a first component arranged opposite to the first opening of the first screen. Fig.11 As shown, the display device 1100 includes an acquisition unit 1110 , a display unit 1120 , and a determination unit 1130 .

[0085] The acquisition unit 1110 is used to acquire the opening and closing states of at least two screens. The display unit 1120 is used to display a preset image in the display area of ​​the first screen according to the opening and closing states, wherein the preset image and the area of ​​the first opening constitute a preset area, and the center of the preset area is aligned with the center of the first component in a direction perpendicular to the first screen.

[0086] The determination unit 1130 is used to determine the offset of the first component according to the opening and closing state. The determination unit 1130 is also used to determine the center of the preset area according to the offset and the center of the first opening. The determination unit 1130 is also used to determine the range of the preset image according to the center of the preset area and the size of the first opening.

[0087] In other embodiments, the radius of the preset area is greater than or equal to the sum of the radius of the first opening and the offset, and the range of the preset image is the area of ​​the preset area excluding the first opening.

[0088] In some other embodiments, the determination unit 1130 is further configured to determine whether the folding screen device is in a preset state according to the opening and closing state. The display unit 1120 is further configured to display a preset image in a preset area based on the folding screen device being in a non-preset state.

[0089] In other embodiments, the preset state is a folded state, a semi-folded state, or an unfolded state.

[0090] In other embodiments, based on the preset state being the folded state, when the opening and closing angle is the first angle, the range of the preset area is the first size. Furthermore, when the opening and closing angle is the second angle, the range of the preset area is the second size, and the second angle is greater than the first angle, and the second size is greater than the first size.

[0091] In other embodiments, the first component is one or more of a front camera, a rear camera, a microphone, a speaker, an infrared sensor, an ambient light sensor, and a lidar.

[0092] In other embodiments, the preset area includes one or more of a circle, an ellipse, a rounded rectangle, and a rectangle.

[0093] In this way, through the display device 1100 provided by the present application, the displayed preset image and the opening area together constitute a preset area, which visually forms an "opening" that is larger than the original opening. The center of this larger "opening" can be aligned with the center of the lower component, thereby visually improving the aesthetics. Moreover, there is no need to modify the hardware of the folding screen device 100. By displaying a preset image, the problem of the center of the opening and the component not being aligned can be visually solved, saving hardware costs.

[0094] The following first introduces the folding screen device 100 involved in an embodiment of the present application.

[0095] See also Fig.12 , Fig.12 A schematic structural diagram of an exemplary folding screen device 100 provided in an embodiment of the present application is shown.

[0096] The folding screen device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a magnetic sensor 180C, an acceleration sensor 180D, a touch sensor 180E, etc.

[0097] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the folding screen device 100. In other embodiments of the present application, the folding screen device 100 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0098] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0099] Among them, the controller can be the nerve center and command center of the folding screen device 100. The controller can generate an operation control signal according to the instruction operation code and the timing signal to complete the control of fetching and executing instructions.

[0100] The charging management module 140 is used to receive charging input from a charger, where the charger can be a wireless charger or a wired charger.

[0101] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, and the wireless communication module 160. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc.

[0102] The wireless communication function of the folding screen device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor.

[0103] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in the folding screen device 100 can be used to cover a single or multiple communication frequency bands.

[0104] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the folding screen device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc.

[0105] The modulation and demodulation processor may include a modulator and a demodulator, wherein the modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium-high frequency signal, and the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.

[0106] The wireless communication module 160 can provide wireless communication solutions for application on the folding screen device 100, including WLAN (such as wireless fidelity (WiFi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication technology (NFC), infrared technology (IR), etc.

[0107] The folding screen device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connecting the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0108] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MINILED, a MICROLED, a MICRO-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the folding screen device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0109] In some embodiments of the present application, the display screen 194 displays the interface content currently output by the system, such as a screen-off interface, a lock screen interface, or an unlock interface.

[0110] The folding screen device 100 can realize the shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor. The ISP is used to process the data fed back by the camera 193. The camera 193 is used to capture a static image or a video. In some embodiments, the folding screen device 100 may include 1 or M cameras 193, where M is a positive integer greater than 1.

[0111] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the folding screen device 100 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0112] The video codec is used to compress or decompress digital video. The folding screen device 100 can support one or more video codecs.

[0113] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the folding screen device 100.

[0114] The internal memory 121 can be used to store computer executable program codes, which include instructions. The processor 110 executes various functional applications and data processing of the folding screen device 100 by running the instructions stored in the internal memory 121. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area can store data created during the use of the folding screen device 100 (such as audio data, a phone book, etc.), etc.

[0115] The folding screen device 100 can implement audio functions through the audio module 170 and the application processor, such as music playback and recording.

[0116] The audio module 170 is used to convert digital audio information into analog audio signal output, and also used to convert analog audio input into digital audio signal. The audio module 170 can also be used to encode and decode audio signals.

[0117] The pressure sensor 180A is used to sense pressure signals and convert the pressure signals into electrical signals.

[0118] The gyroscope sensor 180B can be used to determine the motion posture of the folding screen device 100. In some embodiments of the present application, the gyroscope sensor 180B can be used to determine the angular velocity of the folding screen device 100 around three axes (the X-axis, Y-axis, and Z-axis of the electronic device), thereby identifying the user's rotation or shaking operation of the folding screen device 100.

[0119] The magnetic sensor 180C includes a Hall sensor. In the embodiment of the present application, the Hall sensor can be used to obtain the opening and closing state of the folding screen.

[0120] The acceleration sensor 180D can detect the magnitude of the acceleration of the folding screen device 100 in various directions (generally three axes). When the folding screen device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device, and is applied to applications such as horizontal and vertical screen switching, pedometers, etc.

[0121] The touch sensor 180E is also called a "touch panel". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch operation refers to the operation of the user's hand, elbow, stylus, etc. contacting the display screen 194. Furthermore, through the touch sensor 180E, the folding screen device 100 can obtain the user's click operation, sliding operation and other touch operations.

[0122] Buttons 190 include a power button, a volume button, and the like.

[0123] Motor 191 can generate vibration prompts.

[0124] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0125] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to or disconnected from the folding screen device 100 by inserting the SIM card interface 195 or pulling the SIM card out of the SIM card interface 195.

[0126] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media integration. The available medium can be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state hard disk), etc.

[0127] A person skilled in the art can understand that to implement all or part of the processes in the above-mentioned embodiments, the processes can be completed by a computer program to instruct the relevant hardware, and the program can be stored in a computer-readable storage medium. When the program is executed, it can include the processes of the above-mentioned method embodiments. The aforementioned storage medium includes: a read-only memory (ROM) or a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes.

Claims

1. A display method, characterized in that: Applied to a folding screen device, the folding screen device includes at least two screens, a first screen of the at least two screens includes a first opening, and the folding screen device has a first component arranged opposite to the first opening of the first screen, the method includes: Acquire the opening and closing status of the at least two screens; According to the opening and closing state, a preset image is displayed in the display area of ​​the first screen, wherein the preset image and the area of ​​the first opening constitute a preset area, and the center of the preset area is aligned with the center of the first component in a direction perpendicular to the first screen.

2. The method according to claim 1, characterized in that The displaying of a preset image in the display area of ​​the first screen includes: Determining an offset of the first component according to the opening and closing state; Determining the center of the preset area according to the offset and the center of the first opening; Determining a range of the preset image according to a center of the preset area and a size of the first opening; The preset image is displayed.

3. The method according to claim 2, characterized in that The radius of the preset area is greater than or equal to the sum of the radius of the first opening and the offset, and the range of the preset image is the area of ​​the preset area excluding the first opening.

4. The method according to claim 1, characterized in that In a preset state of the folding screen device, the center of the first opening and the center of the first component are aligned in a direction perpendicular to the screen, and the method further includes: According to the opening and closing state, determining whether the folding screen device is in a preset state; Based on the fact that the folding screen device is in a non-preset state, a preset image is displayed in a preset area.

5. The method according to claim 4, characterized in that The preset state is a folded state, a semi-folded state or an unfolded state.

6. The method according to claim 1, characterized in that The opening and closing state includes an opening and closing angle of the at least two screens, and the method further includes: Based on the fact that the preset state is the folded state and the opening and closing angle is the first angle, the range of the preset area is the first size; and When the opening and closing angle is a second angle, the range of the preset area is a second size, and the second angle is greater than the first angle, and the second size is greater than the first size.

7. The method according to claim 1, characterized in that The first component is one or more of a front camera, a rear camera, a microphone, a speaker, an infrared sensor, an ambient light sensor, and a lidar.

8. The method according to claim 1, characterized in that: The preset area includes one or more of a circle, an ellipse, a rounded rectangle, and a rectangle.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory is used to store instructions, and the processor is used to execute the instructions. When the processor executes the instructions, the method according to any one of claims 1 to 8 is executed.

10. A computer-readable storage medium, characterized in that: The method comprises instructions, which, when executed on an electronic device, cause the electronic device to execute the method as claimed in any one of claims 1 to 8.

Images