Screenshot method based on folding screen, terminal device and computer-readable storage medium

By obtaining the real-time position of the main screen in the folded state of the outer folded folding screen, the starting position of the screen frame is solved, and the base image error occurs when the main screen and the back screen are illuminated at the same time, improving the accuracy of the screenshot.

CN117389449BActive Publication Date: 2025-02-18HONOR DEVICE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202311216188.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-09-19
Publication Date
2025-02-18
Estimated Expiration
2043-09-19

Smart Images

  • Figure CN117389449B_ABST
    Figure CN117389449B_ABST
Patent Text Reader

Abstract

The embodiment of the present application provides a screenshot method based on a folding screen, a terminal device and a computer-readable storage medium, and relates to the field of terminal technology. The screenshot method provided is applied to a terminal device, including a folding screen that folds outward. The folding screen of the terminal device is in a folded state, the main screen displays a first interface, and receives a first operation, which is a finger joint screenshot operation. In response to the first operation, the terminal device obtains first parameters such as the width and height of the main screen and the real-time position of the main screen. The terminal device can capture a first image according to the real-time position of the main screen, with the width and height of the main screen as the screenshot frame, and then generate a second image based on the first image as a screenshot indicated by the first operation. The screenshot method provided in the embodiment of the present application obtains the base map according to the real-time position of the main screen, rather than directly obtaining the base map with the upper left corner of the currently lit screen as the starting position, which can effectively avoid errors in the base map and improve the accuracy of the screenshot.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a screenshot method based on a folding screen, a terminal device, and a computer-readable storage medium. Background Art

[0002] With the development of flexible screens, terminal devices with folding screens are increasingly widely used by users, and the display functions of such terminal devices are becoming more and more powerful. For example, the folding screen may include a folding screen that folds inward (referred to as the inward folding screen) and a folding screen that folds outward (referred to as the outward folding screen). Take the folding screen that can be folded to form a first screen and a second screen as an example. After the inward folding screen is folded, the display directions of the first screen and the second screen are opposite, and both are invisible to the user. The inward folding screen also includes a third screen, which is arranged on the back of the first screen or the second screen. After the inward folding screen is folded, the third screen is visible to the user. After the outward folding screen is folded, the display directions of the first screen and the second screen are opposite, and both are visible to the user.

[0003] Regardless of whether the folding screen (including the inner folding folding screen and the outer folding folding screen) is in the unfolded state or the folded state, the terminal device can respond to the user's screenshot operation and capture the screen image. In response to the above screenshot operation, the terminal device can combine the current posture of the terminal device (such as the horizontal screen state or the vertical screen state), start from the upper left corner of the currently lit screen, and generate an image as a base image according to the width and height of the screen affected by the screenshot operation, and then generate a screenshot based on the base image.

[0004] For example, when the folding screen is in the unfolded state, the first screen and the second screen are displayed as a complete screen (called the full screen), and the full screen can be lit to display the image. Among them, when the folding screen is in the unfolded state, the screenshot operation input by the user acts on the full screen. Therefore, when the folding screen is in the unfolded state, in response to the screenshot operation, the terminal device can combine the current posture of the terminal device, start from the upper left corner of the full screen, and generate an image as a base map according to the width and height of the full screen, and then generate a screenshot based on the base map.

[0005] For another example, when the folding screen is in the folded state, the main screen can be lit up to display an image. When the folding screen is in the folded state, the screenshot operation input by the user acts on the main screen. Among them, the main screen of the inner folding folding screen is the third screen, and the inner folding folding screen is in the folded state, the third screen is lit up, and the first screen and the second screen are off. Of the first screen and the second screen of the outer folding folding screen, one serves as the main screen and the other serves as the back screen. When the outer folding folding screen is in the folded state, the main screen is lit up, and the back screen is off. Therefore, when the folding screen is in the folded state, in response to the screenshot operation, the terminal device can combine the current posture of the terminal device, start from the upper left corner of the currently lit screen, that is, the upper left corner of the main screen, and generate an image as a base map according to the width and height of the main screen, and then generate a screenshot based on the base map.

[0006] However, when the outward folding screen is in the folded state, if the main screen and the back screen are on at the same time. The terminal device generates an image as the base map based on the current posture, starting from the upper left corner of the currently lit screen, that is, the upper left corner of the back screen. Then, the generated base map includes at least part of the interface of the back screen, not the interface of the main screen. In other words, when the outward folding screen is in the folded state, if the main screen and the back screen are on at the same time, the base map may be wrong, which may lead to screenshot errors. Summary of the invention

[0007] The embodiments of the present application provide a folding screen-based screenshot method, a terminal device, and a computer-readable storage medium, which are used to solve the technical problem that the terminal device obtains an erroneous screenshot when responding to a touch screenshot operation, and improve the screenshot accuracy of the terminal device.

[0008] To achieve the above objectives, the embodiments of the present application adopt the following technical solutions:

[0009] In a first aspect, a screenshot method based on a folding screen is provided, which is applied to a terminal device. The terminal device includes a folding screen, which can be folded to form a first screen and a second screen; after the folding screen is folded, the first screen and the second screen are opposite to each other and the display directions are opposite. The folding screen of the terminal device displays a first interface, and the folding screen receives a first operation. The first operation includes a knuckle tapping operation without leaving the screen and a closed curve sliding operation. The first operation is used to indicate the capture of the corresponding image in the first interface displayed by the folding screen. When the folding screen is in a folded state, the folding screen that responds to the first operation is the main screen, and the first interface of the screenshot indicated by the first operation is the display interface of the main screen, at which time the main screen may be on or off. In response to the first operation, the terminal device obtains first parameters such as the width and height of the main screen and the real-time position of the main screen. The real-time position is used to determine the starting position of the screenshot frame. The terminal device can capture the first image according to the real-time position of the main screen and the width and height of the main screen as the screenshot frame, and then generate a second image according to the first image as the screenshot indicated by the first operation.

[0010] The screenshot method provided in the embodiment of the present application, in addition to obtaining the width and height of the main screen, also obtains the real-time position of the main screen when responding to a touch operation in the folded state. The base image is obtained according to the real-time position of the main screen, rather than directly using the upper left corner of the currently lit screen as the starting position to obtain the base image, which can effectively avoid errors in the base image and improve the accuracy of the screenshot.

[0011] According to a possible implementation of the first aspect, different device states are distinguished to execute different screenshot methods. The device state of the terminal device includes an unfolded state and a folded state.

[0012] If the folding screen is in the expanded state, obtain the width and height of the full screen of the folding screen; starting from the upper left corner of the currently lit screen, capture the third image with the width and height of the full screen as the screenshot frame; wherein, in the expanded state, the full screen is lit; display the fourth image; wherein the fourth image is a screenshot corresponding to the first operation in the third image.

[0013] According to a possible implementation of the first aspect, different screenshot methods are executed by distinguishing between device states and screen-on states. The solution provided in this scenario further distinguishes and defines different screen-on states in the folded state.

[0014] When the terminal device detects that the device is in the folded state, it further determines whether the main screen and the back screen are on at the same time. If the main screen is on and the back screen is off, the screen that is on at this time is the main screen, and the upper left corner of the screen that is on is the same as the upper left corner of the real-time position indicator of the main screen. In this case, the terminal device can obtain the first image as the base map according to the general screenshot method provided in the above scenario one. The terminal device can also generate a fifth image with the upper left corner of the lit screen as the starting position, and generate a sixth image corresponding to the screenshot based on the fifth image. The base maps obtained by these two methods are the same, and the screenshots obtained based on the base map are also the same.

[0015] According to a possible implementation of the first aspect, different screenshot methods are executed by distinguishing between the screen on / off state and the rotation state. The solution provided in this scenario further defines different rotation states when the screen is on at the same time based on scenario three.

[0016] When the main screen is rotated 0° or 90° relative to the reference posture, the base map obtained by using the upper left corner of the screen that is lit as the starting position may have a technical problem of base map error. In order to solve this problem, when the terminal device determines that the device state is folded and the main screen and other screens are lit at the same time, it can also match different screenshot methods through different rotation states. If the terminal device determines that the main screen is not in a preset rotation state, it can obtain the width and height of the main screen in response to the first operation, starting from the upper left corner of the currently lit screen, and using the width and height of the main screen as the screenshot frame to capture the seventh image, and generate the eighth image based on the seventh image, that is, as the screenshot corresponding to the first operation.

[0017] If the terminal device determines that the main screen is in a preset rotation state, it is necessary to execute a screenshot method for obtaining a base map according to the real-time position of the main screen to ensure an accurate base map and improve the accuracy of the screenshot.

[0018] According to a possible implementation of the first aspect, the terminal device includes an application layer, a framework layer, a hardware abstraction layer and a kernel layer. The framework layer includes an input module, a window management service, a touch manager, a display module, a folding screen management module and a folding screen management module, and the hardware abstraction layer includes an interface module, a window controller and a system interface. The specific process includes: the display module displays the first interface, the input module receives the first operation acting on the folding screen; the display module obtains the width and height of the main screen, the folding screen management module obtains the real-time position of the main screen, and sends it to the touch manager; the touch manager forwards the first parameter to the window controller; the window controller captures the first image according to the real-time position of the main screen and the width and height of the main screen as the screenshot frame, and sends it to the touch manager; the touch manager sends the first parameter and the first image to the system interface; the system interface generates a second image based on the first image and the first operation; the display module displays the second image.

[0019] In a second aspect, a terminal device is provided, including a folding screen, a memory, and a processor; the folding screen can be folded to form a first screen and a second screen; after the folding screen is folded, the first screen and the second screen are opposite to each other and display directions are opposite; the folding screen and the memory are coupled to the processor. The memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory, so that the terminal device executes the folding screen-based screenshot method as described in any one of the first aspects.

[0020] According to a possible implementation manner of the second aspect, the processor is configured to:

[0021] The folding screen displays a first interface, and receives a first operation acting on the folding screen; the first operation is used to instruct to capture a corresponding image in the first interface displayed on the folding screen;

[0022] In response to the first operation, the folding screen is in the folding state, and the first parameter of the main screen is obtained; wherein the first parameter includes the width and height of the main screen and the real-time position of the main screen; the real-time position is used to determine the starting position of the screenshot frame; the main screen is the first screen, and the second screen is the back screen; or the main screen is the second screen, and the first screen is the back screen; in the folding state, the main screen is on, and the back screen is on or off;

[0023] According to the real-time position of the main screen, the first image is captured with the width and height of the main screen as the screenshot frame;

[0024] The second image is displayed; wherein the second image is a screenshot corresponding to the first operation in the first image.

[0025] According to a possible implementation manner of the second aspect, the processor is configured to:

[0026] In response to the first operation, the foldable screen is in an unfolded state, and the width and height of the full screen of the foldable screen are obtained;

[0027] Starting from the upper left corner of the currently lit screen, a third image is captured with the full screen width and height as the screenshot frame; wherein, in the expanded state, the full screen is lit;

[0028] A fourth image is displayed; wherein the fourth image is a screenshot corresponding to the first operation in the third image.

[0029] According to a possible implementation manner of the second aspect, the processor is configured to:

[0030] In response to the first operation, the folding screen is in the folded state, and it is determined whether the main screen and the back screen are lit at the same time;

[0031] If the main screen and the back screen are turned on at the same time, the first parameter of the main screen is obtained.

[0032] According to a possible implementation manner of the second aspect, the processor is configured to:

[0033] If the main screen is on and the back screen is off, get the width and height of the main screen;

[0034] Starting from the upper left corner of the currently lit screen, the fifth image is captured with the width and height of the main screen as the screenshot frame;

[0035] The sixth image is displayed; wherein the sixth image is a screenshot corresponding to the first operation in the fifth image.

[0036] According to a possible implementation manner of the second aspect, the processor is configured to:

[0037] In response to the first operation, the folding screen is in a folded state, and it is determined whether the folding screen is in a preset rotation state; wherein the preset rotation state refers to a state corresponding to a rotation of the folding screen relative to a reference posture by a preset angle;

[0038] If the folding screen is in a preset rotation state, the first parameter of the main screen is obtained.

[0039] According to a possible implementation manner of the second aspect, the processor is configured to:

[0040] If the folding screen is not in a preset rotation state, obtain the width and height of the main screen of the folding screen;

[0041] Starting from the upper left corner of the currently lit screen, the seventh image is captured using the width and height of the main screen as the screenshot frame;

[0042] An eighth image is displayed; wherein the eighth image is a screenshot corresponding to the first operation in the seventh image.

[0043] According to a possible implementation manner of the second aspect, the preset rotation angles include: 0° and 90°.

[0044] According to a possible implementation of the second aspect, the first operation includes a knuckle tapping operation without the finger leaving the screen and a closed curve sliding operation.

[0045] According to a possible implementation manner of the second aspect, the terminal device includes an application layer, a framework layer, a hardware abstraction layer and a kernel layer;

[0046] The framework layer includes input module, window management service, touch manager, display module, folding screen management module and folding screen management module, and the hardware abstraction layer includes interface module, window controller and system interface;

[0047] The display module displays a first interface, and the input module receives a first operation acting on the folding screen;

[0048] The display module obtains the width and height of the main screen, and the folding screen management module obtains the real-time position of the main screen and sends it to the touch manager;

[0049] The touch manager forwards the first parameter to the window controller;

[0050] The window controller captures the first image according to the real-time position of the main screen and the width and height of the main screen as the screenshot frame, and sends the first image to the touch manager;

[0051] The touch manager sends the first parameter and the first image to the system interface;

[0052] The system interface generates a second image according to the first image and the first operation;

[0053] The display module displays the second image.

[0054] In a third aspect, a terminal device is provided, which has the function of implementing the screenshot method based on a folding screen in the first aspect. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above functions.

[0055] In a fourth aspect, a computer-readable storage medium is provided, in which instructions are stored. When the computer-readable storage medium is run on a computer, the computer can execute the folding screen-based screenshot method of any one of the first aspects above.

[0056] In a fifth aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to execute the folding screen-based screenshot method of any one of the first aspects described above.

[0057] Among them, the technical effects brought about by any design method in the second to fifth aspects can refer to the technical effects brought about by different design methods in the first aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Figure 1 A schematic diagram of the structure of a terminal device;

[0059] Figure 2 It is a schematic diagram of the interface of the terminal device in the unfolded state;

[0060] Figure 3 It is a schematic diagram of the interface of the terminal device in a folded state;

[0061] Figure 4 One of the schematic diagrams of responding to the knuckle screenshot operation when the terminal device is in the unfolded state;

[0062] Figure 5 The second schematic diagram is a diagram of responding to a knuckle screenshot operation when the terminal device is in an unfolded state;

[0063] Figure 6 The third schematic diagram is a diagram of responding to a knuckle screenshot operation when the terminal device is in an unfolded state;

[0064] Figure 7 The fourth schematic diagram is a diagram of responding to a knuckle screenshot operation when the terminal device is in an unfolded state;

[0065] Figure 8 The fifth schematic diagram is a diagram of responding to a knuckle screenshot operation when the terminal device is in an unfolded state;

[0066] Fig. 9 One of the schematic diagrams of responding to the knuckle screenshot operation when the terminal device is in the folded state;

[0067] Fig.10 The second schematic diagram is a diagram of responding to a knuckle screenshot operation when the terminal device is in a folded state;

[0068] Fig.11 The third schematic diagram is a diagram of responding to a knuckle screenshot operation when the terminal device is in a folded state;

[0069] Fig.12 The fourth schematic diagram is a diagram of responding to a knuckle screenshot operation when the terminal device is in a folded state;

[0070] Fig.13 The fifth schematic diagram is a diagram of responding to a knuckle screenshot operation when the terminal device is in a folded state;

[0071] Fig.14 The sixth schematic diagram of responding to a knuckle screenshot operation when the terminal device is in a folded state;

[0072] Fig.15 The seventh schematic diagram is a diagram of responding to a knuckle screenshot operation when the terminal device is in a folded state;

[0073] Fig.16The eighth schematic diagram is a diagram of responding to a knuckle screenshot operation when the terminal device is in a folded state;

[0074] Fig.17 One of the flowcharts of a screenshot method based on a folding screen provided in an embodiment of the present application;

[0075] Fig.18 A schematic diagram of a software framework of a terminal device provided in an embodiment of the present application;

[0076] Fig.19 A schematic diagram of internal interactions of a folding screen-based screenshot method provided in an embodiment of the present application;

[0077] Fig. 20 A second flowchart of a screenshot method based on a folding screen provided in an embodiment of the present application;

[0078] Fig.21 A schematic diagram of an interface of a folding screen-based screenshot method provided in an embodiment of the present application;

[0079] Fig. 22 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0080] The following is a description of exemplary embodiments of the present application in conjunction with the accompanying drawings, including various details of the embodiments of the present application to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present application. Similarly, for the sake of clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0081] To facilitate understanding, some technical common sense involved in the embodiments of the present application is first introduced.

[0082] The terminal device includes a folding screen, which can be folded to form a first screen and a second screen; after the folding screen is folded, the first screen and the second screen are opposite to each other and have opposite display directions. The first screen of the terminal device can be a main screen, and the second screen can be a back screen. Alternatively, the first screen of the terminal device can also be a back screen, and the second screen can also be a main screen. In different usage states, the main screen and the back screen of the terminal device can be in the same plane or in different planes.

[0083] For ease of description, the embodiment of the present application takes a terminal device with a main screen and a back screen as an example, where the main screen and the back screen have the same height, and the width of the main screen is greater than the width of the back screen. Of course, this is only to distinguish between the main screen and the back screen, and the number and relative width and height of the main screen and the back screen are limited. In actual use, the number of main screens and back screens, as well as the relative width and height of the main screen and the back screen can be implemented in a variety of specific ways.

[0084] In addition, to facilitate the description of components in different orientations of the terminal device, the following will unify the reference orientation, that is, the side where the main screen of the terminal device is located is the front, the side where the back panel is located is the back, the side where the charging cable jack or headphone cable jack below the main screen is the bottom of the terminal device, and the opposite direction of the side where the charging jack or headphone cable jack is located is the top of the terminal device, and the posture of the terminal device at this time is the reference posture. Of course, the orientation is limited here only for the convenience of description and understanding, and does not limit the posture of the terminal device when in use.

[0085] When the terminal device is in use, there are mainly two device states: one is the unfolded state and the other is the folded state. Figure 1 The figure shows a structural schematic diagram of a terminal device, in which the folding screen of the terminal device is a longitudinally folded outward folding screen. Figure 1 In the device state shown in (a), the device state is the unfolded state. In the unfolded state, the angle between the main screen 101 and the back screen 102 (referring to the angle in the direction opposite to the folding direction, such as denoted as α, the same below) is 180°, and the main screen 101 and the back screen 102 can form a larger full screen to display the user interface. The main screen 101 and the back screen 102 are folded along the folding axis 103. For example, the main screen 101 is folded along the direction shown in 1a and / or the back screen 102 is folded along the direction shown in 1b, which can form Figure 1 In the semi-folded state (hereinafter referred to as the semi-folded state), the angle between the main screen 101 and the back screen 102 satisfies 180°<α<360°. The main screen 101 and the back screen 102 continue to fold along the folding axis 103, for example, the main screen 101 continues to fold along the direction shown in 1a and / or the back screen 102 continues to fold along the direction shown in 1b. Figure 1 (c) or Figure 1 In the folded state, the angle between the main screen 101 and the back screen 102 is 360°, and the display direction 1c of the main screen 101 and the display direction 1d of the back screen 102 are opposite to each other. Figure 1 In the figure, (c) and (d) are schematic diagrams of the outward-folding screen in a folded state at different viewing angles.

[0086] Figure 2 This is a full-screen interface diagram when the terminal device is in the expanded state. Figure 3 This is a schematic diagram of the interface when the terminal device is in a folded state. Figure 3 In the figure, (a) is a schematic diagram of the interface of the main screen, and (b) is a schematic diagram of the interface of the back screen.

[0087] Generally, the unfolded state and the folded state correspond to two different working modes. The working mode of the terminal device in the unfolded state is that the main screen and the back screen are spliced ​​into a full screen, and the main screen and the back screen may not be functionally partitioned within the full screen, that is, the main screen and the back screen can both perform display functions and touch response functions.

[0088] The working mode of the terminal device in the folded state is to divide the main screen and the back screen into functional partitions. The main screen performs the main display function and responds to the user's touch operations on the main screen, while the back screen only performs auxiliary display functions and usually does not respond to the user's touch operations on the back screen. The functions that the main screen can perform include: displaying the video content of the player application, responding to user operations to take pictures, chat with instant messaging software, take screenshots, make phone calls, etc. The back screen can assist in displaying screen saver pictures, QR codes, and using the AO (Always On) Camera to perform pedestrian face recognition scanning, etc., and does not respond to user touch operations on the back screen.

[0089] Different terminal devices have different settings for the working mode corresponding to the semi-folded state. For example, if the main screen and the back screen are unfolded by about 120°, the corresponding working mode in one terminal device may be the working mode of the unfolded state, and the corresponding working mode in another terminal device may be the working mode of the folded state. In some other embodiments, the terminal device may also stipulate that if the terminal device is gradually folded from the fully unfolded state to the first angle (for example, 120°), the working mode at this time is set to the working mode of the unfolded state. Conversely, if the terminal device is gradually unfolded from the fully folded state to the second angle (for example, 90°), the working mode at this time can be set to the working mode of the folded state. Specifically, the working module corresponding to each semi-folded state can be determined according to the factory program settings of each terminal device, or the user's custom settings after powering on, without limitation. The screenshot method provided in the embodiment of the present application does not involve how each terminal device distinguishes and identifies the folded state and the unfolded state. It only needs to further limit the use process of the confirmed folded state and the unfolded state on the basis of the internal program of each terminal device setting the distinguishing and identifying device states.

[0090] Above Figures 1 to 3 The terminal devices shown are all terminal devices including an outward folding screen, that is, the main screen and the back screen can be in an outward folding state folded away from each other. The embodiments of the present application are mainly limited to the use of the terminal device including the outward folding screen.

[0091] When the terminal device is in the expanded state or folded state, the expanded full screen or the folded main screen can respond to the user's touch operation, such as the screenshot operation. There are many ways for the user to perform the screenshot operation, such as knuckle screenshot, key screenshot, voice screenshot, etc. The following will describe the knuckle screenshot scheme in the expanded state and the knuckle screenshot scheme in the folded state respectively.

[0092] The knuckle screenshot solution refers to the terminal device responding to the user's knuckle tapping screen event, and performing various screenshot operations corresponding to the sliding traces of the user's knuckles on the screen by detecting the sliding traces of the user's knuckles on the screen. The knuckle screenshot operations corresponding to various sliding traces may include but are not limited to: closed pattern screenshot operations, scrolling screenshot operations, and full-screen screenshot operations. The screen that receives the user's knuckle operation can be a full screen in an expanded state or a main screen in a folded state. For ease of description, the target screen is used to refer to the screen that receives the user's knuckle operation.

[0093] Among them, the closed pattern screenshot operation refers to: the user's knuckles tap and slide on the target screen of the terminal device, the terminal device detects the knuckle tapping and sliding events, and collects the custom closed pattern corresponding to the sliding traces of the knuckles. The terminal determines the target screen acted upon by the knuckle tapping and sliding events, generates a base map with the display interface of the target screen, captures part of the pattern within the coverage of the custom closed pattern on the base map, and generates a screenshot with the captured part of the base map. The terminal device can directly use the captured part of the base map as a screenshot, or perform shape adjustment processing or other image processing operations on the part of the base map to obtain a screenshot. After the terminal device generates the screenshot, the screenshot can be directly displayed on the display interface of the target screen, or it can be stored in a predefined screenshot storage area.

[0094] Scrolling screenshot means that the terminal device predefines one or more open patterns of preset types, such as "S". If the terminal device detects that the user's knuckles tap and slide on the target screen, and the sliding traces correspond to the predefined open pattern, the terminal device can start screenshots with the current display interface of the target screen, and continue to capture the display interface for a period of time or a certain number of times, and stitch the images of multiple screenshots in sequence to form a long screenshot or screen recording video.

[0095] The full-screen screenshot operation means that the terminal device detects the double-click operation of the user's knuckle on the target screen, and the terminal device takes a screenshot of the display interface of the target screen, and directly uses the screenshot as the final screenshot presented or stored. Of course, the knuckle screenshot solution can also have other screenshot solutions for other operations, such as half-screen screenshot, etc., without limitation.

[0096] In addition to the above-mentioned types of knuckle screenshot operations, the screenshot operations that the terminal device can respond to may also include key screenshot operations and voice screenshots, etc., without limitation.

[0097] From the above introduction, it can be seen that no matter it is a knuckle screenshot operation, a button screenshot operation or a voice screenshot operation, the terminal device generates a base image based on the display interface of the target screen that currently responds to the touch operation or performs the main display operation, and then takes a screenshot, or directly takes a screenshot based on the display interface. The target screen that responds to the touch operation or performs the main display operation mentioned here is usually the full screen in the expanded state or the main screen in the folded state. The back screen in the folded state usually cannot respond to the user's touch screenshot operation.

[0098] The conventional scheme for the terminal device to perform a screenshot operation based on the target screen is: starting from the upper left corner of the currently lit screen, a screenshot frame is circled according to the width and height of the target screen, a base image is generated corresponding to the screenshot frame, and then the base image is directly used as the screenshot, or image processing is performed on the basis of the base image before further generating a screenshot.

[0099] like Figure 4 As shown in FIG. 1 , it is a schematic diagram of responding to a knuckle screenshot operation when the terminal device is in an unfolded state. The user taps the screen with his knuckles and draws a closed pattern on the screen with his knuckles (such as Figure 4 ). If the screen of the terminal device that responds to the screenshot operation is full screen, then the width and height of the target screen is the width and height of the full screen, that is, the width and height of the main screen + the back screen. The upper left corner of the current screen of the terminal device is the current upper left corner of the full screen, that is, the corresponding position of the upper left corner of the back screen, such as Figure 4 The P0 position shown in the figure. The terminal device starts from the upper left corner of the currently lit screen and circles the background image range according to the width and height of the full screen, which is the range from the P0 position to the P1 position, that is, the current full screen range.

[0100] At this time, the terminal device takes the full-screen display interface as the screenshot range, and the generated base map is as follows Figure 5 Afterwards, the terminal device further generates a screenshot based on the base map according to the coverage of the closed pattern drawn by the user's knuckles. Figure 6 The final screenshot is as shown. Figure 7 As shown. During the entire screenshot process, Figure 5 The base map shown may not be displayed to the user. Figure 6 The schematic diagram comparing the base image and the screenshot area shown can be displayed to the user. By dimming the brightness of the base image area and brightening the brightness of the screenshot area, the user can clearly understand the base image corresponding to the screenshot operation and the area of ​​the pattern captured based on the base image, so that the user can confirm whether to take a screenshot in the current range, or whether to adjust the screenshot area or cancel the screenshot. If the user confirms to take a screenshot in the current range, the terminal device can Figure 7 The screenshot shown is displayed to the user.

[0101] In display Figure 7 Before the screenshot shown, a user adjustment operation interface for the screenshot can also be added. Figure 8 As shown, operation controls corresponding to the screenshot 800 may also be displayed, such as a return control 801, an edit control 802, a save control 803, a share control 804, a free graphic control 805, a square control 806, an elliptical control 807, etc. Among them, the return control 801 is used to indicate returning to the previous interface or exiting the current interface. The edit control 802 is used to indicate that the current screenshot 800 can be edited. The save control 803 is used to indicate that the screenshot 800 can be saved. The share control 804 is used to indicate that the screenshot 800 can be shared. The free graphic control 805, the square control 806, and the elliptical control 807 are used to indicate adjusting the shape of the screenshot 800, etc. Of course, controls for other functions may also be displayed without limitation.

[0102] like Fig. 9 As shown in FIG. 1 , it is a schematic diagram of responding to a knuckle screenshot operation when the terminal device is in a folded state. When the terminal device is in a folded state, the main screen is used as the target screen for performing the main display operation and receiving the touch operation. The user's knuckles tap the main screen and draw a closed pattern (such as Fig. 9 It should be noted that in the relevant scenarios of the knuckle screenshot operation in the folded state, for comparison display, the back screen that is currently off and the main screen that is currently on are placed side by side, and the back screen is placed on the left side of the main screen according to the relative positions of the main screen and the back screen. However, in actual use, when the terminal device is in the folded state, the main screen is on and the back screen is off, and the back screen and the main screen are not placed side by side.

[0103] In one case, the current screen of the terminal device is only the main screen, that is, the back screen is off. Then the upper left corner of the current screen of the terminal device is the current upper left corner of the main screen, that is, Fig. 9 The P2 position shown in the figure is not the P3 position. Since the width and height of the target screen are still the width and height of the main screen, the terminal device starts from the upper left corner of the main screen that is currently lit, and the base map range is circled according to the width and height of the main screen, which is the range from the P2 position to the P1 position, that is, the area between the lines L1 and L2, which is actually the current main screen range. At this time, the terminal device generates a base map based on the base map range of the main screen, such as Fig.10 shown.

[0104] Afterwards, the terminal device further generates a screenshot based on the base map. Fig.11 The final screenshot is as shown. Fig.12 As shown, corresponding to Fig. 9 The screenshot area is circled by the user's knuckles, achieving the screenshot effect expected by the user. Fig.10The base map shown may not be displayed to the user. Fig.11 The schematic diagram comparing the base image and the screenshot area shown can be displayed to the user. By dimming the brightness of the base image area and brightening the brightness of the screenshot area, the user can clearly understand the base image corresponding to the screenshot operation and the area of ​​the pattern captured based on the base image, so that the user can confirm whether to take a screenshot in the current range, or whether to adjust the screenshot area or cancel the screenshot. If the user confirms to take a screenshot in the current range, the terminal device can Fig.12 The screenshot shown is displayed to the user.

[0105] In another case, the terminal device currently has the main screen and the back screen on. That is, even if the user is using the main screen in the folded state, the back screen behind the main screen may also be on at the same time due to factors such as display savers, message notifications, or user active triggering.

[0106] At this time, the screen that responds to the touch operation is still the main screen, so the width and height of the target screen are still the width and height of the main screen. Since the main screen and the back screen are lit at the same time, and the back screen is usually located to the left of the main screen. Then the upper left corner of the current screen of the terminal device is the current upper left corner of the back screen, such as Fig.13 The P3 position shown in the figure is not the P2 position in the upper left corner of the main screen. Since the width and height of the target screen are still the width and height of the main screen, the terminal device starts from the upper left corner of the back screen of the current screen, and the background map range is circled according to the width and height of the main screen, that is, the range from P3 to P4, that is, the area between lines L3 and L4, which is the full range of the back screen plus part of the main screen. The terminal device generates a background map based on this background map range, such as Fig.14 shown.

[0107] This is different from the base map generated by the main screen range between lines L1 and L2 that users originally expected ( Fig.10 ), which is completely different. In other words, when the main screen and the back screen are both on at the same time when the folded state, an incorrect background image is generated. The comparison screenshots generated by the terminal device based on the incorrect background image are as follows Fig.15 As shown, the final screenshot is as follows Fig.16 As shown. Fig.13 In the screenshot area circled by the user's knuckle, it is obvious that when the terminal device is in the folded state and the main screen and the back screen are on at the same time, the wrong background image and screenshot are generated, which does not achieve the screenshot effect expected by the user. Of course, in other cases, if the terminal device detects that the folded state generates a background image containing the back screen area, it can also directly pop up an indication of the screenshot error and not display the wrong screenshot to the user.

[0108] When the terminal device is in the folded state, in the button screenshot and voice screenshot scenarios, as well as in closed area screenshot, scrolling screenshot and other scenarios, if there are operation steps to capture the base image starting from the upper left corner of the currently lit screen, technical problems may also occur in generating incorrect base images and screenshots.

[0109] Based on this, the present application provides a screenshot method based on a folding screen to solve the technical problem of errors in terminal device screenshots. The screenshot method provided in the embodiment of the present application, when responding to a screenshot operation, not only refers to the width and height of the screen responding to the screenshot, but also refers to the real-time position of the screen, and uses the real-time position of the screen as the starting point of the screenshot frame to obtain the correct base image, thereby obtaining a correct screenshot.

[0110] The screen receiving the screenshot operation in the terminal device can be the full screen of the folding screen in the unfolded state, or the main screen of the folding screen in the folded state. The screenshot method provided in the embodiment of the present application has better effect and much improved accuracy for the problems that may exist in the screenshot scene of the terminal device in the folded state.

[0111] The screenshot method provided in the embodiment of the present application has various application scenarios, which will be described below in combination with various application scenarios.

[0112] Scenario 1: To adapt to the general screenshot scenario of various terminal devices.

[0113] like Fig.17 FIG. 1 is a flow chart of a screenshot method based on a folding screen provided in an embodiment of the present application. The screenshot method executed by the terminal device mainly includes the following steps:

[0114] Step S1701: The folding screen displays a first interface, and receives a first operation acting on the folding screen; the first operation is used to instruct to capture a corresponding image in the first interface displayed on the folding screen.

[0115] When the user uses the terminal device, the folding screen lights up and displays the first interface. If the device is in the unfolded state at this time, the folding screen that is lit at this time is full screen. If the device is in the folded state at this time, the folding screen that is lit at this time may include only the main screen, or may include the main screen and the back screen displayed back to back. In other words, the first interface may be a full-screen display interface, or it may be a display interface of the main screen.

[0116] If the user wants to capture the image corresponding to all or part of the content of the first interface, the user can apply a screenshot operation on the folding screen. For ease of description, the screenshot operation applied to the folding screen is defined as a first operation, which is used to instruct to capture the image corresponding to the first interface. The captured image can be a partial image of the first interface or the entire image of the first interface.

[0117] The screenshot method provided in the embodiment of the present application includes a screenshot scenario of a knuckle screenshot, such as Figures 4 to 12 As shown. The knuckle screenshot operation includes two consecutive steps, namely, the knuckle tapping operation without leaving the screen and the closed curve sliding operation. That is to say, the terminal device detects whether the first operation indicating the screenshot is received, and needs to determine whether the knuckle tapping operation and the closed curve sliding operation are detected continuously. If the terminal device receives the knuckle tapping operation and the closed curve sliding operation acting on the folding screen in sequence, it determines that a screenshot needs to be taken for the first interface.

[0118] The acceleration of the force applied by the knuckles on the screen is relatively large, usually greater than the acceleration of the force applied by other parts of the fingers such as the fingertips on the screen. Also, the terminal device can detect infrared signals when the knuckles act on the screen, while other objects with hard surfaces may not be able to detect infrared signals when acting on the screen. Based on this, a knuckle operation recognition algorithm is running inside the terminal device. Based on the characteristics of the large acceleration force and infrared signals applied by the knuckles on the screen, the knuckle operation recognition algorithm is called to identify whether the touch operation applied to the screen is a knuckle operation. After the terminal device detects that the touch operation is a knuckle operation, it distinguishes whether the detected knuckle operation is a knuckle tapping operation or a knuckle sliding operation based on the characteristics of a sudden increase in pressure during a tapping operation and an extension of the pressure area during a sliding operation.

[0119] Step S1702: In response to the first operation, the folding screen is in a folded state, and the first parameter of the main screen is obtained; wherein the first parameter includes the width and height of the main screen and the real-time position of the main screen; the real-time position is used to determine the starting position of the screenshot frame; the main screen is the first screen, and the second screen is the back screen; or, the main screen is the second screen, and the first screen is the back screen; in the folded state, the main screen is on, and the back screen is on or off.

[0120] After detecting that the first operation is a knuckle screenshot operation, the terminal device responds to the first operation and starts screenshot. The screen acted on by the first operation is a folding screen, one case is a full screen in an expanded state, and the other case is a main screen in an expanded state.

[0121] If the terminal device is in a folded state, the main screen in the folded state can respond to touch operations, but the back screen cannot respond to touch operations, then the first interface captured is the display interface of the main screen.

[0122] The steps of taking screenshots by the terminal device mainly include: generating a base map, and taking screenshots based on the base map. In order to take screenshots of all or part of the first interface of the main screen, the terminal device needs to first determine the capture range of the base map, which obtains the first parameters such as the width and height of the main screen and the real-time position. Among them, the width and height of the main screen are used to determine the screenshot frame of the first interface of the main screen, and the real-time position is used to determine the starting position of the screenshot frame.

[0123] Step S1703: According to the real-time position of the main screen, the first image is captured using the width and height of the main screen as the screenshot frame.

[0124] After the terminal device obtains the real-time position and width and height of the main screen, it starts to generate the base map. Specifically, first determine the starting position of the screenshot frame according to the real-time position of the main screen, that is, the starting position of the screenshot. Then, along the two sides of the main screen, extend from the starting position to the width and height of the main screen to obtain the corresponding screenshot frame. The area of ​​the first interface of the main screen covered by the screenshot frame is captured and defined as the first image.

[0125] like Fig. 9 The main screen screenshot scene shown in the figure uses the real-time position of the main screen to determine the upper left corner P2 of the main screen as the starting position, determines the screenshot frame corresponding to the width and height of the main screen, and generates Fig.10 The first image is shown.

[0126] Step S1704: displaying a second image; wherein the second image is a screenshot corresponding to the first operation in the first image.

[0127] After the terminal device obtains the first image according to the real-time position and width and height of the main screen, it can generate a screenshot corresponding to the first operation according to the first image, which is the second image. The terminal device can directly display the second image or save the second image.

[0128] The screenshot operation includes a variety of screenshot types, such as closed pattern screenshot, scrolling screenshot and full-screen screenshot. If the screenshot type indicated by the first operation is a full-screen screenshot, the first image can be directly used as the second image corresponding to the first operation. If the screenshot type indicated by the first operation is a scrolling screenshot, it is necessary to stitch together the multiple first images captured in sequence as the screenshot corresponding to the first operation. If the screenshot type indicated by the first operation is a partial area screenshot, it is necessary to take a screenshot of a partial area of ​​the first image to obtain the second image.

[0129] For the knuckle screenshot scenario, after determining that the first operation includes the knuckle tapping operation and the closed curve sliding operation, the terminal device needs to further collect the closed curve corresponding to the closed curve sliding operation to determine the screenshot type and screenshot area indicated by the first operation. The terminal device generates a corresponding second image based on the first image according to the screenshot type corresponding to the sliding trajectory.

[0130] If the terminal device detects that the sliding track corresponding to the first operation forms a closed pattern, the screenshot type is determined to be a closed pattern screenshot. The screenshot is taken in the coverage area of ​​the first image according to the closed pattern formed by the sliding track as the screenshot corresponding to the first operation, i.e., the second image. Figures 4 to 8 The closed pattern screenshot scene shown, or Figures 9 to 12 In the closed pattern screenshot scenario shown, the terminal device finally obtains a screenshot corresponding to the sliding track of the user's knuckle sliding operation.

[0131] The screenshot method provided in the embodiment of the present application, in addition to obtaining the width and height of the main screen, also obtains the real-time position of the main screen when responding to a touch operation in the folded state. The base image is obtained according to the real-time position of the main screen, rather than directly using the upper left corner of the currently lit screen as the starting position to obtain the base image, which can effectively avoid errors in the base image and improve the accuracy of the screenshot.

[0132] The software system of the terminal device can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes a system with a layered architecture as an example to exemplify the software structure of the terminal device.

[0133] The layered architecture divides the software into several layers, each with a clear role and division of labor. The layers communicate with each other through software interfaces. In some embodiments, see Fig.18 , the system is divided into four layers, from top to bottom: application layer (APP), framework layer (FWK), hardware abstraction layer (HAL), and kernel layer.

[0134] The application layer may include a series of application packages of screen applications. Since the screenshot operation can be performed in most screen applications, the screen application here can be most applications, including but not limited to: desktop applications, chat applications, camera applications, playback applications, etc.

[0135] The framework layer provides an application programming interface (API) and a programming framework for the application programs in the application layer. The framework layer includes some predefined functions.

[0136] The framework layer may include an input module (Input), a window management service (Window Manager Service, WMS), a finger sense manager (Finger Sense Manager, FSM), a display module (Display), and a folding screen management module (Fold Screen Manager, FSM).

[0137] Among them, the window management service is used for window management, window animation management, and as a transfer station for the input system. WMS can also obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0138] The input module collects input operations acting on the screen and other input ports of the terminal device, such as drawing patterns, tapping the screen with knuckles, sliding the screen with fingers, and other touch events. The input and output module can report the collected touch events to the window management service. The window management service reports the received reported touch events to the touch manager.

[0139] As the main processing device, the touch manager receives touch events reported by the window management service, determines the processing scheme for the corresponding touch events, and calls each associated module to execute the processing scheme.

[0140] The display module manages at least two screens and can obtain the width and height of each screen, the screen usage status of various device states, and the screen brightness status.

[0141] The folding screen management module can provide main screen service and back screen service, and can also obtain device status, real-time position of each screen, and screen on / off status, etc. The back screen service can be used to provide various shortcut functions on the back screen of the terminal device, such as displaying a screen saver pattern, which is not limited in the present application embodiment.

[0142] The hardware abstraction layer may include an interface module, a window controller (Surface Control, SC) and a system interface (System User Interface, SystemUI), etc.

[0143] The window controller is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of multiple common audio and video formats, as well as static image files. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis and layer processing. The 2D graphics engine is a drawing engine for 2D drawing.

[0144] The system interface can call the image processing algorithm of the hardware abstraction layer to perform image processing operations, including but not limited to: screenshots, image modification, etc.

[0145] It should be noted that the screen width, height, real-time position and other data obtained by the display module and the folding screen management module are not directly collected, but sent by the window management service. The terminal device is equipped with a sensor, which detects the position, acceleration, angular velocity and other parameters of the terminal device in real time, and reports them to the window management service through the interface module. After the window management service distinguishes various parameters, it updates and reports them to the corresponding module. For example, the window management service periodically updates the screen width and height data to the display module, or updates the real-time position data of the main screen to the folding screen management module.

[0146] The hardware abstraction layer is an abstract structure between the kernel layer and the upper layer. It is a package of the kernel layer driver to provide a unified interface to the upper layer. It makes it unnecessary for the upper layer application to know how the lower layer hardware works, thus shielding the implementation details of the lower layer.

[0147] The hardware abstraction layer provides a standard interface to expose device hardware capabilities to higher-level framework layers.

[0148] The kernel layer is the layer between hardware and software. The kernel layer contains at least the sensor module. In addition, the kernel layer usually also includes display drivers, camera drivers, audio drivers, sensor drivers, etc.

[0149] The screenshot method provided in the embodiment of the present application can be used in the above Fig.18 The software architecture shown in FIG. Fig.18 The software architecture shown, and Fig.19 The schematic diagram of the specific execution process of the screenshot method shown provides a specific screenshot method. In this embodiment, a specific example is provided, that is, the terminal device includes a main screen and a back screen that can be folded mutually, the screen indicating the screenshot is the main screen, and the screenshot type is a closed pattern screenshot.

[0150] Specifically, Fig.18 and Fig.19 As shown, the screen application of the terminal device receives a first operation of the user, and the first operation may include a second operation and a third operation input in sequence. The input module first obtains a first touch event according to the parameters of the second operation, and first reports the first touch event to the window management service, and the first touch event includes parameters such as touch area, position, and strength.

[0151] The window management service calls the knuckle event recognition algorithm to determine whether the first touch event is a knuckle tapping event. If the first touch event is determined to be a knuckle tapping event, a label is added to the first touch event, and the label is used to indicate that the first touch event is a knuckle tapping event. The window management service sends the first touch event and the label to the touch manager.

[0152] After receiving the first touch event, the touch manager detects that the first touch event matches the tag, and then registers an event monitoring task to indicate whether to continue to receive the second touch event associated with the first touch event. For example, if the first touch event is a knuckle tapping event, then the second touch event associated with the first touch event is a knuckle sliding event. The touch manager returns the registered event monitoring task to the window management service, so that the window management service monitors whether the second touch event associated with the first touch event is received.

[0153] The input module of the terminal device continuously receives multiple touch events and uploads all received touch events to the window management service. The window management service calls the finger joint event recognition algorithm to determine whether there is a second touch event associated with the first touch event in the multiple touch events based on the parameters of each touch event. When the second touch event is detected, it is reported to the touch manager. The second touch event includes the identification information of the main screen acted on by the finger joint and the sliding trajectory of the sliding event and other parameters.

[0154] If the touch manager receives a second touch event reported by the window management service after the first touch event, it confirms to execute the screenshot on the main screen. Based on the solution introduction of the above scenario 1, it can be known that the terminal device needs to first obtain the width and height dimensions and real-time position of the main screen.

[0155] The touch manager calls the display module to obtain the width and height of the main screen, such as width and height. The touch manager then calls the folding screen management module to obtain the real-time position of the main screen.

[0156] The touch manager sends the width and height of the main screen and the real-time position to the window controller, which then performs the operation of obtaining the base map. The window controller captures the image of the display interface of the main screen according to the real-time position of the main screen and the width and height of the main screen as the screenshot frame to obtain the base map, and returns the generated base map to the touch manager.

[0157] The touch manager then packages the base image and the parameters of the sliding track included in the second touch event and sends them to the system interface, which captures the partial image covered by the sliding track according to the base image to obtain the final screenshot. Afterwards, the system interface can directly display the screenshot.

[0158] Based on the above embodiments, Fig. 20 As shown, the embodiment of the present application also expands several application scenarios to provide screenshot methods suitable for different application scenarios.

[0159] Scenario 2: Different device states are distinguished and different screenshot methods are executed.

[0160] The device state of the terminal device includes an unfolded state and a folded state. If the folding screen is in the unfolded state, the width and height of the full screen of the folding screen are obtained; starting from the upper left corner of the currently lit screen, the third image is captured with the width and height of the full screen as the screenshot frame; wherein, in the unfolded state, the full screen is lit; the fourth image is displayed; wherein the fourth image is a screenshot corresponding to the first operation in the third image.

[0161] When the terminal device is in the unfolded state, the folding screen that responds to the touch operation is full screen, and the currently lit screen is also full screen. Then the upper left corner of the currently lit screen and the upper left corner of the real-time position indication of the full screen are the same position. Then, the terminal device can obtain the first image as the base image according to the general screenshot method provided in the above scenario 1, and then obtain the second image as the screenshot based on the first image.

[0162] The terminal device may also obtain a screenshot by using the upper left corner of the lit screen as the starting position to generate a base image. Specifically, in response to the first operation, the terminal device obtains the width and height of the target screen, starts from the upper left corner of the currently lit screen, and uses the width and height of the target screen as the screenshot frame to capture a third image, and then generates a fourth image based on the third image. The base images and final screenshots obtained by these two methods are the same.

[0163] Scenario 3: Differentiate between device status and screen-on status to execute different screenshot methods. Based on Scenario 2, the solution provided in this scenario further distinguishes and limits different screen-on states in the folded state.

[0164] When the terminal device detects that the device is in the folded state, it further determines whether the main screen and the back screen are on at the same time. If the main screen is on and the back screen is off, the screen that is on at this time is the main screen, and the upper left corner of the screen that is on is the same as the upper left corner of the real-time position indicator of the main screen. In this case, the terminal device can obtain the first image as the base map according to the general screenshot method provided in the above scenario one. The terminal device can also generate a fifth image with the upper left corner of the lit screen as the starting position, and generate a sixth image corresponding to the screenshot based on the fifth image. The base maps obtained by these two methods are the same, and the screenshots obtained based on the base map are also the same.

[0165] If the terminal device detects that the target screen and other screens are lit at the same time, the screens that are lit at this time are the main screen and the back screen. Then, the upper left corner of the screen that is lit at this time may be the upper left corner of the back screen, which is different from the upper left corner of the real-time position indication of the main screen. In this case, the method of generating a base map based on the upper left corner of the lit screen as the starting position may result in an incorrect base map, and then an incorrect screenshot.

[0166] To avoid such erroneous screenshots, when the terminal device detects that the main screen and the back screen are lit at the same time, it can choose to obtain the first image as the base image according to the general screenshot method provided in the above scenario one, and then obtain the screenshot as the second image based on the base image to ensure the accuracy of the screenshot.

[0167] Scenario 4: Differentiate between the screen on / off state and the rotation state to execute different screenshot methods. Based on Scenario 3, the solution provided in this scenario further limits the different rotation states when the screen is on at the same time.

[0168] like Fig.21As shown, it is a schematic diagram of the main screen 101 and the back screen 102 of the terminal device being on at the same time. For the convenience of comparison, the folded main screen 101 and the back screen 102 are placed side by side. The main screen of the terminal device faces the user, and the bottom is parallel to the ground as the standard reference direction, that is, Fig.21 The rotation state shown in (a) is a reference posture, and a schematic diagram of the terminal device rotating a certain angle around the reference posture is shown with the center line corresponding to the reference posture as the rotation axis.

[0169] in, Fig.21 The preset rotation state shown in (a) is that the preset rotation angle of the main screen relative to the reference posture is 0°; Fig.21 The preset rotation state shown in (b) is that the preset rotation angle of the main screen relative to the reference posture is 90°; Fig.21 The preset rotation state shown in (c) is that the preset rotation angle of the main screen relative to the reference posture is 180°; Fig.21 The preset rotation state shown in (d) is that the preset rotation angle of the main screen relative to the reference posture is 270°. It should be noted that the rotation angle referred to here is based on clockwise rotation.

[0170] In addition, Fig.21 In the figure, a thicker dotted frame is used to indicate the screenshot frame (such as Fig.21 2100 in the screenshot), the screenshot frame is based on the upper left corner of the current bright screen as the starting position, and is determined according to the width and height of the main screen. It can be seen that when the preset rotation angle of the main screen relative to the reference posture is 0° or 90°, the screenshot frame does not overlap with the main screen; when the preset rotation angle of the main screen relative to the reference posture is 180° or 270°, the screenshot frame overlaps with the main screen. In other words, when the main screen is rotated 0° or 90° relative to the reference posture, the base map obtained by using the upper left corner of the bright screen as the starting position may have a technical problem of base map error.

[0171] In order to solve the above problem, when the terminal device determines that the device state is folded and the main screen and other screens are on at the same time, different rotation states can be used to match different screenshot methods. If the terminal device determines that the main screen is not in the preset rotation state, it can respond to the first operation, obtain the width and height of the main screen, start from the upper left corner of the currently lit screen, and use the width and height of the main screen as the screenshot frame to capture the seventh image, and generate the eighth image based on the seventh image, that is, as the screenshot corresponding to the first operation.

[0172] If the terminal device determines that the main screen is in a preset rotation state, for example Fig.21 In the cases shown in (a) and (b), it is necessary to execute the screenshot method provided in scenario 1 to obtain the base map according to the real-time position of the main screen to ensure an accurate base map and improve the accuracy of the screenshot.

[0173] In addition, an embodiment of the present application also provides a terminal device, including a folding screen, a memory, and a processor;

[0174] Memory stores computer-executable instructions;

[0175] The processor executes the computer-executable instructions stored in the memory, so that the terminal device executes the screenshot method provided by the above embodiment. In addition to these main components, the terminal device also includes components for implementing basic functions. Fig. 22 Provide specific instructions.

[0176] like Fig. 22 The structure diagram of a terminal device 2200 provided in an embodiment of the present application is shown. The terminal device 2200 may include a processor 2210, an external memory interface 2220, a memory 2221, a Universal Serial Bus (USB) interface 2230, a battery 2240, a power management module 2241, a power chip 2242, an antenna 1, an antenna 2, a radio frequency module 2250, a communication module 2260, an audio module 2270, a speaker 2270A, a receiver 2270B, a microphone 2270C, an earphone interface 2270D, a sensor module 2280, a button 2290, a motor 2291, an indicator 2292, a camera 2293, a display screen 2294, and a SIM card module 2295, etc. The sensor module 2280 may include a pressure sensor 2280A, a gyroscope sensor 2280B, an acceleration sensor 2280C, a touch sensor 2280D, etc.

[0177] The structure illustrated in the embodiment of the present invention does not constitute a limitation on the terminal device 2200. It may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0178] The processor 2210 may include one or more processing units. For example, the processor 2210 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processor (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0179] The controller can be a decision maker that directs the various components of the terminal device 2200 to work in coordination according to the instructions. It is the nerve center and command center of the terminal device 2200. The controller generates an operation control signal according to the instruction operation code and timing signal to complete the control of fetching and executing instructions.

[0180] The processor 2210 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 2210 is a high-speed cache memory, which can store instructions or data that the processor 2210 has just used or cyclically used. If the processor 2210 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 2210, and thus improves the efficiency of the system.

[0181] In some embodiments, the processor 2210 may include an interface. The interface may include an Inter-Integrated Circuit (I2C) interface, an Inter-Integrated Circuit Sound (I2S) interface, a Pulse Code Modulation (PCM) interface, a Universal Asynchronous Receiver / Transmitter (UART) interface, a Mobile Industry Processor Interface (MIPI) interface, a General-Purpose Input / Output (GPIO) interface, a SIM interface, and / or a USB interface, etc.

[0182] The I2C interface is a bidirectional synchronous serial bus, including a serial data line (SDL) and a serial clock line (SCL). In some embodiments, the processor 2210 may include multiple groups of I2C buses. The processor 2210 may be coupled to the touch sensor 2280K, the charger, the flash, the camera 2293, etc. through different I2C bus interfaces. For example: the processor 2210 may be coupled to the touch sensor 2280K through the I2C interface, so that the processor 2210 communicates with the touch sensor 2280K through the I2C bus interface, thereby realizing the touch function of the terminal device 2200.

[0183] The I2S interface can be used for audio communication. In some embodiments, the processor 2210 can include multiple groups of I2S buses. The processor 2210 can be coupled to the audio module 2270 via the I2S bus to achieve communication between the processor 2210 and the audio module 2270. In some embodiments, the audio module 2270 can transmit an audio signal to the communication module 2260 via the I2S interface to achieve the function of answering a call through a Bluetooth headset.

[0184] The PCM interface can also be used for audio communication, sampling, quantizing and encoding analog signals. In some embodiments, the audio module 2270 and the communication module 2260 can be coupled via a PCM bus interface. In some embodiments, the audio module 2270 can also transmit audio signals to the communication module 2260 via the PCM interface to realize the function of answering calls via a Bluetooth headset. Both the I2S interface and the PCM interface can be used for audio communication, and the sampling rates of the two interfaces are different.

[0185] The UART interface is a universal serial data bus for asynchronous communication. The bus is a bidirectional communication bus. It converts the data to be transmitted between serial communication and parallel communication. In some embodiments, the UART interface is generally used to connect the processor 2210 and the communication module 2260. For example, the processor 2210 communicates with the Bluetooth module through the UART interface to implement the Bluetooth function. In some embodiments, the audio module 2270 can transmit an audio signal to the communication module 2260 through the UART interface to implement the function of playing music through a Bluetooth headset.

[0186] The MIPI interface can be used to connect the processor 2210 with peripheral devices such as the display screen 2294 and the camera 2293, and the display screen is a folding screen. The MIPI interface includes a camera serial interface (CSI), a display serial interface (DSI), etc. In some embodiments, the processor 2210 and the camera 2293 communicate via the CSI interface to realize the shooting function of the terminal device 2200. The processor 2210 and the display screen 2294 communicate via the DSI interface to realize the display function of the terminal device 2200.

[0187] The GPIO interface can be configured by software. The GPIO interface can be configured as a control signal or as a data signal. In some embodiments, the GPIO interface can be used to connect the processor 2210 with the camera 2293, the display screen 2294, the communication module 2260, the audio module 2270, the sensor module 2280, etc. The GPIO interface can also be configured as an I2C interface, an I2S interface, a UART interface, a MIPI interface, etc.

[0188] The USB interface 2230 may be a Mini USB interface, a Micro USB interface, a USB Type C interface, etc. The USB interface 2230 may be used to connect a charger to charge the terminal device 2200, or may be used to transmit data between the terminal device 2200 and a peripheral device. The USB interface 2230 may also be used to connect headphones to play audio through the headphones. The USB interface 2230 may also be used to connect other terminal devices, such as AR devices, etc.

[0189] The interface connection relationship between the modules shown in the embodiment of the present invention is only for illustrative purposes and does not constitute a structural limitation on the terminal device 2200. The terminal device 2200 may adopt different interface connection modes in the embodiment of the present invention, or a combination of multiple interface connection modes.

[0190] The battery 2240 may be a rechargeable battery or a disposable battery. The rechargeable battery may receive charging input through a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the battery 2240 may receive charging input from a wired charger through the USB interface 2230. In some wireless charging embodiments, the battery 2240 may receive wireless charging input through a wireless charging coil of the terminal device 2200. While the battery 2240 is charging the power chip 2242, it may also power the terminal device 2200 through the power management module 2241.

[0191] The power management module 2241 is used to connect the power chip 2242, the battery 2240 and the processor 2210. The power management module 2241 receives input from the power chip 2242 and / or the battery 2240, and supplies power to the processor 2210, the memory 2221, the external memory interface 2220, the display screen 2294, the camera 2293, and the communication module 2260. The power management module 2241 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some embodiments, the power management module 2241 can also be set in the processor 2210. In some embodiments, the power management module 2241 and the power chip 2242 can also be set in the same device.

[0192] The wireless communication function of the terminal device 2200 can be implemented through antenna 1, antenna 2, RF module 2250, communication module 2260, modem and baseband processor.

[0193] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 2200 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, a cellular network antenna can be reused as a wireless local area network diversity antenna. In some embodiments, the antenna can be used in combination with a tuning switch.

[0194] The RF module 2250 can provide a communication processing module for wireless communication solutions including 2G / 3G / 4G / 5G applied to the terminal device 2200. The RF module 2250 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The RF module 2250 receives electromagnetic waves from the antenna 1, and performs filtering, amplification and other processing on the received electromagnetic waves, and transmits them to the modem for demodulation. The RF module 2250 can also amplify the signal modulated by the modem, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the RF module 2250 can be set in the processor 2210. In some embodiments, at least some of the functional modules of the RF module 2250 can be set in the same device as at least some of the modules of the processor 2210.

[0195] The modem may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 2270A, a receiver 2270B, etc.), or displays an image or video through a display screen 2294. In some embodiments, the modem may be an independent device. In some embodiments, the modem may be independent of the processor 2210 and be arranged in the same device as the RF module 2250 or other functional modules.

[0196] The communication module 2260 can provide a communication processing module for wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (IR), etc., which are applied to the terminal device 2200. The communication module 2260 can be one or more devices integrating at least one communication processing module. The communication module 2260 receives electromagnetic waves via antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 2210. The communication module 2260 can also receive the signal to be sent from the processor 2210, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through antenna 2.

[0197] In some embodiments, the antenna 1 of the terminal device 2200 is coupled to the radio frequency module 2250, and the antenna 2 is coupled to the communication module 2260, so that the terminal device 2200 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include Global System for Mobile communications (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Time-Division Code Division Multiple Access (TD-SCDMA), Long Term Evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology. GNSS may include a Global Positioning System (Satellite Based Augmentation Systems, SBAS), a Global Navigation Satellite System (GLONASS), a BeiDou Navigation Satellite System (BDS), a Quasi-Zenith Satellite System (QZSS) and / or a Satellite Based Augmentation System (SBAS).

[0198] The terminal device 2200 implements the display function through a GPU, a display screen 2294, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 2294 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 2210 may include one or more GPUs, which execute program instructions to generate or change display information.

[0199] The display screen 2294 is used to display images, videos, etc. The display screen 2294 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light-emitting diode or an active matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLED, Micro-OLED, quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 2200 may include 1 or N display screens 2294, where N is a positive integer greater than 1.

[0200] The terminal device 2200 can realize the shooting function through ISP, camera 2293, video codec, GPU, display screen and application processor.

[0201] The ISP is used to process the data fed back by the camera 2293. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to the ISP for processing and converts it into an image visible to the naked eye. The ISP can also perform algorithm optimization on the noise, brightness, and chromaticity of the image. The ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP can be set in the camera 2293.

[0202] The camera 2293 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the terminal device 2200 may include 1 or N cameras 2293, where N is a positive integer greater than 1.

[0203] The digital signal processor is used to process digital signals. In addition to processing digital image signals, it can also process other digital signals. For example, when the terminal device 2200 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the frequency point energy.

[0204] The video codec is used to compress or decompress digital video. The terminal device 2200 may support one or more video codecs. Thus, the terminal device 2200 may play or record videos in various coding formats, such as Moving Picture Experts Group (MPEG) 1, MPEG2, MPEG22, MPEG4, etc.

[0205] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, applications such as intelligent cognition of the terminal device 2200 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.

[0206] The external memory interface 2220 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 2200. The external memory card communicates with the processor 2210 through the external memory interface 2220 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.

[0207] The internal memory 2221 can be used to store computer executable program codes, and the executable program codes include instructions. The processor 2210 executes various functional applications and data processing of the terminal device 2200 by running the instructions stored in the internal memory 2221. The memory 2221 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the terminal device 2200 (such as audio data, a phone book, etc.), etc. In addition, the memory 2221 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, other volatile solid-state storage devices, a universal flash memory (Universal Flash Storage, UFS), etc.

[0208] The terminal device 2200 can implement audio functions such as music playing and recording through the audio module 2270, the speaker 2270A, the receiver 2270B, the microphone 2270C, the earphone interface 2270D, and the application processor.

[0209] The audio module 2270 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal. The audio module 2270 can also be used to encode and decode audio signals. In some embodiments, the audio module 2270 can be arranged in the processor 2210, or some functional modules of the audio module 2270 can be arranged in the processor 2210.

[0210] The speaker 2270A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The terminal device 2200 can listen to music or listen to a hands-free call through the speaker 2270A.

[0211] The receiver 2270B, also called a "handset", is used to convert audio electrical signals into sound signals. When the terminal device 2200 receives a call or voice message, the voice can be received by placing the receiver 2270B close to the human ear.

[0212] Microphone 2270C, also called "microphone" or "microphone", is used to convert sound signals into audio electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 2270C with his mouth to input the sound signal into the microphone 2270C. The terminal device 2200 can be provided with at least one microphone 2270C. In some embodiments, the terminal device 2200 can be provided with two microphones 2270C, which can not only collect sound signals but also realize noise reduction function. In some embodiments, the terminal device 2200 can also be provided with three, four or more microphones 2270C to realize the collection of sound signals, noise reduction, identification of sound sources, realization of directional recording function, etc.

[0213] The earphone interface 2270D is used to connect a wired earphone and can be a USB interface, or a 3.5 mm Open Mobile Terminal Platform (OMTP) standard interface, or a Cellular Telecommunications Industry Association of the USA (CTIA) standard interface.

[0214] The key 2290 includes a power key, a volume key, etc. The key 2290 may be a mechanical key or a touch key. The terminal device 2200 receives the key 2290 input and generates a key signal input related to the user settings and function control of the terminal device 2200.

[0215] Motor 2291 can generate vibration prompts. Motor 2291 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. Touch operations acting on different areas of the display screen 2294 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0216] Indicator 2292 can be an indicator light, which can be used to indicate the charging status, power change, and can also be used to indicate messages, missed calls, notifications, etc.

[0217] The SIM card module 2295 is used to implement the communication function of the SIM card. The SIM card module 2295 may include a SIM card interface, a SIM card circuit and related auxiliary devices. The SIM card can be connected to and separated from the terminal device 2200 by inserting it into the SIM card interface or pulling it out from the SIM card interface. The terminal device 2200 can support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card module 2295 can support Nano SIM cards, Micro SIM cards, SIM cards, etc. Multiple cards can be inserted into the same SIM card interface at the same time. The types of multiple cards can be the same or different. The SIM card interface can also be compatible with different types of SIM cards. The SIM card interface can also be compatible with external memory cards. The terminal device 2200 interacts with the network through the SIM card to implement functions such as calls and data communications. In some embodiments, the terminal device 2200 uses an eSIM, i.e., an embedded SIM card. The eSIM card can be embedded in the terminal device 2200 and cannot be separated from the terminal device 2200.

[0218] The screenshot methods in the aforementioned embodiments can all be implemented in the terminal device 2200 having the aforementioned hardware structure.

[0219] An embodiment of the present application also provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes the folding screen-based screenshot method provided in the above embodiment.

[0220] An embodiment of the present application also provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the folding screen-based screenshot method provided in the above embodiment.

[0221] In summary, the terminal device, computer-readable storage medium, and computer program product containing instructions provided by the embodiments of the present application, in addition to obtaining the width and height of the main screen, also obtain the real-time position of the main screen when responding to a touch operation in the folded state. The base map is obtained according to the real-time position of the main screen, rather than directly using the upper left corner of the currently lit screen as the starting position to obtain the base map, which can effectively avoid errors in the base map and improve the accuracy of screenshots.

[0222] The specific implementation methods of the terminal device, computer-readable storage medium, and computer program product containing instructions provided in the embodiments of the present application and the technical effects brought about by them can be found in the specific implementation process of the screenshot method based on the folding screen provided in the aforementioned embodiments and the technical effects brought about by them, which will not be repeated here.

[0223] In some embodiments, through the description of the above implementation methods, technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the system, device and unit described above can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0224] Each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.

[0225] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk.

[0226] The above are only specific implementations of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited thereto, and any changes or replacements within the technical scope disclosed in the embodiments of the present application should be included in the protection scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application should be based on the protection scope of the claims.

Claims

1. A screenshot method based on a folding screen, characterized in that: Applied to a terminal device, the terminal device comprises a folding screen, and the folding screen can be folded to form a first screen and a second screen; After the folding screen is folded, the first screen and the second screen are facing each other and have opposite display directions; the method comprises: The folding screen displays a first interface, and receives a first operation acting on the folding screen; the first operation is used to instruct to capture a corresponding image in the first interface displayed on the folding screen; The folding screen is in a folded state, the main screen is turned on, and the back screen is turned on. In response to the first operation, a first parameter of the main screen is acquired; wherein the first parameter includes the width and height of the main screen and the real-time position of the main screen; the real-time position of the main screen is the position of the upper left corner of the main screen acted on by the first operation, and the real-time position is used to determine the starting position of the screenshot frame; the main screen is the first screen, and the second screen is the back screen; or, the main screen is the second screen, and the first screen is the back screen; Taking the real-time position of the main screen as the starting position and the width and height of the main screen as the screenshot frame, capturing the first image; A second image is displayed; wherein the second image is a screenshot corresponding to the first operation in the first image.

2. The screenshot method according to claim 1, characterized in that: After the step of receiving the first operation acting on the folding screen, the method further includes: In response to the first operation, the folding screen is in an unfolded state, and the width and height of the full screen of the folding screen are acquired; Starting from the upper left corner of the currently lit screen, a third image is captured with the width and height of the full screen as a screenshot frame; wherein, in the expanded state, the full screen is lit; A fourth image is displayed; wherein the fourth image is a screenshot corresponding to the first operation in the third image.

3. The screenshot method according to claim 2, characterized in that: In response to the first operation, the folding screen is in a folded state, and the step of acquiring a first parameter of the main screen includes: In response to the first operation, the folding screen is in a folded state, and determining whether the main screen and the back screen are lit at the same time; If the main screen and the back screen are turned on at the same time, the first parameter of the main screen is obtained.

4. The screenshot method according to claim 3, characterized in that: After the step of determining whether the main screen and the back screen are lit at the same time, the method further includes: If the main screen is on and the back screen is off, then the width and height of the main screen are obtained; Starting from the upper left corner of the currently lit screen, a fifth image is captured with the width and height of the main screen as the screenshot frame; A sixth image is displayed; wherein the sixth image is a screenshot corresponding to the first operation in the fifth image.

5. The screenshot method according to any one of claims 1 to 3, characterized in that: In response to the first operation, the folding screen is in a folded state, and the step of acquiring a first parameter of the main screen includes: In response to the first operation, the folding screen is in a folded state, and it is determined whether the folding screen is in a preset rotation state; wherein the preset rotation state refers to a state corresponding to a rotation of the folding screen by a preset angle relative to a reference posture; If the folding screen is in a preset rotation state, the first parameter of the main screen is obtained.

6. The screenshot method according to claim 5, characterized in that: After the step of determining whether the folding screen is in a preset rotation state, the method further includes: If the folding screen is not in the preset rotation state, obtaining the width and height of the main screen of the folding screen; Starting from the upper left corner of the currently lit screen, the seventh image is captured with the width and height of the main screen as the screenshot frame; An eighth image is displayed; wherein the eighth image is a screenshot corresponding to the first operation in the seventh image.

7. The screenshot method according to claim 5 or 6, characterized in that: The preset rotation angles include: 0° and 90°.

8. The screenshot method according to any one of claims 1 to 7, characterized in that: The first operation includes a knuckle tapping operation without removing the finger from the screen and a closed curve sliding operation.

9. The screenshot method according to claim 8, characterized in that: The terminal device includes an application layer, a framework layer, a hardware abstraction layer and a kernel layer; The framework layer input module, window management service, touch manager, display module, folding screen management module and folding screen management module, the hardware abstraction layer includes an interface module, a window controller and a system interface; The display module displays a first interface, and the input module receives a first operation acting on the folding screen; The display module obtains the width and height of the main screen, and the folding screen management module obtains the real-time position of the main screen and sends it to the touch manager; The haptic manager forwards the first parameter to the window controller; The window controller captures the first image according to the real-time position of the main screen and takes the width and height of the main screen as the screenshot frame, and sends the first image to the touch manager; The tactile manager sends the first parameter and the first image to the system interface; The system interface generates the second image according to the first image and the first operation; The display module displays the second image.

10. A terminal device, characterized in that: The invention comprises a folding screen, a memory and a processor; the folding screen can be folded to form a first screen and a second screen; after the folding screen is folded, the first screen and the second screen are opposite to each other and have opposite display directions; the folding screen and the memory are both coupled to the processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the terminal device executes the folding screen-based screenshot method as described in any one of claims 1 to 9.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, which, when executed on a computer, enables the computer to execute the folding screen-based screenshot method as claimed in any one of claims 1 to 9.

Citation Information

Patent Citations

  • Webpage screenshot method and device

    CN106610829A

  • Screenshot method and device and storage medium

    CN110389702A