Multi-window screen capture method, intelligent terminal and storage medium

Abstract

The invention provides a multi-window screen capture method, an intelligent terminal and a storage medium, and the method comprises the following steps: receiving a preset instruction under the condition that a screen displays at least two display regions; determining one or more display areas corresponding to the preset instruction as a to-be-screenshot window; and capturing pictures in the one or more windows to be subjected to screen capture, and generating one or more target screenshots. According to the method and the device, identification of the to-be-screenshot window in a multi-window scene is supported, so that the user can capture the content which the user wants to capture more quickly, the split-screen screenshot operation is more convenient, the interaction effect of the screenshot operation is improved, and the user experience is improved.

Description

Multi-window screenshot method, intelligent terminal and storage medium Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a multi-window screenshot method, a smart terminal, and a storage medium. Background Art

[0002] Currently, smart terminals are unable to perform window recognition and screenshot operations in multi-window scenarios such as split screen and small windows. In order to solve this problem, the existing solution obtains the number of split-screen applications and their positions in the split-screen state, and generates selected screenshot application options based on the position information of each application in the split-screen state. That is, screenshot options of multiple windows are obtained through conventional screenshot operations for users to choose from, so that users can obtain screenshot images of the selected application. The interaction path is long and the page presentation is more complicated, which increases the user's screenshot operation cost. Technical issues

[0003] In response to the above technical problems, the present application provides a multi-window screenshot method, a smart terminal and a storage medium, which allow users to select windows and take screenshots in a multi-window scenario with simple and convenient operation. Technical Solutions

[0004] To solve the above technical problems, the present application provides a multi-window screenshot method, wherein the method comprises the following steps:

[0005] S10: receiving a preset instruction when the screen displays at least two display areas;

[0006] S20: Determine one or more display areas corresponding to the preset instruction as windows to be captured;

[0007] S30: Capturing the images in one or more windows to be captured, and generating one or more target screenshots.

[0008] Optionally, the preset instruction includes a gesture motion operation on the screen;

[0009] The S20 includes:

[0010] S21: monitoring the motion trajectory of the gesture motion operation;

[0011] S22: The display area corresponding to the end point of the motion trajectory on the screen is used as a window to be captured.

[0012] Optionally, the step S30 includes:

[0013] S31: Determine a corresponding screenshot strategy according to the gesture change state of the end point;

[0014] S32: Capturing the images in one or more windows to be captured according to the capture strategy to generate one or more target screenshots.

[0015] Optionally, the S31 includes:

[0016] When the current gesture of the end point changes within a preset time period, the screenshot strategy is determined to capture the current moment screen.

[0017] Optionally, the S31 includes:

[0018] When the end point maintains the current gesture within the preset time period, the screenshot strategy is determined to take a long screenshot of the window to be screenshotted.

[0019] Optionally, the S22 includes:

[0020] If the end points of the motion trajectory correspond to at least two display areas on the screen, the minimum circumscribed rectangle of the display area corresponding to the end points is determined as the window to be captured.

[0021] Optionally, the S21 includes:

[0022] Using one or more display areas corresponding to the current position of the motion trajectory on the screen as real-time selection areas;

[0023] One or more of the real-time selected areas are highlighted.

[0024] Optionally, the preset instruction includes a contact instruction or a contactless instruction.

[0025] The present application also provides an intelligent terminal, comprising: a memory and a processor, wherein the memory stores a multi-window screenshot program, and when the multi-window screenshot program is executed by the processor, the steps of the above method are implemented.

[0026] The present application also provides a computer storage medium, wherein the computer storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the above method are implemented. Beneficial effects

[0027] As described above, the multi-window screenshot method of the present application includes: receiving a preset instruction when at least two display areas are displayed on the screen; determining one or more display areas corresponding to the preset instruction as windows to be screenshotted; capturing images in one or more windows to be screenshotted, and generating one or more target screenshots. Through the above technical solution, the multi-window screenshot function can be realized, solving the problem that current smart terminals are unable to perform window recognition and screenshot operations in multi-window scenarios such as split screen and small windows. The present application supports the identification of screenshot windows in multi-window scenarios, making it easier for users to screenshot the content they want to capture more quickly, thereby improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The accompanying drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for describing the embodiments. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without inventive work.

[0029] FIG1 is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application;

[0030] FIG2 is a diagram of a communication network system architecture provided by an embodiment of the present application;

[0031] FIG3 is a schematic flow chart of a multi-window screenshot method according to a first embodiment;

[0032] FIG4 is a first schematic diagram of a multi-window screenshot interface of a multi-window screenshot method according to the first embodiment;

[0033] FIG5 is a second schematic diagram of a multi-window screenshot interface of the multi-window screenshot method according to the first embodiment;

[0034] FIG6 is a schematic flow chart of a multi-window screenshot method according to a second embodiment;

[0035] FIG7 is a schematic flow chart of a multi-window screenshot method according to a third embodiment;

[0036] FIG8 is a schematic diagram of a first screenshot strategy of a multi-window screenshot method according to a third embodiment;

[0037] FIG9 is a schematic diagram of a second screenshot strategy of a multi-window screenshot method according to a third embodiment;

[0038] FIG10 is a schematic structural diagram of a multi-window screenshot device provided in an embodiment of the present application;

[0039] FIG11 is a schematic structural diagram of another mobile terminal provided in an embodiment of the present application;

[0040] FIG12 is a schematic diagram of the hardware structure of a controller 140 provided in an embodiment of the present application;

[0041] FIG13 is a schematic diagram of the hardware structure of a network node 150 provided in an embodiment of the present application.

[0042] The purpose of this application, its features, and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings. The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and the accompanying text are not intended to limit the scope of the present application in any way, but rather to illustrate the concepts of this application to those skilled in the art by reference to specific embodiments. Modes for Carrying Out the Invention

[0043] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all embodiments consistent with the present application. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present application, as detailed in the appended claims.

[0044] It should be noted that, in this document, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, components, features, and elements with the same name in different embodiments of the present application may have the same meaning or different meanings, and their specific meanings need to be determined based on their explanation in the specific embodiment or further combined with the context of the specific embodiment.

[0045] It should be understood that although the terms "first," "second," "third," etc. may be used herein to describe various information, such information should not be limited to these terms. These terms are used solely to distinguish information of the same type from one another. For example, without departing from the scope of this disclosure, first information may also be referred to as second information, and similarly, second information may also be referred to as first information. Depending on the context, the term "if," as used herein, may be interpreted as "upon," "when," or "in response to a determination." Furthermore, as used herein, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context indicates otherwise. It should be further understood that the terms "comprising" and "including" indicate the presence of the recited features, steps, operations, elements, components, items, types, and / or groups, but do not preclude the presence, occurrence, or addition of one or more other features, steps, operations, elements, components, items, types, and / or groups. The terms "or," "and / or," "including at least one of the following," etc., as used herein, may be interpreted as inclusive, meaning any one or any combination. For example, “comprising at least one of the following: A, B, C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”; and for another example, “A, B or C” or “A, B and / or C” means “any of the following: A; B; C; A and B; A and C; B and C; A and B and C”. An exception to this definition will occur only when a combination of elements, functions, steps or operations are inherently mutually exclusive in some manner.

[0046] It should be understood that, although the various steps in the flowchart in the embodiment of the present application are shown in sequence according to the indication of the arrows, these steps are not necessarily performed in sequence in the order indicated by the arrows. Unless clearly stated herein, the execution of these steps is not strictly limited in order, and they can be performed in other orders. Moreover, at least a portion of the steps in the figure may include multiple sub-steps or multiple stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and their execution order is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0047] As used herein, the words "if" and "if" may be interpreted as "at the time of" or "when" or "in response to determining" or "in response to detecting," depending on the context. Similarly, the phrases "if it is determined" or "if (stated condition or event) is detected" may be interpreted as "when it is determined" or "in response to the determination" or "when detecting (stated condition or event)" or "in response to detecting (stated condition or event)," depending on the context.

[0048] It should be noted that in this article, step codes such as S301 and S302 are used for the purpose of expressing the corresponding content more clearly and concisely, and do not constitute a substantial restriction on the order. When implementing the step, those skilled in the art may execute S302 first and then S301, etc., but these should all be within the scope of protection of this application.

[0049] It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application.

[0050] In the subsequent description, the use of suffixes such as "module", "component" or "unit" to represent elements is only for the purpose of facilitating the description of the present application and has no specific meaning. Therefore, "module", "component" or "unit" can be used interchangeably.

[0051] The camera device can be implemented in various forms. For example, the camera device described in this application may include mobile terminals with cameras, such as mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), navigation devices, wearable devices, smart bracelets, pedometers, etc., as well as fixed terminals with cameras, such as digital TVs and desktop computers.

[0052] The subsequent description will be made by taking a mobile terminal as an example. It will be understood by those skilled in the art that, in addition to components specifically used for mobile purposes, the configuration according to the embodiments of the present application can also be applied to fixed-type terminals.

[0053] Please refer to Figure 1, which is a schematic diagram of the hardware structure of a mobile terminal for implementing various embodiments of the present application, provided in an embodiment of the present application. The mobile terminal 100 may include components such as an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an A / V (Audio / Video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. Those skilled in the art will appreciate that the mobile terminal structure shown in Figure 1 does not limit the mobile terminal, and the mobile terminal may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0054] The following is a detailed introduction to the various components of the mobile terminal in conjunction with Figure 1:

[0055] The RF unit 101 can be used to send and receive information or receive signals during calls. Specifically, it receives downlink information from the base station and transmits it to the processor 110 for processing. It also transmits uplink data to the base station. Typically, the RF unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, and more. Furthermore, the RF unit 101 can communicate with the network and other devices via wireless communication. The above-mentioned wireless communications may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication), GPRS (General Packet Radio Service), CDMA2000 (Code Division Multiple Access 2000), WCDMA (Wideband Code Division Multiple Access), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access), FDD-LTE (Frequency Division Duplexing- Long Term Evolution) and TDD-LTE (Time Division Duplexing- Long Term Evolution), etc.

[0056] WiFi is a short-range wireless transmission technology. A mobile terminal, through WiFi module 102, enables users to send and receive emails, browse web pages, and access streaming media, providing wireless broadband Internet access. Although FIG1 illustrates WiFi module 102, it is understood that it is not a required component of the mobile terminal and can be omitted as needed without changing the essence of the application.

[0057] The audio output unit 103 can convert audio data received by the RF unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output it as sound when the mobile terminal 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Furthermore, the audio output unit 103 can also provide audio output related to a specific function performed by the mobile terminal 100 (e.g., a call signal reception sound, a message reception sound, etc.). The audio output unit 103 may include a speaker, a buzzer, or the like.

[0058] The A / V input unit 104 is used to receive audio or video signals. The A / V input unit 104 may include a graphics processing unit (GPU) 1041 and a microphone 1042. The GPU 1041 processes image data from still images or videos captured by an image capture device (such as a camera) in video capture mode or image capture mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the GPU 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the RF unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) in various operating modes, such as phone call mode, recording mode, and voice recognition mode, and process such sound into audio data. In phone call mode, the processed audio (voice) data may be converted into a format that can be transmitted to a mobile communication base station via the RF unit 101. The microphone 1042 may implement various noise cancellation (or suppression) algorithms to eliminate (or suppress) noise or interference generated during the reception and transmission of audio signals.

[0059] The mobile terminal 100 also includes at least one sensor 105, such as a light sensor, a motion sensor, or other sensors. Optionally, the light sensor includes an ambient light sensor and a proximity sensor. Optionally, the ambient light sensor can adjust the brightness of the display panel 1061 based on the brightness of the ambient light, and the proximity sensor can turn off the display panel 1061 and / or the backlight when the mobile terminal 100 is brought to your ear. An accelerometer, a type of motion sensor, can detect acceleration in all directions (typically three axes) and, when stationary, can detect the magnitude and direction of gravity. This can be used for applications that recognize the phone's posture (e.g., switching between landscape and portrait modes, related games, magnetometer posture calibration), vibration recognition-related functions (e.g., pedometer, tapping), and other functions. Other sensors that may be configured on a mobile phone, such as a fingerprint sensor, pressure sensor, iris sensor, molecular sensor, gyroscope, barometer, hygrometer, thermometer, infrared sensor, etc., are not described here.

[0060] The display unit 106 is used to display information input by the user or information provided to the user. The display unit 106 may include a display panel 1061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0061] The user input unit 107 can be used to receive input digital or character information and generate key signal input related to user settings and function control of the mobile terminal. Optionally, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also known as a touch screen, can detect user touch operations on or near it (for example, operations performed on or near the touch panel 1071 using a finger, stylus, or any other suitable object or accessory) and drive corresponding connected devices according to pre-set programs. The touch panel 1071 may include a touch detection device and a touch controller. Optionally, the touch detection device detects the user's touch position and detects signals generated by the touch operation, transmitting the signals to the touch controller. The touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 110. The touch controller can also receive and execute commands from the processor 110. Furthermore, the touch panel 1071 can be implemented using various types of sensors, including resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch panel 1071, the user input unit 107 may further include other input devices 1072. Optionally, the other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, power keys, etc.), a trackball, a mouse, a joystick, etc., and the specifics are not limited here.

[0062] Optionally, the touch panel 1071 may overlay the display panel 1061. When the touch panel 1071 detects a touch operation on or near it, it transmits the information to the processor 110 to determine the type of touch event. The processor 110 then provides a corresponding visual output on the display panel 1061 based on the type of touch event. Although in FIG1 , the touch panel 1071 and the display panel 1061 are shown as two separate components to implement the input and output functions of the mobile terminal, in some embodiments, the touch panel 1071 and the display panel 1061 may be integrated to implement the input and output functions of the mobile terminal, which is not limited to this specific embodiment.

[0063] The interface unit 108 serves as an interface through which at least one external device can be connected to the mobile terminal 100. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the mobile terminal 100 or may be used to transmit data between the mobile terminal 100 and an external device.

[0064] Memory 109 can be used to store software programs and various data. Memory 109 may primarily include a program storage area and a data storage area. Optionally, the program storage area may store an operating system and at least one application required for a function (such as sound playback or image playback); the data storage area may store data generated based on the use of the phone (such as audio data and a phone book). Memory 109 may also include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device.

[0065] Processor 110 is the control center of the mobile terminal, connecting all components of the mobile terminal using various interfaces and circuits. By running or executing software programs and / or modules stored in memory 109 and accessing data stored in memory 109, it executes various functions of the mobile terminal and processes data, thereby providing overall monitoring of the mobile terminal. Processor 110 may include one or more processing units; preferably, processor 110 may integrate an application processor and a modem processor. Optionally, the application processor primarily handles the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 110.

[0066] The mobile terminal 100 may further include a power supply 111 (such as a battery) for supplying power to various components. Preferably, the power supply 111 may be logically connected to the processor 110 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption.

[0067] Although not shown in FIG. 1 , the mobile terminal 100 may further include a Bluetooth module, etc., which will not be described in detail here.

[0068] To facilitate understanding of the embodiments of the present application, the communication network system on which the mobile terminal of the present application is based is described below.

[0069] Please refer to Figure 2, which is a communication network system architecture diagram provided in an embodiment of the present application. The communication network system is an LTE system of universal mobile communication technology. The LTE system includes a UE (User Equipment) 201, an E-UTRAN (Evolved UMTS Terrestrial Radio Access Network) 202, an EPC (Evolved Packet Core) 203 and an operator's IP service 204, which are connected in sequence.

[0070] Optionally, UE201 may be the above-mentioned mobile terminal 100, which will not be described in detail here.

[0071] E-UTRAN 202 includes eNodeB 2021 and other eNodeBs 2022 . Optionally, eNodeB 2021 may be connected to other eNodeBs 2022 via a backhaul (eg, an X2 interface). eNodeB 2021 is connected to EPC 203 , and eNodeB 2021 may provide UE 201 with access to EPC 203 .

[0072] The EPC 203 may include an MME (Mobility Management Entity) 2031, an HSS (Home Subscriber Server) 2032, other MMEs 2033, an SGW (Serving Gate Way) 2034, a PGW (PDN Gate Way) 2035, and a PCRF (Policy and Charging Rules Function) 2036. Optionally, the MME 2031 is a control node that processes signaling between the UE 201 and the EPC 203, providing bearer and connection management. The HSS 2032 provides registers for managing functions such as the Home Location Register (not shown) and stores user-specific information such as service features and data rates. All user data can be sent through SGW2034. PGW2035 can provide IP address allocation and other functions for UE 201. PCRF2036 is the policy and charging control policy decision point for service data flows and IP bearer resources. It selects and provides available policy and charging control decisions for the policy and charging execution function unit (not shown in the figure).

[0073] The IP service 204 may include the Internet, an intranet, an IMS (IP Multimedia Subsystem), or other IP services.

[0074] Although the above introduction takes the LTE system as an example, those skilled in the art should know that the present application is not only applicable to the LTE system, but also to other wireless communication systems, such as GSM, CDMA2000, WCDMA, TD-SCDMA and future new network systems, etc., which are not limited here.

[0075] Based on the above-mentioned mobile terminal hardware structure and communication network system, various embodiments of the present application are proposed.

[0076] An embodiment of the present invention provides a multi-window screenshot method. Referring to FIG. 3 , FIG. 3 is a schematic flow chart of the multi-window screenshot method according to the first embodiment.

[0077] In this embodiment, the multi-window screenshot method includes the following steps:

[0078] S10: When the screen displays at least two display areas, receiving a preset instruction.

[0079] It can be understood that the executor of this embodiment is a smart terminal, which can be a mobile phone, a foldable screen mobile phone, a tablet computer and other devices, or other devices with the same or similar functions. This embodiment does not limit this.

[0080] It should be noted that there are n display areas displayed in the current screen of the screen, where n ≥ 2. Each display area includes but is not limited to a split-screen window, a small window, a full-screen window, etc. The user inputs preset instructions through specific gestures, such as: long press and slide with one finger, multi-finger touch and slide, air gesture, etc. Specifically, the smart terminal recognizes the user gesture and determines whether the currently received instruction is a preset instruction. The specific gesture of three-finger touch and slide is used as an example for explanation: the smart terminal detects touch information, and when it recognizes that the number of fingers is three and the fingers are moving on the touch screen, it determines that a preset instruction has been received.

[0081] S20: Determine one or more display areas corresponding to the preset instruction as windows to be captured.

[0082] It should be understood that the selection range corresponding to the preset instruction is identified, and one or more display areas covered by the selection range are determined as the windows to be captured. Specifically, it is determined whether there is any overlap between the selection range and the display range of the current display area. If there is an overlap, the current display area is selected as the window to be captured, where the current display area is any display area currently displayed.

[0083] Optionally, the preset instruction includes a contact instruction or a contactless instruction.

[0084] It should be understood that the example of the preset instruction being a contact instruction is used for explanation: the contact hot zone of the preset instruction is determined, the selection range is determined based on the contact hot zone, and one or more display areas covered by the selection range are determined as the window to be captured. If the preset instruction is a sliding instruction, optionally, the contact hot zone of the initial trigger point of the preset instruction is analyzed as the selection range; optionally, the contact hot zone of the end point of the sliding of the preset instruction is analyzed as the selection range; optionally, the contact hot zone at each moment of the sliding process is monitored, and the contact hot zones at each moment are merged as the selection range. Specifically, the contact hot zone includes the contact range of the touch screen when the user triggers the preset instruction.

[0085] It should be noted that the preset instruction is a contactless instruction as an example for explanation: identify the current outline of the hand in the field of view, analyze whether the current outline matches the preset outline, and if so, determine that the preset instruction has been received, analyze the finger area according to the current outline, determine the selection range according to the finger area, and determine one or more display areas covered by the selection range as the window to be captured. Optionally, locate the center position of the finger area, determine the projection position of the center position on the touch screen, and the smart terminal determines the selection range according to a specific size and specific graphic with the projection position as the center; optionally, determine the gesture distance, project the finger area onto the touch screen according to the gesture distance, and use the projection area as the selection range.

[0086] S30: Capturing the images in one or more windows to be captured, and generating one or more target screenshots.

[0087] It should be noted that, optionally, screenshots are taken of the images currently displayed in multiple windows to be screenshotted, and multiple target screenshots are generated simultaneously, thereby avoiding inaccurate screenshot information caused by the underlying window image being blocked by the surface window image. Optionally, the images currently displayed in multiple screenshot windows are captured as the same screenshot.

[0088] The following example illustrates the multi-window screenshot method proposed in this embodiment:

[0089] As shown in Figure 4, Figure 4 is a first schematic diagram of a multi-window screenshot interface of a multi-window screenshot method according to the first embodiment; the smart terminal is in a split-screen scenario, and the screen currently displays two display areas, a left split screen and a right split screen. The preset instruction is triggered by three-finger touch and sliding. If the left split screen is selected by the three-finger contact hot area, the target window is identified as the left split screen window. If the right split screen is selected by the three-finger contact hot area, the target window is identified as the right split screen window. If the left split screen and the right split screen are selected by the three-finger contact hot area, the target windows are identified as the left split screen window and the right split screen window. The identified target windows are highlighted and the other areas are displayed as a mask; the motion trajectory of the three fingers sliding down is monitored, and the three-finger contact hot area is continuously identified during the sliding process. If the target window identified by the three-finger contact hot area changes during the sliding process, the changed target window is highlighted in real time; the three-finger sliding stop signal is identified, the end point of the motion trajectory is determined, and the target window selected by the three-finger contact hot area at the end point is the window to be screenshotted; the screen in the window to be screenshotted is captured to generate a target screenshot.

[0090] As shown in Figure 5, Figure 5 is a second schematic diagram of the multi-window screenshot interface of the multi-window screenshot method according to the first embodiment; the smart terminal screen currently displays two display areas, a full-screen image and a small window image, and the preset instruction is triggered by three-finger touch and sliding. If the small window image is selected by the three-finger contact hot area, the target window is identified as the small window window; if the full-screen image is selected by the three-finger contact hot area, the target window is identified as the full-screen window; if the full-screen image and the small window image are selected by the three-finger contact hot area, the target windows are identified as the full-screen window and the small window window, and the identified target windows are highlighted, and other areas are displayed as a mask; the motion trajectory of the three fingers sliding down is monitored, and the three-finger contact hot area is continuously identified during the sliding process. If the target window identified by the three-finger contact hot area changes during the sliding process, the changed target window is highlighted in real time; the three-finger sliding stop signal is identified, the end point of the motion trajectory is determined, and the target window selected by the three-finger contact hot area at the end point is the window to be screenshotted; the picture in the window to be screenshotted is captured to generate a target screenshot.

[0091] The smart terminal screen currently displays three display areas: left split screen, right split screen and small window screen. The preset command is triggered by hovering two fingers, identifying the finger area of ​​the two fingers, locating the center position of the finger area, and determining the projection position of the center position on the touch screen. With the projection position as the center, the selection range is determined according to a specific size and specific graphic, and one or more windows to be captured that overlap with the selection range are determined. The screen in the window to be captured is captured to generate a target screenshot.

[0092] In this embodiment, when the screen displays at least two display areas, a preset instruction is received; one or more display areas corresponding to the preset instruction are determined as windows to be captured; the images in one or more windows to be captured are captured, and one or more target screenshots are generated. Through the above method, the multi-window screenshot function is implemented, solving the problem that current smart terminals cannot perform window recognition and screenshot operations in multi-window scenarios such as split screen and small windows. This application supports the recognition of screenshot windows in multi-window scenarios, making it easier for users to capture the content they want to capture, thereby improving the user experience.

[0093] Refer to FIG6 , which is a flowchart of a multi-window screenshot method according to a second embodiment.

[0094] Based on the first embodiment above, the preset instruction in the multi-window screenshot method of this embodiment includes a gesture motion operation on the screen;

[0095] The S20 includes:

[0096] S21: Monitoring the motion trajectory of the gesture motion operation.

[0097] It should be understood that if the preset command is a contact command, the motion trajectory is the trajectory generated when the user maintains contact with the touch screen by sliding on the touch screen using a specific gesture, such as three-finger touch and swipe up, three-finger touch and swipe down, etc. If the preset command is a contactless command, the motion trajectory is the trajectory projected on the touch screen when the user moves over the touch screen using a specific gesture.

[0098] S22: The display area corresponding to the end point of the motion trajectory on the screen is used as a window to be captured.

[0099] Optionally, when it is detected that the preset instruction input by the user disappears, the end point of the motion track is formed on the screen. Optionally, when it is detected that the user maintains contact with the touch screen and remains stationary for more than a preset time threshold, the end point of the motion track is formed on the screen.

[0100] It should be noted that, if the preset instruction is a contact instruction, the touch area where the preset instruction contacts the touch screen at the end point is determined, and the corresponding display area is determined as the window to be captured based on the touch area.

[0101] Optionally, the touch area is used as the selection range. Taking three-finger touch and slide as an example, m touch areas generated by the three fingers contacting the touch screen are determined, where 1≤m≤3, and one or more display areas covered by the m touch areas are determined as the windows to be captured, and the screenshot operation is performed.

[0102] Optionally, obtain contact hot zone template data of multiple different size ranges, select target contact hot zone template data whose size range includes the touch area, generate a selection range on the screen according to the target contact hot zone template data, determine one or more display areas covered by the selection range as the window to be captured, and perform a screenshot operation.

[0103] Optionally, the center position of the touch area is determined, and based on the center position, a selection range is determined according to a preset template, one or more display areas covered by the selection range are determined as windows to be captured, and a screenshot operation is performed.

[0104] Optionally, in order to avoid window selection errors caused by the dispersion of multiple projection areas, if the preset instruction has multiple touch areas in contact with the touch screen at the end point, the minimum bounding rectangle of any two adjacent touch areas is determined, and the corresponding selection range is determined based on one or more minimum bounding rectangles. The one or more display areas covered by the selection range are determined as the windows to be captured, and the screenshot operation is performed. In a specific implementation, the contour data of the touch area is detected, and multiple contour graphics are generated. The minimum bounding rectangle of any two adjacent contour graphics is analyzed using a pre-built network model, and the range union of one or more minimum bounding rectangles is determined as the selection range. Taking three-finger touch and slide as an example, if three touch areas are generated by three fingers contacting the touch screen, they are recorded as touch area 1, touch area 2, and touch area 3, where touch area 1 is adjacent to touch area 2, and touch area 2 is adjacent to touch area 3, the minimum bounding rectangle A of touch area 1 and touch area 2 is determined, the minimum bounding rectangle B of touch area 2 and touch area 3 is determined, and the range union of the minimum bounding rectangle A and the minimum bounding rectangle B is determined as the selection range.

[0105] Furthermore, the step S22 includes: if the end point of the motion trajectory corresponds to at least two display areas on the screen, determining the minimum circumscribed rectangle of the display area corresponding to the end point as the window to be captured.

[0106] It should be understood that in this embodiment, when performing a screenshot operation, if the end point corresponds to at least two display areas on the screen, for example, the preset instruction selects the left split screen window, small window 1 and small window 2 at the end point, determines the display frame positions of multiple display areas, and uses a pre-built network model to analyze the minimum enclosing rectangle of the multiple display frame positions, captures the current moment picture within the minimum enclosing rectangle on the screen, and obtains the target screenshot.

[0107] Furthermore, in order to facilitate the user to select the screenshot window and meet the screenshot window selection requirements, the S21 includes: using one or more display areas corresponding to the current position of the motion trajectory on the screen as real-time selection areas; and highlighting one or more of the real-time selection areas.

[0108] It should be noted that when a user swipes on the touchscreen using a specific gesture, the touchscreen identifies the preset real-time selection range and determines the real-time selection area that overlaps with the real-time selection range. This identified real-time selection area is then highlighted, while the rest of the screen is masked. If the selected display area changes during the swipe signal, the changed display area is highlighted.

[0109] In this embodiment, when the screen displays at least two display areas, a preset instruction is received; the motion trajectory of the gesture movement operation is monitored; the display area on the screen corresponding to the end point of the motion trajectory is used as the window to be captured; the image in one or more windows to be captured is captured, and one or more target screenshots are generated. By monitoring the motion trajectory of the gesture movement operation and selecting the window to be captured in the above manner, the screenshot window identification and multi-window screenshot function are realized in a multi-window scenario, allowing users to more quickly capture the content they want to capture.

[0110] 7 , which is a schematic flow chart of a multi-window screenshot method according to a third embodiment.

[0111] Based on the above second embodiment, the step S30 of the multi-window screenshot method of this embodiment includes:

[0112] S31: Determine a corresponding screenshot strategy according to the gesture change state of the end point.

[0113] It should be understood that gesture change states include gesture change and gesture hold. Specifically, a gesture change is determined when the preset user input command disappears at the end point of the motion trajectory, and a gesture hold is determined when the user remains in contact with the touch screen and remains stationary for more than a preset time threshold at the end point of the motion trajectory.

[0114] S32: Capturing the images in one or more windows to be captured according to the capture strategy to generate one or more target screenshots.

[0115] It should be noted that different screenshot strategies are set for different gesture change states. Optionally, screenshot strategies include: capturing the current screen (regular screenshot strategy), long screenshot strategy, screen recording strategy, and so on. In the specific implementation, a mapping relationship is set between gesture change states and screenshot strategies. After identifying the gesture change state in the current scenario, the mapping relationship is queried to determine the corresponding screenshot strategy.

[0116] Optionally, when the screenshot strategy is a regular screenshot strategy, the current screen of one or more selected windows to be screenshotted is captured. Optionally, when the screenshot strategy is a long screenshot strategy, the screen of one or more selected windows to be screenshotted is scrolled according to the default scroll-down instruction or the sliding instruction input by the user, and the scrolled content is processed as a long screenshot to generate a target screenshot. Optionally, when the screenshot strategy is a screen recording strategy, the screen displayed in one or more windows to be screenshotted within a certain period of time is recorded to generate a target screenshot.

[0117] Optionally, the S31 includes: when the current gesture of the end point changes within a preset time period, the screenshot strategy is confirmed to capture the current moment screen.

[0118] It should be noted that the preset time period is a system parameter set in advance, which serves as a reference value for identifying whether the gesture at the end point has changed. For example, the preset time period is a1 to a4, the duration for which the user's finger remains stationary at the end point is b, and then leaves the screen, and b is less than a4-a1, then it is determined that the current gesture at the end point has changed within the preset time period, and the duration for which the user's finger remains stationary at the end point is c, and c is greater than a4-a1, then it is determined that the end point maintains the current gesture. When the gesture change state is gesture change, the corresponding screenshot strategy is the regular screenshot strategy. If the user's finger leaves the touch screen within the preset time period to generate a gesture change, the screenshot strategy is determined to be the regular screenshot strategy, and the current moment screen in one or more windows to be screenshotted is captured to generate the target screenshot. Referring to Figure 8, Figure 8 is a schematic diagram of the first screenshot strategy of the multi-window screenshot method according to the third embodiment; under the conventional screenshot strategy, the smart terminal captures the current screen and temporarily displays the screenshot at a preset position, which is the lower left corner of the screen in Figure 8. During the temporary display of the screenshot, if the user clicks on the screenshot display area in Figure 8, the captured target screenshot will be displayed.

[0119] Optionally, the S31 includes: when the end point maintains the current gesture within a preset time period, the screenshot strategy is confirmed to be a long screenshot of the window to be screenshotted.

[0120] The occurrence category of the sliding stop signal includes a preset instruction to keep still category;

[0121] The S303 includes: receiving a sliding instruction according to the screenshot strategy; scrolling the images in the one or more windows to be screenshotted in response to the sliding instruction; and capturing the scrolling displayed images in the one or more windows to be screenshotted to generate a target screenshot.

[0122] It should be understood that when the gesture change state is gesture hold, the corresponding screenshot strategy is a long screenshot strategy, that is, when the user inputs a preset instruction and remains stationary for more than a preset time threshold, the screenshot strategy is determined to be a long screenshot strategy. Long screenshot refers to scrolling and displaying the images in one or more windows to be screenshotted in response to a sliding instruction, and performing long screenshot processing on the scrolled displayed content. Referring to Figure 9, Figure 9 is a schematic diagram of the second screenshot strategy of the multi-window screenshot method according to the third embodiment; under the long screenshot strategy, the smart terminal scrolls and displays the images in one or more windows to be screenshotted in response to the sliding instruction input by the user, and performs long screenshot processing. The sliding instruction includes an up-swipe instruction and a down-swipe instruction, as shown in Figure 9. A confirmation button and a cancel button are also provided in the long screenshot processing mode. When the user clicks the confirmation button, the long screenshot operation is completed and the target screenshot is generated. When the user clicks the cancel button, the long screenshot processing mode is exited, thereby avoiding long screenshot misoperation.

[0123] In this embodiment, when the screen displays at least two display areas, a preset instruction is received; the motion trajectory of the gesture motion operation is monitored; the display area corresponding to the end point of the motion trajectory on the screen is used as the window to be screenshotted; the corresponding screenshot strategy is determined according to the gesture change state of the end point; the images in one or more windows to be screenshotted are captured according to the screenshot strategy, and one or more target screenshots are generated. Through the above method, the screenshot window is identified in a multi-window scenario, and different screenshot strategies are selected according to the gesture change state of the end point. This solves the problem that the current smart terminal only performs a single screenshot operation in response to a gesture, and achieves the effect of executing different screenshot strategies in response to the same preset instruction, making it convenient for users to select a screenshot strategy according to the gesture change state of the end point, thereby capturing the content they want to capture, meeting the user's screenshot needs, and thus improving the user experience.

[0124] Please refer to Figure 10, which is a structural diagram of a multi-window screenshot device provided in an embodiment of the present application. The device can be mounted on the shooting device in the above method embodiment, and the device can specifically be a server. Optionally, in some embodiments, it can also be mounted on a shooting device, and the shooting device includes a first camera and a second camera, and the field of view angle of the first camera is smaller than the field of view angle of the second camera. The multi-window screenshot device shown in Figure 10 can be used to perform some or all of the functions in the method embodiments described in Figures 3, 6 and 7 above. The detailed description of each module is as follows:

[0125] The receiving unit 1101 is configured to receive a preset instruction when the screen displays at least two display areas;

[0126] The processing unit 1102 is configured to determine one or more display areas corresponding to the preset instruction as windows to be captured;

[0127] The processing unit 1102 is further configured to capture images in one or more windows to be captured, and generate one or more target screenshots.

[0128] In an optional embodiment, the preset instruction includes a gesture motion operation on the screen;

[0129] The processing unit 1102 is specifically configured to monitor the motion trajectory of the gesture motion operation; and use the display area corresponding to the end point of the motion trajectory on the screen as a window to be captured.

[0130] In an optional embodiment, the processing unit 1102 is specifically configured to determine a corresponding screenshot strategy according to the gesture change state of the end point; capture images in one or more windows to be screenshotted according to the screenshot strategy, and generate one or more target screenshots.

[0131] In an optional implementation, the processing unit 1102 is specifically configured to, when the current gesture at the end point changes within a preset time period, determine the screenshot strategy as capturing the current moment screen.

[0132] In an optional implementation, the processing unit 1102 is specifically configured to, when the end point maintains the current gesture within a preset time period, determine the screenshot strategy as taking a long screenshot of the window to be screenshotted.

[0133] In an optional embodiment, the processing unit 1102 is specifically configured to determine the minimum circumscribed rectangle of the display area corresponding to the end point as the window to be captured if there are at least two display areas corresponding to the end points of the motion trajectory on the screen.

[0134] In an optional embodiment, the processing unit 1102 is specifically configured to use one or more display areas corresponding to the current position of the motion trajectory on the screen as real-time selected areas; and highlight one or more of the real-time selected areas.

[0135] In an optional implementation, the preset instruction includes a contact instruction or a contactless instruction.

[0136] According to one embodiment of the present application, some of the steps involved in the multi-window screenshot method shown in Figures 3, 6 and 7 can be performed by the various modules in the multi-window screenshot device shown in Figure 10. The various units in the multi-window screenshot device shown in Figure 10 can be individually or completely merged into one or several other modules to form a composition, or one (or some) of the modules can be further divided into multiple functionally smaller units to form a composition, which can achieve the same operation without affecting the realization of the technical effects of the embodiments of the present application. The above-mentioned units are divided based on logical functions. In actual applications, the functions of one module can also be implemented by multiple modules, or the functions of multiple modules can be implemented by one module. In other embodiments of the present application, the multi-window screenshot device may also include other modules. In actual applications, these functions can also be implemented with the assistance of other modules, and can be implemented by the collaboration of multiple modules.

[0137] Please refer to Figure 11, which is a schematic diagram of the structure of another camera device provided in an embodiment of the present application. The present application also provides a mobile terminal, comprising a memory 1201, a processor 1202, and a multi-window screenshot program stored in the memory 1201 and executable on the processor 1202. When the multi-window screenshot program is executed by the processor, the steps of the multi-window screenshot method described in any of the above embodiments are implemented.

[0138] The present application also provides a computer-readable storage medium, on which a multi-window screenshot program is stored. When the multi-window screenshot program is executed by a processor, the steps of the multi-window screenshot method in any of the above embodiments are implemented.

[0139] In the embodiments of the mobile terminal and computer-readable storage medium provided in this application, all technical features of the above-mentioned embodiments of the multi-window screenshot method are included. The expansion and explanation content of the specification are basically the same as those of the above-mentioned embodiments of the call note method, and will not be repeated here.

[0140] An embodiment of the present application further provides a computer program product, which includes computer program code. When the computer program code runs on a computer, the computer executes the methods in the various possible implementation modes described above.

[0141] An embodiment of the present application also provides a chip, including a memory and a processor, wherein the memory is used to store computer programs, and the processor is used to call and run the computer programs from the memory, so that a device equipped with the chip executes the methods in the various possible implementation modes as described above.

[0142] The embodiment of the present application also provides a computer module for executing the methods in the various possible implementation modes described above.

[0143] A computing device generally includes a processor and a memory. The memory is used to store instructions. When the instructions are executed by the processor, the computing device executes the steps or program modules of the present invention.

[0144] FIG12 is a schematic diagram of the hardware structure of a controller 140 provided in this application. The controller 140 includes a memory 1401 and a processor 1402. The memory 1401 is used to store program instructions, and the processor 1402 is used to call the program instructions in the memory 1401 to execute the steps performed by the controller in the above method embodiment. The implementation principles and beneficial effects are similar and will not be repeated here.

[0145] Optionally, the controller further includes a communication interface 1403, which can be connected to the processor 1402 via a bus 1404. The processor 1402 can control the communication interface 1403 to implement the receiving and sending functions of the controller 140.

[0146] Figure 13 is a schematic diagram of the hardware structure of a network node 150 provided in this application. The network node 150 includes a memory 1501 and a processor 1502. The memory 1501 is used to store program instructions, and the processor 1502 is used to call the program instructions in the memory 1501 to execute the steps performed by the first node in the above method embodiment. The implementation principles and beneficial effects are similar and will not be repeated here.

[0147] Optionally, the network node further includes a communication interface 1503, which can be connected to the processor 1502 via a bus 1504. The processor 1502 can control the communication interface 1503 to implement the receiving and sending functions of the network node 150.

[0148] The integrated modules implemented in the form of software function modules can be stored in a computer-readable storage medium. The software function modules stored in a storage medium include a number of instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) or a processor to execute some of the steps of the methods of various embodiments of the present application.

[0149] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When software is used for implementation, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function according to the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrations. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state drive solid state disk, SSD), etc.

[0150] The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0151] In this application, the same or similar terminology, technical solutions and / or application scenario descriptions are generally only described in detail the first time they appear. When they appear again later, they are generally not repeated for the sake of brevity. When understanding the technical solutions and other contents of this application, for the same or similar terminology, technical solutions and / or application scenario descriptions that are not described in detail later, you can refer to the previous relevant detailed descriptions.

[0152] In this application, the description of each embodiment has its own focus. For parts that are not described or recorded in detail in a certain embodiment, please refer to the relevant description of other embodiments.

[0153] The various technical features of the technical solution of this application can be combined arbitrarily. In order to make the description concise, not all possible combinations of the various technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0154] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as mentioned above, and includes a number of instructions for enabling a terminal device (which can be a mobile phone, computer, server, controlled terminal, or network device, etc.) to execute the method of each embodiment of the present application.

[0155] The above are only preferred embodiments of the present application and do not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A multi-window screenshot method, wherein: The method comprises the following steps: S10: receiving a preset instruction when the screen displays at least two display areas; S20: Determine one or more display areas corresponding to the preset instruction as windows to be captured; S30: Capturing the images in one or more windows to be captured, and generating one or more target screenshots.

2. The multi-window screenshot method according to claim 1, wherein: The preset instruction includes a gesture motion operation for the screen; The S20 includes: S21: monitoring the motion trajectory of the gesture motion operation; S22: The display area corresponding to the end point of the motion trajectory on the screen is used as a window to be captured.

3. The multi-window screenshot method according to claim 2, wherein: The S30 includes: S31: Determine a corresponding screenshot strategy according to the gesture change state of the end point; S32: Capturing the images in one or more windows to be captured according to the capture strategy to generate one or more target screenshots.

4. The multi-window screenshot method according to claim 3, wherein: Said S31 comprises: When the current gesture of the end point changes within a preset time period, the screenshot strategy is determined to capture the current moment screen.

5. The multi-window screenshot method according to claim 3, wherein: Said S31 comprises: When the end point maintains the current gesture within the preset time period, the screenshot strategy is determined to take a long screenshot of the window to be screenshotted.

6. The multi-window screenshot method according to claim 2, wherein: Said S22 comprises: If the end points of the motion trajectory correspond to at least two display areas on the screen, the minimum circumscribed rectangle of the display area corresponding to the end points is determined as the window to be captured.

7. The multi-window screenshot method according to claim 2, wherein: Said S21 comprises: Using one or more display areas corresponding to the current position of the motion trajectory on the screen as real-time selection areas; One or more of the real-time selected areas are highlighted.

8. The multi-window screenshot method according to any one of claims 1 to 7, wherein: The preset instruction includes a contact instruction or a contactless instruction.

9. An intelligent terminal, wherein: The smart terminal includes: a memory and a processor, wherein a multi-window screenshot program is stored in the memory, and when the multi-window screenshot program is executed by the processor, the steps of the multi-window screenshot method according to any one of claims 1 to 8 are implemented.

10. A readable storage medium, wherein: The readable storage medium stores a computer program, which, when executed by a processor, implements the steps of the multi-window screenshot method according to any one of claims 1 to 8.

Images