Screenshot processing method and device, electronic device and computer readable medium
By identifying the current picture in contour and combining user operations, the screenshot area is dynamically determined, which solves the problems of cumbersome and inaccurate screenshot operations in the prior art, and achieves more efficient and accurate screenshot processing.
Patent Information
- Application Number
- CN202210397260.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-04-15
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2042-04-15
AI Technical Summary
In the prior art, screenshot operation steps are complicated, and it is difficult to quickly obtain images that meet users' expectations, and it is impossible to accurately select specific content.
By contour recognition of the current screen, candidate intercepting areas are determined, and combined with the user's screenshot operation, the target intercepting areas are dynamically determined to perform screenshot operations.
It improves the efficiency and accuracy of screenshot processing, reduces operation complexity, and makes it easier for users to obtain screenshot results that meet expectations.
Smart Images

Figure CN114708443B_ABST
Abstract
Description
Background Art
[0002] Terminal devices are usually able to implement multiple functions to meet the needs of users. When using terminal devices, users often need to save the content they are interested in in the terminal devices, such as saving images or texts by taking screenshots. However, in the related art, capturing screen content according to the user's screenshot operation instruction not only requires many operation steps, but also fails to quickly obtain images that meet the user's expectations, which is very inconvenient in practical applications. Summary of the invention
[0003] The purpose of the present disclosure is to provide a screenshot processing method, a screenshot processing device, an electronic device and a computer-readable medium, thereby improving the screenshot processing efficiency and the screenshot accuracy at least to a certain extent.
[0004] According to a first aspect of the present disclosure, a screenshot processing method is provided, comprising: performing contour recognition on a current picture to determine a candidate screenshot area according to the obtained contour recognition result; in response to a screenshot operation, determining at least one target screenshot area in the current picture according to the screenshot operation and the candidate screenshot area; and performing a screenshot operation in the current picture based on the at least one target screenshot area.
[0005] According to a second aspect of the present disclosure, a screenshot processing device is provided, comprising: an image recognition module, used to perform contour recognition on a current picture to determine a candidate capture area according to the obtained contour recognition result; an area determination module, used to respond to a screenshot operation, and determine at least one target capture area in the current picture according to the screenshot operation and the candidate capture area; and an image processing module, used to perform a screenshot operation in the current picture based on the at least one target capture area.
[0006] According to a third aspect of the present disclosure, an electronic device is provided, characterized in that it includes: a processor; and a memory for storing one or more programs, which enables the one or more processors to implement the above method when the one or more programs are executed by the one or more processors.
[0007] According to a fourth aspect of the present disclosure, a computer-readable medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the above method is implemented.
[0008] The screenshot processing method provided by the embodiment of the present disclosure performs contour recognition on the current screen, and determines the candidate capture area in the current screen according to the contour recognition result, and then responds to the screenshot operation, determines at least one target capture area in the current screen according to the screenshot operation and the candidate capture area, so as to perform the screenshot operation in the current screen according to the at least one target capture area, so as to capture the target image from the current screen. On the one hand, before the user performs the screenshot operation, the candidate capture area on which the screenshot operation can be performed is first provided for the user to select and refer to, so as to quickly determine the screenshot range and perform the screenshot operation, which not only enriches the screenshot method of the current screen, but also reduces the cumbersomeness of the screenshot operation, and the screenshot operation is efficient; on the other hand, the target capture area is determined by combining the candidate capture area and the screenshot operation, and the user's screenshot operation intention is also integrated into the determination process of the target capture area, so that it is easier to obtain a screenshot result that meets the user's expectations.
[0009] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS
[0010] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present disclosure, and together with the specification, are used to explain the principles of the present disclosure. Obviously, the drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:
[0011] Figure 1 A schematic diagram showing an exemplary system architecture to which embodiments of the present disclosure may be applied;
[0012] Figure 2 A flowchart schematically illustrates a screenshot processing method in an exemplary embodiment of the present disclosure;
[0013] Figure 3 A schematic diagram schematically shows a display mode of a current screen in an exemplary embodiment of the present disclosure;
[0014] Figure 4 A schematic diagram schematically shows another display mode of the current screen in an exemplary embodiment of the present disclosure;
[0015] Figure 5 A schematic diagram schematically illustrates a method of determining a candidate clipping area according to a contour recognition result of a current picture in an exemplary embodiment of the present disclosure;
[0016] Figure 6 A schematic diagram schematically illustrates a generated target image in an exemplary embodiment of the present disclosure;
[0017] Figure 7 A schematic diagram schematically illustrates another generated target image in an exemplary embodiment of the present disclosure;
[0018] Figure 8 A flowchart for screening candidate clipping regions in an exemplary embodiment of the present disclosure is schematically shown;
[0019] Fig. 9 A schematic diagram of a terminal interface after entering a screenshot mode in an exemplary embodiment of the present disclosure is schematically shown;
[0020] Fig.10 A schematic diagram schematically shows a result of screening candidate interception areas in an exemplary embodiment of the present disclosure;
[0021] Fig.11 A flowchart schematically illustrates an implementation method of determining a target interception area in an exemplary embodiment of the present disclosure;
[0022] Fig.12 A schematic diagram schematically shows a method of determining a target clipping area from a candidate clipping area according to a screenshot operation and candidate clipping areas in an exemplary embodiment of the present disclosure;
[0023] Fig.13 A schematic diagram schematically illustrates a method of simultaneously selecting multiple candidate clipping regions in an exemplary embodiment of the present disclosure;
[0024] Fig.14 A schematic diagram schematically illustrates an implementation method of completing a target interception area in an exemplary embodiment of the present disclosure;
[0025] Fig.15 A schematic diagram schematically illustrates another implementation method of completing a target interception area in an exemplary embodiment of the present disclosure;
[0026] Fig.16 A schematic diagram schematically shows a method of determining a target interception area by combining a target trajectory shape corresponding to a target similarity in an exemplary embodiment of the present disclosure;
[0027] Fig.17 A schematic diagram schematically shows the composition of a screenshot processing device in an exemplary embodiment of the present disclosure;
[0028] Fig.18 A schematic diagram of an electronic device to which the embodiments of the present disclosure can be applied is shown. DETAILED DESCRIPTION
[0029] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that the disclosure will be more comprehensive and complete and to fully convey the concepts of the example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
[0030] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or implemented in one or more hardware modules or integrated circuits, or implemented in different networks and / or processor devices and / or microcontroller devices.
[0031] Figure 1 A schematic diagram of a system architecture of an exemplary application environment to which a screenshot processing method and device according to an embodiment of the present disclosure can be applied is shown. In the following description, "user terminal", "mobile terminal" and "terminal" can be used interchangeably.
[0032] like Figure 1 As shown, the system architecture 100 may include one or more of terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is used to provide a medium for communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links or optical fiber cables, etc. The terminal devices 101, 102, 103 may be various electronic devices with image processing functions, including but not limited to desktop computers, portable computers, smart phones, tablet computers, etc. It should be understood that Figure 1 The number of terminal devices, networks and servers in the embodiment is only for illustration. According to the implementation requirements, there may be any number of terminal devices, networks and servers. For example, the server 105 may be a server cluster composed of multiple servers.
[0033] The screenshot processing method provided in the embodiment of the present disclosure is generally executed by the terminal devices 101, 102, and 103, and accordingly, the screenshot processing device is generally disposed in the terminal devices 101, 102, and 103. However, it is easy for those skilled in the art to understand that the screenshot processing method provided in the embodiment of the present disclosure can also be executed by the server 105, and accordingly, the screenshot processing device can also be disposed in the server 105, which is not particularly limited in the present exemplary embodiment. For example, in an exemplary embodiment, a user may capture the current screen through an image collector for capturing screens included in terminal devices 101, 102, and 103, and then upload the current screen to server 105. Server 105 performs contour recognition on the current screen through the screenshot processing method provided in the embodiment of the present disclosure, and determines candidate capture areas based on the obtained contour recognition results and provides them to terminal devices 101, 102, and 103. Then, in response to the screenshot operation, at least one target capture area is determined based on the candidate capture areas and the screenshot operation, so as to perform a screenshot operation in the current screen according to the at least one target capture area, capture a target image from the current screen, and send the target image to terminal devices 101, 102, 103, etc.
[0034] In the related art, when the user enters the screenshot mode, the user first triggers the screenshot operation instruction, and then takes a screenshot of the screen according to the screenshot operation instruction. For example, the user manually selects the screenshot range in the interface of the mobile terminal through a touch medium (such as a stylus, a user's finger, a mouse, etc.), or the user uses the screenshot selection tool provided by the system (such as a square box, a circular box or a free box) to select the screenshot content. However, this screenshot method is completely dependent on user operation. When the user manually selects the screenshot, the screenshot result obtained deviates greatly from the user's expectations. For example, the user cannot accurately select the outline of a person or an object in the image through manual screenshot, resulting in an unsatisfactory screenshot result. The user needs to adjust repeatedly, which increases the cumbersomeness of the screenshot operation and affects the efficiency of the screenshot operation. At the same time, the screenshot method in the related art has not yet predicted the user's screenshot intention and provided an executable screenshot method implementation solution based on the predicted result.
[0035] Based on one or more of the above problems, this exemplary embodiment provides a screenshot processing method. The screenshot processing method can be applied to the above server 105, and can also be applied to one or more of the above terminal devices 101, 102, 103, which is not particularly limited in this exemplary embodiment. Figure 2 As shown, the screenshot processing method may include the following steps S210 to S230:
[0036] In step S210, contour recognition is performed on the current picture to determine a candidate clipping area according to the obtained contour recognition result.
[0037] In an exemplary embodiment of the present disclosure, before the screenshot operation is performed, the display content of the terminal interface is used as the current screen. For example, when the user terminal enters the screenshot mode, if the display content of the terminal interface is static content such as a picture, web page or text, the current display content of the terminal interface is used as the current screen; if the display content of the terminal interface is dynamic content such as an animated picture or a movie being played when the user terminal enters the screenshot mode, the single frame corresponding to the time when the screenshot mode is entered is used as the current screen.
[0038] Among them, Figure 3 As shown, the current picture can be completely covered on the display area of the terminal interface, that is, after the user terminal enters the screenshot mode, the terminal interface only displays the current picture; correspondingly, the current picture can also partially cover the display area of the terminal interface, such as Figure 4 As shown, the current screen can be located at one end of the terminal interface, or the current screen can also be located at one folding screen of the folding screen mobile phone, while the other folding screen normally displays other display contents of the terminal interface. The user can choose whether to completely cover the current screen on the terminal interface. Of course, the embodiments of the present disclosure include but are not limited to the above-mentioned display methods of the current screen, which can be adjusted accordingly according to the actual application scenario of the screenshot processing.
[0039] The methods of entering the screenshot mode in the embodiments of the present disclosure include, but are not limited to, clicking a screenshot function key or a combination key on the terminal or triggering a physical key on the stylus, etc., and the embodiments of the present disclosure do not specifically limit this.
[0040] Image recognition refers to the technology of using computers to process, analyze and understand images to identify various targets and objects. It is a practical application of deep learning algorithms. For example, biometrics, object and scene recognition, and video recognition, etc., involve image matching, image classification, image retrieval, face detection, edge contour detection, etc. Through image recognition technology, contour recognition of the current picture may include: obtaining basic information of the current picture, converting it into information that can be recognized by the machine, and then performing image preprocessing, feature extraction and selection, classifier decision-making and other processes to identify people, objects, text or scenes from the current picture. Among them, image preprocessing includes but is not limited to image enhancement, image restoration, morphological processing, and color image processing. The embodiment of the present disclosure can perform contour recognition on the current picture based on at least one of the above-mentioned image recognition methods. Any technical means that can be used to perform contour recognition on the current picture can be used as the recognition method of this formula embodiment.
[0041] like Figure 5 FIG. 2 shows a schematic diagram of determining a candidate clipping area according to the contour recognition result of the current picture according to an embodiment of the present disclosure. Figure 5As shown, the current picture is a video frame of a movie video. After the contour of the current picture is recognized, the determined candidate interception areas include upper and lower black borders, bottom text, characters, background billboards, trees, high-rise buildings, clouds, and roads, etc. Among them, the contours of the determined candidate interception areas can be displayed distinctively, such as changing the color and line shape of the contours, so as to provide users with more intuitive visual prompts.
[0042] In some possible implementations, the image content of each candidate interception area can also be determined based on the contour recognition result, and the image category of the candidate interception area can be determined based on the category of the image content. For example, the image category of the candidate interception area is determined to be text, the image category of the candidate interception area is determined to be a person category, the image category of the candidate interception area is determined to be an item category, the image category of the candidate interception area is determined to be a landscape, the image category of the candidate interception area is determined to be a web page, and so on. Based on this, the contours or area areas of candidate interception areas belonging to different image categories can also be displayed distinctively. For example, the contours of human characters and background billboards can be displayed distinctively, while the clouds and trees behind the background (both belonging to the landscape category) can be displayed in the same way. The disclosed embodiment can display the contours of the candidate interception areas distinctively according to the actual screenshot scene.
[0043] After determining the candidate screenshot areas and displaying them distinctively, the user can intuitively obtain the area range in the current screen where the screenshot operation can be performed. This process is a prediction of the user's willingness to take a screenshot. By providing candidate screenshot areas for user reference, it not only enriches the screenshot methods of the current screen, but also reduces the complexity of subsequent screenshot operations based on the candidate screenshot areas, thereby improving the efficiency of the screenshot operation and lowering the operational threshold for the screenshot operation, making it convenient for users of different age groups to obtain screenshot results that meet their needs.
[0044] In step S220, in response to the screenshot operation, at least one target screenshot area is determined in the current picture according to the screenshot operation and the candidate screenshot areas.
[0045] In an exemplary embodiment of the present disclosure, a screenshot operation is detected, and the screenshot operation may be an operation performed by a user on a user terminal through a touch medium (such as a user's finger, a stylus, etc.), including but not limited to operation information such as an operation track, operation duration, and pressing force. At least one target capture area may be determined in the current screen in combination with the screenshot operation and the candidate screenshot area.
[0046] The target capture area may be at least one of the candidate capture areas, the target capture area may be an area in the current image that is different from the candidate capture areas, or the target capture area may include at least one of the candidate capture areas and an area that is different from the candidate capture areas. That is, based on the screenshot operation and the candidate capture areas, the user may select at least one of the candidate capture areas as the target capture area, or may skip the candidate capture areas and take the target capture area determined by the screenshot operation as the standard, or may select at least one as the target capture area and take the area determined by the screenshot operation as the target capture area.
[0047] Through this exemplary embodiment, the target capture area is determined by combining the candidate capture areas and the screenshot operation, which can integrate the user's screenshot intention into the final target capture area, making it easier to obtain a screenshot result that meets the user's expectations and improve the accuracy of the screenshot operation.
[0048] In step S230, a screenshot operation is performed in the current picture based on at least one target screenshot area.
[0049] In an exemplary embodiment of the present disclosure, after obtaining at least one target capture area, a screenshot operation can be performed in the current screen according to the at least one target capture area to capture a target image from the current screen. The user terminal can perform a screenshot operation in the current screen according to the at least one target capture area to obtain the target image, or the server can perform a screenshot operation in the current screen according to the at least one target capture area to obtain the target image, and return the target image to the user terminal for display, and the present disclosure does not specifically limit this.
[0050] In some possible implementations, a screenshot operation may be performed in the current screen according to at least one target capture area, and a target image may be generated according to the at least one screenshot obtained. Figure 5 As shown in , if the target capture area is determined to be a character and clouds, then after taking a screenshot of the current screen, the generated target image is as follows Figure 6 shown.
[0051] Accordingly, in some other possible implementations, a screenshot operation may be performed in the current screen according to at least one target capture area, and the obtained at least one screenshot may be deleted, so as to generate a target image according to the current screen after deleting the at least one screenshot, such as Figure 7 As shown in FIG. 1 , after deleting the characters and clouds, the target image is generated. That is, the target capture area may not be the target image generated by capturing the current image, but may be other areas other than the target capture area. Optionally, Figure 5The road section blocked by the characters can be filled in or not, depending on the actual screenshot scene.
[0052] According to the exemplary embodiments of the present disclosure, a screenshot operation can be performed in the current screen according to at least one determined target capture area, breaking through the stereotyped mode of taking a screenshot of the current interface as a whole, selectively capturing an area from the current interface, enriching the screenshot method, and because the target capture area is determined in combination with the candidate capture area and the screenshot operation, the target image is more standardized rather than an irregular screenshot shape, so that the target image meets the screenshot result expected by the user, the screenshot efficiency is high, and terminal users of different age groups can capture screenshot results that meet their expectations, and the user experience is good.
[0053] In an exemplary embodiment, in order to further improve the efficiency of screenshots, a method for implementing the selection of candidate clipping areas is also provided. In response to the screenshot operation, before determining at least one target clipping area in the current picture according to the screenshot operation and the candidate clipping areas, steps S810 and S820 may also be included:
[0054] Step S810: Classify candidate cropping regions into at least two cropping modes corresponding to different image categories.
[0055] In an exemplary embodiment of the present disclosure, the image content of each candidate interception area can be determined according to the image recognition result, so as to determine the image category of the candidate interception area according to the category of the image content. For example, it can include text category, person category, object category, landscape category and web page category, etc. These categories can be further divided. For example, the text category can be divided according to the font, shape, color of the text, etc., and the person category can be further divided into face, limbs, decorations, etc. The embodiment of the present disclosure can determine the image category of the candidate interception area according to the actual screenshot scene, and then divide the candidate interception area into at least two interception modes according to the image category of the candidate interception area.
[0056] For example, see Figure 5 According to the image category of the candidate interception area, the candidate interception area can be divided into 4 interception modes: interception mode 1 includes characters, interception mode 2 includes scenery (clouds and trees), interception mode 3 includes urban buildings (high-rise buildings and roads), and interception mode 4 includes billboards. Of course, each interception mode can be further divided, and the embodiments of the present disclosure will not be listed one by one here.
[0057] In an exemplary embodiment of the present disclosure, after the candidate capture areas are divided into at least two capture modes, a capture mode selection option can be provided on the user terminal for the user to select, and then in response to the user's operation of selecting a target capture mode from at least two capture modes, a candidate capture area corresponding to the target capture mode is provided in the current screen.
[0058] like Fig. 9 As shown, a capture mode selection option may be provided in the current interface of the user terminal for the user to select, and then only candidate capture areas corresponding to the target capture mode may be displayed in the current interface.
[0059] Step S820 , in response to the user selecting a target capture mode from at least two capture modes, providing a candidate capture area corresponding to the target capture mode in the current picture.
[0060] In an exemplary embodiment of the present disclosure, in response to a user selecting a target capture mode from at least two capture modes, a candidate capture area corresponding to the target capture mode is provided in the current picture, such as Fig.10 , when receiving a user from at least two interception modes (such as Fig. 9 After selecting the target capture mode "urban buildings" in the image (as shown), only candidate capture areas "high-rise buildings" and "highways" related to "urban buildings" are provided in the current screen (the outlines are shown as dotted lines), while candidate capture areas of other categories are not displayed (the outlines are solid lines).
[0061] Of course, the embodiment of the present disclosure may also display other candidate capture areas not selected by the user and the candidate capture area corresponding to the target capture mode in a differentiated manner, so as to highlight the candidate capture area corresponding to the target capture mode.
[0062] Through the exemplary embodiments of the present disclosure, by providing the user with a capture mode selection option and providing candidate capture modes corresponding to the target capture mode in the current screen, interference of other capture modes on user selection can be eliminated. For example, if there are many image categories in the current screen, if all candidate capture areas are displayed in the screen, it is easy to cause visual confusion to the user and the user cannot accurately find the candidate capture area he wants to select.
[0063] In an exemplary embodiment of the present disclosure, an implementation method for determining a target capture area is also provided. In response to a screenshot operation, determining at least one target capture area in the current screen according to the screenshot operation and the candidate capture areas may include: in response to a first operation, determining at least one target capture area in the candidate capture areas according to the first operation and the candidate capture areas. The first operation may be a screenshot operation whose operation duration is less than a duration threshold, or a screenshot operation whose pressing force is less than a pressure threshold, etc. The embodiment of the present disclosure may determine the first operation according to the actual screenshot scenario.
[0064] Exemplarily, for a scenario in which the first operation is a screenshot operation with a pressing force less than a pressure threshold, in response to the first operation, determining at least one target capture area in the current screen according to the first operation and the candidate capture areas may include steps S1110 to S1120:
[0065] Step S1110, determining whether the operation duration corresponding to the screenshot operation is less than a duration threshold.
[0066] In an exemplary embodiment of the present disclosure, the operation duration corresponding to the screenshot operation refers to the overall duration from the time corresponding to the initial touch point to the time when the touch medium leaves the user terminal interface when the user uses a touch medium (such as a user's finger, a stylus, a mouse, etc.) on the user terminal interface. The duration threshold is determined according to the actual hardware structure of the user terminal and the actual screenshot scenario, for example, it can be 0.1 seconds, 0.2 seconds, etc., and the present disclosure embodiment does not specifically limit this. The present disclosure embodiment can compare the operation duration corresponding to the screenshot operation with the duration threshold to determine whether the operation duration corresponding to the screenshot operation is less than the duration threshold.
[0067] Among them, different comparison results between the operation duration and the duration threshold can correspond to different screenshot intentions, and then provide different screenshot methods based on the comparison results.
[0068] Step S1120: If the operation duration is less than the duration threshold, at least one target capture area is determined in the candidate capture areas according to the screenshot operation and the candidate capture areas.
[0069] In an exemplary embodiment of the present disclosure, compared with directly selecting an existing candidate clipping area, when a user selects the screenshot content in the terminal interface by himself, it usually takes a certain amount of operation time. Therefore, if the operation time is less than the time threshold, it indicates that the user will determine the target clipping area from the candidate clipping area, that is, if the operation time is less than the time threshold, at least one target clipping area can be determined from the candidate clipping area according to the screenshot operation and the candidate clipping area. In other words, at least one target clipping area can be directly selected from the candidate clipping area according to the clipping operation.
[0070] Through the exemplary embodiments of the present disclosure, when the operation duration is less than the duration threshold, the user's operation intention is predicted to be selected from the existing candidate screenshot areas. Therefore, at least one target screenshot area can be determined from the candidate screenshot areas based on the screenshot operation, and the user's operation intention can be distinguished by comparing the operation duration with the duration threshold to provide a screenshot method that meets the user's needs, thereby reducing the user's thinking cost for screenshot operations and improving the efficiency of screenshot operations.
[0071] In an exemplary embodiment of the present disclosure, a method for determining a target interception area in response to a first operation is provided: obtaining overlapping trajectory points between an operation trajectory and a candidate interception area; if the number of overlapping trajectory points corresponding to the target candidate interception area exists, and the proportion of the total number of operation trajectory points is greater than a proportion threshold, the target candidate interception area is determined as the target interception area.
[0072] Among them, the operation trajectory can be the sliding trajectory of the touch medium on the user terminal interface (such as drawing circles, drawing lines, etc.), the trajectory point of the click operation (such as clicking, double clicking or triple clicking), etc. The present disclosure does not impose special restrictions on the specific type of the operation trajectory. The overlapping trajectory points of the operation trajectory and the candidate interception area refer to the trajectory points where the operation trajectory falls within the candidate interception area, or the points where the operation trajectory coincides with the boundary of the candidate interception area. Optionally, the operation trajectory may have overlapping trajectory points only with a certain candidate interception area; optionally, the operation trajectory may also have overlapping trajectory points with multiple candidate interception areas at the same time. Based on this, the embodiment of the present disclosure determines the target candidate interception area corresponding to the ratio of the number of overlapping trajectory points to the total number of operation trajectory points greater than the ratio threshold as the target interception area.
[0073] For example, Fig.12 The schematic diagram of determining the target interception area in the candidate interception area according to the screenshot operation and the candidate interception area according to the exemplary embodiment of the present disclosure is shown. The number of overlapping trajectory points between the operation trajectory and the candidate interception area where the character is located is 17, accounting for 68% of the total 25 operation trajectory points, which is greater than the ratio threshold of 60%. The number of overlapping trajectory points between the operation trajectory and the candidate interception area where the big tree is located is 6, accounting for 24% of the total 25 operation trajectory points, which is less than the ratio threshold of 60%. The candidate interception area corresponding to the character is determined as the target interception area. Among them, Fig.12 The bold points shown represent operation trajectories. The operation trajectories in the following figures all refer to the bold points in the figures, which will not be described in detail.
[0074] Through this exemplary embodiment, based on the comparison result of the number of overlapping trajectory points between the operation trajectory and the candidate interception areas and the ratio threshold, the target interception area is determined from the target candidate interception areas, so that the screenshot area desired by the user can be accurately obtained, avoiding the selection of the wrong screenshot area due to user misoperation (such as the existence of overlapping trajectory points between the operation trajectory and multiple candidate interception areas).
[0075] It should be noted that, in the process of determining the overlapping trajectory points of the operation trajectory and the candidate interception area, the operation trajectory refers to the operation trajectory corresponding to a selection operation, that is, the operation trajectory generated between the initial touch point and the touch medium leaving the user terminal interface. If the user needs to select multiple candidate interception areas, multiple operation trajectories are generated, and the overlapping trajectory points of the multiple operation trajectories and the corresponding candidate interception areas are obtained respectively, so as to compare the ratio of the number of overlapping trajectory points to the total number of corresponding operation trajectory points with the ratio threshold, thereby realizing the selection operation of multiple candidate interception areas. Fig.12 As shown, the user performs two selection operations respectively, each selection operation has a corresponding operation track, and the above-mentioned judgment process is performed for each operation track, which will not be described one by one here.
[0076] In an exemplary embodiment of the present disclosure, in order to improve the efficiency of determining the target capture area, another implementation method of determining the target capture area in response to the first operation is provided: if the operation trajectory has overlapping trajectory points with at least two target candidate capture areas, the at least two target candidate capture areas are determined as the target capture area.
[0077] The operation track may cross multiple candidate clipping areas at the same time, so the multiple candidate clipping areas that are crossed may all be determined as target clipping areas. Fig.13 As shown, based on this exemplary embodiment, the candidate interception areas where the human character and the tree are located can also be determined as target interception areas to improve the selection efficiency of the target interception areas.
[0078] It should be noted that there may be a situation where, although the operation trajectory has overlapping trajectory points with multiple areas at the same time, the areas therein are not candidate clipping areas, and such non-candidate clipping areas are not used as target clipping areas. Fig.13 ,Although there are overlapping trajectory points between the operation trajectory and the white background, the white background area is not a candidate ,intercepted area, the white background is not taken as the target intercepted area.
[0079] In an exemplary embodiment, a method for implementing a target interception area is also provided: if there are other candidate interception areas that have no overlapping trajectory points with the operation trajectory and are located within the target candidate interception area, then the other candidate interception areas are also determined as the target interception areas, wherein the other candidate interception areas have no overlapping trajectory points with the operation trajectory.
[0080] For example, Fig.14 As shown in the figure, the operation trajectory has no overlapping trajectory points with the "small ball" on the target candidate interception area "highway", but the "small ball" is located in the target candidate interception area "highway", so the "small ball" is also taken as the target interception area. Based on this, the target interception area can be completed to obtain a complete target interception area.
[0081] On the basis of the aforementioned exemplary embodiments, in order to further improve the completeness of the target capture area, the embodiments of the present disclosure also provide another implementation method for completing the target capture area: if there are other candidate capture areas that have an overlapping relationship with the target candidate capture area, the other candidate capture areas are simultaneously determined as the target capture areas, wherein the other candidate capture areas have no overlapping trajectory points with the operation trajectory.
[0082] For example, Fig.15 As shown, the operation trajectory has no overlapping trajectory points with the "small ball" on the target candidate interception area "highway", and the areas corresponding to the "small ball" and the "highway" have an overlapping relationship. Therefore, not only the small ball part (the overlapping part) located in the area corresponding to the "highway" is determined as the target interception area, but the small ball part located outside the area corresponding to the "highway" (the upper half of the ball) is also determined as the target interception area, that is, the "small ball" is also determined as the target interception area, thereby improving the integrity of the target interception area and avoiding missing objects or incomplete objects in the final screenshot content.
[0083] In an exemplary embodiment of the present disclosure, in order to provide a screenshot method that better meets the needs of the user according to the screenshot operation, another implementation method for determining the target screenshot area is also provided: in response to the second operation, at least one target screenshot area is determined in the current screen according to the trajectory shape corresponding to the operation trajectory. The second operation can be a screenshot operation with an operation duration greater than or equal to a duration threshold, or a screenshot operation with a corresponding pressing force greater than or equal to a pressure threshold, etc. The embodiment of the present disclosure can determine the second operation according to the actual screenshot scenario.
[0084] Exemplarily, in a scenario where the second operation is a screenshot operation whose corresponding operation duration is greater than or equal to a duration threshold, in response to the screenshot operation, determining at least one target screenshot area in the current screen based on the screenshot operation and candidate screenshot areas may include step S1130, and step S1130 and step S1120 are not in particular order.
[0085] Step 1130 : If the operation duration is greater than or equal to the duration threshold, at least one target capture area is determined in the current image according to the trajectory shape corresponding to the operation trajectory.
[0086] In an exemplary embodiment of the present disclosure, when a user selects or chooses a screenshot content in a terminal interface, it usually takes a certain amount of operation time. Therefore, when the operation time is greater than or equal to the time threshold, it indicates that the user does not need to determine the provided candidate interception area as the target interception area, so that at least one target interception area can be determined in the current screen according to the trajectory shape corresponding to the operation trajectory. That is, the target interception area is determined according to the range of the graphics drawn by the user. Among them, if it is determined that the user enters the self-drawn target interception area, the provided candidate interception area can also be hidden to avoid the interference of the candidate interception area on the user's vision.
[0087] In a possible implementation, the similarity between the trajectory shape of the operation trajectory and the preset trajectory shape can be obtained, and if there is a target similarity greater than or equal to the similarity threshold, the target interception area is determined according to the target trajectory shape corresponding to the target similarity. Among them, a variety of trajectory shapes can be preset, such as ellipse, square, heart, diamond, and five-pointed star.
[0088] According to the shape of the target trajectory, a target interception area is generated in the current screen so that the target interception area contains the operation trajectory. Fig.16 As shown, if the similarity between the trajectory shape of the operation trajectory and the ellipse is greater than the similarity threshold, then an elliptical target interception area is generated in the current screen according to the elliptical trajectory, and the elliptical target interception area includes the user's operation trajectory. Based on this, it is possible to predict the target interception area where the user needs to draw a certain regular graphic based on the user's operation trajectory, thereby generating a target interception area of the regular graphic containing the operation trajectory. Not only is the user's screenshot intention integrated into the final target interception area, but the target interception area also has a more accurate regular graphic screenshot, which provides a good user experience and promotes product usage. Among them, the range of the target trajectory shape can be the smallest area range that includes the trajectory shape of the operation trajectory, and the size of the area range can also be adjusted accordingly according to actual screenshot requirements.
[0089] In another exemplary embodiment, if the similarity between the trajectory shape of the operation trajectory and a preset shape trajectory is less than or equal to a similarity threshold, the target interception area is determined according to the trajectory shape of the operation trajectory.
[0090] In addition, an exemplary embodiment of the present disclosure can not only select at least one target interception area from the candidate interception areas, but also determine the target interception area according to the trajectory shape of the user's operation trajectory, and merge all the obtained target interception areas as the final target interception area. The specific method of determining each target interception area has been recorded in the above embodiment and will not be repeated here.
[0091] In an exemplary embodiment of the present disclosure, image recognition technology can be used to scan the current picture to obtain the image content in the current picture, and the outline of the image content can be extracted by combining automatic edge recognition, color difference recognition, person and object recognition, automatic matting technology, etc., so as to determine the boundary line of the interception area according to the outline, and then obtain the candidate interception area. Among them, various open source algorithms for intelligent analysis of the current picture are applicable to the embodiments of the present disclosure, and the present disclosure will not elaborate on this.
[0092] In some possible implementations, when determining the boundary line of the intercepted region based on the contour, the obtained contour can be filtered, for example, the contour corresponding to the probability value greater than 70% is determined as the boundary line of the intercepted region, and the contour corresponding to the probability value less than or equal to 70% is filtered and not used as the boundary line of the intercepted region, thereby improving the accuracy of the candidate intercepted region by filtering the contour. The probability value is obtained by image recognition technology and is used to characterize the possibility of whether the recognition result is a contour.
[0093] In an exemplary embodiment of the present disclosure, the image type in the current screen may be a text category. In the process of performing image recognition on the current screen, different text formats can also be used as different recognition results. That is, if the category of the image content corresponding to the contour is text, the contour can be separated into sub-contours corresponding to different text formats. For example, different sub-contours are determined for Songti text, Kaiti text and Heiti text, and each of the separated sub-contours is used as an independent candidate clipping area. Of course, the contour can also be separated into different sub-contours according to the text color, font size, etc., and each of them is used as an independent candidate clipping area, which will not be repeated in the embodiment of the present disclosure.
[0094] Through this exemplary embodiment, after dividing the text into different candidate clipping areas according to the text format, the user can select the candidate clipping area corresponding to the target text format according to the actual clipping needs. For example, all blue text can be selected as the candidate clipping area, which can meet the different screenshot needs of users.
[0095] In an exemplary embodiment, if it is determined that the target capture area is a text category, OCR (Optical Character Recognition) can also be performed on the target capture area, and an editing function for the recognition result can be provided for the user to perform editing operations such as cutting, copying, and saving, so as to meet the user's intention to select text through screenshots.
[0096] To sum up, in the exemplary embodiments of the present disclosure, before the user performs a screenshot operation, candidate capture areas in which the screenshot operation can be performed are first provided for the user to select and refer to, so as to quickly determine the screenshot range and perform the screenshot operation, which not only enriches the screenshot method of the current screen, instead of rigidly capturing the entire screen, but also reduces the tediousness of the screenshot operation, and the screenshot operation is efficient; the embodiments of the present disclosure also combine the candidate capture areas and the user's screenshot operation to determine the target capture area, and also integrate the user's screenshot operation intention into the determination process of the target capture area, which makes it easier to obtain a screenshot result that meets the user's expectations.
[0097] It should be noted that the above figures are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present disclosure, and are not intended to be limiting. It is easy to understand that the processes shown in the above figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.
[0098] For further reference, Fig.17 As shown, in an exemplary embodiment of the present disclosure, a screenshot processing device 1700 is provided, comprising an image recognition module 1710, a region determination module 1720 and an image processing module 1730. Among them:
[0099] The image recognition module 1710 may be used to perform contour recognition on the current picture to determine a candidate clipping area according to the obtained contour recognition result.
[0100] The region determination module 1720 may be configured to determine at least one target capture region in the current picture in response to a capture operation and according to the capture operation and candidate capture regions.
[0101] The image processing module 1730 may be configured to perform a screenshot operation in the current picture based on at least one target screenshot area.
[0102] In an exemplary embodiment, the region determination module 1720 may include:
[0103] A first determining unit is configured to determine, in response to a first operation, the at least one target clipping region in the candidate clipping regions according to the first operation and the candidate clipping regions.
[0104] In an exemplary embodiment, the first operation is a screenshot operation whose operation duration is less than a duration threshold.
[0105] In an exemplary embodiment, the first determining unit may further include:
[0106] An acquisition subunit is used to obtain the overlapping trajectory points between the operation trajectory and the candidate interception area; a first determination subunit is used to determine the target candidate interception area as the target interception area if the number of overlapping trajectory points corresponding to the target candidate interception area accounts for a proportion of the total number of operation trajectory points greater than a proportion threshold.
[0107] In an exemplary embodiment, the first determining unit may further include:
[0108] The second determining subunit is configured to determine the at least two target candidate interception regions as the target interception region when there are overlapping trajectory points between the operation trajectory and the at least two target candidate interception regions.
[0109] In an exemplary embodiment, the screenshot processing device 1700 may further include:
[0110] The first region completion module is used to determine other candidate clipping regions located within the target candidate clipping region as the target clipping region, wherein the other candidate clipping regions have no overlapping trajectory points with the operation trajectory.
[0111] In an exemplary embodiment, the screenshot processing device 1700 may further include:
[0112] The second region completion module is used to determine other candidate clipping regions that have an overlapping relationship with the target candidate clipping region as the target clipping region at the same time if there are other candidate clipping regions that have an overlapping relationship with the target candidate clipping region; wherein the other candidate clipping regions have no overlapping trajectory points with the operation trajectory.
[0113] In an exemplary embodiment, the screenshot processing device 1700 may further include:
[0114] The division mode module is used to divide the candidate cropping area into at least two cropping modes according to the image category of the candidate cropping area. The area screening module is used to respond to the user's operation of selecting a target cropping mode from at least two cropping modes, and provide a candidate cropping area corresponding to the target cropping mode in the current screen.
[0115] In an exemplary embodiment, the region determination module 1720 may include:
[0116] A second determining unit is used to determine at least one target capture area in the current picture in response to a second operation according to a trajectory shape corresponding to the operation trajectory.
[0117] In an exemplary embodiment, the second operation is a screenshot operation with an operation duration greater than or equal to a duration threshold.
[0118] In an exemplary embodiment, the second determining unit may further include:
[0119] The similarity acquisition subunit is used to obtain the similarity between the operation trajectory and the preset shape trajectory; the second determination subunit is used to generate a target capture area in the current screen according to the target shape trajectory corresponding to the target similarity if there is a target similarity greater than or equal to the similarity threshold; wherein the target capture area includes the operation trajectory.
[0120] In an exemplary embodiment, the image processing module 1730 may include:
[0121] The first screenshot processing unit is used to perform a screenshot operation on the current screen according to at least one target capture area, and generate a target image according to the at least one screenshot obtained; the second screenshot processing unit is used to delete the at least one screenshot obtained, and generate a target image according to the current screen after deleting the at least one screenshot.
[0122] In an exemplary embodiment, the image processing module 1730 may include:
[0123] The contour splitting subunit is used to separate the contour into sub-contours corresponding to different text formats if the category of the image content corresponding to the contour is text; the contour determination subunit is used to use each of the separated sub-contours as an independent candidate clipping area.
[0124] The specific details of each module in the above device have been described in detail in the implementation method of the method part. The undisclosed details can be found in the implementation method of the method part, so they will not be repeated here.
[0125] Those skilled in the art will appreciate that various aspects of the present disclosure may be implemented as systems, methods or program products. Therefore, various aspects of the present disclosure may be specifically implemented in the following forms, namely: complete hardware implementation, complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as "circuits", "modules" or "systems".
[0126] In an exemplary embodiment of the present disclosure, an electronic device for implementing the screenshot processing method is also provided, which may be Figure 1 The terminal device 101, 102, 103 or the server 105 in the embodiment. The electronic device at least includes a processor and a memory, the memory is used to store executable instructions of the processor, and the processor is configured to execute the screenshot processing method by executing the executable instructions.
[0127] Below Fig.18 Taking the mobile terminal 1800 in the example, the structure of the electronic device in the embodiment of the present disclosure is exemplarily described. It should be understood by those skilled in the art that in addition to the components specifically used for mobile purposes, Fig.18 The structure in the figure can also be applied to fixed type devices. In other embodiments, the mobile terminal 1800 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure can be implemented in hardware, software, or a combination of software and hardware. The interface connection relationship between the components is only shown schematically and does not constitute a structural limitation of the mobile terminal 1800. In other embodiments, the mobile terminal 1800 may also adopt the same Fig.18 Different interface connection methods, or a combination of multiple interface connection methods.
[0128] like Fig.18 As shown, the mobile terminal 1800 may specifically include: a processor 1810, an internal memory 1821, an external memory interface 1822, a Universal Serial Bus (USB) interface 1830, a charging management module 1840, a power management module 1841, a battery 1842, an antenna 1, an antenna 2, a mobile communication module 1850, a wireless communication module 1860, an audio module 1870, a speaker 1871, a receiver 1872, a microphone 1873, an earphone interface 1874, a sensor module 1880, a display screen 1890, a camera module 1891, an indicator 1892, a motor 1893, a button 1894, and a subscriber identification module (SIM) card interface 1895, etc. The sensor module 1880 may include a depth sensor 18801, a touch sensor 18802, a gyroscope sensor 18803, etc.
[0129] The processor 1810 may include one or more processing units, for example, the processor 1810 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor and / or a neural network processor (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.
[0130] NPU is a neural network (NN) computing processor. By drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, it can quickly process input information and can also continuously self-learn. Through NPU, the intelligent cognition of the mobile terminal 1800 can be realized, such as image recognition, face recognition, voice recognition, text understanding, etc.
[0131] The processor 1810 is provided with a memory. The memory can store instructions for implementing six modular functions: detection instructions, connection instructions, information management instructions, analysis instructions, data transmission instructions, and notification instructions, and the execution is controlled by the processor 1810.
[0132] The charging management module 1840 is used to receive charging input from the charger. The power management module 1841 is used to connect the battery 1842, the charging management module 1840 and the processor 1810. The power management module 1841 receives input from the battery 1842 and / or the charging management module 1840, and provides power to the processor 1810, the internal memory 1821, the display screen 1890, the camera module 1891 and the wireless communication module 1860.
[0133] The wireless communication function of the mobile terminal 1800 can be implemented through antenna 1, antenna 2, mobile communication module 1850, wireless communication module 1860, modulation and demodulation processor and baseband processor. Among them, antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals; mobile communication module 1850 can provide solutions for wireless communication including 2G / 3G / 4G / 5G applied on mobile terminal 1800; modulation and demodulation processor can include modulator and demodulator; wireless communication module 1860 can provide solutions for wireless communication including wireless local area network (WLAN) (such as wireless fidelity (Wi-Fi) network), Bluetooth (BT) and the like applied on mobile terminal 1800. In some embodiments, antenna 1 of mobile terminal 1800 is coupled with mobile communication module 1850, and antenna 2 is coupled with wireless communication module 1860, so that mobile terminal 1800 can communicate with network and other devices through wireless communication technology.
[0134] The mobile terminal 1800 implements the display function through a GPU, a display screen 1890, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 1890 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 1810 may include one or more GPUs that execute program instructions to generate or change display information.
[0135] The mobile terminal 1800 can realize the shooting function through the ISP, the camera module 1891, the video codec, the GPU, the display screen 1890 and the application processor, etc. Among them, the ISP is used to process the data fed back by the camera module 1891; the camera module 1891 is used to capture static images or videos; the digital signal processor is used to process digital signals, and can process other digital signals in addition to digital image signals; the video codec is used to compress or decompress digital videos, and the mobile terminal 1800 can also support one or more video codecs.
[0136] The external memory interface 1822 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the mobile terminal 1800. The external memory card communicates with the processor 1810 through the external memory interface 1822 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.
[0137] The internal memory 1821 can be used to store computer executable program codes, and the executable program codes include instructions. The internal memory 1821 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the mobile terminal 1800 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 1821 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash memory (Universal Flash Storage, UFS), etc. The processor 1810 executes various functional applications and data processing of the mobile terminal 1800 by running instructions stored in the internal memory 1821 and / or instructions stored in a memory provided in the processor.
[0138] The mobile terminal 1800 can implement audio functions such as music playing and recording through the audio module 1870 , the speaker 1871 , the receiver 1872 , the microphone 1873 , the headphone jack 1874 and the application processor.
[0139] The depth sensor 18801 is used to obtain the depth information of the scene. In some embodiments, the depth sensor can be arranged in the camera module 1891.
[0140] The touch sensor 18802 is used to sense touch signals and can convert touch signals into electrical signals. In some embodiments, the touch sensor 18802 can be disposed on the display screen 1890. There are many types of touch sensors 18802, such as resistive touch sensors, inductive touch sensors, capacitive touch sensors, and the like.
[0141] The gyroscope sensor 18803 may be used to determine the motion posture of the mobile terminal 1800. In some embodiments, the angular velocity of the mobile terminal 1800 around three axes (i.e., x, y, and z axes) may be determined by the gyroscope sensor 18803. The gyroscope sensor 18803 may be used for shooting anti-shake, navigation, somatosensory game scenes, and the like.
[0142] In addition, sensors with other functions may be set in the sensor module 1880 according to actual needs, such as an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, an ambient light sensor, a bone conduction sensor, etc.
[0143] The mobile terminal 1800 may also include other devices that provide auxiliary functions. For example, the key 1894 includes a power key, a volume key, etc., and the user can input through the key to generate key signal input related to the user settings and function control of the mobile terminal 1800. Another example is the indicator 1892, the motor 1893, the SIM card interface 1895, etc.
[0144] In addition, the exemplary embodiments of the present disclosure further provide a computer-readable storage medium on which a program product capable of implementing the above-mentioned method of the present specification is stored. In some possible implementations, various aspects of the present disclosure may also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present disclosure described in the above-mentioned "Exemplary Method" section of the present specification.
[0145] It should be noted that the computer-readable medium shown in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.
[0146] In the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in combination with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.
[0147] In addition, program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).
[0148] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary technical means in the art that are not disclosed in the present disclosure. The specification and examples are to be considered as exemplary only, and the true scope and spirit of the present disclosure are indicated by the claims.
[0149] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims
1. A screenshot processing method, characterized in that: include: In response to entering the screenshot mode, contour recognition is performed on the current picture to determine a candidate clipping area according to the obtained contour recognition result, determine the image content of the candidate clipping area according to the contour recognition result, and determine the image category of the candidate clipping area according to the category of the image content; the current picture is the display content of the terminal interface; Dividing the candidate cropped areas into at least two cropped modes corresponding to different image categories; In response to a user selecting a target capture mode from the at least two capture modes, providing a candidate capture area corresponding to the target capture mode in the current picture; and distinctively displaying the contours or areas of the candidate capture areas corresponding to different image categories; In response to a screenshot operation, determining at least one target screenshot area in the current picture according to the screenshot operation and the candidate screenshot areas; Performing a screenshot operation on the current screen based on the at least one target capture area; The performing a screenshot operation in the current picture based on the at least one target capture area includes: Based on the at least one target capture area, performing a screenshot operation in the current picture, and generating a target image according to the at least one obtained screenshot; or The at least one obtained screenshot is deleted, and the target image is generated according to the current screen after the at least one screenshot is deleted.
2. The method according to claim 1, characterized in that In response to the screenshot operation, determining at least one target screenshot area in the current picture according to the screenshot operation and the candidate screenshot areas, comprises: In response to a first operation, the at least one target clipping region is determined among the candidate clipping regions according to the first operation and the candidate clipping regions.
3. The method according to claim 2, characterized in that The first operation is a screenshot operation whose operation duration is less than a duration threshold.
4. The method according to claim 2, characterized in that: The step of determining, in response to the first operation and according to the first operation and the candidate clipping regions, at least one target clipping region in the candidate clipping regions comprises: Acquire the coincident trajectory points between the operation trajectory and the candidate interception area; If the number of overlapping trajectory points corresponding to the target candidate interception area accounts for a proportion of the total number of operation trajectory points that is greater than a proportion threshold, the target candidate interception area is determined as the target interception area.
5. The method according to claim 2, characterized in that: The step of determining, in response to the first operation and according to the first operation and the candidate clipping regions, at least one target clipping region in the candidate clipping regions comprises: If there are overlapping trajectory points between the operation trajectory and at least two target candidate clipping regions, the at least two target candidate clipping regions are determined as the target clipping region.
6. The method according to claim 4 or 5, characterized in that: The method further comprises: simultaneously determining other candidate clipping regions within the target candidate clipping region as the target clipping region; The other candidate interception areas have no overlapping trajectory points with the operation trajectory.
7. The method according to claim 4 or 5, characterized in that: The method further comprises: If there are other candidate clipping regions that have an overlapping relationship with the target candidate clipping region, the other candidate clipping regions are simultaneously determined as the target clipping region; The other candidate interception areas have no overlapping trajectory points with the operation trajectory.
8. The method according to claim 1, characterized in that In response to the screenshot operation, determining at least one target screenshot area in the current picture according to the screenshot operation and the candidate screenshot areas, comprises: In response to the second operation, at least one target capture area is determined in the current picture according to a trajectory shape corresponding to the operation trajectory.
9. The method according to claim 8, characterized in that The second operation is a screenshot operation whose operation duration is greater than or equal to a duration threshold.
10. The method according to claim 8 or 9, characterized in that: In response to the second operation, determining at least one target capture area in the current picture according to a trajectory shape corresponding to the operation trajectory includes: Obtaining the similarity between the trajectory shape of the operation trajectory and the preset trajectory shape; If there is a target whose similarity is greater than or equal to the similarity threshold, generating the target interception area in the current picture according to the target trajectory shape corresponding to the target similarity; Wherein, the target interception area includes the operation track.
11. The method according to claim 1, characterized in that: The performing contour recognition on the current picture to determine the candidate clipping area according to the obtained contour recognition result includes: If the image content category corresponding to the contour of the contour recognition result is text, separating the contour into sub-contours corresponding to different text formats; Each separated sub-contour is taken as an independent candidate clipping area.
12. A screenshot processing device, characterized in that: include: An image recognition module is used to respond to entering the screenshot mode, perform contour recognition on the current screen, determine a candidate clipping area according to the obtained contour recognition result, determine the image content of the candidate clipping area according to the contour recognition result, and determine the image category of the candidate clipping area according to the category of the image content; the current screen is the display content of the terminal interface; divide the candidate clipping area into at least two clipping modes corresponding to different image categories; in response to the user's operation of selecting a target clipping mode from the at least two clipping modes, provide the candidate clipping area corresponding to the target clipping mode in the current screen; and display the contours or areas of the candidate clipping areas corresponding to different image categories in a distinctive manner; an area determination module, configured to determine, in response to a screenshot operation, at least one target screenshot area in the current picture according to the screenshot operation and the candidate screenshot areas; An image processing module, configured to perform a screenshot operation in the current picture based on the at least one target capture area; The image processing module is configured to perform: Based on the at least one target capture area, performing a screenshot operation in the current picture, and generating a target image according to the at least one obtained screenshot; or The at least one obtained screenshot is deleted, and the target image is generated according to the current screen after the at least one screenshot is deleted.
13. An electronic device, characterized in that: include: processor; as well as A memory, configured to store executable instructions of the processor; The processor is configured to perform the method of any one of claims 1 to 11 by executing the executable instructions.
14. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 11 is implemented.
