Screen capture processing method, apparatus and medium

Abstract

Embodiments of the present application provide a screenshot processing method, device and medium. The method specifically includes: after obtaining a screenshot according to a screenshot instruction, receiving a secondary screenshot instruction; in response to the secondary screenshot instruction, determining and displaying a secondary screenshot frame according to a user operation; and removing content corresponding to the secondary screenshot frame from the screenshot. Embodiments of the present application can reduce the operation cost and difficulty coefficient of screenshot processing, thereby improving the screenshot processing efficiency.

Description

Technical Field

[0001] This invention relates to the field of computer technology, and in particular to a screenshot processing method, apparatus, and medium. Background Technology

[0002] A screenshot is a visual image captured by a device and displayed on a screen. Electronic devices typically use screenshot software to capture the currently displayed interface on the screen to obtain a screenshot of the displayed interface.

[0003] In practical applications, screenshots inevitably include unwanted content such as advertisements and images. Currently, image processing software such as Photoshop is commonly used to perform image processing operations such as erasing, covering, or cropping the unwanted content in the screenshot.

[0004] The inventors discovered in implementing the embodiments of the present invention that image processing software such as Photoshop usually has a certain usage threshold, and users often need to spend a lot of time and effort to use image processing software such as Photoshop to complete the screenshot processing; this makes the screenshot processing operation costly and difficult. Summary of the Invention

[0005] This invention provides a screenshot processing method, apparatus, and medium that can reduce the operational cost and difficulty of screenshot processing, thereby improving screenshot processing efficiency.

[0006] To address the above problems, this invention discloses a screenshot processing method, including:

[0007] After obtaining a screenshot according to the screenshot command, receive a second screenshot command;

[0008] In response to the secondary screenshot command, the secondary screenshot frame is determined and displayed according to the user's operation;

[0009] Remove the content corresponding to the secondary screenshot frame from the screenshot.

[0010] On the other hand, embodiments of the present invention disclose a request processing apparatus, comprising:

[0011] The receiving module is used to receive a secondary screenshot command after a screenshot is obtained according to the screenshot command.

[0012] A secondary screenshot frame processing module is used to respond to the secondary screenshot command, determine and display the secondary screenshot frame according to the user operation; and

[0013] The removal module is used to remove the content corresponding to the secondary screenshot frame from the screenshot.

[0014] In another aspect, embodiments of the present invention disclose an apparatus for processing screenshots, including a memory and one or more programs, wherein one or more programs are stored in the memory, and when the programs are executed by one or more processors, they implement the steps of the aforementioned method.

[0015] In another aspect, embodiments of the present invention disclose a machine-readable medium having instructions stored thereon that, when executed by one or more processors, cause a device to perform one or more of the aforementioned screenshot processing methods.

[0016] The embodiments of the present invention have the following advantages:

[0017] This invention provides a secondary screenshot service after obtaining a screenshot according to a screenshot command, allowing the user to identify unwanted content through the secondary screenshot frame. Furthermore, this invention removes the content corresponding to the secondary screenshot frame from the screenshot, thus achieving the removal of unwanted content in the screenshot scenario. This invention achieves the removal of unwanted content in the screenshot scenario because it simplifies the screenshot processing operation path and avoids the jump from the screenshot scenario to the image processing scenario. Therefore, it can achieve the removal of unwanted content without relying on image processing software such as Photoshop, thereby reducing the operational cost and difficulty of screenshot processing and improving screenshot processing efficiency. Attached Figure Description

[0018] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a flowchart illustrating the steps of an embodiment of the screenshot processing method of the present invention;

[0020] Figure 2 This is an illustration of removing the content corresponding to the secondary screenshot frame from a screenshot according to an embodiment of the present invention;

[0021] Figure 3 This is an illustration of removing the content corresponding to the secondary screenshot frame from a screenshot according to an embodiment of the present invention;

[0022] Figure 4 This is a structural block diagram of an embodiment of the input device of the present invention;

[0023] Figure 5 This is a block diagram of an apparatus 800 for processing screenshots according to the present invention; and

[0024] Figure 6 These are schematic diagrams of the server structure in some embodiments of the present invention. Detailed Implementation

[0025] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0026] To address the current technical problems of high operational costs and high difficulty in screenshot processing, this invention provides a screenshot processing solution, which may include: after obtaining a screenshot according to a screenshot instruction, receiving a secondary screenshot instruction; responding to the secondary screenshot instruction, determining and displaying a secondary screenshot frame according to user operation; and removing the content corresponding to the secondary screenshot frame from the screenshot.

[0027] This invention provides a secondary screenshot service after obtaining a screenshot according to a screenshot command, allowing the user to identify unwanted content through the secondary screenshot frame. Furthermore, this invention removes the content corresponding to the secondary screenshot frame from the screenshot, thus achieving the removal of unwanted content in the screenshot scenario. This invention achieves the removal of unwanted content in the screenshot scenario because it simplifies the screenshot processing operation path and avoids the jump from the screenshot scenario to the image processing scenario. Therefore, it can achieve the removal of unwanted content without relying on image processing software such as Photoshop, thereby reducing the operational cost and difficulty of screenshot processing and improving screenshot processing efficiency.

[0028] The screenshot processing method provided in this invention can be applied to a client application environment. The client can run on a device, including but not limited to: smartphones, tablets, e-book readers, MP3 (Moving Picture Experts Group Audio Layer III) players, MP4 (Moving Picture Experts Group Audio Layer IV) players, laptops, in-vehicle computers, desktop computers, set-top boxes, smart TVs, wearable devices, etc. The client can correspond to a website or an app (application). The client can correspond to screenshot apps and other applications.

[0029] Method Example 1

[0030] Reference Figure 1 The diagram illustrates a flowchart of an embodiment of the screenshot processing method of the present invention, which may specifically include the following steps:

[0031] Step 101: After obtaining a screenshot according to the screenshot command, receive a second screenshot command;

[0032] Step 102: In response to the secondary screenshot command, determine and display the secondary screenshot frame according to the user's operation;

[0033] Step 103: Remove the content corresponding to the secondary screenshot frame from the screenshot.

[0034] Figure 1 The illustrated method embodiment can be executed by a client. It is understood that this invention does not limit the specific entity executing the method embodiment. The client can obtain a screenshot according to a screenshot command in a screenshot scenario and provide a secondary screenshot service for that screenshot to remove unwanted content in the screenshot scenario. This invention embodiment can remove unwanted content in a screenshot scenario. Since it avoids the jump from the screenshot scenario to the image processing scenario, it can reduce the operational cost and difficulty of screenshot processing, thereby improving screenshot processing efficiency.

[0035] In step 101, the screenshot command can be used to obtain a screenshot of the interface currently displayed on the screen. Assuming the client is running on a laptop or desktop computer, the process of obtaining a screenshot according to the screenshot command may include: responding to the screenshot command, displaying a screenshot frame on the screen based on mouse operations, and generating a screenshot based on the content within the screenshot frame. It is understood that the above process of obtaining a screenshot according to the screenshot command is merely an example; in practice, the embodiments of the present invention do not limit the specific process of obtaining a screenshot according to the screenshot command.

[0036] The secondary screenshot command can be used to trigger a second screenshot of an existing screenshot. In practice, the secondary screenshot command can be triggered using a keyboard shortcut or a control.

[0037] In one implementation, after obtaining a screenshot according to a screenshot command, a secondary screenshot control can be displayed, and a trigger command from the user for the secondary screenshot control can be received. This trigger command can be an example of a secondary screenshot command. For instance, after obtaining a screenshot according to a screenshot command, a toolbar can be displayed, which may include a secondary screenshot control. This secondary screenshot control can be presented as a preset shape such as scissors. It is understood that this embodiment of the invention does not limit the specific appearance of the secondary screenshot control.

[0038] In step 102, after triggering the secondary screenshot command, the user can input user actions to define the secondary screenshot frame. This secondary screenshot frame can be used to identify unwanted content.

[0039] In one implementation, determining and displaying the secondary screenshot frame can specifically include: responding to the secondary screenshot instruction and displaying a drawing control; determining and displaying the secondary screenshot frame based on the trajectory corresponding to the drawing control. This implementation can employ a drawing method to determine the secondary screenshot frame.

[0040] In its implementation, the drawing control can correspond to a shape, which may include rectangles, ellipses, lines, curves, etc. Multiple drawing controls corresponding to various shapes can be displayed for users to choose from and use. After the user selects a drawing control corresponding to a shape, a secondary screenshot frame corresponding to that shape can be drawn. For example, if the user selects the drawing control corresponding to a rectangle, the drawn secondary screenshot frame can be a rectangle.

[0041] It should be noted that the drawn secondary screenshot frame can be adjusted, including its size and / or position. For example, if the secondary screenshot frame is a rectangle, adjustments can be made to its sides or vertices, as well as its position. If the secondary screenshot frame is an ellipse, adjustments can be made to its major or minor radius.

[0042] In another implementation, determining and displaying the secondary screenshot frame specifically includes: displaying the secondary screenshot frame in response to the secondary screenshot instruction; and adjusting the secondary screenshot frame according to the adjustment instruction. This implementation can use an adjustment method to determine the secondary screenshot frame. The adjustment instruction can be used to adjust the size and / or position of the secondary screenshot frame.

[0043] In an optional embodiment of the present invention, an initial secondary screenshot frame to be displayed before adjustment can be determined based on the analysis results of the screenshot, so that the display position of the initial secondary screenshot frame matches the unwanted content. The position corresponding to the unwanted content can be predicted based on the analysis results of the screenshot, and then the display position of the initial secondary screenshot frame can be determined based on the prediction results.

[0044] For example, the location of unwanted content can be predicted based on the interface layout corresponding to the screenshot. For instance, if the interface layout includes multiple pages, the prediction result can include the preset location of the page. This embodiment of the invention can analyze the data source corresponding to the page to obtain the location where advertisements, watermarks, etc., are set in the data source, as the preset location. For example, the preset location can include the beginning or end of the page.

[0045] For example, the location of unwanted content can be predicted based on the content type of the screenshot. For instance, the content types include a first content type and a second content type. If the ratio of the first content type to the second content type exceeds a threshold, the prediction result can include the location corresponding to the second content type.

[0046] The ratios mentioned above can be either quantity ratios or area ratios. For example, if the first content type and the second content type are text type and image type, respectively, and assuming that the number of paragraphs corresponding to the text type is much greater than the number of paragraphs corresponding to the image type, then the prediction result can include the location corresponding to the image type.

[0047] Alternatively, if the first content type and the second content type are the first language type and the second language type, respectively, and assuming that the number of characters corresponding to the first language type is much greater than the number of characters corresponding to the second language type, then the prediction result can include: the position corresponding to the second language type.

[0048] For example, the positions of unwanted content can be predicted based on the relevance between the content in the screenshot. Specifically, the positions corresponding to content with a relevance less than a relevance threshold can be used as the prediction results. For instance, determining the relevance between paragraphs in chronological order, if the content of the i-th paragraph (where i can be a natural number greater than 1) is unrelated to the content of the (i-1)-th and (i+1)-th paragraphs, then the position corresponding to the i-th paragraph can be used as the prediction result. For example, if the screenshot includes multiple test questions, each test question can correspond to at least one paragraph, different paragraphs corresponding to a test question can be related, and the test question numbers corresponding to adjacent test questions can be related; while the content of paragraphs corresponding to advertisements, watermarks, etc., is unrelated to the content of the paragraphs corresponding to the test questions.

[0049] This invention predicts the position of the initial secondary screenshot frame to match the display position of the initial secondary screenshot frame with unwanted content, thereby reducing the cost for users to adjust the position of the initial secondary screenshot frame.

[0050] After displaying the secondary screenshot box, a corresponding confirmation or cancellation control can be shown. If a trigger operation is received for the confirmation control, it can be assumed that the user has confirmed the secondary screenshot box, and step 103 can be triggered. If a trigger operation is received for the cancellation control, the display of the secondary screenshot box can be stopped, and the process can return to step 101 to await further user action.

[0051] It is understandable that before receiving a trigger operation for the confirmation control, an adjustment instruction can be received, and the secondary screenshot frame can be adjusted according to the adjustment instruction.

[0052] In step 103, the content corresponding to the secondary screenshot frame is removed from the screenshot, which can remove unwanted content in the screenshot scenario.

[0053] The embodiments of the present invention can provide the following technical solution for removing the content corresponding to the secondary screenshot frame from the screenshot:

[0054] Technical Solution 1

[0055] In technical solution 1, the removal of the content corresponding to the secondary screenshot frame from the screenshot specifically includes: if the secondary screenshot frame corresponds to the entire target direction, then the areas on both sides of the secondary screenshot frame are spliced ​​together.

[0056] The target direction represents the reading direction of the screenshot content. In practice, this target direction can be derived from the text direction corresponding to the screenshot. The text direction can refer to the arrangement direction between characters. For example, if the text direction is horizontal, the target direction can be horizontal; or if the text direction is vertical, the target direction can be vertical.

[0057] In one implementation, the process of determining whether the secondary screenshot frame corresponds to the entire target direction can be as follows: compare the secondary screenshot size in the target direction with the upper limit of the screenshot size in the target direction. If the secondary screenshot size equals the upper limit, the secondary screenshot frame can be considered to correspond to the entire target direction; otherwise, if the secondary screenshot size is equal to or less than the upper limit, the secondary screenshot frame can be considered to correspond to a part of the target direction. The upper limit can be the maximum size of the screenshot in the target direction.

[0058] In another implementation, the process of determining whether the secondary screenshot frame corresponds to the entire target direction can be as follows: determine whether the boundary point of the secondary screenshot frame in the target direction is the boundary point of the screenshot in the horizontal direction. If so, the secondary screenshot frame can be considered to correspond to the entire target direction; otherwise, the secondary screenshot frame can be considered to correspond to a part of the target direction.

[0059] Specifically, the first and second boundary points of the secondary screenshot frame in the target direction can be determined, wherein the coordinate value of the second boundary point in the target direction is greater than the coordinate value of the first boundary point in the target direction. Assuming the coordinates of the first and second boundary points are (x1, y) and (x2, y) respectively, it can be determined whether (x1-a, y) and (x2+a, y) are located on the screenshot. If neither (x1-a, y) nor (x2+a, y) is located on the screenshot, then the secondary screenshot frame corresponds to the entire target direction. Otherwise, if either (x1-a, y) or both (x2+a, y) are located on the screenshot, then the secondary screenshot frame corresponds to a local portion of the target direction. Here, 'a' can be a small positive number, the value of which can be determined by those skilled in the art; for example, 'a' can be 0.1, 0.01, 0.001, etc.

[0060] In all cases where the secondary screenshot frame corresponds to the target direction, the areas on both sides of the secondary screenshot frame can be stitched together to discard the area corresponding to the secondary screenshot frame. The two sides of the secondary screenshot frame can be determined based on the vertical direction of the target direction. For example, if the target direction is horizontal, then the two sides of the secondary screenshot frame can be the two sides of the secondary screenshot frame in the vertical direction.

[0061] Reference Figure 2 This illustration demonstrates an embodiment of the present invention for removing content corresponding to a secondary screenshot frame from a screenshot. The screenshot may include a first region 201, a second region 202, and a secondary screenshot frame 203. Assuming the target direction of the screenshot is horizontal, and assuming the secondary screenshot frame 203 corresponds to the entire horizontal direction, the first region 201 and the second region 202 on both sides of the secondary screenshot frame 203 can be joined together to remove the region corresponding to the secondary screenshot frame 203 from the screenshot.

[0062] In one implementation, the above-mentioned stitching of the regions on both sides of the secondary screenshot frame specifically includes: determining the target position based on the secondary screenshot frame; and moving the regions on both sides of the secondary screenshot frame to the target position. Specifically, the objects being moved are the contents within the regions on both sides of the secondary screenshot frame.

[0063] The target position can correspond to the vertical direction of the target direction. In one implementation, the coordinates of the target position in the vertical direction can be determined based on the average coordinates of the secondary screenshot frame in the vertical direction of the target direction. For example, if the target direction is horizontal, the vertical direction of the target direction is vertical, and the secondary screenshot frame is a rectangle with the top and bottom edges having y1 and y2 respectively, then the vertical coordinate of the target position can be (y1+y2) / 2. As another example, if the target direction is horizontal, the vertical direction of the target direction is vertical, and the secondary screenshot frame is an ellipse with the top and bottom edges having y3 and y4 respectively, then the vertical coordinate of the target position can be (y3+y4) / 2.

[0064] It is understood that the above-described process for determining the target location is merely an optional embodiment. In practice, those skilled in the art can determine the target location in other ways. For example, the coordinate range can be determined based on the coordinate values ​​of the secondary screenshot frame in the vertical direction of the target direction, and the coordinate values ​​of the target location in the vertical direction of the target direction can be any value within that coordinate range. Alternatively, the coordinate values ​​of the target location in the vertical direction of the target direction can be a set value. It is understood that the embodiments of the present invention do not limit the specific target location.

[0065] In one implementation, the areas on both sides of the secondary screenshot frame can include a first area and a second area. The first area can be moved to the target position at a first speed, and the second area can be moved to the target position at a second speed. The movement of the first area and the movement of the second area can be synchronized to achieve linkage between the first area and the second area.

[0066] Technical Solution 2

[0067] In technical solution 2, the removal of the content corresponding to the secondary screenshot frame from the screenshot specifically includes: if the secondary screenshot frame corresponds to a local area of ​​the target direction, then the background color of the area corresponding to the secondary screenshot frame is obtained, and the area corresponding to the secondary screenshot frame is filled with the background color.

[0068] Technical solution 2 involves filling the area corresponding to the secondary screenshot frame with a background color. This background color can replace the original foreground content, thereby removing the foreground content corresponding to the secondary screenshot frame from the screenshot. This background color filling improves the matching degree between the area corresponding to the secondary screenshot frame and the surrounding area while removing the foreground content.

[0069] Filling the area corresponding to the secondary screenshot frame with a background color can specifically include setting the pixel value of the area corresponding to the secondary screenshot frame to the pixel value corresponding to the background color.

[0070] In this embodiment of the invention, assuming the area corresponding to the secondary screenshot frame is the third area, the background color of the area corresponding to the secondary screenshot frame can be the original background color of the third area. Alternatively, the background color of the fourth area of ​​the screenshot can be used as the background color of the area corresponding to the secondary screenshot frame.

[0071] The fourth region can be associated with the third region. For example, the fourth region is adjacent to the third region, and / or the coordinates of the fourth region in the perpendicular direction of the target direction match the coordinates of the third region in the perpendicular direction of the target direction.

[0072] Reference Figure 3 This illustration demonstrates an embodiment of the present invention for removing content corresponding to a secondary screenshot frame from a screenshot. The screenshot may include: a first region 301, a second region 302, a secondary screenshot frame 303, and a fourth region 304. Assuming the target direction of the screenshot is horizontal, and assuming the secondary screenshot frame 303 corresponds to a portion of the horizontal direction, since the coordinates of the fourth region 304 in the vertical direction of the target direction match the coordinates of the secondary screenshot frame 303 in the vertical direction of the target direction, the background color of the fourth region 304 can be used as the background color of the secondary screenshot frame 303, and the corresponding area of ​​the secondary screenshot frame 303 can be filled with this background color. This filling can replace the original foreground content.

[0073] After removing the content corresponding to the secondary screenshot box from the original screenshot, a result screenshot can be obtained, which can be displayed on the screen.

[0074] It is understood that embodiments of the present invention can provide one or more secondary screenshot services for a single screenshot. When providing multiple secondary screenshot services, users can specify multiple secondary screenshot frames to remove content corresponding to these frames from the screenshot.

[0075] In one implementation, steps 101 to 103 can be executed cyclically to remove content corresponding to multiple secondary screenshot boxes from the screenshot. One implementation process may include: after obtaining a screenshot according to a screenshot command, receiving a secondary screenshot command A; in response to the secondary screenshot command A, determining and displaying secondary screenshot box A according to user operation; removing content corresponding to secondary screenshot box A from the screenshot; further, receiving a secondary screenshot command B; in response to the secondary screenshot command B, determining and displaying secondary screenshot box B according to user operation; removing content corresponding to secondary screenshot box B from the screenshot.

[0076] In another implementation, step 102 can be executed repeatedly to determine multiple screenshot frames, and then remove the content corresponding to multiple secondary screenshot frames from the screenshot. One implementation process may include: after obtaining a screenshot according to a screenshot instruction, receiving a secondary screenshot instruction; in response to the secondary screenshot instruction, determining and displaying secondary screenshot frame A according to user operation; and in response to the secondary screenshot instruction, determining and displaying secondary screenshot frame B according to user operation; and removing the content corresponding to secondary screenshot frames A and B from the screenshot.

[0077] In an optional embodiment of the present invention, the secondary screenshot frame can be automatically adjusted, and the content corresponding to the automatically adjusted secondary screenshot frame can be removed from the screenshot. In specific implementation, image processing technology can be used to automatically adjust the secondary screenshot frame.

[0078] In one implementation, the connected regions corresponding to the boundary pixels of the secondary screenshot frame can be determined. If the connected region includes pixels located outside the secondary screenshot frame, the boundary pixels of the secondary screenshot frame can be updated based on the connected region to increase the range of the secondary screenshot frame. For example, the boundary pixels included in the connected region but located outside the secondary screenshot frame can be updated to the boundary pixels of the secondary screenshot frame.

[0079] In another implementation, image recognition technology can be used to determine the image target corresponding to the secondary screenshot frame, and the secondary screenshot frame can be automatically adjusted according to the area corresponding to the image target.

[0080] Image recognition refers to the technology of using machines to process, analyze, and understand images in order to identify image targets of various patterns. Specifically, in this invention, machines can be used to process, analyze, and understand screenshots to identify image targets of various patterns. Typically, image targets correspond to specific image areas within a screenshot, and these targets can include: advertisements, watermarks, etc.

[0081] In this embodiment of the invention, the secondary screenshot frame can be reduced in size based on the region corresponding to the image target. For example, if the image target includes both advertisements and test questions in the secondary screenshot frame, the secondary screenshot frame can be reduced in size to exclude the test questions from the scope of the secondary screenshot frame.

[0082] In embodiments of the present invention, the secondary screenshot frame can be expanded according to the region corresponding to the image target. For example, in addition to including part of the advertisement content, the secondary screenshot frame can be expanded to include the entire advertisement content.

[0083] In this embodiment of the invention, a new secondary screenshot frame can be added based on the region corresponding to the image target. For example, if the image target is a watermark, which typically involves multiple discrete characters, then if the user-defined secondary screenshot frame includes the first part of the watermark characters, a new secondary screenshot frame can be added, and this new secondary screenshot frame can correspond to the second part of the watermark characters.

[0084] In summary, the screenshot processing method of this invention provides a secondary screenshot service after obtaining a screenshot according to a screenshot command, allowing the user to identify unwanted content through the secondary screenshot frame. Furthermore, this invention removes the content corresponding to the secondary screenshot frame from the screenshot, thereby removing unwanted content in the screenshot scenario. This invention achieves the removal of unwanted content in the screenshot scenario by simplifying the screenshot processing operation path and avoiding the jump from the screenshot scenario to the image processing scenario. Therefore, it can remove unwanted content without relying on image processing software such as Photoshop, thus reducing the operational cost and difficulty of screenshot processing and improving screenshot processing efficiency.

[0085] It should be noted that, for the sake of simplicity, the method embodiments are all described as a series of motion actions. However, those skilled in the art should understand that the embodiments of the present invention are not limited to the described order of actions, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the motion actions involved are not necessarily required by the embodiments of the present invention.

[0086] Device Examples

[0087] Reference Figure 4 The diagram shows a structural block diagram of an embodiment of the input device of the present invention, which may specifically include: a receiving module 401, a secondary screenshot processing module 402, and a removal module 403.

[0088] The receiving module 401 is used to receive a secondary screenshot instruction after obtaining a screenshot according to the screenshot instruction.

[0089] The secondary screenshot frame processing module 402 is used to respond to the secondary screenshot command, determine and display the secondary screenshot frame according to the user operation; and

[0090] The removal module 403 is used to remove the content corresponding to the secondary screenshot frame from the screenshot.

[0091] Optionally, the removal module 403 may include:

[0092] The splicing module is used to splice the areas on both sides of the secondary screenshot frame if the target direction is all that the secondary screenshot frame corresponds to.

[0093] Optionally, the splicing module may include:

[0094] The target location determination module is used to determine the target location based on the secondary screenshot frame;

[0095] The linkage module is used to move the areas on both sides of the secondary screenshot frame to the target position.

[0096] Optionally, the removal module 403 may include:

[0097] The filling processing module is used to obtain the background color of the area corresponding to the secondary screenshot frame if the secondary screenshot frame corresponds to a local area of ​​the target direction, and fill the area corresponding to the secondary screenshot frame with the background color.

[0098] Optionally, the target direction can be obtained based on the text direction corresponding to the screenshot.

[0099] Optionally, the receiving module 401 may include:

[0100] The first control display module is used to display the secondary screenshot control after a screenshot is obtained according to the screenshot command;

[0101] The instruction receiving module is used to receive user trigger instructions for the secondary screenshot control.

[0102] Optionally, the secondary screenshot frame processing module 402 may include:

[0103] The second control display module is used to display the drawing control in response to the secondary screenshot command;

[0104] The trajectory processing module is used to determine and display the secondary screenshot frame based on the trajectory corresponding to the drawing control.

[0105] Optionally, the secondary screenshot frame processing module 402 may include:

[0106] The screenshot frame display module is used to display the secondary screenshot frame in response to the secondary screenshot command;

[0107] The screenshot frame adjustment module is used to adjust the secondary screenshot frame according to the adjustment instructions.

[0108] As the device embodiment is basically similar to the method embodiment, the description is relatively simple, and relevant parts can be found in the description of the method embodiment.

[0109] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0110] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0111] This invention provides an apparatus for processing screenshots, including a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors. The one or more programs include instructions for performing the following operations: after obtaining a screenshot according to a screenshot instruction, receiving a secondary screenshot instruction; in response to the secondary screenshot instruction, determining and displaying a secondary screenshot frame according to a user operation; and removing the content corresponding to the secondary screenshot frame from the screenshot.

[0112] Figure 5 This is a block diagram illustrating an apparatus 800 for processing screenshots according to an exemplary embodiment. For example, apparatus 800 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0113] Reference Figure 5 The device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output (I / O) interface 812, a sensor component 814, and a communication component 816.

[0114] Processing component 802 typically controls the overall operation of device 800, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 802 may include one or more modules to facilitate interaction between processing component 802 and other components. For example, processing component 802 may include a multimedia module to facilitate interaction between multimedia component 808 and processing component 802.

[0115] Memory 804 is configured to store various types of data to support the operation of device 800. Examples of this data include instructions for any application or method operating on device 800, contact data, phonebook data, messages, pictures, videos, etc. Memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0116] Power supply component 806 provides power to various components of device 800. Power supply component 806 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power to device 800.

[0117] Multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 808 includes a front-facing camera and / or a rear-facing camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0118] Audio component 810 is configured to output and / or input audio signals. For example, audio component 810 includes a microphone (MIC) configured to receive external audio signals when device 800 is in an operating mode, such as call mode, recording mode, and voice input mode. The received audio signals may be further stored in memory 804 or transmitted via communication component 816. In some embodiments, audio component 810 also includes a speaker for outputting audio signals.

[0119] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0120] Sensor assembly 814 includes one or more sensors for providing status assessments of various aspects of device 800. For example, sensor assembly 814 may detect the on / off state of device 800, the relative positioning of components such as the display and keypad of device 800, changes in the position of device 800 or a component of device 800, the presence or absence of user contact with device 800, the orientation or acceleration / deceleration of device 800, and temperature changes of device 800. Sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 814 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 814 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, or a temperature sensor.

[0121] Communication component 816 is configured to facilitate wired or wireless communication between device 800 and other devices. Device 800 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 816 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 816 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID), Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0122] In an exemplary embodiment, the apparatus 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0123] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, which can be executed by a processor 820 of the device 800 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0124] Figure 6This is a schematic diagram of the server structure in some embodiments of the present invention. The server 1900 can vary significantly due to different configurations or performance, and may include one or more central processing units (CPUs) 1922 (e.g., one or more processors) and memory 1932, and one or more storage media 1930 (e.g., one or more mass storage devices) for storing application programs 1942 or data 1944. The memory 1932 and storage media 1930 can be temporary or persistent storage. The program stored in the storage media 1930 may include one or more modules (not shown in the diagram), each module may include a series of instruction operations on the server. Furthermore, the CPU 1922 may be configured to communicate with the storage media 1930 and execute the series of instruction operations in the storage media 1930 on the server 1900.

[0125] The server 1900 may also include one or more power supplies 1926, one or more wired or wireless network interfaces 1950, one or more input / output interfaces 1958, one or more keyboards 1956, and / or one or more operating systems 1941, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, etc.

[0126] A non-transitory computer-readable storage medium that, when instructions in the storage medium are executed by a processor of a device (server or terminal), enables the device to perform... Figure 1 The screenshot processing method shown.

[0127] A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by a processor of a device (server or terminal), enables the device to perform a screenshot processing method, the method comprising: after obtaining a screenshot according to a screenshot instruction, receiving a secondary screenshot instruction; in response to the secondary screenshot instruction, determining and displaying a secondary screenshot frame according to a user operation; and removing content corresponding to the secondary screenshot frame from the screenshot.

[0128] Other embodiments of the invention will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This invention is intended to cover any variations, uses, or adaptations of the invention that follow the general principles of the invention and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of the invention are indicated by the following claims.

[0129] It should be understood that the present invention is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of the invention is limited only by the appended claims.

[0130] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the protection scope of the present invention.

[0131] The foregoing has provided a detailed description of a screenshot processing method, a screenshot processing apparatus, a device for processing screenshots, and a machine-readable medium provided by the present invention. Specific examples have been used to illustrate the principles and implementation methods of the present invention. The descriptions of the above embodiments are only for the purpose of helping to understand the method and core ideas of the present invention. At the same time, for those skilled in the art, there will be changes in specific implementation methods and application scope based on the ideas of the present invention. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. A screenshot processing method, characterized in that, The method includes: After obtaining a screenshot according to the screenshot command, receive a second screenshot command; The steps of responding to the secondary screenshot command, determining and displaying the secondary screenshot frame according to the user operation are executed repeatedly to determine multiple secondary screenshot frames; The step of determining and displaying the secondary screenshot frame in response to the secondary screenshot command, based on the user's operation, includes: In response to the secondary screenshot command, based on the analysis results of the screenshot, the positions corresponding to the unwanted content are predicted to obtain the prediction results; The initial secondary screenshot frame is displayed based on the prediction results, so that the display position of the initial secondary screenshot frame matches the unwanted content. According to the adjustment instructions, the initial secondary screenshot frame is adjusted to determine the secondary screenshot frame; The step of responding to the secondary screenshot command and predicting the location of unwanted content based on the analysis results of the screenshot to obtain a prediction result includes: Based on the interface layout corresponding to the screenshot, the positions of the unwanted content are predicted, and the prediction results include the preset positions of the page. Based on the content type of the screenshot, the location of the unwanted content is predicted. The content type includes a first content type and a second content type. When the ratio of the first content type to the second content type exceeds the ratio threshold, the prediction result includes the location corresponding to the second content type. Based on the relevance between the content in the screenshot, the positions corresponding to the unwanted content are predicted, and the positions corresponding to the content with a relevance less than the relevance threshold are used as the prediction results; Remove the content corresponding to each of the multiple secondary screenshot boxes from the screenshot.

2. The method according to claim 1, characterized in that, Removing the content corresponding to each of the plurality of secondary screenshot boxes from the screenshot includes: If the secondary screenshot frame corresponds to the entire target direction, then the areas on both sides of the secondary screenshot frame are stitched together.

3. The method according to claim 2, characterized in that, The step of stitching together the areas on both sides of the secondary screenshot frame includes: Determine the target location based on the secondary screenshot frame; Move the areas on both sides of the secondary screenshot frame to the target position.

4. The method according to claim 1, characterized in that, Removing the content corresponding to each of the plurality of secondary screenshot boxes from the screenshot includes: If the secondary screenshot frame corresponds to a local area of ​​the target direction, then the background color of the area corresponding to the secondary screenshot frame is obtained, and the area corresponding to the secondary screenshot frame is filled with the background color.

5. The method according to any one of claims 2 to 4, characterized in that, The target direction is obtained based on the text direction corresponding to the screenshot.

6. The method according to claim 1, characterized in that, The receiving of the secondary screenshot instruction includes: After obtaining a screenshot according to the screenshot command, display the secondary screenshot control; Receive user trigger commands for the secondary screenshot control.

7. The method according to claim 1, characterized in that, The method further includes: In response to the secondary screenshot command, display the drawing controls; Based on the trajectory corresponding to the drawing control, determine and display the secondary screenshot frame.

8. A screenshot processing device, characterized in that, The device includes: The receiving module is used to receive a secondary screenshot command after a screenshot is obtained according to the screenshot command. The secondary screenshot frame processing module is used to repeatedly execute the steps of responding to the secondary screenshot command, determining and displaying the secondary screenshot frame according to the user operation, so as to determine multiple secondary screenshot frames; The secondary screenshot processing module is further configured to respond to the secondary screenshot instruction, predict the position of the unwanted content based on the screenshot analysis results, and obtain the prediction result; determine the display position of the initial secondary screenshot frame based on the prediction result to display the initial secondary screenshot frame, so that the display position of the initial secondary screenshot frame matches the unwanted content; and adjust the initial secondary screenshot frame according to the adjustment instruction to determine the secondary screenshot frame. The secondary screenshot processing module is further configured to predict the location of unwanted content based on the interface layout corresponding to the screenshot, wherein the prediction result includes a preset location on the page; predict the location of unwanted content based on the content type corresponding to the screenshot, wherein the content type includes a first content type and a second content type, and when the ratio of the first content type to the second content type exceeds a ratio threshold, the prediction result includes the location corresponding to the second content type; and predict the location of unwanted content based on the correlation between the content in the screenshot, wherein the location of the content with a correlation less than a correlation threshold is used as the prediction result. The removal module is used to remove the content corresponding to each of the multiple secondary screenshot boxes from the screenshot.

9. The apparatus according to claim 8, characterized in that, The removal module includes: The splicing module is used to splice the areas on both sides of the secondary screenshot frame if the target direction is all that the secondary screenshot frame corresponds to.

10. The apparatus according to claim 9, characterized in that, The splicing module includes: The target location determination module is used to determine the target location based on the secondary screenshot frame; The linkage module is used to move the areas on both sides of the secondary screenshot frame to the target position.

11. The apparatus according to claim 8, characterized in that, The removal module includes: The filling processing module is used to obtain the background color of the area corresponding to the secondary screenshot frame if the secondary screenshot frame corresponds to a local area of ​​the target direction, and fill the area corresponding to the secondary screenshot frame with the background color.

12. The apparatus according to any one of claims 9 to 11, characterized in that, The target direction is obtained based on the text direction corresponding to the screenshot.

13. The apparatus according to claim 8, characterized in that, The receiving module includes: The first control display module is used to display the secondary screenshot control after a screenshot is obtained according to the screenshot command; The instruction receiving module is used to receive user trigger instructions for the secondary screenshot control.

14. The apparatus according to claim 8, characterized in that, The secondary screenshot processing module includes: The second control display module is used to display the drawing control in response to the secondary screenshot command; The trajectory processing module is used to determine and display the secondary screenshot frame based on the trajectory corresponding to the drawing control.

15. An apparatus for processing screenshots, characterized in that, It includes a memory and one or more programs, one or more of which are stored in the memory, and when the programs are executed by one or more processors, they implement the steps of the method according to any one of claims 1 to 7.

16. A machine-readable medium having instructions stored thereon that, when executed by one or more processors, cause a device to perform the screenshot processing method as described in one or more of claims 1 to 7.

17. A computer program product comprising computer instructions, characterized in that, When the computer instructions are executed by the processor, they implement the method of any one of claims 1 to 7.

Images