A window content processing method, device, equipment and storage medium

Abstract

The application discloses a window content processing method, device and equipment and a storage medium, and the method comprises the following steps: accepting sensitive data templates sent by a database side; wherein the sensitive data templates comprise an anchor point positioning mode, sensitive area information, and anchor point and sensitive area association information; the position information of the anchor point in the window is determined according to the anchor point positioning mode; the actual position of the sensitive area is calculated according to the position information of the anchor point, the sensitive area information and the anchor point and sensitive area association information; and the sensitive area in the window is blurred according to the actual position of the sensitive area. The application can quickly and accurately blur the sensitive area in the window content.

Description

TECHNICAL FIELD

[0001] The present application relates to a window content processing method and device, electronic equipment and storage medium, belonging to the process mining technical field. BACKGROUND

[0002] In the related art, the robotic process automation software is a kind of software that can effectively improve work efficiency and reduce errors by replacing people to perform repetitive, low-value, non-artificial decision-making and other fixed process operations through the use of automation and intelligent technology. In some application scenarios of the robotic process automation software, for example, in the process of recording user operations, the window of the user operation needs to be recorded to facilitate subsequent auditing or further processing, such as task mining. In actual application, there is a need for privacy protection for some information in the recorded window, which can be defined as sensitive information, and the area displaying the sensitive information can be defined as a sensitive area. Accordingly, when the sensitive information is recorded, it needs to be blurred to ensure the security of enterprise key data and the compliance of business operations.

[0003] In the prior art, the premise of blurring part of the window area is to locate the area that needs to be blurred in the window. The located area is blurred. For example, the OCR (Optical Character Recognition) technology can be used to identify all the text blocks in the window, and then the sensitive information display area is blurred according to the text block content or the position relative to the known label.

[0004] Although the OCR technology has high accuracy, the calculation amount is very large, and it is not suitable to use the OCR technology completely in some application scenarios of the robotic process automation software. Specifically, the robotic process automation software is often used for repetitive and fixed processes, and the window involved in these processes also has the characteristics of high homogeneity. For example, in the expense reimbursement process, the reimbursement window of employee A and the reimbursement window of employee B often have more than 90% similarity. This problem also exists in other processes. Therefore, in this application scenario, the OCR technology is used to distinguish the sensitive area and the non-sensitive area in each window, which is computationally intensive and inefficient, and cannot meet the real-time and lightweight requirements of the robotic process automation software. SUMMARY

[0005] The present application aims to overcome the shortcomings of the prior art and provide a window content processing method, device, equipment and storage medium to solve the technical problems of large calculation amount and low efficiency in the prior art.

[0006] To achieve the above object, the present application is implemented by using the following technical solutions:

[0007] In a first aspect, the present application provides a window content processing method, comprising:

[0008] receiving a sensitive data template sent by a database side; wherein the sensitive data template comprises an anchor point positioning mode, sensitive region information, and anchor point and sensitive region association information;

[0009] determining position information of an anchor point in a window according to the anchor point positioning mode;

[0010] calculating an actual position of a sensitive region according to the position information of the anchor point, the sensitive region information, and the anchor point and sensitive region association information;

[0011] performing blurring processing on the sensitive region in the window according to the actual position of the sensitive region.

[0012] In a second aspect, the present application provides a window content processing device, comprising:

[0013] a receiving module configured to receive a sensitive data template sent by a database side; wherein the sensitive data template comprises an anchor point positioning mode, sensitive region information, and anchor point and sensitive region association information;

[0014] a positioning module configured to determine position information of an anchor point in a window according to the anchor point positioning mode;

[0015] a calculation module configured to calculate an actual position of a sensitive region according to the position information of the anchor point, the sensitive region information, and the anchor point and sensitive region association information;

[0016] a processing module configured to perform blurring processing on the sensitive region in the window according to the actual position of the sensitive region.

[0017] In a third aspect, the present application provides an electronic device, comprising:

[0018] a memory, and one or more processors in communication connection with the memory;

[0019] the memory stores instructions executable by the one or more processors, and the instructions are executed by the one or more processors to enable the one or more processors to implement the method of the first aspect.

[0020] In a fourth aspect, the present application provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the method of the first aspect.

[0021] Compared with the prior art, the window content processing method, device, equipment and storage medium provided by the embodiment of the present application have the following beneficial effects:

[0022] The present application accepts the sensitive data template sent by the database side, wherein the sensitive data template includes anchor positioning mode, sensitive area information, and association information of anchor and sensitive area; the present application uses the sensitive data template to store the anchor positioning mode, the sensitive area information, and the association information of anchor and sensitive area, which can improve the processing speed;

[0023] The present application determines the position information of the anchor in the window according to the anchor positioning mode; the present application uses the anchor positioning mode to reduce the calculation amount under the premise of ensuring the accuracy;

[0024] The present application calculates the actual position of the sensitive area according to the position information of the anchor, the sensitive area information, and the association information of anchor and sensitive area; the present application calculates the actual position of the sensitive area in a way that does not need to limit the fixed area and the variable area of the window, which can ensure the accuracy and flexibility of determining the actual position of the sensitive area;

[0025] The present application performs blurring processing on the sensitive area in the window according to the actual position of the sensitive area; the present application can quickly and accurately perform blurring processing on the sensitive area in the window content. BRIEF DESCRIPTION OF DRAWINGS

[0026] Figure 1 is a flowchart of a window content processing method provided by the embodiment one of the present application;

[0027] Figure 2 is a multi-terminal interaction schematic diagram of a window content processing method provided by the embodiment one of the present application;

[0028] Figure 3 is a schematic diagram of network connection in a window content processing method provided by the embodiment one of the present application;

[0029] Figure 4 is a structural diagram of a window content processing device provided by the embodiment two of the present application;

[0030] Figure 5 is a structural diagram of an electronic device provided by the embodiment three of the present application. DETAILED DESCRIPTION

[0031] The present application will be further described below in conjunction with the drawings. The following embodiments are only used to more clearly illustrate the technical solutions of the present application, and cannot be used to limit the protection scope of the present application.

[0032] In view of the technical problems of large amount of calculation and low efficiency of the existing OCR technology, a window content processing method is provided, which extracts a template index of a real-time window by using a pre-configured sensitive data template library, and then extracts a corresponding sensitive data template from the sensitive data template according to the template index. The sensitive data template can be configured with a template index, and the template index corresponds to an anchor point positioning mode, sensitive area information, and association information of the anchor point and the sensitive area. The anchor point position information is determined from the real-time window according to the anchor point positioning mode; and the real-time window is blurred according to the anchor point position information, the association information of the anchor point and the sensitive area, and the sensitive area information.

[0033] Embodiment one:

[0034] As Figure 1 embodiments of the present application provide a window content processing method, comprising:

[0035] Step S110, receiving the sensitive data template sent by the database side; wherein the sensitive data template comprises an anchor point positioning mode, sensitive area information, and association information of the anchor point and the sensitive area;

[0036] Step S120, determining the position information of the anchor point in the window according to the anchor point positioning mode;

[0037] Step S130, calculating the actual position of the sensitive area according to the position information of the anchor point, the sensitive area information, and the association information of the anchor point and the sensitive area;

[0038] Step S140, blurring the sensitive area in the window according to the actual position of the sensitive area.

[0039] As Figure 1 shown, the specific steps include:

[0040] Step 1: receiving the sensitive data template sent by the database side.

[0041] As Figure 3 shown, the terminal and the server are connected through a network, the terminal can send data to the server, and the server can also send data to the terminal. The server and the database are connected through a network, the server can send a request to the database and can obtain data from the database.

[0042] The terminal can be an electronic device with network access capability. Specifically, for example, the terminal can be a desktop computer, a tablet computer, a notebook computer, a smart phone, a digital assistant, a shopping guide terminal, and a television. Alternatively, the terminal can also be software capable of running in the electronic device.

[0043] The server can be an electronic device with certain computing processing capability. For example, the server can be a server of a distributed system, can be a system with multiple processors, memories, network communication modules, etc. that work together. The server can also be a cloud server, or an intelligent cloud computing server or intelligent cloud host with artificial intelligence technology. The server can also be a server cluster formed by several servers. Alternatively, with the development of science and technology, the server can also be a new technical means capable of realizing the corresponding functions of the embodiments of the present application. For example, it can be a new form of "server" based on quantum computing.

[0044] The database includes an SQL database and a non-SQL database, and is stored locally or remotely and can be accessed through a network. The network connection between the terminal and the server and the network connection between the server and the database include HTTP / HTTPS connection, TCP and UDP based connection. The data sending mode includes HTTP and message flow. In the present embodiment, the connection between the terminal and the server is based on the HTTP request mode, and the connection between the server and the database is based on the TCP packet mode.

[0045] In some cases, when the window content is blurred, a pre-configured sensitive data template can be called to determine the sensitive area in the window. The robotic process automation software often processes highly repetitive and fixed processes, and the windows involved in these processes also have highly homogenized characteristics. Therefore, a sensitive data template can be constructed according to such highly homogenized characteristics. The constructed sensitive data template can be configured on the database side, and the sensitive data template can be called from the database side when performing the blurring process.

[0046] Step 1.1: The terminal sends the index information of the current active window.

[0047] The terminal can run an application program, which includes a local application program and a web application program accessed through a browser. The application program generally includes multiple areas. For example, an area for displaying a title, an area for displaying a menu, an area for displaying a toolbar, and an area for displaying a main text. The area for displaying the main text can be used to display text, pictures, or videos, etc.

[0048] In enterprise application programs, the area for displaying the main text often contains a large number of forms, each form including multiple controls and tables, and each control consisting of a label and an edit box, a text box. Sensitive information is often displayed by the edit box and the text box.

[0049] In actual use, multiple application programs are often running on the terminal at the same time, and each application program has multiple windows. Among them, the window that is currently being used and displayed on the top is the active window.

[0050] Depending on the application type, you can use a variety of different methods to obtain the window content. The window content includes the window title information and other information besides the title information. Depending on the application running environment, you can use different methods to determine the active window and the inactive window.

[0051] Specifically, on Windows systems, you can get the handle of the active window through the system call GetForegroundWindow, and then you can use the handle to query the window title information and other information. On a browser, such as the Chrome browser, you can get the current active tab through the Tab.active property, which is the active window, and get the title of the tab based on the current active tab. If none of the above methods are applicable, you can also use OCR technology. For example, first get the window boundary through border line detection, and then identify the top text line, which is the title information. The window corresponding to the title information is the active window.

[0052] Index information refers to information that indexes a specific sensitive data template from a database. The terminal accesses the database based on the index information and extracts the corresponding sensitive data template from multiple sensitive data templates.

[0053] Index information identifies window content. Windows containing the same type of content have the same index information. Windows containing different types of content have different indexes. For example, the index information for a window in a reimbursement process may be different from the index information for a window in a fixed asset delivery process.

[0054] Index information can be obtained by extracting the window content. Specifically, the window content can be mapped using pre-set mapping rules to obtain index information. In this embodiment, the window content refers to the window title information. Specifically, the window title information is generally divided into a changing part and an unchanged part, such as "Travel Expense Reimbursement Form #1083832", where the numbers are the changing part, corresponding to different forms. When extracting the window index, it is necessary to first remove the changing part and retain the unchanged part, which can be achieved using regular expressions. For example, the number after the "#" sign corresponds to the regular expression: "#\d+", find this string and delete it from the title to obtain the index information corresponding to the window. In some embodiments, in addition to extracting the window title information to obtain index information, other information in the window can also be extracted to obtain index information.

[0055] When the window is a browser page, the index information can also be the metadata information corresponding to the page, such as in HTML <header>Text identification information that is included but not shown.

[0056] Step 1.2: The server sends a request to the database according to the index information, obtains the request for the corresponding sensitive data template, and the database sends the sensitive data template to the server.

[0057] After the index information is extracted, the terminal sends a request to the server, and the server retrieves the corresponding sensitive data template according to the index information. The sensitive data template can include multiple sub-templates, and each sub-template corresponds to an index information. The sub-template can include anchor positioning mode, sensitive area information, and anchor and sensitive area association information.

[0058] An anchor refers to a component in a window that has a relatively fixed position and whose content does not change, including text and icons. The text includes text labels in the menu bar and navigation bar, and text labels corresponding to edit boxes and selection boxes. These labels represent the semantics of menus, edit boxes, and selection boxes, and their text content is fixed and unchangeable. Two forms of the same type, such as two reimbursement forms, have the same text labels, such as a "person in charge" label, but the content in the edit box or selection box corresponding to the "person in charge" is different. Therefore, such text labels can be used as anchors. Icons also have the characteristics of clear semantics and relatively fixed positions, and can also be used as anchors. For example, the toolbar of an application program is often located in the row below the menu bar, and the number and position of icons in the toolbar are fixed. These icons can be preconfigured in the program, and the matched icons are anchors, and other icons are not anchors.

[0059] Anchor positioning mode includes UIA, DOM, OCR, and other modes. The anchor can be positioned and the anchor identification can be determined through the anchor positioning mode. Specifically, if the UIA mode is used, the anchor identification is a UIA identification string, such as "class_name='Nodepad'"; if the DOM mode is used, the anchor identification can be an XPATH path and a CSS selector, and in this embodiment, the XPATH path is used, such as " / html / body / div[3] / div[1] / div / div / div[1]"; if the OCR mode is used, the anchor identification is the corresponding text, such as "person in charge", and if there are multiple identical texts, a number suffix is added to distinguish them, such as "person in charge[2]". Template matching can also be used to position icons. Icons that are anchors are preconfigured in the program, and then these icons are matched in the window to obtain the position of the icons. In this embodiment, the similarity threshold for template matching is set to 0.9, that is, two icons are considered to be the same icon if the similarity is greater than this value.

[0060] The sensitive region information is information for representing the size of the sensitive region. For example, when the sensitive region takes the form of a rectangular frame, the sensitive region information can be represented in the form of (w, h), where w represents the width of the rectangular frame and h represents the height of the rectangular frame. When the sensitive region takes the form of a circular frame, the sensitive region information can be represented in the form of (r), where r represents the radius of the circular frame.

[0061] The association information of the anchor point and the sensitive region can be represented as relative position information of the anchor point and the sensitive region. When the sensitive region takes the form of a rectangular frame, the relative position information can be the offset distance of the center point coordinate of the anchor point and the coordinate of the top-left vertex of the rectangular frame or the center point coordinate. When the sensitive region takes the form of a circular frame, the relative position information can be the offset distance of the center point coordinate of the anchor point and the coordinate of the center of the circular frame. For example, the center point coordinate of the anchor point is (x1, y1) and the center point coordinate of the sensitive region is (x2, y2), and their offset distance is (x1-x2), (y1-y2).

[0062] The sensitive data template can further include identification information of a dynamic region. The identification information of the dynamic region is used to distinguish the dynamic region and the non-dynamic region in the window, and the non-dynamic region can be used to reduce the number of times of calculating the anchor point position. By default, all regions are dynamic regions. The dynamic region can represent a region in which the content of the window can change. For example, the region with a sliding bar, when the sliding bar slides up or down, the content in the region with the sliding bar often changes. In some embodiments, the dynamic region can be artificially specified, that is, directly specifying a certain region in the window as an active region. It can also be distinguished by a pre-trained target recognition model. The pre-trained target recognition model can use yolov5. In some embodiments, whenever the dynamic region changes, the relative position and size of the dynamic region need to be determined again. For example, the position and size of the dynamic region can be recalculated according to the latest position of the scroll bar.

[0063] Step 1.3: The terminal receives the sensitive data template sent by the database side through the server.

[0064] Step 2 can include the following sub-steps in this embodiment.

[0065] Step 2.1: According to the anchor point positioning mode, the position information of the anchor point in the window is determined.

[0066] According to the sensitive data template, all anchor points in the current active window are found, and position information of the anchor point identifier is obtained, which can be position information of the center point of the anchor point identifier. Anchor point positioning methods include UIA, DOM, OCR, and template matching. In this embodiment, UIA positioning is implemented by calling the uiautomation2 library; DOM positioning is implemented by using the selenium library; OCR is implemented by using a pre-trained CRNN model; and template matching is implemented by using the opencv library.

[0067] Step 2.2: According to the position information of the anchor point, the sensitive region information, and the association information of the anchor point and the sensitive region, the actual position of the sensitive region is calculated.

[0068] When the position information of the anchor point is obtained, the actual position of the sensitive region can be calculated according to the sensitive region information and the association information of the anchor point and the sensitive region pre-configured in the sensitive data template. Specifically, when the position of the anchor point is obtained, the center point position of the anchor point is calculated; then the center point position of the sensitive region can be obtained according to the offset provided in the association information of the anchor point and the sensitive region; and finally, the bitmap and size of the sensitive region can be obtained by adding the center point position of the sensitive region to the size of the sensitive region. The bitmap and size of the sensitive region are also the actual position of the sensitive region.

[0069] Step 3: The sensitive region in the window is blurred according to the actual position of the sensitive region.

[0070] Blurring is to perform some operations on the sensitive region so that the information in the sensitive region is covered or cannot be directly recognized. For example, the sensitive region can be processed by mosaic, or the color information of the sensitive region can be processed by calling the tools provided by the browser or application program, so that the naked eye cannot directly recognize it. In this embodiment, a Gaussian blur algorithm is used.

[0071] In some embodiments, when the window content changes, the position information of the anchor point after the window content changes is determined according to the anchor point positioning method.

[0072] In some cases, when the window content changes, for example, the window is enlarged or reduced, the position information of the anchor point in the window determined in the previous time slot will change, so it is necessary to determine the position information of the changed anchor point again. Then, the actual position of the sensitive region is calculated according to the re-determined position information of the anchor point.

[0073] This method takes into account the complexity of specific application scenarios, that is, in actual use, the window content often changes, so it is necessary to determine the position information of the anchor point after the window content changes according to the anchor point positioning method. This method has good practical value.

[0074] In some embodiments, the window includes a dynamic area, and changes in the window content include: shrinking and enlarging the size of the window, moving the window, being blocked, and changes in the dynamic area.

[0075] In some cases, a window's content often changes during actual use. This method specifically lists the situations in which window content changes. When the four situations mentioned above occur, the window content will change, and therefore the anchor point location information needs to be re-determined. This method can re-determine the anchor point location information, accurately and flexibly determining the actual location of the sensitive area even when the window content changes.

[0076] In some embodiments, when the window is obscured, the method for processing the window content also includes: identifying the unobstructed area of ​​the window; for the unobstructed area of ​​the window, determining the position information of the anchor point in the unobstructed area according to the anchor point positioning method; and blurring the sensitive area in the unobstructed area of ​​the window according to the position information of the anchor point in the unobstructed area and the actual position of the sensitive area.

[0077] In some cases, due to certain user operations, the window to be processed may be partially obscured by other windows. However, there may be sensitive areas in the unobstructed area, and the sensitive areas in the unobstructed area still need to be blurred, while the sensitive areas in the obstructed area do not need to be blurred because they are already obscured and further blurring is meaningless.

[0078] In this embodiment, the current active window is first obtained. If the current active window and the window to be processed are the same window, all areas are considered unobstructed areas. If the two windows are different, the intersection of the two windows is calculated, which is the obstructed area, and the rest is considered unobstructed areas.

[0079] In some embodiments, the sensitive data template also includes identification information of the dynamic area. When the dynamic area changes, the position information of the anchor point after the window content changes is determined according to the anchor point positioning method, including: determining the dynamic area in the window according to the identification information of the dynamic area; determining the position information of the anchor point in the dynamic area through the anchor point positioning method.

[0080] This method takes into account the situation where the dynamic area changes, and provides a way to re-determine the actual position of the sensitive area in the dynamic area when the dynamic area changes, which has good practical value.

[0081] In some embodiments, the sensitive data template sent by the database side is received, including: index information of the window; a request for obtaining the corresponding sensitive data template is sent to the database side according to the index information; and the sensitive data template sent by the database side is received.

[0082] In some embodiments, the sensitive data template is obtained by the following steps: obtaining a window screenshot data set; for the window screenshot data set, extracting window index information and identifying anchor points and sensitive areas in the window screenshot; the anchor point information includes commonly used text labels and icons, such as a "person in charge" label, and any component containing only these three characters is an anchor point. In order to filter interference, a restriction condition can also be added, such as a component appearing outside the node in a webpage, or <javascript>The components within the code block are not considered as tags and cannot be used as anchors. The sensitive information area can be automatically identified or manually specified. The automatic identification method is to first identify all the edit boxes, such as edit in a webpage, and then find the corresponding tag. If it is an anchor, the edit box is the sensitive area. In manual specification, the user directly selects the components on the window or page to represent the sensitive area.

[0083] According to the identified anchor and sensitive area, sensitive area information and the association information between the anchor and the sensitive area are constructed. The window index information and the corresponding anchor positioning method, sensitive area information, and the association information between the anchor and the sensitive area are configured in the sensitive data template.

[0084] In some cases, when a certain window does not have a corresponding sensitive data template, the corresponding module can be constructed by the above method. Next time the same kind of window is processed, the corresponding sensitive data template can be called from the database.

[0085] The method considers the closed loop and completeness of the method. In actual application, multiple windows are processed. When a corresponding sensitive data template is not found, the above method can be used to construct a corresponding sensitive data template for next time calling. The method has good practical value.

[0086] Embodiment two:

[0087] As shown in Figure 4 The embodiment of the present application provides a window content processing device, which comprises:

[0088] A receiving module is configured to receive a sensitive data template sent by a database side. The sensitive data template comprises an anchor positioning method, sensitive area information, and association information between the anchor and the sensitive area.

[0089] A positioning module is configured to determine position information of an anchor in a window according to the anchor positioning method.

[0090] A calculation module is configured to calculate an actual position of a sensitive area according to the position information of the anchor, the sensitive area information, and the association information between the anchor and the sensitive area.

[0091] A processing module is configured to perform a fuzzy processing on the sensitive area in the window according to the actual position of the sensitive area.

[0092] Embodiment three:

[0093] The embodiment of the present application provides an electronic device, which comprises:

[0094] A memory and one or more processors in communication connection with the memory.

[0095] The memory stores instructions that can be executed by the one or more processors. The instructions are executed by the one or more processors to enable the one or more processors to implement the method described in the first embodiment.

[0096] Example 4:

[0097] An embodiment of the present invention further provides a computer-readable storage medium, wherein the computer program is stored in the computer-readable storage medium. When the computer program is executed by a processor, the method described in the first embodiment is implemented.

[0098] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware. Furthermore, the present application may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to magnetic disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0099] The present application is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0100] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0101] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a flow or flows and / or a block Figure 1 a step of the function specified in a block or blocks.

[0102] The above description is merely that of the preferred embodiments of the application, and modifications and variations can be effected without departing from the principles of the application, which are defined in the claims.< / javascript> < / header>

Claims

1. A method of processing window content, characterized by, The method comprises the following steps: receiving a sensitive data template sent by a database side; wherein the sensitive data template comprises an anchor point positioning mode, sensitive region information, and anchor point-sensitive region association information; determining position information of anchor points in a window according to the anchor point positioning mode; calculating actual positions of sensitive regions according to the position information of the anchor points, the sensitive region information, and the anchor point-sensitive region association information; performing blurring processing on the sensitive regions in the window according to the actual positions of the sensitive regions; The method further comprises the following steps: in the case of a change in the content of the window, determining position information of the anchor points after the change in the content of the window according to the anchor point positioning mode; the window comprises a dynamic region, and the change in the content of the window comprises the following cases: a case of size reduction or enlargement of the window, a case of movement of the window, a case of the window being blocked, and a case of a change in the dynamic region; in the case of the window being blocked, the method further comprises the following steps: identifying a region of the window that is not blocked; determining position information of anchor points in the region of the window that is not blocked according to the anchor point positioning mode; performing blurring processing on the sensitive regions in the region of the window that is not blocked according to the position information of the anchor points in the region of the window that is not blocked and the actual positions of the sensitive regions; the sensitive data template further comprises identification information of the dynamic region, and in the case of a change in the dynamic region, the determination of the position information of the anchor points after the change in the content of the window according to the anchor point positioning mode comprises the following steps: determining the dynamic region in the window according to the identification information of the dynamic region; determining position information of anchor points in the dynamic region according to the anchor point positioning mode.

2. The method of claim 1, wherein, The method of receiving the sensitive data template sent by the database side comprises the following steps: extracting index information of the window; sending a request for obtaining a corresponding sensitive data template to the database side according to the index information; receiving the sensitive data template sent by the database side.

3. The method of claim 1, wherein, The sensitive data template is obtained through the following steps: obtaining a window screenshot data set; for the window screenshot data set, extracting window index information and identifying anchor points and sensitive regions in the window screenshot; constructing sensitive region information and anchor point-sensitive region association information according to the identified anchor points and sensitive regions; configuring the window index information and the corresponding anchor point positioning mode, sensitive region information, and anchor point-sensitive region association information in the sensitive data template.

4. An apparatus for processing window content, characterized by, The method comprises the following steps: a receiving module is configured to receive a sensitive data template sent by a database side; wherein the sensitive data template comprises an anchor point positioning mode, sensitive region information, and anchor point-sensitive region association information; a positioning module is configured to determine position information of anchor points in a window according to the anchor point positioning mode; a calculation module is configured to calculate actual positions of sensitive regions according to the position information of the anchor points, the sensitive region information, and the anchor point-sensitive region association information; a processing module is configured to perform blurring processing on the sensitive regions in the window according to the actual positions of the sensitive regions; The method further comprises the following steps: In a case where window content changes, position information of the anchor point after the window content changes is determined according to the anchor point positioning manner; the window includes a dynamic region, and the window content changes include a case where the size of the window is reduced or enlarged, a case where the window is moved, a case where the window is blocked, and a case where the dynamic region changes; In the case where the window is blocked, an unblocked region of the window is identified; For the unblocked region of the window, position information of the anchor point in the unblocked region is determined according to the anchor point positioning manner; The sensitive region in the unblocked region of the window is blurred according to the position information of the anchor point in the unblocked region and the actual position of the sensitive region; The sensitive data template further includes identification information of the dynamic region, and in the case where the dynamic region changes, the position information of the anchor point after the window content changes is determined according to the anchor point positioning manner, including: The dynamic region in the window is determined according to the identification information of the dynamic region; Position information of the anchor point in the dynamic region is determined by the anchor point positioning manner.

5. An electronic device, comprising: Including: a memory, and one or more processors in communication connection with the memory; The memory stores instructions executable by the one or more processors, and the instructions are executed by the one or more processors to enable the one or more processors to implement the method of any one of claims 1 to 3.

6. A computer readable storage medium characterized by The readable storage medium stores a computer program, and the computer program is executed by the processor to implement the method of any one of claims 1 to 3.

Images