Data processing method and device

Abstract

The embodiments of this specification provide a data processing method and device, wherein the data processing method includes: obtaining a set of page elements in a page to be processed; determining the page elements to be processed in the set of page elements based on a preset search strategy; determining the initial target page according to the interactive information of the page elements to be processed, and judging whether the initial target page is the target page; if so, determining the initial target page to be the target page; if not, treating the initial target page as a new page to be processed, and executing the step of obtaining the set of page elements in the page to be processed. The data processing method of this specification determines the page elements in the page to be processed, determines the next-level page of the page elements to be processed based on the interactive information of the page elements, and when determining that the next-level page is the target page, determines the path to the target page, so as to facilitate the subsequent path-based entry into the target page of the application and screenshot.

Description

Technical Field

[0001] The embodiments of this specification relate to the field of Internet technology, and in particular to a data processing method. One or more embodiments of this specification also relate to a data processing device, a computing device, a computer-readable storage medium, and a computer program. Background Art

[0002] With the continuous development of computer technology, various types of APPs are being developed and used to meet the different needs of users. Some APP content may contain some false advertisements and other multimedia information that does not comply with laws, regulations or platform rules. In order to monitor such APP content that does not comply with regulations, the commonly used method is to manually review the APP interface and intercept the page with illegal content for feedback; there is also a customized inspection script for the page content of the APP, but the portability of such scripts is low and cannot be applied to multiple types of APPs. In addition, the inspection script needs to be adjusted when the APP is upgraded or revised, resulting in high R&D and maintenance costs.

[0003] Therefore, how to efficiently and cost-effectively determine the APP pages to be checked has become an urgent problem to be solved by technical personnel. Summary of the invention

[0004] In view of this, the present specification provides a data processing method. One or more embodiments of the present specification also relate to a data processing device, a computing device, a computer-readable storage medium and a computer program to solve the technical defects existing in the prior art.

[0005] According to a first aspect of an embodiment of this specification, a data processing method is provided, including:

[0006] Get the page element collection in the page to be processed;

[0007] Determine the page element to be processed in the page element set based on a preset search strategy;

[0008] Determining an initial target page according to the interactive information of the page elements to be processed, and judging whether the initial target page is a target page;

[0009] If so, determining the initial target page as the target page;

[0010] If not, the initial target page is used as a new page to be processed, and the step of obtaining a set of page elements in the page to be processed is performed.

[0011] According to a second aspect of an embodiment of this specification, there is provided a data processing device, including:

[0012] An acquisition module is configured to acquire a set of page elements in a page to be processed;

[0013] A first determination module is configured to determine a to-be-processed page element in the page element set based on a preset search strategy;

[0014] A judgment module is configured to determine an initial target page according to the interaction information of the page element to be processed, and judge whether the initial target page is a target page;

[0015] a second determination module, configured to determine that if yes, the initial target page is the target page;

[0016] The execution module is configured to, if not, take the initial target page as a new page to be processed, and execute the step of obtaining a set of page elements in the page to be processed.

[0017] According to a third aspect of an embodiment of this specification, a computing device is provided, comprising a memory, a processor, and computer instructions stored in the memory and executable on the processor, wherein the processor implements the steps of the data processing method when executing the computer instructions.

[0018] According to a fourth aspect of the embodiments of this specification, a computer-readable storage medium is provided, which stores computer instructions, and when the computer instructions are executed by a processor, the steps of the data processing method are implemented.

[0019] According to a fifth aspect of the embodiments of this specification, a computer program is provided, wherein when the computer program is executed in a computer, the computer is caused to execute the steps of the above-mentioned data processing method.

[0020] The data processing method provided in the present specification obtains a set of page elements in a page to be processed; determines the page elements to be processed in the set of page elements based on a preset search strategy; determines an initial target page according to the interactive information of the page elements to be processed, and judges whether the initial target page is a target page; if so, determines that the initial target page is a target page; if not, uses the initial target page as a new page to be processed, and executes the step of obtaining a set of page elements in the page to be processed.

[0021] An embodiment of the present specification realizes determining the page elements in the page to be processed, determining the next-level page of the page elements to be processed based on the interaction information of the page elements, and when the next-level page is determined to be the target page, determining the path to reach the target page, so as to facilitate subsequent entry into the target page of the application based on the path and taking a screenshot. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1is a flow chart of a data processing method provided by an embodiment of this specification;

[0023] Figure 2 It is a process flow chart of a data processing method for processing a cash register page provided by an embodiment of the present specification;

[0024] Figure 3 It is a schematic diagram of a data processing architecture provided by an embodiment of this specification;

[0025] Figure 4 is a structural schematic diagram of a data processing device provided by an embodiment of this specification;

[0026] Figure 5 It is a structural block diagram of a computing device provided by an embodiment of this specification. DETAILED DESCRIPTION

[0027] Many specific details are described in the following description to facilitate a full understanding of this specification. However, this specification can be implemented in many other ways than those described herein, and those skilled in the art can make similar generalizations without violating the connotation of this specification, so this specification is not limited to the specific implementation disclosed below.

[0028] The terms used in one or more embodiments of this specification are only for the purpose of describing specific embodiments, and are not intended to limit one or more embodiments of this specification. The singular forms of "a", "said" and "the" used in one or more embodiments of this specification and the appended claims are also intended to include plural forms, unless the context clearly indicates other meanings. It should also be understood that the term "and / or" used in one or more embodiments of this specification refers to any or all possible combinations of one or more associated listed items.

[0029] It should be understood that although the terms first, second, etc. may be used to describe various information in one or more embodiments of this specification, this information should not be limited to these terms. These terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of one or more embodiments of this specification, the first may also be referred to as the second, and similarly, the second may also be referred to as the first. Depending on the context, the word "if" as used herein may be interpreted as "at the time of" or "when" or "in response to determining".

[0030] First, the terms involved in one or more embodiments of this specification are explained.

[0031] DFS (Distributed File System): A distributed file system is a way to combine files distributed on different computers into a single name space, making it easier to establish a single, hierarchical multi-file server and server sharing on the network.

[0032] HSV (Hexagonal Cone Model): HSV is a relatively intuitive color model and is widely used in many image editing tools.

[0033] In this specification, a data processing method is provided. This specification also relates to a data processing device, a computing device, a computer-readable storage medium and a computer program, which are described in detail one by one in the following embodiments.

[0034] Figure 1 A flow chart of a data processing method provided according to an embodiment of the present specification is shown, including steps 102 to 110.

[0035] Step 102: Obtain a set of page elements in the page to be processed.

[0036] In order to obtain the path to the target page, it is necessary to explore the interactive elements in the page one by one, so as to finally determine the path to the target page. Before exploring the elements in the page one by one, it is necessary to determine which clickable page elements are included in the page to be processed.

[0037] Among them, the page to be processed refers to the terminal display page containing multimedia content such as text and pictures; the page element set refers to a set composed of page elements, among which the page element refers to the element that contains page interaction information, such as the page element is the "message" element in the homepage of the mobile phone APP. Click "Message" to jump to the message page to view the received messages.

[0038] In actual applications, any page displayed by the terminal can be determined as a page to be processed, and all elements contained in the page to be processed, such as text, pictures, etc., are obtained. Among all the elements of the page to be processed, elements that can be interacted with are determined as page elements to form a page element set.

[0039] In a specific implementation of the present specification, taking the homepage of an instant messaging software as an example, the elements in the homepage of the instant messaging software are identified, such as address book, search, background, etc. Among the elements in the identified homepage of the instant messaging software, elements such as address book and search with interactive information are determined as page elements to form a page element set.

[0040] In practical applications, in order to more accurately determine the page elements in the page to be processed, the specific method for obtaining the page element set in the page to be processed includes:

[0041] Parsing the page to be processed to obtain a set of elements to be processed in the page to be processed;

[0042] A page element set is determined in the to-be-processed element set according to a preset merging rule.

[0043] Among them, the set of elements to be processed refers to a set composed of elements to be processed, wherein the elements to be processed refer to the interactive elements obtained in the page to be processed that have not been merged. For example, if the interactive information of the picture element and the text element identified in the page to be processed is to jump to the address book page, then the picture element and the text element can be used as elements to be processed; the preset merging rule refers to the rule for merging the elements to be processed that contain the same interactive information; the page element set refers to the set composed of page elements obtained by merging the elements to be processed according to the preset merging rule.

[0044] In a specific implementation of the present specification, taking the home page as an example, the set of elements to be processed {image element 1, text element 1, image element 2, text element 2...} includes interactive elements to be processed identified in the home page, including elements to be processed that can be merged. For example, the interactive information of image element 1 and text element 1 is to jump to the address book page. Based on the merging rule of "merging elements to be processed that can jump to the same page", image element 1 and text element 1 are merged to obtain merged page element 1. Similarly, the elements to be processed that can be merged in the set of elements to be processed are merged to obtain page elements. The page element set is composed of the merged page elements and the elements to be processed that cannot be merged in the set of elements to be processed.

[0045] In practical applications, the specific method of parsing the page to be processed and obtaining the set of elements to be processed in the page to be processed includes:

[0046] Obtaining a set of elements in the page to be processed;

[0047] Elements in the element set that contain interactive information are identified as elements to be processed, and form a set of elements to be processed.

[0048] Among them, the element set refers to all the elements obtained in the page to be processed, including interactive elements and non-interactive elements. For example, the interactive element is the contact element, and clicking on the contact can jump to the contact page. The non-interactive element is the background element, and there is no interactive effect after clicking on the background element; the interactive information refers to the information used to achieve the element interaction effect; the element to be processed refers to the element in the page to be processed that will contain the interactive information.

[0049] In a specific implementation of the present specification, taking the address book page as an example, an element set {element 1, element 2...element n} in the address book page is obtained, and elements in the element set containing interactive information are identified. For example, if element 3, element 6, element 7, and element 8 in the interactive set are elements containing interactive information, then the elements containing element information are used as elements to be processed to form a set of elements to be processed for the address book page.

[0050] In order to improve the accuracy of identifying the elements in the page to be processed and facilitate more accurate determination of the elements with which the interaction occurs later, after obtaining the element set in the page to be processed, the following is further included:

[0051] The elements in the element set are screened and corrected based on preset processing rules.

[0052] The preset processing rules refer to the rules for processing elements in the element set.

[0053] Specifically, due to the problem of parsing errors in page parsing, there are some elements in the element set obtained from the page to be processed that do not meet the project requirements. For example, the elements of the mobile phone function bar in the mobile phone page. Since the project requirement is to identify the elements in the mobile phone APP page, the mobile phone system elements need to be screened and not stored in the element set as the elements required by the project; the correction of elements refers to the problem of low accuracy in the recognition of basic elements and the existence of recognition errors. At this time, the elements can be further identified based on other precise recognition methods, such as OCR recognition, that is, the correction of the identified elements is achieved.

[0054] In a specific implementation of the present specification, taking the login page as an example, the preset processing rule is to filter elements in the element set that do not belong to the preset category. For example, if the preset category is elements in the APP page, then the elements in the element set that do not belong to the APP page, such as mobile phone system elements, need to be filtered and deleted from the element set to obtain a filtered element set.

[0055] In practical applications, a specific method for determining a page element set in the to-be-processed element set according to a preset merging rule includes:

[0056] Determine the elements to be processed that contain the same interactive information in the set of elements to be processed;

[0057] The elements to be processed that contain the same interactive information are merged to obtain a page element set.

[0058] The same interactive information refers to information that can produce the same interactive effect.

[0059] Specifically, all the elements to be processed in the set of elements to be processed are traversed to determine the elements to be processed that contain the same interactive information; the elements to be processed that contain the same interactive information are merged to obtain page elements, and the page element set is composed of all the merged page elements and the elements to be processed in the set of elements to be processed that cannot be merged.

[0060] In a specific implementation of the present specification, taking the home page as an example, a set of pending elements for the home page is determined, {pending element 1, pending element 2... pending element n}, wherein the pending elements are all elements containing interactive information; the pending elements in the set of pending elements are traversed to determine the pending elements containing the same interactive information, for example, pending element 1 and pending element 2 contain the same interactive information, and their interactive information is both to jump from the home page to the details page, then pending element 1 and pending element 2 are merged to obtain page element 1; similarly, other pending elements in the set of pending elements containing the same interactive information are merged to obtain page elements, and pending elements that cannot be merged in the set of pending elements are also used as page elements to form a set of page elements {page element 1, page element 2...}.

[0061] Step 104: Determine the page element to be processed in the page element set based on a preset search strategy.

[0062] The preset search strategy refers to a strategy for searching page elements in the page element set; the page element to be processed refers to one of the page elements in the page element set based on the preset search strategy.

[0063] In actual pages, the page to be processed usually contains multiple page elements. When exploring the path to the target page, each page element needs to be explored one by one. If a page contains 10 page elements, there will be 1,000 paths for three consecutive pages. Therefore, in order to improve the search efficiency of the path, some additional information is used to assist in exploring the path, that is, based on the preset search strategy, determining which page elements to search first can explore the path to the target page faster.

[0064] In a specific implementation of the present specification, taking the home page as an example, the page element set of the home page is determined, and the preset search strategy is a strategy of prioritizing searching for elements at the bottom of the page. Then, based on the elements and the search strategy, the elements at the bottom of the position page are determined in the page element set as the page elements to be processed.

[0065] In actual applications, the page elements to be processed may be determined in the page elements based on preset keywords in the preset search strategy or based on preset positions in the preset search strategy, thereby improving the efficiency of searching the target page path based on different methods.

[0066] The method for determining the to-be-processed page element in the page element set according to the preset keywords in the preset search strategy includes:

[0067] Determine preset keywords based on preset search strategies;

[0068] Determining whether the page element set includes a page element matching the preset keyword;

[0069] If yes, the page element in the page element set that matches the preset keyword is used as the page element to be processed;

[0070] If not, the page elements to be processed in the page element set are determined based on a preset element sorting.

[0071] Among them, the preset keywords refer to pre-set keywords related to the page content, such as "VIP", "member", etc.; the preset element sorting refers to the arrangement order of page elements in the page element set.

[0072] In a specific implementation of the present specification, taking the registration page as an example, the page element set of the registration page is determined {page element 1, page element 2...page element n}, the preset search strategy is to prioritize searching for page elements containing "member", and the preset keyword is determined to be "member" based on the preset search strategy; the page element set of the registration page is traversed to obtain page elements containing the preset keyword "member", including page element 4, page element 5 and page element 6, and then page element 4, page element 5 and page element 6 are searched based on the order in which the page elements containing "member" are obtained through the traversal.

[0073] In another specific implementation of the present specification, following the above example, the page element set of the registration page is traversed, and no page element containing "member" is obtained. Then, based on the order of the page elements in the page element set, page element 1 is determined to be the page element to be processed, and the page elements in the page element set are searched in sequence based on the order.

[0074] The method for determining the to-be-processed page element in the page element set according to the preset position in the preset search strategy includes:

[0075] Determine a preset page location based on a preset search strategy;

[0076] Determining whether the page element set includes a page element matching the preset page position;

[0077] If yes, taking the page element in the page element set that matches the preset page position as the page element to be processed;

[0078] If not, the page elements to be processed in the page element set are determined based on a preset element sorting.

[0079] The preset position refers to a preset position in the page to be processed, such as the upper left corner of the page to be processed.

[0080] In actual applications, some commonly used elements generally adopt the same layout method. For example, the element in the upper right corner of the page is generally a setting button. Clicking it will jump to the setting page. If the target page is a setting page, a preset search strategy containing a preset position can be used to search for page elements in the page element set, thereby improving the search efficiency of searching the setting page path.

[0081] In a specific implementation of the present specification, taking the login page as an example, the page element set of the login page {page element a, page element b...page element n} is determined, and the preset search strategy is to prioritize searching for page elements in the lower right corner of the page. Based on the preset search strategy, the preset position is determined to be the lower right corner of the page; the page element set of the login page is traversed to obtain page element c at the preset position "lower right corner of the page", and page element c is used as the page element to be processed, and element c is searched preferentially.

[0082] By presetting the search strategy, the search order of page elements is determined in the page elements, which improves the efficiency of path search and facilitates faster determination of the path to enter the target page.

[0083] Step 106: Determine the initial target page according to the interactive information of the page element to be processed, and judge whether the initial target page is the target page. If so, execute step 108; otherwise, execute step 110.

[0084] Among them, the initial target page refers to the page determined according to the page information contained in the interactive information. For example, if the page element to be processed is the login button on the homepage, then clicking the login button can jump to the initial target page, i.e., the login page; the target page refers to the page corresponding to the project requirement. For example, if the project requirement is to query whether there is unreasonable content on the cashier page, then the target project is the cashier page; determine whether the initial target page is the target page. If so, determine the target path to reach the target page. In the program that displays the page, enter the target page according to the target path to take a screenshot of the target page, so as to further analyze the page content based on the screenshot. If not, continue to determine other element pages in the page element set as page elements to be processed, and continue the path search.

[0085] In practical applications, the specific method for determining the initial target page according to the interaction information of the to-be-processed page elements includes:

[0086] Parsing the page element to be processed to obtain interaction information of the page element to be processed, wherein the interaction information includes an initial target page link;

[0087] An initial target page is determined based on the initial target page link.

[0088] The initial target page link refers to a link used to jump to the initial target page.

[0089] In a specific implementation of the present specification, taking the page element to be processed as a login element as an example, the login element is parsed to obtain the interactive information of the login element, which includes a login page link. According to the page information in the login page link, it is determined that the login element in the current page can jump to the login page.

[0090] By determining the interaction information of the page element to be processed and determining the initial target page according to the interaction information, it is judged whether the path to the target page has been determined, so as to determine whether to continue searching for page elements in the future.

[0091] Step 108: Determine that the initial target page is the target page.

[0092] Specifically, the initial target page is compared with the target page. When it is determined that the initial target page is the target page, the target path to enter the target page is determined, the operation of entering the target page is performed according to the target path, and after entering the target page, the target page is captured to obtain the target page screenshot required for the project, so as to facilitate subsequent analysis of the content in the target page screenshot.

[0093] In a specific implementation of the present specification, taking the login page as an example, after determining the login page according to the interactive information of the login element, it is determined whether the login page is the target page. If the target page in the embodiment is the login page, the login page determined according to the login element is used as the target page.

[0094] Step 110: taking the initial target page as a new page to be processed, and executing step 102.

[0095] Specifically, when it is determined that the initial target page is not the target page, the initial target page is used as a new page to be processed, and the step of obtaining the page element set in the page is continued according to the new page to be processed.

[0096] In a specific implementation of the present specification, the login page is still taken as an example. The target page in this embodiment is the registration page, that is, the login page is not the target page. The login page is used as a new page to be processed, and the operations performed on the page to be processed are performed, including obtaining a set of page elements in the new page to be processed.

[0097] In actual applications, in addition to exploring the main path, there will be abnormal situations outside the path. For example, after some pages are opened, there will be pop-up windows for sign-in and update. In order to avoid the impact of such abnormal situations on the exploration path, additional processing is required.

[0098] The specific methods for handling abnormal pages include:

[0099] Determine whether the pages to be processed include abnormal pages;

[0100] In the case that the pages to be processed include an abnormal page, an abnormal page element in the abnormal page is obtained, and the abnormal page is closed based on the abnormal page element.

[0101] Among them, abnormal pages refer to pages such as pop-up windows and optional boxes outside the main path, such as advertising pop-ups, etc. In order to continue the path exploration, such abnormal pages need to be closed so that subsequent path exploration can continue; abnormal page elements refer to page elements obtained in the abnormal page, such as close window elements, determine update elements, etc., determine the abnormal page elements in the abnormal page, and close the abnormal page based on the abnormal page elements.

[0102] In actual applications, a pre-trained model can be used to determine whether there are abnormal pages. Specifically, an image recognition model can be trained, and the page can be input into the trained image recognition model to determine whether there are abnormal pages; or based on the page elements in the page element set of the page to be processed, it can be determined whether there are abnormal pages. For example, based on the HSV image features of the page elements, it can be determined whether there are abnormal pages; specifically, it can be determined whether there is a bottom pop-up window or a page element that selects a pop-up window in the page element set; since the operation after the pop-up window appears is different from the normal operation path, the pop-up window page can be regarded as an abnormal page.

[0103] Different processing methods can be used for different types of pop-up windows. Pop-ups can be roughly divided into two types. One is a category-selective pop-up window, that is, a pop-up window containing multiple options, such as a pop-up window for selecting a product category. For this type of pop-up window, first parse out all the selectable items in the pop-up window, and then determine the click method of the options, including: clicking one by one for the x-axis aligned options, clicking one randomly in each row for the y-axis aligned options, or clicking the last one in each row for the y-axis aligned options; the other is other pop-ups. There are many styles of this type of pop-up windows, and the pop-up cancellation design of different applications is also different. For this type of pop-up window, you can: click the pop-up window close button, click the negative keyword button, click the positive keyword button, or click the phone back button.

[0104] In a specific implementation of the present specification, taking the login page as an example, it is determined that an update pop-up window will be displayed in the process of entering the login page, then the pop-up window elements in the update pop-up window are obtained, including a cancel element, and the update pop-up window is closed based on a negative keyword button, i.e., the cancel element.

[0105] The data processing method of this manual can automatically process abnormal pages such as pop-up windows, thereby realizing the exploration of all paths and avoiding the situation where access to the next level page is blocked due to abnormal pages.

[0106] In actual applications, after all clickable elements on the current page have been searched, it is necessary to return to the previous page or several previous pages to continue searching for the path. At this time, the page return action needs to be performed.

[0107] The specific method for determining the fallback page based on the current page includes:

[0108] Obtaining interaction information of each page element to be processed in the page to be processed;

[0109] When it is determined that the page information of each interactive information does not include the next level page information, a new page to be processed is determined based on a preset path.

[0110] Among them, the next-level page information refers to the information of the next-level page compared to the current page. For example, if the current page is the homepage and you click on the homepage login to enter the login page, then the login page is the next-level page; the preset path is determined based on the path from the page to be processed to the initial target page; when the interactive information of the page elements in the page to be processed does not contain the next-level page information, the pages to which the page to be processed can fall back are determined based on the preset path, and these pages are used as new pages to be processed, and the paths that can be entered by the new pages to be processed are continued to be explored.

[0111] The following combination Figure 2 , taking the application of the data processing method provided in this specification on the cash register page as an example, the data processing method is further explained. Figure 2 A processing flow chart of a data processing method provided by an embodiment of the present specification is shown, and the specific steps include step 202 to step 210.

[0112] Step 202: Obtain a set of page elements in the page to be processed.

[0113] In a specific implementation of this specification, taking the target page as a cashier page as an example, the home page is determined as a page to be processed, and the page element set of the home page is obtained. The specific steps of obtaining the page element set include S20202-S20208:

[0114] S20202. Get all elements in the home page to obtain an element collection.

[0115] Specifically, a preset basic control recognition algorithm is used to identify all elements in the home page to form an element set, wherein the element set includes picture elements, text elements, and the like.

[0116] S20204. Filter the elements in the element set.

[0117] Specifically, the elements with low confidence and not meeting the target category in the element set are screened out, and the elements are deleted from the element set, such as deleting the background elements in the element set.

[0118] S20206. Determine a set of elements to be processed from the filtered set of elements.

[0119] Specifically, the elements in the element set containing the interactive information are identified as the elements to be processed, and form the element set to be processed.

[0120] S20208. Merge the elements to be processed in the set of elements to be processed to obtain a page element set.

[0121] Specifically, elements containing the same interactive information are merged, elements in the same layout are merged based on the page layout, and the merged elements are used as page elements to form a set of elements to be processed.

[0122] like Figure 3 As shown, Figure 3 It is a schematic diagram of a data processing architecture provided by an embodiment of this specification, wherein the process of obtaining page elements from data is completed in the page parser, and the core control engine module is used to play a logical control role on all events in the system.

[0123] Step 204: Determine the page element to be processed in the page element set based on a preset search strategy.

[0124] In a specific implementation of this specification, the above example is used, and the preset search strategy is to search for page elements containing the keyword "member" first. In the page element set of the home page, the page element containing the keyword "member" is determined as the page element to be processed. For other page elements that do not contain the keyword "member", sequential scheduling is performed based on DFS, thereby realizing the scheduling of all elements in the page element set. Figure 3 As shown, the auxiliary search module is a preset search strategy, and the search sequence scheduling module is to sequentially schedule the page elements in the page element set based on algorithms such as DFS.

[0125] Step 206: Determine the initial target page according to the interaction information of the page element to be processed, and judge whether the initial target page is the target page.

[0126] In a specific implementation of the present specification, following the above example, the interactive information of the to-be-processed page element containing the keyword "member" is obtained, the page link contained in the interactive information is determined, and based on the page link, it is determined that the page can be jumped from the home page to the login page. Since the login page is not the cashier page, the above steps 202-206 are continued to be executed until the page link to the cashier page is obtained.

[0127] In the process of searching for the path to enter the cashier page, there is an update pop-up window. When the pop-up window is recognized to appear, the pop-up window is closed according to the preset pop-up processing strategy. Figure 3 The page exception handler module in the example contains strategies for handling abnormal pages such as pop-up windows.

[0128] Step 208: When the initial target page is determined to be the target page, a target path for entering the target page is determined.

[0129] In a specific implementation of this specification, following the above example, when the page link is obtained as a link to the cashier page, the target path to the cashier page is determined to be "home page - login page - product page - product details page - cashier page". Figure 3 As shown, the path static graph module records the target path to the target page.

[0130] Step 210: Enter the target page based on the target path.

[0131] In a specific implementation of this specification, following the above example, according to the target path in the path static graph module, the operation of entering the cashier page is executed according to the target path in the application containing the cashier page, thereby realizing automatic entry into the cashier page. Figure 3 As shown, the operation executor module performs the operation of entering the cashier page according to the target path, and the operation execution module can further intercept the cashier page to obtain a screenshot of the cashier page; and the operation executor module can connect multiple devices based on actual conditions to achieve distributed operation execution.

[0132] The data processing method of the present specification determines the page elements in the page to be processed, determines the next-level page of the page elements to be processed based on the interaction information of the page elements, and when the next-level page is determined to be the target page, determines the path to reach the target page, so as to facilitate the subsequent entry into the target page of the application based on the path and take a screenshot.

[0133] Corresponding to the above method embodiment, this specification also provides a data processing device embodiment, Figure 4 FIG. 1 shows a schematic diagram of the structure of a data processing device provided by an embodiment of the present specification. Figure 4 As shown, the device comprises:

[0134] The acquisition module 402 is configured to acquire a set of page elements in the page to be processed;

[0135] A first determining module 404 is configured to determine a to-be-processed page element in the page element set based on a preset search strategy;

[0136] The judgment module 406 is configured to determine the initial target page according to the interaction information of the page element to be processed, and judge whether the initial target page is the target page;

[0137] When the judgment result output by the judgment module is yes, the second determination module 408 is executed, and the second determination module 408 is configured to determine that the initial target page is the target page;

[0138] When the judgment result output by the judgment module is negative, the execution module 410 is run. The execution module 410 is configured to take the initial target page as a new page to be processed and continue to run the acquisition module 402 .

[0139] In a specific implementation of this specification, the acquisition module 402 is further configured to:

[0140] Parsing the page to be processed to obtain a set of elements to be processed in the page to be processed;

[0141] A page element set is determined in the to-be-processed element set according to a preset merging rule.

[0142] Optionally, the acquisition module 402 is further configured to:

[0143] Obtaining a set of elements in the page to be processed;

[0144] Elements in the element set that contain interactive information are identified as elements to be processed, and form a set of elements to be processed.

[0145] Optionally, the acquisition module 402 is further configured to:

[0146] The elements in the element set are screened and corrected based on preset processing rules.

[0147] Optionally, the acquisition module 402 is further configured to:

[0148] Determine the elements to be processed that contain the same interactive information in the set of elements to be processed;

[0149] The elements to be processed that contain the same interactive information are merged to obtain a page element set.

[0150] Optionally, the first determining module 404 is further configured to:

[0151] Determine preset keywords based on preset search strategies;

[0152] Determining whether the page element set includes a page element matching the preset keyword;

[0153] If yes, the page element in the page element set that matches the preset keyword is used as the page element to be processed;

[0154] If not, the page elements to be processed in the page element set are determined based on a preset element sorting.

[0155] Optionally, the first determining module 404 is further configured to:

[0156] Determine a preset page location based on a preset search strategy;

[0157] Determining whether the page element set includes a page element matching the preset page position;

[0158] If yes, taking the page element in the page element set that matches the preset page position as the page element to be processed;

[0159] If not, the page elements to be processed in the page element set are determined based on a preset element sorting.

[0160] Optionally, the determining module 406 is further configured to:

[0161] Parsing the page element to be processed to obtain interaction information of the page element to be processed, wherein the interaction information includes an initial target page link;

[0162] An initial target page is determined based on the initial target page link.

[0163] Optionally, the device further comprises a closing module configured to:

[0164] Determine whether the pages to be processed include abnormal pages;

[0165] In the case that the pages to be processed include an abnormal page, an abnormal page element in the abnormal page is obtained, and the abnormal page is closed based on the abnormal page element.

[0166] Optionally, the device further includes a determination submodule configured to:

[0167] Obtaining interaction information of each page element to be processed in the page to be processed;

[0168] When it is determined that the page information of each interactive information does not include the next level page information, a new page to be processed is determined based on a preset path.

[0169] The data processing device of the present specification obtains a set of page elements in a page to be processed through an acquisition module; a first determination module determines the page elements to be processed in the page element set based on a preset search strategy; a judgment module determines the initial target page according to the interactive information of the page elements to be processed, and judges whether the initial target page is the target page; a second determination module determines that the initial target page is the target page if yes; and an execution module uses the initial target page as a new page to be processed, and executes the step of obtaining the set of page elements in the page to be processed if no.

[0170] The above is a schematic scheme of a data processing device of this embodiment. It should be noted that the technical scheme of the data processing device and the technical scheme of the above data processing method belong to the same concept, and the details of the technical scheme of the data processing device that are not described in detail can be referred to the description of the technical scheme of the above data processing method.

[0171] Figure 5 The structure block diagram of a computing device 500 provided according to an embodiment of the present specification is shown. The components of the computing device 500 include but are not limited to a memory 510 and a processor 520. The processor 520 is connected to the memory 510 via a bus 530, and the database 550 is used to store data.

[0172] The computing device 500 also includes an access device 540 that enables the computing device 500 to communicate via one or more networks 560. Examples of these networks include a public switched telephone network (PSTN), a local area network (LAN), a wide area network (WAN), a personal area network (PAN), or a combination of communication networks such as the Internet. The access device 540 may include one or more of any type of network interface (e.g., a network interface card (NIC)) whether wired or wireless, such as an IEEE 802.11 wireless local area network (WLAN) wireless interface, a World Wide Interoperability for Microwave Access (Wi-MAX) interface, an Ethernet interface, a universal serial bus (USB) interface, a cellular network interface, a Bluetooth interface, a near field communication (NFC) interface, and the like.

[0173] In one embodiment of the present specification, the above components of the computing device 500 and Figure 5Other components not shown in the figure may also be connected to each other, for example, via a bus. It should be understood that Figure 5 The computing device structure block diagram shown is only for the purpose of illustration, and is not intended to limit the scope of this specification. Those skilled in the art can add or replace other components as needed.

[0174] The computing device 500 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., a tablet computer, a personal digital assistant, a laptop computer, a notebook computer, a netbook, etc.), a mobile phone (e.g., a smart phone), a wearable computing device (e.g., a smart watch, smart glasses, etc.), or other types of mobile devices, or a stationary computing device such as a desktop computer or PC. The computing device 500 may also be a mobile or stationary server.

[0175] The processor 520 implements the steps of the data processing method when executing the computer instructions.

[0176] The above is a schematic scheme of a computing device of this embodiment. It should be noted that the technical scheme of the computing device and the technical scheme of the above data processing method belong to the same concept, and the details not described in detail in the technical scheme of the computing device can be referred to the description of the technical scheme of the above data processing method.

[0177] An embodiment of the present specification also provides a computer-readable storage medium storing computer instructions, which implement the steps of the data processing method as described above when executed by a processor.

[0178] The above is a schematic scheme of a computer-readable storage medium of this embodiment. It should be noted that the technical scheme of the storage medium and the technical scheme of the above data processing method belong to the same concept, and the details not described in detail in the technical scheme of the storage medium can be referred to the description of the technical scheme of the above data processing method.

[0179] An embodiment of the present specification further provides a computer program, wherein when the computer program is executed in a computer, the computer is caused to execute the steps of the above-mentioned data processing method.

[0180] The above is a schematic scheme of a computer program of this embodiment. It should be noted that the technical scheme of the computer program and the technical scheme of the above data processing method belong to the same concept, and the details not described in detail in the technical scheme of the computer program can be referred to the description of the technical scheme of the above data processing method.

[0181] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0182] The computer instructions include computer program codes, which may be in source code form, object code form, executable files or some intermediate forms, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the content contained in the computer-readable medium may be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.

[0183] It should be noted that, for the above-mentioned method embodiments, for the sake of simplicity of description, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the embodiments of this specification are not limited by the order of the actions described, because according to the embodiments of this specification, some steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the embodiments of this specification.

[0184] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0185] The preferred embodiments of this specification disclosed above are only used to help explain this specification. The optional embodiments do not describe all the details in detail, nor do they limit the invention to the specific implementation methods described. Obviously, many modifications and changes can be made according to the content of the embodiments of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the embodiments of this specification, so that technicians in the relevant technical field can understand and use this specification well. This specification is limited only by the claims and their full scope and equivalents.

Claims

1. A data processing method, comprising: Get the page element collection in the page to be processed; Determining a to-be-processed page element in the page element set based on a preset search strategy, wherein the preset search strategy is used to determine to preferentially search the to-be-processed page elements in the page element set to explore a path to reach a target page; Determine an initial target page according to the interaction information of the page element to be processed, and judge whether the initial target page is a target page, wherein the initial target page refers to a page determined according to the page information included in the interaction information, and the target page refers to a page corresponding to the project requirement; If yes, then determining the initial target page as the target page, wherein, in the case where the initial target page is determined to be the target page, then determining the target path to enter the target page; If not, the initial target page is used as a new page to be processed, and the step of obtaining a set of page elements in the page to be processed is performed.

2. The data processing method according to claim 1, wherein obtaining a set of page elements in the page to be processed comprises: Parsing the page to be processed to obtain a set of elements to be processed in the page to be processed; A page element set is determined in the to-be-processed element set according to a preset merging rule.

3. The data processing method according to claim 2, wherein parsing the page to be processed and obtaining the set of elements to be processed in the page to be processed comprises: Obtaining a set of elements in the page to be processed; Elements in the element set that contain interactive information are identified as elements to be processed, and form a set of elements to be processed.

4. The data processing method according to claim 3, after obtaining the element set in the page to be processed, further comprising: The elements in the element set are screened and corrected based on preset processing rules.

5. The data processing method according to claim 3, wherein determining the page element set in the to-be-processed element set according to a preset merging rule comprises: Determine the elements to be processed that contain the same interactive information in the set of elements to be processed; The elements to be processed that contain the same interactive information are merged to obtain a page element set.

6. The data processing method according to claim 1, wherein determining the page element to be processed in the page element set based on a preset search strategy comprises: Determine preset keywords based on preset search strategies; Determining whether the page element set includes a page element matching the preset keyword; If yes, the page element in the page element set that matches the preset keyword is used as the page element to be processed; If not, the page elements to be processed in the page element set are determined based on a preset element sorting.

7. The data processing method according to claim 1, wherein determining the page element to be processed in the page element set based on a preset search strategy comprises: Determine a preset page location based on a preset search strategy; Determining whether the page element set includes a page element matching the preset page position; If yes, taking the page element in the page element set that matches the preset page position as the page element to be processed; If not, the page elements to be processed in the page element set are determined based on a preset element sorting.

8. The data processing method according to claim 1, wherein determining the initial target page according to the interaction information of the page elements to be processed comprises: Parsing the page element to be processed to obtain interaction information of the page element to be processed, wherein the interaction information includes an initial target page link; An initial target page is determined based on the initial target page link.

9. The data processing method according to claim 1, further comprising: Determine whether the pages to be processed include abnormal pages; In the case that the pages to be processed include an abnormal page, an abnormal page element in the abnormal page is obtained, and the abnormal page is closed based on the abnormal page element.

10. The data processing method according to claim 1, further comprising: Obtaining interaction information of each page element to be processed in the page to be processed; When it is determined that the page information of each interactive information does not include the next level page information, a new page to be processed is determined based on a preset path.

11. A data processing device, comprising: An acquisition module is configured to acquire a set of page elements in a page to be processed; A first determination module is configured to determine the to-be-processed page element in the page element set based on a preset search strategy, wherein the preset search strategy is used to determine to preferentially search the to-be-processed page element in the page element set to explore a path to reach a target page; A judgment module is configured to determine an initial target page according to the interaction information of the page element to be processed, and to judge whether the initial target page is a target page, wherein the initial target page refers to a page determined according to the page information included in the interaction information, and the target page refers to a page corresponding to the project requirement; In the case where the judgment result output by the judgment module is yes, a second determination module is executed, wherein the second determination module is configured to determine that the initial target page is a target page, wherein, in the case where the initial target page is determined to be a target page, a target path to enter the target page is determined; When the judgment result output by the judgment module is negative, the execution module is run, and the execution module is configured to take the initial target page as a new page to be processed and continue to run the acquisition module.

12. A computing device, comprising a memory, a processor, and computer instructions stored in the memory and executable on the processor, wherein the processor implements the steps of the method according to any one of claims 1 to 10 when executing the computer instructions.

13. A computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, implement the steps of the method according to any one of claims 1 to 10.

14. A computer program product, characterized in that The method comprises computer instructions, which, when executed by a processor, implement the steps of the method according to any one of claims 1 to 10.

Images