Web system data static backup method, device, medium and product

By acquiring and storing structured page data and visual screenshots of web systems, the problem of low data migration efficiency in web systems is solved, and complete data backup and page restoration are achieved. This is suitable for domestic migration and compliant archiving of historical systems.

CN120892258BActive Publication Date: 2025-12-09CHANGSHA WANYING TECH DEV CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202511383746.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2025-09-26
Publication Date
2025-12-09
Estimated Expiration
2045-09-26

AI Technical Summary

Technical Problem

In existing technologies, data migration and backup of web systems are inefficient, labor-intensive, require support from the original vendor, and cannot fully back up data and page structure.

Method used

By obtaining the filter elements and header elements of the web system page, an initial list structured data table is created, candidate condition values ​​are combined, a query operation is performed and a screenshot is taken, generating the page structured data and a visual screenshot, forming the final list structured data table.

Benefits of technology

It enables complete backup of web system data, reduces workload, does not rely on vendor support, improves backup efficiency, and can restore page structure. It is suitable for domestic migration and compliant archiving of historical systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120892258B_ABST
    Figure CN120892258B_ABST
Patent Text Reader

Abstract

The application discloses a Web system data static backup method, device, medium and product, relates to the field of data processing, and comprises the following steps: acquiring condition elements, candidate condition values and table header elements of a list page; creating an initial list structured data table and adding preset fields, i.e., the condition elements, the table header elements and column page screenshot identifiers; arranging and combining each candidate condition value; querying each combination; taking a screenshot of a displayed list page for each query, recording the screenshot as a column page screenshot, setting an identifier for the screenshot, and acquiring data corresponding to the table header elements from a new list page; creating a temporary table in the same format as the list structured data table for each new list page, and recording the data corresponding to the candidate condition values and the table header elements and the column page screenshot identifiers into corresponding positions; and adding each temporary table as a subtable into the initial list structured data table to obtain a final list structured data table. The application improves backup efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, in particular to a Web system data static backup method, device, medium and product. BACKGROUND

[0002] In the prior art, data backup is mainly performed in the following ways:

[0003] Migrate the data of the original system, that is, migrate the data of the original system to a new system or data center. However, this method only migrates data, and the backend business logic needs to be understood. In the migration process, all table structures and association relationships are restored, which not only requires a huge amount of work, but also requires technical support from the original manufacturer. Therefore, the migration process is complex, and the efficiency of data backup is low. SUMMARY

[0004] The purpose of the present application is to provide a Web system data static backup method, device, medium and product to solve the technical problems described in the background art.

[0005] To achieve the above-mentioned purpose, the present application provides the following solutions:

[0006] In a first aspect, the present application provides a Web system data static backup method, comprising:

[0007] When the list page is opened for the first time, the conditions elements included in the filter area of the list page and the candidate condition values corresponding to the conditions elements are obtained, and the table header elements of the list area of the list page are extracted, the list page being a page with a filter area in a Web system;

[0008] An initial "list structured data table" is created, and a preset field is added to the initial "list structured data table", the preset field including the condition element field, the table header element field and the list page screenshot identifier field;

[0009] The candidate condition values are arranged and combined to obtain a plurality of candidate condition value combinations;

[0010] For each candidate condition value combination, a query operation is performed once;

[0011] Each time a query operation is performed, a new list page displayed after the query is screenshot, recorded as a list page screenshot, and a list page screenshot identifier is set for the list page screenshot, and data corresponding to the table header elements is obtained from the list area of the new list page;

[0012] For each new list page, create a temporary table in the same format as the initial list structured data table, and record the candidate condition values, data corresponding to the table header elements, and column page screenshot identifiers in the recording areas of the condition element field, the table header element field, and the column page screenshot identifier field of the temporary table, respectively, to obtain multiple temporary tables with page structured data;

[0013] Add each temporary table to the initial list structured data table to obtain a final list structured data table.

[0014] Optionally, the "obtaining each condition element included in the filtering area of the list page and each candidate condition value corresponding to each condition element, and extracting each table header element of the list area of the list page" comprises:

[0015] Obtaining the source code of the list page through a browser automation tool;

[0016] Parsing the source code to obtain the table header elements, the condition elements, and the candidate condition values.

[0017] Optionally, the preset fields of the initial list structured data table further include a current page number and a row number, and when the "recording the candidate condition values, data corresponding to the table header elements, and column page screenshot identifiers in the recording areas of the condition element field, the table header element field, and the column page screenshot identifier field of the temporary table, respectively" is performed, the method further performs: automatically generating a row number for the current page of the temporary table.

[0018] Optionally, the preset fields further include a hash check code field, and after the "performing a query operation each time, taking a screenshot of a new list page displayed after the query as a column page screenshot, setting a column page screenshot identifier for the column page screenshot, and obtaining data corresponding to the table header elements from the list area of the new list page", the method further comprises: setting a hash check code for the column page screenshot; and adding the hash check code to the row corresponding to the hash check code field.

[0019] Optionally, after the "obtaining each condition element included in the filtering area of the list page and each candidate condition value corresponding to each condition element, and extracting each table header element of the list area of the list page" is performed, the method further comprises: removing elements identical to the table header elements from the condition elements.

[0020] Optionally, after the "obtaining multiple temporary tables with page structured data", the method further comprises:

[0021] For each new list page, traverse each row of the new list page, if the row has a next level page link, trigger the next level page link to display the next level page;

[0022] When the next level page is a detail page, take a screenshot of the detail page to obtain a detail screenshot, and set an identifier for the detail screenshot, denoted as a detail screenshot identifier;

[0023] When the next level page is a list page, re-execute "when the list page is first opened" to "obtain a plurality of temporary tables with page structured data", until the next level page is a detail page or there is no next level page.

[0024] Optionally, after the "when the next level page is a detail page, take a screenshot of the detail page to obtain a detail screenshot, and set an identifier for the detail screenshot, denoted as a detail screenshot identifier", the method further comprises: adding a detail screenshot identifier field to the temporary table, and recording the detail screenshot identifier in the row corresponding to the detail screenshot field.

[0025] In a second aspect, the present application provides a computer device, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the method of any one of the first aspect.

[0026] In a third aspect, the present application provides a computer readable storage medium having a computer program stored thereon, wherein the computer program is executed by a processor to implement the steps of the method of any one of the first aspect.

[0027] In a fourth aspect, the present application provides a computer program product comprising a computer program, wherein the computer program is executed by a processor to implement the steps of the method of any one of the first aspect.

[0028] According to the embodiments provided in the present application, the present application has the following technical effects:

[0029] The Web system data static backup method provided by the embodiments of the present application achieves the purpose of Web system data backup by obtaining and storing the page structured data and visual screenshots of each page of the Web system. Compared with the prior art, the data migration method is used for backup. The present application backs up the data of the Web system by using the page structured data and visual screenshots, which not only can completely backup the data and original display page of the Web system, but also makes the data not easy to be tampered with, reduces the workload, and does not need technical support from the manufacturer, thereby improving the efficiency of Web system data backup. BRIEF DESCRIPTION OF DRAWINGS

[0030] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings needed in the embodiments. Obviously, the drawings described below only illustrate some of the embodiments of the present application, and do not illustrate all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative labor should fall within the scope of the present application.

[0031] Figure 1 An application environment diagram of a Web system data static backup method in an embodiment of the present application;

[0032] Figure 2 A flowchart of a Web system data static backup method provided in an embodiment of the present application;

[0033] Figure 3 A diagram of a list page provided in an embodiment of the present application;

[0034] Figure 4 A diagram of a final list structured data table provided in an embodiment of the present application;

[0035] Figure 5 A diagram of a method for obtaining each table header element, each condition element and each candidate condition value provided in an embodiment of the present application;

[0036] Figure 6 A diagram of a Web system data static backup method provided in another embodiment of the present application;

[0037] Figure 7 A diagram of a next level page of a list page provided in an embodiment of the present application;

[0038] Figure 8 A diagram of a Web system data static backup method provided in an embodiment of the present application;

[0039] Figure 9 A diagram of a list structured data table field structure and data source provided in an embodiment of the present application;

[0040] Figure 10 A structural diagram of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0041] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art without creative labor should fall within the scope of the present application.

[0042] The above objects, features and advantages of the present application will become more apparent from the following detailed description considered in conjunction with the accompanying drawings and specific embodiments.

[0043] In addition, before formally introducing the present application, another existing data backup method is introduced:

[0044] The system virtualization method (such as VM snapshot) reserves the entire system, and if data query is needed, the system is restored to provide user query. However, this method faces several problems:

[0045] Capacity problem: complete virtualization of the system requires a large amount of space. Tests show that complete virtualization of an OA system requires 2TB of space, while the present application only requires 120GB.

[0046] Problems caused by system architecture: Some complex systems are not composed of one server, but of multiple servers, which are connected internally through domain names or IP addresses. When migrating data, the IP and routing between servers need to be re-planned to ensure that users can normally access in the future, and the re-planning workload is large.

[0047] Problems of enterprise application environment: Many systems involve data exchange transactions with other systems, and the use of the system needs to rely on the normal operation of the supporting system. Once the system is disabled, the adjustment of the later supporting environment will no longer consider the requirements of the system, and once the environment changes, it will affect the normal use of the system.

[0048] Problems caused by front-end upgrade: Some old systems are based on old versions of browsers and use some special plug-ins and controls, while the front-end application environment is often updated faster, and some browser manufacturers do not support upgrades, which will cause the user's browser to not support the normal display of the original system. If the user forces to use the old version of the browser, there will be security vulnerabilities, such as IE6 browser.

[0049] The Web system data static backup method provided by the embodiment of the present application can be applied to, for example Figure 1The application environment shown in the application environment includes a terminal and a server. The terminal communicates with the server through a network. The data storage system can store data required to be processed by the server. The data storage system can be separately arranged, integrated on the server, or placed on the cloud or other servers. The terminal can send a data backup request to the server. After receiving the data backup request, the server runs the data backup application installed in the server. The server can feed back the process and result of data backup to the terminal. In addition, in some embodiments, the Web system data static backup method can also be implemented by the server or the terminal alone, such as the application software for directly executing data backup by the terminal, or the server obtaining the data to be backed up from the data storage system and performing backup operation on the data to be backed up.

[0050] The terminal can be, but is not limited to, various desktop computers, notebook computers, smart phones, tablet computers, Internet of Things devices, and portable wearable devices. The Internet of Things device can be a smart speaker, a smart television, a smart air conditioner, a smart vehicle-mounted device, etc. The portable wearable device can be a smart watch, a smart bracelet, a head-mounted device, etc. The server can be implemented by an independent server or a server cluster composed of multiple servers, and can also be a cloud server.

[0051] In an exemplary embodiment, referring to Figure 2 A Web system data static backup method is provided, which is executed by a computer device, specifically by a terminal or a server, or by both the terminal and the server. In the embodiments of the present application, the method is applied to the server in Figure 1 The following steps 201 to 203 are included:

[0052] In step 201, when a list page is opened for the first time, each condition element included in the filter area of the list page and each candidate condition value corresponding to each condition element are obtained, and each table header element of the list area of the list page is extracted. The list page is a page with a filter area in the Web system.

[0053] In step 201, the list page is referred to as the current list page, which can be a list page displayed after clicking a page link in the previous list page. Of course, the current list page can also be the first list page.

[0054] In the present application, the pages of the Web system include two types: one is a page with both a filter area and a list area, referred to as a list page, and the other is a page without a filter area and only with a list area, referred to as a detail page.

[0055] When the list page is opened for the first time, the filter area of the list page displays the condition elements, which can also be referred to as Condition_fields, and the list area displays the table header elements, which can also be referred to as Table_fields, according to the current query task. For example, if the query task is "expense analysis", the table header elements corresponding to "expense analysis" are displayed in the table header position of the list area.

[0056] The condition elements generally include multiple condition elements, and each condition element corresponds to multiple candidate condition values.

[0057] The table header elements, which can also be referred to as the fields of the list area, are generally located in the top row of the list area. When the candidate condition values of the condition elements are input and the query is clicked, the related data of the table header elements that meet the candidate condition values is displayed in the list area. It should be noted that at this time, only the condition elements of the filter area and the table header elements of the list area are obtained, and therefore, a specific candidate condition value does not need to be input to select a default condition value.

[0058] For example, referring to Figure 3 FIG. 1 shows a schematic diagram of a list page according to an embodiment of the present application. The year, start and end month, department, subject, project name, procurement auxiliary item, and status in the filter area are condition elements, and the subject, budget data, actual data, available quota, execution rate, and view details in the list area are table header elements. The task name of the query task is expense analysis. In order to facilitate comparison and understanding Figure 3 FIG. 2 is a screenshot of the list page after the candidate condition values are selected.

[0059] The filter area can also be referred to as a search area or a query area.

[0060] In step 202, an initial list structured data table is created, and preset fields are added to the initial list structured data table. The preset fields include the page number, the row number, the condition element field, the table header element field, and the column page screenshot identifier field.

[0061] The initial list structured data table is an empty table, and only the preset fields are added to the table. The preset fields do not have corresponding data.

[0062] The column page screenshot identifier is an identifier set for the screenshot of the list page after the list page is screenshot. At this time, only a field of the column page screenshot identifier is reserved. The column page screenshot identifier is denoted as URI.

[0063] The preset fields are added to the table header position of the empty table.

[0064] In step 203, the candidate condition values are arranged and combined to obtain multiple candidate condition value combinations.

[0065] In this application, the condition element with candidate condition value is the required condition element, and the condition element without candidate condition value is the non-required condition element. In the design of the Web system, the condition element with * represents the required condition element, and the condition element without * represents the non-required condition element.

[0066] Since the non-required condition element needs manual input, it is not collected, such as "all", "not limited", null value, so in this step, only the required condition element is selected.

[0067] In addition, for special fields such as date, a reasonable range value is preset to avoid invalid queries. For example, if the data recorded in the Web system is data after 2020, the starting year of the candidate condition value in the year will start from 2020.

[0068] Step 204, for each candidate condition value combination, perform a query operation once.

[0069] After a query, there may be one new list page or multiple new list pages, which are recorded as a group of list pages. The new list page is displayed in the position corresponding to the table header element in the list area, and the data meets the candidate condition value.

[0070] Each list page included in a group of list pages has the same condition element and table header element, but the specific data corresponding to the table header element is different.

[0071] A group of list pages is a list page corresponding to a candidate condition value combination, so each list page included in the group of list pages has the same condition element and table header element in the filter area and list area.

[0072] It should be noted that the new list page at this time is the list page after selecting the candidate condition value for the condition element in the list page in step 201, so the new list page and the list page in step 201 are sibling list pages.

[0073] Step 205, for each query operation, take a screenshot of the new list page displayed after the query, record it as a column page screenshot, set a column page screenshot identifier for the column page screenshot, and obtain the data corresponding to the table header element from the list area of the new list page.

[0074] Among them, the column page screenshot can be named as {page name}_{list name}_page{page code 1}, saved in PNG format, and used as the URI of the column page screenshot.

[0075] In addition, the page name in it is usually consistent with the list name.

[0076] Exemplarily, still taking the above example, the name is "Fees Analysis_Fees Analysis_Page 1".

[0077] In step 206, for each new list page, a temporary table with the same format as the initial "list structured data table" is created, and the page number, row number, each candidate condition value, data corresponding to the table header element, and column page screenshot identifier are recorded in the recording area of the condition element field, the table header element field, and the column page screenshot identifier field of the temporary table respectively, to obtain multiple temporary tables with page structured data.

[0078] Exemplarily, referring to Figure 4 , a final "list structured data table" is shown. In combination with the figure, step 206 can be understood as: each new list page corresponds to a temporary table, which records the data of the list page. Fill each candidate condition value in the candidate condition value combination used in this query into all rows of each condition element field; record the data corresponding to the table header element into all rows of the corresponding table header element field, and record the column page screenshot identifier into all rows corresponding to the column page screenshot identifier field, that is, the column page screenshot identifier field fills all the column page screenshot identifiers.

[0079] The recording area is an area for writing data, and each candidate condition value field, table header element field, and column page screenshot identifier field are written into the first row of the list area, thereby serving as the fields of the list area.

[0080] In addition, the temporary table is consistent with the number of rows in the list area, and the order is ensured by the row number.

[0081] In step 207, each of the temporary tables is added to the initial "list structured data table" to obtain a final "list structured data table".

[0082] In addition, it should be noted that steps 201-207 are operation steps assuming that there is no sub-page in the current list page. After step 207 is completed, the data backup of the current list page is completed.

[0083] In addition, the data directly displayed on the list column involved in steps 201-207 can be obtained by parsing the DOM of the list page or by OCR.

[0084] The Web system data static backup method provided by the embodiments of the present application realizes the purpose of Web system data backup by acquiring and storing the page structured data and visual screenshots of each page of the Web system. Compared with the prior art, the method of data migration is used for backup; the present application backs up the data of the Web system by page structured data and visual screenshots, which not only can completely backup the data of the Web system, but also makes the data not easy to be tampered with, reduces the workload, and does not need technical support of the manufacturer, and improves the efficiency of Web system data backup.

[0085] In addition, in the prior art, since the page structured data is not backed up, when the user needs to use these data, the original page combination form cannot be restored; and the present application can restore the page combination form by structured data and visual screenshots.

[0086] In addition, the present application is particularly suitable for the compliance archiving of the history system in the process of localization migration or other replaced systems, which significantly reduces the storage requirement while retaining the original interactive form, and solves the problems of business logic black box and strong system dependency faced by the traditional migration scheme.

[0087] Optionally, referring to Figure 5 In another exemplary embodiment of the present application, the above step 201 is replaced by the following steps 301 and 302:

[0088] Step 301: acquiring the source code of the list page by a browser automation tool.

[0089] Step 302: parsing the table header elements, the condition elements and the candidate condition values from the source code.

[0090] The browser automation tool can be a script running tool capable of crawling page data and taking screenshots of the page, such as Selenium, Playwright, etc.

[0091] The source code includes HTML / XML, CSS, DOM and JavaScript.

[0092] In addition, in most cases, the Web system is a DOM application, and the above browser automation tool can be used to acquire page data. For part of the non-DOM application, the list page can be taken a screenshot, and then the list page after the screenshot can be recognized by OCR to identify the condition elements, the table header elements and the positions of the elements.

[0093] In addition, according to the enterprise-level management system design specification, the list page includes, in addition to the filtering area and the list area, the top bar, the side bar, the detail area, and the like. The data of these functional areas can also be obtained by using the steps 301 and 302.

[0094] Further, the positions of the functional areas can also be obtained by using a browser automation tool, and then parsed. Of course, the positions can also be obtained by using an OCR method after taking a screenshot of the page.

[0095] The position of each element is the coordinate position of the element in the list page.

[0096] After obtaining the positions of the functional areas, the optional condition element and the position of the list can be identified based on the positions of the functional areas. For a page that can only be recognized by an OCR, the positions are used to automatically simulate the positioning of the mouse position of the manual time.

[0097] Optionally, in another exemplary embodiment of the present application, the preset field of the initial “list structured data table” further includes a row number, and the step 206 further includes the following step 401: automatically generating the row number of the current page for the temporary table.

[0098] The unique row number ID automatically generated by the system: the system generates a row number for each row in the temporary table, which is the row order number of the current list page. The page number is generated according to the page number.

[0099] For example, there are 7 list pages, and each page has 10 rows. The row numbers are 1-10, which are filled into each row of the “row number” field of the temporary table, and the page numbers are numbered from 1-7.

[0100] Optionally, in another exemplary embodiment of the present application, the preset field further includes a hash check code field. After the step 205, the method further includes the step 501 of setting a hash check code for the column page screenshot. The step 206 further includes: adding the hash check code to the row corresponding to the hash check code field.

[0101] Optionally, the hash check code is generated by the following method: calculating the structured data text of each row of the “list structured data table” and the binary stream of the column page screenshot (all rows correspond to the same column page screenshot) to obtain a multi-modal hash value. Further, the composition of the hash value includes: a data version number (to prevent the system upgrade from causing the check to fail) and a timestamp (accurate to milliseconds).

[0102] The application establishes a unique URI association system for the visual screenshot, regenerates a multi-modal hash check code containing a version number and a timestamp, and archives and stores in a standardized WARC format, thereby not only realizing complete backup of the front-end interface and business data, but also realizing two-way verifiable association of data-screenshot and improving data security.

[0103] Optionally, in another exemplary embodiment of the application, after step 201, the method further comprises step 601: removing the same element as the table header element from the condition element.

[0104] Since some elements of the condition element and the table header element are repeated, the repeated elements can be removed, reducing the data volume and improving the backup speed.

[0105] For example, referring to Figure 4 , there is a "subject" in the condition element and a "subject" in the table header element, so one "subject" is removed. In this way, when creating the list structured data table, one field can be reduced.

[0106] Optionally, referring to Figure 9 , the field structure and data source of the list structured data table are shown:

[0107] 1. Screenshot information, data is the URI of the current page screenshot;

[0108] 2. Record position and sequence information, including page number and line number. The page number data corresponds to the current page code displayed by the list; the line number data is the sequence number coded by the program from 1 according to the sequence of the list line;

[0109] 3. Query condition expansion information area, including year, start and end month, department. The data is taken from the current value of the query condition.

[0110] 4. List information area, including all fields of the list page. The data is taken from all data in the list.

[0111] 5. Subordinate link area. The data source is the subordinate list structured data table URI or detail URI corresponding to each row.

[0112] 6. Check code area. The data source is the hash check code generated for each row.

[0113] Optionally, referring to Figure 6 , in another exemplary embodiment of the application, after step 206, the method further comprises steps 701-703:

[0114] Step 701, for each new list page, traverse each row of the new list page, if the row has a next level page link, trigger the next level page link to display the next level page.

[0115] Exemplarily, as shown in Figure 7 , a next level page of a list page is shown, which is a page after clicking "view details" in the list page. Further, when clicking "view bill" in the "fee details table" page, a next level page is displayed.

[0116] If the current row has no next level page link, continue to traverse the next row until all rows of the new list page are traversed.

[0117] Step 702, when the next level page is a detail page, take a screenshot of the detail page to obtain a detail screenshot, and set an identifier for the detail screenshot, denoted as a detail screenshot identifier.

[0118] The detail screenshot identifier is represented by a URI.

[0119] The obtained detail page DOM is parsed to obtain data of the detail page.

[0120] Further, the detail screenshot is named according to the rule {page name fee details table}_{page number}_{row number}_detail_{subpage name shit123, etc.}.png, stored in PNG format, and the URI of the detail screenshot is generated, and the value of the URI is filled into the corresponding row of the temporary table; wherein if the detail page has multiple subpages, take screenshots respectively, denoted as sub-detail screenshots, and the names are distinguished by {subpage name}.

[0121] Step 703, when the next level page is a list page, re-execute the steps 201-206 until the next level page is a detail page or there is no next level page.

[0122] In this case, the data of the list area of the next level page is added to the temporary table corresponding to the parent list page.

[0123] In addition, in the prior art, there are some simple backup methods: regardless of the process record of the history formation of data, only the remaining data is migrated, which will result in a large amount of process data being unable to be preserved. For example, ERP, financial system, etc. cannot restore and preserve each business record of the process; and the present application can restore and preserve each business record of the process by performing backup on the pages level by level, so as to realize independent retrieval and display independent of the original system environment.

[0124] Optionally, in another exemplary embodiment of the present application, after the step 702, the method further comprises a step 801 of adding a detail screenshot identification field to the temporary table and recording the detail screenshot identification in the row corresponding to the detail screenshot field.

[0125] When there are multiple sub-detail screenshots, multiple detail screenshot identifications can be saved in the "detail screenshot identification" field.

[0126] Further, referring to Figure 8 After the backup is completed, the archived data is archived: the final "list structured data table" is converted into JSON format, TXT format, Excel format and other storage formats, all pictures are saved in the resource directory, and are converted into WARC format for storage.

[0127] Further, auxiliary files can also be generated to facilitate the management of the archived data, and the auxiliary files include:

[0128] Page structure description file: field meta information (field name, type, constraint) is saved separately.

[0129] Query condition index file: records all filterable fields and their unique value sets.

[0130] Global mapping file: maintains the index of row ID->WARC record ID to accelerate retrieval.

[0131] Further, the above WARC file and its associated index (including structured data table, query condition file, global mapping file) are standardized as an archive package, which can support the following functions through a preset parsing engine:

[0132] Multi-modal data retrieval: quickly locate data and associated screenshots based on row ID, field value or time range.

[0133] Interactive restoration: reconstruct the core interaction logic and data display of the original page by parsing the DOM structure and dynamic event record.

[0134] Integrity verification: use multi-modal hash code to implement data-screenshot consistency check.

[0135] In an exemplary embodiment, a computer device, which can be a server or a terminal, is provided, and its internal structure diagram can be seen from Figure 10As shown in the figure. The computer device includes a processor, a memory, an input / output interface (I / O for short) and a communication interface. Among them, the processor, the memory and the input / output interface are connected through the system bus, and the communication interface is connected to the system bus through the input / output interface. Among them, the processor of the computer device is used to provide computing and control capability. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store multi-modal Web system data static backup related data. The input / output interface of the computer device is used to exchange information between the processor and external devices. The communication interface of the computer device is used to communicate with external terminals through network connection. The computer program is executed by the processor, and a Web system data static backup method can be realized.

[0136] Those skilled in the art can understand that, Figure 10 The structure shown in the figure is only a block diagram of part of the structure related to the scheme of the present application, and does not constitute a limitation on the computer device to which the scheme of the present application is applied. The specific computer device can include more or fewer components than those shown in the figure, or combine certain components, or have a different component arrangement.

[0137] In one exemplary embodiment, a computer device is also provided, including a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the steps in each of the above method embodiments.

[0138] In one exemplary embodiment, a computer readable storage medium is provided, storing a computer program, which is executed by a processor to implement the steps in each of the above method embodiments.

[0139] In one exemplary embodiment, a computer program product is provided, including a computer program, which is executed by a processor to implement the steps in each of the above method embodiments.

[0140] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present application are all information and data agreed by the user or fully agreed by all parties, and the collection, use and processing of related data need to comply with relevant regulations.

[0141] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage medium, and when the computer program is executed, the processes of the above-mentioned embodiments of the methods can be included. In the embodiments provided in the present application, any reference to the memory, database or other medium can include at least one of the non-volatile and volatile memories. The non-volatile memory can include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory, optical storage, high-density embedded non-volatile memory, resistive memory (ReRAM), magnetoresistive random access memory (Magnetoresistive Random Access Memory, MRAM), ferroelectric memory (Ferroelectric Random Access Memory, FRAM), phase change memory (Phase Change Memory, PCM), graphene memory, etc. The volatile memory can include random access memory (Random Access Memory, RAM) or external cache memory, etc. As an illustration but not limitation, the RAM can be in various forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, DRAM), etc.

[0142] The database involved in the embodiments provided in the present application can include at least one of a relational database and a non-relational database. The non-relational database can include a distributed database based on a block chain, etc., without being limited thereto. The processor involved in the embodiments provided in the present application can be a general processor, a central processor, a graphics processor, a digital signal processor, a data processing logic of a programmable logic device, etc., without being limited thereto.

[0143] The technical features of the above embodiments can be combined arbitrarily. In order to make the description simple, all possible combinations of the technical features in the above embodiments are not described, but as long as the combinations of the technical features do not exist, they should be considered as the scope of the present application.

[0144] The principles and implementation modes of the present application are described by using specific examples in the present application. The above embodiments are only used to help understand the method and its core idea of the present application; at the same time, for those skilled in the art, according to the idea of the present application, the specific implementation mode and application range will be changed. In conclusion, the content of the present application should not be understood as a limitation.

Claims

1. A method for backing up static data of a Web system, characterized by, The method comprises the following steps: When a list page is opened for the first time, each condition element included in a filtering area of the list page and each candidate condition value corresponding to each condition element are obtained, and each table header element of a list area of the list page is extracted, the list page being a page with a filtering area in a Web system; An initial "list structured data table" is created, and preset fields are added to the initial "list structured data table", the preset fields including a condition element field, a table header element field and a list page screenshot identifier field; Each candidate condition value is arranged and combined to obtain a plurality of candidate condition value combinations; For each candidate condition value combination, a query operation is performed once; Each time the query operation is performed, a new list page displayed after the query is screenshot, recorded as a list page screenshot, and a list page screenshot identifier is set for the list page screenshot, and data corresponding to the table header element is obtained from a list area of the new list page; For each new list page, a temporary table with the same format as the initial "list structured data table" is created, and the candidate condition values, the data corresponding to the table header element and the list page screenshot identifier are recorded in the recording areas of the condition element field, the table header element field and the list page screenshot identifier field of the temporary table respectively to obtain a plurality of temporary tables with page structured data; Each temporary table is added to the initial "list structured data table" to obtain a final "list structured data table".

2. The method of claim 1, wherein, The "obtaining each condition element included in the filtering area of the list page and each candidate condition value corresponding to each condition element, and extracting each table header element of the list area of the list page" comprises the following steps: The source code of the list page is obtained through a browser automation tool; The table header elements, the condition elements and the candidate condition values are parsed from the source code.

3. The method of claim 1, wherein the Web system data staticization backup method is characterized by, If the preset fields of the initial "list structured data table" further include a current page number and a line number, when the "recording the candidate condition values, the data corresponding to the table header element and the list page screenshot identifier in the recording areas of the condition element field, the table header element field and the list page screenshot identifier field of the temporary table respectively" is performed, the method further comprises automatically generating a line number for the current page of the temporary table.

4. The method of claim 3, wherein, If the preset fields further include a hash check code field, after the "each time the query operation is performed, the new list page displayed after the query is screenshot, recorded as a list page screenshot, and a list page screenshot identifier is set for the list page screenshot, and the data corresponding to the table header element is obtained from the list area of the new list page", the method further comprises setting a hash check code for the list page screenshot, and adding the hash check code to the line corresponding to the hash check code field.

5. The method of claim 1, wherein, After the "when the list page is opened for the first time, each condition element included in the filtering area of the list page and each candidate condition value corresponding to each condition element are obtained, and each table header element of a list area of the list page is extracted", the method further comprises removing elements identical to the table header elements from the condition elements.

6. The method of claim 1, wherein, After the "obtaining a plurality of temporary tables with page structured data", the method further comprises the following steps: For each new list page, traverse each row of the new list page, if the row has a next level page link, trigger the next level page link to display the next level page; When the next level page is a detail page, take a screenshot of the detail page to obtain a detail screenshot, and set an identifier for the detail screenshot, denoted as a detail screenshot identifier; When the next level page is a list page, re-execute "when the list page is first opened” to "obtain a plurality of temporary tables with page structured data” until the next level page is a detail page or there is no next level page.

7. The method of claim 6, wherein, After the "when the next level page is a detail page, take a screenshot of the detail page to obtain a detail screenshot, and set an identifier for the detail screenshot, denoted as a detail screenshot identifier”, the method further comprises: adding a detail screenshot identifier field to the temporary table, and recording the detail screenshot identifier in the row corresponding to the detail screenshot field.

8. A computer device comprising: A memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that the processor executes the computer program to implement the Web system data static backup method of any one of claims 1-7.

9. A computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program is executed by the processor to implement the Web system data static backup method of any one of claims 1-7.

10. A computer program product comprising a computer program, characterized in that, The computer program is executed by the processor to implement the Web system data static backup method of any one of claims 1-7.

Citation Information

Patent Citations

  • Method, device and system for screening webpage page data

    CN102073747A

  • Webpage table data acquisition method and device, computer equipment and storage medium

    CN110825944A