Page information display methods, systems, and storage media
By improving the data collection and classification display methods on both the client and server sides, the problems of incomplete data collection and unintuitive display in existing technologies are solved, enabling rapid identification of client-side anomalies.
Patent Information
- Application Number
- CN202010079482.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-02-04
- Publication Date
- 2025-10-31
- Estimated Expiration
- 2040-02-04
AI Technical Summary
Existing technologies struggle to collect comprehensive data when locating client-side issues, are cumbersome to operate, and do not provide intuitive results, making it difficult to pinpoint anomalies.
By sending page information retrieval requests to the terminal, using a software development kit to collect page datasets, and then classifying and displaying the data on the server side, comprehensive data collection and intuitive display can be achieved.
It enables rapid restoration of client status, improves the success rate of locating anomalies, simplifies the operation process, and reduces access costs.
Smart Images

Figure CN113220958B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of Internet communication technology, and in particular to a method, system and storage medium for displaying page information. Background Technology
[0002] Current technologies for locating client-side issues require considering various causes, each of which needs to be broken down into logical points. For example, whether an H5 page was successfully opened needs to be broken down into events related to opening the H5 page link and displaying key information on the H5 page. These trigger points are then embedded in the page coding process. However, it's difficult to consider all possible causes, and embedding them in the code is cumbersome.
[0003] Traditional solutions rely on event tracking to collect client information, which is not only cumbersome to operate but also has a limited amount of data collected, making it prone to errors and omissions. In addition, the results of traditional solutions are mostly displayed in reports, which are not very intuitive and make it difficult to locate problems.
[0004] Therefore, it is necessary to provide a method, system, and storage medium for displaying page information to quickly restore the client's status, thereby facilitating the rapid location of abnormal issues. Summary of the Invention
[0005] This application provides a method, system, and storage medium for displaying page information, which can quickly restore the client's status, thereby facilitating the rapid location of abnormal issues.
[0006] On the one hand, this application provides a method for displaying page information, the method comprising:
[0007] A page information retrieval request is sent to the terminal, the page information retrieval request carrying page configuration information; so that the terminal, based on the page information retrieval request, collects a page dataset that matches the page configuration information through a software development kit;
[0008] Receive the processed page dataset sent by the terminal;
[0009] The processed page dataset is then categorized according to its representation category.
[0010] Based on the page data corresponding to each representation category, determine the page information corresponding to each representation category;
[0011] Display the page information corresponding to each of the aforementioned representation categories.
[0012] On the other hand, a method for displaying page information is provided, the method including:
[0013] Receive a page information retrieval request sent by the server, the page information retrieval request carrying page configuration information;
[0014] Based on the page information retrieval request, a page dataset matching the page configuration information is collected using a software development kit;
[0015] The server sends the processed page dataset to the server so that the server can classify the data in the processed page dataset according to the representation category; determine the page information corresponding to each representation category based on the page data corresponding to each representation category; and display the page information corresponding to each representation category.
[0016] On the other hand, a page information display system is provided, the system including a terminal and a server.
[0017] The terminal is configured to collect a page dataset that matches the page configuration information using a software development kit based on a page information retrieval request; and to send the processed page dataset to the server.
[0018] The server is configured to send a page information retrieval request to the terminal, the page information retrieval request carrying page configuration information; classify the centralized data of the processed page dataset according to the representation category; determine the page information corresponding to each representation category based on the page data corresponding to each representation category; and display the page information corresponding to each representation category.
[0019] On the other hand, a computer-readable storage medium is provided, which stores at least one instruction or at least one program, which is loaded and executed by a processor to implement the page information display method as described above.
[0020] The page information display method, system, and storage medium provided in this application have the following technical effects:
[0021] (1) This application relies on the SDK to complete the collection independently, which is transparent to the business and can be accessed once, making the operation simple.
[0022] (2) This application collects a wider range of data, covering almost all information of the client, avoiding the problem of missing or incorrect information data collection that would prevent the location from being restored.
[0023] (3) Compared with the original solution, which requires a relatively heavy workload to add statistical points in the business, the access cost of this application is very low and there is basically no additional development workload. Attached Figure Description
[0024] To more clearly illustrate the technical solutions and advantages in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0025] Figure 1 This is a schematic diagram of a system provided in an embodiment of this application;
[0026] Figure 2 This is a flowchart illustrating a page information display method provided in an embodiment of this application;
[0027] Figure 3 This is a schematic diagram of the structure of the page dataset provided in the embodiments of this application;
[0028] Figure 4 This is a flowchart of the webworker processing provided in the embodiments of this application;
[0029] Figure 5 This is a flowchart of the page information display method provided in the embodiments of this application;
[0030] Figure 6 This is a flowchart illustrating another method for displaying page information provided in an embodiment of this application;
[0031] Figure 7 This is a flowchart illustrating another method for displaying page information provided in an embodiment of this application;
[0032] Figure 8 This is a schematic diagram of the structure of a page information display server provided in an embodiment of this application;
[0033] Figure 9 This is a schematic diagram of the structure of a page information display terminal provided in an embodiment of this application. Detailed Implementation
[0034] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.
[0035] It should be noted that the terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this application described herein can be implemented in orders other than those illustrated or described herein. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion; for example, a process, method, system, product, or server that comprises a series of steps or units is not necessarily limited to those steps or units explicitly listed, but may include other steps or units not explicitly listed or inherent to such processes, methods, products, or devices.
[0036] The following is an explanation of the terms used in this application.
[0037] DOM & Document: Document Object Model. The DOM is a W3C standard that defines the standards for accessing HTML and XML documents. Within the W3C standard, the DOM is a platform- and language-independent interface that allows programs and scripts to dynamically access and update the content, structure, and style of documents.
[0038] HTML (HyperText Markup Language) is a standard markup language used to create web pages.
[0039] H5: The latest revision of HTML
[0040] JS: JavaScript is an interpreted scripting language. It is a dynamically typed, weakly typed, prototype-based language with built-in type support. Its interpreter, called the JavaScript engine, is part of the browser.
[0041] CSS (Cascading Style Sheets) is a computer language used to add styles (fonts, spacing, colors, etc.) to structured documents (such as HTML documents or XML applications). It is defined and maintained by the W3C. The latest version is CSS2.1, which is the W3C recommendation. CSS3 is now supported by most modern browsers.
[0042] Client: A client, also known as a user terminal, refers to a program that provides local services to a client in contrast to a server. Except for some applications that run only locally, they are generally installed on ordinary client machines and need to work in conjunction with the server. With the development of the Internet, commonly used client applications include web browsers used for the World Wide Web, email clients for sending and receiving emails, and instant messaging client software. For these types of applications, corresponding servers and service programs on the network are required to provide the corresponding services, such as database services, email services, etc. Therefore, a specific communication connection needs to be established between the client and the server to ensure the normal operation of the application.
[0043] URL: Uniform Resource Locator (URL) is a method of representing the location of information on the World Wide Web (WWW) service. It was originally invented by Tim Berners-Lee as a address for the WWW. It has now been adopted as an Internet standard (RFC 1738) by the World Wide Web Consortium.
[0044] APP: Mobile software, mainly referring to software installed on smartphones, improves upon the shortcomings of the original system and provides personalization. It is the main means of enhancing the functionality of mobile phones and providing users with a richer user experience.
[0045] SDK: Software Development Kit, which is generally a collection of development tools used by software engineers to create application software for specific software packages, software frameworks, hardware platforms, operating systems, etc.
[0046] Please see Figure 1 , Figure 1 This is a schematic diagram of a system provided in an embodiment of this application, such as... Figure 1 As shown, the system may include at least server 01 and client 02.
[0047] Specifically, server 01 may include a standalone server, a distributed server, or a server cluster consisting of multiple servers. Server 03 may include network communication units, processors, and memory, etc. Server 01 can provide backend services to client 02.
[0048] Specifically, client 02 can include physical devices such as smartphones, tablets, laptops, digital assistants, smart wearable devices, and in-vehicle terminals, or software running on physical devices.
[0049] The following describes the page information display method based on the above system in this application. Figure 2This is a flowchart illustrating a method for displaying page information according to an embodiment of this application. This specification provides method operation steps as shown in the embodiments or flowcharts, but based on conventional or non-inventive methods, more or fewer operation steps may be included. The order of steps listed in the embodiments is merely one possible execution order among many and does not represent the only possible execution order. In actual system or server product execution, the method can be executed sequentially according to the embodiments or drawings, or in parallel (e.g., in a parallel processor or multi-threaded processing environment). Specifically, as shown... Figure 2 As shown, the method may include:
[0050] S201: The server sends a page information retrieval request to the terminal, which carries page configuration information.
[0051] In the embodiments described in this specification, the server can provide background services to the terminal, and the page configuration information can include different configuration information for multiple scenarios. Specifically, it can include:
[0052] In the embodiments described in this specification, in order to balance the opposing goals of collecting as much information as possible and storing as little information as possible, a remote control client capability is required. The initial configuration retrieval is for this purpose, and the configurations are for the following scenarios.
[0053] (1) Gray-scale full reporting. During the gray-scale testing phase of a business application, the number of requests is generally very small, but there are relatively high requirements for the real-time performance and coverage of monitoring. In this case, full reporting will be set up.
[0054] (2) Report as needed after launch. During the business launch phase, the system is relatively stable, and it is generally set to report only after a specific anomaly occurs, or to be reported along with the user feedback entry.
[0055] (3) Dynamically distribute reporting strategies. In addition, for some services that still have a large reporting volume after classification and configuration, it also supports dynamically setting the gray scale ratio to limit the balance between the amount of reported data and the monitoring effect.
[0056] In this embodiment of the specification, before the step of the server sending a page information retrieval request to the terminal, the method further includes:
[0057] The server identifies the target terminal;
[0058] Accordingly, the server sends a page information retrieval request to the terminal, including:
[0059] The server sends a request to the target terminal to retrieve page information.
[0060] S203: Based on the page information retrieval request, the terminal collects a page dataset that matches the page configuration information through a software development kit;
[0061] In the embodiments of this specification, the page dataset represents user operation behavior, changes in page attribute information, and the processing logic for exceptions and request information; such as Figure 3 As shown, the page dataset may include at least one of the following: user operation behavior, changes in page attribute information and anomalies (invisible information to the user), and processing logic for request information (changes in visible page information to the user).
[0062] User actions can include click events, scroll events, input / select events, mouse events, and touch events. Through the global event listener interface provided by HTML5, information can be collected by listening to each of these event types.
[0063] Changes and anomalies in page attribute information, i.e., information invisible to the user. For this type of page dataset, during page restoration, the page change process can be broken down into page snapshots and incremental page changes. Page snapshots are relatively simple; the DOM tree can be serialized according to a JSON structure and numbered. Incremental page changes rely on the MutationObserver API. Modern browsers almost universally support this interface. Through this interface, we only need to listen for all page changes, just like listening for user behavior. When a change occurs, we compare it with the existing complete page image and generate a JSON description of the timestamp increment. Changes in page attribute information can include adding, deleting, querying, and modifying DOM nodes, DOM style transformations, CSS animations, and canvas (which cannot be replayed).
[0064] The processing logic for request information, i.e., errors and requests invisible to the user, is also categorized and collected. User-invisible information can include HTTP requests, error messages, and console information. Front-end error capture and collection are already quite mature; here, we need to collect additional console error logs because the business logic itself captures errors, making global capture impossible. `console.error` can provide supplementary information. For request information, proxying the native `xmlhttprequest` and using modern browser fetch methods can cover most of the request information records.
[0065] S205: The terminal sends the processed page dataset to the server;
[0066] In the embodiments of this specification, before the step of the terminal sending the processed page dataset to the server, the method may further include:
[0067] S204: The terminal preprocesses the data in the page dataset to obtain the processed page dataset;
[0068] In the embodiments described in this specification, the terminal preprocesses the data in the page dataset to obtain the processed page dataset, which includes:
[0069] The terminal centrally stores the page data into the cache database;
[0070] When the storage space of the cache database is less than a preset threshold, the terminal compresses the page data in the cache database to obtain a compressed dataset.
[0071] The terminal uses the compressed dataset as the processed page dataset;
[0072] In the embodiments described in this specification, if data is reported in real time using conventional methods, the number of requests required for reporting would be large. Browsers have limitations on the number of concurrent requests, which would affect normal business requests. Therefore, a strategy of caching first and then merging the reports is necessary. The instantaneous amount of monitored data is relatively large, and using localStorage for caching can easily exceed the limit, impacting business operations using localStorage. Therefore, IndexDB is used for data caching. Its capacity is large, making it relatively difficult to exceed the limit, and business operations rarely use IndexDB, thus minimizing the impact on business operations.
[0073] In the embodiments of this specification, since the monitoring data has a high degree of repetition, gzip can be used to achieve a good compression ratio. The reported data is compressed on the client side and decompressed on the server side, thus avoiding a large loss of user traffic.
[0074] Accordingly, before the step of classifying the data in the processed page dataset according to the representation category, the method further includes:
[0075] The server decompresses the compressed dataset to obtain the decompressed dataset;
[0076] The server uses a hash algorithm to identify and remove duplicate data in the decompressed dataset, thus obtaining a deduplicated dataset.
[0077] The server stores the deduplicated dataset.
[0078] In the embodiments described in this specification, data storage compression is required. While direct compression significantly reduces data size, it also makes querying highly inflexible. Since replaying user behavior may span multiple time periods and sessions, inflexible queries cannot meet these needs. Therefore, a simple merging approach is adopted. For page-mirrored data, the data is highly likely to be identical for the same business logic. Using hashing and indexing for deduplication can greatly reduce the data volume. Specifically, feature points can be extracted, hash values constructed, and duplicate data removed.
[0079] In this embodiment of the specification, before the step of compressing page data in the cached database to obtain a compressed dataset, the method further includes:
[0080] The terminal determines the amount of page data stored for each application at preset time intervals.
[0081] The terminal determines whether the data storage amount of the page corresponding to each application is greater than the preset storage threshold.
[0082] The terminal identifies applications whose page data storage size exceeds a preset storage threshold as target applications.
[0083] The terminal deletes the target historical data corresponding to the target application based on preset rules.
[0084] In the embodiments of this specification, the preset time period can be set according to the actual situation, for example, it can be set to 20 minutes; since the amount of information collected for user behavior playback is much larger than that of a general monitoring system, although a series of optimization methods have been implemented to compress the data volume, it is still impossible to guarantee that the data entering the database will not exceed the limit due to a surge in business access, which would cause a series of problems affecting service stability. Therefore, the current storage volume of each app can be dynamically calculated every 20 minutes to see if it is close to the limit, and old data can be eliminated according to a predetermined strategy if necessary.
[0085] In this embodiment of the specification, before the step of the terminal storing the page dataset centrally to the cache database, the method further includes:
[0086] The terminal deletes the target page data in the page dataset to obtain a simplified dataset. The target page data includes document object model attribute information data, cascading style sheet data, and script language data.
[0087] The terminal uses worker threads to serialize the simplified dataset.
[0088] In the embodiments of this specification, in order to save as little information as possible, it is necessary to distinguish between useful and useless data and avoid collecting unnecessary data as much as possible. For example, useless DOM attributes are removed and not recorded, inline CSS styles that do not change frequently are removed, and useless JavaScript resources are removed (since all page changes have been recorded, it is no longer necessary to rely on the original script execution to trigger changes. On the contrary, the original script execution may cause repetitive behavior and affect the playback of page data).
[0089] In the embodiments of this specification, the worker thread can be a Web Worker. Data collected from the front end needs to undergo serialization, which inevitably consumes browser resources. Furthermore, the browser's JavaScript execution is serial with event callbacks, and collecting user behavior data requires serializing the raw data, which is a computationally intensive operation that will definitely consume processing resources and affect normal business logic. To solve this problem, a Web Worker is introduced, and the main collection behavior of the monitoring SDK is extracted and executed within the Web Worker to avoid impacting the main page process. The Web Worker processing flowchart is as follows: Figure 4 As shown, the main process of the page executes the following steps:
[0090] S401: SDK initialization operation;
[0091] S403: Listen for page changes and send information to the webworker process;
[0092] The execution steps of a Webworker process include:
[0093] S405: Initialize worker;
[0094] S407: Receives information sent by the main page process and performs message listening;
[0095] S409: Process and report the monitored messages.
[0096] S207: The server will classify the data in the processed page dataset according to the representation category;
[0097] In the embodiments described in this specification, the server classifies the data in the processed page dataset according to the representation category, including:
[0098] The server uses the dataset representing user actions from the processed page dataset as the first dataset.
[0099] In the embodiments described in this specification, the server classifies the data in the processed page dataset according to the representation category, including:
[0100] The server uses the dataset representing changes in page attribute information from the processed page dataset as the second dataset.
[0101] In the embodiments of this specification, the server classifies the data in the processed page dataset according to the representation category, including:
[0102] The server uses the dataset representing the processing logic of exceptions and request information in the processed page dataset as a third dataset.
[0103] S209: The server determines the page information corresponding to each representation category based on the page data corresponding to each representation category;
[0104] In the embodiments described in this specification, the server determines the page information corresponding to each representation category based on the page data corresponding to each representation category, which may include:
[0105] The server determines the page corresponding to the user's action based on the first dataset;
[0106] The server determines the node corresponding to the user's action by searching the document object model;
[0107] The server creates page information corresponding to the user's actions based on the corresponding pages and nodes.
[0108] In the embodiments of this specification, the server determines the page information corresponding to each representation category based on the page data corresponding to each representation category, including:
[0109] The server determines the original page attribute information and the changed page attribute information based on the second dataset;
[0110] The server uses a scripting language to simulate page information corresponding to a dataset representing changes in page attribute information.
[0111] In the embodiments of this specification, the server determines the page information corresponding to each representation category based on the page data corresponding to each representation category, including:
[0112] Based on the third dataset, the server determines the page information corresponding to the dataset representing the processing logic of exceptions and request information.
[0113] In this embodiment of the specification, the page restoration process uses JavaScript to generate the page from the previously reported serialized DOM tree, but does not directly use the URL to restore the page. This is because, firstly, if the page is updated, it's impossible to restore it to its previous state. Secondly, using the URL cannot remove script content associated with the business logic, which would lead to repeated playback when replaying user actions.
[0114] Reconstructing a page using a DOM tree involves distinguishing different DOM nodes, calling the page element generation module (document.createElement) to generate the corresponding nodes, and using the attribute setting interface (setAttribute) to set the node attributes.
[0115] After restoring the page, the next step is to restore the user's behavior and the page's response, which is divided into three categories:
[0116] For user-triggered events, the JavaScript `dispatchEvent` is used. Using `dispatchEvent` to simulate an event requires knowing the event type, the node where it occurs, and the different parameters required for different events, such as the input value for an input event. The event type and related parameters can be directly collected and reconstructed, while the event node needs to be found by searching the DOM tree using the recorded node coordinates.
[0117] The page response is simulated directly using JavaScript. Page response mainly involves style changes and node changes. Style changes can be achieved by setting the `style` attribute of nodes using JavaScript. To add a node, use `document.createElement` to create the new node and then use `document.appendChild` to insert it into the DOM tree. To remove a node, use `document.remove()`.
[0118] Error and request information are displayed directly in a floating window. Errors and API requests are actions of the page backend and cannot be directly seen by the user, but they are an indispensable part of the page replay. The processing logic here is relatively simple: just display the error information or request path, parameters and response collected by the frontend.
[0119] S2011: The server displays the page information corresponding to each representation category.
[0120] In this embodiment of the specification, before the step of the server displaying the page information corresponding to each representation category, the method further includes:
[0121] The server converts the page information corresponding to each representation category into multimedia information;
[0122] Accordingly, the server displays the following page information for each representation category:
[0123] The server plays multimedia information corresponding to each representation category.
[0124] In the embodiments of this specification, multimedia information may be audio information or video information.
[0125] In the embodiments of this specification, the client situation can be restored by video playback, which solves the problem that the results of traditional solutions are not intuitive; and the intuitive display method greatly facilitates the location of problems, and the success rate of locating and solving problems is greatly improved compared with the old solution.
[0126] Specifically, in the embodiments of this specification, the flowchart of the page information display method is as follows: Figure 5 As shown, the terminal collects and reports data; the data collection process includes pulling configurations, collecting various types of data, data simplification, and webworker processing; the data reporting process includes caching into indexDB and compressing data for reporting.
[0127] The server is used for data saving and scenario restoration; data saving includes traffic restrictions and index data; scenario restoration includes restoring user events, restoring page changes, and restoring exceptions and requests.
[0128] In a specific application, such as a reward-based H5 campaign to reactivate an app, the main interaction flow is as follows: a user shares a link, another user opens the promotional link via WeChat, the H5 page guides the first user to open the app and then to the H5 page, where the user completes a specific action to receive a reward. In practice, because this activation requires users to complete specific actions to trigger the app's functionality and reach a state deemed active by the system, issues can arise. These issues might stem from user error (failure to follow instructions), app malfunctions, or page errors, leading to some users participating in the campaign but failing to receive rewards, resulting in complaints and impacting the campaign's effectiveness. The technical solution proposed in this application allows the server to quickly locate and resolve the issue of users being unable to receive rewards after receiving user complaints.
[0129] As can be seen from the technical solutions provided in the embodiments of this specification above, compared with the original solutions, which require a relatively heavy workload to add statistical points to the business, the access cost is very low, and there is virtually no additional development work. Furthermore, the intuitive display method of this application greatly facilitates problem localization, and compared with the old solutions, the success rate of problem localization and resolution is significantly improved.
[0130] The following describes a specific embodiment of a page information display method described in this specification, with the server as the executing entity. Figure 6 This is a flowchart illustrating a page information display method provided in an embodiment of this application. Specifically, in conjunction with... Figure 6 As shown, the method may include:
[0131] S601: Send a page information retrieval request to the terminal, the page information retrieval request carrying page configuration information; so that the terminal can collect a page dataset that matches the page configuration information based on the page information retrieval request through the software development kit;
[0132] S603: Receive the processed page dataset sent by the terminal;
[0133] S605: Classify the data in the processed page dataset according to the representation category;
[0134] S607: Determine the page information corresponding to each representation category based on the page data corresponding to each representation category;
[0135] S609: Displays the page information corresponding to each representation category.
[0136] In some embodiments, classifying the data in the processed page dataset according to representation categories includes:
[0137] The dataset representing user actions in the processed page dataset is used as the first dataset.
[0138] Accordingly, based on the page data corresponding to each representation category, the page information corresponding to each representation category is determined, including:
[0139] Based on the first dataset, determine the page corresponding to the user's action;
[0140] By searching the document object model, the nodes corresponding to user actions are identified;
[0141] Create page information corresponding to user actions based on the corresponding pages and nodes.
[0142] In some embodiments, classifying the data in the processed page dataset according to representation categories includes:
[0143] The dataset representing changes in page attribute information in the processed page dataset is used as the second dataset.
[0144] Accordingly, based on the page data corresponding to each representation category, the page information corresponding to each representation category is determined, including:
[0145] Based on the second dataset, determine the original page attribute information and the changed page attribute information;
[0146] Based on a scripting language, the page information corresponding to the dataset representing changes in page attribute information is simulated.
[0147] In some embodiments, classifying the data in the processed page dataset according to representation categories includes:
[0148] The dataset representing the processing logic of exceptions and request information in the processed page dataset is used as the third dataset.
[0149] Accordingly, based on the page data corresponding to each representation category, the page information corresponding to each representation category is determined, including:
[0150] Based on the third dataset, determine the page information corresponding to the dataset representing the processing logic of exceptions and request information.
[0151] In some embodiments, the processed page dataset sent by the receiving terminal includes:
[0152] The compressed dataset sent by the receiving terminal;
[0153] Accordingly, before the step of classifying the data in the processed page dataset according to the representation category, the method further includes:
[0154] Decompress the compressed dataset to obtain the decompressed dataset;
[0155] Based on the hash algorithm, duplicate data in the decompressed dataset is identified and deleted to obtain a deduplicated dataset.
[0156] Store the deduplicated dataset;
[0157] Before the step of displaying the page information corresponding to each representation category, the method further includes:
[0158] The page information corresponding to each representation category is converted into multimedia information;
[0159] Accordingly, the page information displayed for each representation category includes:
[0160] Play multimedia information corresponding to each representation category.
[0161] This specification provides a page information display server, which includes a processor and a memory. The memory stores at least one instruction or at least one program. The processor loads and executes the at least one instruction or at least one program to implement the page information display method described above.
[0162] The following describes a specific embodiment of a page information display method described in this specification, using the terminal as the execution subject. Figure 7 This is a flowchart illustrating a page information display method provided in an embodiment of this application. Specifically, in conjunction with... Figure 7 As shown, the method may include:
[0163] S701: Receives a page information retrieval request sent by the server. The page information retrieval request carries page configuration information.
[0164] S703: Based on page information retrieval requests, collect a page dataset that matches the page configuration information using a software development kit;
[0165] S705: Send the processed page dataset to the server; so that the server can classify the data in the processed page dataset according to the representation category; and determine the page information corresponding to each representation category based on the page data corresponding to each representation category; and display the page information corresponding to each representation category.
[0166] In some embodiments, prior to the step of sending the processed page dataset to the server, the method further includes:
[0167] The data in the page dataset is preprocessed to obtain the processed page dataset.
[0168] In some embodiments, the preprocessing of data in the page dataset to obtain the processed page dataset includes:
[0169] Centralize the page dataset data and store it in the cache database;
[0170] When the storage space of the cache database is less than a preset threshold, the page data in the cache database is compressed to obtain a compressed dataset.
[0171] Use the compressed dataset as the processed page dataset.
[0172] In some embodiments, before the step of compressing page data in the cache database to obtain a compressed dataset, the method further includes:
[0173] Determine the amount of page data stored for each application at preset time intervals.
[0174] Determine whether the page data storage volume for each application exceeds a preset storage threshold.
[0175] Applications whose page data storage size exceeds a preset storage threshold are identified as target applications.
[0176] Based on preset rules, delete the target application's corresponding historical data.
[0177] Before the step of storing the centralized data of the page dataset into the cache database, the method further includes:
[0178] Remove the target page data from the page dataset to obtain a simplified dataset. The target page data includes document object model attribute information, cascading style sheet data, and script language data.
[0179] The simplified dataset is serialized based on worker threads.
[0180] This specification provides a page information display terminal, which includes a processor and a memory. The memory stores at least one instruction or at least one program. The processor loads and executes the at least one instruction or at least one program to implement the page information display method described above.
[0181] In the embodiments described in this specification, the memory can be used to store software programs and modules. The processor executes various functional applications and data processing by running the software programs and modules stored in the memory. The memory may mainly include a program storage area and a data storage area. The program storage area may store the operating system, applications required for functions, etc.; the data storage area may store data created according to the use of the device, etc. In addition, the memory may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory may also include a memory controller to provide the processor with access to the memory.
[0182] This specification provides a computer-readable storage medium storing at least one instruction or at least one program, wherein the at least one instruction or at least one program is loaded and executed by a processor to implement the page information display method described above.
[0183] This application also provides a page information display server, such as... Figure 8 As shown, the server may include:
[0184] The page information acquisition request sending module 810 is used to send a page information acquisition request to the terminal. The page information acquisition request carries page configuration information so that the terminal can collect a page dataset that matches the page configuration information based on the page information acquisition request through the software development kit.
[0185] The processed page dataset receiving module 820 is used to receive the processed page dataset sent by the terminal;
[0186] The classification module 830 is used to classify the data in the processed page dataset according to the representation category;
[0187] The page information determination module 840 is used to determine the page information corresponding to each representation category based on the page data corresponding to each representation category.
[0188] The page information display module 850 is used to display the page information corresponding to each representation category.
[0189] In some embodiments, the classification module includes:
[0190] The first dataset determination unit is used to take the dataset representing user operation behavior in the processed page dataset as the first dataset.
[0191] In some embodiments, the page information determination module includes:
[0192] The page determination unit is used to determine the page corresponding to the user's operation behavior based on the first dataset;
[0193] The node determination unit is used to determine the node corresponding to the user's operation behavior by searching the document object model;
[0194] The first page information determination unit is used to create page information corresponding to the user's operation behavior based on the page and node corresponding to the user's operation behavior.
[0195] In some embodiments, the classification module includes:
[0196] The second dataset determination unit is used to select the dataset representing changes in page attribute information from the processed page dataset as the second dataset.
[0197] In some embodiments, the page information determination module includes:
[0198] The page attribute information determination unit is used to determine the original page attribute information and the changed page attribute information based on the second dataset.
[0199] The second page information determination unit is used to simulate and obtain the page information corresponding to the dataset representing changes in page attribute information based on a scripting language.
[0200] In some embodiments, the classification module includes:
[0201] The third dataset determination unit is used to take the dataset representing the processing logic of exceptions and request information in the processed page dataset as the third dataset.
[0202] In some embodiments, the page information determination module includes:
[0203] The third page information determination unit is used to determine the page information corresponding to the dataset representing the processing logic of exceptions and request information based on the third dataset.
[0204] In some embodiments, the page dataset receiving module includes:
[0205] The compressed dataset receiving unit is used to receive compressed datasets sent by the terminal.
[0206] In some embodiments, the server further includes:
[0207] The decompression module is used to decompress the compressed dataset to obtain the decompressed dataset;
[0208] The deduplication dataset determination module is used to determine and remove duplicate data in the decompressed dataset based on a hash algorithm, thereby obtaining a deduplication dataset.
[0209] The deduplication dataset storage module is used to store the deduplication dataset.
[0210] In some embodiments, the server further includes:
[0211] The multimedia information conversion module is used to convert the page information corresponding to each representation category into multimedia information.
[0212] In some embodiments, the page information display module includes:
[0213] A multimedia information playback unit is used to play multimedia information corresponding to each representation category. The server in the server embodiment and the method embodiment are based on the same inventive concept.
[0214] This application also provides a page information display terminal, such as... Figure 9 As shown, the terminal may include:
[0215] The page information retrieval request receiving module 910 is used to receive page information retrieval requests sent by the server. The page information retrieval request carries page configuration information.
[0216] The page dataset collection module 920 is used to collect page datasets that match the page configuration information based on page information acquisition requests and through a software development kit; the page datasets represent user operation behavior, changes in page attribute information, and the processing logic for exceptions and request information;
[0217] The processed page dataset sending module 930 is used to send the processed page dataset to the server so that the server can classify the data in the processed page dataset according to the representation category; determine the page information corresponding to each representation category based on the page data corresponding to each representation category; and display the page information corresponding to each representation category.
[0218] In some embodiments, the terminal further includes:
[0219] The preprocessing module is used to preprocess the data in the page dataset to obtain the processed page dataset.
[0220] In some embodiments, the preprocessing module includes:
[0221] The cache database storage unit is used to store page data centrally in the cache database;
[0222] The compressed dataset determination unit is used to compress page data in the cache database to obtain a compressed dataset when the storage space of the cache database is less than a preset threshold.
[0223] The processed page dataset determination unit is used to use the compressed dataset as the processed page dataset.
[0224] In some embodiments, the terminal further includes:
[0225] The page data storage volume determination module is used to determine the page data storage volume corresponding to each application at preset time intervals.
[0226] The data storage quantity judgment module is used to determine whether the data storage quantity of the page corresponding to each application is greater than the preset storage quantity threshold.
[0227] The target application determination module is used to identify applications whose page data storage volume is greater than a preset storage volume threshold as target applications.
[0228] The target historical data deletion module is used to delete the target historical data corresponding to the target application based on preset rules.
[0229] In some embodiments, the terminal further includes:
[0230] The data deletion module is used to delete target page data in the page dataset to obtain a simplified dataset. The target page data includes document object model attribute information data, cascading style sheet data, and script language data.
[0231] The serialization processing module is used to perform serialization processing on a simplified dataset based on a worker thread. The terminal in the terminal embodiment is based on the same inventive concept as the method embodiment.
[0232] This application also provides a page information display system, which includes a terminal and a server.
[0233] The terminal is used to obtain requests based on page information, collect a page dataset that matches the page configuration information through a software development kit; the page dataset represents user operation behavior, changes in page attribute information, and the processing logic of exceptions and request information; preprocess the data in the page dataset to obtain a processed page dataset; and send the processed page dataset to the server.
[0234] The server is configured to send a page information retrieval request to the terminal, the page information retrieval request carrying page configuration information; classify the processed page dataset according to representation categories; determine the page information corresponding to each representation category based on the page data corresponding to each representation category; and display the page information corresponding to each representation category.
[0235] As can be seen from the embodiments of the page information display method, apparatus, server, terminal, storage medium, or system provided in this application, compared with the original solution, the embodiments in this specification require a relatively heavy workload to add statistical points in the business, the access cost is very low, and there is basically no additional development workload. Furthermore, the intuitive display method of this application greatly facilitates problem location, and compared with the old solution, the success rate of problem location and resolution is greatly improved.
[0236] It should be noted that the order of the embodiments described above is merely for descriptive purposes and does not represent the superiority or inferiority of the embodiments. Furthermore, specific embodiments have been described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps described in the claims can be performed in a different order than that shown in the embodiments and still achieve the desired result. Additionally, the processes depicted in the drawings do not necessarily require a specific or sequential order to achieve the desired result. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0237] The various embodiments in this specification are described in a progressive manner. Similar or identical parts between embodiments can be referred to interchangeably. Each embodiment focuses on describing the differences from other embodiments. In particular, the embodiments for servers, terminals, systems, and storage media are basically similar to the method embodiments, so the descriptions are relatively simple; relevant parts can be referred to the descriptions of the method embodiments.
[0238] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.
[0239] The above are merely preferred embodiments of this application and are not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.
Claims
1. A method for displaying page information, characterized in that, The method includes: A page information retrieval request is sent to the terminal, the page information retrieval request carrying page configuration information; so that the terminal, based on the page information retrieval request, collects a page dataset that matches the page configuration information through a software development kit; Receive the processed page dataset sent by the terminal; The processed page dataset is then categorized according to its representation category. Based on the page data corresponding to each representation category, determine the page information corresponding to each representation category; Display the page information corresponding to each of the aforementioned representation categories.
2. The method according to claim 1, characterized in that, The step of classifying the data in the processed page dataset according to the representation category includes: The dataset representing user operation behavior in the processed page dataset is used as the first dataset; Accordingly, determining the page information corresponding to each representation category based on the page data corresponding to each representation category includes: Based on the first dataset, determine the page corresponding to the user's operation behavior; The node corresponding to the user's operation behavior is determined by searching the document object model; Based on the page and node corresponding to the user's operation, create page information corresponding to the user's operation.
3. The method according to claim 1, characterized in that, The step of classifying the data in the processed page dataset according to the representation category includes: The dataset representing changes in page attribute information in the processed page dataset is used as the second dataset; Accordingly, determining the page information corresponding to each representation category based on the page data corresponding to each representation category includes: Based on the second dataset, determine the original page attribute information and the changed page attribute information; Based on a scripting language, the page information corresponding to the dataset representing changes in page attribute information is simulated.
4. The method according to claim 1, characterized in that, The step of classifying the data in the processed page dataset according to the representation category includes: The dataset representing the processing logic of exceptions and request information in the processed page dataset is used as the third dataset. Accordingly, determining the page information corresponding to each representation category based on the page data corresponding to each representation category includes: Based on the third dataset, determine the page information corresponding to the dataset of the processing logic representing anomalies and request information.
5. The method according to claim 1, characterized in that, The processed page dataset received from the terminal includes: Receive the compressed dataset sent by the terminal; Accordingly, before the step of classifying the data in the processed page dataset according to the representation category, the method further includes: The compressed dataset is decompressed to obtain the decompressed dataset; Based on a hash algorithm, duplicate data in the decompressed dataset is identified and deleted to obtain a deduplicated dataset. The deduplicated dataset is stored; Before the step of displaying the page information corresponding to each representation category, the method further includes: The page information corresponding to each of the representation categories is converted into multimedia information; Accordingly, the page information displayed for each representation category includes: Play the multimedia information corresponding to each of the aforementioned representation categories.
6. A method for displaying page information, characterized in that, The method includes: Receive a page information retrieval request sent by the server, the page information retrieval request carrying page configuration information; Based on the page information retrieval request, a page dataset matching the page configuration information is collected using a software development kit; The server sends the processed page dataset to the server so that the server can classify the data in the processed page dataset according to the representation category; determine the page information corresponding to each representation category based on the page data corresponding to each representation category; and display the page information corresponding to each representation category.
7. The method according to claim 6, characterized in that, Before the step of sending the processed page dataset to the server, the method further includes: The data in the page dataset is preprocessed to obtain the processed page dataset; The preprocessing of the data in the page dataset to obtain the processed page dataset includes: The data from the page dataset is centrally stored in a cache database; When the storage space of the cache database is less than a preset threshold, the page data in the cache database is compressed to obtain a compressed dataset. The compressed dataset is used as the processed page dataset.
8. The method according to claim 7, characterized in that, Before the step of compressing the page data in the cache database to obtain a compressed dataset, the method further includes: Determine the amount of page data stored for each application at preset time intervals. Determine whether the page data storage volume for each application exceeds a preset storage threshold. Applications whose page data storage size exceeds a preset storage threshold are identified as target applications. Based on preset rules, delete the target historical data corresponding to the target application; Before the step of storing the centralized data of the page dataset into the cache database, the method further includes: Delete the target page data from the page dataset to obtain a simplified dataset. The target page data includes document object model attribute information data, cascading style sheet data, and script language data. The simplified dataset is serialized based on the worker thread.
9. A page information display system, characterized in that, The system includes a terminal and a server. The terminal is used to collect a page dataset that matches the page configuration information based on a page information retrieval request using a software development kit. And send the processed page dataset to the server; The server is used to send a page information retrieval request to the terminal, the page information retrieval request carrying page configuration information; And classify the data in the processed page dataset according to the representation category; And based on the page data corresponding to each representation category, determine the page information corresponding to each representation category; And display the page information corresponding to each of the aforementioned representation categories.
10. A computer storage medium, characterized in that, The computer storage medium stores at least one instruction or at least one program, which is loaded and executed by a processor to implement the page information display method as described in any one of claims 1-5 or any one of claims 6-8.
Citation Information
Patent Citations
Data collection method and device, medium and computing equipment
CN107423048A
Data acquisition method, apparatus, computer equipment and system
CN109145182A