Page embedding data collection method, device and system

By collecting buried point data on the browser page and forwarding the request to an independent buried point acquisition system, the impact of page buried point data acquisition on the business processing system in the existing technology is solved, and efficient and side-effect data acquisition effect is achieved.

CN113158118BActive Publication Date: 2025-05-02INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110549997.6
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-05-20
Publication Date
2025-05-02
Estimated Expiration
2041-05-20

AI Technical Summary

Technical Problem

When collecting page burial data, the prior art will have a certain impact on the business processing system, and there is a lack of a method that will not affect the business processing.

Method used

By burying the page and burying the control points on the browser page, the operator triggers the burying points, and the browser asynchronously sends and collects the burying point data, uses the forwarding processing system to identify the context root of the request link, and forwards the relevant requests to an independent burying point collection system for processing.

Benefits of technology

It realizes efficient and side-effect collection of page buried data, avoids the impact on the business processing system, and supports accurate collection of operators' browsing behavior and page element operation behavior.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN113158118B_ABST
    Figure CN113158118B_ABST
Patent Text Reader

Abstract

The present invention discloses a method, device and system for collecting data of page buried points, the method comprising: obtaining a request sent by a browser; if the request is a business request, forwarding the business request to a WEB service system for business processing; if the request is a buried point data collection request, forwarding the buried point data collection request to a buried point collection system, so that the buried point collection system stores the buried point data in the buried point data collection request locally, wherein when a buried point in a page is triggered, the browser collects buried point data according to the type of the triggered buried point, and generates the buried point data collection request according to the collected buried point data. The present invention provides a solution for collecting page buried point data that will not affect the business processing system.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of data collection technology, and in particular to a method, device and system for collecting page embedding data. Background Art

[0002] With the rapid development of Internet technology, B / S architecture systems are being used more and more. In B / S architecture systems, browsers are generally used to access the WEB servers of B / S architecture systems through Internet domain names. The server receives relevant requests, processes them and returns corresponding HTML messages. The client browser receives the returned messages, organizes relevant resources, and displays the business processing interface.

[0003] The interface generally has page elements such as pictures, hyperlinks, buttons, radio buttons, drop-down boxes, check boxes, etc. Before making another request to the WEB server, the server side is unaware of the operator's operation on the relevant elements on the page. The system operation and maintenance personnel are also unable to perceive whether the operator is blocked in the page operation, nor can they quantify the usability of the page's UI design. In order to perceive the operator's operation trajectory on the page, it is a common technical means to embed data on the page and its elements. However, the current embedding data collection action will have a certain impact on the business processing system, and the existing technology lacks a page embedding data collection method that will not affect the business processing system. Summary of the invention

[0004] In order to solve the technical problems in the above-mentioned background technology, the present invention proposes a method, device and system for collecting page embedding data.

[0005] In order to achieve the above object, according to one aspect of the present invention, a method for collecting page embedding data is provided, the method comprising:

[0006] Get the request sent by the browser;

[0007] If the request is a business request, forwarding the business request to a WEB service system for business processing;

[0008] If the request is a request for collecting buried point data, the buried point data collection request is forwarded to the buried point collection system so that the buried point collection system stores the buried point data in the buried point data collection request locally. When a buried point in a page is triggered, the browser collects buried point data according to the type of the triggered buried point, and generates the buried point data collection request based on the collected buried point data.

[0009] Optionally, the tracking point collection system includes: an HTTP server;

[0010] The forwarding of the buried point data collection request to the buried point collection system specifically includes:

[0011] The buried data collection request is forwarded to the HTTP server so that the HTTP server sends the resources requested by the buried data collection request to the browser, wherein the buried data collection request is an HTTP request, and the buried data collection request is used to request the target resource in the HTTP server.

[0012] Optionally, the tracking point collection system further includes: an application server and a database;

[0013] The burying point collection system stores the burying point data in the burying point data collection request locally, specifically including:

[0014] The HTTP server obtains the embedded point data in the embedded point data collection request, generates a structured log according to the embedded point data, and writes the generated structured log into a preset structured log file; the application server detects the structured log file, and if there is a newly added structured log in the structured log file, the newly added structured log is formatted and parsed and then written into the database.

[0015] Optionally, the embedding point includes: a page embedding point; when the page embedding point is triggered, the embedding point data collected by the browser is page information.

[0016] Optionally, the tracking point includes: control tracking point; when the control tracking point is triggered, the tracking point data collected by the browser is control information.

[0017] In order to achieve the above object, according to another aspect of the present invention, a page embedding data collection device is provided, the device comprising:

[0018] Request acquisition module, used to obtain the request sent by the browser;

[0019] A first forwarding module, configured to forward the service request to a web service system for service processing if the request is a service request;

[0020] The second forwarding module is used to forward the buried point data collection request to the buried point collection system if the request is a buried point data collection request, so that the buried point collection system stores the buried point data in the buried point data collection request locally, wherein when the buried point in the page is triggered, the browser performs buried point data collection according to the type of the triggered buried point, and generates the buried point data collection request based on the collected buried point data.

[0021] Optionally, the tracking point collection system includes: an HTTP server;

[0022] The second forwarding module is specifically used to forward the buried data collection request to the HTTP server, so that the HTTP server sends the resources requested by the buried data collection request to the browser, wherein the buried data collection request is an HTTP request, and the buried data collection request is used to request the target resource in the HTTP server.

[0023] Optionally, the tracking point collection system further includes: an application server and a database;

[0024] The burying point collection system stores the burying point data in the burying point data collection request locally, specifically including:

[0025] The HTTP server obtains the embedded point data in the embedded point data collection request, generates a structured log according to the embedded point data, and writes the generated structured log into a preset structured log file; the application server detects the structured log file, and if there is a newly added structured log in the structured log file, the newly added structured log is formatted and parsed and then written into the database.

[0026] In order to achieve the above object, according to another aspect of the present invention, a page embedding data collection system is provided, the system comprising:

[0027] Forwarding processing system and buried point collection system;

[0028] The forwarding processing system is used to receive a request sent by a browser, and forward the business request to a WEB service system for business processing when the request is a business request, and forward the buried point data collection request to the buried point collection system when the request is a buried point data collection request, wherein when a buried point in a page is triggered, the browser collects buried point data according to the type of the triggered buried point, and generates the buried point data collection request according to the collected buried point data;

[0029] The buried point collection system is used to store the buried point data in the buried point data collection request locally.

[0030] Optionally, the tracking point collection system includes: an HTTP server;

[0031] The forwarding processing system is specifically used to forward the buried data collection request to the HTTP server;

[0032] The HTTP server is used to send the resource requested by the buried data collection request to the browser, wherein the buried data collection request is an HTTP request, and the buried data collection request is used to request the target resource in the HTTP server.

[0033] Optionally, the tracking point collection system further includes: an application server and a database;

[0034] The HTTP server is further used to obtain the buried point data in the buried point data collection request, generate a structured log according to the buried point data, and write the generated structured log into a preset structured log file;

[0035] The application server is used to detect the structured log file, and if there is a newly added structured log in the structured log file, format and parse the newly added structured log and then write it into the database.

[0036] In order to achieve the above-mentioned purpose, according to another aspect of the present invention, a computer device is also provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, and when the processor executes the computer program, the steps in the above-mentioned page embedding data collection method are implemented.

[0037] In order to achieve the above-mentioned purpose, according to another aspect of the present invention, a computer-readable storage medium is further provided, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed in a computer processor, the steps in the above-mentioned page embedding data collection method are implemented.

[0038] The beneficial effects of the present invention are as follows: when the present invention obtains a request sent by a browser, if the request is a business request, the business request is forwarded to a WEB service system for business processing; if the request is a buried point data collection request, the buried point data collection request is forwarded to the buried point acquisition system, so that the buried point acquisition system stores the buried point data in the buried point data collection request locally. It can be seen that the present invention performs buried point data collection by setting up a buried point acquisition system independent of the WEB service system, and the operation of the buried point acquisition system will not have any impact on the normal business processing of the WEB service system, thereby solving the technical problem that the current buried point data collection action will have a certain impact on business processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the prior art descriptions. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0040] Figure 1 This is a first flow chart of a method for collecting page embedding data according to an embodiment of the present invention;

[0041] Figure 2 This is a flow chart of the operation of the point collection system according to an embodiment of the present invention;

[0042] Figure 3 This is an application scenario diagram of the page embedding data collection method according to an embodiment of the present invention;

[0043] Figure 4 It is a structural block diagram of a page embedding data acquisition device according to an embodiment of the present invention;

[0044] Figure 5 It is a schematic diagram of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0045] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0046] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0047] It should be noted that the terms "including" and "having" and any variations thereof in the specification and claims of the present invention and the above-mentioned drawings are intended to cover non-exclusive inclusions. For example, a process, method, system, product or apparatus comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or apparatus.

[0048] It should be noted that, in the absence of conflict, the embodiments of the present invention and the features in the embodiments can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0049] It should be noted that the present invention can be applied to the financial field as well as other technical fields.

[0050] The present invention provides a method and system for efficiently collecting buried data of B / S architecture system pages. Through the present invention, not only can the setting information such as the client operating system version and the browser version be collected, but also the information such as the pages browsed by the operator, the login time, and the logout time can be recorded. The operation behavior of the page elements can also be collected efficiently and accurately. When the collection system is abnormal, it will not have a negative impact on the normal business interaction.

[0051] The present invention implements page embedding and control embedding on the browser page, the operator triggers the embedding, the browser sends the collected embedding data in an asynchronous manner, utilizes the forwarding processing system to identify the context root of the request link, forwards the relevant request to the HTTP server in the embedding collection system, the HTTP server prints a structured log for the collection request and responds quickly, and then the background system in the embedding collection system monitors the log file, performs quasi-real-time log record collection, and parses and stores it in the warehouse, thereby realizing efficient and side-effect-free embedding data collection.

[0052] Based on one aspect of the present invention, the present invention provides a page embedding data collection system, and the page embedding data collection system of the present invention includes: a forwarding processing system and a embedding collection system.

[0053] The forwarding processing system is used to receive the request sent by the browser, and forward the business request to the WEB service system for business processing when the request is a business request, and forward the buried point data collection request to the buried point collection system when the request is a buried point data collection request. When the buried point in the page is triggered, the browser collects buried point data according to the type of the triggered buried point, and generates the buried point data collection request according to the collected buried point data.

[0054] The buried point collection system is used to store the buried point data in the buried point data collection request locally.

[0055] The present invention performs point-of-care data collection by setting up a point-of-care data collection system independent of the WEB service system. The operation of the point-of-care data collection system will not have any impact on the normal business processing of the WEB service system, thereby solving the technical problem that the current point-of-care data collection action will have a certain impact on business processing.

[0056] Figure 3 : is an application scenario diagram of the page embedding data collection method according to an embodiment of the present invention, such as Figure 3 As shown, the application scenario of the page embedding data collection system of the present invention includes: a browser, the page embedding data collection system of the present invention (a forwarding processing system and a embedding collection system) and a WEB service system.

[0057] The browser, specifically the client browser, is mainly used by operators to perform business interface operations and to connect and interact with the server via HTTP.

[0058] The forwarding processing system includes a reverse proxy server, which mainly identifies the request initiated by the browser through the reverse proxy server, judges the context root of the request link, forwards the business request to the business processing WEB service system, and forwards the buried data collection request to the buried data collection system.

[0059] The WEB service system is mainly an application server system that receives business requests and performs transaction processing.

[0060] The tracking point collection system is mainly composed of HTTP server, background server and database. The HTTP server establishes HTTP service function. After receiving the tracking point data collection request, it generates structured log and inputs it into disk storage. The background server process then monitors the side of the log file, collects new records in quasi-real time, and inserts them into the database after parsing and processing.

[0061] In one embodiment of the present invention, the embedding point includes a page embedding point, and when the page embedding point is triggered, the embedded point data collected is page information. In one embodiment of the present invention, the page information may specifically include: product code, product name, current column number, current column Chinese name, current page number, current page Chinese name, customer information, browser version, screen resolution, access source information, access date, and access time, etc.

[0062] In one embodiment of the present invention, the present invention pre-sets page information for related pages, and after the page is set, adds a trigger page information collection request method, that is, sets a embedding point in the page, and when the embedding point is triggered, the browser automatically collects the pre-set page information.

[0063] In one embodiment of the present invention, the embedding point also includes a control embedding point, and when the control embedding point is triggered, the embedding point data collected by the browser is control information. In one embodiment of the present invention, the control information may specifically include: control number, control Chinese name, control keyword, etc.

[0064] In one embodiment of the present invention, the present invention pre-sets control information for control elements on the page, increases the collection of control information when an operator triggers a related control, and sends a buried data collection request asynchronously before interacting with a business processing server.

[0065] like Figure 3 As shown, in one embodiment of the present invention, the tracking point collection system includes: an HTTP server.

[0066] The forwarding processing system is specifically used to forward the buried data collection request to the HTTP server.

[0067] The HTTP server is used to send the resource requested by the buried data collection request to the browser, wherein the buried data collection request is an HTTP request, and the buried data collection request is used to request the target resource in the HTTP server.

[0068] In one embodiment of the present invention, the HTTP server deploys HTTP service and provides the target resource. The buried point data collection request is actually a request for the target resource of the HTTP server. The request parameter in the buried point data collection request is the collected buried point data. Thus, the buried point data is sent to the HTTP server for processing together with the buried point data collection request.

[0069] In one embodiment of the present invention, the target resource may be a 1-pixel image resource.

[0070] In one embodiment of the present invention, the HTTP server sends the resources requested by the embedding data collection request to the browser, and the browser is configured to only receive the resources sent by the HTTP server but not process the resources sent by the HTTP server.

[0071] The present invention utilizes the efficient processing capability of HTTP server for static resources, collects the buried data while requesting resources, significantly improves the efficiency of buried data collection, and effectively solves the problem of resource consumption caused by frequent interaction between collected information and server.

[0072] like Figure 3 As shown, in one embodiment of the present invention, the tracking point collection system also includes: an application server and a database.

[0073] The HTTP server is also used to obtain the buried point data in the buried point data collection request, generate a structured log according to the buried point data, and write the generated structured log into a preset structured log file.

[0074] The application server is used to detect the structured log file, and if there is a newly added structured log in the structured log file, format and parse the newly added structured log and then write it into the database.

[0075] In one embodiment of the present invention, when the HTTP server receives a request for a target resource, it quickly returns the target resource, performs structured log processing on the request message and the sent parameters, generates a structured log, and enters it into a structured log file on the disk for storage.

[0076] In one embodiment of the present invention, the background system monitors the structured log files in the disk in real time, and after discovering the newly added structured logs, the newly added structured logs are collected in quasi-real time. The background system formats and parses the collected newly added structured logs into original embedded point data, and links to the database to insert the embedded point data into the preset related table records.

[0077] Based on the same inventive concept, the present invention also provides a page embedding data collection method on the other hand. Since the principle of solving the problem by the page embedding data collection method is similar to that of the page embedding data collection system, the embodiment of the page embedding data collection method can refer to the embodiment of the page embedding data collection system, and the repeated parts will not be repeated.

[0078] Figure 1 is a flow chart of a method for collecting page embedding data according to an embodiment of the present invention, and the implementing subject is a forwarding processing system in the above-mentioned page embedding data collection system, such as Figure 1 As shown, the page embedding data collection method of this embodiment includes steps S101 to S103.

[0079] Step S101, obtaining a request sent by a browser.

[0080] Step S102: If the request is a service request, forward the service request to a WEB service system for performing service processing.

[0081] Step S103, if the request is a buried point data collection request, the buried point data collection request is forwarded to the buried point collection system, so that the buried point collection system stores the buried point data in the buried point data collection request locally, wherein when the buried point in the page is triggered, the browser performs buried point data collection according to the type of the triggered buried point, and generates the buried point data collection request according to the collected buried point data.

[0082] In one embodiment of the present invention, the tracking point collection system includes: an HTTP server. The above step S103 of forwarding the tracking point data collection request to the tracking point collection system specifically includes:

[0083] The buried data collection request is forwarded to the HTTP server so that the HTTP server sends the resources requested by the buried data collection request to the browser, wherein the buried data collection request is an HTTP request, and the buried data collection request is used to request the target resource in the HTTP server.

[0084] In one embodiment of the present invention, the tracking point collection system further includes: an application server and a database. Figure 2 As shown, the burying point collection system in the above step S103 stores the burying point data in the burying point data collection request locally, which specifically includes step S201 and step S202.

[0085] Step S201, the HTTP server obtains the buried point data in the buried point data collection request, generates a structured log according to the buried point data, and writes the generated structured log into a preset structured log file;

[0086] In step S202, the application server detects the structured log file, and if there is a newly added structured log in the structured log file, the newly added structured log is formatted and parsed and then written into the database.

[0087] It can be seen from the above embodiments that the present invention can efficiently collect page and control element information of the browser interface, achieving at least the following beneficial effects:

[0088] 1. The present invention utilizes the efficient processing capability of HTTP server for static resources, collects the buried data while requesting the image resources, and effectively solves the resource consumption problem of frequent interaction between the collected information and the server.

[0089] 2. The present invention uses an asynchronous request sending method, so even if a systemic failure occurs in the buried point data acquisition system, it will not affect the normal business processing system.

[0090] 3. The present invention can consolidate the data foundation of the product by standardizing the embedding and data collection of the page, and become an important data source for customer behavior analysis, precision marketing, and 360-degree comprehensive portrait of customers.

[0091] It should be noted that the steps shown in the flowcharts of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and that, although a logical order is shown in the flowcharts, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0092] Based on the same inventive concept, an embodiment of the present invention also provides a page buried point data collection device, which can be used to implement the page buried point data collection method described in the above embodiment, as described in the following embodiment. Since the principle of solving the problem by the page buried point data collection device is similar to that of the page buried point data collection method, the embodiment of the page buried point data collection device can refer to the embodiment of the page buried point data collection method, and the repeated parts will not be repeated. As used below, the term "unit" or "module" can be a combination of software and / or hardware that implements the predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceived.

[0093] Figure 4 is a structural block diagram of a page embedding data collection device according to an embodiment of the present invention, such as Figure 4 As shown, the page embedding data collection device according to the embodiment of the present invention includes:

[0094] Request acquisition module 1, used to obtain the request sent by the browser;

[0095] A first forwarding module 2, configured to forward the service request to a WEB service system for service processing if the request is a service request;

[0096] The second forwarding module 3 is used to forward the buried point data collection request to the buried point collection system if the request is a buried point data collection request, so that the buried point collection system stores the buried point data in the buried point data collection request locally, wherein when the buried point in the page is triggered, the browser performs buried point data collection according to the type of the triggered buried point, and generates the buried point data collection request according to the collected buried point data.

[0097] In one embodiment of the present invention, the tracking point collection system includes: an HTTP server.

[0098] In one embodiment of the present invention, the second forwarding module is specifically used to forward the buried data collection request to the HTTP server, so that the HTTP server sends the resources requested by the buried data collection request to the browser, wherein the buried data collection request is an HTTP request, and the buried data collection request is used to request the target resource in the HTTP server.

[0099] In one embodiment of the present invention, the tracking point collection system also includes: an application server and a database.

[0100] In one embodiment of the present invention, the burying point collection system stores the burying point data in the burying point data collection request locally, specifically including:

[0101] The HTTP server obtains the embedded point data in the embedded point data collection request, generates a structured log according to the embedded point data, and writes the generated structured log into a preset structured log file; the application server detects the structured log file, and if there is a newly added structured log in the structured log file, the newly added structured log is formatted and parsed and then written into the database.

[0102] In order to achieve the above object, according to another aspect of the present application, a computer device is also provided. Figure 5 As shown, the computer device includes a memory, a processor, a communication interface and a communication bus. A computer program that can be executed on the processor is stored in the memory. When the processor executes the computer program, the steps in the above-mentioned embodiment method are implemented.

[0103] The processor may be a central processing unit (CPU). The processor may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or a combination of the above chips.

[0104] The memory, as a non-transitory computer-readable storage medium, can be used to store non-transitory software programs, non-transitory computer executable programs and units, such as the corresponding program units in the above method embodiments of the present invention. The processor executes various functional applications of the processor and works data processing by running the non-transitory software programs, instructions and modules stored in the memory, that is, implementing the method in the above method embodiments.

[0105] The memory may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created by the processor, etc. In addition, the memory may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0106] The one or more units are stored in the memory, and when executed by the processor, the method in the above embodiment is performed.

[0107] The specific details of the above-mentioned computer device can be understood by referring to the corresponding related descriptions and effects in the above-mentioned embodiments, and will not be repeated here.

[0108] In order to achieve the above purpose, according to another aspect of the present application, a computer-readable storage medium is also provided, wherein the computer-readable storage medium stores a computer program, and the computer program implements the steps in the above-mentioned page embedding data collection method when executed in a computer processor. Those skilled in the art can understand that the implementation of all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a computer-readable storage medium, and the program, when executed, can include the processes of the embodiments of the above-mentioned methods. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), a flash memory (Flash Memory), a hard disk (Hard Disk Drive, abbreviated as: HDD) or a solid-state drive (SSD), etc.; the storage medium can also include a combination of the above-mentioned types of memories.

[0109] Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, and optionally, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0110] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for collecting page embedding data, characterized in that: include: Obtaining a request sent by a browser, wherein when a buried point in a page is triggered, the browser collects buried point data according to the type of the triggered buried point, and generates a buried point data collection request according to the collected buried point data; If the request sent by the browser is a business request, forwarding the business request to a WEB service system for business processing; If the request sent by the browser is the buried point data collection request, the buried point data collection request is forwarded to the buried point collection system, so that the buried point collection system stores the buried point data in the buried point data collection request locally; the buried point collection system includes: an HTTP server, an application server and a database; The forwarding of the buried point data collection request to the buried point collection system specifically includes: Forwarding the buried data collection request to the HTTP server, so that the HTTP server sends the resource requested by the buried data collection request to the browser, wherein the buried data collection request is an HTTP request, and the buried data collection request is used to request the target resource in the HTTP server; The burying point collection system stores the burying point data in the burying point data collection request locally, specifically including: The HTTP server obtains the embedded point data in the embedded point data collection request, generates a structured log according to the embedded point data, and writes the generated structured log into a preset structured log file; the application server detects the structured log file, and if there is a newly added structured log in the structured log file, the newly added structured log is formatted and parsed and then written into the database.

2. The method for collecting page embedding data according to claim 1, characterized in that: The embedding points include: page embedding points; when the page embedding points are triggered, the embedding point data collected by the browser is page information.

3. The method for collecting page embedding data according to claim 1, characterized in that: The burying points include: control burying points; when the control burying points are triggered, the burying point data collected by the browser is control information.

4. A page embedding data collection device, characterized in that: include: A request acquisition module, used to acquire a request sent by a browser, wherein when a buried point in a page is triggered, the browser collects buried point data according to the type of the triggered buried point, and generates a buried point data collection request according to the collected buried point data; A first forwarding module, configured to forward the service request to a WEB service system for performing service processing if the request sent by the browser is a service request; A second forwarding module is used for forwarding the buried point data collection request to the buried point collection system if the request sent by the browser is the buried point data collection request, so that the buried point collection system stores the buried point data in the buried point data collection request locally; the buried point collection system includes: an HTTP server, an application server and a database; The second forwarding module is specifically used to forward the buried data collection request to the HTTP server, so that the HTTP server sends the resource requested by the buried data collection request to the browser, wherein the buried data collection request is an HTTP request, and the buried data collection request is used to request the target resource in the HTTP server; The burying point collection system stores the burying point data in the burying point data collection request locally, specifically including: The HTTP server obtains the embedded point data in the embedded point data collection request, generates a structured log according to the embedded point data, and writes the generated structured log into a preset structured log file; the application server detects the structured log file, and if there is a newly added structured log in the structured log file, the newly added structured log is formatted and parsed and then written into the database.

5. A page embedding data collection system, characterized in that: include: Forwarding processing system and buried point collection system; The forwarding processing system is used to receive a request sent by a browser, wherein when a buried point in a page is triggered, the browser collects buried point data according to the type of the triggered buried point, and generates a buried point data collection request according to the collected buried point data, and when the request sent by the browser is a business request, forwards the business request to a WEB service system for business processing, and when the request sent by the browser is a buried point data collection request, forwards the buried point data collection request to the buried point collection system; The burying point collection system is used to store the burying point data in the burying point data collection request locally; the burying point collection system includes: an HTTP server, an application server and a database; The forwarding processing system is specifically used to forward the buried data collection request to the HTTP server; The HTTP server is used to send the resource requested by the buried data collection request to the browser, wherein the buried data collection request is an HTTP request, and the buried data collection request is used to request the target resource in the HTTP server; The HTTP server is further used to obtain the buried point data in the buried point data collection request, generate a structured log according to the buried point data, and write the generated structured log into a preset structured log file; The application server is used to detect the structured log file, and if there is a newly added structured log in the structured log file, format and parse the newly added structured log and then write it into the database.

6. The page embedding data collection system according to claim 5, characterized in that: The embedding points include: page embedding points; when the page embedding points are triggered, the embedding point data collected by the browser is page information.

7. The page embedding data collection system according to claim 5, characterized in that: The burying points include: control burying points; when the control burying points are triggered, the burying point data collected by the browser is control information.

8. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 3 is implemented.

9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed in a computer processor, the computer program implements the method according to any one of claims 1 to 3.

Citation Information

Patent Citations

  • Method for data collection in website statistics

    CN106469185A

  • Buried point data reporting method and device and electronic device

    CN108156006A