Data processing method and device, equipment and storage medium

By adding agreed-upon feature values ​​during data collection and verifying data validity on the server side, combined with log recording and authorization authentication, the problem of inaccurate data in the company's internal data statistics platform was solved, improving the accuracy of statistical results and the security of the system.

CN117112658BActive Publication Date: 2026-02-27GREE ELECTRIC APPLIANCE INC OF ZHUHAI +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202310880450.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-07-17
Publication Date
2026-02-27
Estimated Expiration
2043-07-17

AI Technical Summary

Technical Problem

The data collection process of the existing internal data statistics platform is too transparent, which leads to the falsification of data sources, the appearance of falsified and redundant data, and the resulting inaccurate statistical results.

Method used

During data collection, agreed-upon feature values ​​are added, the server verifies the validity of the data, and the interface is protected through logging and authorization authentication. Abnormal access rules are set to prevent data tampering and unauthorized access.

Benefits of technology

This improved the accuracy of data statistics, reduced falsified and redundant data, and ensured the stable and secure operation of the system.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117112658B_ABST
    Figure CN117112658B_ABST
Patent Text Reader

Abstract

The application provides a data processing method and device, equipment and a storage medium. In the application, when the client sends the data to be counted, it is determined whether the data to be counted includes a predetermined characteristic value. If the data to be counted includes the predetermined characteristic value, the data to be counted is valid data. The data to be counted is received and counted, so that the accuracy of the counting result is improved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of data processing, in particular to a data processing method and device, equipment and a storage medium. BACKGROUND

[0002] Some companies develop application data statistics platforms by themselves in order to collect and count the index conditions of the application software in the company. The application data statistics platform is used to collect and count the index conditions of the application software in the company, including the access volume and the number of visitors. The application data statistics platform is developed based on the intranet environment of the company to avoid possible data leakage caused by external user access. At present, the data collected by the application data statistics platform mainly comes from the application software in the company, including the external network and the internal network, and contains various software such as APP and Web. The collection process is relatively simple and transparent, which may lead to incomplete and unauthentic data sources (such as fake data, redundant data or dirty data), resulting in inaccurate actual statistical results. SUMMARY

[0003] In view of the above problems, the present application provides a data processing method, device, equipment and storage medium. The method includes: determining whether the to-be-counted data includes a predetermined characteristic value, and receiving the to-be-counted data and counting only when the to-be-counted data includes the predetermined characteristic value, so as to avoid unauthentic data sources and improve the accuracy of the statistical results.

[0004] The present application provides a data processing method, which includes:

[0005] In the case where the to-be-counted data sent by the client is obtained, it is determined whether the to-be-counted data includes a predetermined characteristic value.

[0006] In the case where the to-be-counted data includes the predetermined characteristic value, the to-be-counted data is determined as valid data.

[0007] The to-be-counted data is received and counted.

[0008] In some embodiments, the method further includes:

[0009] In the case where the to-be-counted data does not include the predetermined characteristic value, the to-be-counted data is determined as invalid data, and the to-be-counted data is discarded.

[0010] In some embodiments, the method further includes:

[0011] In the case where the access request of the interface sent by the client is obtained, it is determined whether the interface is an externally open interface of the server.

[0012] In the case where the interface is an externally open interface, the log record of the interface is started.

[0013] In some embodiments, the method further comprises:

[0014] obtaining log record information of accessing the open interface;

[0015] analyzing the log record information to obtain an analysis result;

[0016] configuring an abnormal access rule of the interface based on the analysis result.

[0017] In some embodiments, the method further comprises:

[0018] In the case that the interface is a non-open interface of the server, determining whether the access request meets a set rule;

[0019] In the case that the access request meets the set rule, allowing the client to access the non-open interface.

[0020] In some embodiments, the method further comprises:

[0021] In the case that the access request of the interface of the server sent by the client is obtained, verifying the client to determine whether the client has the access right of the interface; wherein, in the case that it is determined that the client has the access right of the interface, it is determined whether the interface is an open interface of the server; in the case that it is determined that the client does not have the access right of the interface, the client is prohibited to access the interface.

[0022] In some embodiments, the method further comprises:

[0023] determining whether the access request triggers the abnormal access rule;

[0024] In the case that it is determined that the access request triggers the abnormal access rule, determining the risk level of the access request;

[0025] processing the access request of the client based on the risk level.

[0026] Embodiments of the present application provide a data processing apparatus, comprising:

[0027] a first determination module configured to determine whether the to-be-counted data comprises a predetermined characteristic value in the case that the to-be-counted data sent by the client is obtained;

[0028] a second determination module configured to determine that the to-be-counted data is valid data in the case that the to-be-counted data comprises the predetermined characteristic value;

[0029] a counting module configured to receive the to-be-counted data and count.

[0030] The embodiment of the present application provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the computer program is executed by the processor to execute the data processing method according to any one of the preceding embodiments.

[0031] The embodiment of the present application provides a computer readable storage medium, which stores a computer program capable of being executed by one or more processors and capable of being used to implement the data processing method.

[0032] The data processing method, device and equipment and storage medium provided by the present application can determine whether the to-be-counted data includes a predetermined characteristic value when the to-be-counted data sent by the client is acquired, determine that the to-be-counted data is valid data when the to-be-counted data includes the predetermined characteristic value, receive the to-be-counted data and perform counting, so that the accuracy of the counting result can be improved. BRIEF DESCRIPTION OF DRAWINGS

[0033] The present application will be described in more detail below based on the embodiments and with reference to the drawings.

[0034] Figure 1 The implementation flowchart of the data processing method provided by the embodiment of the present application is shown in the figure.

[0035] Figure 2 The component structure diagram of the electronic device provided by the embodiment of the present application is shown in the figure.

[0036] In the drawings, the same components are denoted by the same reference numerals, and the drawings are not drawn according to the actual scale. DETAILED DESCRIPTION

[0037] In order to make the purpose, technical scheme and advantages of the present application clearer, the present application will be described in further detail below with reference to the drawings, and the described embodiments should not be regarded as limiting the present application, and all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.

[0038] In the following description, "some embodiments" are described, which describe a subset of all possible embodiments, but it can be understood that "some embodiments" can be the same subset or different subsets of all possible embodiments, and can be combined with each other without conflict.

[0039] If the application file appears "first \ second \ third" similar description is added the following description, the term "first \ second \ third" involved in this paper is only to distinguish similar objects, not to represent the specific order of the object, can be understood, "first \ second \ third" can be exchanged in the specific order or the order of precedence, as far as possible, to enable the application described herein to be implemented in an order other than that illustrated or described herein.

[0040] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used in the specification herein is for describing the embodiments of the application only and is not intended to limit the application.

[0041] Based on the problems in the related art, the application embodiment provides a data processing method, the method is applied to an electronic device, the electronic device can be a computer, a mobile terminal, etc., the computer, the mobile terminal can be a server of an application data statistics platform, the mobile terminal can include a mobile phone, a tablet computer, etc., in some embodiments, the electronic device can be a controller of the server of the application data statistics platform. The function realized by the data processing method provided by the application embodiment can be realized by calling program code by the processor of the electronic device, wherein the program code can be saved in the computer storage medium.

[0042] In the application embodiment, the application data statistics platform can be a platform used internally by an enterprise.

[0043] The application embodiment provides a data processing method, Figure 1 The implementation flowchart of the data processing method provided by the application embodiment is shown in Figure 1 As shown, it includes:

[0044] Step S101, in the case of obtaining the to-be-counted data sent by the client, determining whether the to-be-counted data includes a predetermined characteristic value.

[0045] In the application embodiment, the to-be-counted data can be any data sent by the client, for example, an access request, etc.

[0046] In the application embodiment, the predetermined characteristic value can be an identifier, for example, the identifier can be a number, etc., the predetermined characteristic value is used to represent the source of the data, that is, it can be used to represent the client.

[0047] In some embodiments, the predetermined characteristic value can be generated according to an encryption algorithm in combination with a time stamp.

[0048] In this embodiment of the application, the client can communicate with the data statistics platform. Each time the client sends data, it can add agreed feature values ​​to the data to be counted.

[0049] In this embodiment of the application, the electronic device can parse the statistical data to be analyzed, thereby determining whether the statistical data to be analyzed includes a feature value. If there is a feature value, the electronic device can verify the feature value, thereby determining whether the feature value is a predefined feature value, and thus determining whether the statistical data to be analyzed includes a predefined feature value.

[0050] In this embodiment of the application, if the feature value is the same as the agreed feature value, then it is determined that the statistical data to be collected includes the agreed feature value.

[0051] In this embodiment of the application, if there is no feature value, then no verification is required, and the statistical data to be collected does not include the agreed feature value.

[0052] Step S102: If the statistical data to be collected includes agreed-upon feature values, determine that the statistical data to be collected is valid data.

[0053] In this embodiment of the application, if the statistical data to be collected includes agreed-upon feature values, it can be considered that the client has correctly accessed the system, the client is a valid access party, and the statistical data to be collected is not forged from API tools or other external sources.

[0054] Step S103: Receive the statistical data to be collected and perform statistical analysis.

[0055] In this embodiment of the application, the electronic device can perform statistics to obtain statistical information, which may include statistical results.

[0056] In this embodiment, the electronic device can store valid data in a Hive database and write statistical results into a MySQL database, thereby facilitating use by the service provider.

[0057] This application provides a data processing method that, upon receiving statistical data to be collected from a client, determines whether the statistical data includes predetermined feature values; if the statistical data includes predetermined feature values, determines that the statistical data is valid; and receives and performs statistical analysis on the statistical data, thereby avoiding data from untrue sources and improving the accuracy of the statistical results.

[0058] Currently, mainstream data security strategies generally include introducing encryption algorithms, signature verification, and rate limiting. The combined use of these methods can meet security requirements. However, for platforms used internally by enterprises, some of these methods are quite complex, cumbersome to implement, and may result in less effective results.

[0059] The method provided in the embodiments of the present application has a simple implementation process relative to introducing encryption algorithms, adding and verifying signatures, and flow limiting.

[0060] In some embodiments, after step S102, the method further includes:

[0061] Step S104, in the case that the to-be-counted data does not include the agreed characteristic value, determining that the to-be-counted data is invalid data, and discarding the to-be-counted data.

[0062] In the embodiments of the present application, in the case that the to-be-counted data does not include the agreed characteristic value, it can be considered that the sending client of the to-be-counted data is an invalid access party, and the to-be-counted data is invalid data, which may be data forged by other API tools.

[0063] The method provided in the embodiments of the present application can improve the accuracy of the statistical result by determining that the to-be-counted data is invalid data in the case that the to-be-counted data does not include the agreed characteristic value, and discarding the to-be-counted data.

[0064] In some embodiments, the method further includes:

[0065] Step S105, in the case that the access request of the interface sent by the client is acquired, determining whether the interface is an externally open interface of the server.

[0066] In the embodiments of the present application, the electronic device has pre-stored information about whether each interface is an externally open interface, and after the access request of the interface is acquired, the electronic device can determine whether the interface is an externally open interface of the server based on the pre-stored information.

[0067] In the embodiments of the present application, the externally open interface is an interface that can be accessed by all users.

[0068] Step S106, in the case that the interface is an externally open interface, starting log recording of the interface.

[0069] In the embodiments of the present application, in the case that log recording is started, detailed information of each request and response is recorded.

[0070] The method provided in the embodiments of the present application can focus on monitoring the interface by starting log recording of the externally open interface.

[0071] In some embodiments, after step S106, the method further includes:

[0072] Step S107, acquiring log recording information of accessing the externally open interface.

[0073] In the embodiments of the present application, the electronic device logs the open interface, and can obtain log record information of accessing the open interface.

[0074] In step S108, the log record information is analyzed to obtain an analysis result.

[0075] In the embodiments of the present application, the log record information can be analyzed based on a log analysis tool, and the log analysis tool can be an ELK log analysis tool. The log record can be reviewed and analyzed by the log analysis tool.

[0076] In step S109, an abnormal access rule of the interface is configured based on the analysis result.

[0077] In the embodiments of the present application, the abnormal access rule can include limiting the access frequency of a user or an IP, the maximum access quantity, the delay time, and the like.

[0078] The analysis result can include the average access frequency of an IP, the average access quantity, the average delay time of access, and the like.

[0079] In the embodiments of the present application, the abnormal access rule can be configured based on the analysis result.

[0080] In some embodiments, the analysis result can also be written to an application data statistics platform management end to enable a developer to view.

[0081] The method provided by the embodiments of the present application can ensure the stable and safe operation of the system by analyzing the log record information and setting the abnormal access rule.

[0082] In some embodiments, before step S105, the method further includes:

[0083] In step S1051, when the access request of the interface of the server sent by the client is obtained, the client is further verified to determine whether the client has the access right of the interface. When it is determined that the client has the access right of the interface, it is determined whether the interface is the open interface of the server, and when it is determined that the client does not have the access right of the interface, the client is prohibited to access the interface.

[0084] The method provided by the embodiments of the present application can avoid the unauthorized data access by authorizing and authenticating the client.

[0085] In some embodiments, after step S105, the method further includes:

[0086] Step S110, in a case where the interface is the non-open interface of the server, determining whether the access request meets a set rule.

[0087] In the embodiments of the present application, the non-open interface is not developed for all people. When a user needs to access the non-developed interface, it is necessary to determine whether the access request meets a set rule.

[0088] In the embodiments of the present application, the electronic device hides the non-open interface, and can provide a resolution rule to part of the clients. The client can access the non-open interface through the resolution rule.

[0089] In the embodiments of the present application, the electronic device can resolve the access request, so as to determine whether the set resolution rule is met.

[0090] Step S111, in a case where the access request meets the set rule, allowing the client to access the non-open interface.

[0091] The method provided in the embodiments of the present application can protect the interface data and avoid tampering of the interface data by setting the set rule to access the non-developed interface.

[0092] In some embodiments, the method further includes:

[0093] Step S112, determining whether the access request triggers the abnormal access rule.

[0094] In the embodiments of the present application, the abnormal access rule can include a limited access frequency of a user or an IP, a maximum access quantity, a delay time, and the like.

[0095] Step S113, in a case where it is determined that the access request triggers the abnormal access rule, determining a risk level of the access request.

[0096] In the above example, if the user of the access request is a limited user, the abnormal access rule is triggered. If the access frequency of the IP of the access request is higher than the set access frequency, the abnormal access rule is triggered.

[0097] In the embodiments of the present application, different abnormal access rules can correspond to different risk levels.

[0098] In the embodiments of the present application, the risk level can include a first risk level and a second risk level, and the first risk level is higher than the second risk level.

[0099] Step S114, processing the access request of the client based on the risk level.

[0100] In the embodiments of the present application, the electronic device stores a corresponding relationship between different risk levels and processing manners, and when the risk level is determined, the corresponding processing manner can be determined, so that processing is performed based on the processing manner.

[0101] Exemplarily, the first risk level corresponds to immediate processing, and the processing manner can include blacklisting the user or IP or limited period interception request.

[0102] The processing manner corresponding to the second risk level can include sending a summary alarm to the developer for processing.

[0103] In some embodiments, the abnormal access rule can be dynamically adjusted according to actual conditions to ensure long-term stable operation of the interface.

[0104] Based on the foregoing various embodiments, the embodiments of the present application further provide a data processing method, which is used to solve the problems in the prior art that the data collection process of the application data statistical platform of a company is too transparent, too much invalid data or counterfeit data is easily received, the interface data interaction process is too simple, and data leakage or tampering is easily caused.

[0105] The data processing method provided by the embodiments of the present application includes:

[0106] The third-party system accesses the application data statistical platform, the third-party system acts as a client, and a characteristic value is agreed according to a certain rule. The characteristic value (the agreed characteristic value in the above-mentioned embodiments) is carried by the client at each time of data collection, that is, when the client sends the to-be-processed data to the server through the way of embedding a code, the agreed characteristic value needs to be sent to the server as one of the parameters. The server needs to verify the characteristic value and the agreed format, and consider that it is the data sent by the access party system, and it is included in the valid data set, otherwise it is considered as invalid data.

[0107] In the embodiments of the present application, the characteristic value can be an identification of a unique marking system provided by a service provider to an access party (the client in the above-mentioned embodiments).

[0108] In the embodiments of the present application, the characteristic value can be encrypted according to a certain encryption algorithm in combination with a time stamp parameter, and the parameter value is put into the request of each data sending.

[0109] In the embodiments of the present application, when the service party receives the data, the parameter (the characteristic value) is verified, when the parameter is identified as a valid access party, the data is started to be received, and when the verification fails, it is considered that the data sender does not correctly access the system, or the data is from a system outside the API tool and the like, and the data is invalid.

[0110] In the embodiments of the present application, when receiving valid data sent by the access party, the application data statistics platform performs statistics, and writes the data to the hive database, and writes the statistical results to the mysql database for use by the service party.

[0111] In the embodiments of the present application, when the client sends a request to the external interface of the server, the server starts log recording for the interface, and performs masking processing and access restriction on sensitive data, and records detailed information of each request and response, and performs intensive monitoring on the interface involving sensitive data acquisition, and combines a log analysis tool such as ELK to review and analyze the log, and writes the results to the application data statistics platform management end, sets access permission for only developers to view, and does not open to the outside; when accessing a non-external interface, the server hides the interface information, and provides the client with a parsing rule, and the client calls the non-external interface according to the rule, so as to protect the interface data from tampering.

[0112] In the embodiments of the present application, through accumulated log analysis records, in combination with the internal network environment server resources of the actual system running, initial abnormal access rules are generated, the abnormal access rules include limiting the access frequency, the maximum access quantity, the delay time of the user and the ip, and the abnormal access levels are set accordingly, to prevent DDOS attacks.

[0113] In the embodiments of the present application, the interface access can be monitored according to the abnormal access rules, when the abnormal access of the user or the ip to the interface triggers the condition configured by the rules, the abnormal access detailed information is recorded, the abnormal access of a higher risk level is implemented immediately, and the processing mode can be to blacklist the user or the ip or intercept the request for a limited period, the access of other risk levels is recorded, and a summary alarm is sent to the developer every day, the developer processes the alarm information, and the rule parameters are dynamically adjusted according to the actual situation, so as to ensure the long-term stable operation of the interface.

[0114] The method provided by the embodiments of the present application adds a conventional characteristic value to the collected data for marking the data source, for the server to check the data validity, to reduce redundant data or dirty data, and to avoid the occurrence of fake data, through the permission authorization and authentication of the interface request sending party, to avoid the occurrence of data access exceeding the authority, through the statistical results of the interface access, to long-term track the use situation of the calling party, to timely implement the interface calling control strategy, and to ensure the stable and safe operation of the system.

[0115] Based on the foregoing embodiments, the embodiments of the present application provide a data processing apparatus, each module included in the apparatus and each unit included in each module can be implemented by a processor in a computer device; of course, the embodiments can also be implemented by specific logic circuits; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor unit (MPU), a digital signal processor (DSP), a field programmable gate array (FPGA) or the like.

[0116] The embodiments of the present application provide a data processing apparatus, comprising:

[0117] A first determination module is configured to determine whether the to-be-counted data includes a predetermined characteristic value when the to-be-counted data sent by the client is acquired.

[0118] A second determination module is configured to determine that the to-be-counted data is valid data when the to-be-counted data includes the predetermined characteristic value.

[0119] A counting module is configured to receive the to-be-counted data and perform counting.

[0120] In some embodiments, the data processing apparatus is further configured to:

[0121] determine that the to-be-counted data is invalid data and discard the to-be-counted data when the to-be-counted data does not include the predetermined characteristic value.

[0122] In some embodiments, the data processing apparatus is further configured to:

[0123] determine whether the interface is an externally open interface of the server when an access request of an interface sent by the client is acquired.

[0124] start log recording of the interface when the interface is an externally open interface.

[0125] In some embodiments, the data processing apparatus is further configured to:

[0126] acquire log recording information of accessing the externally open interface;

[0127] analyze the log recording information to obtain an analysis result.

[0128] configure an abnormal access rule of the interface based on the analysis result.

[0129] In some embodiments, the data processing apparatus is further configured to:

[0130] In a case where the interface is a non-open interface of the server, determine whether the access request meets a set rule;

[0131] In a case where the access request meets a set rule, allow the client to access the non-open interface.

[0132] In some embodiments, the data processing apparatus is further configured to:

[0133] In a case where the access request of the interface of the server sent by the client is obtained, verify the client to determine whether the client has the access right of the interface; wherein, in a case where it is determined that the client has the access right of the interface, it is determined whether the interface is an open interface of the server; in a case where it is determined that the client does not have the access right of the interface, the client is prohibited to access the interface.

[0134] In some embodiments, the data processing apparatus is further configured to:

[0135] Determine whether the access request triggers the abnormal access rule;

[0136] In a case where it is determined that the access request triggers the abnormal access rule, determine the risk level of the access request;

[0137] Process the access request of the client based on the risk level.

[0138] Embodiments of the present application provide an electronic device; Figure 2 The composition structure schematic diagram of the electronic device provided by the embodiments of the present application is shown in Figure 2 As shown in the figure, the electronic device 500 includes a processor 501, at least one communication bus 502, a user interface 503, at least one external communication interface 504, and a memory 505. The communication bus 502 is configured to realize the connection and communication between the components. The user interface 503 can include a control screen, and the external communication interface 504 can include a standard wired interface and a wireless interface. The processor 501 is configured to execute the program of the data processing method stored in the memory to realize the steps in the data processing method provided in the above embodiments.

[0139] Embodiments of the present application provide a data processing method, comprising:

[0140] In a case where the to-be-counted data sent by the client is obtained, determine whether the to-be-counted data includes a predetermined characteristic value;

[0141] In a case where the to-be-counted data comprises a predetermined characteristic value, it is determined that the to-be-counted data is valid data.

[0142] The to-be-counted data is received and counted.

[0143] In some embodiments, the method further comprises:

[0144] In a case where the to-be-counted data does not comprise a predetermined characteristic value, it is determined that the to-be-counted data is invalid data, and the to-be-counted data is discarded.

[0145] In some embodiments, the method further comprises:

[0146] In a case where an access request for an interface sent by a client is acquired, it is determined whether the interface is an externally open interface of a server.

[0147] In a case where the interface is an externally open interface, log recording of the interface is started.

[0148] In some embodiments, the method further comprises:

[0149] Log recording information of accessing the externally open interface is acquired.

[0150] The log recording information is analyzed to obtain an analysis result.

[0151] Based on the analysis result, an abnormal access rule of the interface is configured.

[0152] In some embodiments, the method further comprises:

[0153] In a case where the interface is a non-externally open interface of the server, it is determined whether the access request satisfies a set rule.

[0154] In a case where the access request satisfies a set rule, the client is allowed to access the non-externally open interface.

[0155] In some embodiments, the method further comprises:

[0156] In a case where an access request for an interface of a server sent by a client is acquired, the client is verified to determine whether the client has access rights to the interface. In a case where it is determined that the client has access rights to the interface, it is determined whether the interface is an externally open interface of the server. In a case where it is determined that the client does not have access rights to the interface, the client is prohibited from accessing the interface.

[0157] In some embodiments, the method further comprises:

[0158] determine whether the access request triggers the exceptional access rule;

[0159] in a case where it is determined that the access request triggers the exceptional access rule, determine a risk level of the access request;

[0160] process the access request of the client based on the risk level.

[0161] It should be noted that the above description of the storage medium and device embodiments is similar to the description of the above method embodiments, and has similar beneficial effects to the method embodiments. For technical details not disclosed in the storage medium and device embodiments of the present application, please refer to the description of the method embodiments of the present application for understanding.

[0162] It should be understood that the "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in various embodiments of the present application, the size of the sequence number of each process does not mean the order of execution, and the execution order of each process should be determined according to its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The sequence number of the above embodiments of the present application is only for description, not representing the advantages and disadvantages of the embodiments.

[0163] It should be noted that in this paper, the term "include", "contain" or any other variant thereof is intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements not only includes those elements, but also includes other elements not explicitly listed, or includes elements inherent to such process, method, article or device. Without more limitations, the element defined by the statement "including a" does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0164] In several embodiments provided by the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are only schematic. For example, the division of the units is only a logical function division, and actual implementation can have another division manner. For example, multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the controlled or discussed components can be through some interface, indirect coupling or communication connection between devices or units, which can be electrical, mechanical or other forms.

[0165] The units described as separate components above can or can not be physically separate, and the components controlled as units can or can not be physical units; they can be located in one place or distributed on multiple network units; and part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0166] In addition, each functional unit in each embodiment of the present application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the integrated unit can be realized in the form of hardware or in the form of hardware plus software functional units.

[0167] Those skilled in the art can understand that all or part of the steps of the above-mentioned method embodiments can be completed by program instruction-related hardware, and the aforementioned program can be stored in a computer-readable storage medium, and the program executes the steps including the above-mentioned method embodiments when executed; and the aforementioned storage medium includes mobile storage devices, read-only memories (ROMs), magnetic discs or optical discs, and various storage media that can store program codes.

[0168] Alternatively, the integrated units of the present application, if implemented in the form of software functional modules and sold or used as independent products, can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present application can be embodied in the form of software products, which are stored in a storage medium and include a number of instructions for causing a controller to execute all or part of the methods described in the embodiments of the present application. The aforementioned storage medium includes mobile storage devices, ROMs, magnetic discs or optical discs, and various storage media that can store program codes.

[0169] The above is only an embodiment of the present application, but the protection scope of the present application is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A data processing method, characterized by, The method comprises the following steps: In the case that an access request of an interface sent by a client is acquired, it is determined whether the interface is an open interface of a server; In the case that the interface is an open interface, log recording of the interface is started; Log recording information of accessing the open interface is acquired; The log recording information is analyzed to obtain an analysis result; Based on the analysis result, an abnormal access rule of the interface is configured, wherein the analysis result comprises at least one of an average access frequency of an IP, an average number of accesses, and an average delay time of access, and the abnormal access rule comprises at least one of an access frequency, a maximum access number, and a delay time of limiting a user or an IP; In the case that the interface is a non-open interface of the server, it is determined whether the access request meets a set rule; In the case that the access request meets the set rule, the client is allowed to access the non-open interface; In the case that the client sends to-be-counted data, it is determined whether the to-be-counted data comprises a predetermined characteristic value; In the case that the to-be-counted data comprises the predetermined characteristic value, the to-be-counted data is determined as valid data; The to-be-counted data is received and counted.

2. The method of claim 1, wherein, The method further comprises: In the case that the to-be-counted data does not comprise the predetermined characteristic value, the to-be-counted data is determined as invalid data, and the to-be-counted data is discarded.

3. The method of claim 1, wherein, The method further comprises: In the case that an access request of an interface of a server sent by a client is acquired, the client is verified to determine whether the client has an access right of the interface; wherein in the case that it is determined that the client has the access right of the interface, it is determined whether the interface is an open interface of the server; in the case that it is determined that the client does not have the access right of the interface, the client is prohibited to access the interface.

4. The method according to claim 1, characterized in that, The method further comprises: It is determined whether the access request triggers the abnormal access rule; In the case that it is determined that the access request triggers the abnormal access rule, a risk level of the access request is determined; Based on the risk level, the access request of the client is processed.

5. A data processing apparatus for implementing the data processing method of any one of claims 1 to 4, characterized in that, The method comprises the following steps: A first determination module is configured to determine, in the case that to-be-counted data sent by a client is acquired, whether the to-be-counted data comprises a predetermined characteristic value; A second determination module is configured to determine, in the case that the to-be-counted data comprises the predetermined characteristic value, the to-be-counted data as valid data; A counting module is configured to receive the to-be-counted data and count.

6. An electronic device, comprising: The storage medium stores a computer program, which can be executed by one or more processors, and can be used to implement the data processing method in any one of claims 1 to 4.

7. A storage medium, characterized by The storage medium stores a computer program, which can be executed by one or more processors, and can be used to implement the data processing method in any one of claims 1 to 4.

Citation Information

Patent Citations

  • Request processing method, device, apparatus and system and user portrait generation method

    CN112565226A

  • Interface access log acquisition record query method and device and storage medium

    CN114595201A