User data caching method, device, storage medium and electronic device

By storing the user log data of the AAA server in different types of databases according to the time interval difference, the problem of limited resources is solved, efficient data storage and query are achieved, and the server load is reduced.

CN116361330BActive Publication Date: 2025-09-23BEIJING CAPITEK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202111615064.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-27
Publication Date
2025-09-23
Estimated Expiration
2041-12-27

AI Technical Summary

Technical Problem

When processing a large number of authentication and accounting requests, the AAA server has limited resources, resulting in insufficient throughput. Existing technologies make it difficult to efficiently utilize limited resources to provide data storage and query services.

Method used

By determining the time interval difference between the time when the processing result of the user log data is generated and the current time, the data is stored in an appropriate memory cache component, relational database or distributed database to reduce storage pressure and improve query efficiency.

Benefits of technology

It reduces the amount of data stored, reduces the reading and writing pressure, avoids server paralysis, and improves data query efficiency and business development capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116361330B_ABST
    Figure CN116361330B_ABST
Patent Text Reader

Abstract

This application provides a user data caching method, apparatus, storage medium, and electronic device, relating to the field of fixed-line broadband technology. This method, applied to a data management server including a memory cache component, includes: determining first processing result data of initial user log data; determining a time interval difference between the time when the first processing result data was generated and the current time; determining a storage location for the first processing result data based on the time interval difference, the storage location including a first database; and storing the first processing result data based on the determined storage location. This method reduces storage pressure on the storage location and effectively improves the server's response speed and throughput.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of fixed-line broadband technology, and in particular to a user data caching method, device, storage medium, and electronic device. Background Art

[0002] With the popularization of fixed-line broadband services, the number of authentication, authorization, and accounting (AAA) users and message requests are increasing. AAA servers need to support more concurrency, and servers and databases are performing more and more computations. However, server resources are limited, and the number of requests that databases can accept per second is also limited. How to utilize limited resources to provide the highest possible throughput has always been a challenge in data processing. Summary of the Invention

[0003] In order to solve the above technical problems, the present application is proposed. The embodiments of the present application provide a user data caching method, device, storage medium and electronic device.

[0004] In a first aspect, an embodiment of the present application provides a user data caching method, which is applied to a data management server including a memory cache component, the method comprising: determining first processing result data of initial user log data; determining a time interval difference between a generation time of the first processing result data and a current time; based on the time interval difference, storing the first processing result data in a corresponding storage location, the storage location comprising a first database.

[0005] In combination with the first aspect, in certain implementations of the first aspect, storing the first processing result data in a corresponding storage location based on the time interval difference includes: if it is determined that the first processing result data belongs to the historical data range based on the time interval difference, the first processing result data is stored in the first database in real time.

[0006] In combination with the first aspect, in certain implementations of the first aspect, storing the first processing result data in a corresponding storage location based on the time interval difference includes: if it is determined that the first processing result data belongs to the non-historical data range based on the time interval difference, the first processing result data is stored in a memory cache component in real time.

[0007] In combination with the first aspect, in certain implementations of the first aspect, the first database includes a relational database, and after storing the first processing result data in a memory cache component in real time, it also includes: performing statistical processing on the first processing result data stored in the memory cache component to obtain second processing result data corresponding to the first processing result data; and based on a first preset data transfer time, periodically storing the second processing result data in the relational database.

[0008] In combination with the first aspect, in certain implementations of the first aspect, the storage location also includes a second database, and after the first processing result data is stored in the memory cache component in real time, it also includes: based on a second preset data transfer time, the first processing result data stored in the memory cache component is periodically stored in the second database, wherein the second database includes a distributed database.

[0009] In combination with the first aspect, in certain implementations of the first aspect, determining the first processing result data of the initial user log data includes: using the computing engine in the data management server to obtain standardized log data corresponding to the initial user log data from the message middleware; using the computing engine to process the standardized log data to determine the first processing result data.

[0010] In combination with the first aspect, in certain implementations of the first aspect, before using the computing engine in the data management server to obtain the standardized log data corresponding to the initial user log data from the message middleware, it also includes: determining the initial user log data, the initial user log data includes user authentication data and / or initial user call record data; performing data extraction, conversion and loading operations on the initial user log data to obtain standardized log data corresponding to the initial user log data; and using the data management server to send the standardized user log data to the message middleware.

[0011] In the second aspect, an embodiment of the present application provides a user data caching device, which is applied to a data management server including a memory cache component, and the device includes: a first determination module, used to determine the first processing result data of the initial user log data; a second determination module, used to determine the time interval difference between the generation time of the first processing result data and the current time; a data storage module, used to store the first processing result data in a corresponding storage location based on the time interval difference, and the storage location includes a first database.

[0012] In a third aspect, an embodiment of the present application provides a computer-readable storage medium, which stores a computer program for executing the user data caching method mentioned in any of the above embodiments.

[0013] In a fourth aspect, an embodiment of the present application provides an electronic device, which includes: a processor; a memory for storing processor-executable instructions; and the processor is used to execute the user data caching method mentioned in any of the above embodiments.

[0014] The user data caching method provided in the embodiments of the present application processes initial user log data to obtain first processing result data, thereby reducing the amount of data to be cached and thereby alleviating data storage pressure and data read and write pressure. Furthermore, the storage location of the first processing result data is reasonably determined based on the time interval difference between the generation time of the first processing result data and the current time, further alleviating data storage pressure and improving user data query efficiency. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The above and other purposes, features, and advantages of the present application will become more apparent through a more detailed description of the embodiments of the present application in conjunction with the accompanying drawings. The accompanying drawings are intended to provide a further understanding of the embodiments of the present application and constitute a part of the specification. Together with the embodiments of the present application, they are used to explain the present application and do not constitute a limitation of the present application. In the drawings, the same reference numerals generally represent the same components or steps.

[0016] Figure 1 FIG2 is a flow chart of a user data caching method provided in an embodiment of the present application.

[0017] Figure 2 The figure shows a flow chart of storing the first processing result data in the corresponding storage location provided by an embodiment of the present application.

[0018] Figure 3 The figure shows a flow chart of storing first processing result data in a corresponding storage location provided by another embodiment of the present application.

[0019] Figure 4 The figure shows a flow chart of storing first processing result data in a corresponding storage location provided by another embodiment of the present application.

[0020] Figure 5 The figure shows a flow chart of determining first processing result data of initial user log data provided by an embodiment of the present application.

[0021] Figure 6 The figure shows a flow chart of determining first processing result data of initial user log data provided by another embodiment of the present application.

[0022] Figure 7 The following is a business flow diagram of a user data caching method provided by an embodiment of the present application.

[0023] Figure 8 FIG2 is a schematic diagram of the structure of a user data caching device provided in one embodiment of the present application.

[0024] Figure 9 Shown is a structural schematic diagram of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0026] AAA servers are primarily responsible for user authentication, authorization, and billing. This means identifying and confirming users' identities and permissions when accessing network services and resources, and performing billing operations based on usage. With the rapid expansion of fixed-line broadband services, AAA servers play a crucial role. The increasing number of users presents greater challenges in storing and analyzing the massive amounts of log data generated.

[0027] Figure 1 FIG. 1 is a flow chart of a user data caching method provided by an exemplary embodiment of the present application. For example, the user data caching method is applied to a data management server including a memory cache component. Figure 1 As shown, the user data caching method provided in the embodiment of the present application includes the following steps.

[0028] Step 10: Determine first processing result data of the initial user log data.

[0029] Specifically, the initial user log data refers to user log data that has not undergone any data processing operations, including but not limited to some authentication data and call record data generated by the user.

[0030] Authentication typically involves a user entering a username and password to conduct a rights review. The principle behind authentication is that each user has unique access criteria, which the AAA server compares against the criteria of every other user in its database. If they meet the criteria, the user is authenticated; if they do not, the network connection is denied. For example, if a user fails authentication, the AAA server denies the user a fixed-line broadband connection. Authentication data is data generated by the user during authentication. Examples include the user's password, username, number of authentication attempts, incorrect usernames and passwords entered during authentication, and so on.

[0031] Call record data refers to the user's original communication record information, including serial number, user ID, start time of network usage, end time of network usage, network usage duration, rate, fee, etc.

[0032] Furthermore, the first processing result data of the initial user log data is completed in the calculation engine. Specifically, the calculation engine obtains the first processing result data of the initial user log data corresponding to a specific business according to the business.

[0033] Step 20: Determine the time interval difference between the generation time of the first processing result data and the current time.

[0034] It can be understood that the first processing result data is determined based on the initial user log data, and the generation time of the first processing result data refers to the generation time of various types of user data contained in the initial user log data. For example, if the generation time of a certain call record data in the initial user log data is November 1, 2021, then the generation time of the first processing result data corresponding to the initial user data is November 1, 2021; if a certain authentication data in the initial user log data is generated on November 15, 2021, then the generation time of the first processing result data corresponding to the user log data is November 15, 2021.

[0035] For example, if the current time is November 16, 2021, then for the first processing result data generated on November 1, 2021, the time interval difference is 15 days; for the first processing result data generated on November 15, 2021, the time interval difference is 1 day.

[0036] Step 30: Based on the time interval difference, store the first processing result data in a corresponding storage location.

[0037] Specifically, the first processing result data is stored in a corresponding storage location based on the time interval difference using the preset time interval threshold data.

[0038] The time interval threshold data can be set arbitrarily according to the needs of the service to be executed. For example, if the service to be executed is to count the network usage patterns of a certain user within 5 days, the time interval threshold can be set to 5.

[0039] By determining the first processing result of user log data, the amount of data to be cached is reduced, alleviating data storage pressure and read / write pressure. Based on the different tasks being executed, the difference between the generation time of the first processing result data and the current time is compared and the first processing result data is stored in the appropriate location, improving data query efficiency and facilitating backend management systems to retrieve data according to their business needs.

[0040] Figure 2 The figure shows a flow chart of storing the first processing result data in the corresponding storage location according to an embodiment of the present application. Figure 1 Based on the embodiment shown Figure 2 The embodiment shown is described below in detail. Figure 2 The embodiment shown and Figure 1 The differences and similarities between the illustrated embodiments are not described in detail.

[0041] like Figure 3 As shown, in the user data caching method provided in the embodiment of the present application, the step of storing the first processing result data in the corresponding storage location based on the time interval difference includes the following steps.

[0042] Step 31: Based on the time interval difference, determine whether the first processing result data belongs to the historical data range.

[0043] Specifically, based on the relationship between the time interval difference and the preset time interval threshold data, it is determined whether the first processing result data belongs to the historical data range.

[0044] Continued use Figure 1 In the example, the preset time interval threshold is 5. For the first processing result data with a time interval difference of 15 days, the first processing result data does not belong to the historical data range. For the first processing result data with a time interval difference of 1 day, the first processing result data belongs to the historical data range.

[0045] For example, in actual application, if the judgment result of step 31 is yes, that is, based on the time interval difference, the first processing result data belongs to the historical data range, then step 32 is executed; if the judgment result of step 31 is no, that is, based on the time interval difference, the first processing result data does not belong to the historical data range, then step 33 is executed.

[0046] Step 32: Store the first processing result data in the first database in real time.

[0047] Specifically, the first database includes a relational database. Exemplarily, if the first processing result data belongs to the historical data range, the first data result data is stored in real time in the relational database, which is disk-based.

[0048] Step 33: Store the first processing result data in a memory cache component in real time.

[0049] Specifically, if the first processing result data does not belong to the historical data range, the first processing result data is stored in a memory cache component in real time, and the memory cache component is memory-based.

[0050] The memory cache component is memory-based, and the first database is disk-based. By judging whether the first processing result data belongs to the historical data range, the first processing result data is stored in the first database or the memory cache component accordingly. This is different from directly storing the first processing result data in the first database. The technical solution in this embodiment can reduce the access pressure of the database and avoid the problem of the database being disconnected due to being unable to withstand a large number of input and output flows. The first processing result data that does not belong to the historical data range has a high read and write frequency. Storing it in the memory cache component can increase the data reading and writing speed, thereby improving the data query efficiency. In addition, the background management system can read data through the memory cache component and use the data to expand other businesses in addition to the specified business, such as using the data to conduct statistical analysis and indicator analysis on user network behavior.

[0051] Figure 3 The figure shows a flow chart of storing the first processing result data in the corresponding storage location provided by another embodiment of the present application. Figure 2 Based on the above embodiment, Figure 3 The embodiment shown is described below in detail. Figure 3 The embodiment shown and Figure 2 The differences and similarities between the illustrated embodiments are not described in detail.

[0052] like Figure 3 As shown, in the user data caching method provided in the embodiment of the present application, after the first processing result data is stored in the memory cache component in real time, the following steps are also included.

[0053] Step 34 : performing statistical processing on the first processing result data stored in the memory cache component to obtain second processing result data corresponding to the first processing result data.

[0054] Illustratively, statistical processing is performed on the first processing result data, and the obtained second processing result data may be the distribution pattern of users' network usage time points, network usage duration, network usage fee distribution pattern, etc.

[0055] Step 35: Based on the first preset data transfer time, the second processing result data is stored in the relational database at a fixed time.

[0056] Specifically, the first preset data transfer time can be set arbitrarily as needed. For example, the first preset data transfer time is midnight every day, and the second processing result data will be regularly stored in the relational database at midnight every day.

[0057] Relational databases only support basic data storage formats. The data tables in a relational database are associated with each other, and the usage rate is high in terms of convenient data reading and writing, resulting in a very high read and write concurrency of the relational database. By further statistically processing the first processing result data in the memory cache component, the second processing result data after statistical processing is stored in the relational database, thereby reducing the amount of data stored in the database. Based on the preset first data transfer time, the second processing result data is stored in the relational database at regular intervals. This is different from storing the second processing result data in the relational database in real time. The method in this embodiment avoids the problem of frequent database interactions causing server paralysis.

[0058] Figure 4 The figure shows a flow chart of storing the first processing result data in the corresponding storage location provided by another embodiment of the present application. Figure 2 Based on the above embodiment, Figure 4 The embodiment shown is described below in detail. Figure 4 The embodiment shown and Figure 2 The differences and similarities between the illustrated embodiments are not described in detail.

[0059] like Figure 4 As shown, in the user data caching method provided in the embodiment of the present application, after the first processing result data is stored in the memory cache component in real time, the following steps are also included.

[0060] Step 36: Based on the second preset data transfer time, the first processing result data stored in the memory cache component is stored in the second database at a fixed time.

[0061] Specifically, the second database includes a distributed database. The second preset data transfer time may be the same as or different from the first preset transfer time. For example, the second preset transfer time is 1:00 a.m. daily, and the second processing result data is regularly transferred to the distributed database at 1:00 a.m. daily.

[0062] Distributed databases have higher data access speeds, stronger scalability, and higher concurrency, and they support multiple storage formats, such as document format, image format, etc. By storing the first processing result data in a distributed database, the pressure of reading and writing data can be further reduced. Based on the preset second data transfer time, the second processing result data is stored in the distributed database at regular intervals. This is different from storing the second processing result data in the distributed database in real time. The method in this embodiment also avoids the problem of frequent database interactions causing server paralysis.

[0063] Figure 5 The figure shows a flow chart of determining the first processing result data of the initial user log data provided by an embodiment of the present application. Figure 1 Based on the above embodiment, Figure 5 The embodiment shown is described below in detail. Figure 5 The embodiment shown and Figure 1 The differences and similarities between the illustrated embodiments are not described in detail.

[0064] like Figure 5 As shown, in the user data caching method provided in the embodiment of the present application, the step of determining the first processing result data of the initial user log data includes the following steps.

[0065] Step 14: using the computing engine in the data management server to obtain standardized log data corresponding to the initial user log data from the message middleware;

[0066] Step 15: Process the standardized log data using a computing engine to determine first processing result data.

[0067] Compared with the initial user log data, the first processing result data has a smaller amount of data. Through the technical solution in this embodiment, the storage amount of the first processing result data corresponding to the initial user log data is reduced, and it is also beneficial for the background management system to expand other businesses based on the first processing result data, without having to pull a copy of the initial user log data for repeated data processing.

[0068] Figure 6 The figure shows a flow chart of determining the first processing result data of the initial user log data provided by another embodiment of the present application. Figure 5 Based on the above embodiment, Figure 6 The embodiment shown is described below in detail. Figure 6 The embodiment shown and Figure 5 The differences and similarities between the illustrated embodiments are not described in detail.

[0069] like Figure 6 As shown, in the user data caching method provided in the embodiment of the present application, before using the computing engine in the data management server to obtain the standardized log data corresponding to the initial user log data from the message middleware, the following steps are also included.

[0070] Step 11, determining the initial user log data, wherein the initial user log data includes initial user authentication data and / or initial user call record data;

[0071] Step 12: performing data extraction, conversion, and loading operations on the initial user log data to obtain standardized log data corresponding to the initial user log data;

[0072] Specifically, an ETL (Extract-Transform-Load) operation is performed on the initial user log data, i.e., extraction, transformation, and loading operations are performed to filter out some dirty data and process some irregular data to obtain standardized log data corresponding to the initial user log data.

[0073] Step 13: Utilize the data management server to send the standardized user log data to the message middleware.

[0074] Through the technical solution of this embodiment, dirty data in the initial user log data can be filtered out, and the initial user log data can be converted into a standardized format that is convenient for unified processing, which is conducive to the next step of processing the standardized user log data.

[0075] In some embodiments, the business flow diagram of the user data caching method is as follows: Figure 7 shown.

[0076] Step a: cache the data that does not belong to the historical data range into the memory cache component and maintain the data in the relevant data table.

[0077] Step b: Cache the data within the historical data range into a relational database.

[0078] Step c: Update the data in the memory cache component.

[0079] Step d: Count the data in the memory cache component and cache the statistical results to the relational database at regular intervals.

[0080] Step e: Periodically cache the data in the memory cache component to the distributed database.

[0081] right Figure 7 For a more detailed description, see Figures 1 to 6 In the embodiment.

[0082] Combined with the above Figures 1 to 7 , describes in detail the embodiment of the user data caching method of the present application, and the following is combined with Figure 8 , describes in detail the embodiment of the user data caching device of the present application. It should be understood that the description of the embodiment of the user data caching method corresponds to the description of the embodiment of the user data caching device, so for parts not described in detail, please refer to the previous method embodiment.

[0083] Figure 8 FIG. 1 is a schematic diagram of the structure of a user data caching device provided by an exemplary embodiment of the present application. Figure 8 As shown, the user data caching device provided in the embodiment of the present application includes:

[0084] A first determining module 100 is used to determine first processing result data of initial user log data;

[0085] The second determining module 200 is used to determine the time interval difference between the generation time of the first processing result data and the current time;

[0086] The data storage module 300 is used to store the first processing result data in a corresponding storage location based on the time interval difference, and the storage location includes a first database.

[0087] In one embodiment of the present application, the second determining module 300 is further configured to, if it is determined based on the time interval difference that the first processing result data belongs to the historical data range, store the first processing result data in the first database in real time.

[0088] In one embodiment of the present application, the second determination module 300 is further configured to, if it is determined based on the time interval difference that the first processing result data belongs to the non-historical data range, store the first processing result data in a memory cache component in real time.

[0089] In one embodiment of the present application, the second determination module 300 is also used to perform statistical processing on the first processing result data stored in the memory cache component to obtain second processing result data corresponding to the first processing result data; based on the first preset data transfer time, the second processing result data is stored in the relational database at regular intervals.

[0090] In one embodiment of the present application, the second determination module 300 is further configured to periodically store the first processing result data stored in the memory cache component in a second database based on a second preset data transfer time, wherein the second database includes a distributed database.

[0091] In one embodiment of the present application, the first determination module 100 is also used to use the computing engine in the data management server to obtain standardized log data corresponding to the initial user log data from the message middleware; use the computing engine to process the standardized log data to determine the first processing result data.

[0092] In one embodiment of the present application, the first determination module 100 is also used to determine the initial user log data, which includes user authentication data and / or initial user call record data; perform data extraction, conversion and loading operations on the initial user log data to obtain standardized log data corresponding to the initial user log data; and use the data management server to send the standardized user log data to the message middleware.

[0093] It should be understood that Figure 8 The operations and functions of the first determination module 100, the second determination module 200, and the data storage module 300 in the provided user data cache device can refer to the above Figures 1 to 7 To avoid repetition, the data caching method provided is not described here.

[0094] Below, reference Figure 9 To describe the electronic device according to the embodiment of the present application. Figure 9 Shown is a schematic structural diagram of an electronic device provided by an exemplary embodiment of the present application.

[0095] like Figure 9 As shown, the electronic device 70 includes one or more processors 701 and a memory 702. Exemplarily, the electronic device 70 includes a server.

[0096] The processor 701 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 70 to perform desired functions.

[0097] The memory 702 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may, for example, include random access memory (RAM) and / or cache memory (cache), etc. The non-volatile memory may, for example, include read-only memory (ROM), a hard disk, a flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 701 may execute the program instructions to implement the user data caching method of each embodiment of the present application described above and / or other desired functions. Various contents such as user authentication data and call record data may also be stored in the computer-readable storage medium.

[0098] In one example, the electronic device 70 may further include an input device 703 and an output device 704 , and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0099] The input device 703 may include, for example, a keyboard, a mouse, and the like.

[0100] The output device 704 can output various information to the outside, including user authentication data and call record data, etc. The output device 704 can include, for example, a display, a speaker, a printer, a communication network and its connected remote output device, etc.

[0101] Of course, to simplify, Figure 9Only some of the components related to the present application in the electronic device 70 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, the electronic device 70 may further include any other appropriate components according to specific application scenarios.

[0102] In addition to the above-mentioned methods and devices, an embodiment of the present application may also be a computer program product, which includes computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the user data caching method according to various embodiments of the present application described above in this specification.

[0103] The computer program product may be written in any combination of one or more programming languages ​​to implement the program code for performing the operations of the embodiments of the present application, including object-oriented programming languages ​​such as Java, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0104] In addition, an embodiment of the present application may also be a computer-readable storage medium having computer program instructions stored thereon, which, when executed by a processor, enables the processor to execute the steps of the user data caching method according to various embodiments of the present application described above in this specification.

[0105] The computer-readable storage medium can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium can, for example, include but is not limited to a system, device or component of electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof.

[0106] The basic principles of the present application have been described above in conjunction with specific embodiments. However, it should be noted that the advantages, strengths, and effects mentioned in this application are merely illustrative and not restrictive, and it should not be assumed that these advantages, strengths, and effects are required of each embodiment of this application. In addition, the specific details disclosed above are merely illustrative and facilitating understanding, and are not restrictive. The above details do not limit this application to necessarily being implemented using the above specific details.

[0107] The block diagrams of the devices, devices, equipment, and systems involved in this application are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As will be appreciated by those skilled in the art, these devices, devices, equipment, and systems can be connected, arranged, or configured in any manner. Words such as "include," "comprise," "have," and the like are open-ended words, meaning "including but not limited to," and can be used interchangeably therewith. The words "or" and "and" used herein refer to the words "and / or" and can be used interchangeably therewith, unless the context clearly indicates otherwise. The word "such as" used herein refers to the phrase "such as but not limited to," and can be used interchangeably therewith.

[0108] It should also be noted that in the apparatus, device, and method of the present application, each component or each step can be decomposed and / or recombined, and such decomposition and / or recombination should be regarded as equivalent solutions of the present application.

[0109] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present application. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of the present application. Therefore, the present application is not intended to be limited to the aspects shown herein, but rather to be accorded the widest scope consistent with the principles and novel features disclosed herein.

[0110] The above description has been provided for the purpose of illustration and description. Furthermore, this description is not intended to limit the embodiments of the present application to the forms disclosed herein. Although a number of example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations thereof.

Claims

1. A user data caching method, characterized in that: Applied to a data management server including a memory cache component, the method comprises: Determining first processing result data of initial user log data; Determine a time interval difference between the generation time of the first processing result data and the current time; Based on the time interval difference, the first processing result data is stored in a corresponding storage location, the storage location includes a first database, the storage location also includes a memory cache component and a second database, the first database is a relational database, and the second database is a distributed database.

2. The user data caching method according to claim 1, characterized in that: The storing the first processing result data in a corresponding storage location based on the time interval difference includes: If it is determined based on the time interval difference that the first processing result data belongs to the historical data range, the first processing result data is stored in the first database in real time.

3. The user data caching method according to claim 1, wherein: The storing the first processing result data in a corresponding storage location based on the time interval difference includes: If it is determined based on the time interval difference that the first processing result data belongs to the non-historical data range, the first processing result data is stored in the memory cache component in real time.

4. The user data caching method according to claim 3, characterized in that: After storing the first processing result data in the memory cache component in real time, the method further includes: Performing statistical processing on the first processing result data stored in the memory cache component to obtain second processing result data corresponding to the first processing result data; Based on a first preset data transfer time, the second processing result data is stored in the relational database at a regular interval.

5. The user data caching method according to claim 3, characterized in that: After storing the first processing result data in the memory cache component in real time, the method further includes: Based on a second preset data transfer time, the first processing result data stored in the memory cache component is stored in a second database at a regular interval.

6. The user data caching method according to any one of claims 1 to 5, characterized in that: The first processing result data of determining the initial user log data includes: Obtaining standardized log data corresponding to the initial user log data from the message middleware using a computing engine in the data management server; The standardized log data is processed using the computing engine to determine the first processing result data.

7. The user data caching method according to claim 6, characterized in that: Before obtaining the standardized log data corresponding to the initial user log data from the message middleware using the computing engine in the data management server, the method further includes: Determining the initial user log data, where the initial user log data includes initial user authentication data and / or initial user call record data; Performing data extraction, conversion, and loading operations on the initial user log data to obtain standardized log data corresponding to the initial user log data; The standardized log data is sent to the message middleware by using the data management server.

8. A user data caching device, characterized in that: Applies to data management servers that include memory cache components, including: A first determining module, configured to determine first processing result data of the initial user log data; A second determining module is used to determine the time interval difference between the generation time of the first processing result data and the current time; A data storage module is used to store the first processing result data in a corresponding storage location based on the time interval difference, the storage location includes a first database, the storage location also includes a memory cache component and a second database, the first database is a relational database, and the second database is a distributed database.

9. A computer-readable storage medium, characterized in that The storage medium stores a computer program, and the computer program is used to execute the user data caching method according to any one of claims 1 to 7.

10. An electronic device, characterized in that: The electronic device comprises: processor; a memory for storing instructions executable by the processor; The processor is used to execute the user data caching method described in any one of claims 1 to 7.

Citation Information

Patent Citations

  • Log writing method and device, electronic equipment and medium

    CN111414343A