Data management method, device, equipment and storage medium

By storing the data files corresponding to user role information in the target database in the financial industry marketing system, customized data management based on user roles is realized, solving the problems of slow query speed and waste of storage space, and improving query efficiency and storage Space utilization.

CN114428913BActive Publication Date: 2025-02-07AGRICULTURAL BANK OF CHINA
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202210201630.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2021-12-13
Filing Date
2022-03-03
Publication Date
2025-02-07
Estimated Expiration
2042-03-03

AI Technical Summary

Technical Problem

In report query, the financial industry marketing system generates a full data file and multiple table joint query, resulting in slow server query speed, affecting work efficiency, and wasting data storage space.

Method used

By storing the data files corresponding to the role information of all users in the target database, custom data management based on the user role is formed, and the corresponding data files are queried based on the role information of the current user.

Benefits of technology

It improves query efficiency, saves data storage space, and adapts to different data needs of different user roles.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114428913B_ABST
    Figure CN114428913B_ABST
Patent Text Reader

Abstract

The embodiment of the present invention discloses a data management method, device, equipment and storage medium. The method includes: when receiving a query request sent by a user, determining the role information of the current user; based on the role information, combined with a pre-stored target database, determining a target data file associated with the role information, wherein the target database stores data files corresponding to the role information of all users; according to the query request, querying the target data file to obtain a query result. The technical solution provided by the embodiment of the present invention forms customized data management based on user roles by storing data files corresponding to the role information of all users in the target database, making it easy to query corresponding data files according to the role information of the current user, improving query efficiency, and saving data storage space.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of data management technology, and in particular, to a data management method, apparatus, device and storage medium. Background Art

[0002] With the continuous increase in financial business, a business operation is usually accompanied by data changes in multiple modules of the backend system. According to the needs of the financial industry, it is necessary to provide queries of various dimensions of related transactions to support the marketing activities and assessments of business departments. The characteristics of financial industry marketing systems are mostly that there are many report transactions and large amounts of data. In previous report queries, full data files will be generated, involving complex situations such as multi-table joint queries, resulting in slow server query speeds, seriously affecting work efficiency, and wasting data storage space. Summary of the invention

[0003] The embodiments of the present invention provide a data management method, apparatus, device and storage medium, which form customized data management based on user roles by storing data files corresponding to the role information of all users in a target database, making it easy to query corresponding data files according to the role information of the current user, thereby improving query efficiency and saving data storage space.

[0004] In a first aspect, an embodiment of the present invention provides a data management method, the method comprising:

[0005] When receiving a query request sent by a user, determining the role information of the current user;

[0006] Based on the role information, in combination with a pre-stored target database, determining a target data file associated with the role information, wherein the target database stores data files corresponding to the role information of all users;

[0007] According to the query request, a query is performed in the target data file to obtain a query result.

[0008] In a second aspect, an embodiment of the present invention further provides a data management device, the device comprising:

[0009] A role information determination module, used to determine the role information of the current user when receiving a query request sent by the user;

[0010] A target data file determination module, used to determine a target data file associated with the role information based on the role information and in combination with a pre-stored target database, wherein the target database stores data files corresponding to the role information of all users;

[0011] The query result obtaining module is used to perform a query in the target data file according to the query request to obtain a query result.

[0012] In a third aspect, an embodiment of the present invention further provides a computer device, including: a memory and one or more processors;

[0013] The memory is used to store one or more programs;

[0014] When the one or more programs are executed by the one or more processors, the one or more processors implement the data management method as described in the first aspect above.

[0015] In a fourth aspect, an embodiment of the present invention further provides a storage medium comprising computer executable instructions, wherein the computer executable instructions are used to execute the data management method as described in the first aspect when executed by a computer processor.

[0016] The embodiment of the present invention discloses a data management method, device, equipment and storage medium. The method includes: when receiving a query request sent by a user, determining the role information of the current user; based on the role information, combined with a pre-stored target database, determining a target data file associated with the role information, wherein the target database stores data files corresponding to the role information of all users; according to the query request, querying the target data file to obtain a query result. The technical solution provided by the embodiment of the present invention forms customized data management based on user roles by storing data files corresponding to the role information of all users in the target database, making it easy to query corresponding data files according to the role information of the current user, improving query efficiency, and saving data storage space. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 A flowchart of a data management method provided in Embodiment 1 of the present invention;

[0018] Figure 2 A structural block diagram of a data management device provided in Embodiment 2 of the present invention;

[0019] Figure 3 This is a structural block diagram of a computer device provided in Embodiment 3 of the present invention. DETAILED DESCRIPTION

[0020] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention, rather than to limit the present invention.

[0021] It should also be noted that, for ease of description, only the part relevant to the present invention but not all content is shown in the accompanying drawings. It should be mentioned before discussing exemplary embodiments in more detail that some exemplary embodiments are described as processing or methods depicted as flow charts. Although the flow chart describes each operation (or step) as sequential processing, many operations therein can be implemented in parallel, concurrently or simultaneously. In addition, the order of each operation can be rearranged. When its operation is completed, the processing can be terminated, but it can also have additional steps not included in the accompanying drawings. The processing can correspond to methods, functions, procedures, subroutines, subprograms, etc.

[0022] The terms "first" and "second" and the like in the description, claims and drawings of the embodiments of the present invention are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may include steps or units that are not listed.

[0023] Embodiment 1

[0024] Figure 1 This is a flow chart of a data management method provided in Embodiment 1 of the present invention. This embodiment is applicable to data query situations of multi-table joint query. The method can be executed by a data management device, which can be composed of hardware and / or software and can generally be integrated in a computer device. The method specifically includes the following steps:

[0025] S110: When receiving a query request sent by a user, determine the role information of the current user.

[0026] For financial marketing systems, users need to query the data generated and saved by the system regularly or irregularly according to actual conditions to obtain user demand data. The characteristics of this type of system are mostly that there are many report-type transactions and a large amount of data. In previous report queries, complex situations such as multi-table joint queries were involved. Since different users have different needs and different data to be queried, in order to obtain the data to be queried, the existing technology often needs to traverse the entire amount of data. The embodiment of the present invention statistically analyzes the user's query needs based on the user's usage habits, and customizes the user's personalized data file as needed instead of blindly generating a full amount of data file.

[0027] Among them, the user's role information can be specifically understood as the user's position information. Different user positions have different data query rights, and different user positions need to query different data. For example, the role of the president of a first-level branch will query the deposit balance of institutions under its jurisdiction every day, and will also query the details of large-amount change reports; the operation and maintenance personnel need to query system operation data information, etc. They have the authority to query system operation data information, but do not have the authority to query deposit balances, etc.

[0028] In this embodiment, when a user performs a data query, it is necessary to first determine the user's role information, and then directly query the data file corresponding to the user's role information to quickly query the user's required data. Specifically, when a user performs a data query, the user initiates a data query request by operating on the system; when receiving the query request sent by the user, the request information may carry the identification information of the current user, the account information and password corresponding to the current user, etc.; the corresponding role information can be found based on the current user's account information. For example, when receiving the query request, the current user's account information is determined. Assuming that the account information is "Zhang XX", the role information can be determined as "Bank President" based on the account information. When performing a data query later, the data file corresponding to "Bank President" can be queried based on the role information to query the required data.

[0029] S120: Based on the role information and in combination with a pre-stored target database, determine a target data file associated with the role information.

[0030] The target database stores data files corresponding to the role information of all users. Users with different role information will need different data, which will produce different user query habits. Collect the query habits of front-end users, such as which roles are likely to use which query conditions; based on data analysis, create user profiles for the user's query habits. According to the needs of the user profile and the frequency of use of the defined report conditions, based on the user's role information, user profiles containing different role information can be formed. Based on the distributed system infrastructure, generate customized query data files corresponding to the user's role information.

[0031] In this embodiment, each role information corresponds to a large data file, and different role information corresponds to different data files. The data files corresponding to different role information can be stored in the target database. In this way, the user's query needs can be statistically analyzed based on the user's usage habits, and the user's personalized data file can be customized as needed instead of blindly generating a full data file, which improves the user's query efficiency and saves batch time and server file storage space.

[0032] Specifically, when a user's query request is received and the role information of the current user is determined, a data file corresponding to the role information can be queried in the target database based on the role information for the user to query data in the next step.

[0033] S130: According to the query request, query is performed in the target data file to obtain query results.

[0034] Specifically, according to the data query request, a query is performed in the target data file to obtain the query result, thereby improving the query efficiency of the user.

[0035] The embodiment of the present invention discloses a data management method. The method includes: when receiving a query request sent by a user, determining the role information of the current user; based on the role information, combined with a pre-stored target database, determining a target data file associated with the role information, wherein the target database stores data files corresponding to the role information of all users; and querying the target data file according to the query request to obtain a query result. The technical solution provided by the embodiment of the present invention forms customized data management based on user roles by storing data files corresponding to the role information of all users in the target database, making it easy to query corresponding data files according to the role information of the current user, improving query efficiency, and saving data storage space.

[0036] As an optional embodiment of the embodiment of the present invention, based on the above embodiment, when a query request sent by a user is received, the step of determining the role information of the current user can be specifically described as follows:

[0037] S111. When receiving a query request sent by a user, determine the account information of the current user.

[0038] In this embodiment, the system data resources are open to users with system use rights. When receiving a query request sent by a user, it is necessary to confirm the account information of the user accessing the system data resources to confirm the role information of the user. Specifically, since the query request sent by the user carries the user's account information and password, the account information of the current user can be determined based on the account information carried in the query request.

[0039] S112. Determine the role information of the current user according to the account information.

[0040] It is clear that multiple roles can be divided under each business system, such as auditor, administrator, department manager, data entry clerk, system maintainer, product developer, product trader, etc., which can be set according to the actual situation. Different roles correspond to different permission operations, such as review, management, entry rights, etc., or have the same permissions such as download, view, delete, create, upload, modify, etc., which can be set according to the actual situation. Here, by determining the role information of the current user, the query habits corresponding to the role information are determined, that is, the frequently queried data files corresponding to the role information are determined.

[0041] Specifically, according to the current user's account information, the role information corresponding to the account information can be queried from the system. For example, when the current user's account information is determined to be "Zhang XX", the role corresponding to "Zhang XX" can be found as an ordinary employee from the corresponding table of account information and role information stored in the system.

[0042] As an optional embodiment of the embodiment of the present invention, based on the above embodiment, the method further includes: generating a target database based on the historical query information and set usage frequency of all users.

[0043] In this embodiment, the historical query information of all users can be the query information of all users obtained based on the system within a set time period, that is, the query habits of different users are determined through historical query information. These query habits are further analyzed as basic data to establish a multi-dimensional user portrait from the aspects of user role information, usage frequency, transaction scenarios, association relationships, etc. After the user portrait is generated, it is batch processed to realize the customization of user data needs; at the same time, the generated data file is loaded into the database for subsequent users to perform data queries.

[0044] It should be noted that some data in the system, such as reports, need to be checked regularly, and some data need to be checked by users with certain role information at a set frequency. The set frequency can be daily, weekly, monthly, etc., and can be set according to actual conditions. For example, a report needs to be checked or used by ordinary employees every week. In this case, the report can be set to be stored in the target database at the set frequency of weekly. Similarly, the report needs to be stored in correspondence with the corresponding role, that is, the role of ordinary employee.

[0045] Optionally, based on the historical query information of all users and the set usage frequency, the steps of generating the target database can be specifically described as follows:

[0046] a1) Based on the historical query information of all users, a multi-dimensional user profile including role information is established.

[0047] Among them, the process of establishing a multi-dimensional user portrait is to abstract each specific information of the user into labels, and use these labels to concretize the user image, so as to provide users with targeted services.

[0048] Specifically, we obtain the historical query information of all users and build a multi-dimensional user portrait from the aspects of user role information, usage frequency, transaction scenario, association relationship, etc. To build a more specific user portrait, we need to make the obtained data more comprehensive, extract effective user tags, integrate them, and depict more detailed user information.

[0049] Optionally, based on the historical query information of all users, a multi-dimensional user profile including role information is created, including:

[0050] a11) Obtain all historical query information within the time period set by the user.

[0051] Specifically, historical query information of all users can be collected based on JavaScript (JS). Collect the query habits of front-end users, such as which roles are more likely to use which query conditions. JS is a lightweight, interpreted or just-in-time compiled programming language with function priority. It is a multi-paradigm dynamic scripting language based on prototype programming, and supports object-oriented, imperative and declarative styles.

[0052] For example, the role of the president of a first-level branch will query the deposit balance of institutions under its jurisdiction every day, and will also query the details of large-amount change reports. The usage habits of different roles are collected through the JS front desk, and these habits are used as basic data for the next step of analysis.

[0053] a12) Classify historical query information according to set attribute labels and establish a multi-dimensional user portrait including role information.

[0054] The set attribute tags may be user role information, usage frequency, transaction scenario, association relationship, etc. Specifically, the acquired historical query information of all users is classified according to the set attribute tags, and the user role information may be used as a basis to describe the relevant dimensional data corresponding to the role information, so as to establish a multi-dimensional user portrait including the role information.

[0055] b1) Generate a target database based on multi-dimensional user portraits and set usage frequency.

[0056] Specifically, according to the user portrait and the set usage frequency, based on the distributed system infrastructure, the data files corresponding to the role information of all users are determined respectively, and the data files are loaded into the target database for the user to query later.

[0057] Optionally, generate a target database based on user profiles and set usage frequency, including:

[0058] b11) According to the user portrait and the set usage frequency, based on the distributed system infrastructure, the data files corresponding to the role information of all users are determined respectively.

[0059] In this embodiment, based on the distributed system infrastructure (Hadoop Distributed File System, Hadoop), the data corresponding to the role information of all users can be processed to form an indexed data file. One role information corresponds to one data file, and different role information corresponds to different data files. Among them, Hadoop is a distributed system infrastructure developed by the Apache Foundation. Users can develop distributed programs without understanding the details of the distributed underlying layer. Make full use of the power of the cluster for calculation and storage. Hadoop implements a distributed file system (Hadoop Distributed File System, HDFS), one of the components of which is HDFS. HDFS has the characteristics of high fault tolerance and is designed to be deployed on low-cost hardware. It also provides high throughput to access application data and is suitable for applications with very large data sets. The core design of the Hadoop framework is HDFS and MapReduce. HDFS provides storage for massive data, and MapReduce provides calculation for massive data.

[0060] Among them, the user portrait contains multi-dimensional data corresponding to the role information. Specifically, on the one hand, based on the user portrait, Hadoop is called up for batch processing to generate a data file for user customized query. It can be clearly seen that each data file contains multi-dimensional data involved in the user portrait corresponding to a role information; on the other hand, according to the defined report setting usage frequency, the corresponding report is batch processed according to the set usage frequency to generate a data file. The set usage frequency can be set according to the actual usage of the report. For example, if report A needs to be reviewed by the bank president every month, the set usage frequency can be set to "monthly", and the role that can view report A is "bank president". It can be clearly seen that in order not to affect the normal business operation of the system, the time for batch processing can be the time when the system is not performing business operations, such as batch processing at night for users to query data the next day, or batch processing on weekends, and no specific restrictions are made here.

[0061] b12) Load the data file into the target database.

[0062] Among them, the target database can be selected from Oracle database. This database is a relational database management system of Oracle Corporation, which has always been a leading product in the database field. It can be said that Oracle database system is currently the most popular relational database management system in the world. The system has good portability, is easy to use, has powerful functions, and is suitable for all kinds of large, medium and small microcomputer environments. It is a highly efficient, reliable and high-throughput database solution.

[0063] Specifically, the personalized customized data files corresponding to the user role information are stored in the target database, without blindly generating and storing the full data files, thus saving data file storage space.

[0064] As an optional embodiment of the embodiment of the present invention, based on the above embodiment, after performing a query in the target data file according to the data query request and obtaining the query result, the following is further included:

[0065] Update the multi-dimensional user portrait based on the current user's role information and query request.

[0066] Specifically, when the current user completes the data query, the current user's role information, query request, and queried information can be used as new historical query information to update the multi-dimensional user portrait, so that the multi-dimensional user portrait can more accurately describe the user and ensure the accuracy of the multi-dimensional user portrait.

[0067] An optional embodiment of the present invention specifies the step of determining the role information of the current user when a query request sent by the user is received, thereby determining the user's corresponding role information; in addition, it specifies the step of generating a pre-stored target database, statistically analyzing the user's query needs based on the user's usage habits, and customizing the user's personalized data file as needed instead of blindly generating a full data file, thereby improving the user's query efficiency and saving batch time and server file storage space; at the same time, the multi-dimensional user portrait is updated for the new user query information generated, so that the formed user portrait description is more accurate.

[0068] Embodiment 2

[0069] Figure 2 This is a structural block diagram of a data management device provided in the second embodiment of the present invention. This embodiment is applicable to data query situations involving multiple table joint queries. The device may be composed of hardware and / or software and may generally be integrated into a computer device. Figure 2 As shown, the device may specifically include: a role information determination module 21, a target data file determination module 22 and a query result acquisition module 23.

[0070] The role information determination module 21 is used to determine the role information of the current user when receiving a query request sent by the user;

[0071] The target data file determination module 22 is used to determine the target data file associated with the role information based on the role information and in combination with the pre-stored target database, wherein the target database stores data files corresponding to the role information of all users;

[0072] The query result obtaining module 23 is used to perform a query in the target data file according to the query request to obtain the query result.

[0073] Optionally, the role information determination module 21 is specifically used for:

[0074] When receiving a query request sent by a user, determining the account information of the current user;

[0075] Determine the role information of the current user based on the account information.

[0076] Optionally, the device further comprises a target database generating module.

[0077] Target database generation module: used to generate the target database based on the historical query information of all users and the set usage frequency.

[0078] Optionally, the target database generation module includes:

[0079] A multi-dimensional user portrait building unit, used to build a multi-dimensional user portrait including role information based on the historical query information of all users;

[0080] The target database generation unit is used to generate a target database according to multi-dimensional user portraits and set usage frequencies.

[0081] Optionally, the multi-dimensional user portrait establishing unit is specifically used for:

[0082] Get all historical query information within the time period set by the user;

[0083] Historical query information is classified according to set attribute labels to create a multi-dimensional user portrait including role information.

[0084] Optionally, the target database generation unit is specifically used for:

[0085] According to the user portrait and set usage frequency, based on the distributed system infrastructure, the data files corresponding to the role information of all users are determined respectively;

[0086] Load the data file into the target database.

[0087] Optionally, the device further includes a multi-dimensional user portrait updating module.

[0088] The multi-dimensional user portrait update module is used to update the multi-dimensional user portrait according to the current user's role information and query request.

[0089] The above device can execute the data management method provided by all the above embodiments of the present invention, and has the corresponding functional modules and beneficial effects of executing the above methods. For technical details not described in detail in this embodiment, please refer to the methods provided by all the above embodiments of the present invention.

[0090] Embodiment 3

[0091] Figure 3 A structural block diagram of a computer device provided in Embodiment 3 of the present invention is shown in FIG. Figure 3 As shown, the computer device includes a processor 31, a memory 32, an input device 33 and an output device 34; the number of processors 31 in the computer device can be one or more. Figure 3 A processor 31 is taken as an example; the processor 31, memory 32, input device 33 and output device 34 in the computer device can be connected by a bus or other means. Figure 3 The example of connecting through bus is taken in the following.

[0092] The memory 32 is a computer-readable storage medium that can be used to store software programs, computer executable programs and modules, such as the modules corresponding to the data management method in the embodiment of the present invention (for example, the role information determination module 21, the target data file determination module 22 and the query result acquisition module 23 in the data management device). The processor 31 executes various functional applications and data processing of the computer device by running the software programs, instructions and modules stored in the memory 32, that is, implements the above-mentioned data management method.

[0093] The memory 32 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system and at least one application required for a function; the data storage area may store data created according to the use of the terminal, etc. In addition, the memory 32 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other non-volatile solid-state storage device. In some instances, the memory 32 may further include a memory remotely arranged relative to the processor 31, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0094] The input device 33 may be used to receive input digital or character information and generate key signal input related to user settings and function control of the computer device. The output device 34 may include a display device such as a display screen.

[0095] Embodiment 4

[0096] Embodiment 4 of the present invention further provides a storage medium containing computer executable instructions, wherein the computer executable instructions are used to execute a data management method when executed by a computer processor, the method comprising:

[0097] When receiving a query request sent by a user, determining the role information of the current user;

[0098] Based on the role information, in combination with a pre-stored target database, a target data file associated with the role information is determined, wherein the target database stores data files corresponding to the role information of all users;

[0099] According to the query request, the query is performed in the target data file to obtain the query result.

[0100] Of course, the computer executable instructions of a storage medium including computer executable instructions provided by an embodiment of the present invention are not limited to the operations of the method described above, but can also execute related operations in the data management method provided by any embodiment of the present invention.

[0101] Through the above description of the implementation methods, the technicians in the relevant field can clearly understand that the present invention can be implemented by means of software and necessary general hardware, and of course it can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as a computer floppy disk, read-only memory (ROM), random access memory (RAM), flash memory (FLASH), hard disk or optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods described in each embodiment of the present invention.

[0102] It is worth noting that in the embodiment of the above-mentioned data management device, the various units and modules included are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention.

[0103] Note that the above are only preferred embodiments of the present invention and the technical principles used. Those skilled in the art will understand that the present invention is not limited to the specific embodiments described herein, and that various obvious changes, readjustments and substitutions can be made by those skilled in the art without departing from the scope of protection of the present invention. Therefore, although the present invention has been described in more detail through the above embodiments, the present invention is not limited to the above embodiments, and may include more other equivalent embodiments without departing from the concept of the present invention, and the scope of the present invention is determined by the scope of the appended claims.

Claims

1. A data management method, characterized in that: include: When receiving a query request sent by a user, determining the role information of the current user; Based on the role information, in combination with a pre-stored target database, determining a target data file associated with the role information, wherein the target database stores data files corresponding to the role information of all users; According to the query request, query the target data file to obtain a query result; Wherein, the method further comprises: Generate the target database based on the historical query information and set usage frequency of all users; The target database is generated based on the historical query information and set usage frequency of all users, including: Based on the historical query information of all users, a multi-dimensional user portrait including role information is established; generating the target database according to the multi-dimensional user portrait and the set usage frequency; The step of establishing a multi-dimensional user portrait including role information based on the historical query information of all users includes: Obtain the historical query information within the time period set by all users; Classifying the historical query information according to the set attribute tags to establish the multi-dimensional user portrait including the role information; The step of generating the target database according to the multi-dimensional user portrait and the set usage frequency includes: According to the multi-dimensional user portraits and the set usage frequency, based on the distributed system infrastructure, respectively determine data files corresponding to the role information of all the users; The data file is loaded into the target database.

2. The method according to claim 1, characterized in that When receiving a query request sent by a user, determining the role information of the current user includes: When receiving a query request sent by a user, determining the account information of the current user; According to the account information, the role information of the current user is determined.

3. The method according to claim 1, characterized in that After performing a search in the target data file according to the query request and obtaining a query result, the method further includes: The multi-dimensional user portrait is updated according to the role information of the current user and the query request.

4. A data management device, characterized in that: include: A role information determination module, used to determine the role information of the current user when receiving a query request sent by the user; A target data file determination module, used to determine a target data file associated with the role information based on the role information and in combination with a pre-stored target database, wherein the target database stores data files corresponding to the role information of all users; A query result obtaining module, used to perform a query in the target data file according to the query request to obtain a query result; Wherein, the device also includes a target database generation module; The target database generation module is used to generate the target database based on the historical query information and set usage frequency of all users; Wherein, the target database generation module includes: A multi-dimensional user portrait establishing unit, used to establish a multi-dimensional user portrait including role information based on the historical query information of all users; A target database generating unit, configured to generate the target database according to the multi-dimensional user portrait and the set usage frequency; The multi-dimensional user portrait establishing unit is specifically used to obtain the historical query information within a set time period of all users; classify the historical query information according to the set attribute tags to establish the multi-dimensional user portrait including role information; Among them, the target database generation unit is specifically used to determine the data files corresponding to the role information of all users according to the multi-dimensional user portraits and the set usage frequency, based on the distributed system infrastructure; and load the data files into the target database.

5. A computer device, characterized in that: include: memory and one or more processors; The memory is used to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the data management method as described in any one of claims 1 to 3.

6. A storage medium containing computer executable instructions, characterized in that: The computer executable instructions are used to execute the data management method according to any one of claims 1 to 3 when executed by a computer processor.

Citation Information

Patent Citations

  • Data processing method and device, equipment and storage medium

    CN111125266A