Data storage method, system, medium and terminal
Patent Information
- Application Number
- CN202311490355.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-09
- Publication Date
- 2026-09-18
- Estimated Expiration
- 2043-11-09
AI Technical Summary
[0004]有鉴于此,本申请提供一种数据的存储方法以及系统、介质、终端,主要目的在于改善现有分机构存储方式无法实现上下级数据流转、对全量数据进行统计分析以及集中存储方式数据库的性能要求高、易引起全局故障的问题
[0036] This application provides a data storage method, system, medium, and terminal. First, in response to an access operation by a target user, the access operation is categorized. Second, if the categorization result is a hierarchical flow category, the process jumps to the main cluster to perform main cluster processing on the access operation, and the main cluster processing result is stored in the main cluster database. Finally, the organization identifier of the target user is obtained, and the main cluster processing result is synchronized to the group cluster database corresponding to the organization identifier based on the group cluster database message queue. Compared with existing technologies, in this embodiment, when the access operation of the target user is identified as a hierarchical flow, the process jumps to the main cluster for processing and stores the processing results in the main cluster database. By centrally storing the processing results of access operations of hierarchical flow categories in the main cluster database, the data flow requirements of multiple organizations within a single process can be met. At the same time, the processing results of the main cluster are synchronized to the group cluster database corresponding to the target user through a message queue. By storing the processing results by organization, the problem of system performance degradation due to excessive data volume is avoided. Furthermore, when one database fails, it will not affect the operation of other databases, reducing the scope of the failure and improving the customer experience.
Smart Images

Figure CN117493059B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of digital office technology, and in particular to a data storage method, system, medium, and terminal. Background Technology
[0002] With the widespread adoption of digital office solutions, more and more companies are implementing OA (Office Automation) systems. Existing OA system data storage solutions mostly fall into two categories: distributed storage and centralized storage. Distributed storage involves grouping data according to organization, with each organization isolated from the others. Centralized storage involves storing all data centrally within the same cluster and using the same database.
[0003] However, with the branch-based storage approach, the independent deployment and physical isolation of each organization's OA system make it impossible to achieve multi-level data flow within a single process. Furthermore, the data is fragmented, hindering comprehensive statistical analysis. Conversely, the centralized storage approach, with all organizations' applications and databases deployed in a single environment, places extremely high demands on database performance, easily leading to performance bottlenecks. Moreover, significant increases in system concurrency or business volume can cause performance degradation, failing to meet user needs and future business growth requirements. Additionally, database outages or unexpected crashes will impact all users globally, resulting in a wide-ranging failure. Summary of the Invention
[0004] In view of this, this application provides a data storage method, system, medium, and terminal, the main purpose of which is to improve the existing branch-based storage method, which cannot realize the flow of data between upper and lower levels, perform statistical analysis of full data, and address the problems of high performance requirements and easy global failure of centralized storage databases.
[0005] According to one aspect of this application, a data storage method is provided, comprising:
[0006] In response to the access operation of the target user, the access operation is categorized.
[0007] If the category identification result is a hierarchical flow category, then jump to the main cluster to perform main cluster processing on the access operation based on the main cluster, and store the main cluster processing result in the main cluster database;
[0008] Obtain the organization identifier of the target user, and synchronize the main cluster processing result to the group cluster database corresponding to the organization identifier based on the group cluster database message queue.
[0009] Preferably, after obtaining the organization identifier of the target user and synchronizing the main cluster processing result with the group cluster database corresponding to the organization identifier based on the group cluster database message queue, the method further includes:
[0010] Based on the query and statistics database message queue, the processing results of the main cluster are synchronized to the query database and the statistics database, so as to obtain data from the query database or the statistics database when responding to data query instructions or data statistics instructions.
[0011] Preferably, after classifying the access operation in response to the access operation of the target user, the method further includes:
[0012] If the category identification result is a same-level flow category, then the organization identifier of the target user is obtained, and the user is redirected to the group cluster corresponding to the organization identifier. The access operation is then processed based on the group cluster, and the processing result is stored in the group cluster database corresponding to the group cluster.
[0013] Preferably, if the category identification result is a same-level flow category, then the organization identifier of the target user is obtained, and the user is redirected to the group cluster corresponding to the organization identifier, so as to perform group cluster processing on the access operation based on the group cluster, and the group cluster processing result is stored in the group cluster database corresponding to the group cluster. The method further includes:
[0014] Based on the query and statistics database message queue, the group cluster processing results are synchronized to the query database and the statistics database, so as to obtain data from the query database or the statistics database when responding to data query instructions or data statistics instructions.
[0015] Preferably, after classifying the access operation in response to the access operation of the target user, the method further includes:
[0016] If the category identification result is a statistical query category, then jump to the statistical query cluster and perform content identification on the access operation;
[0017] If the content recognition result is a data query instruction, then the data is searched in the query database according to the recognition information carried by the data query instruction;
[0018] If the content recognition result is a data statistics instruction, then the corresponding data is obtained from the statistics database according to the recognition information carried by the data statistics instruction.
[0019] According to another aspect of this application, a data storage system is provided, comprising:
[0020] The main cluster, the main cluster database, multiple group cluster databases, and the group cluster database message queue;
[0021] The main cluster communicates with the main cluster database, and the main cluster communicates with multiple group cluster databases through message queues of the group cluster databases.
[0022] The main cluster is used to process access operations of the upper and lower level flow categories.
[0023] The main cluster database is used to store the main cluster processing results obtained after processing by the main cluster.
[0024] The group cluster database is used to store the corresponding main cluster processing results based on the organization identifier of the target user who initiated the access operation.
[0025] The group cluster database message queue is used to synchronize the processing results of the main cluster to the corresponding group cluster database.
[0026] Preferably, the system further includes: multiple group clusters;
[0027] The group cluster communicates with the corresponding group cluster database to perform group cluster processing on access operations of the same level flow category, and transmits the group cluster processing results to the corresponding group cluster database.
[0028] Preferably, the system further includes: a statistical query cluster, a query database, a statistical database, and a query statistical database message queue;
[0029] The statistical query cluster communicates with the query database and the statistical database respectively. The query database and the statistical database communicate with the main cluster and the multiple group clusters through the query and statistical database message queue.
[0030] The statistical query cluster is used to perform content recognition on the access operation and obtain data from the query database or the statistical database based on the content recognition result;
[0031] The query statistics database message queue is used to synchronize the main cluster processing results with the group cluster processing results in the query database and the statistics database.
[0032] According to another aspect of this application, a storage medium is provided, wherein at least one executable instruction is stored therein, the executable instruction causing a processor to perform an operation corresponding to the data storage method described above.
[0033] According to another aspect of this application, a terminal is provided, comprising: a processor, a memory, a communication interface, and a communication bus, wherein the processor, the memory, and the communication interface communicate with each other through the communication bus;
[0034] The memory is used to store at least one executable instruction, which causes the processor to perform the operation corresponding to the above data storage method.
[0035] By employing the above technical solutions, the technical solutions provided in the embodiments of this application have at least the following advantages:
[0036] This application provides a data storage method, system, medium, and terminal. First, in response to an access operation by a target user, the access operation is categorized. Second, if the categorization result is a hierarchical flow category, the process jumps to the main cluster to perform main cluster processing on the access operation, and the main cluster processing result is stored in the main cluster database. Finally, the organization identifier of the target user is obtained, and the main cluster processing result is synchronized to the group cluster database corresponding to the organization identifier based on the group cluster database message queue. Compared with existing technologies, in this embodiment, when the access operation of the target user is identified as a hierarchical flow, the process jumps to the main cluster for processing and stores the processing results in the main cluster database. By centrally storing the processing results of access operations of hierarchical flow categories in the main cluster database, the data flow requirements of multiple organizations within a single process can be met. At the same time, the processing results of the main cluster are synchronized to the group cluster database corresponding to the target user through a message queue. By storing the processing results by organization, the problem of system performance degradation due to excessive data volume is avoided. Furthermore, when one database fails, it will not affect the operation of other databases, reducing the scope of the failure and improving the customer experience.
[0037] The above description is only an overview of the technical solution of this application. In order to better understand the technical means of this application and to implement it in accordance with the contents of the specification, and to make the above and other objects, features and advantages of this application more obvious and understandable, the following are specific embodiments of this application. Attached Figure Description
[0038] Various other advantages and benefits will become apparent to those skilled in the art upon reading the following detailed description of preferred embodiments. The accompanying drawings are for illustrative purposes only and are not intended to limit the scope of this application. Furthermore, the same reference numerals denote the same parts throughout the drawings. In the drawings:
[0039] Figure 1A flowchart of a data storage method provided in an embodiment of this application is shown;
[0040] Figure 2 A flowchart of another data storage method provided in an embodiment of this application is shown;
[0041] Figure 3 A flowchart of another data storage method provided in an embodiment of this application is shown;
[0042] Figure 4 This paper shows a block diagram of a data storage system according to an embodiment of the present application;
[0043] Figure 5 A schematic diagram of the structure of a terminal provided in an embodiment of this application is shown. Detailed Implementation
[0044] Exemplary embodiments of the present disclosure will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.
[0045] At the same time, it should be understood that, for ease of description, the dimensions of the various parts shown in the accompanying drawings are not drawn according to actual scale.
[0046] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the scope of this application and its application or use.
[0047] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.
[0048] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.
[0049] The embodiments of this application can be applied to computer systems / servers that can operate with a wide range of other general-purpose or special-purpose computing system environments or configurations. Examples of well-known computing systems, environments, and / or configurations suitable for use with computer systems / servers include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, handheld or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network PCs, minicomputer systems, mainframe computer systems, and distributed cloud computing environments that include any of the above systems, etc.
[0050] Computer systems / servers can be described in the general context of computer system executable instructions (such as program modules) executed by the computer system. Typically, program modules can include routines, programs, object programs, components, logic, data structures, etc., which perform specific tasks or implement specific abstract data types. Computer systems / servers can be implemented in distributed cloud computing environments, where tasks are performed by remote processing devices linked through a communication network. In distributed cloud computing environments, program modules can reside on local or remote computing system storage media, including storage devices.
[0051] This application provides a data storage method, such as... Figure 1 As shown, the method includes:
[0052] 101. In response to the access operation of the target user, classify the access operation.
[0053] The access operations are categorized into hierarchical flow, peer flow, statistical query, external integration, and general configuration categories. In this embodiment, the current execution end can be an OA system, which first identifies the category of the user's access operation upon receiving it.
[0054] It should be noted that access operations for hierarchical circulation include official documents such as work requests and collaborative tasks that connect upper and lower levels of organizations; access operations for peer circulation include official documents circulating within the same level, such as company incoming documents, company outgoing documents, department incoming and outgoing documents, and signed reports; access operations for statistical query include monthly, quarterly, and annual OA document processing efficiency statistical analysis of organizations at all levels; access operations for external interfaces include obtaining updated personnel data from the HR system and providing document query interfaces for the expense reimbursement system; and access operations for general configuration include general configurations such as system configuration, group settings, permission configuration, and delegation settings.
[0055] 102. If the category identification result is a hierarchical flow category, then jump to the main cluster to process the access operation based on the main cluster, and store the main cluster processing result in the main cluster database.
[0056] wherein, the main cluster is a core application cluster of the current execution end, configured to perform main cluster processing on access operations of upper-lower level flow category, access operations of external docking category, and access operations of general configuration category; the main cluster database is used to represent a database matched with the main cluster, and is configured to store main cluster processing results obtained after processing by the main cluster, which can include data generated during creation, update or deletion of basic configuration data such as organization personnel data, official document data communicated between upper and lower levels, and process template codes. In the embodiments of the present application, when it is identified that the category of an access operation is an upper-lower level flow category, an external docking category or a general configuration category, the access operation is automatically redirected to the main cluster, the main cluster performs main cluster processing on the current access operation, and stores the main cluster processing result in the main cluster database matched with the main cluster.
[0057] 103. Acquiring an organization identifier of a target user, and synchronizing the main cluster processing result to a grouped cluster database corresponding to the organization identifier based on a grouped cluster database message queue.
[0058] wherein, the organization identifier is used to identify the affiliated organization of the target user, and may be a provincial-level organization code to which the user belongs, etc.; the grouped cluster database is configured to store the corresponding main cluster processing result according to the organization identifier of the target user; the grouped cluster database message queue, which can be constructed based on Kafka, is configured to synchronize the main cluster processing result to the corresponding grouped cluster database, including official document data, organization personnel, various configurations and other data generated by the main cluster. In the embodiments of the present application, while the main cluster processing result is stored in the main cluster database, the main cluster processing result can also be synchronized to the corresponding grouped cluster database through the message queue.
[0059] it should be noted that the grouped cluster database is matched with the corresponding grouped cluster, each branch organization is configured with a grouped cluster and a corresponding grouped cluster database, which is also configured to perform grouped cluster processing on access operations of the peer-to-peer flow category, and store the grouped cluster processing result in the corresponding grouped cluster database.
[0060] Compared with existing technologies, in this embodiment, when the access operation of the target user is identified as a hierarchical flow, the process jumps to the main cluster for processing and stores the processing results in the main cluster database. By centrally storing the processing results of access operations of hierarchical flow categories in the main cluster database, the data flow requirements of multiple organizations within a single process can be met. At the same time, the processing results of the main cluster are synchronized to the group cluster database corresponding to the target user through a message queue. By storing the processing results by organization, the problem of system performance degradation due to excessive data volume is avoided. Furthermore, when one database fails, it will not affect the operation of other databases, reducing the scope of the failure and improving the customer experience.
[0061] In one embodiment of this application, for further definition and explanation, step 103 of the embodiment obtains the organization identifier of the target user, and after synchronizing the main cluster processing result to the group cluster database corresponding to the organization identifier based on the group cluster database message queue, the method of the embodiment further includes: synchronizing the main cluster processing result to the query database and the statistics database based on the query statistics database message queue, so as to obtain data from the query database or the statistics database when responding to data query instructions or data statistics instructions.
[0062] The query database can use Elasticsearch (ES) and can be configured with fuzzy search functionality, supporting fuzzy searches of the main text and attachments. It also allows for access control based on specific roles and workflows, and includes document data from the entire OA cluster. The statistical database also contains document data from the entire OA cluster, used for monthly, quarterly, and annual statistical analysis of OA document processing efficiency at all levels of the organization. The query and statistical database message queue can be built based on Kafka and is used to synchronize the processing results of the main cluster to the query and statistical databases, including document data, organizational personnel data, and various configuration data generated by the main cluster.
[0063] This application provides another method for storing data, such as... Figure 2 As shown, the method includes:
[0064] 201. In response to the access operation of the target user, classify the access operation.
[0065] 202. If the category identification result is a same-level flow category, then obtain the target user's organization identifier and jump to the group cluster corresponding to the organization identifier, so as to perform group cluster processing on the access operation based on the group cluster, and store the group cluster processing result in the group cluster database corresponding to the group cluster.
[0066] 203. Based on the query and statistics database message queue, the group cluster processing results are synchronized to the query database and the statistics database, so as to retrieve data from the query database or the statistics database when responding to data query instructions or data statistics instructions.
[0067] Each group cluster can correspond to one or more provincial-level institutions based on the actual data volume, preferably three to five. In this embodiment, the query statistics database message queue is also used to synchronize the group cluster processing results to the query database and the statistics database, including official document carriers circulating at the same level, such as company incoming documents, company outgoing documents, department incoming and outgoing documents, and signed reports. In this embodiment, when the current access operation is identified as belonging to the same-level circulation category, the user is redirected to the corresponding group cluster based on the institution identifier of the target user. The corresponding group cluster then processes the current access operation and stores the processing results in the group cluster database corresponding to the current group cluster. Simultaneously, the group cluster processing results are synchronized to the query database and the statistics database based on the query statistics database message queue.
[0068] This application provides another method for storing data, such as... Figure 3 As shown, the method includes:
[0069] 301. In response to the access operation of the target user, classify the access operation.
[0070] 302. If the category identification result is a statistical query category, then jump to the statistical query cluster and perform content identification on the access operation.
[0071] 303a. If the content recognition result is a data query instruction, then the data is searched in the query database according to the recognition information carried by the data query instruction;
[0072] 303b. If the content recognition result is a data statistics instruction, then the corresponding data shall be obtained from the statistics database according to the recognition information carried by the data statistics instruction.
[0073] The content recognition results are divided into two types: data query instructions and data statistics instructions. The statistical query cluster is used to perform content recognition on access operations and retrieve data from the query database or statistical database based on the content recognition results. In this embodiment, when the access operation is identified as a statistical query category, the system jumps to the statistical query cluster and performs content recognition on the access operation. If the content recognition result is a data query instruction, the system searches for data in the query database based on the recognition information carried by the data query instruction; if the content recognition result is a data statistics instruction, the system retrieves the corresponding data from the statistical database based on the recognition information carried by the data statistics instruction. The recognition information can be information that can distinguish data, such as keywords or organization numbers.
[0074] This application provides a data storage method. First, in response to an access operation by a target user, the access operation is categorized. Second, if the categorization result is a hierarchical flow category, the process jumps to the main cluster for main cluster processing of the access operation, and the main cluster processing result is stored in the main cluster database. Finally, the organization identifier of the target user is obtained, and the main cluster processing result is synchronized to the group cluster database corresponding to the organization identifier. Compared with the prior art, in this embodiment, when the access operation of the target user is identified as a hierarchical flow category, the process jumps to the main cluster for main cluster processing, and the main cluster processing result is stored in the main cluster database. By centrally storing the processing results of hierarchical flow category access operations in the main cluster database, the data flow requirements of multiple organizations within a single process can be met. Simultaneously, the main cluster processing result is synchronized to the group cluster database corresponding to the target user via a message queue. By storing the processing results by organization, the system performance degradation caused by excessive data volume is avoided. Furthermore, if one database fails, it will not affect the operation of other databases, reducing the scope of the failure and improving the user experience.
[0075] Furthermore, as a response to the above Figure 1 The implementation of the method shown in this application provides a data storage system, such as... Figure 4 As shown, the system includes:
[0076] 41. Main cluster; 42. Main cluster database; 43. Multiple group cluster databases; 44. Group cluster database message queue;
[0077] Among them, the main cluster 41 communicates with the main cluster database 42, and the main cluster 41 communicates with multiple group cluster databases 43 through the group cluster database message queue 44 respectively.
[0078] The main cluster 41 is used to process access operations of the upper and lower level flow categories.
[0079] The main cluster database 42 is used to store the main cluster processing results obtained after processing by the main cluster.
[0080] Group cluster database 43 is used to store the corresponding main cluster processing results based on the organization identifier of the target user who initiated the access operation;
[0081] Group cluster database message queue 44 is used to synchronize the processing results of the main cluster to the corresponding group cluster database.
[0082] It should be noted that the main cluster is the core application cluster of the current execution end, used for processing access operations of hierarchical flow categories, external interface categories, and general configuration categories; the main cluster database is used to represent the database that is paired with the main cluster, and is used to store the main cluster processing results obtained after processing by the main cluster. It can include data generated when basic configuration data such as organizational personnel data, hierarchical document data, and process template codes are created, updated, or deleted; the group cluster database is used to store the corresponding main cluster processing results according to the organizational identifier of the target user.
[0083] Compared with existing technologies, in this embodiment, when the access operation of the target user is identified as a hierarchical flow, the process jumps to the main cluster for processing and stores the processing results in the main cluster database. By centrally storing the processing results of access operations of hierarchical flow categories in the main cluster database, the data flow requirements of multiple organizations within a single process can be met. At the same time, the processing results of the main cluster are synchronized to the group cluster database corresponding to the target user through a message queue. By storing the processing results by organization, the problem of system performance degradation due to excessive data volume is avoided. Furthermore, when one database fails, it will not affect the operation of other databases, reducing the scope of the failure and improving the customer experience.
[0084] In specific application scenarios, embodiments of this application provide another data storage system, which includes:
[0085] The main cluster, the main cluster database, multiple group cluster databases, and the group cluster database message queue;
[0086] The main cluster communicates with the main cluster database, and the main cluster communicates with multiple group cluster databases through message queues of the group cluster databases.
[0087] The main cluster is used to process access operations of the upper and lower level flow categories.
[0088] The main cluster database is used to store the main cluster processing results obtained after processing by the main cluster.
[0089] The group cluster database is used to store the corresponding main cluster processing results based on the organization identifier of the target user who initiated the access operation.
[0090] The group cluster database message queue is used to synchronize the processing results of the main cluster to the corresponding group cluster database.
[0091] In specific application scenarios, the system also includes: multiple grouped clusters;
[0092] The group cluster communicates with the corresponding group cluster database to perform group cluster processing on access operations of the same level flow category, and transmits the group cluster processing results to the corresponding group cluster database.
[0093] In specific application scenarios, the system also includes: a statistical query cluster, a query database, a statistical database, and a query statistical database message queue;
[0094] The statistical query cluster communicates with the query database and the statistical database respectively. The query database and the statistical database communicate with the main cluster and the multiple group clusters through the query and statistical database message queue.
[0095] The statistical query cluster is used to perform content recognition on the access operation and obtain data from the query database or the statistical database based on the content recognition result;
[0096] The query statistics database message queue is used to synchronize the main cluster processing results with the group cluster processing results in the query database and the statistics database.
[0097] This application provides a data storage system, including: a main cluster, a main cluster database, multiple group cluster databases, and a group cluster database message queue; wherein, the main cluster communicates with the main cluster database, and the main cluster communicates with the multiple group cluster databases through the group cluster database message queues respectively; the main cluster is used to process access operations of upper and lower level flow categories; the main cluster database is used to store the main cluster processing results obtained after processing by the main cluster; the group cluster databases are used to store the corresponding main cluster processing results according to the organization identifier of the target user initiating the access operation; and the group cluster database message queues are used to synchronize the main cluster processing results with the corresponding group cluster databases. Compared with existing technologies, in this embodiment, when the access operation of the target user is identified as a hierarchical flow, the process jumps to the main cluster for processing and stores the processing results in the main cluster database. By centrally storing the processing results of access operations of hierarchical flow categories in the main cluster database, the data flow requirements of multiple organizations within a single process can be met. At the same time, the processing results of the main cluster are synchronized to the group cluster database corresponding to the target user through a message queue. By storing the processing results by organization, the problem of system performance degradation due to excessive data volume is avoided. Furthermore, when one database fails, it will not affect the operation of other databases, reducing the scope of the failure and improving the customer experience.
[0098] According to one embodiment of this application, a storage medium is provided, the storage medium storing at least one executable instruction, which can execute the data storage method in any of the above method embodiments.
[0099] Based on this understanding, the technical solution of this application can be embodied in the form of a software product. This software product can be stored in a non-volatile storage medium (such as a CD-ROM, USB flash drive, or portable hard drive), and includes several instructions to cause a computer device (such as a personal computer, server, or network device) to execute the methods described in the various implementation scenarios of this application.
[0100] Figure 5 The diagram shows a structural schematic of a terminal according to one embodiment of the present application. The specific embodiments of the present application do not limit the specific implementation of the terminal.
[0101] like Figure 5 As shown, the computer device may include: a processor 502, a communications interface 504, a memory 506, and a communications bus 508.
[0102] The processor 502, communication interface 504, and memory 506 communicate with each other via communication bus 508.
[0103] Communication interface 504 is used to communicate with other network elements such as clients or other servers.
[0104] The processor 502 is used to execute program 510, specifically to execute the relevant steps in the above data storage method embodiment.
[0105] Specifically, program 510 may include program code that includes computer operation instructions.
[0106] Processor 502 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application. The computer device includes one or more processors, which may be processors of the same type, such as one or more CPUs; or they may be processors of different types, such as one or more CPUs and one or more ASICs.
[0107] Memory 506 is used to store program 510. Memory 506 may include high-speed RAM memory, and may also include non-volatile memory, such as at least one disk storage device.
[0108] Specifically, program 510 can be used to cause processor 502 to perform the following operations:
[0109] In response to the access operation of the target user, the access operation is categorized.
[0110] If the category identification result is a hierarchical flow category, then jump to the main cluster to perform main cluster processing on the access operation based on the main cluster, and store the main cluster processing result in the main cluster database;
[0111] Obtain the organization identifier of the target user, and synchronize the main cluster processing result to the group cluster database corresponding to the organization identifier based on the group cluster database message queue.
[0112] The storage medium may also include an operating system and a network communication module. The operating system is a program that manages the hardware and software resources of the physical device storing the aforementioned data, supporting the operation of information processing programs and other software and / or programs. The network communication module is used to enable communication between the various components within the storage medium, as well as communication with other hardware and software in the information processing physical device.
[0113] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on its differences from other embodiments. Similar or identical parts between embodiments can be referred to interchangeably. For system embodiments, since they largely correspond to method embodiments, the description is relatively simple; relevant parts can be referred to the descriptions in the method embodiments.
[0114] The methods and systems of this application may be implemented in many ways. For example, they may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above-described order of steps for the methods is for illustrative purposes only, and the steps of the methods of this application are not limited to the order specifically described above, unless otherwise specifically stated. Furthermore, in some embodiments, this application may also be implemented as a program recorded on a recording medium, the program including machine-readable instructions for implementing the methods according to this application. Thus, this application also covers recording media storing programs for performing the methods according to this application.
[0115] Obviously, those skilled in the art should understand that the modules or steps of this application described above can be implemented using general-purpose computing devices. They can be centralized on a single computing device or distributed across a network of multiple computing devices. Optionally, they can be implemented using computer-executable program code, thereby storing them in a storage device for execution by a computing device. In some cases, the steps shown or described can be performed in a different order than those presented here, or they can be fabricated as separate integrated circuit modules, or multiple modules or steps can be fabricated as a single integrated circuit module. Thus, this application is not limited to any particular combination of hardware and software.
[0116] The above description is merely a preferred embodiment of this application and is not intended to limit this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of protection of this application.
Claims
1. A method for storing data, characterized in that, Applied to enterprise OA systems, including: In response to the access operation of the target user, the access operation is categorized. The categories of the access operation include hierarchical circulation categories and peer circulation categories. The hierarchical circulation category includes at least the document carriers of work requests and collaborative tasks that connect hierarchical organizations. The peer circulation category includes at least the document carriers of documents that circulate within the same level, such as company receipts, company outgoings, department receipts and outgoings, and reports. The categories of the access operation also include statistical query categories, external interface categories, and general configuration categories. If the category identification result is a hierarchical flow category, the process jumps to the main cluster to perform main cluster processing on the access operation, and stores the main cluster processing result in the main cluster database. The main cluster database is used to centrally store the processing results of hierarchical flow categories to meet the data flow needs of multiple organizations within a single process. The main cluster is also used to perform main cluster processing on access operations of external interface categories and general configuration categories. The content stored in the main cluster database includes data generated when basic configuration data is created, updated, or deleted. The basic configuration data includes organizational personnel data, hierarchical document data, and process template codes. The organization identifier of the target user is obtained, and the processing result of the main cluster is synchronized to the group cluster database corresponding to the organization identifier based on the group cluster database message queue. The group cluster database message queue is built based on Kafka. The group cluster database is used to store the corresponding main cluster processing result according to the organization identifier of the target user. The group cluster database communicates with the corresponding group cluster. The group cluster is also used to perform group cluster processing on access operations of the same flow category and store the group cluster processing result in the corresponding group cluster database.
2. The method according to claim 1, characterized in that, The method of obtaining the organization identifier of the target user, and synchronizing the main cluster processing result with the group cluster database corresponding to the organization identifier based on the group cluster database message queue, further includes: Based on the query and statistics database message queue, the processing results of the main cluster are synchronized to the query database and the statistics database, so as to obtain data from the query database or the statistics database when responding to data query instructions or data statistics instructions.
3. The method according to claim 2, characterized in that, After classifying the access operation in response to the access operation of the target user, the method further includes: If the category identification result is a same-level flow category, then the organization identifier of the target user is obtained, and the user is redirected to the group cluster corresponding to the organization identifier. The access operation is then processed based on the group cluster, and the processing result is stored in the group cluster database corresponding to the group cluster.
4. The method according to claim 3, characterized in that, If the category identification result is a same-level flow category, then the organization identifier of the target user is obtained, and the user is redirected to the group cluster corresponding to the organization identifier. The access operation is then processed based on the group cluster, and the group cluster processing result is stored in the group cluster database corresponding to the group cluster. The method further includes: Based on the query and statistics database message queue, the group cluster processing results are synchronized to the query database and the statistics database, so as to obtain data from the query database or the statistics database when responding to data query instructions or data statistics instructions.
5. The method according to claim 4, characterized in that, After classifying the access operation in response to the access operation of the target user, the method further includes: If the category identification result is a statistical query category, then jump to the statistical query cluster and perform content identification on the access operation; If the content recognition result is a data query instruction, then the data is searched in the query database according to the recognition information carried by the data query instruction; If the content recognition result is a data statistics instruction, then the corresponding data is obtained from the statistics database according to the recognition information carried by the data statistics instruction.
6. A data storage system, characterized in that, Applied to enterprise OA systems, including: The main cluster, the main cluster database, multiple group cluster databases, and the group cluster database message queue; The main cluster communicates with the main cluster database, and the main cluster communicates with multiple group cluster databases through message queues of the group cluster databases. The enterprise OA system is used to respond to access operations by target users and classify the access operations. The categories of access operations include hierarchical circulation categories and peer circulation categories. The hierarchical circulation category includes at least the document carriers of work requests and collaborative tasks that connect hierarchical organizations. The peer circulation category includes at least the document carriers of documents that circulate within the same level, such as company receipts, company outgoings, department receipts and outgoings, and reports. The categories of access operations also include statistical query categories, external interface categories, and general configuration categories. The enterprise OA system is further configured to, if the category identification result is a hierarchical transfer category, redirect to the main cluster for main cluster processing of the access operation, and store the main cluster processing result in the main cluster database. The main cluster is used to process access operations of the upper and lower level flow categories; the main cluster is also used to process access operations of the external interface category and the general configuration category. The main cluster database is used to store the main cluster processing results obtained after processing by the main cluster; wherein, the main cluster database is used to centrally store the processing results of the upper and lower level flow categories, so as to realize the data flow requirements of multiple organizations and upper and lower levels within a process; the content stored in the main cluster database includes the data generated when the basic configuration data is created, updated or deleted; the basic configuration data is organization personnel data, document data connecting upper and lower levels, and process template codes; The group cluster database is used to store the corresponding main cluster processing result according to the organization identifier of the target user who initiated the access operation; the group cluster database is used to store the corresponding main cluster processing result according to the organization identifier of the target user; the system also includes: multiple group clusters, which communicate with the corresponding group cluster database, and are also used to perform group cluster processing on access operations of the same level flow category, and store the group cluster processing result in the corresponding group cluster database. The group cluster database message queue is used to synchronize the processing results of the main cluster to the corresponding group cluster database; wherein, the group cluster database message queue is built based on Kafka.
7. The system according to claim 6, characterized in that, The system also includes: a statistical query cluster, a query database, a statistical database, and a query statistical database message queue; The statistical query cluster communicates with the query database and the statistical database respectively. The query database and the statistical database communicate with the main cluster and the multiple group clusters through the query and statistical database message queue. The statistical query cluster is used to perform content recognition on the access operation and obtain data from the query database or the statistical database based on the content recognition result; The query statistics database message queue is used to synchronize the processing results of the main cluster and the processing results of the group clusters to the query database and the statistics database.
8. A storage medium storing at least one executable instruction, characterized in that, The executable instructions cause the processor to perform the operation corresponding to the data storage method as described in any one of claims 1-5.
9. An electronic device, comprising: The processor, memory, communication interface, and communication bus are provided, wherein the processor, memory, and communication interface communicate with each other via the communication bus. The memory is used to store at least one executable instruction, characterized in that the executable instruction causes the processor to perform an operation corresponding to the data storage method as described in any one of claims 1-5.
Citation Information
Patent Citations
Multi-cluster data synchronization method of distributed storage system and related device
CN110795503A
Message distribution method and device, server and storage medium
CN115348222A
Data synchronization method, storage system, equipment and storage medium
CN115563221A