Business data processing method and device, storage medium and program product

Abstract

The embodiment of the invention provides a business data processing method and device, a storage medium and a program product, and the method comprises the steps: obtaining business target data and actual business data of each employee; sending the business target data and the actual business data to a data warehouse after each preset synchronization time; and obtaining and calculating actual business data in the data warehouse by using a pre-obtained calculation model, comparing an actual business result obtained after calculation with the business target data, and generating a business index progress of each employee. According to the business data processing method provided by the embodiment of the invention, the business data of multiple employees can be processed in batches in real time, and the data processing efficiency is improved.

Description

Technical Field

[0001] This application relates to the field of computer technology, specifically to a business data processing method, apparatus, storage medium, and program product. Background Technology

[0002] Currently, bank branches set business targets for their employees in the form of documents. However, the actual business volume completed by employees is sometimes automatically calculated by the bank system and sometimes recorded manually. This makes the management of banking business very complicated. When there is a lot of business data, the calculation is heavy and the data loading speed is very slow, resulting in low efficiency.

[0003] Furthermore, existing banking systems require the entire business document to be re-uploaded and updated whenever updates are needed, resulting in excessively high maintenance costs and the document content being prone to errors. Summary of the Invention

[0004] The purpose of this application is to provide a business data processing method, apparatus, storage medium, and program product to solve at least some of the above-mentioned problems.

[0005] To achieve the above objectives, the first aspect of this application provides a business data processing method, comprising: acquiring business target data and actual business data for each employee; sending the business target data and actual business data to a data warehouse after each preset synchronization time; acquiring and calculating the actual business data in the data warehouse using a pre-acquired calculation model; comparing the calculated actual business results with the business target data; and generating the business indicator progress for each employee.

[0006] In this embodiment of the application, the computing model is constructed based on the following steps: obtaining multiple target computing requirements based on business target data; and constructing computing logic corresponding to each target computing requirement based on the multiple target computing requirements to form a computing model.

[0007] In this embodiment of the application, the step of sending the business target data and actual business data to the data warehouse after each preset synchronization time includes: pre-storing the acquired business target data and actual business data in a relational database; and establishing a communication connection between the relational database and the data warehouse based on a preset data transmission protocol, so that the relational database sends the business target data and actual business data to the data warehouse after each preset synchronization time.

[0008] In this embodiment of the application, the data warehouse includes a data service cluster, a distributed storage module, multiple data processing units, and a data synchronization warehouse.

[0009] In this embodiment of the application, the step of sending business target data and actual business data to the data warehouse after each preset synchronization time of the relational database includes: based on a preset data transmission protocol, the relational database sends the business target data and actual business data to the data service cluster after each preset synchronization time; controlling multiple data processing units to send the business target data and actual business data to the distributed storage module for storage; and synchronously loading the business target data and actual business data stored in the distributed storage module to the data synchronization warehouse.

[0010] In this embodiment of the application, the steps of acquiring and calculating actual business data in the data warehouse using a pre-acquired calculation model, and comparing the calculated actual business results with the business target data to generate the business indicator progress for each employee include: comparing the actual business time of the actual business data with the target business time of the business target data using the pre-acquired calculation model, determining whether the actual business time is within the range of the target business time, and removing actual business data that is not within the range of the target business time to obtain processed business data; traversing and calculating the processed business data using the pre-acquired calculation model to obtain actual business results, wherein the actual business results are the current business completion data for each employee; comparing the calculated actual business results with the business target data to generate actual business data; and comparing the calculated actual business results with the business target data to generate the business indicator progress for each employee.

[0011] In this embodiment of the application, the business indicator progress includes the proportion of each employee's actual business data to the business target data, and a task target progress table arranged in descending order of the proportion values ​​for all employees.

[0012] In this embodiment of the application, the business target data includes each employee's target assessment organization, target assessment personnel, target assessment indicators, task start time, and task end time.

[0013] A second aspect of this application provides a business data processing apparatus, comprising: a data acquisition module for acquiring business target data and actual business data for each employee; a data transmission module for sending the business target data and actual business data to a data warehouse after each preset synchronization time; and a calculation and comparison module for acquiring and calculating the actual business data in the data warehouse using a pre-acquired calculation model, comparing the calculated actual business results with the business target data, and generating the business indicator progress for each employee.

[0014] A third aspect of this application provides a machine-readable storage medium storing instructions that, when executed by a processor, configure the processor to perform the aforementioned business data processing method.

[0015] A fourth aspect of this application provides a computer program product, including a computer program that, when executed by a processor, implements the above-described business data processing method.

[0016] The above technical solution enables real-time batch processing of business data from multiple employees and calculation of the progress of each employee's business data, thereby improving data processing efficiency.

[0017] Other features and advantages of the embodiments of this application will be described in detail in the following detailed description section. Attached Figure Description

[0018] The accompanying drawings are provided to further illustrate the embodiments of this application and form part of the specification. They are used together with the following detailed description to explain the embodiments of this application, but do not constitute a limitation on the embodiments of this application. In the drawings: Figure 1 This illustration schematically shows an application environment diagram of the business data processing method according to an embodiment of this application; Figure 2 The illustration shows a schematic flowchart of a business data processing method according to an embodiment of this application; Figure 3 The illustration shows a flowchart of step S120 in a business data processing method according to an embodiment of this application; Figure 4 The schematic diagram illustrates a flowchart of step S122 in a business data processing method according to an embodiment of this application; Figure 5 This illustration schematically shows a flowchart of constructing a computational model in a business data processing method according to an embodiment of this application; Figure 6 This illustration schematically shows a functional diagram of a computational model in a business data processing method according to an embodiment of this application; Figure 7 The schematic diagram illustrates a flow chart of step S130 in a business data processing method according to an embodiment of this application; Figure 8 This schematically illustrates a structural block diagram of a business data processing system applied to a business data processing method according to an embodiment of this application; Figure 9 This schematic diagram illustrates a structural block diagram of business data processing according to an embodiment of this application; Figure 10 The diagram illustrates the internal structure of a computer device according to an embodiment of this application. Detailed Implementation

[0019] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only for illustration and explanation of the embodiments of this application and are not intended to limit the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the scope of protection of this application.

[0020] It should be noted that if the embodiments of this application involve directional indicators (such as up, down, left, right, front, back, etc.), the directional indicators are only used to explain the relative positional relationship and movement of each component in a certain specific posture (as shown in the figure). If the specific posture changes, the directional indicators will also change accordingly.

[0021] Furthermore, if the embodiments of this application involve descriptions such as "first" or "second," these descriptions are for descriptive purposes only and should not be construed as indicating or implying their relative importance or implicitly specifying the number of technical features indicated. Therefore, features defined with "first" or "second" may explicitly or implicitly include at least one of those features. Additionally, the technical solutions of various embodiments can be combined with each other, but this must be based on the ability of those skilled in the art to implement them. If the combination of technical solutions is contradictory or impossible to implement, it should be considered that such a combination of technical solutions does not exist and is not within the scope of protection claimed in this application.

[0022] The acquisition, transmission, storage, use, and processing of data in this application comply with relevant laws and regulations. Furthermore, it should be noted that certain software, components, models, and other existing industry solutions may be mentioned in the embodiments of this application. These should be considered exemplary, intended only to illustrate the feasibility of implementing the technical solution of this application, and do not imply that the applicant has already used or necessarily used such solutions.

[0023] The business data processing method provided in this application can be applied to, for example... Figure 1 In the application environment shown, terminal 110 communicates with server 120 via a network to implement the business data processing method of this embodiment. Terminal 110 can be, but is not limited to, various personal computers, laptops, smartphones, tablets, and portable wearable devices, and server 120 can be a standalone server or a server cluster consisting of multiple servers.

[0024] like Figure 2As shown in the embodiments of this application, a business data processing method is provided. This embodiment mainly applies this method to the above-mentioned... Figure 1 Taking server 120 as an example, the business data processing method of this application embodiment includes steps S110 to S130.

[0025] In step S110, business target data and actual business data for each employee are obtained.

[0026] In this embodiment, the actual business data refers to each employee's current business completion data, namely the current business volume and the processing time of each task. The business target data includes each employee's target assessment organization, target assessment personnel, target assessment indicators, task start time, and task end time.

[0027] In step S120, after each preset synchronization time, the business target data and actual business data are sent to the data warehouse.

[0028] like Figure 3 As shown, in one embodiment of this application, step S120 includes steps S121 to S122.

[0029] In step S121, the acquired business target data and actual business data are pre-stored in a relational database.

[0030] In step S122, based on a preset data transmission protocol, a communication connection is established between the relational database and the data warehouse. This ensures that the relational database sends the business target data and actual business data to the data warehouse every preset synchronization interval. Specifically, the data warehouse includes a data service cluster, a distributed storage module, multiple data processing units, and a data synchronization warehouse.

[0031] like Figure 4 As shown, step S122 further includes steps S1221 to S1223.

[0032] In step S1221, based on a preset data transmission protocol, the relational database sends the business target data and actual business data to the data service cluster every preset synchronization time.

[0033] In step S1222, multiple data processing units are controlled to send business target data and actual business data to the distributed storage module for storage.

[0034] In step S1223, the business target data and actual business data stored in the distributed storage module are synchronously loaded into the data synchronization warehouse.

[0035] like Figure 8As shown, in this embodiment, the data synchronization warehouse is a Hive data warehouse, and the data service cluster includes an HDFS distributed storage module and a data processing unit. The data processing unit includes an Hdoop distributed computing cluster and a MapReduce (MR) computing module. The acquired target business data and actual business data are first stored in a MySQL relational database. Then, after each preset synchronization interval, the target business data and actual business data are sent to the MR computing module. The MR computing module splits the actual business data into multiple sub-data, allowing the Hdoop distributed computing cluster to simultaneously preprocess multiple sub-data. The preprocessed actual business data is then sent to the distributed storage module, which synchronously loads the target business data and actual business data into the data synchronization warehouse.

[0036] Through the aforementioned data service cluster and data synchronization warehouse, it is possible to store and synchronously load large amounts of business target data and actual business data, enabling large-scale data computation and solving the problems of slow data loading and low computational efficiency of existing storage methods.

[0037] In step S130, the actual business data in the data warehouse is acquired and calculated using the pre-acquired calculation model. The actual business results obtained after calculation are compared with the business target data to generate the business indicator progress for each employee.

[0038] The computational model can be obtained in advance before executing the business data processing method of this application embodiment, or through... Figure 5 The following steps are pre-built: Step S101: Based on the business target data, obtain multiple target calculation requirements.

[0039] Step S102: Based on multiple target computing requirements, construct computing logic corresponding to each target computing requirement to form a computing model.

[0040] like Figure 6 As shown in this embodiment, for different employees' businesses, the data formats of their business data are different depending on the type of business. Therefore, the actual business data of each employee is calculated by the calculation model constructed in the above steps. During the calculation process, according to the different data formats of the actual business data and the corresponding data formats of the business target data, the data are converted into the same format through the corresponding calculation logic, so that the business indicator progress of multiple employees can be calculated based on a unified calculation model, so as to facilitate the statistics of the business indicator progress of each employee.

[0041] like Figure 7 As shown, step S130 in this embodiment includes steps S131 to S133.

[0042] In step S131, the actual business time of the actual business data is compared with the target business time of the business target data using the pre-acquired calculation model to determine whether the actual business time is within the target business time. Actual business data whose actual business time is not within the target business time range is removed, and processed business data is obtained.

[0043] In step S132, the pre-acquired calculation model is used to traverse and calculate the processed business data to obtain the actual business results. The actual business results refer to the current business completion data for each employee.

[0044] In step S133, the calculated actual business results are compared with the business target data to generate actual business data. The calculated actual business results are then compared with the business target data to generate the business indicator progress for each employee.

[0045] like Figure 8 As shown in this embodiment, the business indicator progress includes the proportion of each employee's actual business data to the business target data, and a task target progress table arranged in descending order of the proportion values ​​for all employees.

[0046] When the calculation model calculates the actual business results for each employee, it determines whether the actual business time of each task in the actual business data is within the time range of the target business time in the business target data. If it is within the time range of the target business time, it proves that the task is the target task in the current business target data. If it is not within the time range of the target business time, it proves that the task is not the target task in the current business target data, and it is removed to form the processed business data.

[0047] After further processing and calculation of the processed business data, relevant data indicators of each employee's actual business results are obtained.

[0048] Finally, after the computational model calculates the actual business results for each employee, the actual business results are input into the Spark data processing framework. The calculated actual business results are then compared with the business target data to obtain the business indicator progress for each employee.

[0049] For example, the actual business results obtained after processing and calculating the business data are the completion amount of each employee's current tasks, the start time and end time of completed tasks, and the start time and end time of incomplete tasks.

[0050] The Spark data processing framework is used to compare the calculated actual business results with the target performance indicators, task start time, and task end time in the business target data. This determines whether each employee's task meets the target performance indicators and is completed within the target time range of the task start and end time. If a task meets the target performance indicators and is completed within the target time range, it is considered completed. The proportion of each employee's completed tasks in all tasks is then calculated. The tasks are then sorted according to the proportion of each employee's completed tasks to obtain the task target progress table. Finally, the business indicator progress of each employee is calculated.

[0051] By following the steps described above, business data from multiple employees can be processed in batches, converting the business data of all employees' different types of business into a unified format, and calculating the business indicator progress of each employee to facilitate the management and updating of business data.

[0052] The business data processing method provided in this application embodiment can process the business data of multiple employees in batches in real time and calculate the business data progress of each employee, thereby improving data processing efficiency.

[0053] It should be understood that, although Figure 2 The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figure 2 At least some of the steps in the process may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily completed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least some of the sub-steps or stages of other steps.

[0054] like Figure 9 As shown in the illustration, this application also provides a business data processing device, which includes a data acquisition module, a data transmission module, and a calculation and comparison module, wherein: The data acquisition module is used to obtain business target data and actual business data for each employee.

[0055] The data sending module sends the target business data and the actual business data to the data warehouse after each preset synchronization time.

[0056] The calculation and comparison module uses a pre-acquired calculation model to obtain and calculate the actual business data in the data warehouse, compares the calculated actual business results with the business target data, and generates the business indicator progress for each employee.

[0057] The business data processing device provided in this application embodiment can process the business data of multiple employees in batches in real time and calculate the business data progress of each employee, thereby improving data processing efficiency.

[0058] The business data processing device includes a processor and a memory. The data acquisition module, data transmission module, and calculation comparison module are all stored in the memory as program units, and the processor executes the program modules stored in the memory to implement the corresponding functions.

[0059] The processor contains a kernel, which retrieves the corresponding program units from memory. One or more kernels can be configured, and the aforementioned business data processing methods can be implemented by adjusting kernel parameters.

[0060] The memory may include non-permanent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM, and the memory includes at least one memory chip.

[0061] This application also provides a machine-readable storage medium storing a program thereon, which, when executed by a processor, implements the above-described business data processing method.

[0062] Specifically, the business data processing apparatus in this application embodiment can be a computer device, which can be a server, and its internal structure diagram can be as follows. Figure 10 As shown. The computer device includes a processor A01, a network interface A02, a memory (not shown), and a database (not shown) connected via a system bus. The processor A01 provides computing and control capabilities. The memory includes internal memory A03 and a non-volatile storage medium A04. The non-volatile storage medium A04 stores an operating system B01, a computer program B02, and a database (not shown). The internal memory A03 provides an environment for the operation of the operating system B01 and the computer program B02 stored in the non-volatile storage medium A04. The database stores data for executing the business data processing method steps described above. The network interface A02 communicates with external terminals via a network connection. When the computer program B02 is executed by the processor A01, it implements the business data processing method described above.

[0063] Those skilled in the art will understand that Figure 10The structure shown is merely a block diagram of a portion of the structure related to the present application and does not constitute a limitation on the computer device to which the present application is applied. Specific computer devices may include more or fewer components than those shown in the figure, or combine certain components, or have different component arrangements.

[0064] In one embodiment, the business data processing method provided in this application can also be implemented as a computer program, which can be implemented as follows: Figure 10 The computer device shown operates on this system. The computer device's memory can store various program modules that constitute the implementation of the above-described business data processing method, for example, Figure 9 The data acquisition module, data transmission module, and calculation and comparison module are shown. The computer program comprised of these modules causes the processor to execute the steps of the above-described business data processing methods of the various embodiments of this application as described in this specification.

[0065] This application also provides a computer program product, which, when executed on a data processing device, is suitable for executing a program that initializes the following method steps: In step S110, business target data and actual business data for each employee are obtained.

[0066] In step S120, after each preset synchronization time, the business target data and actual business data are sent to the data warehouse.

[0067] In step S130, the actual business data in the data warehouse is acquired and calculated using the pre-acquired calculation model. The actual business results obtained after calculation are compared with the business target data to generate the business indicator progress for each employee.

[0068] The computer program product of this application embodiment, by implementing the business data processing method of this application, can process the business data of multiple employees in batches in real time and calculate the business data progress of each employee, thereby improving data processing efficiency.

[0069] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0070] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0071] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0072] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0073] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0074] Memory may include non-persistent memory in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0075] Computer-readable media include both permanent and non-permanent, removable and non-removable media, which can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0076] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0077] The above are merely embodiments of this application and are not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A business data processing method, characterized in that, include: Obtain business target data and actual business data for each employee; After each preset synchronization time, the target business data and the actual business data are sent to the data warehouse. The actual business data in the data warehouse is acquired and calculated using a pre-acquired calculation model. The actual business results obtained after calculation are compared with the business target data to generate the business indicator progress for each employee.

2. The business data processing method according to claim 1, characterized in that, The computational model is constructed based on the following steps: Based on the aforementioned business objective data, multiple target computing requirements are obtained; Based on the multiple target computing requirements, computing logic corresponding to each target computing requirement is constructed to form the computing model.

3. The business data processing method according to claim 1, characterized in that, The step of sending the target business data and the actual business data to the data warehouse after each preset synchronization time includes: The acquired business target data and the actual business data are pre-stored in a relational database; Based on a preset data transmission protocol, the relational database and the data warehouse are connected for communication, so that the relational database sends the business target data and the actual business data to the data warehouse every preset synchronization time.

4. The business data processing method according to claim 3, characterized in that, The data warehouse includes a data service cluster, a distributed storage module, multiple data processing units, and a data synchronization warehouse.

5. The business data processing method according to claim 4, characterized in that, The step of sending the business target data and the actual business data to the data warehouse after each preset synchronization time in the relational database includes: Based on a preset data transmission protocol, the relational database sends the business target data and the actual business data to the data service cluster every preset synchronization time. The system controls multiple data processing units to send the target business data and the actual business data to the distributed storage module for storage. The business target data and the actual business data stored in the distributed storage module are synchronously loaded into the data synchronization warehouse.

6. The business data processing method according to claim 1, characterized in that, The steps of acquiring and calculating the actual business data in the data warehouse using a pre-acquired calculation model, comparing the calculated actual business results with the business target data, and generating the business indicator progress for each employee include: The actual business time of the actual business data is compared with the target business time of the target business data using the pre-acquired calculation model. It is determined whether the actual business time is within the range of the target business time, and the actual business data that is not within the range of the target business time is removed to obtain the processed business data. The pre-acquired computing model is used to traverse and calculate the processed business data to obtain the actual business results, wherein the actual business results are the current business completion data of each employee; The calculated actual business results are compared with the business target data to generate the business indicator progress for each employee.

7. The business data processing method according to claim 1, characterized in that, The business performance indicators include the proportion of each employee's actual business data to the business target data, and a task target progress table of all employees arranged in descending order of the proportion.

8. The business data processing method according to claim 1, characterized in that, The business target data includes each employee's target assessment organization, target assessment personnel, target assessment indicators, task start time, and task end time.

9. A business data processing device, characterized in that, include: The data acquisition module is used to acquire business target data and actual business data for each employee; The data sending module sends the target business data and the actual business data to the data warehouse after each preset synchronization time. The calculation and comparison module acquires and calculates the actual business data in the data warehouse using a pre-acquired calculation model, compares the calculated actual business results with the business target data, and generates the business indicator progress for each employee.

10. A machine-readable storage medium storing instructions thereon, characterized in that, When executed by a processor, this instruction causes the processor to be configured to perform the business data processing method according to any one of claims 1 to 8.

11. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the business data processing method according to any one of claims 1 to 8.

Images