Business data processing method, device and system
By obtaining and processing target template data, using preset rules and identification models, automatically generating site meeting materials, the problem of physical boards in the agile R&D team being unable to show project conditions and risk identification efficiency in real time, and achieving efficient risk identification and communicate.
Patent Information
- Application Number
- CN202410944165.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-15
- Publication Date
- 2024-11-08
AI Technical Summary
In the agile R&D team's site meeting, existing physical boards cannot show the overall situation of the project in real time, resulting in low communication efficiency and relying on personal identification capabilities may lead to untimely exposure of risks.
By obtaining target template data, including basic variables and risk warning variables, extracting business data and inputting the identification model according to preset data extraction rules and risk warning rules, generating processing result files, realizing risk identification and early warning, and automatically generating site meeting materials.
It improves the efficiency of site meeting materials generation, accurately identifies potential risks in the project, and solves the problem that physical boards cannot display the project situation and risks in real time.
Smart Images

Figure CN118917658A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of artificial intelligence technology, and in particular to a method, device and system for processing business data. Background Art
[0002] At present, in the agile R&D team briefing, the existing physical dashboard lacks real-time display of overall situation data. Team members use verbal reporting, which is not intuitive and inefficient. In addition, when reporting risks, team members rely on their personal ability to identify risk points, which easily leads to the situation where risks are not exposed in time. Manual material sorting involves multiple systems, and there are many manual operation steps, which makes material sorting inefficient.
[0003] To address the above problems, no effective solution has been proposed yet. Summary of the invention
[0004] The embodiments of this specification provide a business data processing method, device and system to solve the problem that the physical billboards used in current team stand-up meetings cannot display the overall project situation in real time, resulting in low communication efficiency and the failure to expose possible risks in a timely manner.
[0005] The embodiment of this specification provides a business data processing method, including:
[0006] Acquire target template data; the target template data includes a plurality of basic variables associated with the target business and risk warning variables corresponding to the target business;
[0007] Extracting business data corresponding to each of the basic variables according to preset data extraction rule information;
[0008] Based on the business data corresponding to each of the basic variables, the preset risk warning rule information is judged to obtain the first risk identification result data of the target business; the process data corresponding to the target business is input into the target identification model to obtain the second risk identification result data of the target business;
[0009] The variable value of each basic variable in the target template data is determined by using the business data corresponding to each basic variable, and the variable value of the risk warning variable in the target template data is determined in combination with the first risk identification result data and the second risk identification result data to obtain the processing result file of the target business.
[0010] In one embodiment, the preset data extraction rule information includes a preset data extraction rule table;
[0011] The preset data extraction rule table includes at least one data extraction rule; the data extraction rule includes at least one of the following: data extraction rule number, variable identifier, variable description, data extraction system identifier, value logic path, formatting processing type and rule status.
[0012] In one embodiment, extracting business data corresponding to each of the basic variables according to preset data extraction rule information includes:
[0013] Reading the operation rule information associated with the target business, the operation rule information including at least one operation rule, the information in the operation rule including at least one of the following: an operation rule identifier, a business number, a data extraction rule number, an operation start date, an operation end date, an operation frequency, and a rule status;
[0014] Obtaining an operation rule whose rule status is effective in the operation rule information, reading a data extraction rule table corresponding to a data extraction rule number in the operation rule, performing data extraction according to information in each data extraction rule in the data extraction rule table, and extracting business data corresponding to each of the basic variables;
[0015] The business data corresponding to each basic variable in the multiple basic variables associated with the target business extracted according to the data extraction rules are packaged according to the business number and integrated into result data.
[0016] In one embodiment, the preset risk warning rule information includes a preset risk warning rule table;
[0017] The risk warning rule table includes at least one risk warning rule, and the risk warning rule includes at least one of the following: risk warning rule identification, rule description, data extraction system identification, risk judgment rule description, implementation logic function, risk level and rule status.
[0018] In one embodiment, based on the business data corresponding to each of the basic variables, the preset risk warning rule information is judged to obtain the first risk identification result data of the target business, including:
[0019] Read at least one risk warning rule in the preset risk warning rule table;
[0020] Determine the risk category corresponding to each of the risk warning rules based on the business data corresponding to each of the multiple basic variables;
[0021] According to the risk category corresponding to each of the risk warning rules, first risk identification result data of the target business is generated.
[0022] In one embodiment, the target recognition model is trained in the following manner:
[0023] Acquire process data and label data of multiple businesses in a historical time period; the label data is used to characterize the risk category corresponding to each of the businesses;
[0024] Processing the process data of each of the services to obtain a word sequence corresponding to each of the services, and generating a training sample set based on the word sequence and label data corresponding to each of the services;
[0025] The preset recognition model is trained using the training sample set to obtain a target recognition model; the preset recognition model is constructed based on the FastText model.
[0026] In one embodiment, after obtaining the processing result file of the target service, the method further includes:
[0027] Determine whether it is necessary to convert the format of the processing result file;
[0028] If yes, the processing result file of the target business is format-converted, and the converted processing result file is saved.
[0029] The embodiment of this specification also provides a business data processing device, including:
[0030] An extraction module, used to extract business data corresponding to each of the basic variables according to preset data extraction rule information;
[0031] A risk identification module is used to determine the preset risk warning rule information based on the business data corresponding to each of the basic variables to obtain the first risk identification result data of the target business; input the process data corresponding to the target business into the target identification model to obtain the second risk identification result data of the target business;
[0032] A generation module is used to use the business data corresponding to each of the basic variables to determine the variable value of each of the basic variables in the target template data, and to determine the variable value of the risk warning variable in the target template data in combination with the first risk identification result data and the second risk identification result data to obtain a processing result file for the target business.
[0033] The embodiment of this specification also provides a business data processing system, including:
[0034] External connection device, used to set connection parameters with external system;
[0035] A rule customization device, used to customize preset data extraction rule information and preset risk warning rule information, and also used to customize template data;
[0036] A recognition model building device, used to build and store a target recognition model;
[0037] A data storage device, used to store the preset data extraction rule information, the preset risk warning rule information and template data and the template data;
[0038] A business data processing device, comprising:
[0039] an acquisition module, used to acquire preset data extraction rule information, preset risk warning rule information and target template data corresponding to the target business from the data storage device, and acquire external connection parameters set by the external connection device; the target template data includes a plurality of basic variables associated with the target business and risk warning variables corresponding to the target business;
[0040] An extraction module, configured to establish a connection with the external system based on the connection parameters, and extract business data corresponding to each of the basic variables from the external system according to the preset data extraction rule information;
[0041] A risk identification module, used to determine the preset risk warning rule information based on the business data corresponding to each of the basic variables to obtain the first risk identification result data of the target business; and also used to call the identification model building device to input the process data corresponding to the target business into the target identification model to obtain the second risk identification result data of the target business;
[0042] A generation module is used to use the business data corresponding to each of the basic variables to determine the variable value of each of the basic variables in the target template data, and to determine the variable value of the risk warning variable in the target template data in combination with the first risk identification result data and the second risk identification result data to obtain a processing result file for the target business.
[0043] An embodiment of the present specification also provides a computer device, including a processor and a memory for storing processor executable instructions, and when the processor executes the instructions, the steps of the business data processing method described in any of the above embodiments are implemented.
[0044] The embodiments of the present specification also provide a computer-readable storage medium on which computer instructions are stored. When the instructions are executed by a processor, the steps of the business data processing method described in any of the above embodiments are implemented.
[0045] The embodiments of this specification also provide a computer program product, including a computer program / instruction, which implements the steps of the business data processing method described in any of the above embodiments when executed by a processor.
[0046] In an embodiment of the present specification, a business data processing method is provided, which obtains target template data, wherein the target template data includes multiple basic variables associated with a target business and risk warning variables corresponding to the target business, extracts business data corresponding to each basic variable according to preset data extraction rule information, and judges the preset risk warning rule information based on the business data corresponding to each extracted basic variable to obtain first risk identification result data of the target business, inputs process data corresponding to the target business into a target identification model to obtain second risk identification result data of the target business, uses the business data corresponding to each basic variable to determine the variable value of each basic variable in the target template data, and determines the variable value of the risk warning variable in the target template data in combination with the first risk identification result data and the second risk identification result data to obtain a processing result file of the target business. In the above solution, lightweight attention data is automatically downloaded according to customized data extraction rules. At the same time, potential risk points in the project process can be accurately identified by customizing risk warning rules and deploying risk intelligent identification models. According to customized material style templates, stand-up meeting materials can be quickly integrated and automatically generated, which can improve generation efficiency and accurately identify risks. It can solve the problem that the current physical billboards used in team stand-ups cannot display the overall situation of the project in real time, resulting in low communication efficiency and the problem that possible risks are not exposed in time. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] The drawings described herein are used to provide a further understanding of this specification, constitute a part of this specification, and do not constitute a limitation of this specification. In the drawings:
[0048] Figure 1 A flow chart showing a method for processing business data in an embodiment of this specification is shown;
[0049] Figure 2 A schematic diagram of a business data processing device in an embodiment of the present specification is shown;
[0050] Figure 3 A system structure diagram of a business data processing system in an embodiment of this specification is shown;
[0051] Figure 4 A schematic diagram showing the deployment of a business data processing system in an embodiment of this specification is shown;
[0052] Figure 5A schematic diagram showing the functional units of a rule customization device in an embodiment of this specification is shown;
[0053] Figure 6 A sample template of stand-up meeting materials in an embodiment of this specification is shown;
[0054] Figure 7 A schematic diagram of functional units of a recognition model building device in an embodiment of this specification is shown;
[0055] Figure 8 A flowchart showing a business processing method in an embodiment of this specification is shown;
[0056] Fig. 9 A flow chart of template variable data extraction processing in an embodiment of this specification is shown;
[0057] Fig.10 A risk warning data processing flow chart in an embodiment of this specification is shown;
[0058] Fig.11 A flow chart of material result file output processing in one embodiment of this specification is shown;
[0059] Fig.12 A schematic diagram of a computer device in an embodiment of the present specification is shown. DETAILED DESCRIPTION
[0060] The principles and spirit of this specification will be described below with reference to several exemplary embodiments. It should be understood that these embodiments are provided only to enable those skilled in the art to better understand and implement this specification, and are not intended to limit the scope of this specification in any way. On the contrary, these embodiments are provided to make this specification more thorough and complete, and to fully convey the scope of this disclosure to those skilled in the art.
[0061] Those skilled in the art will appreciate that the embodiments of this specification may be implemented as a system, device, method, or computer program product. Therefore, this specification may be implemented in the following forms: complete hardware, complete software (including firmware, resident software, microcode, etc.), or a combination of hardware and software.
[0062] The embodiment of this specification provides a method for processing business data. Figure 1A flowchart of a business data processing method in an embodiment of the present specification is shown. Although the present specification provides method operation steps or device structures as shown in the following embodiments or drawings, more or fewer operation steps or module units may be included in the method or device based on routine or no creative labor. In the steps or structures where there is no necessary causal relationship logically, the execution order of these steps or the module structure of the device is not limited to the execution order or module structure described in the embodiments of the present specification and shown in the drawings. When the method or module structure is applied to an actual device or terminal product, it can be connected according to the method or module structure shown in the embodiments or drawings for sequential execution or parallel execution (for example, a parallel processor or a multi-threaded processing environment, or even a distributed processing environment).
[0063] like Figure 1 As shown, a business data processing method provided by an embodiment of the present specification may include the following steps.
[0064] Step S101, obtaining target template data; the target template data includes a plurality of basic variables associated with a target business and risk warning variables corresponding to the target business.
[0065] The method in this embodiment can be applied to a server. Target template data can be obtained. The target template data is a pre-built template. The target template data can include multiple basic variables associated with the target business and risk warning variables corresponding to the target business.
[0066] The target business may be a project in the field of software development management. Multiple basic variables may be used to characterize basic information and progress information of the target business. In one embodiment, multiple basic variables may include at least one of the following: business number, generation date, business overview, design progress, coding progress, testing progress, distribution of personnel work tasks in the next week, overdue tasks, unresolved bottleneck problems, long-term problems, etc. Risk warning variables are used to characterize the risks of the target business. The risks here may be the risk of whether the project can be completed on schedule, the risk of whether the project can meet user needs, the degree of project overdue, etc. In one embodiment, the target template data may be a template in the format of courseware. It is understandable that the target template data may also be a template in the form of a document, a table, etc.
[0067] Step S102: extracting the business data corresponding to each of the basic variables according to preset data extraction rule information.
[0068] The business data corresponding to each basic variable in the multiple basic variables associated with the target business can be extracted according to the preset data extraction rule information. The preset data extraction rule information may include relevant information of the data extraction system, extraction path and variable identification. For a basic variable, the identification of the data extraction system corresponding to the basic variable and the extraction path can be determined based on the variable identification of the basic variable to extract the business data corresponding to the basic variable from the corresponding data extraction system. The business data may be the data associated with the basic variable. For example, when the basic variable is the business number, the corresponding business data is the business number of the target business. When the basic variable is the design progress, the corresponding business data is the design progress data of the target business.
[0069] In some embodiments of the present specification, the preset data extraction rule information may include a preset data extraction rule table; the preset data extraction rule table may include at least one data extraction rule; the data extraction rule includes at least one of the following: data extraction rule number, variable identifier, variable description, data extraction system identifier, value logical path, formatting processing type and rule status. Among them, the data extraction rule number is the identifier of the data extraction rule. The variable identifier is the variable identifier of the basic variable. The variable description is used to describe the specific meaning of each variable. The data extraction system identifier is the identifier of the system where the business data of the corresponding variable is stored. The value logical path is the logical path of the business data corresponding to the extracted variable. The formatting processing type defines the formatting processing type for the data extraction of the variable. The formatting processing type may include at least one of the following: information extraction, form embedding, snapshot screen capture and link display. The rule status is used to indicate the rule status corresponding to the corresponding data extraction rule, which may include effective and invalid.
[0070] In some embodiments of the present specification, extracting the business data corresponding to each of the basic variables according to the preset data extraction rule information may include: reading the operation rule information associated with the target business, the operation rule information includes at least one operation rule, and the information in the operation rule includes at least one of the following: operation rule identifier, business number, data extraction rule number, operation start date, operation end date, operation frequency and rule status; obtaining the operation rule with the rule status as effective, reading the data extraction rule table corresponding to the data extraction rule number in the operation rule, and extracting the business data corresponding to each of the basic variables according to the information in each data extraction rule in the data extraction rule table; packaging the business data extracted according to each data extraction rule according to the business number and integrating it into result data. Among them, the operation rule identifier is used to uniquely identify an operation rule. The business number is used to uniquely identify the business. The process data information corresponding to the business number can be obtained by associating the business-related demand management system, unified design platform, test case management system, and problem management system through the business number. The data extraction rule number is the number of the associated data extraction rule. The operation start date is the start date of the stand-up meeting material generation and processing of the business. The end date of the operation is the end date of the stand-up meeting material generation and processing of the business. The operation frequency is the frequency of the stand-up meeting material generation and processing of the business, for example 1, daily; 2, weekly, etc. Rule status: 0 is effective, 1 is invalid. In this embodiment, when extracting the business data corresponding to each basic variable, first read the operation rule information associated with the target business. For the operation rule information whose rule status is effective, read the data extraction rule table corresponding to the data extraction rule number in the operation rule, and extract the business data corresponding to each of the basic variables according to the information in each data extraction rule in the data extraction rule table. Afterwards, the extracted business data is packaged according to the business number. In the above manner, the business data corresponding to each basic variable can be extracted and integrated into result data.
[0071] Step S103, based on the business data corresponding to each of the basic variables, the preset risk warning rule information is judged to obtain the first risk identification result data of the target business; the process data corresponding to the target business is input into the target identification model to obtain the second risk identification result data of the target business.
[0072] After extracting the business data corresponding to each basic variable from the multiple basic variables, the risk warning rule information can be determined based on the extracted business data to obtain the first risk identification result data of the target business. The process data corresponding to the target business can also be input into the target identification model to obtain the second risk identification result data of the target business. The risk identification result corresponding to the business can be determined from two dimensions, which can more accurately and efficiently identify the potential risks of the business.
[0073] In some embodiments of the present specification, the preset risk warning rule information may include a preset risk warning rule table; the risk warning rule table may include at least one risk warning rule, and the risk warning rule includes at least one of the following: risk warning rule identifier, rule description, data extraction system identifier, risk judgment rule description, implementation logic function, risk level and rule status. Among them, the risk warning rule identifier is used to uniquely identify the risk warning rule. The rule description is used to describe the specific meaning of the risk warning rule. The data extraction system identifier is the identifier of the data extraction system of the business data corresponding to the rule. The risk judgment rule description is used to describe the specific judgment rule. The implementation logic function is a function used to implement the judgment rule. The risk level is the determined risk level. Rule status: 0 is effective and 1 is invalid.
[0074] In some embodiments of the present specification, based on the business data corresponding to each of the basic variables, the preset risk warning rule information is judged to obtain the first risk identification result data of the target business, including: reading each of the risk warning rules in the preset risk warning rule table; judging each of the risk warning rules based on the business data corresponding to each of the basic variables, and determining the risk category corresponding to each of the risk warning rules; generating the first risk identification result data of the target business according to the risk category corresponding to each of the risk warning rules. In this embodiment, each of the risk warning rules in the risk warning rule table can be read, and the corresponding risk warning rules can be judged based on the business data corresponding to each of the basic variables to obtain the risk category corresponding to each of the risk warning rules. The risk categories corresponding to each of the risk warning rules are then integrated to obtain the first risk identification result data of the target business. In the above manner, the risk type of the target business can be identified.
[0075] In some embodiments of this specification, the target recognition model is trained in the following manner: obtaining process data and label data of multiple businesses in a historical time period; the label data is used to characterize the risk category corresponding to each of the businesses; processing the process data of each of the businesses to obtain a word sequence corresponding to each of the businesses, and generating a training sample set based on the word sequence and label data corresponding to each of the businesses; using the training sample set to train the preset recognition model to obtain a target recognition model; the preset recognition model is built based on the FastText model. In this embodiment, the process data and label data of multiple businesses in a historical time period can be obtained. Among them, the process data can be management process indicator data of the business, such as project development progress, test progress, time cycle, etc. The process data can be digitized, missing values are processed, and the required fields are converted. Preliminary processing such as feature screening can be performed through RF (random forest) correlation analysis and IV value (information value, used to evaluate variable prediction ability) processing to form training sample data related to project risk. The model used in this embodiment is the FastText model, which inputs a sequence of words and outputs the probability that this word sequence belongs to different categories. The words and phrases in the sequence form feature vectors, which are mapped to the middle layer through linear transformation, and the middle layer is mapped to the label. The FastText model is trained with the preprocessed data to obtain the target recognition model. In this way, a model for identifying target business risks can be constructed.
[0076] Step S104, using the business data corresponding to each of the basic variables to determine the variable value of each of the basic variables in the target template data, and combining the first risk identification result data and the second risk identification result data to determine the variable value of the risk warning variable in the target template data, to obtain the processing result file of the target business.
[0077] After obtaining each basic variable among the multiple basic variables associated with the target business and the first risk identification result data and the second risk identification result data, the business data corresponding to each basic variable among the multiple basic variables associated with the target business can be used to assign values to each basic variable among the multiple basic variables in the target template data, that is, to determine the variable value of each basic variable. The business data corresponding to each basic variable can be determined as the variable value of each basic variable in the target template data. The first risk identification result data and the second risk identification result data can also be integrated, and the integrated data can be used to assign values to the risk warning variables in the target template data, that is, to determine the variable value of the risk warning variable. The integrated data can be determined as the variable value of the risk warning variable. After assigning values to multiple variables in the target template data, the processing result data of the target business can be obtained.
[0078] In the above embodiment, lightweight attention data is automatically downloaded according to customized data extraction rules. At the same time, potential risk points in the project process are accurately identified by customizing risk warning rules and deploying risk intelligent identification models. The stand-up meeting materials can be quickly integrated and automatically generated according to customized material style templates, which can improve generation efficiency and accurately identify risks. It can solve the problem that the current physical billboards used in team stand-ups cannot display the overall situation of the project in real time, resulting in low communication efficiency and the problem that possible risks are not exposed in a timely manner.
[0079] In some embodiments of the present specification, after obtaining the processing result file of the target business, it may also include: determining whether it is necessary to perform format conversion on the processing result file; if so, performing format conversion on the processing result file of the target business, and saving the converted processing result file. In this embodiment, it can be determined whether it is necessary to perform format conversion on the processing result file according to the needs of the user, and if so, performing format conversion and saving. In one embodiment, in response to the user's business processing request, the business data processing method in the above embodiment is executed. The business processing request may include an identifier of the target business and a type identifier of the generated processing result file. If the type identifier is different from the preset type, format conversion is required. In the above manner, it can be determined whether to perform format conversion on the processing result file according to the needs of the user to obtain a processing result file that meets the user's needs.
[0080] Each embodiment in this specification is described in a progressive manner, and the same or similar parts between the embodiments can be referred to each other, and each embodiment focuses on the differences from other embodiments. For details, please refer to the description of the above-mentioned related processing related embodiments, and no further description is given here.
[0081] The above is a description of a specific embodiment of the specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0082] Based on the same inventive concept, a business data processing device is also provided in the embodiments of this specification, as described in the following embodiments. Since the principle of solving the problem by the business data processing device is similar to that of the business data processing method, the implementation of the business data processing device can refer to the implementation of the business data processing method, and the repetitions are not repeated. As used below, the term "unit" or "module" can be a combination of software and / or hardware that implements a predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceived. Figure 2 is a structural block diagram of a business data processing device according to an embodiment of this specification, such as Figure 2 As shown, it includes: an acquisition module 201, an extraction module 202, a risk identification module 203 and a generation module 204. The structure is described below.
[0083] The acquisition module 201 is used to acquire target template data; the target template data includes a plurality of basic variables associated with a target business and risk warning variables corresponding to the target business.
[0084] The extraction module 202 is used to extract business data corresponding to each basic variable among multiple basic variables associated with the target business according to preset data extraction rule information.
[0085] The risk identification module 203 is used to determine the preset risk warning rule information based on the business data corresponding to each basic variable among the multiple basic variables extracted, and obtain the first risk identification result data of the target business; it is also used to input the process data corresponding to the target business into the target identification model to obtain the second risk identification result data of the target business.
[0086] The generation module 204 is used to determine the variable value of each of the basic variables in the target template data using the business data corresponding to each of the basic variables, and to determine the variable value of the risk warning variable in the target template data in combination with the first risk identification result data and the second risk identification result data, so as to generate a processing result file for the target business.
[0087] In some embodiments of the present specification, the preset data extraction rule information may include a preset data extraction rule table; the preset data extraction rule table may include at least one data extraction rule; the data extraction rule includes at least one of the following: data extraction rule number, variable identifier, variable description, data extraction system identifier, value logic path, formatting processing type and rule status.
[0088] In some embodiments of the present specification, the extraction module is specifically used to: read the operation rule information associated with the target business, the operation rule information may include at least one operation rule, and the operation rule may include at least one of the following: operation rule identifier, business number, data extraction rule number, operation start date, operation end date, operation frequency and rule status; obtain the operation rule with a rule status of effective in the operation rule information, read the data extraction rule table corresponding to the data extraction rule number in the operation rule, and extract data according to the information in each data extraction rule in the data extraction rule table; package the business data corresponding to each basic variable of the multiple basic variables associated with the target business extracted by each data extraction rule according to the business number, and integrate them into result data.
[0089] In some embodiments of the present specification, the preset risk warning rule information may include a preset risk warning rule table; the risk warning rule table may include at least one risk warning rule, and the risk warning rule includes at least one of the following: risk warning rule identifier, rule description, data extraction system identifier, risk judgment rule description, implementation logic function, risk level and rule status.
[0090] In some embodiments of the present specification, the risk identification module is specifically used to: read each risk warning rule in at least one risk warning rule in the preset risk warning rule table; make judgments based on each risk warning rule in the business data corresponding to multiple basic variables, and determine the risk category corresponding to each risk warning rule; and generate the first risk identification result data of the target business according to the risk category corresponding to each risk warning rule.
[0091] In some embodiments of the present specification, the target recognition model is trained in the following manner: obtaining process data and label data of each business among multiple businesses within a historical time period; the label data is used to characterize the risk category corresponding to each business among the multiple businesses; processing the process data of each business to obtain a word sequence corresponding to each business, and generating a training sample set based on the word sequence and label data corresponding to each business; using the training sample set to train a preset recognition model to obtain a target recognition model; the preset recognition model is built based on the FastText model.
[0092] In some embodiments of the present specification, the device may also include a format conversion module, which is specifically used to: after obtaining the processing result file of the target business, determine whether the processing result file needs to be format converted; if so, convert the format of the processing result file of the target business and save the converted processing result file.
[0093] This specification also provides a business data processing system. Figure 3 , shows a schematic diagram of the structure of the business data processing system in the embodiment of this specification. Figure 3 As shown, the business data processing system 10 includes: an external connection device 11, a rule customization device 12, a recognition model building device 13, a data storage device 15 and a business data processing device 14, and the structure is described below.
[0094] The external connection device 11 is used to set connection parameters with an external system.
[0095] The rule customization device 12 is used to customize preset data extraction rule information and preset risk warning rule information, and is also used to customize template data.
[0096] The recognition model building device 13 is used to build and store the target recognition model.
[0097] The data storage device 15 is used to store the preset data extraction rule information, the preset risk warning rule information and template data and the template data.
[0098] The business data processing device 14 includes an acquisition module, an extraction module, a risk identification module and a generation module.
[0099] The acquisition module is used to obtain the preset data extraction rule information, preset risk warning rule information and target template data corresponding to the target business from the data storage device 15, and obtain the external connection parameters set by the external connection device 11; the target template data includes multiple basic variables associated with the target business and risk warning variables corresponding to the target business.
[0100] The extraction module is used to establish a connection with the external system based on the connection parameters, and extract the business data corresponding to each of the basic variables from the external system according to the preset data extraction rule information.
[0101] The risk identification module is used to judge the preset risk warning rule information based on the business data corresponding to each of the basic variables to obtain the first risk identification result data of the target business; it is also used to call the identification model construction device 13 to input the process data corresponding to the target business into the target identification model to obtain the second risk identification result data of the target business.
[0102] The generation module is used to determine the variable value of each basic variable in the target template data using the business data corresponding to each basic variable, and determine the variable value of the risk warning variable in the target template data in combination with the first risk identification result data and the second risk identification result data, to obtain the processing result file of the target business.
[0103] The above system is described below in conjunction with a specific embodiment. However, it should be noted that the specific embodiment is only for better illustrating the present specification and does not constitute an improper limitation on the present specification.
[0104] In this specific embodiment, a business data processing system is provided. The business data processing system in this specific embodiment automatically downloads lightweight data of interest according to customized data extraction rules by connecting to the relevant enterprise-level project management platform system (i.e., external system), and accurately identifies potential risk points in the project process by deploying risk intelligent identification models, and quickly integrates and automatically generates stand-up meeting materials according to customized material style templates for team morning meeting communication and confirmation, so as to solve the problem that the physical billboards used in the current team stand-up meetings cannot display the overall situation of the project in real time, resulting in low communication efficiency, and the possible risks are not exposed in time.
[0105] Figure 4 Figure 1 is a deployment diagram of a business data processing system. Figure 4 As shown, the business data processing system 10 is connected to each project R&D management system (such as a demand management system, a unified design platform, a test case management system, a problem management system, etc.) to realize the extraction and integration of relevant R&D management process data.
[0106] Please continue to refer to Figure 3 ,like Figure 3 As shown, the business data processing system 10 includes an external connection device 11, a rule customization device 12, a recognition model building device 13, a business data processing device 14, and a data storage device 15. The relevant devices are described in detail as follows.
[0107] The external connection device 11 is used to set the connection parameters between the business data processing system 10 and the demand management system, unified design platform, test case management system, problem management system, as well as the download directory of the processing results and other related parameters.
[0108] The rule customization device 12 is used to customize the relevant rules needed by the system, such as Figure 5 As shown, a functional module diagram of the rule customization device 12 is shown, which may include a system operation rule module 121, a data extraction rule module 122, a risk warning rule module 123, and a material style customization module 124. Specifically:
[0109] The system operation rule module 121 is mainly used to define the rules of the system operation, including project number, operation cycle, and operation frequency. The rules of the system operation rule table RULRUN are shown in Table 1 below.
[0110] Table 1
[0111]
[0112] The configuration items are described as follows:
[0113] Rule ID: uniquely identifies a system operation rule.
[0114] Project number: When processing, this system uses the project number to associate with the relevant demand management system, unified design platform, test case management system, and problem management system to obtain the process data information corresponding to the project number.
[0115] Associated extraction rule number: corresponds to the data extraction rule defined by the data extraction rule module 122 .
[0116] Operation start date: The start date of business data processing for this project.
[0117] Operation end date: the date when the business data processing of this project ends.
[0118] Operation frequency: The frequency of business data processing for this project, for example 1, daily; 2, weekly, etc.
[0119] Rule status: 0 means effective, 1 means ineffective.
[0120] The data extraction rule module 122 is mainly used to define the rules for the system to perform lightweight extraction of project process data, including extraction data description, extraction target system ID, extraction table name, and extraction rule logic. It can be personalized according to the focus of different team meetings. The rules of the data extraction rule table RULDAT are shown in Table 2 below.
[0121] Table 2
[0122]
[0123]
[0124] The configuration items are described as follows:
[0125] Rule number: corresponds to the rule number of a material style template. If the templates of two material styles are different, different rule numbers can be defined.
[0126] Tag variables: define variables in the template. When the system is processing, it extracts information according to the information acquisition rules of the tag variables and assembles the result data stream. A template can define multiple tag variables.
[0127] Variable Description: Defines the description of the variable in the template.
[0128] Data extraction system: Identifies the system from which data for this tag variable is obtained.
[0129] Value extraction logic path: specifies the logic path for extracting the data of the label variable from the data extraction system.
[0130] Formatting processing type: defines the formatting processing type for data extraction of the tag variable, including 1-information extraction, 2-form embedding, 3-snapshot screenshot, and 4-link display. Among them:
[0131] 1-Information extraction: used for indifferent replacement after variable information extraction, such as rule number 3 above, to obtain project status information from pdmStruct.product.pd.information of the demand management system as the data value of the project overview variable L3 defined in the template.
[0132] 2-Form embedding: used to embed data into materials in the form of an Excel form, mainly used for the display of detailed data.
[0133] 3-Snapshot screenshot: used to present data in the form of pictures in the materials. It is mainly used when the data extraction system has some statistical result data presentation functions that meet the requirements. Users only need to take a screenshot of the result and paste it into the scene of the stand-up meeting materials.
[0134] 4-Link display: It is used to display data in the material in the form of data links. It is mainly used when the data extraction system has some function menus that meet the requirements. Users only need to display the result link in the scene of the stand-up material.
[0135] Rule status: 0 means effective, 1 means ineffective.
[0136] The risk warning rule module 123 is used to set the judgment rules based on the process data to judge whether there is a project risk. When the model operation module 133 is executed, it reads the rules set by the risk warning rule module 123, makes rule judgments based on the extracted data one by one, and outputs the results. The rules of the risk warning rule table RULRISK are shown in Table 3 below.
[0137] Table 3
[0138]
[0139]
[0140] The output of the risk warning rule table RULRISK judgment results is shown in Table 4 below.
[0141] Table 4
[0142] Project Number Warning rule ID Judgment result Risk Level K202306180009 A00001 Y generally K202306180009 A00002 Y serious K202306180009 A00003 N K202306180009 A00003 N ……
[0143] The material style customization module 124 is used to customize the stand-up material style template processed by this system. The style template is stored in the system's template path and is used by the material result file output processing step of the business data processing device 14. In the scheme of the present invention, the style template is in the form of a PPT master board. If other file formats need to be output, the business data processing device 14 converts them and outputs them. The sample template of the stand-up material is as follows Figure 6 As shown. Figure 6 As shown in the figure, {Lx} (x = 1, 2, ... n) in the material template is a defined variable identifier. When the system processes, it will assemble the extracted data into the material template and finally output it. Multiple {Lx} variable identifiers can be defined according to user needs.
[0144] The identification model building device 13 is responsible for implementing the training and deployment of the risk intelligent identification model. It can intelligently identify and warn project risks based on the preset risk warning rules and the trained artificial intelligence model, and prompt the team to focus on it. Figure 7 This is a schematic diagram of the functional modules of the identification model building device 13 , which includes a model training module 131 , a model management module 132 , and a model operation module 133 .
[0145] Specifically, the model training module 131 is responsible for training the risk intelligent identification model to achieve more accurate risk point prompts based on process data. The steps for establishing the intelligent identification model are described in detail as follows:
[0146] Sample data: Get the original data of project management in the past period from the R&D management system, provide an interface for Python to call, and after getting the relevant data from the above interface, perform preliminary processing such as digitizing the data, processing missing values, and converting required fields. Perform feature selection through RF (random forest) correlation analysis and IV value (information value, used to evaluate the predictive ability of variables) processing to form training sample data related to project risks. As shown in the figure below.
[0147] Model selection and training: The present invention requires natural language communication with computers, which involves natural language processing. Natural language processing is a field in computer science, artificial intelligence, and linguistics that focuses on the direct interaction between computers and human languages. The current natural language processing and machine learning training models in the industry include FastText, TextCNN, ULMFit, BERT, etc. The model used in this article is the FastText model. The FastText model inputs a sequence of words and outputs the probability that this word sequence belongs to different categories. The words and phrases in the sequence form feature vectors, which are mapped to the middle layer through linear transformation, and the middle layer is mapped to the label. The model is trained with preprocessed data.
[0148] Model training output results: The results of model training verification under the test sample set reach the model online accuracy threshold set by the model management module 132, which can meet the online requirements, and the model status is updated to "pending online".
[0149] The model management module 132 is responsible for the maintenance and management of the relevant models of the system, including the setting of model training parameters (such as the model online accuracy threshold), starting training, terminating training, model online, model offline, etc.
[0150] The model operation module 133 runs the effective model and outputs the risk identification results. The results output by this module include two parts: one is to make business judgments based on the preset rule library and output a business list that hits the warning rules; the other is to output the model execution results based on the deployed model and output the intelligent warning business list to prompt the R&D team to focus on it.
[0151] The business data processing device 14 is responsible for automatically generating stand-up meeting materials, such as Figure 8 , which shows a flow chart of a business processing method in a specific embodiment. Figure 8 As shown, it can include three steps: template variable data extraction processing, risk warning data processing, and material result file output processing.
[0152] Among them, the template variable data extraction processing step completes the extraction processing of template variable related data according to the data extraction rules defined by the rule customization device 12. The data is stored in the form of kv key-value pairs and written into the data extraction temporary table of the system. The detailed processing flow of template variable data extraction is as follows Fig. 9 shown.
[0153] The risk warning data processing step calls the identification model building device 13 to obtain the warning data output by the model operation. The warning data includes two parts: one is the result data output by the risk warning rule table RULRISK, and the other is the warning data result output by the model operation of the identification model building device 13. Fig.10 This is the risk warning data processing flow chart.
[0154] Material result file output processing steps: read the material result table of the project station meeting, extract the variable data generated in the previous steps and the risk warning result data, parse the material data stream, replace the variable values according to the variables defined in the customized material format, and save them to the specified directory path for users to download, such as Fig.11 This is a flow chart for the material result file output process. The material result file output generates a PPT format file by default. Furthermore, different file format conversion processes can be provided to achieve different material result format conversion outputs, such as .doc, .pdf, etc.
[0155] The data storage device 15 is responsible for storing various rules and model data of the system, as well as temporarily storing the process data of each extraction and the result data of the stand-up meeting materials.
[0156] The method in the above specific embodiment can efficiently realize the intelligent automatic generation of stand-up meeting materials based on lightweight data extraction, solving the problem of low efficiency of stand-up meetings and failure to expose risks in a timely manner due to the limitations of physical billboards in current project stand-up meetings.
[0157] From the above description, it can be seen that the embodiments of this specification achieve the following technical effects: according to the customized data extraction rules, lightweight focus data is automatically downloaded, and at the same time, potential risk points in the project process are accurately identified by customizing risk warning rules and deploying risk intelligent identification models. According to the customized material style template, stand-up meeting materials can be quickly integrated and automatically generated for team morning meetings to solve the current problem that the use of physical billboards in team stand-up meetings cannot display the overall situation of the project in real time, resulting in low communication efficiency, and possible risks are not exposed in time.
[0158] This specification also provides a computer device, which can be found in Fig.12 The computer device structure diagram of the business data processing method provided by the embodiment of this specification is shown, and the computer device may specifically include an input device 21, a processor 22, and a memory 23. Among them, the memory 23 is used to store processor executable instructions. When the processor 22 executes the instructions, the steps of the business data processing method described in any of the above embodiments are implemented.
[0159] In this embodiment, the input device may specifically be one of the main devices for information exchange between the user and the computer system. The input device may include a keyboard, a mouse, a camera, a scanner, a light pen, a handwriting input board, a voice input device, etc.; the input device is used to input the original data and the program for processing these numbers into the computer. The input device can also obtain and receive data transmitted from other modules, units, and devices. The processor can be implemented in any appropriate manner. For example, the processor can take the form of a computer-readable medium, a logic gate, a switch, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), a programmable logic controller, and an embedded microcontroller, etc., such as a microprocessor or a processor and a computer-readable program code (such as software or firmware) that can be executed by the (micro) processor. The memory may specifically be a memory device used to store information in modern information technology. The memory may include multiple levels. In a digital system, anything that can store binary data can be a memory; in an integrated circuit, a circuit with a storage function without a physical form is also called a memory, such as a RAM, a FIFO, etc.; in a system, a storage device with a physical form is also called a memory, such as a memory stick, a TF card, etc.
[0160] In this embodiment, the functions and effects specifically realized by the computer device can be explained in comparison with other embodiments and will not be described in detail here.
[0161] A computer storage medium based on the business data processing method is also provided in the implementation mode of this specification. The computer storage medium stores computer program instructions, and when the computer program instructions are executed by a processor, the steps of the business data processing method described in any of the above embodiments are implemented.
[0162] In this embodiment, the storage medium includes, but is not limited to, a random access memory (RAM), a read-only memory (ROM), a cache, a hard disk (HDD) or a memory card. The memory may be used to store computer program instructions. The network communication unit may be an interface for network connection communication set in accordance with the standard specified by the communication protocol.
[0163] In this embodiment, the functions and effects specifically implemented by the program instructions stored in the computer storage medium can be explained in comparison with other embodiments and will not be repeated here.
[0164] An embodiment of this specification also provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements the steps of the application deployment method based on a low-code platform described in any of the above embodiments.
[0165] Obviously, those skilled in the art should understand that the modules or steps of the above-mentioned embodiments of this specification can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, and optionally, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order from that here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. In this way, the embodiments of this specification are not limited to any specific combination of hardware and software.
[0166] It should be understood that the above description is for illustration and not for limitation. Many embodiments and many applications beyond the examples provided will be apparent to those skilled in the art upon reading the above description. Therefore, the scope of this specification should not be determined with reference to the above description, but should be determined with reference to the preceding claims and the full scope of equivalents to which these claims belong.
[0167] The above description is only the preferred embodiment of this specification and is not intended to limit this specification. For those skilled in the art, the embodiments of this specification may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this specification shall be included in the protection scope of this specification.
Claims
1. A business data processing method, It is characterized in that include: Get target template data; The target template data includes a plurality of basic variables associated with the target business and risk warning variables corresponding to the target business; Extracting business data corresponding to each of the basic variables according to preset data extraction rule information; Based on the business data corresponding to each of the basic variables, the preset risk warning rule information is judged to obtain the first risk identification result data of the target business; Inputting the process data corresponding to the target business into the target identification model to obtain second risk identification result data of the target business; The variable value of each basic variable in the target template data is determined by using the business data corresponding to each basic variable, and the variable value of the risk warning variable in the target template data is determined in combination with the first risk identification result data and the second risk identification result data to obtain the processing result file of the target business.
2. The business data processing method according to claim 1, It is characterized in that The preset data extraction rule information includes a preset data extraction rule table; The preset data extraction rule table includes at least one data extraction rule; the data extraction rule includes at least one of the following: data extraction rule number, variable identifier, variable description, data extraction system identifier, value logic path, formatting processing type and rule status.
3. The business data processing method according to claim 2, It is characterized in that According to the preset data extraction rule information, the business data corresponding to each of the basic variables is extracted, including: Reading the operation rule information associated with the target business, the operation rule information including at least one operation rule, the information in the operation rule including at least one of the following: an operation rule identifier, a business number, a data extraction rule number, an operation start date, an operation end date, an operation frequency, and a rule status; Obtaining an operation rule whose rule status is effective, reading a data extraction rule table corresponding to a data extraction rule number in the operation rule, and extracting business data corresponding to each of the basic variables according to information in each data extraction rule in the data extraction rule table; The business data extracted according to the data extraction rules are packaged according to the business numbers and integrated into result data.
4. The business data processing method according to claim 1, It is characterized in that The preset risk warning rule information includes a preset risk warning rule table; The risk warning rule table includes at least one risk warning rule, and the risk warning rule includes at least one of the following: risk warning rule identification, rule description, data extraction system identification, risk judgment rule description, implementation logic function, risk level and rule status.
5. The business data processing method according to claim 4, It is characterized in that Based on the business data corresponding to each of the basic variables, the preset risk warning rule information is judged to obtain the first risk identification result data of the target business, including: Read each of the risk warning rules in the preset risk warning rule table; Judging each of the risk warning rules based on the business data corresponding to each of the basic variables, and determining the risk category corresponding to each of the risk warning rules; According to the risk category corresponding to each of the risk warning rules, first risk identification result data of the target business is generated.
6. The business data processing method according to claim 1, It is characterized in that The target recognition model is trained in the following way: Acquire process data and label data of multiple businesses in a historical time period; the label data is used to characterize the risk category corresponding to each of the businesses; Processing the process data of each of the services to obtain a word sequence corresponding to each of the services, and generating a training sample set based on the word sequence and label data corresponding to each of the services; Using the training sample set to train a preset recognition model to obtain a target recognition model; The preset recognition model is built based on the FastText model.
7. A business data processing device, It is characterized in that include: An acquisition module is used to acquire target template data; The target template data includes a plurality of basic variables associated with the target business and risk warning variables corresponding to the target business; An extraction module, used to extract business data corresponding to each of the basic variables according to preset data extraction rule information; A risk identification module, configured to determine preset risk warning rule information based on the business data corresponding to each of the basic variables, and obtain first risk identification result data of the target business; Inputting the process data corresponding to the target business into the target identification model to obtain second risk identification result data of the target business; A generation module is used to use the business data corresponding to each of the basic variables to determine the variable value of each of the basic variables in the target template data, and to determine the variable value of the risk warning variable in the target template data in combination with the first risk identification result data and the second risk identification result data to obtain a processing result file for the target business.
8. A business data processing system, It is characterized in that include: External connection device, used to set connection parameters with external system; A rule customization device, used to customize preset data extraction rule information and preset risk warning rule information, and also used to customize template data; A recognition model building device, used to build and store a target recognition model; A data storage device, used to store the preset data extraction rule information, the preset risk warning rule information and template data and the template data; A business data processing device, comprising: an acquisition module, used to acquire preset data extraction rule information, preset risk warning rule information and target template data corresponding to the target business from the data storage device, and acquire external connection parameters set by the external connection device; the target template data includes a plurality of basic variables associated with the target business and risk warning variables corresponding to the target business; An extraction module, configured to establish a connection with the external system based on the connection parameters, and extract business data corresponding to each of the basic variables from the external system according to the preset data extraction rule information; A risk identification module, used to determine the preset risk warning rule information based on the business data corresponding to each of the basic variables to obtain the first risk identification result data of the target business; and also used to call the identification model building device to input the process data corresponding to the target business into the target identification model to obtain the second risk identification result data of the target business; A generation module is used to use the business data corresponding to each of the basic variables to determine the variable value of each of the basic variables in the target template data, and to determine the variable value of the risk warning variable in the target template data in combination with the first risk identification result data and the second risk identification result data to obtain a processing result file for the target business.
9. A computer device, It is characterized in that The method comprises a processor and a memory for storing processor-executable instructions, wherein the processor implements the steps of the method according to any one of claims 1 to 6 when executing the instructions.
10. A computer-readable storage medium having computer instructions stored thereon, It is characterized in that When the instructions are executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
11. A computer program product comprising a computer program / instructions, It is characterized in that When the computer program / instructions are executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
