A method and device for updating data status
Through the data interface matching the task response system, acquiring and converting task data, generating data quality reports and creating monitoring tasks, the problem that users cannot obtain task processing status in real time is solved, and the efficiency of task management and the convenience of state acquisition is achieved.
Patent Information
- Application Number
- CN202010191013.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-03-18
- Publication Date
- 2025-03-21
- Estimated Expiration
- 2040-03-18
AI Technical Summary
In the existing task response technology, users can only obtain the task response structure after the task response is completed, and cannot obtain the task processing status in real time, resulting in a reduction in task management effect and increasing the difficulty of obtaining task status.
The task data is obtained through the data interface matching the task response system and converted into standard data to generate a data quality report. If the conversion is successful, create a monitoring task and update the task status in real time so that the user can obtain the task processing progress in real time.
It enables users to obtain task processing progress in real time, reduces the difficulty of obtaining task status, and improves the efficiency of task management.
Smart Images

Figure CN111475375B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of data processing, and in particular relates to a method and device for updating data status. Background Art
[0002] With the continuous advancement of the electronic process, a large number of task response processes can be processed online through the server or client, and the processing results can be fed back to the user, realizing remote response to the task request initiated by the user. The existing task response technology generally feeds back a request reception information to the user after receiving the user's task request, and outputs the task response result after the task response is completed. However, the response process of some tasks takes a long time, and there are multiple task states. There may also be abnormal responses in the task during the task response process. For the above types of tasks, users cannot obtain the processing status of the task, which reduces the management effect of the task and increases the difficulty of obtaining the task status. Summary of the invention
[0003] In view of this, an embodiment of the present invention provides a method and device for updating data status to solve the problem of existing task response technology, in which the user can only obtain the task response structure after the task response is completed, and cannot obtain the intermediate status during the task response process, thereby reducing the task management effect and increasing the difficulty of obtaining the task status.
[0004] A first aspect of an embodiment of the present invention provides a method for updating a data state, comprising:
[0005] Calling a data interface matching the task response system to obtain task data of the target task from the task response system;
[0006] Based on the database type of the task response system, converting the task data into standard data;
[0007] Generating a data quality report on the data interface according to the standard data of each of the target tasks;
[0008] If the report result of the data quality report is that the conversion is successful, identifying the data interface as a valid interface, and creating a monitoring task for the target task;
[0009] The task data of the target task is updated through the effective interface, and the task status of the monitoring task is adjusted based on the updated task data.
[0010] A second aspect of an embodiment of the present invention provides a data status updating device, including:
[0011] A task data acquisition unit, used to call a data interface matching the task response system to acquire task data of a target task from the task response system;
[0012] A standard data conversion unit, used for converting the task data into standard data based on the database type of the task response system;
[0013] A data quality report generating unit, used for generating a data quality report on the data interface according to the standard data of each target task;
[0014] A monitoring task creation unit, configured to identify the data interface as a valid interface and create a monitoring task for the target task if the report result of the data quality report is that the conversion is successful;
[0015] The monitoring task updating unit is used to update the task data of the target task through the effective interface, and adjust the task status of the monitoring task based on the updated task data.
[0016] A third aspect of an embodiment of the present invention provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the first aspect when executing the computer program.
[0017] A fourth aspect of an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the first aspect are implemented.
[0018] The method and device for updating data status provided by the embodiment of the present invention have the following beneficial effects:
[0019] The embodiment of the present invention obtains the task data of the target task through a data interface matching the task response system, and converts the task data into standard data that can be directly stored locally, determines the conversion effect of the data interface based on the standard data, and generates a data quality report. If the data interface can effectively convert the task data of the task response system into standard data, a data quality report of successful conversion is generated, and a corresponding monitoring task is created for the task data obtained by the data interface, the real-time status of the task data is obtained through an effective interface, and the task status of the monitoring task is updated, so that the user can obtain the processing progress of the target task in real time. Compared with the existing task response technology, the terminal device can retrieve the task data of the target data from different task response systems through a preset data interface, convert it into standard data and store it locally, establish a corresponding monitoring task, update the task data in real time, and adjust the task status. The user can determine the processing progress of the target task by querying the task status of the local monitoring task, which reduces the difficulty of obtaining the task status and improves the efficiency of task management. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.
[0021] Figure 1 is a flow chart of an implementation method of a data status update method provided by the first embodiment of the present invention;
[0022] Figure 2 is a specific implementation flow chart of a data status updating method provided by the second embodiment of the present invention;
[0023] Figure 3 This is a specific implementation flow chart of a data status updating method S102 provided in the third embodiment of the present invention;
[0024] Figure 4 This is a specific implementation flow chart of a data status updating method S103 provided in the fourth embodiment of the present invention;
[0025] Figure 5 This is a specific implementation flow chart of a data status updating method S101 provided in the fifth embodiment of the present invention;
[0026] Figure 6 This is a specific implementation flow chart of a data status updating method S104 provided in the sixth embodiment of the present invention;
[0027] Figure 7This is a specific implementation flow chart of a data status updating method S105 provided in the seventh embodiment of the present invention;
[0028] Figure 8 It is a structural block diagram of a data status updating device provided by an embodiment of the present invention;
[0029] Fig. 9 It is a schematic diagram of a terminal device provided by another embodiment of the present invention. DETAILED DESCRIPTION
[0030] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0031] The embodiment of the present invention obtains the task data of the target task through a data interface matching the task response system, and converts the task data into standard data that can be directly stored locally, determines the conversion effect of the data interface based on the standard data, and generates a data quality report. If the data interface can effectively convert the task data of the task response system into standard data, a data quality report of successful conversion is generated, and a corresponding monitoring task is created for the task data obtained by the data interface, the real-time status of the task data is obtained through an effective interface, and the task status of the monitoring task is updated so that the user can obtain the processing progress of the target task in real time, which solves the problem of the existing task response technology that the user can only obtain the task response structure after the task response is completed, and cannot obtain the intermediate status in the task response process, thereby reducing the management effect of the task and increasing the difficulty of obtaining the task status.
[0032] In the embodiment of the present invention, the execution subject of the process is a terminal device, which includes but is not limited to: a server, a computer, a smart phone, a tablet computer and other devices capable of performing data export operations. Figure 1 The following is a flowchart of the method for updating the data status provided by the first embodiment of the present invention, which is described in detail as follows:
[0033] In S101, a data interface matching a task response system is called to obtain task data of a target task from the task response system.
[0034] In this embodiment, when a user needs to process a task, he can send the target task to the corresponding task response system for processing. During the process of the task response system processing the target task, the terminal device can obtain the task data of the target task through the data interface associated with the task response system. The task data is specifically used to indicate the processing status of the target task, for example, the task processing progress, the intermediate data generated during the task processing, and the task status identifier. The terminal device can determine the processing status of the target task based on the task data.
[0035] In this embodiment, the terminal device may be configured with at least one data interface, and one data interface may be associated with at least one task response system. When the terminal device needs to obtain task data from a certain task response system, it may obtain a data interface that matches the task response system based on the preset correspondence between the task response system and the data interface. It should be noted that one data interface may match multiple different task response systems, and at this time, the database types of different task response systems may be the same or different. If one data interface matches multiple task response systems with different database types, in this case, the data interface is configured with multiple different data conversion scripts, which may convert task data of different data types into standard data. Therefore, before calling the data interface to obtain task data, the terminal device may query the database type associated with the system identifier of the task response system according to the system identifier of the task response system, and adjust the data interface through the data conversion script that matches the database type, and then call the data interface to obtain task data from the task response system.
[0036] In particular, the terminal device can be a task management platform, which is used to obtain task data of various task response systems to the local computer. Users can use the task management platform to determine the response progress of target tasks initiated in different task response systems. For example, the task management platform is an insurance management platform, and different types of insurance are processed by different task response systems, such as life insurance systems, financial management systems, etc. Different task response systems use different database types. If task data needs to be retrieved to the task management platform, it is first necessary to call a data interface that matches the database type, and obtain the task data of the target task from the associated task response system through the data interface.
[0037] Optionally, in this embodiment, the terminal device can configure corresponding task query cycles for different task response systems. The task query cycle can be determined based on the task volume of the task response system. For example, if the average task volume of a task response system is large, it means that the task update speed is fast, and the corresponding task query cycle is short. On the contrary, if the average task volume of a task response system is small, it means that the task update speed is slow, and the corresponding task query cycle is long. The terminal device can query the task list currently processed by the task response system according to the task query cycle, compare the task list of this cycle with the task list of the previous cycle, identify the newly added task as the target task, and obtain the task data of the target task.
[0038] Optionally, in this embodiment, the acquisition modes for obtaining task data from the task response system can be divided into four types, namely: RSET-API, File Transfer Protocol (FTP), database, and WebService. The terminal device can select an acquisition mode that matches the task response system from the above four types, and perform initialization configuration operations on the data interface through the configuration script of the acquisition mode.
[0039] In S102, the task data is converted into standard data based on the database type of the task response system.
[0040] In this embodiment, after the terminal device obtains the task data of the target task through the data interface, it needs to store the task data locally. Since the data format used by the terminal device does not necessarily match the database format of the task response system, the task data cannot be directly parsed and stored locally. Therefore, the terminal device can query the database type of the task response system based on the system identifier of the task response system, and determine the data conversion algorithm based on the database type of the task response system and the data type used locally, and convert the task data into standard data through the data conversion algorithm, so that the terminal device can store and use the task data locally.
[0041] Optionally, in this embodiment, the terminal device can be provided with a standard data template, which configures associated fields for different data items. The terminal device can parse the parameter values of each data item in the task data and import the parameter values into the fields associated with the data items, thereby generating standard data that matches the task data.
[0042] Optionally, in this embodiment, the data interface is configured with a data conversion algorithm. Since the data interface matches the task response system, the data conversion algorithm associated with the database type can be encapsulated into the data interface. After the task response system retrieves the task data, the data interface can convert the task data into standard data through the built-in data conversion algorithm, store the standard data in the cache area, and perform subsequent operations.
[0043] In this embodiment, the terminal device can configure the interface status to different acquisition statuses according to the different ways in which the data interface obtains data from the task response system. If the data interface is an active acquisition interface type, the corresponding status includes (already acquired, acquiring, acquisition failed); if the data interface is a passive receiving interface type, the corresponding status includes (task abnormality red warning, task normal green), the terminal device can configure corresponding acquisition cycles or data reception feedback cycles for different interfaces, if the corresponding task data can be acquired within the preset cycle, then the data interface is identified as being in a normal state, otherwise, the data interface is identified as being in an abnormal state, and the data acquisition status of each data interface is output to the business management personnel through a visual interface, so that the business management personnel can quickly repair the abnormal situation.
[0044] In S103, a data quality report on the data interface is generated according to the standard data of each target task.
[0045] In this embodiment, in order to confirm the data conversion capability of the data interface and whether the target data can be successfully converted into standard data, the terminal device can output a data quality report of the data interface based on a preset detection frequency. The report results of the data quality report may include multiple different results such as successful conversion, failed conversion, abnormal conversion, etc. According to the standard data of multiple target tasks, the conversion success rate is calculated. If the conversion success rate is greater than the preset success rate threshold, the data quality report of the data interface is identified as a successful conversion; conversely, if the conversion success rate is less than or equal to the preset success rate threshold, the data quality report of the data interface is identified as a failed conversion. At this time, the terminal device can generate an interface abnormality information so that the maintenance personnel can reconfigure the abnormal data interface to improve the efficiency of data conversion.
[0046] Specifically, in this embodiment, the terminal generates a data quality report in a manner that: the quality of the standard data obtained by the above conversion is evaluated by a preset data evaluation algorithm. The data evaluation algorithm is mainly used to count the following multiple parameters of the standard data, including: integrity, redundancy, consistency, legality and matching. The terminal device can configure a corresponding script for each parameter. For example, for consistency detection, the terminal device can obtain two task data of the same type from the task response system, determine the standard data corresponding to each task data through the above data conversion algorithm, and determine whether the changes in the data format and parameter values of the above two standard data are consistent after the standardized conversion. By calculating the above multiple parameters, the conversion score of the data interface in different parameter dimensions can be determined. If the conversion score of the standard data converted by a certain data interface is lower than the preset score threshold, the data conversion algorithm of the data interface is identified as abnormal, and manual repair is required, and a data quality report of failed conversion is output; on the contrary, if the conversion score of the standard data converted by a certain data interface is not lower than the preset score threshold, the data interface is identified as normal, and data reception continues, and a data quality report of successful conversion is output.
[0047] Optionally, in this embodiment, according to the corresponding data detection algorithm and the job IDE function, a task is established to clean and transform the data to achieve standardization. During the process, the four links of task operation, access management, cleaning and conversion, and data warehousing can be monitored. In each link, the normal status of the access data task, whether there are tasks to be run, and the abnormal status of the data task can be viewed. The problem can be quickly located and solved according to the actual situation, so as to achieve in-process control after data access and ensure the effective storage of data in the local database.
[0048] In S104, if the report result of the data quality report is that the conversion is successful, the data interface is identified as a valid interface, and a monitoring task for the target task is created.
[0049] In this embodiment, if a data interface can effectively convert the task data into standard data after acquiring the task data, the terminal device will output a data quality report of successful conversion and identify the data interface as a valid interface. It should be emphasized that the terminal device can configure a valid time for the valid interface, and will not output the data quality report of the data interface again during the valid time, that is, the data conversion status of the data interface is detected; if the valid time is exceeded at a certain moment, it returns to execute the operation of S103.
[0050] In this embodiment, since the data interface is a valid interface, the converted standard data is valid data. At this time, a monitoring task for the target task can be created, and the initial state of the monitoring task can be determined based on the standard data obtained this time.
[0051] In S105, the task data of the target task is updated through the effective interface, and the task status of the monitoring task is adjusted based on the updated task data.
[0052] In this embodiment, the terminal device may be provided with an update cycle, and obtain the current task data of the target task from the task response system through an effective interface during the update cycle, and convert the task data into standard data through a preset data conversion algorithm, and update the task status of the monitoring task based on the updated standard data, so as to achieve the purpose of updating the task status in real time, so that the user can determine the processing progress of the target task in real time. It should be noted that in addition to actively updating the task data based on the update cycle, the task response system may send updated task data to the terminal device when the task data changes, that is, when the processing progress of the target task changes, and then the terminal device may adjust the task status of the monitoring task based on the received updated task data.
[0053] As can be seen from the above, a data status update method provided by an embodiment of the present invention obtains the task data of the target task through a data interface matching the task response system, and converts the task data into standard data that can be directly stored locally, determines the conversion effect of the data interface based on the standard data, and generates a data quality report. If the data interface can effectively convert the task data of the task response system into standard data, a data quality report of successful conversion is generated, and a corresponding monitoring task is created for the task data obtained by the data interface, the real-time status of the task data is obtained through an effective interface, and the task status of the monitoring task is updated, so that the user can obtain the processing progress of the target task in real time. Compared with the existing task response technology, the terminal device can retrieve the task data of the target data from different task response systems through a preset data interface, and convert it into standard data and store it locally, establish a corresponding monitoring task, update the task data in real time, and adjust the task status. The user can determine the processing progress of the target task by querying the task status of the local monitoring task, which reduces the difficulty of obtaining the task status and improves the efficiency of task management.
[0054] Figure 2 FIG. 2 shows a specific implementation flow chart of a data status update method provided by the second embodiment of the present invention. Figure 2 , relative to Figure 1 The embodiment, a data status updating method provided by the embodiment, before calling the data interface matching the task response system to obtain the task data of the target task from the task response system, further includes: S201 to S203, which are described in detail as follows:
[0055] Furthermore, before calling the data interface matching the task response system to obtain the task data of the target task from the task response system, it also includes
[0056] In S201, the system type of the task response system is obtained, and the target compilation language associated with the system type is queried.
[0057] In this embodiment, before the terminal device acquires the task data, the corresponding relationship between the data interface and the task response system can be configured. The terminal device can query the currently available task response system and send a system type query instruction to the task response system. After receiving the system type query instruction, the task response system will send its own system type to the terminal device. After determining the system type of the task response system, the terminal device can query the target compilation language associated with the system type, thereby determining the data format of the task response system, so as to perform subsequent data conversion operations.
[0058] Optionally, in this embodiment, if the system type of a task response system is compatible with multiple compilation languages, at this time, the terminal device can send a test task to the task response system and receive the test results returned by the task response system, determine the compilation language used by the task response system database based on the data type of the test results, and identify the compilation language as the target compilation language.
[0059] In S202, the associated statements of each compilation statement of the target compilation language are searched in the local compilation language library, and a corresponding relationship of the associated statements is established according to the compilation statements and the associated statements.
[0060] In this embodiment, the terminal device needs to establish a data conversion algorithm, that is, to convert the task data output by the target compilation language based on the task response system into standard data that can be used by the local compilation language. In order to realize the mutual conversion between different compilation languages, it is necessary to establish the corresponding relationship between the associated statements of the two compilation languages. The specific implementation method is as follows: the terminal device can identify the compilation statements contained in the target compilation language, and query the associated statements of each compilation language in the local compilation language library, that is, the role of the compilation statement in the target compilation language is consistent with the role of the associated statement in the local compilation language. After identifying the associated statements of all compilation statements in the local compilation language, a corresponding relationship between associated statements can be established; the corresponding relationship between associated statements records: the association relationship between the compilation statements of the target compilation language and the compilation statements of the local compilation language.
[0061] In S203, based on the corresponding relationship of the associated sentences, the data interface matching the task response system is configured to convert the task data of the task response system through the data interface.
[0062] In this embodiment, the terminal device can generate a data conversion algorithm based on the correspondence relationship of associated statements, and import the data conversion algorithm into a preset interface template, thereby generating a data interface that matches the task response system. When the task data sent by the task response system is received, the task data can be converted through the built-in correspondence relationship of associated statements.
[0063] In an embodiment of the present invention, by determining the target compilation language of the task response system and querying the associated statements of the compilation statements of the target compilation language in the local compilation language, a corresponding relationship between the associated statements is established, and a data interface is generated. Task data can be received and converted through the data interface, thereby improving the efficiency of data conversion.
[0064] Figure 3 FIG. 4 shows a specific implementation flow chart of a data status updating method S102 provided in the third embodiment of the present invention. Figure 3 , relative to Figure 2 In the embodiment described above, a data status updating method S102 provided in this embodiment includes: S1021 to S1023, which are described in detail as follows:
[0065] Furthermore, the converting the task data into standard data based on the database type of the task response system includes:
[0066] In S1021, the task data is parsed to extract the compiled sentences to which each target segment in the task data belongs.
[0067] In this embodiment, after the terminal device obtains the task data through the data interface, the task data can be converted through the corresponding relationship of the associated statements built into the data interface. The implementation method is as follows: when the terminal device obtains the task data through the data interface, a thread will be configured for the data interface, and the operation of the data interface will be managed through the thread. After detecting that the data interface has collected the task data from the task response system, the task data can be stored in the cache area, and the task data can be parsed to determine the compilation statements used in each target segment in the task data. Since the target segment contains not only compilation statements but also parameters related to the target task, it is necessary to identify the sentence keywords in each target segment to determine the compilation statement described in the target statement, that is, the function used.
[0068] In S1022, based on the corresponding relationship of the associated sentences, the associated sentences corresponding to the compiled sentences to which the target segment belongs are searched.
[0069] In this embodiment, after determining the compiled sentence described in the target segment, the terminal device can query the corresponding relationship of the associated sentences to determine the associated sentences of the compiled sentence to which the target segment belongs. It should be noted that the above operation can be performed for all target segments, so as to determine the associated sentences to which each target segment belongs in the local compiled language.
[0070] In S1023, the standard segment of the related sentence is extracted, and the target segment is imported into the standard segment to generate the standard data.
[0071] In this embodiment, the terminal device can extract the standard segment corresponding to the associated sentence from the segment library. The standard segment specifically defines the segment format of the associated segment, that is, the data type required to be filled in each field. Then, the terminal device can extract task information related to the target task from the target segment, and based on the data type of each task information, import it into the field associated with the standard segment, thereby obtaining the standard data corresponding to the task data, thereby achieving the purpose of data format conversion.
[0072] In the embodiment of the present invention, by parsing the task data, determining the compiled sentence to which the target segment belongs, and querying the associated sentences of the compiled sentence, the conversion of standard data is achieved, thereby improving the success rate of data conversion.
[0073] Figure 4 FIG. 4 shows a specific implementation flow chart of a data status updating method S103 provided in the fourth embodiment of the present invention. Figure 4 , relative to Figure 1-3 In the embodiment, a data status updating method S103 provided in this embodiment includes: S1031 to S1036, which are described in detail as follows:
[0074] Furthermore, generating a data quality report on the data interface according to the standard data of each target task includes:
[0075] In S1031, the interface type of the data interface is identified.
[0076] In this embodiment, the data interface can be divided into two different types according to different collection methods, one is an active collection interface that actively obtains task data from the task response system, and the other is a passive collection interface that passively receives task data sent by the task response system. For different interface types, there are differences in the way of generating their data quality reports. Therefore, when outputting the data quality report, it is necessary to identify the interface type of the data interface. If the interface type is an active collection type, the operation of S1032 is executed; otherwise, if the interface type is a passive collection type, the operation of S1034 is executed.
[0077] In S1032, if the interface type is an active collection type, the collection time of each task data is obtained, and the delay parameter of the data interface is calculated according to each collection time and a preset collection cycle.
[0078] In this embodiment, if the interface type of a data interface is an active acquisition type, it is necessary to detect whether the data interface obtains task data from the task response system according to the preset acquisition trigger condition, so it is necessary to calculate the delay parameter of the data interface. Specifically, the terminal device can obtain the acquisition time of the task data of each target task. Since the data interface obtains the task data from the task response system based on the preset acquisition cycle, the distribution of the acquisition time should be on the acquisition time nodes of each acquisition cycle. Based on this, the terminal device can calculate the difference between the acquisition time and the acquisition time node of the acquisition cycle associated with it, identify the absolute value of the difference as the delay value, and calculate the delay parameter of the data interface based on the delay value of all task data.
[0079] In S1033, the data quality report is generated based on the delay parameter.
[0080] In this embodiment, the terminal device can compare the delay parameter with the delay threshold. If the delay parameter is less than or equal to the delay threshold, a data quality report indicating a successful conversion is output; otherwise, if the delay parameter is greater than the delay threshold, a data quality report indicating a failed conversion is output.
[0081] In S1034, if the interface type is a passive acquisition type, the standard data is parsed to determine the task status of each target task.
[0082] In this embodiment, if the interface type of a data interface is a passive collection type, it means that the task response system will actively send task data to the terminal device. At this time, it is necessary to determine the accuracy of the data interface for data conversion. The terminal device can determine the task status of each target task through standard data, and the task status may include: task pending, task in progress, task abnormality, etc.
[0083] In S1035, the actual status of each of the target tasks is obtained from the task response system, and the conversion accuracy of the data interface is calculated according to the task status and the actual status.
[0084] In this embodiment, in addition to sending task data to the terminal device, the task response system can also send the actual status of the target task to the terminal device, and determine whether the standard data is successfully converted by comparing the actual status with the task status determined based on the standard data. The conversion accuracy of the data interface is determined based on the ratio of the number of successfully converted standard data to the number of target tasks.
[0085] In S1036, the data quality report is generated based on the conversion accuracy.
[0086] In this embodiment, the terminal device can compare the conversion accuracy with the accuracy threshold. If the conversion accuracy is less than or equal to the accuracy threshold, a data quality report of failed conversion is output; otherwise, if the conversion accuracy is greater than the accuracy threshold, a data quality report of successful conversion is output.
[0087] In the embodiment of the present invention, by identifying the interface type of the data interface and outputting the data quality report in different ways, the conversion effect of the data interface can be measured by different parameters, thereby improving the accuracy of the data quality report.
[0088] Figure 5 FIG. 5 shows a specific implementation flow chart of a data status updating method S101 provided in the fifth embodiment of the present invention. Figure 5 , relative to Figures 1 to 3 In the embodiment, a data status updating method S101 provided in the embodiment includes: S1011 to S1013, which are described in detail as follows:
[0089] Further, the calling of a data interface matching the task response system to obtain the task data of the target task from the task response system includes:
[0090] In S1011, a task list of a target user is obtained; the task list includes the target tasks initiated by the target user.
[0091] In this embodiment, the terminal device can realize batch import of target tasks to be monitored, that is, all tasks of a certain user are created with corresponding monitoring tasks. At this time, the terminal device can query all target tasks initiated by the target user from the task database according to the user ID of the target user, and generate a task list.
[0092] In S1012, the task response system to which each target task belongs is determined.
[0093] In this embodiment, the terminal device may determine a task response system that responds to the target task based on the task information of each target task.
[0094] In S1013, based on the number of the task response systems, a plurality of the data interfaces are called to connect to each of the task response systems respectively, so as to obtain the task data of the target task from each of the task response systems.
[0095] In this embodiment, the terminal device can call multiple data interfaces that match the number of task response systems, and obtain task data of the target task responded by each task response system from each task response system, thereby achieving the purpose of concurrent downloading of task data.
[0096] In the embodiment of the present invention, by acquiring the task list of the target user, the purpose of downloading multiple task data in parallel is achieved, and the efficiency of acquiring the task data is improved.
[0097] Figure 6 FIG. 5 shows a specific implementation flow chart of a data status updating method S104 provided in the sixth embodiment of the present invention. Figure 6 , relative to Figures 1 to 3 In the embodiment, a data status updating method S104 provided in the embodiment includes: S1041 to S1042, which are described in detail as follows:
[0098] Furthermore, if the report result of the data quality report is that the conversion is successful, identifying the data interface as a valid interface and creating a monitoring task for the target task includes:
[0099] In S1041, based on the task identifier of the target task, a monitoring item of the target task is created on a preset monitoring page.
[0100] In this embodiment, after the terminal device determines that a data interface is a valid interface, that is, the standard data converted from the valid interface is legal data, the target task corresponding to the standard data can be monitored. The terminal device can create a monitoring project on a preset monitoring page according to the task identifier of the target task. The user can obtain the response status of each target task through the monitoring page.
[0101] In S1042, the standard data is parsed to determine the initial state of the target task, and the initial display mode of the monitoring item on the monitoring page is set according to the initial state.
[0102] In this embodiment, the terminal device parses the converted standard data, determines the initial state of the target task, and queries the display mode corresponding to the initial state, and uses the display mode as the initial display mode of the monitoring project. The display mode includes: display color, status mark, prompt mode and other display-related information.
[0103] In the embodiment of the present invention, by creating a monitoring item for the target task on the monitoring page and determining the initial display mode by parsing standard data, it is convenient for users to view the current task status of each task in real time, thereby improving task management efficiency.
[0104] Figure 7 FIG. 5 shows a specific implementation flow chart of a data status updating method S105 provided in the seventh embodiment of the present invention. Figure 7 , relative to Figure 6 In the embodiment, a data status updating method S105 provided in the embodiment includes: S1051-S1052, which are described in detail as follows:
[0105] In S1051, the current state of the target task is determined based on the updated task data.
[0106] In this embodiment, the terminal device can obtain updated task data from the task response system through a data interface, and obtain updated standard data by performing data conversion on the updated task data, and parse the updated standard data to determine the current status of the target task.
[0107] In S1052, the current display mode of the monitoring item is adjusted based on the current state.
[0108] In this embodiment, the terminal device can adjust the display mode of the monitoring items of the target task on the monitoring page according to the current status, that is, the current display mode mentioned above, such as changing the display status mark, or changing the display color, so as to facilitate users to distinguish different processing statuses.
[0109] In the embodiment of the present invention, by acquiring updated task data and adjusting the display mode of the monitoring task according to the updated data, it is convenient for the user to determine the change of the task response progress, thereby improving the efficiency of task management.
[0110] It should be understood that the order of execution of the steps in the above embodiment does not necessarily mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiment of the present invention.
[0111] Figure 8 The structure diagram of a data status update device provided by an embodiment of the present invention is shown. The data status update device includes units for executing Figure 1 For details, please refer to the steps in the corresponding embodiment. Figure 1 and Figure 1 For the convenience of explanation, only the parts related to this embodiment are shown.
[0112] See also Figure 8 , the data status updating device includes:
[0113] The task data acquisition unit 81 is used to call a data interface matching the task response system to acquire the task data of the target task from the task response system;
[0114] A standard data conversion unit 82, configured to convert the task data into standard data based on the database type of the task response system;
[0115] A data quality report generating unit 83, configured to generate a data quality report on the data interface according to the standard data of each target task;
[0116] A monitoring task creation unit 84 is used to identify the data interface as a valid interface and create a monitoring task for the target task if the report result of the data quality report is that the conversion is successful;
[0117] The monitoring task updating unit 85 is used to update the task data of the target task through the effective interface, and adjust the task status of the monitoring task based on the updated task data.
[0118] Optionally, the data status updating device further includes:
[0119] A system type identification unit, used to obtain the system type of the task response system and query the target compilation language associated with the system type;
[0120] An associated statement correspondence establishing unit, used for searching the local compiled language library for associated statements of each compiled statement of the target compiled language, and establishing an associated statement correspondence according to the compiled statements and the associated statements;
[0121] A data interface configuration unit is used to configure the data interface matching the task response system based on the corresponding relationship of the associated statements, so as to convert the task data of the task response system through the data interface.
[0122] Optionally, the standard data conversion unit 82 includes:
[0123] A compiled sentence extraction unit, used for parsing the task data and extracting compiled sentences belonging to each target segment in the task data;
[0124] A related sentence identification unit, configured to query the related sentence corresponding to the compiled sentence to which the target segment belongs based on the related sentence correspondence relationship;
[0125] The standard data output unit is used to extract the standard segment of the associated sentence, import the target segment into the standard segment, and generate the standard data.
[0126] Optionally, the data quality report generating unit 83 includes:
[0127] An interface type identification unit, used to identify the interface type of the data interface;
[0128] An active collection response unit, for obtaining the collection time of each of the task data if the interface type is an active collection type, and calculating the delay parameter of the data interface according to each of the collection times and a preset collection cycle;
[0129] A delay parameter comparison unit, used to generate the data quality report based on the delay parameter;
[0130] A passive collection response unit, configured to parse the standard data and determine the task status of each target task if the interface type is a passive collection type;
[0131] A conversion accuracy calculation unit, used for obtaining the actual state of each of the target tasks from the task response system, and calculating the conversion accuracy of the data interface according to the task state and the actual state;
[0132] A conversion accuracy comparison unit is used to generate the data quality report based on the conversion accuracy.
[0133] Optionally, the task data acquisition unit 81 includes:
[0134] A task list acquisition unit, used to acquire a task list of a target user; the task list includes the target task initiated by the target user;
[0135] A task response system identification unit, used to determine the task response system to which each of the target tasks belongs;
[0136] The data interface calling unit is used to call a plurality of the data interfaces to connect with each of the task response systems respectively based on the number of the task response systems, so as to obtain the task data of the target task from each of the task response systems.
[0137] Optionally, the monitoring task creation unit 84 includes:
[0138] A monitoring project creation unit, used to create a monitoring project of the target task on a preset monitoring page based on the task identifier of the target task;
[0139] The initial display mode configuration unit is used to parse the standard data, determine the initial state of the target task, and set the initial display mode of the monitoring item on the monitoring page according to the initial state.
[0140] Optionally, the monitoring task updating unit 85 includes:
[0141] A current state identification unit, used to determine the current state of the target task based on the updated task data;
[0142] A display mode adjustment unit is used to adjust the current display mode of the monitoring item based on the current state.
[0143] Therefore, the data status updating device provided in the embodiment of the present invention can also retrieve the task data of the target data from different task response systems through a preset data interface, convert it into standard data and store it locally, establish corresponding monitoring tasks, update the task data in real time, and adjust the task status. Users can determine the processing progress of the target task by querying the task status of the local monitoring task, which reduces the difficulty of obtaining the task status and improves the efficiency of task management.
[0144] Fig. 9 FIG. 1 is a schematic diagram of a terminal device provided by another embodiment of the present invention. Fig. 9 As shown, the terminal device 9 of this embodiment includes: a processor 90, a memory 91, and a computer program 92 stored in the memory 91 and executable on the processor 90, such as a data status update program. When the processor 90 executes the computer program 92, the steps in the above-mentioned data status update method embodiments are implemented, such as Figure 1 Alternatively, when the processor 90 executes the computer program 92, the functions of each unit in the above-mentioned device embodiments are realized, for example, Figure 8 The functions of modules 81 to 85 are shown.
[0145] Exemplarily, the computer program 92 may be divided into one or more units, which are stored in the memory 91 and executed by the processor 90 to complete the present invention. The one or more units may be a series of computer program instruction segments capable of completing specific functions, which are used to describe the execution process of the computer program 92 in the terminal device 9. For example, the computer program 92 may be divided into a task data acquisition unit, a standard data conversion unit, a data quality report generation unit, a monitoring task creation unit, and a monitoring task update unit, and the specific functions of each unit are as described above.
[0146] The terminal device 9 may be a computing device such as a desktop computer, a notebook, a PDA, or a cloud server. The terminal device may include, but is not limited to, a processor 90 and a memory 91. Those skilled in the art will appreciate that Fig. 9It is only an example of the terminal device 9 and does not constitute a limitation on the terminal device 9. It may include more or fewer components than shown in the figure, or a combination of certain components, or different components. For example, the terminal device may also include input and output devices, network access devices, buses, etc.
[0147] The processor 90 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.
[0148] The memory 91 may be an internal storage unit of the terminal device 9, such as a hard disk or memory of the terminal device 9. The memory 91 may also be an external storage device of the terminal device 9, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, etc. equipped on the terminal device 9. Further, the memory 91 may also include both an internal storage unit of the terminal device 9 and an external storage device. The memory 91 is used to store the computer program and other programs and data required by the terminal device. The memory 91 may also be used to temporarily store data that has been output or is to be output.
[0149] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0150] The embodiments described above are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. Such modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.
Claims
1. A method for updating data status, characterized in that: include: Calling a data interface matching the task response system to obtain task data of the target task from the task response system; Based on the database type of the task response system, converting the task data into standard data; Generating a data quality report on the data interface according to the standard data of each of the target tasks; If the report result of the data quality report is that the conversion is successful, identifying the data interface as a valid interface, and creating a monitoring task for the target task; Updating the task data of the target task through the effective interface, and adjusting the task status of the monitoring task based on the updated task data; Before calling the data interface matching the task response system to obtain the task data of the target task from the task response system, the method further includes: Obtaining a system type of the task response system, and querying a target compilation language associated with the system type; Searching for associated statements of each compilation statement of the target compilation language in the local compilation language library, and establishing a corresponding relationship between the associated statements according to the compilation statements and the associated statements; Based on the corresponding relationship of the associated sentences, the data interface matching the task response system is configured to convert the task data of the task response system through the data interface.
2. The updating method according to claim 1, characterized in that: The converting the task data into standard data based on the database type of the task response system includes: Parsing the task data, and extracting compiled sentences belonging to each target segment in the task data; Based on the corresponding relationship of the associated sentences, querying the associated sentences corresponding to the compiled sentences to which the target segment belongs; A standard segment of the associated sentence is extracted, and the target segment is imported into the standard segment to generate the standard data.
3. The updating method according to any one of claims 1 to 2, characterized in that: Generating a data quality report on the data interface according to the standard data of each target task includes: Identifying an interface type of the data interface; If the interface type is an active collection type, the collection time of each task data is obtained, and the delay parameter of the data interface is calculated according to each collection time and a preset collection cycle; Based on the delay parameter, generating the data quality report; If the interface type is a passive acquisition type, parsing the standard data to determine the task status of each target task; Acquire the actual status of each of the target tasks from the task response system, and calculate the conversion accuracy of the data interface according to the task status and the actual status; Based on the conversion accuracy, the data quality report is generated.
4. The updating method according to any one of claims 1 to 2, characterized in that: The calling of a data interface matching the task response system to obtain task data of the target task from the task response system includes: Acquire a task list of a target user; the task list includes the target tasks initiated by the target user; Determine the task response system to which each of the target tasks belongs; Based on the number of the task response systems, a plurality of the data interfaces are called to connect to each of the task response systems respectively, so as to obtain the task data of the target task from each of the task response systems.
5. The updating method according to any one of claims 1 to 2, characterized in that: If the report result of the data quality report is that the conversion is successful, identifying the data interface as a valid interface and creating a monitoring task for the target task includes: Based on the task identifier of the target task, create a monitoring item of the target task on a preset monitoring page; The standard data is parsed to determine the initial state of the target task, and the initial display mode of the monitoring item on the monitoring page is set according to the initial state.
6. The updating method according to claim 5, characterized in that: The updating of the task data of the target task through the effective interface and adjusting the task status of the monitoring task based on the updated task data includes: updating the task data of the target task through the effective interface, and determining the current state of the target task based on the updated task data; The current display mode of the monitoring item is adjusted based on the current state.
7. A data status updating device, characterized in that: include: A task data acquisition unit, used to call a data interface matching the task response system to acquire task data of a target task from the task response system; A standard data conversion unit, used for converting the task data into standard data based on the database type of the task response system; A data quality report generating unit, used for generating a data quality report on the data interface according to the standard data of each target task; A monitoring task creation unit, configured to identify the data interface as a valid interface and create a monitoring task for the target task if the report result of the data quality report is that the conversion is successful; A monitoring task updating unit, configured to update the task data of the target task through the effective interface, and adjust the task state of the monitoring task based on the updated task data; The data status updating device also includes: A system type identification unit, used to obtain the system type of the task response system and query the target compilation language associated with the system type; An associated statement correspondence establishing unit, configured to search the local compiled language library for associated statements of each compiled statement of the target compiled language, and to establish an associated statement correspondence according to the compiled statements and the associated statements; A data interface configuration unit is used to configure the data interface matching the task response system based on the corresponding relationship of the associated statements, so as to convert the task data of the task response system through the data interface.
8. A terminal device, characterized in that: The terminal device comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor executes the steps of the method according to any one of claims 1 to 6 when executing the computer program.
9. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Compiling system and method
CN101290581A
Heterogeneous data source standardized processing method and device and server
CN108038239A