Data determination method, device, equipment and computer storage medium

Abstract

The present application discloses a data determination method, apparatus, device, and computer storage medium. The data determination method includes: performing a data information query operation on a filter control table in response to a data query request sent by a user terminal; matching first data information with data information in the filter control table when data information is found in the filter control table; obtaining the correction data if correction data corresponding to the second data information is cached in a cache table when second data information matching the first data information exists in the filter control table; and generating feedback data for transmission to the user terminal based on the correction data. The method provided by the present application can obtain correction data from the cache table for queries on erroneous data during the correction processing of erroneous data batches, thereby preventing users from querying erroneous data during the correction processing of erroneous data batches.

Description

Technical Field

[0001] The present application relates to the field of data security technology, and in particular to a data determination method, apparatus, device, and computer storage medium. Background Art

[0002] When a business service platform provides business services (such as communication services) to users, a large amount of business data is generated. Among them, the business data generated by the business service platform may contain erroneous data, so it is necessary to batch process the erroneous data to update the erroneous data to the correct business data.

[0003] However, since batch processing of erroneous data takes a long time, during this period, the business service platform may receive data query requests initiated by users, which will cause the erroneous data requested by users to be displayed, which may easily cause users to complain due to seeing the displayed erroneous data, thereby causing a high complaint rate for the business service platform. Summary of the Invention

[0004] An embodiment of the present invention provides a data determination method to solve the technical problem of a high complaint rate of a business service platform caused by displaying erroneous data to users during batch erroneous data processing.

[0005] In a first aspect, an embodiment of the present invention provides a data determination method, the method comprising:

[0006] In response to a data query request sent by a user terminal, performing a data information query operation on a filtering control table, wherein the data query request is used to query business data corresponding to the first data information in the production table, and the filtering control table is used to record data information of erroneous data in the production table that is in batch data correction processing;

[0007] When it is found that the data information exists in the filtering control table, matching the first data information with the data information in the filtering control table;

[0008] When second data information matching the first data information exists in the filtering control table, if correction data corresponding to the second data information is cached in the cache table, acquiring the correction data, wherein the second data information is part or all of the first data information, and the cache table is used to: cache correction data corresponding to erroneous data for which correction processing has been completed in batch data correction processing;

[0009] generating feedback data for transmission to the user terminal based on the correction data;

[0010] If the correction data corresponding to the second data information is not cached in the cache table, service data is not sent to the user terminal.

[0011] In a second aspect, an embodiment of the present invention provides a data determination device, the device comprising:

[0012] a query module, configured to perform a data information query operation on a filter control table in response to a data query request sent by a user terminal, wherein the data query request is configured to query business data corresponding to the first data information in a production table, and the filter control table is configured to record data information of erroneous data in the production table that is in batch data correction processing;

[0013] A matching module, configured to match the first data information with the data information in the filtering control table when the data information exists in the filtering control table;

[0014] a first acquisition module configured to, if second data information matching the first data information exists in the filtering control table, acquire the corrected data if correction data corresponding to the second data information is cached in the cache table, wherein the second data information is part or all of the first data information, and the cache table is configured to cache, in batch data correction processing, correction data corresponding to erroneous data for which correction processing has been completed;

[0015] A generating module, configured to generate feedback data for sending to the user terminal based on the correction data;

[0016] If the correction data corresponding to the second data information is not cached in the cache table, service data is not sent to the user terminal.

[0017] In a third aspect, an embodiment of the present application provides an electronic device, the device comprising:

[0018] At least one processor, at least one memory and computer program instructions stored in the memory, which implement the above data determination method when the computer program instructions are executed by the processor.

[0019] In a fourth aspect, an embodiment of the present application provides a computer storage medium having computer program instructions stored thereon, and the computer program instructions implement the above-mentioned data determination method when executed by a processor.

[0020] Compared with the existing technology, this application has the following beneficial effects:

[0021] This application can create a cache table to cache the corrected data after the error data is corrected during the process of batch correction processing of error data by an electronic device. It can determine whether the business data requested by the user terminal is error data that is currently being corrected by filtering the control table. If the data requested is error data that is currently being corrected, the corrected data corresponding to the error data is obtained from the cache table and fed back to the user terminal. If the data requested is error data that has not yet been corrected, the business data is not sent to the user terminal. Therefore, during the batch correction processing of error data, the corrected data can be obtained from the cache table for access to the error data and fed back to the user terminal for display, solving the technical problem of high complaint rates on business service platforms caused by displaying error data to users.

[0022] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0024] Figure 1 This is a schematic diagram of a data determination process shown in an exemplary embodiment;

[0025] Figure 2 This is a schematic diagram of a data determination process shown in an exemplary embodiment;

[0026] Figure 3 This is a flow chart of a batch data correction process shown in an exemplary embodiment;

[0027] Figure 4 FIG. 1 is a schematic diagram of a data segment for requesting a query, shown in an exemplary embodiment;

[0028] Figure 5 This is a flowchart of a data query process shown in an exemplary embodiment.

[0029] Figure 6 is a structural diagram of a data determination device shown in an exemplary embodiment;

[0030] Figure 7 FIG. 1 is a schematic structural diagram of an electronic device according to an exemplary embodiment. DETAILED DESCRIPTION

[0031] The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is merely to provide a better understanding of the present application by illustrating the examples of the present application.

[0032] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, the elements defined by the phrase "comprising..." do not exclude the presence of other identical elements in the process, method, article, or device comprising the elements.

[0033] In order to solve the problems in the prior art, the embodiments of the present application provide a data determination method, apparatus, device, and computer storage medium. The data determination method provided by the embodiments of the present application is first introduced below.

[0034] like Figure 1 As shown, this embodiment provides a data determination method, which is applied to an electronic device, which may be a server, etc. The data determination method includes the following steps:

[0035] Step S101: In response to a data query request sent by a user terminal, a data information query operation is performed on a filter control table; the data query request is used to query business data corresponding to first data information in a production table, and the filter control table is used to record data information of erroneous data in the production table that is undergoing batch data correction processing;

[0036] Step S102: When the data information is found in the filter control table, the first data information is matched with the data information in the filter control table;

[0037] Step S103: If there is second data information matching the first data information in the filter control table, and if correction data corresponding to the second data information is cached in the cache table, then the correction data is acquired. The second data information is part or all of the first data information. The cache table is used to cache correction data corresponding to erroneous data that has been corrected during batch data correction processing.

[0038] Step S104: generating feedback data for sending to the user terminal based on the correction data;

[0039] If the correction data corresponding to the second data information is not cached in the cache table, the service data is not sent to the user terminal.

[0040] The specific implementation of each of the above steps will be described in detail below.

[0041] In the embodiment of the present application, during the process of batch data correction processing of erroneous data by an electronic device, a cache table is created to cache the corrected data after the erroneous data correction processing. By filtering the control table, it is determined whether the business data requested by the user terminal is erroneous data that is currently being corrected. If the data requested is erroneous data that is currently being corrected, the corrected data corresponding to the erroneous data is obtained through the cache table and fed back to the user terminal. If the data requested is erroneous data that has not yet been corrected, the business data is not sent to the user terminal. In this way, during the long period of batch erroneous data processing, the erroneous data can be avoided from being fed back to the user terminal for display, thereby effectively reducing the complaint rate of the business service platform.

[0042] The specific implementation methods of the above steps are introduced below.

[0043] In the above step S101, when the electronic device performs batch data correction processing on the production table, if the user terminal sends a data query request to the electronic device, the electronic device performs a data information query operation on the filter control table in response to the received data query request.

[0044] Among them, the above-mentioned data query request can be used to request to query the business data corresponding to the first data information in the production table. Specifically, the above-mentioned data query request can be a request carrying the above-mentioned first data information, and the first data information can be data information generated by the user terminal according to the user's operation.

[0045] For example, the first data information may be that when the user terminal receives a time period input by the user, the user terminal determines the time period as the first data information, and sends the first data information to the above-mentioned electronic device through a data query request.

[0046] In some embodiments, the user terminal may be a smart phone (Android phone, iOS phone, etc.), a tablet computer, a smart watch, a PDA, a mobile Internet device (MID), a computer, etc.

[0047] The electronic device performs a data information query operation on the filtering control table in response to a data query request received from a user terminal. Specifically, the electronic device obtains first data information carried in the data query request based on the data query request received from the user terminal, and queries the filtering control table for data information that matches the first data information. The data information may include: the name of the production table to which the data belongs, a data identifier, and a processing status of error data.

[0048] Here, obtaining the first data information carried in the data query request may involve the electronic device parsing the data query request to obtain the first data information. For example, if the data query request is an SQL statement, the electronic device may parse the SQL statement to obtain the data information carried in the data query instruction. The specific method for obtaining the business data information is known in the art and is not limited in this application. The method may be selected based on actual needs.

[0049] In addition, the filter control table can be used to record data information of erroneous data in the production table that is in the process of batch data correction. Batch data correction refers to the centralized correction of large amounts of erroneous data in business data.

[0050] For example, assuming that the production table includes business data generated in time period 1, and time period 1 includes time period 11, time period 12, ..., and time period 1N, N is an integer greater than 2, when the business data in time period 12 and time period 13 are erroneous data and are in batch data correction processing, the above-mentioned filter control table records time period 12 and time period 13.

[0051] Correction processing can be done by processing incorrect data in the production table and correcting it to correct data. For example, if the batch price of the user list data is incorrect, the correct data can be recalculated based on the correct user data. Alternatively, incorrect data can be replaced with correct data.

[0052] Optionally, in some embodiments, before step S101, the following steps may be further included:

[0053] When the production table is obtained, determine the erroneous data in the production table;

[0054] Record the data information of the erroneous data in the production table in the filter control table;

[0055] Perform batch data correction on the erroneous data corresponding to the data information recorded in the filter control table;

[0056] In the batch data correction process, the correction data corresponding to the erroneous data that has completed the correction process is cached in the cache table.

[0057] In the embodiment of the present application, erroneous data in the production table is first determined, data information of the erroneous data is obtained, and the data information of the erroneous data is recorded in the filter control table. Then, a cache table is created, and after batch data correction processing is started on the erroneous data, the corrected data corresponding to the erroneous data that has completed the correction processing is cached in the cache table. When a user terminal queries the erroneous data that is undergoing batch data correction processing, the corrected data can be obtained from the cache table and fed back to the user terminal.

[0058] In some embodiments, the determination of erroneous data in the production table may be done manually or by other technical means in the prior art for determining erroneous data, which is not limited in this application.

[0059] The cache table is used to cache correction data corresponding to erroneous data that has been corrected during batch data correction processing.

[0060] For example, assume that it is determined that the business data generated in time period 1 in the production table is erroneous data, and the erroneous data in time period 1 include erroneous data 11, erroneous data 12, ..., and erroneous data 1N, where N is an integer greater than 2; create a cache table, and start batch correction processing of the erroneous data in time period 1: perform correction processing on erroneous data 11 to generate corresponding correction data 11, store the correction data 11 in the cache table, and then continue to process erroneous data 12, ..., and erroneous data 1N, and continuously store the newly generated correction data in the cache table during the batch data correction processing.

[0061] Optionally, in some embodiments, after all erroneous data has been corrected, the data information of the erroneous data in the filter control table and the cache table may be deleted.

[0062] When there is erroneous data in multiple time periods that requires batch data correction processing, in order to implement batch data correction processing for the erroneous data in multiple time periods at the same time, in some embodiments, the batch data correction processing for the erroneous data corresponding to the data information recorded in the filter control table may include:

[0063] Determine that the data information recorded in the filter control table includes N time periods, where N is an integer greater than 1;

[0064] Data correction processing is performed on erroneous data in N time periods simultaneously through N processing threads.

[0065] In an embodiment of the present application, the data information recorded in the filter control table may include the time period for the storage of batch error data. When batch data correction processing is required for error data in N time periods, these N time periods are entered into the filter control table, and batch data correction processing can be performed simultaneously on the error data in the N time periods through N processing threads. Specifically, N corresponding cache tables are created for the error data in the N time periods, and batch data correction processing can be performed simultaneously on the error data in the N time periods. The corrected data obtained after the error data correction processing is cached in the cache table corresponding to the time period to which the error data belongs.

[0066] For example, assuming that the production table includes business data generated in time period 1, and time period 1 includes time period 11, time period 12, ..., and time period 1N, where N is an integer greater than 2, if time period 11 and time period 12 are recorded in the filter control table, corresponding cache table 11 and cache table 12 are created for the erroneous data in time period 11 and time period 12, respectively; batch data correction processing is performed on the erroneous data in time period 11 and time period 12; the corresponding corrected data after the correction processing is completed for the erroneous data in time period 11 is cached in cache table 11, and the corresponding corrected data after the correction processing is completed for the erroneous data in time period 12 is cached in cache table 12. The time period to which the erroneous data requiring batch data correction processing belongs can be determined based on the storage timestamp of the erroneous data.

[0067] Optionally, in some embodiments, after all erroneous data in a time period has been corrected, the data information of the time period in the filter control table and the fragment table corresponding to the time period are deleted.

[0068] In the above embodiment, the correction data of the erroneous data generated during the batch data correction process can be cached in the cache table, so that when the user terminal queries the erroneous data in the batch data correction process, the correction data can be obtained from the cache table and fed back to the user terminal.

[0069] Optionally, after performing the data information query operation on the filter control table in the above step S101, the following steps may also be included:

[0070] When it is found that there is no data information in the filter control table, or there is no data information matching the first data information in the filter control table, the business data corresponding to the first data information in the production table is used as feedback data.

[0071] In this embodiment of the present application, if the query finds that the data information does not exist in the filter control table, it means that there is no erroneous data in the production table, and therefore the requested data can be directly obtained from the production table. If the filter control table does not contain data information that matches the first data information, it means that there is no erroneous data in the business data requested for the query, and therefore the business data can also be directly obtained from the production table according to the query conditions.

[0072] In step S102, when it is found that the data information exists in the filter control table, the first data information is matched with the data information in the filter control table.

[0073] In an embodiment of the present application, if there is data information in the filter control table, it means that there is erroneous data in the production table. At this time, the first data information, that is, the data information of the business data requested for query, is matched with the data information in the filter control table. Through the matching of the data information, it can be determined whether there is erroneous data in the business data requested for query, and the data information of the erroneous data in the first data information can be determined.

[0074] For example, if the data in the filter control table for the error data currently being corrected is for time period 1, and the first data is for time period 2, then the business data being queried does not contain any error data currently being corrected. Therefore, the business data corresponding to the first data can be directly retrieved from the production table.

[0075] Optionally, in some embodiments, if the first data information is a target time period, the method may further include:

[0076] Check whether the target time period is within N time periods;

[0077] If at least part of the target time period is within the N time periods, it is determined that second data information matching the first data information exists in the filter control table, and the second data information includes: a first time period in the N time periods that overlaps with the target time period.

[0078] The first data information is the target time period, i.e., the time period to which the requested business data belongs. The second data information is the data information that matches the first data information in the filter control table. The first time period is the time period that overlaps with the target time period in the data information recorded in the filter control table when the first data information is the target time period.

[0079] In an embodiment of the present application, it is recorded in the filter control table that erroneous data in N time periods are being corrected in batch data. If the time period to which the first data information belongs overlaps with the N time periods recorded in the filter control table, it can be determined that there is second data information in the filter control table that matches the first data information, and the overlapping time period is the second data information.

[0080] For example, assuming that the filter control table records the time periods of erroneous data being corrected in batch data as 10:00-11:00 and 12:00-13:00, if the first data information is 10:30-12:30, then the first data information overlaps with the data information recorded in the filter control table, and the second data information is 10:30-11:00 and 12:00-12:30.

[0081] Optionally, in some embodiments, before the error data in a time period begins to be corrected, the processing status of the error data is recorded as being processed, and after all error data has been corrected, the status of the error data is recorded as processed. If the data processing status in the data information in the filter control table is "processing," the first data information is matched with the data information in the filter control table; if the data processing status in the data information in the filter control table is "processed," the first data information is not matched with the data information marked as being processed.

[0082] For example, suppose that the business data generated in time periods 11 and 12 in the production table is determined to be erroneous data. If the erroneous data in time period 11 is marked as processed in the filter control table, and the erroneous data in time period 12 is marked as being processed, then only the first data information is matched with time period 12.

[0083] In the above embodiment, the second data information can be determined by matching the first data information with the data information recorded in the filter control table.

[0084] In step S103, when there is second data information matching the first data information in the filter control table, if the cache table caches corrected data corresponding to the second data information, the corrected data is acquired, and the second data information is part or all of the first data information.

[0085] The second data information is part or all of the first data information. That is, the case where the second data information is part of the first data information means that only part of the business data requested for query is erroneous data in the batch correction process recorded in the filter control table. The case where the second data is all of the first data information means that all of the business data requested for query is erroneous data in the batch data correction process recorded in the filter control table.

[0086] For example, the data information recorded in the filter control table is that the time period of the erroneous data being corrected in batch data is 10:00-11:00. If the first data information is 10:30-10:50, then the second data information is 10:30-10:50:00, and the business data corresponding to the second data information is obtained from the cache table; if the first data information is 10:30-12:30, then the second data information is 10:30-11:00.

[0087] In an embodiment of the present application, the electronic device can determine, based on the second data information determined in step S102, whether correction data corresponding to the second data information is cached in the cache table, and then obtain the correction data. Specifically, the electronic device obtains the second data information by matching the first data information with the data information recorded in the filter control table, and determines, based on the second data information, whether correction data corresponding to the second data information exists in the cache table; if correction data corresponding to the second data information exists in the cache table, the correction data corresponding to the second data information is obtained from the cache table.

[0088] For example, assuming that the filter control table records that the time period to which the erroneous data being corrected in batch data belongs is 9:00-10:00, and during the processing, the corresponding cache table stores the correction data corresponding to the erroneous data within 9:00-9:30. If the second data information is 9:00-9:10, the correction data within 9:00-9:10 is obtained from the cache table.

[0089] In step S104, feedback data for sending to the user terminal is generated based on the correction data; if the correction data corresponding to the second data information is not cached in the cache table, the service data is not sent to the user terminal.

[0090] Herein, based on the correction data, feedback data for sending to the user terminal is generated, that is, the electronic device generates feedback data sent to the user terminal according to the correction data obtained in step S103, and the user terminal displays the feedback data after receiving the feedback data.

[0091] In some embodiments, if the corrected data corresponding to the second data information is not cached in the cache table, it means that the business data corresponding to the second data information requested to be accessed is erroneous data that has not been corrected. At this time, the business data corresponding to the second data information will not be sent to the user terminal.

[0092] For example, assuming that the filtering control table records that the time period to which the erroneous data being corrected in batch data belongs is 9:00-10:00, and during the processing, the corresponding cache table stores the correction data corresponding to the erroneous data between 9:00-9:30. If the second data information is 9:40-9:50, and the cache table does not cache the correction data corresponding to 9:40-9:50, the business data corresponding to the second data information will not be fed back to the user terminal.

[0093] In some embodiments, when the second data information is all data information of the first data information, correction data corresponding to the second data information is directly obtained from the cache table, and feedback data is generated according to the obtained correction data.

[0094] In some embodiments, when the second data information is part of the first data information, correction data corresponding to the second data information is obtained from the cache table, and business data corresponding to other data information in the first data information except the second data information is obtained from the production table, and the obtained correction data and business data are merged to generate feedback data.

[0095] Optionally, the first time period is a partial time period of the target time period within the N time periods, and the correction data includes the business data in the cache table that is in the first time period;

[0096] After matching the first data information with the data information in the filter control table, the method may further include:

[0097] Acquire business data in a second time period in the production table, wherein the second time period is a time period in the target time period excluding the first time period;

[0098] Based on the correction data, feedback data for sending to the user terminal is generated, including: combining the correction data and the service data in the second time period to form the feedback data for sending to the user terminal.

[0099] In an embodiment of the present application, when the first time period is a partial time period of the target time period within N time periods, and the correction data includes the business data in the cache table located in the first time period, the correction data located in the first time period is obtained from the cache table, and the business data located in the second time period is obtained from the production table, and then the correction data and the business data located in the second time period are merged to generate feedback data for sending to the user terminal.

[0100] The first time period is the target time period that is part of the N time periods, which refers to the time period where the time period of the business data requested for query overlaps with the N time periods recorded in the filter control table. The second time period is the time period other than the first time period in the target time period, which refers to the time period of the business data requested for query that does not overlap with the N time periods recorded in the filter control table.

[0101] For example, assuming that the filtering control table records that the time periods of the erroneous data being corrected in batch data are 10:00-11:00 and 12:00-13:00, if the target time period (i.e., the first data information) is 10:30-12:30, then the target time period overlaps with the data information recorded in the filtering control table, and the first time period (i.e., the second data information) is 10:30-11:00 and 12:00-12:30; the second time period is 11:00-12:00, then the correction data corresponding to 10:30-11:00 and 12:00-12:30 is obtained from the cache table, and the business data corresponding to 11:00-12:00 is obtained from the production table, and then the correction data and the business data are merged to generate feedback data for sending to the user terminal.

[0102] In this embodiment, when the electronic device receives a query request sent by a user terminal that contains both erroneous data that is undergoing batch data correction processing and business data that does not require batch data correction processing, it obtains the corrected data of the erroneous data after correction processing from the cache table, and obtains the business data that does not require batch data correction processing from the production table, thereby filtering out the erroneous data and only feeding back the correct data to the user terminal.

[0103] The above is a specific implementation of the data determination method provided in the embodiment of the present application. During the process of batch data correction processing of erroneous data by an electronic device, a cache table can be created to cache the corrected data after the erroneous data correction processing. By filtering the control table, it is determined whether the service data requested by the user terminal is erroneous data being corrected. If the requested data is erroneous data being corrected, the corrected data is obtained through the cache table and fed back to the user terminal. This avoids feeding back erroneous data to the user terminal during the long period of batch erroneous data processing.

[0104] Furthermore, during the batch data correction process, the corrected data corresponding to the erroneous data that has been corrected is continuously cached in the cache table until the erroneous data is processed. This allows the user terminal to obtain continuously updated feedback data during multiple service data queries. Therefore, the technical solution of this application can also monitor the processing of erroneous data in real time.

[0105] For ease of understanding, the following description is made using an example where N is equal to 1.

[0106] In some embodiments, as Figure 2 As shown, taking N=1 as an example, that is, when the error data to be processed is data within a time period, the technical solution of this application can be implemented by the following steps:

[0107] Step 21. When the problem data processing starts, the data processing program inserts a control information into the filter control table to identify a certain interval segment of data in a certain type of original production table (identified by the storage timestamp) as erroneous data, which needs to be processed in batches (that is, the data information of the erroneous data in the production table is recorded in the filter control table). During this period, the query of related data points to the fragment table (that is, for the request to query the data that is being processed in batches, the processed corrected data is obtained from the cache table). After the batch data processing is completed, the corresponding record in the filter control table is modified to be processed completed, and the query display program is notified that no filtering control is required (that is, if there is no data information matching the first data information in the filter control table, the business data corresponding to the first data information in the production table is used as feedback data).

[0108] Step 22: The problem data processing program starts to delete the problem data in the original production table, generates new correct data, and writes it into the original production table (ie, corrects the erroneous data).

[0109] Step 23: Write the newly generated correct data into the fragment table (ie, in the batch data correction process, the corrected data corresponding to the erroneous data that has completed the correction process is cached in the cache table).

[0110] Step 24: After receiving the front-end user request, the query display program first checks whether the interval covered by the user-related request data falls within the time segment in the filter control table (i.e., in response to the data query request sent by the user terminal, performs a data information query operation on the filter control table).

[0111] Step 25: If the interval covered by the user-related request data falls outside the time period in the filter control table, directly query the production table and return (that is, if there is no data information matching the first data information in the filter control table, the business data corresponding to the first data information in the production table is used as feedback data).

[0112] Step 26. If the intervals covered by the user-related request data all fall within the time segments in the filter control table, directly query the fragment table and return (that is, if there is second data information matching the first data information in the filter control table, if the cache table has corrected data corresponding to the second data information, then obtain the corrected data).

[0113] Step 27. If the interval covered by the user-related request data spans the time period in the filter control table, the user's query needs to be divided into two parts: the query fragment table within the filter interval and the query original production table outside the filter interval, and the two query result sets are merged and returned to the user (i.e., the business data in the cache table located in the first time period and the business data in the production table located in the second time period are obtained, and the correction data and the business data located in the second time period are merged to form feedback data for sending to the user terminal).

[0114] When N adopts other values, the same implementation method is adopted as when N is equal to 1, and for the sake of brevity, it is not elaborated here.

[0115] In some embodiments, the specific error data processing process can be implemented by an error data processing program. The error data processing program mainly inserts a filter control record into the filter control table when starting batch data correction processing, initializes the fragment table (i.e., cache table), and inserts the new correction data into the production table and the fragment table. After the batch data correction processing is completed, the corresponding record status identifier of the filter control table is changed.

[0116] The filter control table, production table, and fragment table are designed according to actual conditions. This application can be applied to static data tables similar to call record storage. For example, a relational database table is shown in Table 1 and Table 2. Table 1 is the filter control database table, and Table 2 is the information structure of the production table and fragment table:

[0117]

[0118] Table 1

[0119]

[0120]

[0121] Table 2

[0122] In some embodiments, the batch data correction process is as follows Figure 3 As shown, the following steps may be included:

[0123] Step 31: Read the configuration information to obtain the production table information to be processed and the data information of the problem data to be processed (ie, when the production table is obtained, determine the erroneous data in the production table).

[0124] Step 32: insert control information into the filter control table to identify the data in the production table that needs to be queried in the fragment table (i.e., enter the data information of the problem data into the filter control table), and at the same time set the status of the control information to 1, indicating that the problem data is being processed.

[0125] Step 33: Store the correct information into the production table and the fragment table, and delete the erroneous information in the production table (i.e., perform batch data correction on the erroneous data corresponding to the data information recorded in the filter control table, and cache the corrected data corresponding to the erroneous data that has completed the correction in the cache table).

[0126] Step 34: Determine whether the problem data has been processed. If the problem data has not been processed, return to step 3; if the problem data has been processed, go to step 35.

[0127] Step 35: Change the status of the filter control table to 0, indicating that the problem data has been processed.

[0128] In some embodiments, the specific query and display process of data can be implemented by a query display program. After receiving the user's query request, the query display program checks whether the interval covered by the user's relevant request data falls within the time segment in the filter control table. If all are within the interval, the fragment table is directly queried for return. If they are outside the interval, the production table is directly queried for return. If they span the interval, such as Figure 4 As shown, the user's query needs to be divided into two parts: the query fragment table within the filtered interval, and the query original production table outside the filtered interval, and the two query result sets are merged and returned to the user. That is, the user's query needs to be divided into two parts, the upper half queries the production table, and the lower half queries the fragment table.

[0129] In some embodiments, the specific query display process is as follows: Figure 5 As shown, the following steps may be included:

[0130] Step 51: After receiving the query request, check whether the filter control table has filter control information with a status of 1 (i.e., in response to the data query request sent by the user terminal, perform a data information query operation on the filter control table); if not, directly query the production table information according to the conditions and return the query results to the front desk; if so, go to step 52.

[0131] Step 52, determine whether the foreground query data is all within the filter range (that is, perform a data information query operation on the filter control table); if so, directly query the data in the fragment table and return the result (if there is second data information matching the first data information in the filter control table, if the cache table has corrected data corresponding to the second data information, then obtain the corrected data); if not, go to step 53.

[0132] Step 53, determine whether the front-end query data is all outside the filter interval (that is, perform a data information query operation on the filter control table); if so, directly query the production table information and return the query result to the front-end (that is, when there is no data information matching the first data information in the filter control table, the business data corresponding to the first data information in the production table is used as feedback data); if not, divide the user's query into two parts, the query fragment table within the filter interval segment, and the query original production table outside the filter interval segment, and merge the two query result sets and return them to the user (that is, merge the correction data corresponding to the first time period and the business data in the second time period to form feedback data for sending to the user terminal).

[0133] Based on the data determination method provided in the above embodiment, the present application also provides a specific implementation of a data determination device. Please refer to the following embodiment.

[0134] See Figure 6 , is a data determination device provided in an embodiment of the present application, such as Figure 6 As shown, the device includes:

[0135] A query module 601 is configured to perform a data information query operation on a filter control table in response to a data query request sent by a user terminal, wherein the data query request is configured to query business data corresponding to the first data information in a production table, and the filter control table is configured to record data information of erroneous data in the production table that is undergoing batch data correction processing;

[0136] A matching module 602 is configured to match the first data information with the data information in the filtering control table when the data information is found in the filtering control table;

[0137] A first acquisition module 603 is configured to acquire the corrected data if, when second data information matching the first data information exists in the filter control table, the second data information is cached in the cache table. The second data information is part or all of the first data information. The cache table is configured to cache corrected data corresponding to erroneous data for which correction processing has been completed during batch data correction processing.

[0138] A generating module 604 is configured to generate feedback data for transmission to a user terminal based on the correction data;

[0139] If the correction data corresponding to the second data information is not cached in the cache table, the service data is not sent to the user terminal.

[0140] The data determination device provided in the embodiment of the present application can, during the process of performing batch data correction processing on erroneous data, create a cache table to cache the corrected data after the erroneous data correction processing. By filtering the control table, it is determined whether the business data requested by the user terminal is erroneous data currently being corrected. If the data requested is erroneous data currently being corrected, the corrected data corresponding to the erroneous data is obtained from the cache table and fed back to the user terminal. If the data requested is erroneous data that has not yet been corrected, the business data is not sent to the user terminal. Therefore, during the batch correction processing of erroneous data, access to the erroneous data can obtain the corrected data from the cache table and feed it back to the user terminal for display, solving the technical problem of high complaint rates on business service platforms caused by displaying erroneous data to users.

[0141] Optionally, in response to the data query request sent by the user terminal, the above apparatus may further include:

[0142] A determination module is used to determine the erroneous data in the production table when the production table is obtained;

[0143] A control module, used for recording data information of erroneous data in the production table in a filtering control table;

[0144] A correction module is used to perform batch data correction processing on the erroneous data corresponding to the data information recorded in the filter control table;

[0145] The cache module is used to cache the correction data corresponding to the erroneous data that has completed the correction process in the cache table during the batch data correction process.

[0146] The above device can store the correction data of the erroneous data generated during the batch data correction process in the cache table, so that when the user terminal queries the erroneous data being corrected in the batch data correction process, the correction data can be obtained from the cache table and fed back to the user terminal.

[0147] Optionally, the correction module may include:

[0148] a determining unit, configured to determine that the data information recorded in the filtering control table includes N time periods, where N is an integer greater than 1;

[0149] The correction subunit is used to perform data correction processing on erroneous data in N time periods simultaneously through N processing threads.

[0150] The above device can realize batch data correction processing for erroneous data in multiple time periods at the same time.

[0151] Optionally, the first data information is a target time period; and the apparatus further includes:

[0152] A judgment module is used to query whether the target time period is within N time periods;

[0153] The matching result determination module is used to determine whether there is second data information matching the first data information in the filtering control table if at least part of the target time period is in N time periods. The second data information includes: the first time period in the N time periods that coincides with the target time period.

[0154] The above device can determine that the service data requested for query matches the data information in the filter control table when the filter control table records data information of erroneous data in batch data correction processing for N time periods.

[0155] Optionally, the first time period is a partial time period of the target time period within the N time periods, and the correction data includes the service data in the cache table that is in the first time period. The above apparatus may further include:

[0156] A second acquisition module is used to acquire business data in a second time period in the production table, wherein the second time period is a time period in the target time period excluding the first time period;

[0157] The generating module 604 is specifically configured to generate feedback data for transmission to the user terminal based on the correction data, including:

[0158] The correction data is combined with the service data in the second time period to form feedback data for sending to the user terminal.

[0159] The above-mentioned device can obtain the correction data corresponding to the erroneous data from the cache table and obtain other data from the production table when the queried business data includes both erroneous data in the batch data correction processing and other business data other than the erroneous data in the batch data correction processing, thereby filtering the erroneous data and displaying only correct data on the user terminal.

[0160] Optionally, the above-mentioned generation module 604 can also be used for: after performing a data information query operation on the filter control table, if it is found that there is no data information in the filter control table, or there is no data information matching the first data information in the filter control table, the business data corresponding to the first data information in the production table is used as feedback data.

[0161] It should be noted that the data determination device is a device corresponding to the above-mentioned data determination method. All implementation methods in the above-mentioned method embodiments are applicable to the embodiments of the device and can achieve the same technical effects.

[0162] Figure 7A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application is shown.

[0163] The electronic device may include a processor 701 and a memory 702 storing computer program instructions.

[0164] Specifically, the processor 701 may include a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0165] The memory 702 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 702 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive, or a combination of two or more of these. Where appropriate, the memory 702 may include removable or non-removable (or fixed) media. Where appropriate, the memory 702 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, the memory 702 is a non-volatile solid-state memory.

[0166] The memory may include read-only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical or other physical / tangible memory storage devices. Thus, generally, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the methods according to the present disclosure.

[0167] The processor 701 implements any one of the data determination methods in the above embodiments by reading and executing computer program instructions stored in the memory 702 .

[0168] In one example, the electronic device may further include a communication interface 703 and a bus 704. Figure 7 As shown, the processor 701 , the memory 702 , and the communication interface 703 are connected via a bus 704 and communicate with each other.

[0169] The communication interface 703 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.

[0170] Bus 704 includes hardware, software or both, and the parts of online data flow metering equipment are coupled to each other. For example, but not limitation, bus can include accelerated graphics port (AGP) or other graphics bus, enhanced industry standard architecture (EISA) bus, front side bus (FSB), hypertransport (HT) interconnection, industry standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 704 can include one or more buses. Although the present application embodiment describes and shows specific bus, the application considers any suitable bus or interconnection.

[0171] In addition, in conjunction with the data determination method in the above embodiments, embodiments of the present application may provide a computer storage medium for implementation. The computer storage medium stores computer program instructions; when the computer program instructions are executed by a processor, any one of the data determination methods in the above embodiments is implemented.

[0172] It should be understood that the present application is not limited to the specific configurations and processes described above and illustrated in the figures. For the sake of brevity, a detailed description of known methods is omitted here. In the above embodiments, several specific steps are described and illustrated as examples. However, the method process of the present application is not limited to the specific steps described and illustrated. Those skilled in the art can make various changes, modifications, and additions, or change the order of the steps after understanding the spirit of the present application.

[0173] The functional blocks shown in the above block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, they can be, for example, electronic circuits, application specific integrated circuits (ASICs), appropriate firmware, plug-ins, function cards, etc. When implemented in software, the elements of the present application are programs or code segments that are used to perform the required tasks. Programs or code segments can be stored in machine-readable media, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable media" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROMs, flash memories, erasable ROMs (EROMs), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. The code segments can be downloaded via computer networks such as the Internet, intranets, etc.

[0174] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, this application is not limited to the order of the above steps. In other words, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.

[0175] Aspects of the present disclosure have been described above with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable data processing device to produce a machine so that these instructions executed by the processor of the computer or other programmable data processing device enable the implementation of the function / action specified in one or more boxes of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor or a field programmable logic circuit. It is also understood that each box in the block diagram and / or flowchart and the combination of the boxes in the block diagram and / or flowchart can also be implemented by dedicated hardware that performs the specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions.

[0176] The above is only a specific implementation method of the present application. Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the scope of protection of the present application is not limited to this. Any technician familiar with this technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the scope of protection of this application.

Claims

1. A data determination method, characterized in that: The method comprises: In response to a data query request sent by a user terminal, performing a data information query operation on a filtering control table, wherein the data query request is used to query business data corresponding to the first data information in the production table, and the filtering control table is used to record data information of erroneous data in the production table that is in batch data correction processing; When it is found that the data information exists in the filtering control table, matching the first data information with the data information in the filtering control table; When second data information matching the first data information exists in the filtering control table, if correction data corresponding to the second data information is cached in the cache table, acquiring the correction data, wherein the second data information is part or all of the first data information, and the cache table is used to: cache correction data corresponding to erroneous data for which correction processing has been completed in batch data correction processing; generating feedback data for transmission to the user terminal based on the correction data; If the correction data corresponding to the second data information is not cached in the cache table, service data is not sent to the user terminal.

2. The method according to claim 1, characterized in that Before performing a data information query operation on the filtering control table in response to the data query request sent by the user terminal, the method further includes: When the production table is obtained, determining erroneous data in the production table; Recording data information of erroneous data in the production table in the filtering control table; Performing batch data correction processing on erroneous data corresponding to the data information recorded in the filtering control table; In the batch data correction process, the correction data corresponding to the erroneous data that has completed the correction process is cached in the cache table.

3. The method according to claim 2, characterized in that The performing batch data correction processing on the erroneous data corresponding to the data information recorded in the filtering control table includes: Determining that the data information recorded in the filtering control table includes N time periods, where N is an integer greater than 1; Data correction processing is performed on the erroneous data in the N time periods simultaneously through N processing threads.

4. The method according to claim 3, characterized in that The first data information is a target time period; In the case where second data information matching the first data information exists in the filtering control table, if corrected data corresponding to the second data information is cached in the cache table, before obtaining the corrected data, the method further includes: Query whether the target time period is within the N time periods; If at least part of the target time period is within the N time periods, it is determined that there is second data information matching the first data information in the filtering control table, and the second data information includes: the first time period in the N time periods that coincides with the target time period.

5. The method according to claim 4, characterized in that The first time period is a partial time period of the target time period within the N time periods, and the correction data includes the business data in the cache table that is within the first time period; After matching the first data information with the data information in the filtering control table, the method further includes: Acquire business data in a second time period in the production table, wherein the second time period is a time period in the target time period excluding the first time period; The generating, based on the correction data, feedback data for sending to the user terminal includes: The correction data is combined with the service data in the second time period to form feedback data for sending to the user terminal.

6. The method according to claim 1, characterized in that After performing the data information query operation on the filter control table, the method further includes: When it is found that no data information exists in the filter control table, or that no data information matching the first data information exists in the filter control table, the business data corresponding to the first data information in the production table is used as the feedback data.

7. A data determination device, characterized in that: The device comprises: a query module, configured to perform a data information query operation on a filter control table in response to a data query request sent by a user terminal, wherein the data query request is configured to query business data corresponding to the first data information in a production table, and the filter control table is configured to record data information of erroneous data in the production table that is in batch data correction processing; A matching module, configured to match the first data information with the data information in the filtering control table when the data information exists in the filtering control table; a first acquisition module configured to, if second data information matching the first data information exists in the filtering control table, acquire the corrected data if correction data corresponding to the second data information is cached in a cache table, wherein the second data information is part or all of the first data information, and the cache table is configured to cache, in batch data correction processing, correction data corresponding to erroneous data for which correction processing has been completed; A generating module, configured to generate feedback data for sending to the user terminal based on the correction data; If the correction data corresponding to the second data information is not cached in the cache table, service data is not sent to the user terminal.

8. The device according to claim 7, characterized in that The device further comprises: a determination module, configured to determine erroneous data in the production table when the production table is obtained; A control module, configured to record data information of erroneous data in the production table in the filtering control table; A correction module, configured to perform batch data correction processing on erroneous data corresponding to the data information recorded in the filtering control table; In the batch data correction process, the correction data corresponding to the erroneous data that has completed the correction process is cached in the cache table.

9. The device according to claim 8, characterized in that The correction module includes: a determining unit, configured to determine that the data information recorded in the filtering control table includes N time periods, wherein N is an integer greater than 1; The correction unit is used to perform data correction processing on the erroneous data in the N time periods simultaneously through N processing threads.

10. The device according to claim 9, characterized in that The first data information is a target time period; The device further comprises: A judgment module, configured to query whether the target time period is within the N time periods; A matching result determination module is used to determine whether there is second data information matching the first data information in the filtering control table if at least part of the target time period is within the N time periods, and the second data information includes: a first time period in the N time periods that coincides with the target time period.

11. The device according to claim 10, characterized in that The first time period is a partial time period of the target time period within the N time periods, and the correction data includes the business data in the cache table that is within the first time period; The device further comprises: A second acquisition module is configured to acquire business data in a second time period in the production table, wherein the second time period is a time period in the target time period excluding the first time period; The generation module is specifically used to: The correction data is combined with the service data in the second time period to form feedback data for sending to the user terminal.

12. The device according to claim 7, characterized in that The device further comprises: When it is found that no data information exists in the filter control table, or that no data information matching the first data information exists in the filter control table, the business data corresponding to the first data information in the production table is used as the feedback data.

13. A data determination device, characterized in that: include: At least one processor, at least one memory, and computer program instructions stored in the memory, which implement the method according to any one of claims 1 to 6 when the computer program instructions are executed by the processor.

14. A computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Images