Time association data table processing method and device, computer equipment and readable storage medium

By sliding the window on the time data column and filtering business data, the problem of difficult to deal with a large amount of time-related business data in the existing technology is solved, and flexible screening of time and data dimensions is realized, and the operation status of business data is determined, which is convenient for the Analysis and backtracking.

CN118917286APending Publication Date: 2024-11-08SUZHOU HUAXING YUANCHUANG TECH CO LTD

Patent Information

Application Number
CN202411079771.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-07
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

The prior art is difficult to effectively screen and process a large amount of time-related business data, especially after the sensor accuracy is improved, resulting in large amounts of data and it is difficult to achieve multi-dimensional screening of time-related business data.

Method used

By sliding the window on the time data column, the corresponding business data collection is obtained and filtered according to the time and data filtering conditions to determine the status monitoring results of the business data, including the identification of stable and abnormal segments.

Benefits of technology

It realizes flexible multi-dimensional screening of time-related business data, can determine the operating status of business data in a specific time period, facilitates business personnel to backtrack and analyze, and improves the efficiency and accuracy of data processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118917286A_ABST
    Figure CN118917286A_ABST
Patent Text Reader

Abstract

The invention relates to a time association data table processing method and device, computer equipment, a computer readable storage medium and a computer program product. The method comprises the steps of obtaining time data columns arranged according to a time sequence from a to-be-processed data table, wherein the to-be-processed data table comprises business data corresponding to the time data columns; a sliding window determined according to the time screening condition slides on the time data column, service data corresponding to time data covered by the position where the sliding window is located is obtained, service data sets are obtained, and the position of one sliding window corresponds to one service data set; taking the business data set with the business data meeting the data screening condition as a target business data set; and determining a state monitoring result of the business data based on the time data corresponding to the target business data set. By adopting the method, multi-dimensional screening of the time-associated service data can be realized.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of data analysis, and in particular to a method, apparatus, computer equipment, computer-readable storage medium and computer program product for processing a time-related data table. Background Art

[0002] In the industrial production process, there are often scenarios where sensors are required to collect business data. For example, in some scenarios, sensors are placed near the chip to determine whether the chip reads the data accurately by comparing the business data read by the chip with the business data collected by the sensor. In other scenarios, the business data collected by the sensor is used to determine whether the environmental parameters meet the control requirements.

[0003] Business data usually changes over time, so it is often necessary to filter business data based on time conditions. At present, the relevant technology mainly uses Excel software to filter business data. However, due to the increasing accuracy of sensors, the amount of data that needs to be processed each time the business data is filtered is large, and the relevant technology is difficult to achieve conditional filtering of time-related business data. Summary of the invention

[0004] Based on this, it is necessary to provide a method, device, computer equipment, computer-readable storage medium and computer program product for processing time-related data tables that can realize multi-dimensional screening of time-related business data in response to the above technical problems.

[0005] In a first aspect, the present application provides a method for processing a time-related data table, comprising:

[0006] Acquire a time data column arranged in time sequence from a data table to be processed, wherein the data table to be processed includes business data corresponding to the time data column;

[0007] Determine the screening conditions of the data table to be processed, wherein the screening conditions include a time screening condition and a data screening condition;

[0008] By sliding a sliding window determined according to the time screening condition on the time data column, business data corresponding to the time data covered by the position of the sliding window are respectively obtained to obtain a business data set, wherein one sliding window position corresponds to one business data set;

[0009] The business data set that satisfies the data screening condition is set as a target business data set;

[0010] The status monitoring result of the business data is determined based on the time data corresponding to the target business data set.

[0011] In one of the embodiments, determining the status monitoring result of the business data based on the time data corresponding to the target business data set includes:

[0012] Determine, according to the time data corresponding to the target business data set, a continuous time segment in which the business data meets the screening condition;

[0013] The continuous time segments of the time data belonging to the determined stable change interval are output as stable interval results.

[0014] In one embodiment, determining the continuous time segment in which the business data meets the screening condition according to the time data corresponding to the target business data set includes:

[0015] Merging the time data corresponding to the target business data set to obtain a time data set;

[0016] Deduplication processing is performed on the time data set to obtain a target time data set;

[0017] A continuous time segment is determined based on the first time data and the last time data in the target time data set.

[0018] In one embodiment, a column of business data in the to-be-processed data table corresponds to a device that collects the business data, and determining the state monitoring result of the business data based on the time data corresponding to the target business data set includes:

[0019] Determine, according to the time data corresponding to the target business data set, abnormal time information that the business data does not meet the screening condition;

[0020] The abnormal device information of the service data collected in the to-be-processed data table is determined according to the abnormal time information.

[0021] In one embodiment, the data screening condition includes at least one of the following:

[0022] The range of the business data of a single column in the business data set is less than a preset first threshold;

[0023] The deviation value between the business data of a single column in the business data set and the preset target value is less than a preset second threshold value;

[0024] The range of all the business data in the business data set is less than a preset third threshold.

[0025] In one of the embodiments, the time accuracy of the time data includes no less than at least one of the following: millisecond level, microsecond level or nanosecond level.

[0026] In one embodiment, the business data includes temperature data, and / or the data table to be processed includes an Excel table.

[0027] In a second aspect, the present application further provides a device for processing a time-related data table, comprising:

[0028] A data acquisition module, used to acquire a time data column arranged in time sequence from a data table to be processed, wherein the data table to be processed includes business data corresponding to the time data column;

[0029] A screening condition determination module, used to determine the screening conditions of the to-be-processed data table, wherein the screening conditions include a time screening condition and a data screening condition;

[0030] A time screening module, configured to slide a sliding window determined according to the time screening condition on the time data column, respectively obtain business data corresponding to the time data covered by the position of the sliding window, and obtain a business data set, wherein one sliding window position corresponds to one business data set;

[0031] A data screening module, used for collecting the business data satisfying the data screening condition as a target business data set;

[0032] A result analysis module is used to determine the status monitoring result of the business data based on the time data corresponding to the target business data set.

[0033] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the steps of any of the above-described methods when executing the computer program.

[0034] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of any of the methods described above when executed by a processor.

[0035] In a fifth aspect, the present application also provides a computer program product, including a computer program, which implements the steps of any of the methods described above when executed by a processor.

[0036] The above-mentioned processing method, device, computer equipment, computer-readable storage medium and computer program product of the time-related data table obtain the time data column in the data table to be processed, slide the sliding window on the time data column, obtain the corresponding business data from the data table to be processed according to the time data in the sliding window, and obtain multiple groups of business data sets of time window interval segments, which can flexibly filter out business data in different time segments; by further filtering the business data set according to the data characteristics of the business data, it is possible to filter out business data that meets the data dimension conditions from business data that meets the time dimension conditions. Since the business data is associated with the business time dimension, the running status of the business in a specific time period can be determined according to the filtered business data. According to the time data corresponding to the filtered business data, the time when the business is in a specific running state can be determined, and then the state of the object corresponding to the business data can be determined, which is convenient for business personnel to trace back and analyze. Furthermore, according to the time data corresponding to the filtered business data, the time when the business is in a specific running state can be determined, which is convenient for business personnel to trace back and analyze. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0038] Figure 1 A schematic diagram of a process flow of processing a time-related data table in one embodiment;

[0039] Figure 2 is a flow chart of step S110 in one embodiment;

[0040] Figure 3 is a schematic flow chart of step A1 in one embodiment;

[0041] Figure 4 is a flow chart of step S110 in another embodiment;

[0042] Figure 5 is a structural block diagram of a device for processing a time-related data table in one embodiment;

[0043] Figure 6 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0044] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0045] At present, many data are collected continuously or intermittently through various sensor devices, and then stored in Excel tables in the order of the collected time to form time-related data tables, which can be used for subsequent data processing. In many business scenarios of data collection, the amount of data in the acquired time-related data table is usually large. For example, the time-related data table to be processed may include more than one million rows of business data. It is impossible to open a data table with a large amount of data using Excel software, such as data with more than 65,536 rows, and it is also impossible to analyze the operating status of the business based on the data in the data table. Among them, the business can be monitoring using sensors, adjusting environmental parameters such as temperature, humidity, pressure, and light of the equipment, or a certain process in the production process. Based on the current data processing requirements of computer equipment in the industry for time-related tables, the present disclosure provides a method for processing time-related data tables.

[0046] It should be noted that the embodiments provided by the present disclosure are not limited to data processing for Excel scenarios, and data processing of other time-related tables can also perform the embodiments of the present disclosure. Figure 1 As shown, a method for processing a time-related data table is provided. This embodiment uses the method applied to a server as an example for illustration. It can be understood that the method can also be applied to a terminal, and can also be applied to a system including a terminal and a server, and is implemented through the interaction between the terminal and the server. In this embodiment, the method includes the following steps:

[0047] Step S102, obtaining a time data column arranged in time sequence from a data table to be processed, wherein the data table to be processed includes business data corresponding to the time data column.

[0048] Specifically, the data table to be processed may include a time data column and a business data column, and the time data and business data in the same row usually correspond to each other. The time data can be used to characterize the collection time of the corresponding business data. Among them, the time data in the time data column can be arranged in time sequence, such as in the time sequence of the collected data. The time accuracy of the time data can be in microseconds. The business data column can be multiple columns, and the business data in different business data columns can be collected by different devices. In some implementation scenarios, different devices can be located at different positions of the same device, or they can be located in different devices, or they can be implementation scenarios of the same or different devices collected by the same device.

[0049] The data table to be processed can be obtained in a variety of ways, such as directly transmitting and storing the collected data in a data table in a server, or reading data from a database or other system to obtain a data table to be processed. Exemplarily, a data processing tool can be called to read the time data column in the data table to be processed. Here, the data processing tool can be an extension library Pandas of the Python language. In practical applications, time data can be composed of date data and time point data, and a date data column and a time point data column arranged in time sequence are formed in the data table to be processed. At this time, after reading out the date data column and the time point data column, the date data column and the time point data column can be merged into one column, and the merged date data and time point data are formatted according to a preset time format conversion method to obtain a pre-processed time data column.

[0050] Step S104, determining the screening conditions of the data table to be processed, the screening conditions including time screening conditions and data screening conditions.

[0051] Among them, the screening conditions can be determined according to the data processing requirements of the business. In some embodiments of the present disclosure, the screening conditions may include time screening conditions in the time dimension and data screening conditions for specific business data screening in terms of data content. Some implementation scenarios may also determine the screening conditions according to different operating states of the target, such as whether the data acquisition device for the business data is in a newly started operating state or in a stable monitoring state. For example, the screening condition may be that the business data is zero and lasts for a certain period of time, or whether the monitoring business data fluctuates within a certain period of time and exceeds a set threshold. In some application scenarios of the present disclosure, when the target operating state is to control the stability of the environmental parameters of the equipment, the screening condition may be that the fluctuation of the business data is within a preset range and lasts for a certain period of time.

[0052] Exemplarily, the time screening conditions may include a start time, an end time, a time span, a periodicity condition, etc. The data screening conditions may include a value range, whether it is missing, a statistical feature range, etc.

[0053] Step S106, sliding the sliding window determined according to the time screening condition on the time data column, respectively obtaining the business data corresponding to the time data covered by the position of the sliding window, and obtaining a business data set, wherein one sliding window position corresponds to one business data set.

[0054] Exemplarily, the initial position of the sliding window can be set to point to the first time data in the time data column, and the end position can be set to point to the last time data in the time data column, that is, it can start from the first time data in the time data sequence and slide to the last time data in the time data sequence. At present, in other implementations, it is also possible to set a sliding window to filter data for one or more interval segments in the time data sequence. The size of the sliding window can be set so that the time data covered by the sliding window at each position meets the time filtering condition. When the sliding window slides, it can slide with a behavior as the sliding step, or it can slide the window with time as the sliding step. When using time as the sliding step, the step size of the sliding window is usually not greater than the size of the sliding window, so that the sliding window slides through the time data column.

[0055] In one implementation, here, the sliding window can be set by the rolling method in Pandas. In a possible implementation, the sliding step can be set to 1, that is, the sliding window moves one row each time it slides. For example, in an example, the sliding window size is 10 seconds. If the sliding window covers the time data of the 1st to 10th rows at the initial position, then after sliding once, the sliding window covers the time data of the 2nd to 11th rows.

[0056] Of course, as mentioned above, the sliding window can also be slid with time as the sliding step. When the time screening condition includes a time span, the size of the sliding window can be determined according to the time span so that the difference between the last time data and the first time data in the sliding window is equal to the time span. For example, in an example, the data in the time data column starts from 21:00:00:000000 on August 1, 2024, and the time screening condition is 10 seconds. Then, the initial position of the sliding window can be set to start from the first time data in the time data column. At this time, the first row of the sliding window covers 21:00:00:000000 on August 1, 2024, and the last row of the sliding window covers 21:00:10:000000 on August 1, 2024. At this time, the 10-second sliding window can include all time data within 10 seconds from 21:00:00:000000 on August 1, 2024 to 21:00:10:000000 on August 1, 2024, which can be more than 10 rows of data or less than 10 rows of data. The sliding step size of the time dimension can be set according to demand. In some embodiments, the sliding step size of the time dimension can be set to be less than the sliding window. For example, when the sliding window is 10 seconds and the sliding step size is 1 second, it can be set to slide from the previous window position to the window position of the next second each time, such as the first row of the sliding window from 21:00:00:000000 on August 1, 2024 to 21:00:01:000000 on August 1, 2024. This can improve the accuracy of data screening. In other implementations, the sliding step size of the time dimension can also be set to be equal to the sliding window, for example, when the sliding window is 10 seconds and the sliding step size is 10 seconds. Referring to the above example, if the first row of the sliding window slides from August 1, 2024, 21:00:00:000000 to August 1, 2024, 21:00:10:000000, the speed of data filtering can be improved.

[0057] When the sliding window slides on the time data column, the business data corresponding to the time data covered by the sliding window at the current position can be obtained respectively. The position of a sliding window corresponds to a business data set, and business data sets of multiple sliding windows at different positions can be obtained.

[0058] Step S108: collect the business data sets that meet the data screening conditions as the target business data sets.

[0059] In some embodiments of the present disclosure, due to the separately set time judgment condition, the data judgment condition here may no longer include time-related screening conditions in some embodiments. The data screening conditions may include multiple conditions and multiple types of screening requirements, such as the business data contains specific key characters, one or more data values ​​themselves meet / do not meet the set threshold, the results obtained by statistics on the business data meet / do not meet the set conditions, etc. The specific data judgment can be specifically set according to the screening requirements of the business data. For example, in some embodiments of the present disclosure, the data screening conditions can be set to include at least one of the following: extreme difference conditions, maximum value conditions, average value conditions, and variance conditions, etc.

[0060] The business data set obtained according to the time screening condition is further screened according to the preset data screening condition to obtain a business data set that meets the data screening condition. For ease of description, the business data set that meets the data screening condition may be referred to as a target business data set.

[0061] Step S110: determining a status monitoring result of the business data based on time data corresponding to the target business data set.

[0062] Specifically, the status monitoring results may include status monitoring information of the object corresponding to the business data that can be fed back or characterized according to the processing of the data in the data table to be processed. The status monitoring results of the business data are usually associated with time information, and may include status information such as the status information of the device that collects the business data as described above at a certain time point or interval, and may also include data status information that characterizes the business data itself at a certain time point or interval, such as the average value or range of the collected business data in a certain time interval is greater than a threshold, etc. Of course, the status monitoring results in some temperature monitoring implementation scenarios disclosed in the present invention may include, for example, normal business operation results, abnormal business operation results, normal business operation time, and abnormal business operation time. Normal business operation results may include stable interval results, change interval results, process interval results, etc. Abnormal business operation results may include abnormal time information, abnormal devices, abnormal processes, etc.

[0063] In the above-mentioned method for processing the time-related data table, by obtaining the time data column in the data table to be processed, a sliding window is used to slide on the time data column, and the corresponding business data is obtained from the data table to be processed according to the time data in the sliding window, so as to obtain multiple sets of business data sets of time window intervals, which can flexibly filter out business data in different time segments; by further filtering the business data set according to the data characteristics of the business data, it is possible to filter out business data that meets the data dimension conditions from business data that meets the time dimension conditions. Since the business data is associated with the business time dimension, the operating status of the business in a specific time period can be determined based on the filtered business data. According to the time data corresponding to the filtered business data, the time when the business is in a specific operating state can be determined, and then the state of the object corresponding to the business data can be determined, which is convenient for business personnel to trace back and analyze.

[0064] In some embodiments provided by the present disclosure, the stability of control can be judged based on business data. Specifically, Figure 2 As shown, the above step S110 may include:

[0065] Step A1, determining the continuous time segments of the business data that meet the screening conditions according to the time data corresponding to the target business data set.

[0066] Exemplarily, the minimum and maximum values ​​in the time data corresponding to the target business data set can be screened out to obtain the start time and end time of the continuous time segment, respectively. It is understandable that the number of target business data sets can be one or more, and the continuous time segment can also be one or more. In the case where the time segments corresponding to the target business data sets are adjacent, the adjacent continuous time segments can be merged.

[0067] Step A2: Outputting the continuous time segments of the time data belonging to the determined stable change interval as stable interval results.

[0068] The time data can be used to determine the stable change interval to characterize that the business data corresponding to the time data fluctuates within a preset range. For example, when the business data is temperature data, the stable change interval can be used to characterize the time for which the temperature remains stable. The output may include obtaining / determining the stable interval, or visually displaying the obtained / determined stable interval through a chart or the like, or feeding back the obtained / determined stable interval to another processing object.

[0069] Specifically, the stable interval result may include whether a stable change interval exists / does not exist, and / or the start time and end time of the stable change interval.

[0070] Optionally, the continuous time segments of the time data belonging to the determined unstable change interval can be output as unstable interval results. The unstable change interval can be other intervals in the time data column except the stable change interval. For example, when the business data is temperature data, the unstable change interval can be used to characterize the time of temperature change.

[0071] In this embodiment, the operating status and duration of the business can be determined based on the time data corresponding to the business data that meets the screening conditions. Furthermore, when it is necessary to judge the stability of the control, the results such as whether stable control can be achieved and the time period in which stable control can be achieved are displayed.

[0072] In one possible implementation, Figure 3 As shown, the above step A1 may include:

[0073] Step A11, merging the time data corresponding to the target business data set to obtain a time data set.

[0074] Step A12, deduplicate the time data set to obtain a target time data set.

[0075] Step A13, determining a continuous time segment based on the first time data and the last time data in the target time data set.

[0076] Exemplarily, when the step size of the sliding window is smaller than the size of the sliding window, there is an overlap of continuous time segments corresponding to the target business data set. At this time, the time data corresponding to the target business data set can be merged and deduplicated to form one or more target data sets, so that the time data in the target time data set is continuous in the time data column.

[0077] In this embodiment, by merging and deduplicating the time data sets corresponding to the target business data sets, overlapping time segments can be combined into one continuous time segment.

[0078] In one embodiment, a column of business data in the to-be-processed data table corresponds to a device (eg, a temperature sensor) for collecting business data. Figure 4 As shown, the above step S110 may include:

[0079] Step B1, determining abnormal time information of business data that does not meet the screening conditions according to the time data corresponding to the target business data set.

[0080] The abnormal time information may include a time point and / or a time segment. Exemplarily, time data other than the time data corresponding to the target business data set may be screened out from the time data column, and the abnormal time information may be determined based on these data.

[0081] Step B2, determining the abnormal device information of the collected service data in the to-be-processed data table according to the abnormal time information.

[0082] In some scenarios, the time information that does not require warning in the abnormal time information can be excluded first (for example, in certain time periods, fluctuations in business data are allowed). The abnormal time information here can usually indicate that the business data at a certain time point or interval in the data table to be processed does not meet the data screening conditions, and these business data are abnormal. Therefore, the corresponding abnormal business data can be further found based on the abnormal time information, and then the specific abnormal device information of these abnormal business data can be determined. The abnormal device information can be output to business personnel to facilitate the analysis of abnormal situations, greatly improving the automated processing of finding abnormal time information and / or abnormal device information based on the time dimension and data dimension condition screening of business data, and more effectively, quickly and accurately monitoring and handling abnormal devices.

[0083] In practical applications, it is possible to determine whether the environmental parameters meet the control requirements based on the business data. In an embodiment of the business data processing of temperature data disclosed in the present invention, the above data screening conditions may include at least one of the following:

[0084] The range of the business data of a single column in the business data set is less than a preset first threshold.

[0085] The deviation value between the business data of a single column in the business data set and the preset target value is less than a preset second threshold value.

[0086] The range of all the business data in the business data set is smaller than a preset third threshold.

[0087] The implementation scheme provided by the present disclosure can perform data screening from three dimensions: the range of business data in a single column, the difference between business data in a single column and the target value, and the range of all business data in all columns (target business data) within a period of time. It can more accurately reflect the changes in business data and can more accurately screen out qualified business data. Exemplarily, each column of business data can be collected by sensors at different positions in the device. The range of business data in a single column can be used to characterize the single-point fluctuation amplitude of each sensor within a preset time span. The deviation value of business data in a single column from the preset target value can be used to characterize the deviation of each sensor from its corresponding target value. In the same environment, the target values ​​corresponding to each sensor can be the same. At this time, the business data set is a two-dimensional array. For each business data set, each column in the business data set can be traversed, the range of business data in a single column and the deviation value of business data in a single column from the preset target value can be calculated, and then the range of all business data is calculated to determine the business data set that meets the data screening conditions.

[0088] For example, when the business data is temperature data and the filtering conditions are used to determine a stable change interval, the time filtering conditions may include a preset time span of 10 seconds, and the data filtering conditions may include a preset first threshold of 0.1 degrees Celsius, a preset target value between 20 degrees Celsius and 21 degrees Celsius, a preset second threshold of 0.3 degrees Celsius, and a preset third threshold of 0.3 degrees Celsius.

[0089] In this embodiment, by combining the time dimension and the data dimension to calculate the data features of the business data in the business data set, it is possible to determine whether the environmental parameters meet the control requirements based on the business data.

[0090] In some embodiments, the business data may include temperature data, and / or the data table to be processed may include an Excel table. In practical applications, the time accuracy corresponding to the business data is usually high. As mentioned above, the data accuracy of temperature acquisition in some scenarios can reach microseconds or nanoseconds, and the requirements for such data processing are extremely high. Conventional Excel processing may not be able to process data of this level of accuracy. Therefore, in some embodiments provided by the present disclosure, the time accuracy of the time data includes not less than at least one of the following: milliseconds, microseconds or nanoseconds. In one embodiment, microsecond time data can be processed by Pandas.

[0091] Exemplarily, when controlling the temperature in the cavity of the device, there is a need to adjust the ambient temperature to a target value, maintain the ambient temperature stable at the current temperature for a period of time, and then adjust the ambient temperature to the next target value. For example, the ambient temperature needs to be controlled to 25 degrees Celsius, 35 degrees Celsius, and 55 degrees Celsius in sequence. Therefore, the temperature data will cycle between stable and changing states. At this time, the screening conditions can be used to screen out temperature data in a stable state / changing state and temperature data in an abnormal state. Furthermore, based on the screened temperature data, the duration of the stable state / changing state and abnormal sensors or devices can be determined.

[0092] In summary, the above-mentioned processing method, device, computer equipment, computer-readable storage medium and computer program product of the time-related data table can flexibly filter out business data in different time periods by obtaining the time data column in the data table to be processed, sliding the sliding window on the time data column, and obtaining the corresponding business data from the data table to be processed according to the time data in the sliding window; by further filtering the business data set according to the data characteristics of the business data, it is possible to filter out business data that meets the data dimension conditions from the business data that meets the time dimension conditions. Since the business data is associated with the business time dimension, the operating status of the business in a specific time period can be determined based on the filtered business data. According to the time data corresponding to the filtered business data, the time when the business is in a specific operating state can be determined, and then the state of the object corresponding to the business data can be determined, which is convenient for business personnel to trace back and analyze.

[0093] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0094] Based on the same inventive concept, the embodiment of the present disclosure also provides a device for processing a time-related data table for implementing the method for processing a time-related data table involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the embodiment of the device for processing one or more time-related data tables provided below can refer to the limitations of the method for processing a time-related data table above, and will not be repeated here.

[0095] In an exemplary embodiment, Figure 5 As shown, a device 200 for processing a time-related data table is provided, comprising: a data acquisition module 202, a screening condition determination 204, a time screening module 206, a data screening module 208 and a result analysis module 210, wherein:

[0096] The data acquisition module 202 is used to acquire a time data column arranged in time sequence from the data table to be processed, wherein the data table to be processed includes business data corresponding to the time data column.

[0097] The screening condition determination module 204 is used to determine the screening conditions of the data table to be processed, and the screening conditions include time screening conditions and data screening conditions.

[0098] The time screening module 206 is used to slide a sliding window determined according to the time screening condition on the time data column, obtain the business data corresponding to the time data covered by the position of the sliding window, and obtain a business data set, wherein one sliding window position corresponds to one business data set.

[0099] The data screening module 208 is used to collect the business data sets that meet the data screening conditions as the target business data set.

[0100] The result analysis module 210 is used to determine the status monitoring result of the business data based on the time data corresponding to the target business data set.

[0101] In an exemplary embodiment, the result analysis module 210 includes:

[0102] The time segment determination submodule is used to determine the continuous time segments of the business data that meet the screening conditions based on the time data corresponding to the target business data set.

[0103] The first result output submodule is used to output the continuous time segments of the time data belonging to the determined stable change interval as stable interval results.

[0104] In an exemplary embodiment, the time segment determination submodule includes:

[0105] The merging unit is used to merge the time data corresponding to the target business data set to obtain a time data set.

[0106] The deduplication unit is used to perform deduplication processing on the time data set to obtain the target time data set.

[0107] The time segment determination unit is used to determine the continuous time segments based on the first time data and the last time data in the target time data set.

[0108] In an exemplary embodiment, a column of business data in the to-be-processed data table corresponds to a device for collecting business data, and the result analysis module 210 includes:

[0109] The abnormal time information submodule is used to determine the abnormal time information of the business data that does not meet the screening conditions based on the time data corresponding to the target business data set.

[0110] The second result output submodule determines the abnormal device information of the collected business data in the data table to be processed according to the abnormal time information.

[0111] In an exemplary embodiment, the data screening condition includes at least one of the following:

[0112] The range of the business data of a single column in the business data set is less than a preset first threshold;

[0113] The deviation value between the business data of a single column in the business data set and the preset target value is less than a preset second threshold value;

[0114] The range of all the business data in the business data set is smaller than a preset third threshold.

[0115] In an exemplary embodiment, the time accuracy of the above time data includes no less than at least one of the following: millisecond level, microsecond level or nanosecond level.

[0116] In an exemplary embodiment, the business data includes temperature data, and / or the data table to be processed includes an Excel table.

[0117] Each module in the above-mentioned time-related data table processing device can be implemented in whole or in part by software, hardware, or a combination thereof. Each of the above-mentioned modules can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each of the above modules.

[0118] In an exemplary embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as shown in FIG. Figure 6As shown. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected through a system bus, and the communication interface is connected to the system bus through the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data tables to be processed. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a method for processing a time-related data table is implemented.

[0119] Those skilled in the art will understand that Figure 6 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0120] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the processor implements the steps in the above-mentioned method embodiments when executing the computer program.

[0121] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0122] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0123] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0124] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0125] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A method for processing a time-related data table, characterized in that: The method comprises: Acquire a time data column arranged in time sequence from a data table to be processed, wherein the data table to be processed includes business data corresponding to the time data column; Determine the screening conditions of the data table to be processed, wherein the screening conditions include a time screening condition and a data screening condition; By sliding a sliding window determined according to the time screening condition on the time data column, business data corresponding to the time data covered by the position of the sliding window are respectively obtained to obtain a business data set, wherein one sliding window position corresponds to one business data set; The business data set that satisfies the data screening condition is set as a target business data set; The status monitoring result of the business data is determined based on the time data corresponding to the target business data set.

2. The method according to claim 1, characterized in that: The determining the status monitoring result of the business data based on the time data corresponding to the target business data set includes: Determine, according to the time data corresponding to the target business data set, a continuous time segment in which the business data meets the screening condition; The continuous time segments of the time data belonging to the determined stable change interval are output as stable interval results.

3. The method according to claim 2, characterized in that The step of determining, based on the time data corresponding to the target business data set, a continuous time segment in which the business data meets the screening condition, includes: Merging the time data corresponding to the target business data set to obtain a time data set; Deduplication processing is performed on the time data set to obtain a target time data set; A continuous time segment is determined based on the first time data and the last time data in the target time data set.

4. The method according to claim 1, characterized in that: A column of business data in the to-be-processed data table corresponds to a device for collecting the business data, and determining the state monitoring result of the business data based on the time data corresponding to the target business data set includes: Determine, according to the time data corresponding to the target business data set, abnormal time information that the business data does not meet the screening condition; The abnormal device information of the service data collected in the to-be-processed data table is determined according to the abnormal time information.

5. The method according to claim 1, characterized in that The data screening condition includes at least one of the following: The range of the business data of a single column in the business data set is less than a preset first threshold; The deviation value between the business data of a single column in the business data set and the preset target value is less than a preset second threshold value; The range of all the business data in the business data set is less than a preset third threshold.

6. The method according to claim 1, characterized in that The time accuracy of the time data includes no less than at least one of the following: millisecond level, microsecond level or nanosecond level.

7. The method according to any one of claims 1 to 6, characterized in that: The business data includes temperature data, and / or the data table to be processed includes an Excel table.

8. A device for processing a time-related data table, characterized in that: The device comprises: A data acquisition module, used to acquire a time data column arranged in time sequence from a data table to be processed, wherein the data table to be processed includes business data corresponding to the time data column; A screening condition determination module, used to determine the screening conditions of the to-be-processed data table, wherein the screening conditions include a time screening condition and a data screening condition; A time screening module, configured to slide a sliding window determined according to the time screening condition on the time data column, respectively obtain business data corresponding to the time data covered by the position of the sliding window, and obtain a business data set, wherein one sliding window position corresponds to one business data set; A data screening module, used for collecting the business data satisfying the data screening condition as a target business data set; A result analysis module is used to determine the status monitoring result of the business data based on the time data corresponding to the target business data set.

9. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Business data management method and device

    CN112711614A

  • Equipment operation event detection method and device, electronic equipment and storage medium

    CN113591984A

  • Data processing method and device and electronic equipment

    CN114860846A

Cited By

  • Data processing method and device, equipment, medium and program product

    CN119226362A

  • Method and apparatus for processing time-associated data table, and computer device and readable storage medium

    WO2026031651A1