Analysis and management method and system based on media terminal data

Abstract

The embodiments of the present invention relate to the field of data analysis technology, and specifically disclose an analysis management method and system based on media terminal data. The embodiments of the present invention determine multiple target media terminals, perform periodic data collection on the multiple target media terminals; perform preprocessing, standardization and data integration on the data collected from the multiple terminals to generate standard integrated data; create a visual management environment, perform visual processing and visual display on the standard integrated data; obtain data mining requirements, perform statistical and predictive mining analysis on the standard integrated data according to the data mining requirements, and perform mining display. It is possible to perform periodic data collection on multiple target media terminals, generate standard integrated data through preprocessing, standardization and data integration, and then perform visual processing display and mining analysis display, thereby realizing unified analysis and management of data from multiple media terminals, and realizing effective mining and rich visual display of media terminal data.

Description

Technical Field

[0001] The present invention belongs to the technical field of data analysis, and in particular, relates to an analysis management method and system based on media terminal data. Background Art

[0002] Media terminal data is data collected, processed and generated by various smart devices or platforms related to communication media. With the development of information technology, media terminals have expanded from traditional televisions and radios to smartphones, tablets, smart TVs, VR / AR devices, set-top boxes and other forms. These terminals will generate a large amount of data during user use.

[0003] In the existing technology, each media terminal is relatively independent, and it is difficult to uniformly analyze and manage the data of multiple media terminals at the same time, resulting in relatively simple analysis and management of media terminal data, inability to effectively mine media terminal data, and relatively simple visualization. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide an analysis and management method and system based on media terminal data, aiming to solve the problems raised in the background technology.

[0005] To achieve the above objectives, the embodiments of the present invention provide the following technical solutions:

[0006] The analysis and management method based on media terminal data specifically comprises the following steps:

[0007] Determine a plurality of target media terminals, and perform periodic data collection on the plurality of target media terminals according to a preset data collection period to obtain data collected by the plurality of terminals;

[0008] Preprocessing, standardizing and integrating the data collected by the multiple terminals to generate standard integrated data;

[0009] Obtaining visualization management requirements, creating a visualization management environment according to the visualization management requirements, and performing visualization processing and visualization display on the standard integrated data;

[0010] Obtain data mining requirements, perform statistical and predictive mining analysis on the standard integrated data according to the data mining requirements, and perform mining display.

[0011] As a further limitation of the technical solution of the embodiment of the present invention, the determining of multiple target media terminals, performing periodic data collection on the multiple target media terminals according to a preset data collection period, and obtaining the collected data of the multiple terminals specifically include the following steps:

[0012] Obtain terminal management requirements and determine multiple target media terminals;

[0013] According to the preset data collection cycle, periodically generate data collection instructions;

[0014] According to the data collection instruction, acquiring the terminal communication addresses of the plurality of target media terminals;

[0015] Constructing multiple terminal collection channels according to the multiple terminal communication addresses;

[0016] Through the multiple terminal collection channels, periodic data collection is performed on the multiple target media terminals to obtain multiple terminal collection data.

[0017] As a further limitation of the technical solution of the embodiment of the present invention, the preprocessing, standardization and data integration of the data collected by the multiple terminals to generate standard integrated data specifically includes the following steps:

[0018] Preprocessing the data collected by the plurality of terminals to generate a plurality of preprocessed data;

[0019] Obtain standardized information;

[0020] According to the standardization information, the plurality of pre-processed data are standardized to generate a plurality of standardized data;

[0021] The plurality of standardized data are integrated to generate standardized integrated data.

[0022] As a further limitation of the technical solution of the embodiment of the present invention, the preprocessing of the data collected by the multiple terminals to generate multiple preprocessed data specifically includes the following steps:

[0023] Identify missing data and fill or delete them;

[0024] Identifying and eliminating abnormalities in the data collected by the multiple terminals;

[0025] Performing standardized processing on the data collected by the multiple terminals;

[0026] After missing identification and filling or deletion, anomaly identification and elimination, and standardization, multiple pre-processed data are generated.

[0027] As a further limitation of the technical solution of the embodiment of the present invention, the obtaining of the visualization management requirement, creating the visualization management environment according to the visualization management requirement, and performing visualization processing and visualization display on the standard integrated data specifically include the following steps:

[0028] Obtain visual management requirements;

[0029] According to the visual management requirements, select visualization tools and create a visual management environment;

[0030] Importing the standard integrated data into the visual management environment, performing visual processing, and generating a visual chart;

[0031] A plurality of visualization managers are determined, and the visualization chart is transmitted to the plurality of visualization managers for visualization display.

[0032] As a further limitation of the technical solution of the embodiment of the present invention, the obtaining of data mining requirements, performing statistical and predictive mining analysis on the standard integrated data according to the data mining requirements, and performing mining display specifically include the following steps:

[0033] Obtain data mining requirements;

[0034] According to the data mining requirements, statistical analysis is performed on the standard integrated data to obtain multiple statistical mining values;

[0035] Analyze multiple statistical mining values ​​to predict data change trends;

[0036] The data change trend is transmitted to multiple visualization managers for mining and display.

[0037] An analysis and management system based on media terminal data, the system includes a periodic data collection unit, a data processing and integration unit, a visualization processing and display unit, and a data mining and display unit, wherein:

[0038] A periodic data collection unit, used to determine a plurality of target media terminals, and perform periodic data collection on the plurality of target media terminals according to a preset data collection period, to obtain the collected data of the plurality of terminals;

[0039] A data processing and integration unit, used for preprocessing, standardizing and integrating the data collected by the plurality of terminals to generate standard integrated data;

[0040] A visualization processing and display unit, used to obtain visualization management requirements, create a visualization management environment according to the visualization management requirements, and perform visualization processing and visualization display on the standard integrated data;

[0041] The data mining display unit is used to obtain data mining requirements, perform statistical and predictive mining analysis on the standard integrated data according to the data mining requirements, and perform mining display.

[0042] As a further limitation of the technical solution of the embodiment of the present invention, the periodic data acquisition unit specifically includes:

[0043] The terminal determination module is used to obtain terminal management requirements and determine multiple target media terminals;

[0044] An instruction generation module, used to periodically generate data collection instructions according to a preset data collection cycle;

[0045] An address acquisition module, used to acquire the terminal communication addresses of the plurality of target media terminals according to the data acquisition instruction;

[0046] A channel construction module, used to construct multiple terminal collection channels according to multiple terminal communication addresses;

[0047] The data collection module is used to perform periodic data collection on the plurality of target media terminals through the plurality of terminal collection channels to obtain the collected data of the plurality of terminals.

[0048] As a further limitation of the technical solution of the embodiment of the present invention, the data processing integration unit specifically includes:

[0049] A data preprocessing module, used for preprocessing the data collected by the plurality of terminals to generate a plurality of preprocessed data;

[0050] An information acquisition module, used to acquire standardized information;

[0051] A standardization processing module, used for performing standardization processing on the plurality of pre-processed data according to the standardization information to generate a plurality of standardized data;

[0052] The data integration module is used to integrate the plurality of standardized data to generate standard integrated data.

[0053] As a further limitation of the technical solution of the embodiment of the present invention, the visualization processing and display unit specifically includes:

[0054] Demand acquisition module, used to obtain visual management requirements;

[0055] An environment creation module, used to select visualization tools and create a visualization management environment according to the visualization management requirements;

[0056] A visualization processing module, used for importing the standard integration data into the visualization management environment, performing visualization processing, and generating visualization charts;

[0057] The visualization display module is used to determine multiple visualization managers and transmit the visualization chart to the multiple visualization managers for visualization display.

[0058] Compared with the prior art, the present invention has the following beneficial effects:

[0059] The embodiment of the present invention determines multiple target media terminals and performs periodic data collection on the multiple target media terminals; performs preprocessing, standardization and data integration on the data collected by multiple terminals to generate standard integrated data; creates a visual management environment to perform visual processing and visual display on the standard integrated data; obtains data mining requirements, performs statistical and predictive mining analysis on the standard integrated data according to the data mining requirements, and performs mining and display. It is possible to perform periodic data collection on multiple target media terminals, generate standard integrated data through preprocessing, standardization and data integration, and then perform visual processing display and mining analysis display, thereby realizing unified data analysis and management of multiple media terminals, and realizing effective mining of media terminal data and rich visual display. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention.

[0061] Figure 1 A flow chart of a method provided by an embodiment of the present invention is shown.

[0062] Figure 2 A flow chart of periodic data collection in the method provided by an embodiment of the present invention is shown.

[0063] Figure 3 A flow chart of generating standard integration data in the method provided by an embodiment of the present invention is shown.

[0064] Figure 4 A flow chart of generating multiple pre-processed data in the method provided by an embodiment of the present invention is shown.

[0065] Figure 5 A flowchart of visualization processing and display in the method provided by an embodiment of the present invention is shown.

[0066] Figure 6 A flow chart of performing mining, analysis and display in the method provided by an embodiment of the present invention is shown.

[0067] Figure 7 The application architecture diagram of the system provided by the embodiment of the present invention is shown.

[0068] Figure 8 The structure block diagram of the periodic data acquisition unit in the system provided by the embodiment of the present invention is shown.

[0069] Fig. 9 The structure block diagram of the data processing integration unit in the system provided by the embodiment of the present invention is shown.

[0070] Fig.10 The structure block diagram of the visualization processing display unit in the system provided by the embodiment of the present invention is shown. DETAILED DESCRIPTION

[0071] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0072] It is understandable that in the existing technology, each media terminal is relatively independent, and it is difficult to uniformly analyze and manage the data of multiple media terminals at the same time, resulting in relatively simple analysis and management of media terminal data, inability to effectively mine media terminal data, and relatively simple visualization.

[0073] To solve the above problems, the embodiments of the present invention determine multiple target media terminals, perform periodic data collection on the multiple target media terminals according to a preset data collection period, and obtain data collected by multiple terminals; perform preprocessing, standardization and data integration on the data collected by multiple terminals to generate standard integrated data; obtain visual management requirements, create a visual management environment according to the visual management requirements, and perform visual processing and visual display on the standard integrated data; obtain data mining requirements, perform statistical and predictive mining analysis on the standard integrated data according to the data mining requirements, and perform mining and display. It is possible to perform periodic data collection on multiple target media terminals, generate standard integrated data through preprocessing, standardization and data integration, and then perform visual processing and display and mining analysis and display, thereby realizing unified data analysis and management of multiple media terminals, and realizing effective mining of media terminal data and rich visual display.

[0074] Figure 1 A flow chart of a method provided by an embodiment of the present invention is shown.

[0075] Specifically, the analysis and management method based on media terminal data includes the following steps:

[0076] Step S101, determining a plurality of target media terminals, and performing periodic data collection on the plurality of target media terminals according to a preset data collection period to obtain data collected by the plurality of terminals.

[0077] In an embodiment of the present invention, terminal management requirements are obtained, terminal target identification is performed on the terminal management requirements, and multiple target media terminals are determined. Then, according to a preset data collection cycle, data collection instructions are periodically generated, and then according to the data collection instructions, terminal communication addresses of the multiple target media terminals are obtained. According to the multiple terminal communication addresses, terminal collection channels are constructed with the multiple target media terminals. Through the multiple terminal collection channels, periodic data collection is performed on the multiple target media terminals to obtain multiple terminal collection data, wherein the multiple terminal collection data may include user behavior data, content consumption data, device data, advertising data, social data, etc.

[0078] Specifically, Figure 2 A flow chart of periodic data collection in the method provided by an embodiment of the present invention is shown.

[0079] Among them, in the preferred implementation mode provided by the present invention, the determining of multiple target media terminals, performing periodic data collection on the multiple target media terminals according to a preset data collection period, and obtaining the collected data of the multiple terminals specifically include the following steps:

[0080] Step S1011, obtaining terminal management requirements and determining multiple target media terminals;

[0081] Step S1012, periodically generating data collection instructions according to a preset data collection cycle;

[0082] Step S1013, acquiring terminal communication addresses of a plurality of target media terminals according to the data collection instruction;

[0083] Step S1014, constructing multiple terminal collection channels according to the multiple terminal communication addresses;

[0084] Step S1015, periodically collect data from the plurality of target media terminals through the plurality of terminal collection channels to obtain the plurality of terminal collection data. The corresponding process has the following relationship:

[0085] ;

[0086] in, Indicates time The total data collection results obtained at the moment, Indicates the number of terminals, Indicates The data collection cycle of each terminal is Indicates Terminals at time A specific data value at a moment in time, Indicates The attenuation coefficient of each terminal is used to simulate the attenuation effect of data over time; Indicates The amplitude factor of each terminal is used to simulate the periodic changes of data; Indicates The angular frequency of each terminal determines the oscillation frequency of the data; Indicates The initial phase of each terminal is used for phase shift; Indicates The phase modulation factor of each terminal is Indicates Cumulative data of terminals; represents the number of interference sources, Indicates External factors in time The impact value of the moment;

[0087] In the data collection process of the above steps, the present invention uses an exponential function Simulate the attenuation effect of data over time in practical applications through sine and cosine functions To simulate the oscillation and fluctuation of data, to represent the periodic changes of data, through the derivative Capture dynamic changes to indicate the rate of change of data and introduce external factors , so that the present invention can comprehensively consider multiple factors and accurately calculate the comprehensive data value of each terminal in a specific time period, which can better simulate and capture various complex situations that may be encountered in actual applications.

[0088] Furthermore, the analysis and management method based on media terminal data also includes the following steps:

[0089] Step S102, preprocessing, standardizing and integrating the data collected by the multiple terminals to generate standard integrated data.

[0090] In an embodiment of the present invention, missing parts are identified for data collected by multiple terminals, missing positions are filled or deleted, and then abnormalities are identified for the data collected by multiple terminals, abnormal values ​​are determined and eliminated, and the data collected by multiple terminals are standardized according to standard dimensions or units. After missing parts identification and filling or deletion, abnormalities identification and elimination, and standardized processing, multiple pre-processed data are generated. At the same time, standardized information is obtained, and standardized processing of format conversion is performed on the multiple pre-processed data according to the standardized information to generate multiple standardized data. After that, data integration is performed on the multiple standardized data to generate standard integrated data.

[0091] Specifically, Figure 3A flow chart of generating standard integration data in the method provided by an embodiment of the present invention is shown.

[0092] Among them, in the preferred embodiment provided by the present invention, the preprocessing, standardization and data integration of the data collected by the multiple terminals to generate standard integrated data specifically includes the following steps:

[0093] Step S1021, pre-processing the data collected by the multiple terminals to generate multiple pre-processed data.

[0094] Specifically, Figure 4 A flow chart of generating multiple pre-processed data in the method provided by an embodiment of the present invention is shown.

[0095] Among them, in the preferred embodiment provided by the present invention, the preprocessing of the plurality of terminal collected data to generate a plurality of preprocessed data specifically comprises the following steps:

[0096] Step S10211, identifying missing data and filling or deleting missing data of the plurality of terminals;

[0097] Step S10212, identifying and eliminating abnormalities in the data collected by the multiple terminals;

[0098] Step S10213, performing standardization processing on the data collected by the multiple terminals;

[0099] Step S10214, after missing identification and filling or deletion, abnormal identification and elimination and standardization processing, multiple pre-processed data are generated.

[0100] Furthermore, the preprocessing, standardization and data integration of the data collected by the multiple terminals to generate standard integrated data also includes the following steps:

[0101] Step S1022, obtaining standardization information.

[0102] Step S1023, performing standardization processing on the plurality of pre-processed data according to the standardization information to generate a plurality of standardized data, and the corresponding process has the following relationship:

[0103] ;

[0104] in, Indicates at time Moment, The terminal Normalized values ​​for data points; Indicates at time Moment, The terminal The original value of the data point; Indicates at time Moment, The mean of the data points; represents the number of features of a data point, Representation characteristics and Features The weight between Representation characteristics The nonlinear transformation function is Indicates at time Moment, The standard deviation of the data points; represents the regularization parameter, Indicates the total time period of data collection;

[0105] In the process of data preprocessing in the above steps, the present invention Adjust the original data by the mean to centralize the data and reduce the offset between different features; perform nonlinear transformation of weighted features , capturing the complex relationships between features; through the standard deviation Scaling is performed so that the distribution of the data has the same magnitude and the standardized data is in the same range, which is convenient for model training; regularization terms are introduced , this regularization term measures the deviation between a data point and its long-term average, which aims to prevent the model from overfitting to short-term fluctuations, improve the robustness of the model, reduce sensitivity to noise, and maintain good generalization ability during training; and adds time integral to the regularization term As the benchmark value of the data point, it can more accurately describe the long-term trend of the data. It is especially suitable for time series data. It can better simulate and capture various complex situations that may be encountered in practical applications, thereby providing more accurate and dynamic monitoring and analysis results.

[0106] Step S1024, integrating the plurality of standardized data to generate standard integrated data.

[0107] Furthermore, the analysis and management method based on media terminal data also includes the following steps:

[0108] Step S103, obtaining visualization management requirements, creating a visualization management environment according to the visualization management requirements, and performing visualization processing and visualization display on the standard integrated data.

[0109] In an embodiment of the present invention, by obtaining visualization management requirements, a visualization tool such as Excel, Tableau or Power BI is selected according to the visualization management requirements, and then a visualization management environment is created according to the visualization tool and in combination with the data type. By importing standard integrated data into the visualization management environment, the standard integrated data is visualized in the visualization management environment to generate visualization charts such as line charts, bar charts and / or pie charts, and then multiple visualization managers are determined, and the visualization charts are transmitted to multiple visualization managers for targeted visualization presentation.

[0110] Specifically, Figure 5 A flowchart of visualization processing and display in the method provided by an embodiment of the present invention is shown.

[0111] Among them, in the preferred implementation mode provided by the present invention, the obtaining of visualization management requirements, creating a visualization management environment according to the visualization management requirements, and visualization processing and visualization display of the standard integrated data specifically include the following steps:

[0112] Step S1031, obtaining visual management requirements;

[0113] Step S1032, selecting a visualization tool and creating a visualization management environment according to the visualization management requirements;

[0114] Step S1033, importing the standard integration data into the visualization management environment, performing visualization processing, and generating a visualization chart. The corresponding process has the following relationship:

[0115] ;

[0116] in, Indicates at time Moment, The terminal Visual transformation values ​​of data points; Indicates at time Moment, The terminal The standard integrated data value of data points; Indicates at time Moment, The terminal The standard integrated data value of each feature; Indicates at time Moment, The terminal Data points and The weight coefficient of each feature; Indicates The terminal The angular frequency of the data point, No. The terminal The initial phase of the data point, Indicates at time Moment, The terminal Smoothing coefficient for data points; Indicates The terminal The oscillation frequency of each data point; Indicates at time Moment, The terminal The standard deviation of the data points; Indicates The terminal Smoothing factor for data points; Indicates at time Moment, The terminal The mean of the data points;

[0117] In the process of visualizing the above steps, the present invention This weighting mechanism reflects the association between data. It allows capturing the relationship and influence between data points and can effectively integrate multiple features. It also introduces cosine and sine terms, where the cosine term Describes the periodic changes of data over time to simulate periodic natural phenomena, making the visualization results more consistent with the actual data behavior. Describe the smoothing and oscillation effects of data to effectively represent the noise and fluctuations in the data, enhance the dynamic performance of the data, and make it more visually attractive and expressive; Combining the standard deviation and logarithmic transformation of the data, the distribution of the data is adjusted to make it more suitable for visualization. Among them, the logarithmic transformation enhances the suppression of outliers and improves the stability and readability of the visualization effect, especially when the data range is large or there are extreme values, which can prevent certain data points from dominating the overall effect.

[0118] Step S1034, determining a plurality of visualization managers, and transmitting the visualization chart to the plurality of visualization managers for visualization display.

[0119] Furthermore, the analysis and management method based on media terminal data also includes the following steps:

[0120] Step S104, obtaining data mining requirements, performing statistical and predictive mining analysis on the standard integrated data according to the data mining requirements, and performing mining display.

[0121] In an embodiment of the present invention, by obtaining data mining requirements, statistical analysis is performed on standard integrated data according to the data mining requirements to obtain multiple statistical mining values ​​including distribution, mean and median, and then the multiple statistical mining values ​​are analyzed by using algorithms such as machine learning to predict data change trends, which are then transmitted to multiple visualization managers for targeted mining and display.

[0122] Specifically, Figure 6 A flow chart of performing mining, analysis and display in the method provided by an embodiment of the present invention is shown.

[0123] Among them, in the preferred implementation mode provided by the present invention, the obtaining of data mining requirements, performing statistical and predictive mining analysis on the standard integrated data according to the data mining requirements, and performing mining display specifically include the following steps:

[0124] Step S1041, obtaining data mining requirements;

[0125] Step S1042, performing statistical analysis on the standard integrated data according to the data mining requirements to obtain a plurality of statistical mining values;

[0126] Step S1043, analyzing the plurality of statistical mining values ​​to predict the data change trend, the corresponding process has the following relationship:

[0127] ;

[0128] in, Indicates at time Moment, The terminal The predicted value of the data point; Indicates at time Moment, The terminal Data points and Standard integrated data values ​​related to each feature; Indicates at time Moment, The terminal Data points and Standard integrated data values ​​related to each feature; Indicates The weight coefficient associated with each feature, Indicates The attenuation coefficient associated with each feature is Indicates time from 0 to The integral term of Indicates The terminal The periodic variation coefficient of the data points, Indicates The terminal The offset constant for each data point.

[0129] In the above steps to predict the trend of data changes, the second-order derivative term is used To express the acceleration of data, in order to capture the rapid change characteristics of data; using the historical data integral term To represent the historical cumulative effect of the data, while taking into account the decay to smooth and predict future trends; through the periodic change term To represent the periodic change of data, the periodic change is controlled by angular frequency and initial phase; and a constant offset term is introduced In order to adjust the forecast baseline, the present invention can capture the rapid changes in data, historical cumulative effects and cyclical changes through acceleration terms, historical data integration terms and cyclical change terms, thereby providing more accurate forecast results. This can provide managers with more valuable and forward-looking information.

[0130] Step S1044, transmitting the data change trend to the multiple visualization managers for mining and display.

[0131] Furthermore, Figure 7 The application architecture diagram of the system provided by the embodiment of the present invention is shown.

[0132] Among them, in another preferred embodiment provided by the present invention, the analysis and management system based on media terminal data includes:

[0133] The periodic data collection unit 101 is used to determine a plurality of target media terminals, and perform periodic data collection on the plurality of target media terminals according to a preset data collection period to obtain the collected data of the plurality of terminals.

[0134] In the embodiment of the present invention, the periodic data collection unit 101 obtains terminal management requirements, performs terminal target identification on the terminal management requirements, determines multiple target media terminals, and then periodically generates data collection instructions according to a preset data collection period, and then obtains the terminal communication addresses of the multiple target media terminals according to the data collection instructions, and builds terminal collection channels with the multiple target media terminals based on the multiple terminal communication addresses. Through the multiple terminal collection channels, periodic data collection is performed on the multiple target media terminals to obtain multiple terminal collection data, wherein the multiple terminal collection data may include user behavior data, content consumption data, device data, advertising data, social data, etc.

[0135] Specifically, Figure 8 It shows a structural block diagram of the periodic data acquisition unit 101 in the system provided by the embodiment of the present invention.

[0136] Among them, in the preferred embodiment provided by the present invention, the periodic data acquisition unit 101 specifically includes:

[0137] The terminal determination module 1011 is used to obtain terminal management requirements and determine multiple target media terminals;

[0138] The instruction generation module 1012 is used to periodically generate data collection instructions according to a preset data collection cycle;

[0139] An address acquisition module 1013, used to acquire the terminal communication addresses of the plurality of target media terminals according to the data acquisition instruction;

[0140] A channel construction module 1014 is used to construct multiple terminal collection channels according to the multiple terminal communication addresses;

[0141] The data collection module 1015 is used to perform periodic data collection on the multiple target media terminals through the multiple terminal collection channels to obtain the multiple terminal collection data.

[0142] Furthermore, the analysis and management system based on media terminal data also includes:

[0143] The data processing and integration unit 102 is used to pre-process, standardize and integrate the data collected by the multiple terminals to generate standard integrated data.

[0144] In an embodiment of the present invention, the data processing and integration unit 102 identifies missing data collected by multiple terminals, fills or deletes missing positions, identifies anomalies in the data collected by multiple terminals, determines abnormal values ​​and eliminates them, and standardizes the data collected by multiple terminals according to standard dimensions or units. After the missing identification and filling or deletion, anomaly identification and elimination, and standardization, multiple pre-processed data are generated. At the same time, standardized information is obtained, and standardized processing of format conversion is performed on the multiple pre-processed data according to the standardized information to generate multiple standardized data. After that, data integration is performed on the multiple standardized data to generate standard integrated data.

[0145] Specifically, Fig. 9 It shows a structural block diagram of the data processing integration unit 102 in the system provided by an embodiment of the present invention.

[0146] Among them, in the preferred embodiment provided by the present invention, the data processing integration unit 102 specifically includes:

[0147] The data preprocessing module 1021 is used to preprocess the data collected by the plurality of terminals to generate a plurality of preprocessed data;

[0148] An information acquisition module 1022 is used to acquire standardized information;

[0149] A standardization processing module 1023, configured to perform standardization processing on the plurality of pre-processed data according to the standardization information to generate a plurality of standardized data;

[0150] The data integration module 1024 is used to integrate the plurality of standardized data to generate standard integrated data.

[0151] Furthermore, the analysis and management system based on media terminal data also includes:

[0152] The visualization processing and display unit 103 is used to obtain visualization management requirements, create a visualization management environment according to the visualization management requirements, and perform visualization processing and visualization display on the standard integrated data.

[0153] In an embodiment of the present invention, the visualization processing and display unit 103 obtains visualization management requirements, selects visualization tools such as Excel, Tableau or Power BI according to the visualization management requirements, and then creates a visualization management environment according to the visualization tools and in combination with data types, imports standard integrated data into the visualization management environment, and visualizes the standard integrated data in the visualization management environment to generate visualization charts such as line charts, bar charts and / or pie charts, then determines multiple visualization managers, and transmits the visualization charts to the multiple visualization managers for targeted visualization display.

[0154] Specifically, Fig.10 It shows a structural block diagram of the visualization processing and display unit 103 in the system provided by an embodiment of the present invention.

[0155] Among them, in the preferred embodiment provided by the present invention, the visualization processing and display unit 103 specifically includes:

[0156] The requirement acquisition module 1031 is used to acquire the visual management requirement;

[0157] An environment creation module 1032 is used to select visualization tools and create a visualization management environment according to the visualization management requirements;

[0158] A visualization processing module 1033 is used to import the standard integration data into the visualization management environment, perform visualization processing, and generate a visualization chart;

[0159] The visualization display module 1034 is used to determine a plurality of visualization managers and transmit the visualization chart to the plurality of visualization managers for visualization display.

[0160] Furthermore, the analysis and management system based on media terminal data also includes:

[0161] The data mining and display unit 104 is used to obtain data mining requirements, perform statistical and predictive mining analysis on the standard integrated data according to the data mining requirements, and perform mining and display.

[0162] In an embodiment of the present invention, the data mining and display unit 104 obtains data mining requirements, performs statistical analysis on standard integrated data according to the data mining requirements, obtains multiple statistical mining values ​​including distribution, mean and median, and then analyzes the multiple statistical mining values ​​according to algorithms such as machine learning to predict data change trends, and then transmits the data change trends to multiple visualization managers for targeted mining and display.

[0163] It should be understood that, although each step in the flow chart of each embodiment of the present invention is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0164] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0165] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0166] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

[0167] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions and improvements made within the spirit and principles of the present invention should be included in the protection scope of the present invention.

Claims

1. A method for analyzing and managing media terminal data, characterized in that: The method specifically comprises the following steps: Determine a plurality of target media terminals, and perform periodic data collection on the plurality of target media terminals according to a preset data collection period to obtain data collected by the plurality of terminals; Preprocessing, standardizing and integrating the data collected by the multiple terminals to generate standard integrated data; Obtaining visualization management requirements, creating a visualization management environment according to the visualization management requirements, and performing visualization processing and visualization display on the standard integrated data; Obtaining data mining requirements, performing statistical and predictive mining analysis on the standard integrated data according to the data mining requirements, and performing mining display; The step of determining a plurality of target media terminals, performing periodic data collection on the plurality of target media terminals according to a preset data collection period, and obtaining the collected data of the plurality of terminals specifically comprises the following steps: Obtain terminal management requirements and determine multiple target media terminals; According to the preset data collection cycle, periodically generate data collection instructions; According to the data collection instruction, acquiring the terminal communication addresses of the plurality of target media terminals; Constructing multiple terminal collection channels according to the multiple terminal communication addresses; Perform periodic data collection on the plurality of target media terminals through the plurality of terminal collection channels to obtain the plurality of terminal collection data; In the step of periodically collecting data from the plurality of target media terminals through the plurality of terminal collection channels to obtain the collected data from the plurality of terminals, the following relationship exists correspondingly: ； in, Indicates time t The total data collection results obtained at the moment, Indicates the number of terminals, Indicates i The data collection cycle of each terminal is Indicates i Terminals at time t A specific data value at a moment in time, Indicates i The attenuation coefficient of each terminal is used to simulate the attenuation effect of data over time; Indicates i The amplitude factor of each terminal is used to simulate the periodic changes of data; Indicates i The angular frequency of each terminal determines the oscillation frequency of the data; Indicates i The initial phase of each terminal is used for phase shift; Indicates i The phase modulation factor of each terminal is Indicates i Cumulative data of terminals; represents the number of interference sources, Indicates m External factors in time t The impact value of the moment; The obtaining of visual management requirements, creating a visual management environment according to the visual management requirements, and visually processing and visually displaying the standard integrated data specifically include the following steps: Obtain visual management requirements; According to the visual management requirements, select visualization tools and create a visual management environment; The standard integration data is imported into the visual management environment, and visual processing is performed to generate a visual chart. The corresponding process has the following relationship: ； in, Indicates at time t Moment, i The terminal j Visual transformation values ​​of data points; Indicates at time t Moment, i The terminal j The standard integrated data value of data points; Indicates at time t Moment, i The terminal k The standard integrated data value of each feature; Indicates at time t Moment, i The terminal j Data points and k The weight coefficient of each feature; Indicates i The terminal j The angular frequency of the data point, No. i The terminal j The initial phase of the data point, Indicates at time t Moment, i The terminal j Smoothing coefficient for data points; Indicates i The terminal j The oscillation frequency of each data point; Indicates at time t Moment, i The terminal j The standard deviation of the data points; Indicates i The terminal j Smoothing factor for data points; Indicates at time t Moment, i The terminal j The mean of the data points; Determine a plurality of visualization managers, and transmit the visualization chart to the plurality of visualization managers for visualization display; The obtaining of data mining requirements, performing statistical and predictive mining analysis on the standard integrated data according to the data mining requirements, and performing mining display specifically include the following steps: Obtain data mining requirements; According to the data mining requirements, statistical analysis is performed on the standard integrated data to obtain multiple statistical mining values; Analyze multiple statistical mining values ​​to predict data change trends. The corresponding process has the following relationship: ； in, Indicates at time t Moment, i The terminal j The predicted value of the data point; Indicates at time t Moment, i The terminal j Data points and k Standard integrated data values ​​related to each feature; Indicates at time s Moment, i The terminal j Data points and k Standard integrated data values ​​related to each feature; Indicates k The weight coefficient associated with each feature, Indicates k The attenuation coefficient associated with each feature is Indicates time from 0 to t The integral term of Indicates i The terminal j The periodic variation coefficient of the data points, Indicates i The terminal j The offset constant for each data point; The data change trend is transmitted to multiple visualization managers for mining and display.

2. The analysis and management method based on media terminal data according to claim 1, characterized in that: The preprocessing, standardization and data integration of the data collected by the multiple terminals to generate standard integrated data specifically includes the following steps: Preprocessing the data collected by the plurality of terminals to generate a plurality of preprocessed data; Obtain standardized information; According to the standardization information, the plurality of pre-processed data are standardized to generate a plurality of standardized data. The corresponding process has the following relationship: ； in, Indicates at time t Moment, i The terminal j Normalized values ​​for data points; Indicates at time t Moment, i The terminal j The original value of the data point; Indicates at time t Moment, j The mean of the data points; represents the number of features of a data point, Representation characteristics c and Features k The weight between Representation characteristics k The nonlinear transformation function is Indicates at time t Moment, j The standard deviation of the data points; represents the regularization parameter, Indicates the total time period of data collection; The plurality of standardized data are integrated to generate standardized integrated data.

3. The analysis and management method based on media terminal data according to claim 2 is characterized in that: The preprocessing of the plurality of terminal collected data to generate a plurality of preprocessed data specifically comprises the following steps: Identify missing data and fill or delete them; Identifying and eliminating abnormalities in the data collected by the multiple terminals; Performing standardized processing on the data collected by the multiple terminals; After missing identification and filling or deletion, anomaly identification and elimination, and standardization, multiple pre-processed data are generated.

4. An analysis and management system based on media terminal data, characterized in that: The method for analyzing and managing media terminal data according to any one of claims 1 to 3 is applied, wherein the system comprises a periodic data collection unit, a data processing and integration unit, a visualization processing and display unit, and a data mining and display unit, wherein: A periodic data collection unit, used to determine a plurality of target media terminals, and perform periodic data collection on the plurality of target media terminals according to a preset data collection period, to obtain the collected data of the plurality of terminals; A data processing and integration unit, used for preprocessing, standardizing and integrating the data collected by the plurality of terminals to generate standard integrated data; A visualization processing and display unit, used to obtain visualization management requirements, create a visualization management environment according to the visualization management requirements, and perform visualization processing and visualization display on the standard integrated data; The data mining display unit is used to obtain data mining requirements, perform statistical and predictive mining analysis on the standard integrated data according to the data mining requirements, and perform mining display.

5. The analysis and management system based on media terminal data according to claim 4 is characterized in that: The periodic data acquisition unit specifically includes: The terminal determination module is used to obtain terminal management requirements and determine multiple target media terminals; An instruction generation module, used to periodically generate data collection instructions according to a preset data collection cycle; An address acquisition module, used to acquire the terminal communication addresses of the plurality of target media terminals according to the data acquisition instruction; A channel construction module, used to construct multiple terminal collection channels according to multiple terminal communication addresses; The data collection module is used to perform periodic data collection on the plurality of target media terminals through the plurality of terminal collection channels to obtain the collected data of the plurality of terminals.

6. The analysis and management system based on media terminal data according to claim 5, characterized in that: The data processing integration unit specifically includes: A data preprocessing module, used for preprocessing the data collected by the plurality of terminals to generate a plurality of preprocessed data; An information acquisition module, used to acquire standardized information; A standardization processing module, used for performing standardization processing on the plurality of pre-processed data according to the standardization information to generate a plurality of standardized data; The data integration module is used to integrate the plurality of standardized data to generate standard integrated data.

7. The analysis and management system based on media terminal data according to claim 6 is characterized in that: The visualization processing and display unit specifically includes: Demand acquisition module, used to obtain visual management requirements; An environment creation module, used to select visualization tools and create a visualization management environment according to the visualization management requirements; A visualization processing module, used for importing the standard integration data into the visualization management environment, performing visualization processing, and generating visualization charts; The visualization display module is used to determine multiple visualization managers and transmit the visualization chart to the multiple visualization managers for visualization display.

Images