126 results about "Online analytical processing" patented technology

The invention discloses a decision tree based game cheat detection method invented for solving the problem of the prior art that the passive defensive mode cannot detect external hanging. The method of the invention comprises the following procedures: the non-redundant characteristic attribute data set is extracted from the information database of a player at predetermined time; data in the characteristic attribute data set are divided into characteristic attribute exercise data and characteristic attribute test data; a decision tree is generated with the characteristic attribute exercise data and clipping on the decision tree through the characteristic attribute test data is performed to generate an objective decision tree model; the objective decision tree is assessed to obtain an appropriate objective decision tree model; analytical treatment is performed on the objective decision tree to produce categorized player databases and then on-line analysis of the categorized player databases is conducted to detect cheating players with external hanging. The invention can conduct data mining analysis with the data mining method in an active defensive mode to detect cheating players, thereby improving the external hanging preventing ability in online network games.

The invention discloses a big data tax-related information analysis system. The system comprises the following modules: a data acquisition module which performs incremental acquisition on data in the internet by adopting a crawler acquisition mode, a data cleaning module which performs data cleaning in ways of unrelated field cleaning, price and discount price filtering, time stamping and currency automatic conversion, a data analysis module which performs multi-dimensional analysis on tax-related information data through online analysis processing and data mining technologies, a data storage module which dispersedly stores the data in a plurality of independent devices by adopting a distributed storage policy and an extendable system structure, and a data output module used for outputting the data required by a user according to a specific rule. According to the big data tax-related information analysis system, a large amount of tax-related information data is provided for taxation collection and management in real time, and a tax-related information law is found and future tax avoidance and tax evasion trends are predicted by utilizing trend indexes.

A system and method for managing summary tables. A summary table manager is disclosed for managing summary tables in an OLAP (OnLine Analytical Processing) database system, comprising: a query analysis system that generates a set of proposed summary tables based on query statistics gathered for a set of inputted queries; and a system for calculating a performance measure for each of the proposed summary tables based on the query statistics.

The invention provides a flow data processing method capable of realizing multi-dimensional free analysis. OLAP (online analytical processing) technology is adopted to correspondingly classify original flow data and establish relevant association. Simultaneously, relevant association is also established between each classification of flow data and all dimensions, and all classified data share dimension data, so the multi-dimensional free analysis on the flow data can be realized by using multi-dimension to analyze the data layer by layer. A user can take any part of the flow data out in a report form, perform gradual free analysis by using a plurality of the dimensions and select the flow data continuously until a final desired data report is obtained.

The invention discloses a third-party rhochrematic data disposal method, which is characterized by the following: adapting on-line analysis processing (OLAP) technique in the third-party rhochrematic management system; making decision of specific problem for third-party rhochrematic company person; analyzing, inquiring and reporting at multiple-dimension pattern; observing the data regulation from more direct angle.

The invention provides a data preprocessing method for heterogeneous data sources. The method comprises the following steps: reading heterogeneous data from a plurality of heterogeneous data sources; preprocessing the heterogeneous data based on a preprocessing rule library to obtain normalized data; storing the normalized data in a database to be applied to data integration, data mining and/or online analysis processing of enterprises. By adopting the data preprocessing method, politics and law service data can be shared; the method has high generality, and is easy to extend; three times of progressive preprocessing are performed on the data, and a processing process can be traced, so that a processing rule is easy to modify, the data processing efficiency and processing accuracy are increased, and the data can be stored in a unified way based on an error log modification and extraction rule to provide services to the outside.

The invention discloses a data processing method. The method comprises the steps of writing a date switching record in a first log table under the condition that a batch processing triggering request is received, wherein a log type identifier of the first log table is the same as that in a control table; reading a record on that day in the first log table and a file required for batch processing; performing batch processing on day initial data generated on the previous day and comprising a data table set generated by batch processing on the previous day according to the record and the file; and when an online transaction request is received, performing online business processing according to the online transaction request and the first data table set, and writing a transaction record in the first log table, wherein a log type identifier of the first data table set is the same as that in the control table. According to the method, different data are accessed in the batch processing and the online transaction processing, access data conflicts do not exist, and certain businesses of the batch processing do not need to be executed again in the online transaction processing, so that the load of online transaction is reduced.

The invention provides an online analytical processing (OLAP)-based intelligent analysis method and application thereof to the development of a business intelligence (BI) system. In the method, each dimension of a data cube is automatically traversed by cyclic means, and recursive vertical drilling and inter-dimension connection analysis are performed on each dimension, thereby obtaining a plurality of dimension members with the highest contribution degree for a current report total sum or a certain measure and combinations thereof. In the whole flow, manual analysis is not required, only the data cube is required to serve as input, and output comprises each measure in the cube and the combinations of N dimension members with the highest contribution degree for the measures.

The invention discloses a highway network operation-oriented decision support system, comprising a hardware platform and a software system, wherein the hardware platform comprises a data access end, a data interactive processing platform and a user terminal connected by network equipment in sequence; and the software system comprises a data access module, an on-line analysis processing module, a state early warning module, a mining analysis module, an auxiliary decision module and a technical support module. Data generated during highway network operation can be intelligently analyzed, multi-dimensional mining analysis is performed on the data under the support of basic data and knowledge and the coordination of the modules to discover a problem and propose a solving strategy, and a scientific and intelligent decision support system is thus established for providing qualitative and quantitative suggestion for various action decisions for improving the operation and service levels, and assisting in realizing secure, efficient and green goals of on-line operation and service.

The embodiment of the invention discloses a method and a device for analyzing a multi-dimensional query sentence in an online analysis processing server. The method comprises the following steps of: analyzing a multi-dimensional query sentence and generating a syntactic tree according to an analyzed result, wherein a node of the syntactic tree comprises a horizontal axis object, a longitudinal axis object, a slicing axis object, a calculating member object, a calculating unit object and a custom function CDF object; when a multi-dimensional query expression of various objects on the syntactictree is executed, if a function needs to be called, judging whether the function is a custom function or not according to a function definition of the custom function, if so, entering the executing process of the custom function; otherwise, judging whether the function is a standard function or not according to the function definition of a standard function; and if so, entering the executing process of a marking function. By the embodiment of the invention, the working efficiency of a developer in the development process of the whole OLAP system can be improved.

The invention relates to an online analyzing process system and the method that is used to online process the log created from device. The online analyzing process system comprises a log collection module used to dynamic collect the log sent from device; a log analyzing module used to analyze the collected log; log saving module used to store the log after being analyzed; intermediate process module used to intermediate process the log in the log saving module and create and save intermediate result; online analyzing process module used to process and display the intermediate result. The method of the corresponding online analyzing process method includes: log collection and analyzing step, log saving step, intermediate result creation step and online analyzing process step. The invention would realize online analyzing process by intermediate result, so the responding speed and process efficiency would be increased. It can also take dynamic collection and find problem in time.

The invention discloses a financial data service system, comprising an ETL unit, an OSD unit, a data warehouse DW, an on-line analysis processing unit OLAP and an enterprise service bus ESB. A data service subsystem set comprises a plurality of service subsystems which are used for processing relevant data of all subsystems; the enterprise service bus ESB is connected with the data service subsystem set, the ETL unit, the OSD unit and the on-line analysis processing unit for maintaining the same data in different subsystems in a plurality of subsystems at the same time. The financial data service system in the invention can effectively solve the problem of information island, ensure independence of all subsystems, reduce the maintaining cost of IT system and promote data safety, and the service ability of the IT system and utilization ability of all kinds of information reach new height.

The invention discloses a method and device for on-line analysis and processing of large data. The method comprises a storing step and a searching step. The data processed by ETL is assigned to the computing nodes for aggregation calculation. According to the method and device, the method combining the pre-calculation and compression is used to solve the storage pressure caused by large data to OLAP. Storage of historical data over a long period of time is achieved through cold and hot data separation. Moreover, distributed computing is used to separate computing pressure and quickly respond to searching requirements. The method and device for on-line analysis and processing of large data solves the storage pressure caused by large data to the OLAP by adopting the method combining pre-calculation and compression, achieves the storage of historical data over a long period of time through cold and hot data separation, and uses distributed computing to separate computing pressure and quickly respond to searching requirements.

The invention relates to the OLAP recommending technology, in particular to an online analytical processing (OLAP) query log mining and recommending method based on efficient mining of frequent closed sequences (BIDE). In the method, the possible next query is recommended to OLAP users, so that the process of browsing and analyzing multi-dimensional data by the users is simplified. The method has the advantages that: based on the characteristic of query operation in the field of OLAP, fields for expressing OLAP operation in log files are extracted, and the log files are abstracted to form a query sequence, so that the expression method of the log files is simplified; a query pattern is mined in the query sequence by a BIDE algorithm, so that the efficiency of subsequent recommending is improved on the premise of ensuring that the recommending accuracy is not reduced; a suffix tree is established on the query mode, so that a starting point of query matching is not needed to be searched for by a search algorithm in subsequent pattern matching to improve the speed of the pattern matching; and a matching algorithm of a fuzzy query pattern is provided to improve the recommending accuracy.

The invention provides a data processing method and apparatus, and a data query method and apparatus. The data processing method comprises the steps that a load balance server receives a query request used for requesting to query predetermined data; the load balance server selects an OLAP (Online Analytical Processing) server used for processing the query request from an OLAP server cluster according to a selection policy, wherein the OLAP server cluster comprises at least two OLAP servers and the OLAP servers in the OLAP server cluster are independent mutually; and the load balance server forwards the query request to the OLAP server. Through the methods and the apparatuses, the problem that the OLAP cannot quickly make a response to user demands under the condition of high concurrency and large data volume of data stored in a database in related technologies is solved, so that the effect of quickly making a response to the user demands under the condition of high concurrency and large data volume of data stored in the database is achieved and the user experience is improved.

The invention provides a report penetration device and a report penetration method for an online analytical processing system. The device comprises an information transmitting module, an information merging module and a data query module, wherein the information transmitting module transmits context filtering information of a source list to a target list; the information merging module merges the context filtering information of the source list in context filtering information of the target list; and the data query module performs data query and displays the result data according to the context filtering information of the target list. According to the device, the context filtering information of the source list and the target list is combined, and the dimensionality information of the source list and the target list is actually and comprehensively considered, so that the penetrated data has significance.

The present invention discloses a telecommunication report generation system and the method. The telecommunication report generation system comprises a data warehouse for storing the specific format data generated according to the network management data and the service requires, a mapping unit for mapping the data in the network management system data base to the data warehouse according to the specific mapping rules, and a report unit for using the data in the data warehouse to generate a telecommunication report meeting the specific conditions based on the online analytical processing technology. The present invention can adapt to different network layers, different device manufacturers and different data base systems, therefore the users can easily customize the content and format of the report as required, and can select specific time strategy to generate the telecommunication report meeting the specific condition.

The invention provides a fault diagnosis method and system of an intelligent electric meter, and an electronic device. The method comprises the following steps: acquiring test data of the intelligentelectric meter; preprocessing the test data to obtain a preprocessing result of the test data; performing online analytical processing on the preprocessing result to obtain an online analytical processing result corresponding to the test data; and inputting the online analytical processing result into a pre-trained fault diagnosis model, and outputting a fault diagnosis result of the intelligent electric meter, wherein the fault diagnosis model is obtained by training a machine learning model. The method realizes comprehensive analysis of data of fault cases of an electric meter through a machine learning algorithm, and a relevant identification model with high integrality and robustness is formed, so that the accuracy of fault diagnosis of the intelligent electric meter is improved.

The invention provides an online analytical processing method and device. The method comprises the steps that query instructions are received, the query instructions include pending to query conditions; a column storage child library associated with the pending to query conditions in the preset column storage library is determined based on the pending to query conditions, the preset column storage library includes at least a column storage child library, the column storage child library has at least a record according to the column storage, each record includes an identifier and data corresponding to the identifier, data of different column storage child library have different properties; records meeting the pending to query conditions are searched and obtained from the column storage library associated with the pending to query conditions. According to the technical scheme, the disk IO bottleneck problem caused by big data can be better solved, the speed and efficiency of online analytical processing are effectively improved, and large-scale promotions and applications of online analytical processing models are facilitated.