34 results about "Data analyst" patented technology

Disclosed in some examples are methods, systems, devices, and machine-readable medium for providing a consumer collections and servicing analytics platform and application to simplify data analyst search and analysis of data from disparate data sources. The platform and application ingest data into a centralized data repository, from a plurality of disparate data sources. The application transforms the ingested data into standardized data using one or more standardized formats and applies custom processing algorithms and data enrichment techniques to the standardized data to generate enriched data. The application automates manual data collection and reporting processes using the enriched data and causes a user interface to be displayed to the user device, the user interface including self-service access to the enriched data in the centralized data repository.

The invention is suitable for the field of data processing, and discloses a data treatment method, terminal equipment and a storage medium. The method is applied to a data facility, the data facility comprises a data platform, a data system and a data tool, and the method comprises the steps of accessing or collecting to-be-governed data; executing a preset operation corresponding to the full life cycle stage on the to-be-treated data, wherein the full life cycle stage comprises a data production stage, a data processing stage, a data circulation stage, a data application stage, a data maintenance stage, a data display stage and a data destruction stage; multi-dimensional data assessment corresponding to the full life cycle stage is executed on the to-be-governed data, assessment results are obtained, and the assessment results comprise a data value assessment report, a data quality assessment report, a data standardization assessment report and a data safety assessment report; and constructing a matrix type responsibility system according to an evaluation result, wherein the responsibility system maps a data engineer, a data analyst, a data manager, a data security teacher and a data quality evaluator to a corresponding life cycle stage in the full life cycle stage. According to the method, the problems of full-flow fault, evaluation subjectivity, role fuzzification and facility islanding in datamation treatment are solved.

The invention provides a construction system for realizing a business intelligent data question-answering system based on semantic recognition, which belongs to the technical field of information and comprises a user interaction layer, a semantic analysis layer, a data access layer, a data analysis layer and a visual presentation layer. A user can input a query request through a natural language, and the system analyzes the intention of the user by using an advanced semantic recognition technology and quickly extracts related information from mass business data. And then, the system visually presents an analysis result to the user in forms of charts, reports and the like through a visual tool, so that a business department is assisted to quickly understand a data trend and make an efficient decision. According to the system, the data query and analysis process is simplified, the dependence on professional data analysts is reduced, the working efficiency is greatly improved through automatic and intelligent means, the operation and maintenance cost is reduced, good expansibility and integration are achieved, and diversified business requirements of business departments are met.

The invention discloses a business intelligent analysis method, system and device and a storage medium, belongs to the technical field of computer science and information, and solves the technical problem that a traditional BI system usually needs professional data analysts and developers to perform complex programming and configuration. The method comprises a low-code platform, an AI Agent agent and a BI system. The method comprises the steps that a service model, a service interface, a service trend display mode and a dialog box for interaction between a user and the AI Agent agent are created through the low-code platform; acquiring data through the service interface and the dialog box; synchronizing the service model and the data through the BI system to form a data analysis data set; importing a business model and data through an AI Agent agent, and creating a large model; obtaining the content asked by the user for the AI Agent agent and a text input by the user; data analysis is carried out based on the large model, and a data analysis result is fed back to the BI system for further analysis; and the BI system returns analysis result data to the low-code platform for data display.

Data analysis system with highly dynamic and interactive data analysis user interfaces which enable data analysts to quickly and efficiently explore large volume data sources. The system enables the user to investigate large volumes of data over many different paths of analysis while maintaining detailed and retraceable steps taken by the user over the course of an investigation, as captured via the user's queries and user interaction with the user interfaces provided by the data analysis system. Data analysis paths may involve exploration of high volume data sets. The data analyst may pursue a data analysis path that involves, among other things, applying filters, joining to other tables in a database, viewing interactive data visualizations, and so on. The data analysis system enables a user to refresh or insert a node in a workflow. The data analysis system further provides data editing, reporting, enrichment, expression language, and charting functionality.

The systems and methods described herein provide highly dynamic and interactive data analysis user interfaces which enable data analysts to quickly and efficiently explore large volume data sources. The data analysis system enables the user to investigate large volumes of data over many different paths of analysis while maintaining detailed and retraceable steps taken by the user over the course of an investigation, as captured via the user's queries and user interaction with the user interfaces provided by the data analysis system. Data analysis paths may involve exploration of high volume data sets, such as Internet proxy data, which may include trillions of rows of data. The data analyst may pursue a data analysis path that involves, among other things, applying filters, joining to other tables in a database, viewing interactive data visualizations, and so on. The data analysis system enables a user to refresh or insert a node in a workflow. The data analysis system further provides data editing, reporting, enrichment, expression language, and charting functionality.

The invention relates to the technical field of operation and maintenance of a maglev traffic system, and discloses a missing data recovery method for health monitoring of the maglev traffic system. The method comprises the following steps: acquiring data detected by each sensor of the maglev traffic system to obtain a data table with missing data; extracting data from the data table with the missing data, and constructing a two-dimensional data matrix with the missing data; constructing a hydrophilic-sparse matrix of the two-dimensional data matrix; constructing an optimization objective function based on the stability of the hydrophilic-hydrophobic matrix; iteratively updating the affinity-sparseness matrix by using the optimized objective function to obtain an updated affinity-sparseness matrix; and carrying out missing data recovery by utilizing the updated intimacy-sparseness matrix to obtain a data matrix after missing data recovery. Therefore, the missing data can be accurately recovered, the availability of the data is greatly improved, and data analysts can conveniently and effectively analyze test results.

The invention provides a sequential sequence fragment search method and system based on multilevel features, relates to the technical field of sequential signal processing, and solves the problems of instability and subjectivity when data analysts manually judge a current sequential sequence. The method comprises the following steps: firstly, slicing time sequence data in a time domain dimension to obtain a plurality of time sequence fragments, and then correspondingly extracting multi-level features including parameter statistical distribution features, differential statistical distribution features and expert-level features; and performing weighted summation on the multilevel features of the sequential sequence fragments to obtain corresponding comprehensive features, and comparing the comprehensive features of the sequential sequence fragments to be searched and matched with the comprehensive features of a plurality of sequential sequence fragments of historical sequential sequence data stored in a database to obtain the closest historical sequential sequence fragment. According to the method, the most similar sequence matching of the time sequence can be realized, and the judgment accuracy and the analysis efficiency of data analysts can be improved by assisting the data analysts.

The present invention relates to the technical field of multidimensional data analysis in big data, and discloses an intelligent dynamic dimensional sorting method and system based on multidimensional feature parameters, the method comprising: creating a commodity hierarchical dimension table containing the atomic dimensions and hierarchical relationships of commodities according to the standard dimensional data of commodities stored in a data warehouse; creating a commodity parameter dimension table containing all parameter types and corresponding parameter values ​​of commodities according to the parameter types corresponding to each commodity and in combination with the hierarchical dimension table; disassembling commodities of different levels according to parameter types, and performing dimensionally differentiated sorting on each parameter value after disassembly through a sorting algorithm. The intelligent dynamic dimensional sorting method and system based on multidimensional feature parameters provided by the present invention solve the problem that traditional business multidimensional definitions cannot be controlled, reduce physical storage space and manual management costs through intelligent analysis and sorting, and can help business data analysts gain insight into key issues more quickly.

The present disclosure relates to a weather prediction data display method, device, storage medium, equipment and system, which obtains meteorological element files corresponding to each meteorological element in multiple prediction files by analyzing and splitting multiple prediction files of multiple prediction lengths, obtains multiple image files corresponding to multiple meteorological elements in different prediction files through analysis and processing of each meteorological element prediction file, and establishes a weather prediction atlas according to the multiple image files, so as to achieve the purpose of covering various meteorological elements of multiple prediction lengths, and help data analysts and on-site operation and maintenance personnel understand the phenomenon and law of meteorological data through image display.

The invention discloses a method for acquiring real-time production data of a cold rolling processing line based on an algorithm script. The method comprises the following steps: configuring relevant parameters for acquiring the real-time production data of the cold rolling processing line; the collected real-time production data of the cold rolling processing line are sent to the time sequence database; judging whether the DB address of the data corresponds to the measured values of the plurality of measuring instruments, and if the DB address of the data does not correspond to the measured values of the plurality of measuring instruments, directly adopting the data in a time sequence database to carry out data analysis; and if the DB address of the data has the measurement values corresponding to a plurality of measurement instruments, performing data analysis on the data according to a first preset rule. The problem that in the prior art, when data needed by a data analyst does not exist in all the DB addresses corresponding to the PLC, the data cannot be directly input into the DB addresses for broker forwarding and then fall into a time sequence library is solved.

The invention provides an LLM-based multi-agent financial analysis collaboration method, and relates to the technical field of artificial intelligence, and the method comprises the steps: carrying out the evaluation and fine adjustment of an LLM, registering agents of a header, a financial analyst, a data assistant, a data analyst, a summary, and the like, and building a pool; a natural language submission requirement of the user; the header pipe utilizes an LLM thinking chain to decompose the demand into dependent subtasks and generate a dependency graph, and a first-level team is established according to the vector similarity of task description and metadata of each analyst; the first-level team decomposes subtasks for the second time, and data assistants and analysts are matched according to similarity to form a second-level team; the second-level team calls a tool to complete a task and writes the task into a shared message pool; summarizing an intelligent agent weighted fusion result output strategy; and the header reports and obtains feedback to the user, and triggers an observation-reflection-iterative loop re-planning task if deviation exists. The financial decision-making efficiency, quality and flexibility are improved, and the labor cost is reduced.

The invention discloses a low-code data visualization and analysis platform and method. The method comprises the following steps: S1, extracting data information required for constructing an application menu by multiple data sources; s2, maintaining data information extracted by customizing query, and supplementing data attributes through dictionary and data table management; s3, expanding a business scene of the created application to carry out data query and interaction scenes; and S4, constructing a visual data component library, and configuring an expected data visual effect through a dragging operation. According to the method, post-configuration is used as a new entry point, and the timeliness and flexibility of data function development are improved for data analysts with SQL development capability.

The invention provides a privacy-protecting 6G offshore intelligent transportation monitoring system and an operation method thereof. The system comprises three heterogeneous 6G networks, namely an ocean network, a land network and a space network. The ocean network comprises an unmanned aerial vehicle, an underwater sensor, an autonomous underwater vehicle (AUV) and a sink node Sink; the unmanned aerial vehicles and the underwater sensors are organized into different unmanned aerial vehicle clusters and underwater sensor clusters according to geographic positions, and each cluster is composed of a cluster head CH and a plurality of cluster members CM; the land network comprises a key generation center KGC, a data center DC and a plurality of data analysts DA; the server is used for data storage, utilization and transmission management; the space network comprises a communication satellite and a satellite signal receiving facility for connecting the ocean network and the land network. According to the method, key challenges such as high public key overhead, replay, vulnerability of Sybil attacks, privacy protection and the like are solved at the same time.

The invention provides a monitoring data processing method and system, a computer and a storage medium, and the method comprises the following steps: obtaining a monitoring data set, so as to judge whether the data output of target monitoring equipment is normal or not; and carrying out time sequence linear regression segmentation fitting on the data to judge whether the monitoring point has a data exception risk or not. By analyzing the data characteristics of the monitoring data set in the collection period of the single monitoring device, the state of the monitoring device is alarmed and prompted. By setting the monitoring time window and performing time sequence linear regression on the index of each piece of monitoring data, the trend of the monitoring data can be automatically monitored and early warned, and the data processing efficiency can be improved; by calculating the online rate and the continuity rate of the equipment, in the project operation and maintenance process, the system can monitor data changes in real time and automatically generate a statistical report, instant decision support is provided for data analysts, and the data analysis efficiency is greatly improved.

The invention provides an information registration method and device, equipment, a medium and a product, and relates to the field of financial science and technology or other related fields. The method comprises the following steps: receiving a log message sent by an application system managed by a data asset system; determining a function module in the application system for triggering the target database from the log message, and determining function information for describing functions of the target database according to related information of the function module; determining first registration information of the target database from a data source system which registers basic information of each database in the application system based on attribute information of the target database in the log message; and performing supplementary registration processing on the first registration information by using the function information to obtain second registration information of the target database. According to the product, the difficulty of determining the source data required by the business personnel by the data analysis personnel can be reduced.

The application provides a code visualization method and a related device, and relates to the field of data processing.The method comprises the following steps: obtaining a data conversion script, the data in the data conversion script being in the form of a table, wherein the data conversion script comprises a plurality of variables, one of the plurality of variables belongs to one of a table, a row in the table and a column in the table, generating a blood relationship graph according to the relationship between the plurality of variables in the data conversion script, the blood relationship graph representing the blood relationship between the plurality of variables, and displaying the blood relationship graph on a view interface where the data conversion script is located. According to the embodiment of the application, the process relationship between the variables in the data conversion script is represented by the blood relationship graph, the blood relationship graph is displayed on the view interface where the data conversion script is located, the data analyst can analyze the data process realized by the data conversion script, and thus the data analysis is realized.

The present invention discloses a differential privacy method, system and device based on dynamic database histogram publishing, which belongs to the technical field of database privacy protection. The method includes building a tree structure according to time nodes after receiving a data query request based on a histogram in any time range; counting and summarizing the histograms of all time nodes in the tree structure; adding noise that satisfies differential privacy to the histogram of each time node to obtain a noisy histogram and publish it; selecting and summarizing the noisy histogram on the target time node to respond to the data query request. The present invention divides time based on a tree structure to reduce the disturbance of noise, thereby improving the accuracy of histogram publishing. Building a tree structure according to time nodes can be applicable to data queries based on histograms in any time range. Using a tree structure to summarize and perturb all node histograms can respond to any query of a data analyst in a timely manner, thereby improving the real-time nature of query feedback.

The invention provides an index sharing method, an index sharing platform, electronic equipment and a storage medium, the method is applied to the index sharing platform, the index sharing platform is used for providing an index sharing interface, and the method comprises the following steps: displaying one or more indexes on the index sharing interface; and receiving an index subscription instruction of a first user for one index, and putting the index corresponding to the index subscription instruction into a subscription index set of the first user. The indexes provided by the platform or uploaded by other users are displayed in the index sharing interface, and when the user is interested in a certain index, the index can be subscribed. By means of the method, the data analyst can rapidly obtain the latest and most important indexes in the industry, the working efficiency of the data analyst is improved, and the data analyst can conveniently concentrate on actual analysis and application of data.

The invention relates to the technical field of intelligent driving, and particularly discloses a flying book multi-dimensional table-based 4D millimeter-wave radar scene library management method, which comprises the following steps of: acquiring a demand collection table filled by a demand presenter, and automatically generating a demand billboard and a demand pool according to the demand collection table; obtaining a test outline filled by a demand principal, automatically generating a test outline table according to the test outline, and predicting a test calendar and a test board; obtaining an original database filled by a data collector, and automatically generating an original data board and an original database table according to the original database; obtaining a scene library filled by a scene storage person, and automatically generating a scene board and a scene library table according to the scene library; and obtaining a test report filled by the data analyzer, and automatically generating a test report table according to the test report. According to the 4D millimeter wave radar scene library management method based on the flying book multi-dimensional table, management is more convenient, the maintenance cost is lower, no use threshold exists, and the efficiency is higher.

This invention relates to an AI-based automated report generation method, system, device, and medium. The method includes: acquiring a user's natural language query request; parsing the natural language query request, generating and executing a first SQL query statement to obtain an initial result set; performing multi-dimensional analysis on the initial result set to generate at least one array of analytical dimensions; executing the corresponding analytical SQL query statement for each array of analytical dimensions to obtain a dimension dataset, and generating a corresponding result array based on a recommended chart type; and formatting the result array to generate a visual analysis report. This method automates the entire report generation process, reducing the manpower required from developers and data analysts, freeing up resources for high-value tasks, and significantly reducing labor costs. Moreover, from input requirements to report output, the process can be completed in seconds, far faster than traditional manual methods, significantly reducing time costs.

The application relates to a visual component interaction method and system based on a retail industry template knowledge base, which uses a large language knowledge base model to connect user needs, automatically performs demand understanding and key indicator extraction matching, and analyzes charts through an industry knowledge base. Users only need to describe the analysis scene or target through natural language, and the system automatically generates chart results while also providing more analysis perspective suggestions and complete analysis report templates, which are more intelligent and automated, helping users quickly discover hidden information and rules in data. At the same time, users can also use interactive controls or natural language to change the corresponding charts to quickly explore data. In the process of generating new demands for business parties, data analysts can generate examples on the spot through system conversation to avoid subsequent ambiguity and rework rate below 10%, thereby improving the overall business analysis efficiency of enterprises.

The invention provides an SQL (Structured Query Language)-based risk control variable online derivation method and system. The method comprises the following steps: defining a derivation SQL of a risk control variable; establishing a verification task for configuring a verification sample size and a sample time period, and capturing stock data of risk control variables as sample data according to the verification task; performing off-line batch logic verification on the captured sample data based on the defined derivative SQL to obtain a verification result; and submitting the derivative SQL which passes verification for online application, examining and approving the derivative SQL which is applied for online application, and providing the derivative SQL which passes the examination and approval for risk control variable feature derivative production to call in real time. According to the method, risk control online variable derivation is carried out by using the SQL, data analysts can be directly provided for a production environment to be called in real time on line in a system after realizing variable calculation logic through the SQL, and the characteristic derivation efficiency of risk control variables is effectively improved.

This invention provides a cardinality estimation and approximate query processing method and apparatus based on a product network model. In the model construction step, the row number bitmaps of leaf nodes are merged based on accuracy requirements, thereby constructing a product network model with a fused bitmap that achieves high accuracy and minimizes inference overhead. In the query processing step, the calculation method of the leaf nodes is determined based on given rules related to accuracy requirements and the query requests decomposed down to the lowest-level product nodes, thus achieving optimal inference accuracy and cost. The method and apparatus of this invention improve the accuracy of cardinality estimation in query optimization, thereby helping to improve query optimization results, reduce query execution overhead, and assist data analysts in real-time analysis of large-scale datasets. By incorporating additional data distribution characteristics, the accuracy of approximate query processing on SPJA queries is improved, thereby enhancing user experience and increasing the effectiveness of decision-making.

The invention provides a data correlation analysis method and system, a readable storage medium and a computer, and the method comprises the steps: carrying out the filtering and smoothing of monitoring data, and carrying out the data aggregation of the monitoring data after the filtering and smoothing, and obtaining an optimized data set; grouping the monitoring data according to a pairwise combination mode to obtain grouped data; performing data correlation analysis on the grouped data to obtain a corresponding data correlation analysis result; sorting according to the data correlation analysis result to obtain ranking differences of the grouped data, and calculating Spearman level correlation coefficients corresponding to the grouped data according to the ranking differences of the grouped data; and performing correlation judgment on the corresponding grouped data according to each Spearman level correlation coefficient to output a data judgment result. According to the method, relevance judgment can be performed on a pair of data, unified processing and analysis can be performed on multiple items of data, and powerful decision support is provided for data analysts.

The application discloses a multi-dimension index data query method and device, equipment and a storage medium. The method comprises the following steps: associating business data with dimension configuration data to obtain dimension-based business data; calculating the index value of each dimension according to the dimension-based business data to obtain index result data; storing the index result data in an HBase, wherein the HBase comprises the corresponding relationship between the dimensions and the indexes; receiving a query request from a client, and querying the corresponding index data in the HBase according to the dimension information and the index information in the query request. The index data query method can read different indexes by using the same index query service interface. When a new space-time dimension index needs to be calculated, the configuration file of the associated dimension and the business data only need to be modified, so that the rapid calculation of the existing indexes can be realized. The development and test workload is reduced, the data can be quickly put online, and the analysis efficiency of the data analysts is improved.

The present invention belongs to the field of game data analysis, and discloses a game data analysis system based on machine learning, including an analysis terminal, an authorization terminal and a database terminal; the authorization terminal is used to set multiple database authority ranges for data analysts, including: setting corresponding database ranges for each type of authority verification data respectively; the database terminal is used to store the corresponding database authority ranges for each type of authority verification data, and store game data; the analysis terminal is used to obtain the authority verification data and the download request, and send the authority verification data and the download request to the database terminal; the database terminal is used to determine whether the download request is legal according to the authority verification data, and if so, return the corresponding data to the analysis terminal according to the download request; the analysis terminal is used to analyze the data returned by the database terminal to obtain the analysis result. The present invention effectively improves the efficiency of data analysis.

Embodiments of the present invention relate to a novel approach to automatically detect the occurrence of evoked potentials, quantify the attributes of the signal and visualize the effect across a high number of spinal cord epidural stimulation parameters. This new method is designed to automate the current process for performing this task that has been accomplished manually by data analysts through observation of the raw EMG signals, which is laborious and time-consuming as well as being prone to human errors. The proposed method provides fast and accurate framework for activation detection and visualization of the results within five main algorithms.

The invention discloses a robot stacking rhythm optimization and parallel processing method. Comprising the following steps that initialization robot parameter information is established, information collection is carried out, a central scheduling unit produces stacking poses and action paths, the central scheduling unit carries out dynamic task scheduling and distribution, multiple robots carry out parallel execution and real-time optimization, and the stacking robots execute stacking tasks and work completion reset and exception handling are carried out. And the central scheduling unit adopts a heuristic algorithm to perform data analyst on the structured material data set, obtains a stacking pose planning result, and then generates an optimal motion track of the robot according to the stacking pose planning result. According to the method, through full-process beat optimization, the single-task operation time is effectively shortened, meanwhile, the deviation problem in the operation process is solved through a real-time dynamic adjustment mechanism, the beat stability is ensured, and in addition, through parallel processing, efficient collaborative operation of multiple robot units is achieved, and the efficiency advantage of parallel operation of multiple robots is fully exerted.

The embodiment of the invention belongs to the technical field of data processing visualization, is applied to a data volume visualization statistics scene, and relates to a data statistics visualization method, device and equipment and a storage medium thereof.The data statistics visualization method comprises the steps that all task execution nodes covered by a data statistics task are displayed in a data statistics visualization component in a task execution flow chart mode; identifying a non-tail-end task execution node and a tail-end task execution node according to the execution logic relationship among all the task execution nodes; and displaying data statistics results respectively corresponding to the non-tail-end task execution nodes and the tail-end task execution nodes at the interface display reserved positions in a distinguished manner, and completing data statistics visualization. Especially in data statistics scenes with relatively complicated data such as bank data statistics and financial institution data statistics, the data statistics visualization method is adopted to display the data entry quantity counted by each task execution node to a target interface, so that data analysts can be assisted to intuitively understand a data statistics result.