69results about How to "Improve data analysis efficiency" patented technology

The invention discloses a visual analysis method and system, and belongs to the field of big data visual analysis. The visual analysis method comprises the steps of collecting data sources for data sources; performing data association on the data sources, and generating a data association library list; on the basis of the data association library list, creating a data library; on the basis of the data library, generating a visual analysis engine; performing visual analysis on the visual analysis engine, and outputting a visual result through an interaction engine. According to the technical scheme, efficient data analysis can be achieved, a project period can be shortened, and data visual analysis and presentation can be achieved.

The invention discloses a method for analyzing and diagnosing failure. The method comprises the following steps: acquiring failure diagnosing information and data information of the adopted analysis method, wherein the failure diagnosing information comprises a diagnosing object and a failure reason; providing the failure diagnosing information for a maintenance terminal, and receiving feedback information determining whether the failure diagnosing information is correct from the maintenance terminal; and according to the feedback information, counting and storing the data information comprising the analysis method and the failure diagnosing information. In addition, the invention also discloses a system for analyzing and diagnosing the failure. The technical proposal can improve the efficiency of analyzing and diagnosing the failure.

The invention discloses a method for visually analyzing a city common bicycle system borrowing and returning mode. The method comprises steps that 1, the common bicycle data is collected and is further pre-processed; 2, a geographic view is designed on the basis of the spatial perspective, geographic position distribution of a station is visually displayed, a space filtering function is further provided, and an analyzer is facilitated to interactively select a station or a station set; 3, on the basis of the time perspective, a single station borrowing and returning time domain heat view is designed; a visual coding mode similar to a table is employed to display borrowing and returning change and difference of a certain station at different time segments; 4, on the basis of the spatial perspective, a station borrowing and returning association view is designed, and multiple-to-multiple station borrowing and returning relationships are displayed; and 5, a multi-attribute view is designed. The method is advantaged in that understanding of traffic management staff about an operation situation of a common bicycle system can be effectively improved, data analysis efficiency is improved, and auxiliary decision is provided for station management and vehicle scheduling.

The invention provides a wafer test system. The wafer test system comprises a test unit, a control unit, a data storage unit and a display and interaction unit, wherein the test unit is used for testing wafers and storing test data into the data storage unit, the control unit is used for extracting test data of a designated wafer from the data storage unit according to an instruction received by the display and interaction unit and controlling the display and interaction unit for displaying the specific test data of the designated test wafer through one-two-dimensional images according to a designated display mode. The wafer test system is advantaged in that a problem that the specific test information of a test wafer can not be conveniently acquired by a traditional wafer test system in the prior art is solved.

The invention belongs to the information technology field of the construction industry, and provides a building information model file segmentation method based on IFC standard for the distributed data analysis of the building information model. The method comprises the following steps of: reading and analyzing a source file of a building information model based on IFC standard; determining a filesegmentation mark according to the result of the source file analysis and the default parameter of a node of a distributed data analysis system; extracting a component object contained in a sub-fileaccording to a file splitting flag; decoupling the data of the resource layer entity according to the association relation of the entity object, and obtaining all the associated data of the componentobject; Finally, according to the IFC standard, the model spatial structure file and the data independent sub-file are generated. The invention realizes the building information model file segmentation based on IFC standard, provides a reasonable source file preprocessing scheme for the distributed data analysis of the large volume model, can effectively reduce the processing pressure of the system node and improve the model data analysis efficiency.

The invention provides a data analysis method, device and system of a database. The data analysis method of the database comprises the following steps: establishing an array list; scanning to obtain key names of all keys in a target database and storing in the array list; transmitting a data analysis instruction to the target database according to the key names in the array list to obtain data quantity corresponding to each key in the target data; sorting the keys in the target database according to the data quantity. By using the technical scheme, processing of a magnetic disk file of large data quantity is avoided, the analysis speed is high, and the data analysis efficiency is obviously improved.

The invention discloses a distributed scheduling analysis method, system and device for big data, and a storage medium. The method comprises the following steps that: a scheduling service side module obtains the use state information of a distributed operation server in sequence, and according to the use state information, the operation server which conforms to a resource idle state is selected to operate an operation program; and a big data analysis module adopts a componentized operation frame to carry out big data analysis processing on data which operates the operation program. Through a distributed scheduling way and a mature operation framework, operation processing performance and data analysis efficiency based on big data can be effectively improved.

The embodiment of the invention discloses a live broadcast data processing method and device, a computer and a readable storage medium, and relates to a data transmission technology in the field of big data; and the method comprises the steps: enabling middle station equipment to obtain a live broadcast data stream pushed by a live broadcast platform according to a middle station interface and a data access protocol, the data access protocol being a communication protocol agreed between the live broadcast platform and the middle station equipment and generating the middle station interface bythe middle station equipment based on a data access protocol; searching a target playing channel matched with the live broadcast data stream in the at least two playing channels, and obtaining a target channel interface generated by the target playing channel based on a live broadcast forwarding protocol, the live broadcast forwarding protocol being a communication protocol agreed between the target playing channel and the middle station equipment; and calling back a target channel interface to push the live broadcast data stream to the target playing channel, so that the target playing channel outputs the live broadcast data stream. According to the application, the live broadcast data processing efficiency and the live broadcast data stream pushing real-time performance can be improved.

The invention relates to the technical field of an Internet of vehicles, particularly an Internet of vehicles system with an inspiring function. The Internet of vehicles system is composed of a plurality of vehicular systems, a network feedback control platform and a plurality of external inspiring docking platforms. The vehicular systems, the external inspiring docking platforms and the network feedback control platform are all connected through a network. The new system with a generalization feature and a big data analysis capability in the field of traffic is realized. Quantitative evaluation is carried out on driving behaviors of vehicle owners, equivalent matching is carried out by the external inspiring docking platforms, the social benefits of the driving behaviors are realized, so the utilization frequency of the private cars is reduced, drivers are facilitated to select green travel when there is a traffic jam, the conversion of a traffic mode is guided, the social traffic condition is effectively improved through multi-party union, demands of people are satisfied more effectively, and the problem in the prior art is solved.

The invention relates to an Excel document data analysis method. The method comprises steps as follows: step 10, acquiring a document flow of an Excel document requiring analysis; step 20, analyzing the document flow, and acquiring information about workbooks and worksheets in the document flow; step 30, reading xml (extensive markup language) documents corresponding to the worksheets respectively through multiple threads; step 40, analyzing xml documents of shared data in the document flow, and finding storage locations of the shared data corresponding to the worksheets and reading the storage locations through the multiple threads; step 50, performing analysis in combination of the xml documents corresponding to the worksheets and the shared data corresponding to the worksheets through the multiple threads so as to acquire data of the Excel document. The invention further relates to an Excel document data analysis device. The Excel document data analysis method and device are generally applicable to the all kinds of formats of Excel documents and can be applied to larger Excel documents, and the data analysis efficiency is improved.

The invention discloses a network attack behavior simulation system for a power grid enterprise, and the system comprises a data package distribution module which is used for distributing a path IP address for a data package entering the simulation system; a plurality of data simulation modules which are used for performing simulation operation on the received data packets, wherein each data simulation module is internally provided with a program calling interface, a data communication interface and a safety probe interface; a preset program database which is used for storing a preset program and is in communication connection with the data simulation module through a program calling interface; a safety probe monitoring module which is connected with the data simulation module through a safety probe interface and is used for monitoring attack behaviors; an attack behavior characteristic monitoring module which is connected with the data simulation module through a data communication interface and used for extracting and comparing the attack behavior characteristics. The defects in the prior art can be overcome, and the attack behavior detection speed and accuracy are effectively improved.

The invention discloses an interactive data analysis method and device, electronic equipment and a computer readable storage medium. The method comprises the steps of determining an index field and adata aggregation type for data retrieval based on a data analysis selection operation executed by a user on a visual chart displayed at a front end; retrieving to-be-analyzed data corresponding to theindex field from a preset database; performing data aggregation analysis on the to-be-analyzed data according to the data aggregation type; the aggregation analysis result is displayed at the front end, so that interactive data analysis based on a visual chart is realized, and the data analysis efficiency is improved.

A data analysis method includes steps of: obtaining at least one data table; wherein the data table includes a plurality of fields, and each of the fields stores field data; analyzing the field type according to the field data; determining a field category for each of the fields; calculating the similarity between the fields in different tables; determining the correlation between each of the fields according to the similarity; generating a field data description file according to the field type, the field categories and the correlations; and determining whether the field data description file is abnormal. A data analysis system is also disclosed.

The embodiment of the invention discloses a data analysis method based on the Internet of Things. The method comprises the steps that a data analysis request sent by Internet of Things equipment is acquired; wherein the data analysis request comprises demand information of the Internet of Things equipment and to-be-analyzed data; an algorithm resource corresponding to the demand information is determined in a preset resource library, the preset resource library comprising at least one algorithm resource, and the algorithm resource being used for representing at least one algorithm for realizing data analysis; an execution resource corresponding to the algorithm resource is created, wherein the execution resource is used for representing a reference mode of the algorithm resource; and the to-be-analyzed data is analyzed according to the execution resources and the algorithm resources. Therefore, the data analysis efficiency of the Internet of Things can be improved. The embodiment of the invention further discloses a terminal, a data analysis device based on the Internet of Things and a storage medium.

The invention provides a general parallel analysis method and device for airborne binary files and electronic equipment, and relates to the technical field of computer data processing. The method comprises the following steps: respectively configuring storage structures of binary files of different file types, including file headers of the binary files, contained data blocks, and data structures, data types and transfer functions of the data blocks; and reading the data blocks according to the configuration information, adding the theme information and the timestamp tag, and sending the data blocks, the additional theme information and the timestamp tag to a message queue, so that a consumption end of the message queue acquires the data blocks in the queue in parallel, acquires the data structures, the data types and the corresponding transfer functions of the data blocks according to the theme information, analyzes the data and stores the data in a text file. A user-defined file analysis rule is achieved through graphical configuration, and universal parallel analysis of binary files of different models is achieved; and the message queue is adopted to analyze and decompose the binary file into data block production and data analysis consumption, so that the large file analysis time is greatly shortened.

The invention discloses a power grid development-oriented multivariate information mining analysis method and system. The method comprises the steps of obtaining related influence data in a power gridsystem operation scene; preprocessing the data to obtain a multivariate information integrated data set of internal and external data; performing time-space correlation degree classification analysison all the data sources, and determining distribution difference and characteristics of resources such as loads and power supplies in different operation scenes in space dimension; determining space-time correlation characteristics of power grid operation information in various external environments; and determining and adjusting a power grid planning and reconstruction architecture scheme. Dataintegration, data preprocessing and data analysis are carried out according to internal and external multivariate information data during power grid operation, an effective information set is formed according to power grid development diagnosis indexes, and the data analysis efficiency is improved by adopting parallel computing; the whole power grid development process is studied, and data space-time correlation characteristics and dynamic change rules are obtained through data mining, so that a power grid planning and reconstruction architecture scheme is determined and adjusted.

The invention provides an intelligent water level monitoring analysis early warning method and system, and the method comprises the steps: obtaining the environment information of a first monitoring site; obtaining a first distribution instruction; carrying out position distribution on the water level sensors; enabling the water level sensors to continuously collect front-end data to obtain a first water level data set; inputting the first water level data set into an analog input module to obtain a first output signal; uploading the first output signal to a cloud platform through an Internet of Things DTU module to obtain a first water level data packet; acquiring a first analysis instruction, enabling the cloud platform to analyze the first water level data packet according to the first analysis instruction, and obtaining a first analysis result; and obtaining first reminding information according to the first analysis result. The technical problems that in the prior art, on-site water level monitoring is inconvenient, the accuracy of water level monitoring data is low, the data analysis difficulty is large, the monitoring result cannot be checked in real time, and the timeliness and efficiency of water level over-limit alarm are low are solved.

The present invention provides a data analysis method and device. A test data analysis result of the mobile network can be quickly and automatically output through adoption of an autonomously writtendata analysis method, and the data analysis efficiency is improved. The method comprises the following steps: acquiring key index data of a sampling point; based on the serial number of the main service base station of the sampling point and the serial number of the main service base station cell of the sampling point, matching an existing network database to determine the name of the main servicebase station cell of the sampling point, wherein the current network database comprises one or more of the name of at least one main service base station cell, the azimuth angle beta of the at leastone main service base station cell, the longitude and latitude of the at least one main service base station cell or the quadrant where the azimuth angle beta of the at least one main service base station cell is located; and determining a problem cell based on the key index data and data corresponding to the name of the main service base station cell of the sampling point in the current network database.

The invention discloses a method for protecting a data analysis tool of a reactive voltage control system. The method comprises the steps that firstly, a statistical range is determined, wherein the device operation frequency in a repair cycle, the initial operation frequency Ms, the automatic operation frequency of the reactive voltage control system Ma, the monitoring personnel manual operation frequency Mm, and the maintenance frequency upper limit Mmax of a certain device are within the statistical range; secondly, the device operation frequency Mr in the repair cycle is calculated; thirdly, data confidentiality measures are taken; fourthly, the operation process is conducted, wherein after last-time maintenance of a supply network device is completed, the reactive voltage control system conducts statistics on the Mr according to the first step and the second step, when the Mr exceeds the limit, operation and maintenance personnel are informed of the fact that the device needs maintenance, the operation and maintenance personnel send a maintainer to maintain the device on the site according to the process, a report is sent to the operation and maintenance personnel after the maintenance process is completed, monitoring personnel are notified to conduct zero clearing on the Mr in the reactive voltage control system, statistics is conducted again, and the steps are executed in a circulating mode.

The present invention discloses a real-time data processing method on the industrial equipment side, and belongs to the technology in the field of data analysis. The method comprises the following steps that: Step S1, a user selects, through a user terminal, multiple measurement points that need to perform data collection, and an intelligent terminal connected with the associated measurement pointis taken as an associated terminal; Step S2, the user terminal generates an analysis program including a data configuration file and sends the analysis program to the server; Step S3, a correspondingdata processing instruction is sent to the associated terminal; Step S4, extracting feature data of the associated measurement point according to the real-time operating data; Step S5, the feature data is fed back to the server; and Step S6, the server obtains a corresponding data analysis result. The technical scheme of the present invention has the beneficial effects that the amount of data transmission is reduced, the real-time performance of data processing and the efficiency of data analysis are improved, the operating efficiency of the server is improved, and the maintainability and robustness of the system are improved.

The invention relates to a wireless network mass data storage method which comprises: each network element data server, according to the preset integration strategy, processes the original data captured from the corresponding network element and stores the data, and reduces the data to the secondary data under the premise of guaranteeing the necessary analytic information; each network element data server, according to the preset data acquisition strategy, centralizes the data required for the statistics in a data server from the secondary data stored therein, and sends the data to a centralized data server for storage via the network. The method constructs the hierarchical data storage, and according to the service rule and analysis requirement, extracts the mass original data at different hierarchies on the premise of guaranteeing the necessary analytic information, to form the hierarchical data. Additionally, the method can prolong the storage period of secondary data hierarchy by reducing the storage period of the original data, that is, the method can meet not only the requirement of original data query but also the statistical requirement for routine maintenance and centralized control, and provide strong support for the field network maintenance and optimization.

The invention discloses a monitoring method for land reclamation in a mining area, comprising the following steps: collecting data of basic land parameters of a mining area to be monitored and determining a plurality of monitoring indexes for land reclamation; A physical model of the mining area to be monitored is constructed according to the collected basic parameter data, and a plurality of monitoring indexes are arranged on the physical model of the mining area to be monitored by a virtual actuator, so as to establish a relationship with each element in the physical model of the mining areato be monitored; The simulation analysis module and virtual sensor are inserted into the obtained physical model of the mining area to be monitored. Based on the data acquisition module, the real-time collection of specific data of multiple monitoring indicators is carried out, and the collected data is fed back to the virtual actuator. The virtual actuator driving simulation module calculates and solves different parameters, and the virtual sensor displays the results. Based on the real-time collection of a plurality of reclamation indexes, the invention comprehensively monitors the land reclamation situation of the mining area, and realizes the visualization of the land reclamation situation of the mining area.

The invention relates to a fuel cell vehicle heat balance test device and test method. According to the test device, a vehicle control unit CAN bus, an analyzer, a current sensor, a voltage sensor, atemperature sensor, a pressure sensor, a flow sensor, a wind speed sensor and a data acquisition module are adopted to synchronously acquire key signals of current, voltage, temperature, pressure, flow, wind speed and the like of key components such as a vehicle passenger compartment, an electric pile, a cooling water pump, a radiator, a heater, a battery, a motor, a controller and the like, and can also acquire signals of an environment bin and a chassis dynamometer; and therefore, signal acquisition is comprehensive and reliable. The fuel cell vehicle heat balance test device and test methodcan be used for high-temperature heat balance test and research and development verification of fuel cell vehicles. According to the test device, CAN data are adopted, so that the problem that some thermal management test key signals of a vehicle are difficult to obtain can be effectively solved.

The invention belongs to the technical field of data analysis, and particularly relates to a data analysis method based on a block chain. Aiming at the problems that when an existing regional chain is applied, all data are generally stored and applied through a host, all data need to be compared when data analysis is carried out, the operation amount is larger, and therefore, the operation efficiency of a host is affected, the invention proposes the following technical scheme that the method comprises the following steps: S1, creating a plurality of data storage nodes, and performing classification setting on each data node; S2, collecting legal data information, classifying the collected data through a central controller, and respectively storing the collected data in corresponding data nodes; S3, carrying out unit classification on the data information in each node, and creating a unit window. The system is simple to operate and convenient to use, and can perform point-to-point comparative analysis processing on data information, so that the operation load of a central processing unit is reduced, and the data analysis efficiency is improved.

The invention relates to the technical field of satellite navigation, and discloses a satellite navigation monitoring system and monitoring method. The satellite navigation monitoring system comprisesa signal receiving module, wherein the output end of the signal receiving module is electrically connected with the input end of a signal analysis value acquisition module, and the output end of thesignal analysis value acquisition module is electrically connected with the input end of a data comparison module; and the output end of the data comparison module is electrically connected with the input end of a log module. According to the satellite navigation monitoring system and the satellite navigation monitoring method, the radio frequency input unit, the radio frequency data integration unit, the sensor unit and the baseband digital processing unit are matched for use, so the radio frequency input unit and the radio frequency data integration unit receive satellite signals; the sensorunit and the baseband digital processing unit receive the position signal of the signal receiving module, so the receiving performance of the system for the satellite signal is further improved, andthe accuracy of the position information of the signal receiving module is ensured.

The invention, which relates to the technical field of terminal application, discloses a data transmission method and device so that useless log data in a mobile terminal can be filtered out and thusthe developer can analyze the log data conveniently and the network resource consumption during the log data transmission process can be reduced. The method comprises: to-be-transmitted log data of the corresponding type are obtained via a classified monitoring interface; a current network environment of the mobile terminal is checked and whether the current network environment has permission of transmitting the to-be-transmitted log data is determined based on a data transmission strategy; and if so, the to-be-transmitted log data are sent to a data receiver based on the current network environment. The data transmission method and device are applied to the process of transmitting the mobile phone application program log.

The invention provides a data processing method which can be applied to the technical field of big data. The method comprises the following steps: in response to triggering a first timed task, extracting incremental government affair evaluation data from a resource sharing center; in response to triggering of the second timed task, performing statistical analysis on the incremental government affair evaluation data based on a statistical index associated with the second timed task and a preset query strategy to obtain a statistical result; storing the statistical result into a result table associated with the statistical index; and in response to a data query request for the target statistical index, determining a target query result from statistical results in a target result table, the target result table being associated with the target statistical index. In addition, the invention also provides a data processing device, equipment and a storage medium.

The invention belongs to the technical field of logistics safety, and discloses a logistics safety information early warning system and early warning method based on big data analysis. After placing an order, a platform automatically randomly generates two-dimensional code information of a buyer and a seller, and displays the two-dimensional code information. After the goods are picked up, code scanning operation is performed by account login. If there is abnormal information, the platform will receive the signal for alarm feedback; a GPS positioner is used to position the vehicle in real time, and the positioning information is transmitted to the platform through the network, and the network sends the information to buyers and customers through the internet; image information of differentcommodities is obtained through the cameras in the ordinary logistics box and the special logistics box. The damage to the commodities caused by collision is fed back for real-time checking and viewing. The method and the system have the advantages of novel thought and convenient use, can ensure the safety of information, can carry out intelligent alarm, enable the buyer to know the location of goods in real time, and can observe the collision damage situation of the commodities purchased by the buyer in the transportation process in real time.

The invention can provide a moving track data processing method and device, a computer equipment and a storage medium. The method comprises the following steps: acquiring crowd movement track data and interest point data in a set area, wherein the set area comprises a plurality of functional areas; matching the crowd movement track data with the interest point data, and generating flow data among interest points according to a matching result, wherein the flow data among the interest points represents movement data of the crowd among the interest points; generating inter-region flow data between any two functional regions based on the flow data between the interest points and the distribution information of the interest points in the functional regions, wherein the inter-region flow data represents movement data of the crowd between the functional regions; and calculating the embedded vector expression data of each functional region according to the inter-region flow data, and performing clustering processing on the plurality of functional regions according to the embedded vector expression data. According to the invention, urban area feature analysis is carried out based on crowd movement trajectory data, and the technical effects of reducing data acquisition difficulty, improving analysis efficiency and the like are achieved.

The invention relates to a data processing method and device, and the method comprises the steps: automatically executing a data statistical task according to a preset timing program, and obtaining a statistical result; according to a preset page template, performing serialization processing on the statistical result to obtain result data; storing the result data into a cache database; the method comprises the following steps: when a viewing request is received, firstly querying whether result data matched with the viewing request exists in a cache database or not; if yes, the corresponding result data is responded to the request end; and if not, putting the viewing request into a to-be-processed queue. According to the scheme, effective data can be extracted from mass data according to requirements, junk data and invalid data are avoided in the data analysis process, and therefore the data analysis efficiency is greatly improved; a uniform page template is adopted, so that a data result is convenient to observe; and data in different formats are serialized at the server side, so that interface butt joint during development is facilitated, and the working efficiency is improved.