4520 results about "Data format" patented technology

The invention discloses a geographic information big data-oriented multi-source data processing system, and relates to the technical field of data acquisition and sensors, and the system comprises a data acquisition module which accesses a remote sensing satellite, an unmanned aerial vehicle, an Internet of Things sensor and social media in real time through a multi-source heterogeneous interface, and carries out the adaptive analysis of a data format and metadata marking; the distributed storage module is used for performing partition storage on the geographic information data based on a space-time database and an object storage architecture, and establishing dynamic space-time index and version control; the data fusion module is used for realizing coordinate system conversion, time sequence calibration and semantic knowledge graph matching based on a multi-source data alignment method of dynamic weight distribution; and an intelligent analysis module and a security control module. According to the method, core pain points such as data splitting, low storage efficiency, extensive analysis and compliance risks in the geographic information field are systematically solved, and a full-stack type technical base is provided for scenes such as smart cities, emergency disaster relief and environment monitoring.

The invention belongs to the technical field of artificial intelligence and big data, and discloses a customer data processing and insight system based on a big language model. The system is composed of a multi-source data access module, a data preprocessing and label fusion module, a large language model semantic understanding module, a knowledge enhancement and semantic linkage module, an insight generation and visualization module, an intelligent strategy output module and a feedback learning and self-optimization module. According to the method, multi-source heterogeneous data such as texts, voices and structured behaviors are integrated, and the deep semantic analysis capability of a large language model is combined, so that global modeling of customer behaviors and intentions is realized; a multi-modal synchronous acquisition and standardization mechanism eliminates data format barriers, and a dynamic label mechanism adapts to context changes, so that the system can capture deep semantic association in customer expression, and compared with a traditional keyword matching method, the semantic understanding accuracy is improved by more than 40%, and a more complete data base is provided for insight generation.

The invention discloses an intelligent file classification and retrieval method and system, and the method comprises the steps: carrying out the unified format conversion and feature extraction of text, image and audio data according to the original data format of a file through a multi-modal data fusion algorithm, and obtaining a standardized file feature data set; based on a deep learning adaptive classification model, performing classification processing on the standardized archive feature data set to generate multi-level archive classification labels; analyzing the semantic relationship between the archive classification labels through an enhanced semantic network construction technology, generating a semantic association map, and optimizing the semantic association map to obtain an optimized semantic association map; and according to a retrieval request input by a user, performing semantic matching and correlation sorting by utilizing the optimized semantic correlation graph, and outputting archive information most related to the retrieval request. By utilizing the embodiment of the invention, the relevance and accuracy of retrieval can be improved, and modernization and intellectualization of archive management are promoted.

The invention discloses an industrial equipment fault prediction method based on multi-modal data, and belongs to the technical field of specific calculation models, and the method comprises the steps: carrying out the preprocessing according to the collected multi-modal data of the operation of industrial equipment, so as to unify the format of the multi-modal data, and obtaining the structural data; extracting features of the structured data one by one according to data categories, and obtaining a multi-modal fusion feature through a dynamic fusion mechanism; according to the multi-modal fusion features, a fault prediction classification score is obtained through a deep neural network model to perform fault prediction; and when the drift parameter of the multi-modal data is greater than a preset threshold value, performing incremental training on the deep neural network model through the multi-modal data collected in real time to update parameters of the deep neural network model. Through multi-modal data unified processing, dynamic feature fusion, deep neural network modeling and an online learning mechanism, the problems of insufficient multi-modal data fusion, prediction uncertainty quantization deficiency, poor model adaptability and the like are solved.

The invention discloses a multi-dimensional carbon flux monitoring method, and particularly relates to the technical field of carbon flux monitoring, and the method comprises the following steps: collecting multi-source heterogeneous sensor data, and carrying out spatial resolution unification, time synchronization alignment and data format standardization preprocessing to ensure data consistency; executing fusion validity detection, and correcting time synchronization deviation and data redundancy conflicts; according to an abnormal detection result, dynamically adjusting a fusion weight or determining a weight based on historical clustering, and combining spatial adjacency interpolation and time interpolation to realize data fusion; and finally, inputting a carbon flux inversion model, and outputting a high-precision carbon flux monitoring value to realize dynamic monitoring and prediction. According to the method, a dynamic fusion weight adjustment mechanism is adopted, the fusion weight of each data source is dynamically optimized, adaptive fusion of multi-source observation data is realized, the problems of data discontinuity and insufficient data coverage in the prior art are solved, and a multi-dimensional, full-coverage and high-resolution carbon flux fusion data set is ensured to be formed.

The invention discloses a geological disaster early warning method and a precise early warning system based on multi-source data fusion, and relates to the technical field of geological disaster early warning. According to the method, multi-source heterogeneous data such as remote sensing, meteorological and geological monitoring are fused, a standardized protocol is utilized to unify a data format and temporal-spatial resolution, a standardized data set is formed, key features are extracted by adopting principal component analysis and a recursive feature elimination algorithm, and a long-short-term memory network and a convolutional neural network model are combined, so that the real-time performance of the system is improved. According to the method, the disaster risk is accurately predicted, the space risk distribution diagram is generated, in addition, through application of the real-time stream processing framework and the self-adaptive learning algorithm, rapid distribution of early warning signals and dynamic optimization of model parameters are achieved, the accuracy and timeliness of an early warning system are remarkably improved, and the geological disaster risk is effectively reduced.

The invention relates to the technical field of medical data management, in particular to a medical data document classification and marking system which comprises a document structure analysis module, a semantic information identification module, a classification and marking module and a document intelligent label module. According to the method, document visualization and retrieval efficiency is improved by analyzing document content and extracting titles, texts and appendixes, analytic performance and operability of data are enhanced by identifying key information and semantic relations and accurately extracting and labeling medical terms, medicine research data and medical record records, storage is optimized according to priorities in combination with classification and marking, and the method is high in practicability and easy to popularize and use. Clinical values and application scenes of documents are clarified, document management processes are refined, management compatible with clinical data formats is formed through structured storage of marked data and classification label generation, storage normalization and retrieval efficiency are improved, the requirement for accurate information calling in clinical tests is met, document management capacity is improved, and the document management efficiency is improved. And support is provided for improvement of clinical decision-making and research efficiency.

The invention discloses a method and a system for realizing data synchronization between heterogeneous databases based on logs. The method comprises the following steps: acquiring connection information of a source database and a target database; querying a table structure of the source end database and generating an SQL statement to establish a data mapping rule; matching a corresponding rule model from a mapping rule model library; if the matching is not successful, the system abnormally quits and prompts the user to create a new mapping model and add the new mapping model to the mapping rule model base; converting a table structure of the source end database into a JSON character string based on a standard field type; an SQL statement required by the target database is output through the data mapping engine module; the message monitoring program reads the data in the temporary storage area and converts the data into data meeting the requirements of the target database; formatting the converted data into SQL statements supported by a target database; and sending the generated SQL statement to a target database to complete data migration. Accurate and controllable synchronization of the data and the model in a heterogeneous environment is realized.

The invention relates to a metro field large language model evaluation method and system. The method comprises the following steps: step 1, constructing a data set; the step 1 comprises the following steps of: 1.1, collecting public professional data; step 1.2, collecting internal professional data; 1.3, collecting a general data set; 2, data processing; in the step 2, the following steps are executed: step 2.1, data formatting; step 2.2, data cleaning is carried out; step 2.3, performing data enhancement; 3, fine adjustment of the model; in the step 3, the following steps are executed: step 3.1: constructing a training data set; step 3.2, fine adjustment of the model; step 3.3, carrying out model evaluation; 4, constructing an evaluation system; in the step 4, the following steps are executed: step 4.1, determining evaluation indexes; step 4.2, constructing an evaluation system; step 4.3, constructing an intelligent agent; step 4.4, multi-agent cooperation is carried out; and 5, performing model evaluation.

The invention relates to an intelligent equipment access system and access method based on an AI large model, and relates to the field of artificial intelligence and Internet of Things. According to the technical scheme, a dynamically adaptive universal object model access framework is constructed, functional attributes, control instructions and data formats of intelligent devices of different brands and protocols are mapped into a standardized logic model, meanwhile, a multi-mode AI large model engine is combined, high-precision voice recognition, voiceprint feature detection and multi-level semantic intention analysis capabilities are integrated, and the intelligent devices of different brands and protocols can be obtained. And an intelligent interaction closed loop of end-cloud collaboration is formed. Semantic analysis adopts a mixed strategy, a natural language instruction is converted through function mapping, a local knowledge base is utilized to match user scene requirements, and external data is queried by means of cloud networking to optimize instruction logic. According to the scheme, the multi-device access and operation and maintenance cost is remarkably reduced, the semantic understanding accuracy and scene adaptability are improved, and the method is widely applied to the fields of smart home, smart medical treatment and industrial Internet of Things.

The invention provides an identity information dynamic desensitization method and system based on SM4 and SM9 algorithms, and the method comprises the steps: carrying out the data segmentation of original identity information, and obtaining sensitive segment information and common segment information; performing key dynamic generation based on an SM4 algorithm, and encrypting the sensitive segment information to obtain encrypted sensitive segment information; extracting a feature value of the common segment information through a preset hash function, and converting the feature value into coded data in a preset format to obtain converted common segment information; splicing the converted common segment information and the encrypted sensitive segment information to obtain preliminary desensitized data; and encrypting the preliminary desensitized data based on an SM9 algorithm to generate an encrypted ciphertext, and embedding a unique identity identifier associated with the original identity information into the encrypted ciphertext in an encryption mode to obtain desensitized identity information. According to the invention, the dynamic desensitization of the identity information can be realized, and the data format can be kept unchanged.

The invention discloses a multi-protocol intelligent interaction heterogeneous device full interconnection method and system, and belongs to the technical field of computers, and the method comprises the steps: S1, collecting data, and deploying edge computing nodes; s2, preprocessing the collected data; s3, performing classification according to task requirements of the data; s4, after classification, determining an optimal communication protocol suitable for the current network condition; s5, realizing data format standardization and communication protocol unification by adopting an OPC UA protocol; s6, on the basis of an OPC UA publishing / subscribing mechanism and a QoS priority mechanism, allowing the equipment to publish or subscribe data in real time and ensuring priority transmission of high-priority data; s7, performing data matching and association, and fusing the data; s8, realizing a global decision; according to the multi-protocol intelligent interaction heterogeneous equipment full interconnection method and system provided by the invention, by introducing protocol unification, intelligent interaction and distributed optimization technologies, the interoperability of multi-protocol equipment and the overall management efficiency of a traffic system can be effectively improved.

The invention provides an erasure code compatible read-write method and system based on a bidirectional data access agency, and relates to the technical field of distributed storage, and the method comprises the steps: employing multi-agent reinforcement learning to construct a heterogeneous resource portrait and optimize task allocation, combining a space-time graph convolutional network and a federated learning framework to construct a data format conversion model, and constructing an erasure code compatible read-write model; data features are analyzed through an encoder based on an attention mechanism, a fragmentation strategy is generated, self-adaptive encoding is achieved through a capsule neural network, data integrity verification and repairing are conducted through a double-layer space attention network and a graph attention network, the data access efficiency of a heterogeneous storage system is improved, data format compatibility is enhanced, and the data access efficiency is improved. And the data integrity is ensured.

The invention provides an electronic information data association method and system based on the Internet of Things. The method comprises the steps that a parallel processing architecture is adopted to execute rapid protocol conversion on a high-priority data packet, data recombination is directly carried out through a pre-compiled conversion rule template, a complex format verification link is skipped, and the integrity and format correctness of the converted data packet are determined; response time and error rate statistical information in the data transmission process are obtained, protocol conversion rules and scheduling strategies are optimized through a feedback mechanism, and if the success rate of certain protocol conversion is lower than a standard value, corresponding mapping rules and verification algorithms are updated; and carrying out standardized packaging on all converted data by adopting a unified data exchange standard, adding an equipment identifier, a timestamp and a data type label, establishing a cross-protocol general data format, and carrying out final distribution after judging whether a data packet meets a standard format requirement.

The invention discloses a multi-source heterogeneous data fusion processing and intelligent analysis method, device and equipment, and relates to the field of data fusion processing.The method comprises the steps that firstly, data in data sources of corresponding types are collected through different collection strategies; performing data preprocessing on the collected data to obtain standard data in a unified format; performing data fusion on the standard data based on the structural features of the data to obtain a fused data set; and determining a target analysis model according to the data analysis target, and performing data analysis on the fused data set. According to the method, various types of data formats can be processed, multi-source heterogeneous data fusion is realized, and through data semantic understanding and a feature-based fusion algorithm, the accuracy and quality of data fusion are improved, and correct data association is established on the semantic level.

The invention relates to the technical field of industrial automation, and discloses a method for detecting abnormal operation of industrial control equipment based on industrial control protocol analysis, which comprises the following steps of: 1, acquiring operation data of the industrial control equipment through at least one industrial control protocol which is a Modbus protocol, an OPC UA protocol or a PROFIBUS protocol, the operation data comprises sensor data, register data and equipment state data of the equipment; and 2, analyzing the collected data packet by using a protocol analyzer, extracting key information related to the equipment operation state, the key information comprising parameters such as equipment working frequency, load, vibration, temperature and pressure, and converting the key information into a uniform data format. By collecting, analyzing and analyzing the operation data of the industrial control equipment in real time, abnormal conditions in operation of the equipment can be found in time, spreading of equipment faults is avoided, and stable operation of the equipment is guaranteed.

A computer-implemented method for performing natural language-based data integration includes causing execution of a data integration application on a remote device via a network and causing surfacing of a GUI corresponding to the data integration application on a display of the remote device. The method includes receiving, via the GUI, a natural language input representing a data integration task, generating, via an LLM, a set of ordered activities corresponding to the data integration task represented by the natural language input, and selecting, via the LLM, one or more APIs for performing each activity within the set of ordered activities. The method also includes generating a data pipeline based on the set of ordered activities and the API(s) for performing each activity, as well as back-translating the data pipeline to a desired data format for execution by the data integration application.

The invention discloses an article recognition system based on computer vision. The article recognition system comprises a multi-modal data acquisition module, a multi-modal data processing module and a computer vision processing module, wherein the multi-modal data acquisition module is used for acquiring multi-modal data through a multi-modal sensor array; the data preprocessing module is used for standardizing a multi-modal data format and generating a time-space aligned multi-modal tensor; the feature extraction module is used for respectively extracting modal specific features from texture, spectrum and geometric dimensions by adopting ResNet50, 3D-CNN and PointNet + +; the multi-modal fusion module is used for constructing cross-modal joint representation; the adaptive sensing module is used for modeling illumination invariance and scene dynamics based on self-supervised comparative learning and a 3D-STMN space-time memory network, predicting a shielded target trajectory by using Kalman filtering in combination with the shielding sensing propagation module, and generating an environment sensing parameter set; and the recognition engine module is used for integrating YOLOv8 detection, Mask R-CNN segmentation and multi-modal decision tree classification, outputting a target bounding box, a category and confidence in combination with the depth data, and generating three-dimensional space coordinates combined with the depth data.

The invention discloses a digital financial data sharing system and method, and belongs to the technical field of digital financial data analysis, and the system comprises a data standardization management module, a data access conversion interface module, a cross-mechanism authentication authority management module, a safety audit risk control module and an intelligent analysis cooperation platform module. The data standardization management module is used for unifying a data format to be XBRL, metadata definition and cleaning rules and eliminating data semantic differences between mechanisms, and the data access conversion interface module is used for supporting multi-source heterogeneous data access and providing a standardized output interface. The cross-institution authentication authority management module is used for realizing decentralized identity authentication based on a block chain technology, zero-knowledge proof and a federated learning technology, and controlling a data access range in a hierarchical manner in combination with role authority, and the security audit risk control module is used for monitoring data flow in real time. According to the invention, on the basis of realizing digital financial data sharing, the problem of data islands can be solved, and cross-mechanism data authentication can be facilitated.

The invention discloses an abnormal behavior detection method based on multi-modal fusion and interpretability analysis, and the method comprises the steps: carrying out the data formatting, and converting unstructured behavior data into structured employee behavior data; thirdly, constructing a daily employee behavior sequence and extracting daily employee behavior characteristics; constructing a daily interaction graph and extracting an embedded representation of each employee node; statistical analysis is introduced to obtain daily employee statistical characteristics; splicing the three features to obtain a daily multi-modal feature fusion vector; and finally, identifying an abnormal vector set through an LOF algorithm, and carrying out importance analysis by adopting an SHAP value analysis method to output an abnormal reason. According to the method, multi-angle and multi-level feature representation is constructed, so that behavior diversity is captured more comprehensively, and perception and representation of complex user behaviors are improved; and meanwhile, fusion detection is carried out based on behavior feature importance analysis, so that abnormal employees can be locked, abnormal behavior reasons can be traced, and the interpretability of an abnormal detection result is enhanced.

The invention relates to an intelligent power data searching method based on a resource map, which comprises the following steps of: S1, integrating power data from different systems, cleaning the data, and unifying a data format; s2, performing entity recognition by using Stanford NLP and BERT, and establishing relation mapping among entities by using a relation extraction algorithm; s3, storing a knowledge graph by using a graph database, mapping entities to nodes, mapping relationships to edges, and establishing multiple types of indexes; s4, natural language query is converted into graph database query languages such as Cypher, and query execution is accelerated by utilizing an index of a graph database to be matched with a cache strategy; s5, on the basis of the established multi-type index, using a query mode prediction model to predict a query mode and dynamically adjusting the index; and S6, adjusting a result sequence based on user history and context information, and executing semantic reasoning to expand a query result according to a semantic concept and a hierarchical structure of the knowledge graph. According to the method, the query efficiency on the large-scale power multi-source data set is effectively improved.

The invention provides an equipment health management method and system for a wind generating set. The method belongs to the technical field of wind power generation, and comprises the following steps: acquiring multi-source data of a wind generating set, preprocessing the acquired multi-source data, and integrating the preprocessed multi-source data into a uniform data format by using a data fusion technology; based on domain knowledge and data characteristics, key features reflecting the health state of the equipment are extracted, and a feature subset with the highest prediction value for the health state of the equipment is screened out through a feature selection algorithm. Key components of the wind generating set are monitored in real time through a high-precision sensor network, and comprehensive collection of data is realized in combination with multi-source information such as a historical fault database and meteorological data.

The invention discloses a multi-source heterogeneous data dynamic protocol security exchange adaptation system, which comprises a protocol analysis engine, a data encryption module, a data format standardization engine and a routing strategy engine, and is characterized in that the protocol analysis engine is respectively connected with a data source, the data encryption module and the data format standardization engine; the data format standardization engine is connected with the routing strategy engine, and the routing strategy engine is connected with the nodes. The invention discloses a multi-source heterogeneous data dynamic protocol secure exchange adaptation method. Comprising the following steps of protocol analysis and data conversion, data encryption and sensitive data desensitization, integrity verification and anomaly detection, routing strategy and intelligent scheduling, data distribution and storage, and dynamic extension and protocol adaptation, and the dynamic conversion of different protocol data ensures that various types of data can be smoothly interacted. Meanwhile, an advanced data security enhancement technology is integrated, multiple protections such as encryption and authentication are carried out on transmitted and stored data, and the data security is effectively improved.

The invention belongs to the field of data analysis, and discloses a data analysis method for engineering consultation digital intelligent management, which comprises the following steps: mapping multi-project heterogeneous data to a unified three-dimensional space-time grid through space-time grid division to form a grid mapping data set; detecting data format and attribute conflicts based on neighborhood correlation analysis, and distributing calibration data through dynamic weight; missing values and abnormal fluctuations are processed by using a time sequence autoregression model and a smoothing technology, and a complete data set with continuous time is constructed by combining linear interpolation and multi-dimensional data fusion; key indexes are extracted to construct a digital mirror image containing spatial positions, time sequences and attribute association, real-time data are synchronized, and outlier grid points are corrected; and multi-scene operation conditions are constructed based on the mirror image data, and a dynamic adjustment scheme is realized. According to the method, heterogeneous data are integrated through space-time grids, digital twinning and multi-scene simulation technologies are combined, and full-period management and risk intelligent decision-making of engineering data are achieved.

The invention relates to a heterogeneous network engineering-oriented adaptive protocol conversion gateway system and a control method, and belongs to the technical field of Internet of Things, and the system comprises a protocol identification module which is used for monitoring a data stream in real time and identifying the type of a protocol used in current communication; the adaptive protocol selection module is used for selecting the most suitable protocol according to the network state and the data flow type; the protocol conversion module is used for data format conversion between different protocols and mapping of header information; the network resource optimization module is used for dynamically adjusting the transmission mode of the protocol according to the current network state; and the data caching and traffic scheduling module is used for scheduling the cache and the traffic when different protocols are switched. According to the method, the problem of compatibility among different network protocols is solved, the data transmission efficiency and the utilization of network resources are optimized, and the method can adapt to different application scenes and is widely applied to environments needing cross-protocol communication, such as the Internet of Things, a smart power grid and cloud computing.

The invention relates to the technical field of data acquisition, and discloses a multi-protocol extensible data acquisition system architecture and method with a unified interface standard, and the architecture comprises a data source management module which is used for storing data source configuration information and distributing protocol identifiers; the protocol adaptation module comprises an analysis unit and a matching unit and is used for realizing data format conversion and protocol compatibility verification; the data conversion module is used for generating target data through format conversion and semantic mapping; the data verification module and the anomaly detection module are used for comparing and monitoring data integrity based on an integrity algorithm and a threshold value; the data quality monitoring module and the early warning module are used for comparing and evaluating data quality through a consistency model and a threshold value; and the result output module transmits the early warning information to a target system. The method comprises the steps of data source configuration, protocol adaptation, data conversion, integrity and quality monitoring, early warning and the like. The system expansibility and the data reliability are improved, and the method is suitable for multi-scene data acquisition.

The invention discloses a reinforcement learning modeling method and device fusing multi-source heterogeneous data, and the method comprises the steps: obtaining the multi-source heterogeneous data from different data sources and having different data formats through an intelligent agent, carrying out the feature extraction through employing a corresponding feature extraction technology, obtaining different modal features, and carrying out the feature extraction through employing a corresponding feature extraction technology; effectively fusing different modal features to obtain environment state representation, and constructing an intelligent model of the intelligent agent by using a deep reinforcement learning algorithm based on the obtained environment state representation; different modal features extracted from different data sources are effectively fused, the fused features can comprehensively and accurately represent the current environment state, the intelligent model of the intelligent agent is constructed by using a deep reinforcement learning algorithm based on the fused environment state representation, and the intelligent model can obtain more comprehensive and accurate environment information, so that the intelligent model can be applied to the intelligent system of the intelligent agent. And the strategy is adjusted in real time to adapt to the change of the environment, so that the generalization ability and the accuracy of the intelligent model are effectively improved.

An apparatus and method for static image of time series measured data to time series translation is disclosed. The apparatus comprises at least a processor configured to receive a static image of time series measured data, convert that static image from its initial domain to a usable time series within another user-selected domain, then to validate the conversion against a confidence threshold.

The invention discloses a medical field large model pre-training and fine tuning method and device based on a knowledge graph, and the method comprises the steps: training a reward model through employing collected medical related text data and a quality marking result, and screening out high-quality data from the newly obtained medical related text data through employing the trained reward model; coding the medical knowledge graph into a text format processed by a large language model, and alternately inputting the high-quality data and the coded medical knowledge graph into the large language model in different batches for model pre-training; and designing an instruction fine tuning data format comprising an instruction, a knowledge graph reasoning path and a generated answer, inputting a training sample constructed in the instruction fine tuning data format into the pre-trained large language model for model fine tuning, and outputting a final answer and reasoning path according to the instruction newly input by the user by utilizing the fine-tuned large language model. According to the method, the professionality of the large language model in the medical field can be effectively improved, and AI application in high-risk fields such as medical treatment is promoted.

The invention discloses an information consultation service system and method based on a cloud computing platform, and the method comprises the steps: accessing a user request through a plurality of channels, analyzing multi-modal data through a natural language processing technology, and carrying out the analysis in combination with the historical data of a user; data formats are unified through data cleaning and standardization tools, the data formats are stored in a cloud computing platform, and user requirements are understood through knowledge maps and semantic analysis; providing related consultation contents based on the user behavior data by using deep learning and machine learning recommendation algorithms; a / B testing and performance analysis are carried out regularly, and the system and the model are optimized; safety is guaranteed by adopting TLS and AES encryption and multi-factor authentication, the performance is monitored in real time, the response type design is adapted to different devices, and user feedback is collected to improve the experience; according to the information consultation service system and method based on the cloud computing platform, the accuracy and adaptability of the AI model are improved through reinforcement learning and deep learning technologies, and more accurate consultation services are provided for users.