20 results about "Converged storage" patented technology

This invention discloses an intelligent analysis and early warning cloud database system for big data in water conservancy project operation and maintenance, specifically relating to the field of water conservancy project operation and maintenance technology. The system is based on a cloud-native architecture and includes an intelligent data lake warehouse, a time-series graph fusion storage engine, an embedded model computation module, a collaborative early warning and analysis module, and a self-learning optimization module. The intelligent data lake warehouse performs semantic annotation preprocessing on multi-source heterogeneous operation and maintenance data; the time-series graph fusion storage engine deeply integrates domain knowledge graphs with semantically annotated time-series data sequences, logically binding the time-series data sequences to graph nodes through globally unique identifiers to form a time-series-graph hybrid data model; the embedded model computation module deploys dedicated analysis models; the collaborative early warning and analysis module aggregates multimodal evidence chains, schedules model collaborative computation, and performs fusion analysis to generate early warnings; the self-learning optimization module optimizes the model online based on feedback. This invention achieves data fusion storage and intelligent early warning, improving operation and maintenance efficiency and reliability.

The invention discloses a cloud-edge fusion storage system supporting federated learning, and belongs to the field of cloud-edge cooperative control. An edge client comprises a CPU, a GPU, an RAM and a CSD; the RAM and the CSD are organized into a memory pool based on a CXL protocol; in each round of federated learning, the edge client side executes the following steps: acquiring global update data from the central cloud side and storing the global update data into the memory pool; the global update data comprises an updated global model and a global sample accumulative gradient; training the updated global model by using the local data set to obtain an updated local model, and forming local update data by the updated local model and the local sample cumulative gradient; the importance score sequence of the samples in the local data set does not exceed a preset sample quantity threshold value; and uploading the local update data to a central cloud, so that the central cloud aggregates the local update data of each edge client into global update data. According to the invention, the storage efficiency and the I / O performance of the edge client in a stream data federated learning scene can be improved.

The application relates to an ultra-fusion storage system, relates to the technical field of data storage management, and comprises data collection equipment used for collecting monitoring data of a highway toll station, an edge computing device in communication connection with the data collection equipment and used for pre-processing the monitoring data, a network switch in communication connection with the edge computing device and used for transmitting the pre-processed monitoring data, and a computing storage node in communication connection with the network switch and used for receiving the pre-processed monitoring data, analyzing the pre-processed monitoring data and storing the pre-processed monitoring data. The application has the effect of improving data computing storage efficiency.

The invention discloses a secure storage synchronization method for cloud edge fusion, and belongs to the field of computer storage, in the method, a synchronization participant initiates a synchronization request when a file needs to be synchronously modified, a cloud center node is responsible for processing the synchronization request and monitoring resources of each edge node, and the cloud center node is responsible for processing the synchronization request; the system performance is prevented from being affected by a large number of requests of malicious users through a token bucket algorithm, current limiting is achieved under coordination of a cloud center node, direct data communication of all edge nodes is coordinated, a safe communication channel between two synchronous parties is established, and the system safety is improved. By adopting the adaptive method provided by the invention, the synchronization mode is adaptively selected for efficient synchronization according to the network state during synchronization and the size of the file needing to be synchronized; by adopting the improved incremental synchronization method provided by the invention, the overhead of the incremental synchronization process can be obviously reduced; the problems of large storage synchronization calculation overhead, high time delay, limited edge device resources, high isomerism and poor reliability in the existing cloud edge fusion storage are solved.

The application discloses a method, device, file system and storage medium for storage space allocation, and belongs to the technical field of file systems. The method comprises the following steps: receiving a data write request corresponding to a first file; determining a to-be-added data amount of the first file according to a to-be-written data amount, a current data amount of the first file and a current operation pointer of the first file; determining that the to-be-added data amount meets a new storage space allocation condition, and determining that a storage space meets a low residual capacity condition; selecting at least one to-be-fused storage file meeting a low usage condition of a storage page; selecting at least one idle storage page as a to-be-used storage page; and writing data stored in a terminal storage page corresponding to the first file, to-be-written data of the first file and data stored in a terminal storage page corresponding to the to-be-fused storage file into the to-be-used storage page. The application can provide storage space utilization.

The present application relates to a kind of multi-source data processing method, device, electronic equipment and storage medium.The method comprises: obtaining initial multi-source data;After the initial multi-source data is preprocessed, first type data is temporarily stored in distributed cache queue;Based on the identity of each data in the first type data, the first type data is associated and fused, to obtain second type data;According to the preset multi-dimensional hierarchical strategy, each fusion data of the second type data is distributed to the storage layer corresponding to the storage module, and the storage module includes at least two storage layers.The present application realizes the automatic linkage of multi-source data accurate fusion and hierarchical storage by the core design of "fusion-storage automation linkage" and "multi-dimensional hierarchical rule".

This application discloses a data storage method, apparatus, electronic device, and readable storage medium, relating to the field of data storage technology. The method includes: in response to a converged storage instruction, acquiring source data in a first format; on the transmission path where the source data is written to target memory, converting the source data into target data in a second format using an accompanying processing module configured on the transmission path, and packaging multiple target data sets into combined data matching the access granularity of the target memory; and writing the combined data into the target memory. This application has the effects of reducing the computational load on the EU (Entity Memory), improving the utilization rate of core computing resources, optimizing the data processing pipeline, and achieving deep task pipeline parallelism.

The invention discloses a data optimization storage method based on artificial intelligence and a big data system, and relates to the technical field of data storage, and the method comprises the steps: obtaining files, classifying the files into pictures, documents and videos, and extracting the features of the files through different methods; through a multi-modal learning technology, mining semantic association among the pictures, the documents and the videos, and constructing an association graph; performing compression, hierarchical storage and index optimization on the data according to the semantic association and the association graph; according to the method, the data is stored, the storage state is monitored in real time, the storage performance indexes are collected, the model is optimized according to the performance indexes, fusion storage of pictures, documents and videos is achieved, and subsequent file query is facilitated by intelligently analyzing data features and mining semantic association among the data.

The invention discloses a digital port data storage and analysis method and device. The method comprises a data modeling step, a unified storage step, a dynamic expansion step and a query optimization step. According to the method, data of a plurality of traditional discrete business tables are fused and stored in a unified physical table according to a time main line, the association relation between the tables is internalized into a structured format of the data, and dynamic seamless expansion of a data mode and qualitative leap of query performance are achieved through an innovative index strategy and a storage optimization technology. The structure that hundreds of tables are stored in the database is simplified into the structure that only one to three tables are stored, and the maintenance work of the table structure in the database is greatly reduced.

The invention provides a multi-page lookup table cache fusion method and device based on a many-core system. The CPU in the many-core unit issues instructions and data, the GPU, the ALU, the SFU and the FPU respectively execute corresponding operations and generate results, and the many-core unit transmits the operation data and the results to the Cluster; the ClusterControl of the Cluster generates a hash value corresponding to the data, and transmits the data, the result and the hash value to the Group; the Group sends the data, the result and the hash value to a multi-page index module, and the multi-page index module presets paired index pages according to the number of the Group in advance; the multi-page index module buffers data and Hash values, extracts Tag information, indexes to paired index pages corresponding to Group through the Hash values, writes in the Tag information and data in an alternating mode, and then eliminates the instruction competition problem; and transmitting the processed data to the L3Cache according to an index page registration sequence to complete cache fusion storage. According to the scheme of the invention, the consistency of the cache can be maintained, the overlarge overhead is avoided, and the transmission of repeated data is reduced for the data transmission.

The invention discloses an integrated acquisition system and an integrated acquisition method for a slowly-varying parameter and a rapidly-varying parameter, and solves the problems that when an existing Dewei acquisition system is used for acquiring the slowly-varying parameter and the rapidly-varying parameter in a rocket engine test scene, the acquisition efficiency is high; the technical problems of insufficient time synchronization precision of a slowly varying parameter and a rapidly varying parameter, low manual data fusion efficiency, easy introduction of human errors, tedious operation process and weak ability to adapt to a complex aerospace scene exist in the prior art. A parameter classification configuration module, a synchronous trigger control module, a time-sharing processing algorithm module and a fusion storage module are arranged in an upper computer carrying OXYGEN software, synchronous control of a DEWE3-RM16 master control unit and a DEWE3-RM16 slave control unit by adopting a clock can be realized, and the time deviation of a slowly varying parameter and a rapidly varying parameter is controlled within 1ms; and multi-parameter correlation analysis requirements of scenes such as airspace engine test run and spacecraft attitude control are completely met.

The application provides an early warning customized service system based on cloud and local end cooperation, the system comprises: a basic resource layer for integrating cloud computing resources and local hardware resources; a data exchange layer for accessing multi-source heterogeneous meteorological data of satellite broadcast, international meteorological exchange system and local observation system; a digital base layer for cleaning, fusing, storing and managing the gathered data; an algorithm processing layer for identifying meteorological risks and generating early warning decision results; an integrated platform layer for encapsulating computing, data and algorithm capabilities as unified services; a business application layer for realizing comprehensive monitoring, forecast analysis and early warning information release based on the services. The application has the beneficial effects that through the cooperation and deep customization design of the cloud and the edge, the data transmission minimization, the on-demand utilization of computing resources and the efficient, flexible and accurate improvement of early warning capability are realized while ensuring the business continuity in extreme scenarios.

The invention discloses a community cognitive weakness risk intelligent intervention system based on multi-source data fusion. The system comprises an intelligent data gateway layer which collects multi-source data through a household patient end APP, community screening equipment and a hospital medical system; the ontology and standardization mapping layer is used for mapping the intermediate data into a standardization concept entity defined in the domain ontology; the knowledge graph construction and fusion storage layer is used for constructing and storing a panoramic knowledge graph of the cognitive decline patient; the risk early warning module is used for calculating a risk level based on the standardized feature vector and triggering an alarm when the risk level reaches an early warning threshold value; the intelligent intervention module is used for carrying out unsupervised clustering analysis and outputting a crowd classification label, and a scheme generation engine carries out reasoning, matching and combination of standardized intervention components in a classification-intervention rule knowledge graph according to the crowd classification label and a risk level to generate a personalized intervention scheme; and the three-level joint control platform comprises a hospital end, a community end and a household patient end and is used for data sharing, feedback and early warning.

The application belongs to the technical field of databases, and specifically discloses an index column fusion storage method and system, which comprises the following steps: determining a target column, the target column being a data column in a column storage table configured with a PSort index, and the character length of the field type of the original data of the target column being greater than the character length of an index position identifier, the column storage table being a data table adopting a column storage mode, and the index position identifier being used for indicating the position of the original data in an index file; and configuring the field type of the target column as an index position identifier type, so that the index position identifier is stored in each row of the target column. Through the application, high-performance high-compression index column data fusion is achieved, and the disk space occupied by the data file and the index file can be reduced while the query efficiency is taken into account.

1. The name of the design product: super-converged storage management graphical user interface of electronic equipment. 2. The use of the design product: for an electronic device. 3. The design points of the design product: in the graphical user interface. 4. The picture or photo that best indicates the design points: front view. 5. The use of the graphical user interface: the present graphical user interface is used for the display of the super-converged storage management page, and the user can realize the corresponding function by clicking the corresponding control. 6. Other circumstances that need to be explained: "XX" in the interface represents replaceable text and / or numbers and / or letters and / or symbols.

The application is suitable for the field of data storage, and provides an artificial intelligence-based data optimization storage method and system.The method comprises collecting and fusing real-time performance data of storage nodes and logical relationship data of a storage system to form multidimensional monitoring data flow; a candidate fault device presenting early degradation characteristics is identified through a pre-trained fault prediction model to generate a fault early warning signal; a physical topology and a logical dependency graph are constructed to deduce a data availability risk chain and an associated service influence chain caused by the fault; and an active defense strategy of data migration and access path adjustment is formulated and executed according to the risk chain.The application realizes early prediction and full-link risk prevention and control of storage faults, improves data availability and stability of the storage system, and promotes intelligent and active transformation of storage operation and maintenance.

The application provides a data transmission and storage method for autonomous detection in a closed space, and relates to the technical field of emergency rescue, which comprises the following steps: moving and collecting multi-source perception data in the closed space by using an autonomous detection device, and generating space point cloud data by using a simultaneous localization and mapping (SLAM) module carried by the autonomous detection device; performing real-time analysis on the multi-source perception data by using a front-end computing unit of the autonomous detection device to obtain an analysis result, and dynamically generating a priority label representing rescue efficiency of the data according to the analysis result, so as to encapsulate the original data into a data packet of the priority label. The application realizes intelligent perception, elastic transmission and integrated fusion storage of data in an extreme environment.

The embodiment of the invention provides a point cloud storage method and device, a server cluster, a storage medium and a program product. The method comprises the following steps: receiving an original point cloud uploaded by a client based on a reference library service; performing spatial projection segmentation on the geographic area to which the original point cloud belongs to obtain point cloud files corresponding to a plurality of sub geographic areas; according to the point cloud file, performing data retrieval on the memory database to obtain a first retrieval result; wherein the memory database comprises file index information of a plurality of historical point cloud files; the file index information comprises a storage path and a sub-geographic area identifier; and if it is determined that the first retrieval result represents a first historical point cloud file of the sub geographic area to which the stored point cloud file belongs, performing fusion storage on the point cloud file and the first historical point cloud file. According to the method, the point cloud storage space occupation can be reduced, and the point cloud storage management cost is reduced.

The embodiment of the invention discloses a fusion storage method and device for counting and extracting data and actual payment data in reinsurance. The method comprises the following steps: acquiring a fusion bill detail table and a bill adjustment log table in fusion storage of counting and extracting data and actual payment data in reinsurance business processing; determining a target control displayed in the fused bill detail table according to service attribute information in the fused bill detail table and auditing state information in the bill adjustment log table; and displaying the calculation and extraction data in the reinsurance service and the adjustment data corresponding to the actual payment data in the fused bill detail table, and displaying the target control at the adjustment data. According to the method, the calculation and extraction data and the actual payment data are fused and stored in the same data table, and the target control is added in the data table, so that the data in the table can be adjusted, the type of the data is distinguished according to the target control, and the effects of fusion storage and type distinguishing of the calculation and extraction data and the actual payment data are achieved.

Disclosed in the present invention are a method and apparatus for columnar data storage in a database, a device, and a storage medium. The method comprises: writing a data table to be stored; storing data of each column in said data table according to a column header of the column to form an original storage column; generating fused data on the basis of data corresponding to each row in said data table, and performing column-based storage on the fused data to form a fused storage column; and arranging the fused storage column as a new column after the original storage column to generate a fused column-based storage table, and storing the fused column-based storage table into a database. By using the method, on the basis of original storage columns, a new fused column is introduced, in which multiple columns of a data table are fused, such that during multi-column query, data can be preferentially retrieved from the fused column, thereby improving access performance of multi-column query in a column-based storage mode.