698 results about "Data storage system" patented technology

The invention relates to the technical field of natural language processing and artificial intelligence, and discloses a silk path knowledge base intelligent question answering system based on a large language model, comprising a silk path data acquisition module used for acquiring multi-source silk path knowledge data; the silk path knowledge base construction module is used for processing the multi-source silk path knowledge data to construct a structured knowledge base and an unstructured knowledge base; the data storage system module is used for storing a structured knowledge base and an unstructured knowledge base and providing a structured retrieval interface and an unstructured retrieval interface; and the man-machine interaction module is used for identifying a user intention according to the user question and outputting an answer corresponding to the user question by adopting a corresponding answer generation mode based on the user intention. According to the method, efficient and accurate silk path knowledge questions and answers are realized by constructing the multi-modal knowledge base and optimizing a retrieval algorithm and a prompt engineering technology.

The invention relates to a data access prediction scheduling method and system based on a dynamic threshold value, and belongs to the technical field of data processing. The method comprises the following steps of: dynamically adjusting an abnormal detection threshold in an access behavior by utilizing reinforcement learning and an error feedback mechanism, realizing preposition identification of potential high-frequency access data by combining abnormal point classification processing and access trend prediction, and generating a scheduling request to drive cache preheating or interface priority scheduling of the data. According to the method, access behavior modeling, anomaly recognition, trend prediction and strategy feedback mechanisms are combined, interface access optimization requirements in a mass data storage system are met, and the key problems that access behaviors are unpredictable, scheduling response lags and the like are solved.

A dynamic marketplace system leveraging store and warehouse mobility features a neuroevolution (NE) engine, an electronic device, and a request handler facilitating communication between the electronic device and the NE engine. The NE engine interfaces with a data storage system and an event handler receiving real-time event data from a public cloud services processor. An intentions handler interprets user intention data to predict user behavior. The NE engine, integrated with a processor, generates a predictive evolutionary model for the marketplace based on request, event, and intention data. An AI agent processor within the NE engine creates a recommendation model for mobile retail vendors, devises route plans, and deploys vendors to strategic locations.

The invention relates to the field of heterogeneous data storage, in particular to a heterogeneous data storage method and system for a civil aviation data platform, and the method comprises the steps: collecting metadata of each subsystem in the heterogeneous data storage system in real time, inputting the metadata into a pre-constructed metadata unified model, and carrying out standardization processing to generate a global metadata view; establishing a data traceability tracking mechanism according to the global metadata view, and mapping dispersed metadata items and data entity operation records according to the data traceability tracking mechanism to generate a traceable metadata change track; and a metadata quality label is embedded in the metadata unified model, a metadata knowledge graph is constructed according to the metadata change track and the metadata quality label, and a resource allocation strategy of the heterogeneous data storage system is dynamically optimized according to an analysis result of the metadata knowledge graph. The problem of low storage management efficiency caused by difficulty in integrating and tracing metadata in a heterogeneous data storage system in civil aviation data is solved.

Data storage systems are disclosed. In some implementations, a data storage device includes a controller coupled to a plurality of memory devices to control memory operations of the plurality of memory devices, and including M communication lanes, and an interface device configured to include N communication lanes to be connected to a host device that includes N communication lanes and to the M communication lanes of the controller, wherein the interface device includes a connector configured to connect the N communication lanes of the host device to the N communication lanes of the interface device, and a selector configured to, in response to a host port type identification signal received from the host device, selectively activate M communication lanes of the interface device, out of the N communication lanes of the interface device, to transmit or receive the data to or from the M communication lanes of the controller.

The invention discloses a database data storage system based on multi-level cache, and relates to the technical field of database data storage systems, the database data storage system comprises a basic storage layer, a first-level cache layer, a second-level cache layer, a cache cooperative control module and a data read-write scheduling module, the basic storage layer is used for persistently storing total data of a database; the first-level cache layer is divided into a plurality of hot data partitions; and the second-level cache layer is provided with quasi hot data partitions in one-to-one correspondence with the hot data partitions. According to the database data storage system based on the multi-level cache, the system constructs a'high frequency-secondary high frequency-full quantity 'layered architecture through the first-level cache, the second-level cache and the basic storage layer, dynamic flow of data is achieved in cooperation with a data aging counter and a heat recovery detector, heat reduction data is migrated from the first-level cache to the second-level cache, and the heat reduction data is transferred to the second-level cache. And the heat recovery data returns to the first-level cache from the second-level cache to ensure that the high-frequency data is always kept in a cache layer.

The invention discloses an intelligent RAG enhanced large model auxiliary writing system, and relates to the technical field of artificial intelligence auxiliary writing. In order to overcome the defects of an existing writing auxiliary tool, the adopted scheme comprises an interface and user layer for receiving a writing demand and redisplaying a generation result; the service layer is used for deploying three types of intelligent agents including writing, interactive writing enhancement and checking; the platform layer is used for carrying out industry adaptation analysis, mixed retrieval and RAG enhancement on writing demands and then sending the writing demands to the large model layer; three intelligent agents of writing, interactive writing enhancement and checking are called in sequence based on the output of the large model layer, and then a text is redisplayed to the interface and user layer after fact accuracy verification is completed through a tense knowledge graph; the data layer is used for providing a multi-type data storage system; the large model layer outputs a paragraph-level text and a reference index based on a writing large model, the paragraph-level text is returned to the platform layer, and reference index information is fed back to the interpretability and security layer for tracing; and the infrastructure layer is used for providing bottom layer resource support for each layer.

The invention relates to an internet-of-things monitoring and early warning system for lake water quality. The internet-of-things monitoring and early warning system comprises a multi-mode intelligent sensor acquisition system, a self-adaptive wireless transmission system, a distributed data storage system, an intelligent data analysis system, a visual interaction system, an intelligent early warning system and a remote intelligent control and repair system. The invention also relates to a monitoring method using the lake water quality Internet of Things monitoring and early warning system. Traditional and innovative sensors are cooperated to comprehensively collect water quality and ecological data, the biosensor accurately detects specific pollutants, the hyperspectral imaging sensor monitors algae distribution and water color change, rich and high-precision data are provided for lake water quality monitoring, the monitoring comprehensiveness and precision are improved, and the water quality monitoring system is suitable for being popularized and applied. The lake ecological protection work is powerfully supported.

An example operation may include one or more of detecting a first amount of energy that is received by an energy data storage system during a predetermined period of time, detecting at least one source of the first amount of energy, detecting a second amount of energy that is consumed from the energy data storage system during the predetermined period of time, generating a digital token that includes a value based on the first amount of energy, the second amount of energy, and the at least one source of the first amount of energy, and storing the digital token in a digital wallet.

The invention discloses a life omics knowledge graph construction method and system based on a large language model, and relates to the technical field of computer data processing. The method comprises the following steps: acquiring and preprocessing multivariate life omics data, wherein the multivariate life omics data at least comprises an unstructured biomedical text; performing information extraction on the text data based on a large language model to obtain entity mention and relation description; standardizing and normalizing the entity mention and the relation description on the basis of a large language model in combination with an external knowledge base to obtain a standard knowledge triple; and storing the triple into a graph data storage system, and constructing the knowledge graph. According to the method, the powerful natural language understanding ability of the large language model is utilized, efficient information extraction is achieved through structured prompt or field fine tuning, the model is innovatively utilized for entity standardization of relation perception, and the accuracy of knowledge fusion is remarkably improved.

The invention relates to the field of log burying point downloading, and discloses a front-end log classified downloading method and device and a storage medium. The method comprises the steps that a log collection system collects a DOM event triggered by a user behavior, and behavior JSON data is generated; the data processing coordinator performs data filtering processing on the behavior JSON data according to a preset filtering rule to generate filtered JSON data; based on a preset classification algorithm, performing label classification processing on the filtered JSON data to obtain classified JSON constraint data; the storage system performs hierarchical encryption of metadata and content on the classified JSON constraint data to obtain encrypted data; and the transmission system receives a log downloading request, queries corresponding log data from the persistent queue based on the log downloading request, and obtains requested log data. In the embodiment of the invention, log collection, data processing and storage are integrated at the front end, so that the conditions of network delay and data loss are reduced, and the classification efficiency of the log data is improved by utilizing the classification labels for marking.

In one embodiment, a system comprises a host processor and a storage system. The storage system comprises one or more storage devices, and each storage device comprises a non-volatile memory and a compute offload controller. The non-volatile memory stores data, and the compute offload controller performs compute tasks on the data based on compute offload commands from the host processor.

The invention discloses a data consistency processing method, a distributed storage system and electronic equipment, and belongs to the field of distributed data storage systems, and the data consistency processing method comprises the following steps: when any storage node in the distributed storage system receives to-be-updated data sent by a client, obtaining a corresponding data updating path by taking the storage node as a first storage node; according to the data updating path, each storage node carries out data persistence on itself after receiving the data to be updated, if persistence succeeds, the data to be updated is transmitted to the next storage node, if persistence fails, data rollback is carried out, and feedback information of path updating failure is sent to the upstream of the data updating path; and after receiving the information, each upstream storage node carries out data rollback on the current updated data. According to the scheme, even if the update message processing flow fails, the consistency of the data between the survival copies / fragments can be ensured in real time.

A server receives and rebroadcasts live streaming video content from a video capture device, such as a mobile phone or unmanned surveillance vehicle. The server includes a media server configured to stream selected video content to a client device, a video analysis system configured to analyze the live video content and generate object detection data, a storage system configured to store the generated object detection data and an identifier of the associated live video content, and a search engine configured to receive a text-based search request, search the object detection data stored in the storage system for relevant search results, and generate a list of live and stored video content associated with the relevant search results.

Record-level transaction conflicts may be detected at storage nodes of a database back-end storage service. When a prepare statement is received, a storage node can determine whether another prepare statement acting on at least one of the same records has succeeded. If so, then the storage node can indicate to the database access application that there is a conflict, allowing the database access application to wait to try again or abort the transaction.

The invention discloses a multi-element information acquisition and analysis system based on telemetering drifting buoys, and relates to the technical field of marine environment monitoring. A three-dimensional fluorescence spectrometer, a temperature-salinity-depth sensor, a positioning module and a miniature water sampler are carried on each telemetering drifting buoy; the system is used for collecting algae fluorescence spectrums, water quality parameters and position data in real time, inputting the data into a trained random forest model to output the red tide occurrence probability, triggering multi-level early warning in combination with a preset expert rule engine, linking air and shore-based equipment and a data storage system, and utilizing laboratory true value data obtained by a miniature water sampler to determine the red tide occurrence probability. And performing incremental training on the random forest model every day, thereby dynamically optimizing internal structure parameters of the model. The method effectively improves the prediction probability of the red tide.

The application provides a data processing method and a data storage system. The method comprises training, by the data storage system, a first streaming model according to a plurality of first access data features corresponding to the first file at an i-1th access request and a first access attribute parameter of the first file, then inputting a plurality of second access data features corresponding to the first file at an ith access request into the first streaming model to obtain a second access attribute parameter possessed by the first file at an i+1th access request, and then pre-fetching or migrating the first file according to the second access attribute parameter. In this way, the method trains the first streaming model using the plurality of first access data features, thereby consuming relatively few storage resources and computing resources, and enabling the first streaming model to adapt to changing file access patterns, thereby effectively improving the business performance of the data storage system.

An illustrative data storage management system comprises a management database that stores administrative preferences and system configurations, as well as results and / or statistics of completed secondary storage operations, i.e., information needed by the system to protect customers' data and to track and recover the protected data, including secondary copies such as backup copies, archive copies, etc. The disclosed data storage management system is configured to protect its own system data subject to a very aggressive (short) Recovery Point Objective (RPO), by using an innovative infrastructure that enables the system's storage manager to fail over to any number of other failover destination storage managers, each one comprising a destination management database. An illustrative database granularly tracks whether each and every transaction log file has been successfully applied to each and every destination management database to synchronize with the source management database.

The invention discloses a movable recirculating aquaculture system and method based on digital twinning. The system comprises a monitoring system used for monitoring aquaculture water body data and aquaculture equipment data and obtaining fish school images; the processing system is connected with the monitoring system and used for receiving and analyzing the aquaculture water body data, the aquaculture equipment data and the fish school images and sending out a control instruction according to an analysis result; the control system is connected with the processing system and used for receiving the control instruction and adjusting related equipment according to the control instruction; and the data storage system is connected with the processing system and is used for storing the aquaculture water body data, the aquaculture equipment data, the fish school images and the analysis results. Data acquisition and real-time processing can be efficiently carried out, the optimal fish school growth condition is analyzed in combination with the water quality environment, and a decision basis is provided for farmers.

The invention discloses a distributed cooperative processing method, system and equipment for mass spectrum data analysis, and relates to the field of biological information distributed processing, and the method comprises the steps: receiving original mass spectrum data submitted by a user, and analyzing flow configuration and global parameter configuration; analyzing the analysis process configuration into a directed acyclic graph taking the mass spectrum data processing step as a node; splitting the directed acyclic graph into a plurality of parallel atomic tasks according to the quantity of the original mass spectrum data and the space occupation amount; each atomic task is allocated to a Worker node storing corresponding associated data, and the atomic tasks are executed in parallel; when it is detected that the atomic tasks fail to be executed, the Worker nodes are distributed to the atomic tasks which fail to be executed again; different data storage systems are adopted to store original mass spectrum data, intermediate results and final analysis results. According to the invention, efficient parallel processing of mass spectrum data is realized, and continuity and reliability of an analysis process are guaranteed.

The invention discloses a whole vehicle data storage system based on a block chain, and relates to the field of data storage, and the system comprises a data collection module which is used for collecting key data of a vehicle; the data processing module is used for carrying out desensitization processing on the vehicle key data, carrying out format conversion and encryption on the vehicle key data and compressing redundant data; the block chain evidence storage module is integrated in a block chain node in the T-Box and is used for converting the processed key data into a hash value and uploading the hash value to a block chain network; the intelligent contract module is used for performing logic consistency verification on the uploaded data according to intelligent contract logic and a preset multi-dimensional association rule; the data application module is used for service application driven by vehicle data and feeding back application information to the feedback optimization module; and the feedback optimization module is used for receiving the verification result and the feedback application information, and dynamically adjusting the collected data and the intelligent contract logic according to the verification result and the feedback application information.

A semiconductor device includes a first substrate structure including a first decoder circuit region, a second decoder circuit region, and a page buffer circuit region, and a second substrate structure connected to the first substrate structure. The second substrate structure includes a first cell structure that includes first horizontally extending gate electrodes, and a second cell structure that includes second horizontally extending gate electrodes. The second cell structure is disposed below the first cell structure. A first stair structure is disposed to one side of the first and second cell structures, and a second stair structure is disposed to a second side opposite the first side. a dummy structure is disposed below the first stair structure. First contact plugs pass through the first stair structure and the first dummy structure and are respectively connected to the first gate electrodes, and second contact plugs pass through the second stair structure and are respectively connected to the second gate electrodes.

A storage system is provided. The storage system includes a plurality of storage nodes configured to provide storage services for the storage system. The corresponding storage node comprises a processing device, a memory, a network interface and a plurality of device interfaces supporting hot-pluggable managed flash memory storage devices. A respective managed flash memory storage device includes a flash memory and a storage device controller that supports a set of commands for access by the respective storage nodes and optimizes use of the flash memory for use in the storage system, wherein at least a subset of the managed flash memory storage devices further comprises a memory and an energy storage for temporarily storing writes and for storing metadata of the storage system.

Examples described herein provide a computer-implemented method that includes receiving, at a token generation service, a contract token request from a data non-owner, the contract token request indicating a condition of an agreement between the data non-owner and a data owner that owns data stored in a data storage system. The method further includes generating, by the token generation service, a contract token based on the contract token request, the contract token including an attribute that defines the condition of the agreement between the data non-owner and the data owner. The data storage system enables the data owner to execute an operation on the data based at least in part on the contract token.

In some implementations, a storage system may receive, via a system controller of the storage system, a write command and data associated with the write command. The storage system may classify, via the system controller, the data. The storage system may associate, via the system controller, the data with a queue based on classifying the data. The storage system may retrieve, via a processor of the storage system, the data associated with the queue. The storage system may compress, via the processor, the data to form compressed data for storage in a memory device of the storage system based on the write command.

A semiconductor device and a data storage system including the same may include a first semiconductor structure including a first substrate, a first circuit element on the first substrate, a first circuit interconnect line on the first circuit element, and a first peripheral region insulating layer; a second semiconductor structure including a first region of a second substrate on the first semiconductor structure, a second circuit element on the first region of the second substrate, and a second circuit interconnect line on the second circuit element; a capacitor structure including a first capacitor electrode spaced apart from the first circuit interconnect line on a lower surface of the second substrate, a second region of the second substrate facing the first capacitor electrode, and a first through-via extending in the second substrate and electrically connected to the first capacitor electrode; and a third semiconductor structure including a third substrate on the second semiconductor structure and a memory cell on the third substrate.

A backup agent for performing a backup operation is provided. The backup agent comprises a memory storing one or more processor-executable routines and a processor communicatively coupled to a data storage system and configured to access unstructured data stored in therein. The processor comprises a master node and a plurality of proxy nodes. The master node is configured to perform a backup operation by generating a plurality of threads to perform a scan operation; wherein during the scan operation a plurality of batches of data stored on a data storage device is scanned. The processor is further configured to create a global queue of the plurality of batches of data upon completion of the scan and assign the plurality of batches of data from the global queue to a plurality of proxy nodes and / or to the master node. The master node and each proxy node are configured to perform an upload operation by uploading the assigned batch of data on the cloud network; wherein the master node and the proxy nodes operate concurrently.

The invention provides an intelligent civil aircraft separated emergency flight data storage system facing flight accident scenes. The system collects multi-source data such as flight parameters, audios, videos and data links, carries out preprocessing and semantic modeling on the multi-source data, and extracts multi-modal feature information; multi-modal features are fused based on a modal perception attention mechanism and a diagnosis feedback readjustment mechanism, and intelligent diagnosis of a current flight state is realized in combination with a semantic consistency discrimination mechanism. When the flight state is judged to be abnormal or accident, starting a satellite communication channel to carry out remote emergency transmission on key data; and when the flight state is judged to be normal, performing modular hierarchical storage on the acquired data according to the data type. And the separated emergency data transmission subsystem is immediately started under the extreme conditions of power failure of the main system and the like. According to the method, strategies such as multi-mode intelligent diagnosis and multi-level storage are fused, and the flight data acquisition efficiency and the flight safety guarantee capability are remarkably improved.

A semiconductor device includes: a conductive layer; a stack structure including gate electrodes spaced apart from each other and sequentially stacked in a first direction, in a first region and a second region, a first separation region and a second separation region penetrating through the stack structure, and extending in a second direction, perpendicular to the first direction, and spaced apart from each other in a third direction, perpendicular to the first direction and the second direction; channel structures respectively including a channel layer and penetrating through the stack structure in the first direction, in the first region; and contact plugs extending by different lengths by penetrating through at least one of the gate electrodes of the stack structure, electrically connected to each of the gate electrodes, and spaced apart from each other, in the second region.