33results about How to "Efficient data storage" patented technology

A wireless communication apparatus that communicates data with an external wireless apparatus in a wireless communication range includes a controller and a wireless communication interface device is provided. The wireless communication interface device includes a transmitting unit that transmits response request data to the external wireless apparatus, a counter that counts time for determining whether or not a time limit for waiting for the response data has elapsed, a storage unit that stores the response data, a receiving unit that receives first response data from the external wireless apparatus and that instantaneously receives second response data without an instruction from the controller when the time limit has not elapsed, a frame length checking unit that checks a frame length of the received response data, and an error detector that performs error detection on the response data.

The present disclosure relates to a data storage system including a RAID subsystem having a first and second type of RAID storage. A virtual volume configured to accept I / O is stored on the first type of RAID storage, and snapshots of the virtual volume are stored on the second type of RAID storage. A method of the present disclosure includes providing an active volume that accepts I / O and generating read-only snapshots of the volume. In certain embodiments, the active volume is converted to a snapshot. The active volume includes a first type of RAID storage, and the snapshots include a second type of RAID storage. The first type of RAID storage has a lower write penalty than the second type of RAID storage. In typical embodiments, the first type of RAID storage includes RAID 10 storage and the second type of RAID storage includes RAID 5 and / or RAID 6 storage.

A navigation apparatus 200 comprises a processing resource 260 configured to: determine a route to a selected destination; obtain weather-related data; and modify speed data for a plurality of route segments in dependence on the weather-related data. For each route there is a respective classifier that classifies the road type for the route segment, and the processing resource is configured to modify the speed data for each route segment based on the weather-related data and the road type represented by the classifier for that route segment.

The Networked Data Shadowing System comprises a memory module that is connected to a plurality of monitored computer systems via an existing communication medium to store the shadowed data. The memory module includes one or more memory devices for data storage as well as software, including a control software component that is automatically installed on the monitored computer systems when the monitored computer system is first connected to the memory module, as well as associated module software for maintaining a record of the data stored on the memory devices and controlling the operation of the memory devices. The Networked Data Shadowing System operates autonomously and achieves a significant amount of data storage efficiency by implementing a “data de-duplication” process to avoid storing multiple copies of the same files.

A variable resolution grid provides a mechanism for focusing specific concentrations of risk exposure on a geographical grid to determine projected loss caused by a particular catastrophe. The geographic grid provides a stable base map by using latitudes and longitudes to define the grid points and cells. Each cell is assigned a geographic identifier or geocode that identifies the location of the cell and its associated resolution. The resolution of the grid may be varied depending in part, on the resolution of any available of hazard data.

The present application provides a power network security monitoring method and system based on ELK log collection and analysis. The method comprises the following steps: adopting a centralized log management method to collect a network security equipment log of a power monitoring system; Filtering, normalizing and storing the collected network security equipment logs of the power monitoring system; Using the distributed log retrieval method, the stored logs are retrieved and counted; displaying the log data in a summarized manner. The electric power network security monitoring method and system based on ELK log collection and analysis provided by the application adopts a cluster mode, data storage, query is efficient and fast, realizes real-time log monitoring and storage, and meets log storage requirements; and through the visualization mode for log display, friendly interface, simple and easy to use, log analysis rules can be customized to facilitate staff real-time monitoring of network security events, improve the network security monitoring level of power monitoring system.

The invention discloses a multi-sensor fusion road extraction and indexing method based on global and local grid maps. Data storage and preprocessing are carried out by adopting global and local gridmaps; the real-time position and posture of an unmanned vehicle are obtained through a differential positioning system. High-precision road boundaries lane lines and road sign positions are obtainedthrough laser radar point cloud related data stored in the grid map and projected into the monocular vision image, the lane line type is judged based on a deep learning method, road sign semantic information is recognized, and therefore a high-precision road map with semantic information is obtained. Efficient storage and indexing are realized in a mode of establishing multiple global sections androad sets.

A highly accurate and robust cubic cell mesh generator “Cubegen” capable of a trillion plus cell meshes on a single processor 4-Gigabyte main memory workstation has been developed. The cells are generated in Yee format for the Finite Difference Time Domain method. Three key techniques were employed to achieve this capability: a highly efficient data storage ray tracing method, a highly accurate ray-facet intersection test, and a novel exact arithmetic tie-breaking algorithm for rays intersecting facet edges and vertices.

The invention provides a parallel computing hardware structure based on a separation and combination thought, which comprises a plurality of first parallel computing units, a plurality of second computing units, a task dispatcher used for controlling a plurality of the first parallel computing units and a plurality of the second parallel computing units, a global memory used for storing global data, a local memory for storing intermediate results computed by a plurality of the first parallel computing units and providing the intermediate results to a plurality of the second computing units after starting computation, and a data controller used for providing data for a plurality of the first parallel computing units and the task dispatcher. By adopting the hardware structure applied in parallel computing and provided by the embodiment of the invention, design thoughts such as dispatching, synchronizing and communicating can be effectively covered, so a designer can directly focus on the description of a computation part of an algorithm, thus reducing design complexity of a parallel circuit and shortening circuit design and realization time to a large degree.

A method for achieving an NoSQL key-value storage engine comprises two stages: firstly obtaining NoSQL storage engine Key Value SE: A1, removing an independent module from A relational database management system (RDBMS), and only keeping the storage engine in the RDBMS; A2, establishing a single-row byte string data line structure serving as a data line structure of a data table in the storage engine; and A3, setting a dependent manner of the storage engine based on callback functions registered by users; and secondly, enabling the storage engine Key Value SE to be remade into a storage engine supporting multi-process and multi-thread: B1, enabling all global variable to be placed in a thread local storage; B2, replacing an original signal communication mechanism between processes with a communication mechanism between threads; and B3, setting a thread initialization function and an exit function. The method can make maximum use of a mature storage engine of the RDBMS to achieve development of the NoSQL key-value storage engine, avoids a large amount of repeated development work, and simultaneously can rapidly achieve production of the NoSQL key-value storage engine with high concurrency, complete ACID transactional semantics and an efficient data storage and access method.

The invention discloses a configurable Internet of Things data acquisition system and a configuration method, and belongs to the technical field of Internet of Things. The Internet of Things data configuration method is configurable for system construction and supports modification, addition, deletion and other operations of information such as monitoring objects and data acquisition equipment, the data acquisition system can be rapidly built by using a variable template and the like. The Internet of Things data acquisition system comprises a data acquisition module, a system software module and an application software module. The system software module comprises a data transmission sub-module, a real-time library sub-module, a relation library sub-module, an alarm early warning information sub-module, a system configuration sub-module, a data interface sub-module, a system log sub-module and a remote control sub-module. The organization of functional data such as data storage, alarm early warning and data interfaces takes monitoring objects as the basis, data are stored in a real-time library in a hash mode, the data are stored in a relational library in a variable grouping mode,and the application of data in a system and a third-party application is facilitated.

The invention discloses a multi-mode medical image and report data management method and a system. The system comprises an uploading module, a data processing module, a data storage management moduleand a leading-out module. The uploading module is used for uploading dispersed image data, image report and pathological report. The data processing module is used for analyzing, structuring and association processing on the received image data, the image report and the pathological report, thereby obtaining storable data in a unified format. The data storage management module is used for storingand searching the storable image with the unified format. The leading-out module is used for reading the image data, the image report and the pathological report, verifies data integrity converts thedata format and performs exporting. According to the method and the system, the unified data format is supplied for the multi-mode medical image data, the image report data and the pathological reportdata for storage; the association among the three kinds of data is established; and through patient main indexes, a high-efficiency data storage and data matching mechanism is supplied.

The invention discloses a distributed real-time monitoring system for manufacturing equipment. The system comprises a data collection unit, a data processing module, a data transmission module, a local server arranged in each factor, and a cloud server used for inquiring each local server, wherein the data collection unit comprises a pressure sensor, a photoelectric distance sensor, an eddy current sensor, a coder and a PLC (Programmable Logic Controller); after the data collection unit collects equipment data, the data is transmitted to the data processing module; the data processing module is used for compressing and packaging the above equipment operation data, and transmitting the above equipment operation data to the local server through the data transmission module; the local serveris used for storing the equipment operation data, and meanwhile, the real-time operation state of each piece of equipment is monitored; the cloud server is used for inquiring the database of each factor; for key data in a part forming process, the health state of the equipment and the quality of parts can be judged; and when the data exceeds a set value, an alarm prompt is given. By use of the system, real-time data detection and equipment maintenance can be realized.

The invention discloses a log storage method and a log storage system. The log storage method comprises the following steps: after receiving log data, a program starts a data receiving thread for datatransmission; Receiving the transmitted data and performing queue processing; invoking The data after the queue processing is stored in the form of multi-node shunt. The log storage method of the invention is convenient for programs to call and process log data, reduces data packet loss, enhances service high availability, and realizes efficient data storage and extremely strong expansion.

The invention relates to the technical field of block chains, and discloses a block chain-based rapid data retrieval method, which comprises the steps of obtaining to-be-stored data, and performing encoding processing on the to-be-stored data by utilizing a pipeline-based data encoding scheme to obtain encoded data; storing the coded data into a block chain, and storing a copy of the to-be-storeddata into a block chain node by utilizing a time-based copy storage method; slicing the data stored in the blockchain by utilizing a data slicing mode based on the erasure code to obtain sliced data based on the erasure code; utilizing an index construction method based on a time sequence to construct a time sequence index; and utilizing the time sequence index of the data to quickly retrieve thedata. The invention further provides a rapid data retrieval system based on the block chain. According to the invention, data retrieval is realized.

A storage device 101 includes: a plurality of division processing parts 120, each configured so as to correspond to a characteristic of data to be written, for dividing the data in accordance with a previously set criterion; and a data writing part 117 for writing division data obtained by division by the division processing part into a storage device. The storage device also includes: a reception buffer 111 for receiving data to be written and temporarily storing as reception data; a division process selecting part 113 for detecting a characteristic of the reception data stored by the reception buffer and selecting the division processing part configured so as to correspond to the detected characteristic of the reception data; and a data transmitting part 114 for transmitting the reception data stored by the reception buffer, to the division processing part selected by the division process selecting part.

The invention discloses a large-scale knowledge graph storage scheme based on a distributed key value library. A "KG over SQL" unified storage scheme or a "KG over KV" unified storage scheme is adopted; the unified storage scheme of "KG over SQL" comprises the following steps: reading knowledge graph data; extracting metadata in the mapping knowledge domain, and generating a corresponding SQL statement; extracting data in the knowledge graph, storing the data in a data structure, and generating a corresponding SQL statement; executing an SQL statement through an external SQL interface of the Cockroach DB database, and establishing a relation table; mapping the data in the relation table into a key value pair form by using an original data coding mapping scheme in a Cockroach DB database, and storing the data in a Cockroach DB bottom layer; By means of the "KG over KV" unified storage scheme, knowledge graph data are read, a knowledge graph is converted into a graph containing index nodes, index node graph data are stored in a data structure, and the data are mapped into a key value pair form through an optimized data coding mapping scheme and stored in a Cockroach DB bottom layer. According to the method, efficient data storage compatible with the RDF graph model and the attribute graph model can be realized.

The invention relates to an accurate intelligent medical digital system based on a blockchain. The system comprises a user module, a medical supplier module, a blockchain module, an accurate intelligent medical module and a telemedicine module. The user module is used for storing the information of a user and a local medical record and defining a blockchain intelligent contract. The medical supplier module is used for providing an access platform for serving the user for a medical service supplier. The blockchain module is used for storing and reading a user medical record in a distributed mode. The accurate intelligent medical module is used for intelligently analyzing and excavating accurate medical data. The telemedicine module is used for providing a communication platform between theuser and a doctor.

The invention belongs to the technical field of data processing, and discloses a verifiable deletion method and system supporting efficient update of outsourcing data, and the method comprises the steps that a data owner encrypts a file to protect sensitive information in the file, and outsources a ciphertext to a cloud server; the cloud server maintains the received data and returns a storage evidence, and the storage evidence is used for verifying a storage result; the data owner sends an updating request to the cloud server, and the cloud server updates the data according to the updating request and returns updating evidences; the data owner can verify whether the data is correctly updated or not; if the data is not needed any more, the data owner sends a data deleting command to the cloud server to delete the data; the cloud server executes deletion operation and returns deletion evidences; and the data owner can verify the deletion result according to the returned deletion evidence. Verifiable data storage and deletion and efficient data updating can be realized at the same time, and public verifiability can be realized without any trusted third party.

Embodiments of the invention provide efficient data storage for multiple file contents. In specific embodiments, a content management computer is coupled via a network to a storage system, and comprises a processor, a memory, and a content compose / decompose module. The content compose / decompose module is configured to: decompose a file into multiple parts of data and store the multiple parts into adaptive logical storage partitions; and in response to a read request for the file, re-compose the multiple parts into an original file and send the original file. The file is decomposed into the multiple parts based on both structure and characteristics of the data in the file. The multiple parts are stored into different media provided by the adaptive logical storage partitions according to the structure and characteristics of the data in the multiple parts.

The invention discloses a data storage and access method, nodes and a server cluster. According to the scheme, after a storage node receives a data storage request sent by a data node, the storage node determines an initial address for storing target data, information of the initial address and the to-be-stored target data carried by the data storage request are sent to a graphic processor of the storage node, and the target data is stored into a memory according to the initial address through the graphic processor. Through the scheme, the graphic processor is utilized to process storage and reading tasks of the data needing to be processed by the storage node, occupation of the processor can be reduced, and therefore the data calculation processing efficiency of the processor can be improved beneficially while efficient data storage and reading are guaranteed.

The invention discloses a cloud platform system for missile weapon information management, and relates to the field of weapon equipment information management. The system comprises an application server, man-machine interaction equipment and a data server. The application server is used for collecting equipment information of electrical equipment of a launching vehicle through interface board cards arranged on the equipment of the launching vehicle and managing the information of the launching vehicle based on the collected equipment information. The man-machine interaction equipment is used for storing equipment information acquired in a manual acquisition mode, and the man-machine interaction equipment is further used for sending the stored equipment information to the application server. The data server is used for storing the equipment information in the application server, and is further used for providing a data sharing service. According to the invention, the requirements of storage, management, backup and filing of information resources of combat units of different scales can be met.

A data management method and device. The method includes: dividing a magnetic disk into a plurality of storage pools logically, with the blocks in the same storage pool being equal in size; providing an ingress index array in the memory which indicates information about each storage pool; grouping the Key in a key value pair Key-Value, the pool index of the storage pool divided in the magnetic disk, and the block index of the block in the storage pool into a triple and storing same into the memory; locating the storage location of a certain data record in the magnetic disk according to the ingress index array provided and the triple information stored in the memory and performing read, write or delete operation of the data according to the storage location. The technical solution can effectively manage massive data without disk defragmentation, so that the utilization rate of the magnetic disk can be improved significantly and the speed of indexing and reading K-V can be improved greatly, thus providing highly efficient data storage and management operations.

A data storage device includes a non-volatile memory, including a first region and a second region different from the first region, and a controller which stores first and second data in a first region of the non-volatile memory. The first region of the non-volatile memory includes first and second storage regions. A part of the first data is stored in the first storage region, and another part of the first data is stored in the second storage region. The second data is stored in the second storage region, and an offset value of the second storage region in which the second data is started is stored in the second region of the non-volatile memory.

The invention discloses a multi-sensor fusion road extraction and indexing method based on global and local grid maps, which uses global and local grid maps for data storage and preprocessing, and obtains the real-time position and attitude of unmanned vehicles through a differential positioning system , Obtain high-precision road boundaries, lane lines, and road sign position information through the lidar point cloud related data stored in the raster image, and project them into the monocular vision image, judge the lane line type and recognize the road sign based on the deep learning method Semantic information, so as to obtain high-precision road maps with semantic information. At the same time, multiple global sections and road sets are established to achieve efficient storage and indexing.

A resistive memory device and a method of operation of the resistive memory device are provided. The resistance memory device includes a resistance change layer that has a tunneling film and has many states. The conductance is changed symmetrically in a SET operation and a RESET operation. Thus, the resistive memory device can be used for efficient and accurate data storage as a RRAM in a high-capacity memory array, and as a synaptic device controlling the connection strength of a synapse in a neuromorphic system.

The invention discloses a data storage method and device for a database, which are used for providing a data storage mode of the database with high efficiency and lower maintenance cost. In the application, the data processing device can record the first log when detecting the data change of the database, the first log is preferentially stored in the first memory, and when the data processing device determines that the storage space in the first memory is insufficient, for example, less than the first threshold value, the data processing device can be switched to the second memory to continue to record the first log, the first memory and the second memory are deployed in different devices. The log of the database is not limited in the local memory any more, and when the storage space in the first memory is insufficient, the first memory can be switched to other memories to continue to store the log, so that the data storage mode of the database is more efficient, the multiple memories can be deployed in different devices, a larger local disk is not needed any more, the disk maintenance cost of the database can be effectively reduced.

The present invention provides a method for data deduplication and compression in an untrusted storage system for more efficiently storing a large amount of data in a secure manner by maintaining data integrity. The data deduplication and compression are performed in an untrusted storage system using a system that includes a set of trusted servers that are configured to mutually trust and share a common encryption key.

The invention provides a parallel computing hardware structure based on a separation and combination thought, which comprises a plurality of first parallel computing units, a plurality of second computing units, a task dispatcher used for controlling a plurality of the first parallel computing units and a plurality of the second parallel computing units, a global memory used for storing global data, a local memory for storing intermediate results computed by a plurality of the first parallel computing units and providing the intermediate results to a plurality of the second computing units after starting computation, and a data controller used for providing data for a plurality of the first parallel computing units and the task dispatcher. By adopting the hardware structure applied in parallel computing and provided by the embodiment of the invention, design thoughts such as dispatching, synchronizing and communicating can be effectively covered, so a designer can directly focus on the description of a computation part of an algorithm, thus reducing design complexity of a parallel circuit and shortening circuit design and realization time to a large degree.