144results about How to "Realize distributed storage" patented technology

The invention provides a distributed key-value query engine system and a query method. The system comprises a metadata server, at least one agency node and at least one storage node, wherein the metadata server is used for maintaining the global routing list information pointing to the storage node; the agency node comprises a query forwarding module and a data forwarding module, wherein the query forwarding module is used for responding to a request which is emitted by a client end and comprises a target KEY, and forwarding the request of the client end to a corresponding storage node on the basis of the global routing list information; the data forwarding module is used for transmitting a respond package which is returned by the corresponding storage node and comprises a target Value to the client end; the storage node is used for obtaining required data from local storage on the basis of the received request of the client end, and sending the respond package comprising the target Value to the agency node. According to the distributed key-value query engine system and the query method, the key-value data distributed storage and query are realized, the massive key-value data can be contained, and the adaptability to high concurrent access is stronger.

The embodiment of the invention discloses a distributed storage method and device, computer equipment and a storage medium. The method comprises the steps of grouping a to-be-stored file to form multiple data groups; forming at least three data fragments from all the data groups, wherein each data fragment comprises part of data groups, and each data group is added to at least two data fragments;distributedly storing all the data fragments in distributed storage nodes; recording a corresponding relationship between the data fragments and the data groups, and a corresponding relationship between the storage nodes and the stored data fragments; deleting the local to-be-stored file. According to the technical scheme, a user conveniently stores files in a distributed network to lower the storage cost, the privacy and safety of the stored files can be effectively improved, and thus an attacker is prevented from restoring original files.

The invention discloses a storage system based on a block chain, which comprises an application layer, a block chain network and a distributed storage network, wherein the application layer is used for an uploader to generate an uploading request, a storage user to generate a storage request and a downloader to generate a download request and for segmenting the file to be stored into a plurality of file fragments according to the uploading request; the block chain network is used for storing the uploading request, the downloading request and the meta information of the file and for carrying out authority verification on the downloader initiating the download request; the distributed storage network is used for storing the file fragments, performing the authority verification on the storageuser when the file is uploaded, and carrying out authority verification on the downloader when the file is downloaded. According to the storage system, the block chain technology is adopted to storethe meta information of the file in the block chain network, so that the file cannot be tampered, the safety is greatly improved, the stability which is provided by the electric power network is combined; and stable and safe cloud storage is realized.

The embodiment of the invention provides a mirror image file uploading method, a mirror image file downloading method and devices, which relates to the technical field of virtualization and can solve a problem that the mirror image file uploading and downloading speed is slow. According to the invention, mirror image layers of a mirror image file are stored in storage servers respectively in the form of fragments, so that the mirror image layers can be quickly stored in the storage servers respectively in the form of fragments concurrently through a management server or fragments of the mirror image layers to be downloaded are acquired concurrently from the storage servers through the management server when a host machine uploads or downloads the corresponding mirror image layers of the mirror image file. The embodiment of the invention is used for uploading and downloading mirror image files of a container.

The invention discloses a deep learning-based experiential word vector and emotion classification method. A context model of a word is firstly built; then, emotion information is added to the contextmodel of the word to build an experiential word vector; and finally, through an active deep confidence network method and in combination of the experiential word vector, semi-supervised emotion classification on a comment document is carried out. The problem that the existing word vector learning algorithm generally only uses the context of the word but ignores the emotion information of the textis solved.

The invention provides a log management method, and relates to the field of computer application. By the aid of the log management method, log data can be stored and managed in a distributed manner. The log management method includes collecting traffic log and click log; preprocessing the acquired traffic log and the acquired click log; storing the preprocessed traffic log and the preprocessed click log in a distributed manner. According to the technical scheme, the log management method has the advantages that the log management method is applicable to data mining, and log files can be stored in the distributed manner on the basis of HDFS (Hadoop distributed file system) architectures.

The embodiment of the invention provides an information announcement method based on a blockchain, an information announcement apparatus based on the blockchain, and a related device, which are used for realizing trusted query and verification of announcement information data. The method in the embodiment of the invention may comprise: acquiring to-be-announced information details; constructing atarget merkle tree according to the information details, writing a first root abstract of the target merkle tree into the blockchain; receiving an information verification request of a user, wherein the information verification request comprises target information which needs to be verified; acquiring associated information from the target merkle tree according to the information verification request; generating a second root abstract according to the information verification request and the associated information, extracting the first root abstract from the blockchain, and checking whether the first root abstract is consistent with the second root abstract, if so, judging that the target information passes through verification.

The invention relates to the field of road traffic control, and particularly relates to an information processing method and apparatus based on an intelligent traffic cloud control system. The method comprises the following steps: a first node releases a subscription message to a control server, when the control server determines a preset condition indicated by the subscription message is satisfied, the control server returns IP field device acquisition information and a corresponding processing result to the first node, and the first node generates a corresponding cooperative control strategy or a local control strategy for the returned IP field device acquisition information and the corresponding processing result. Since the first node can acquire the returned IP field device acquisition information and the corresponding processing result of each control server according to demand, the adjustment effect of traffic conditions within a certain area can be improved, and the overall information transmission of the information processing method is reduced at the same time, thereby generating no information transmission congestion, and reducing the information storage quantity and the information calculation quantity of the central system while ensuring the transmission efficiency.

The invention discloses a data file processing method and device. The data file processing method includes: searching and collecting a specific key value identical to a search field in an original data file according to a defined search field; analyzing the specific key value, and acquiring range distribution of the specific key value; determining a file storage strategy and a file splitting strategy on basis of use of cluster resources of an Hadoop data storage environment; splitting the original data file into a plurality of sub-files according to the file splitting strategy; and finally storing all the sub-files in different nodes of HDFS clusters. The data file processing method and device can achieve distributed storage of data files; the distributed stored sub-files provide the possibility of multi-thread operation of the data files; and then the a plurality of sub-files can be processed at the same time, and the efficiency of data processing can be improved.

The invention relates to a mixed storage method for distribution and utilization multi-source heterogeneous data. The method includes the steps that the data type of the distribution and utilization data in a target distribution and utilization data source is judged according to the target distribution and utilization data source; the data extraction mode and data storage mode of the distribution and utilization data in the target distribution and utilization data source are determined according to the data type; the distribution and utilization data in the target distribution and utilization data source are extracted from the target distribution and utilization data source according to the data extraction mode of the distribution and utilization data in the target distribution and utilization data source; the extracted distribution and utilization data are stored according to the data storage mode of the distribution and utilization data in the target distribution and utilization data source; data cleaning and conversion are carried out on the stored distribution and utilization data in various distribution and utilization data sources to obtain cleaning and conversion results, and the cleaning and conversion results are stored in the Oracle database. By adopting the scheme, convenience of reading calculation is ensured while achieving storage of mass distribution and utilization multi-source data.

The invention discloses an account-number-transaction processing method and device based on blockchain. An account-number-transaction registration request sent by an account-number seller is receivedthrough a blockchain node, the blockchain node generates account-number-transaction registration information according to the account-number-transaction registration request, an intelligent contract containing the account-number-transaction registration information is established, and the intelligent contract containing the account-number-transaction registration information is stored in a blockchain network. Through the blockchain technology, distribution-type storage of the account-number-transaction registration information is achieved, and through the intelligent contract suitable for account-number-transaction processing, it is achieved that fictitious assets corresponding to the game account number/the application account number/the asset account number related to the platform account number are rapidly realized.

The invention discloses a method for dispersing and recovering storage data on a dynamically changed storage medium. The method comprises the following steps: firstly, equally dividing data required to be stored into J groups, numbering each group of data and setting the groups from 1 to J; secondly, secondarily and equally dividing each group of data into N blocks, adding corresponding X checking blocks, wherein X is greater than 0, numbering the equally divided data and setting the data into 1.1, 1.2 until 1.N+X, 2.1, 2.2 until 2.N+X till J.1, J.2 until J.N+X; numbering all storage equipment on the network and setting the storage equipment from 1 to M, wherein M is greater than 0; distributing data of T blocks on M storage equipment; when partial M equipment is online, acquiring serial numbers of the current online storage equipment, obtaining T storage equipment which are most approximate to the serial numbers of each group and distributing and storing the data of T blocks on the T storage equipment; monitoring whether the storage equipment carries out online or offline change or not at regular time; and if the data are changed due to offline or damage of the storage equipment, restoring original data blocks or checking blocks and redistributing the data blocks according to the steps.

The invention discloses an Internet of Things system, an Internet of Things communication method and electronic equipment. The system comprises an equipment layer, an edge computing layer and a cloudservice layer, wherein the equipment layer is used for acquiring acquired data; the edge computing layer is in communication connection with the equipment layer and is used for receiving the acquireddata sent by the equipment layer and processing the acquired data to obtain a data processing result; the cloud service layer is in communication connection with the edge computing layer, receives theacquired data and/or the data processing result sent by the edge computing layer, and processes the acquired data and/or the data processing result; the cloud service layer is constructed based on ablock chain technology. The system is advantaged in that time delay caused by data transmission to the cloud service layer can be reduced, the data processing efficiency is improved, in addition, decentralized distributed storage of the cloud data in the cloud service layer can be achieved, and safety of cloud data storage is improved.

The invention belongs to the technical field of block chains, and particularly relates to a network page evidence storage method and device based on a block chain, a medium and electronic equipment. The method comprises the following steps: analyzing a web page evidence storage request to obtain web page evidence storage service data carried in the web page evidence storage request; performing webpage snapshot processing on the to-be-stored web page to obtain a webpage snapshot image containing complete page content of the to-be-stored web page; carrying out abstract extraction processing on the webpage snapshot image to obtain a page image abstract used for carrying out unique identification on the to-be-stored network page; storing the page image abstract to an evidence storage block chain maintained by a block chain network; and according to an upper chain result of the page image abstract, determining evidence storage upper chain information of the network page to be subjected to evidence storage, and according to the evidence storage upper chain information, generating an evidence storage upper chain certificate used for proving an evidence storage position and evidence storage time of the network page. According to the invention, the evidence storage reliability and effectiveness of the web page as the electronic evidence can be improved.

The invention discloses a safe cloud storage method and system with the support of file encryption based on a windows platform. The system comprises a user registration module, a file option module, a sharing module, an encryption option module, a message option module, a check mode module. The method and the system are based on Eclipse and the Java language development is used, the practicability is high, the cost of development is low, and the energy consumption is low; an RSA encryption algorithm is used to protect a session key, the security of the algorithm is high, and the efficiency is relatively high; a Hadoop cloud storage architecture is used by a cloud end storage architecture, the distributed storage and threshold storage are realized. The system has the advantages of a small size and low memory consumption, the storage of a private key into a mobile device is supported, and the decryption operation of an encrypted file is supported.

The invention provides a combustion gas usage safety protection system based on the Internet of Things and a method thereof. The protection system comprises a safety cloud service platform, an intelligent terminal, an alarm device, a safety Internet of Things module, a community joint defense module and a communication module, and the protection method comprises following steps: user real-name registration, positioning and installation of the alarm device, combustion gas household, and processing of a danger generation system. By employing the system, the combustion gas safety community jointdefense method is provided, the response is rapid and reliable, the operation cost is low, the effect is good, problems of man-made gas reversal, water injection, adulteration and real-name usage canbe better solved, and combustion gas usage risks of combustion gas leakage, carbon monoxide standard exceeding and temperature anomaly are reduced.

The invention discloses a tax file sharing system based on an HDFS and an implementation method, and belongs to the tax technology field, the technical problem to be solved by the invention is how tomanage tax bureau files more finely, fully improve the security of internal files of the tax bureau, and improve the file sharing efficiency of all departments and all tax personnel. According to thetechnical scheme, the tax file sharing system comprises at least one Web client, at least one third-party application system and at least one server side; the function module of the Web client comprises a file management module, a system management module and a sharing management module; the third-party application system comprises at least one big data cluster system, at least one cluster management module, at least one interface management module and at least one document conversion system; the server comprises at least one database. The invention further discloses an implementation method of the tax file sharing system based on the HDFS.

The invention discloses a bus monitoring video distributed storage method, which is characterized by comprising the steps of: arranging wireless Access Point (AP) nodes and storage nodes in a public transportation network coverage area, and arranging a wireless access controller on a bus; establishing a wireless network with the corresponding wireless AP nodes through the wireless access controller; obtaining original video files through a video monitoring all-in-one machine terminal on the bus, performing video sampling and splitting on the original video files, and generating small video files; and sending the small video files to the corresponding storage nodes for storage through the established wireless network. The invention also discloses a bus monitoring video distributed storage system. Through the method and the system of the invention, the distributed storage of bus monitoring videos based on the wireless transmission can be realized, and the valuable videos can be stored in time before terminal physical damages happen.

The invention provides a video monitoring system based on the internet of things, and relates to the field of the video monitoring. The problem that the existing internet of things needs to reconstruct an internet of things base station can be solved. The video monitoring system comprises a cloud server, and at least one communication base station connected with the cloud server, wherein each communication base station is connected with at least one set of video processing equipment; the video processing equipment and the video monitoring equipment are in one-to-one corresponding connection, each communication base station is loaded on lighting equipment, and each communication base station and the connected video processing equipment and video monitoring equipment form a local area network. The video monitoring system is used for the video monitoring.

The invention belongs to the technical field of electric automobile charging control, and discloses an electric automobile charging method by using video locking user information in a non-communication state. The method is based on an image recognition technology, a network credit system and a localized charging management system are deployed, so that a charging facility can interact with a user in a network-free environment, temporarily charging can be carried out for the user who needing a charging service, and order storage and management are completed. According to the charging method, through a video recognition system and user identities and the automobile information stored on a charging pile, the temporary charging service is carried out on the user in a network-free environment, a certain charging limit is issued in advance, so that a charging service flow of the user is simplified, and a user can obtain better charging experience; and a distributed credit management system based on a block chain technology is developed and deployed, so that the distributed reliable storage of the charging credit of the user is realized, and a basic support is provided for the construction of a charging credit system.

The invention provides a distributed storage method, device and system based on a graph database. The method comprises the following steps: extracting a main graph from a source graph to be stored inthe distributed storage; dividing the remaining graph after extracting the main graph to obtain a plurality of sub graphs; storing the main graph in a main graph database of a main server in the distributed system; According to the storage capacity of the sub-graph database of each sub-server in the distributed system and the information of each sub-graph, each sub-graph is stored in the sub-graphdatabase corresponding to each sub-server. the invention realizes the distributed storage based on graph database by extracting the main graph and dividing the sub-graph of the source graph, and solves the problems of super node and large graph storage and processing based on graph database. In addition, the invention separates the main map from the sub-map, which can reduce the density of the source map data, decouple the large-scale network data, and further improve the query performance.