43results about How to "Solving Data Consistency Issues" patented technology

The invention discloses a method and a device for updating data in a distributed storage system. The method comprises the steps as follows: a current server node distributes an only version number to to-be-updated data in a progressive increase manner, and a plurality of replica server node identifiers where a plurality of replicas of the to-be-updated data are located from a metadata information repository; the current server node sends the to-be-updated data and the distributed version number to the replica server nodes corresponding to the plurality of the replica server node identifiers, so that a plurality of the replica server nodes can update respectively preserved replicas and corresponding version numbers according to the to-be-updated data; the version numbers represent the update times of the replicas; and the current server node judges whether data of more than a half of the plurality of the replica server nodes are updated successfully, if the data are updated successfully, successful data updating information and updated version numbers are sent back to a client. With the adoption of the method and the device for updating data in the distributed storage system, the expenditure is increased, and the data consistency among the plurality of the replicas can be guaranteed.

The invention discloses a cache realization method of interface calling, which effectively integrates a centralized cache and a stand-alone cache. Interface version number information saved in a stand-alone Ehcache cache is used for monitoring timeliness of interface information in a stand-alone memory cache, an interface calling return result is preferentially acquired from the local stand-alone cache during interface calling, so that the local stand-alone cache can be made full use of to acquire the interface calling return result under the condition of low interface update frequency, the centralized cache can be used for acquiring the interface calling return result under the condition of high interface frequency, the data consistency of the stand-alone cache can be realized, the stand-alone cache can be made full use of, the pressure of the centralized cache is effectively reduced, the network transmission overhead is reduced, and the system resource waste is avoided.

The invention discloses a production and consumption method based on a kafka cluster, and relates to the technical field of information processing. The method comprises the following steps: S1, setting a message submission rule; S2, setting an automatic message retry rule; S3, setting the number of copies of the theme topic, and setting the number of copies of the theme topic to be greater than orequal to 3; S4, setting the number of message write-in copies, and ensuring that the number of copies of the topic is greater than the number of message write-in copies; S5, submitting the offset Offset after ensuring that the message consumption is finished; S6, setting threads of a plurality of servers. The method is characterized in that the partition number of multiple data topics is counted,the following formula is adopted for calculation: P/n = concurrence, P is the data of the total partition number, n is the number of servers, and concurrence is the number of threads; the method hasthe advantages that data fluctuation caused by instability of a single server is completely eradicated, and the problems of data consistency and single-point faults are solved.

The invention relates to the field of information construction, in particular to a big data platform-based data processing domain architecture method, which comprises the following steps of establishing a service bus for communication between a service provider and a service caller through a public communication bus consisting of various point-to-point connections; establishing a message-orientedmiddleware for communication between different application systems; and establishing a unified data access service, providing a unified data access entry of the underlying heterogeneous databases, andabstracting the plurality of underlying physical databases/stored tables into one or more logical databases according to the requirements of the business. According to the present invention, the dataprocessing domain realizes the service integration architecture between systems through the service bus and the message middleware, the cross-department business collaboration and the logic data sharing are realized, the flexible multi-data-source access is provided for business monitoring applications, and the unified data monitoring is realized, and the problem that the data consistency and timeliness cannot be guaranteed due to the redundant copying and multi-copy storage of the service data, is solved.

The invention discloses a method for unidirectional data synchronization between multiple data sources and relates to the technical field of data storage. Through carrying out mapping management on data between master and slave data sources, configuration management on unidirectional data synchronization between the master and slave data sources and distributed scheduling management on data transmission tasks, making transmission nodes carry out parallel transmission on the data and changing and collecting the data between the master and slave data sources, data synchronization is realized, and the problems of consistency and timeliness of the data between the master and slave data sources of the existing distributed data storage are solved. The method has the advantages of strong fault tolerance, simplicity in operation and data change timing consistency.

The present invention relates to the database technology and aims at providing a method for realizing high availability of a database based on a docker environment. The method for realizing high availability of the database based on the docker environment comprises the following steps: creating docker containers at a server; configuring database applications in the docker containers; mounting thedata storage directory of the database in the docker container to the same directory of the server and testing the same; deploying multiple docker containers on the server; forming a LAN by multiple docker containers, configuring a virtual IP and setting to be keeplived for master-slave switching to provide services for the outside world. The database application data storage directory in each docker container in the invention is mounted on a directory of a server, so the invention solves the problem of data consistency completely with low cost and high efficiency.

The invention provides a Hadoop-based electric power cloud platform design scheme. Through the HDFS and HBase, the efficiency of data storage and index is increased; MapReduce is employed for offline analysis of data and efficient processing of data. Rest-standard Web Service facilitates uploading of user data and brings convenience for the development of a third party. The scheme solves the problems of low efficiency and poor performance in a conventional data processing process, solves the problem of low efficiency in solving the problem in data consistency in the data processing process under the conventional single machine condition, guarantees the stable operation of clusters and has a high handling capacity; data interfaces of higher standards are used, and thus the cost for repeated development is prevented.

The invention relates to online games, in particular to a method for preventing user from cheating by means of logic random numbers. By setting a logic number instruction set, the problem about data consistency between clients in the prior art is solved, and meanwhile cheating risks caused by the data consistency problem are eliminated.

The invention belongs to the technical field of information retrieval and database structures thereof, and discloses a distributed database for big data and a constructing method thereof. A file storage layer is a distributed file system HDFS specifically and used for saving HBase data in the system and data needed by Hadoop. A database main body layer is divided into an HBase database core layerand a Redis high-speed buffering layer. An assisting tool layer is divided into an Sqoop data import export tool and a Tephra affair assisting processing framework. When the HBase and the Redis are selected to be combined and used, the saving of a large amount of data can be achieved while high concurrence and high timeliness of the system can be taken into account. For the ensuring of the consistency of data in the database, three types of replications of snapshot replication, affair replication and combining replication are mainly adopted.

The invention relates to a multi-purpose vehicle remote detecting and monitoring device, which belongs to the field of vehicle remote detecting and monitoring. The device comprises a main control unit, a mobile communication unit, an audio signal unit, a satellite positioning unit, a vehicle detection unit, an image acquisition unit, a power management unit, a keyboard/touch screen, and a liquid crystal display. All the units and components except the main control unit, the mobile communication unit and the power management unit can be combined freely, can be configured flexibly for different applications, and are easy to expand and upgrade. The device can be used as a vehicular unit of multiple detecting and monitoring systems, can provide a variety of monitoring and detecting services for customers, multiple monitoring centers and service centers, and can send an alarm to multiple public alarm centers. The device integrates the systems effectively and makes the systems work together. Thus, the problem that the systems isolated from one another fight for resources, have repetitive functions and data and are inconsistent in data is solved, and investment is saved.

The invention relates to an automatic synchronization method of multistate data in an integrated substation monitoring system. The method is technically characterized by including: firstly, allowing for source data file synchronization among multiple computer nodes by means of creating a file server; secondly, allowing a model database to automatically sync to an operational database through a data incremental mechanism; and thirdly, syncing the operational database to the model database by means of table change record real-time loading. The method is reasonable in design, data are kept constantly consistent in the source data files, the operational database and the model database among the computer nodes of the dual-mode integrated system, field engineering efficiency is greatly increased for intelligent substation automation engineering, and maintenance operations are simpler.

The invention discloses a height-based block chain peer-to-peer network data synchronization method, which comprises the following steps of: calculating an account book data set height which needs to be formally recorded in an account book, wherein an account book recorder broadcasts the account book data set height and an account book data set to an adjacent account book recorder through message broadcasting; the close account book recorder receives the broadcasted message and stores the broadcasted message locally; and each account book recorder sends a node height query request to the surrounding accounting nodes at regular time, compares the height of a request return node with the height of a local node, and starts a difference compensation mechanism to perform data synchronization if the height of the request return node is greater than the height of the local node. According to the invention, on the premise that the block chain network system allows free access of any node, whether the node data is in the latest calculation baseline in the distributed peer-to-peer network system is rapidly and accurately judged; and meanwhile, a synchronization standard and a synchronization range are defined for data replication among different nodes in the peer-to-peer network.