52results about How to "Solving Data Consistency Issues" patented technology

The invention discloses a method and a device for updating data in a distributed storage system. The method comprises the steps as follows: a current server node distributes an only version number to to-be-updated data in a progressive increase manner, and a plurality of replica server node identifiers where a plurality of replicas of the to-be-updated data are located from a metadata information repository; the current server node sends the to-be-updated data and the distributed version number to the replica server nodes corresponding to the plurality of the replica server node identifiers, so that a plurality of the replica server nodes can update respectively preserved replicas and corresponding version numbers according to the to-be-updated data; the version numbers represent the update times of the replicas; and the current server node judges whether data of more than a half of the plurality of the replica server nodes are updated successfully, if the data are updated successfully, successful data updating information and updated version numbers are sent back to a client. With the adoption of the method and the device for updating data in the distributed storage system, the expenditure is increased, and the data consistency among the plurality of the replicas can be guaranteed.

The invention discloses an intelligent hash data layout method, a cluster storage system and a cluster storage method. The intelligent hash data layout method is used for laying out storage nodes in a data volume. Data is distributed through a hash distribution method by taking a directory as a basic unit. The parent directory of a file utilizes extended attributes to record the mapping information of the storage nodes. Sub-files are distributed in the storage nodes to which the parent directory belongs. The distribution method of the sub-files in the storage nodes to which the parent directory belongs specifically comprises one of the following situations that: the sub-files are distributed in the storage nodes to which the parent directory belongs through the hash distribution method; the sub-files are distributed in the storage nodes to which the parent directory belongs through a zonal two-level distribution method; the sub-files are distributed in the storage nodes to which the parent directory belongs through a duplicate two-level distribution method; and the sub-files are firstly distributed in the storage nodes to which the parent directory belongs through the zonal two-level distribution method and then are distributed through a duplicate three-level distribution method. The system and the methods provided by the invention have the advantages that the extensibility, the performance, the availability and the applicability of the cluster storage system can be remarkably improved, and the load pressure of a storage server can be greatly decreased.

The invention relates to a data caching achieving method. The method includes the steps that firstly, data information in caches is acquired by an application program through data middleware; secondly, when data are modified through the application program, the data in a database are written in through the data middleware, and data in the caches are updated at the same time; thirdly, an updating cycle is acquired by the data middleware through configuration information; fourthly, the data in the caches are regularly updated by the data middleware according to the updating cycle to keep the data in the caches assistant with the data in the database. The data caching achieving method improves the response speed of data reading and system performance, effectively achieves the consistency of the data in the caches and the data in the database and the purposes of guaranteeing data consistency and improving system performance within a certain period of time, reduces the number of times of the occasions that a system has the request of calling the database, and reduces performance expenses for database calling.

The invention discloses a cache realization method of interface calling, which effectively integrates a centralized cache and a stand-alone cache. Interface version number information saved in a stand-alone Ehcache cache is used for monitoring timeliness of interface information in a stand-alone memory cache, an interface calling return result is preferentially acquired from the local stand-alone cache during interface calling, so that the local stand-alone cache can be made full use of to acquire the interface calling return result under the condition of low interface update frequency, the centralized cache can be used for acquiring the interface calling return result under the condition of high interface frequency, the data consistency of the stand-alone cache can be realized, the stand-alone cache can be made full use of, the pressure of the centralized cache is effectively reduced, the network transmission overhead is reduced, and the system resource waste is avoided.

A data communication method of a redundant CAN bus communication system comprises the following steps: a sending terminal sends PDO messages containing a scrolling count value a on two CAN buses; when the sending terminal sends the PDO messages with the same message ID, each time a frame of the PDO message is sent, the scrolling count value a is increased by 1, the initial value of a is 0, the upper limit value of a is N, and when a reaches N, the count is restarted from 1; an expectation counter and an invalid receiving window are arranged at a receiving terminal, and the count value b of the expectation counter indicates the scrolling count value of the PDO message that is expected to be received; when receiving a frame of the PDO message sent by the sending terminal each time, the receiving terminal firstly judges whether the message is valid; if the message is valid, and a is equal to 0, b is set to 1; if the message is valid, and b is less than N, b is updated to b=a+1, and if b is equal to N, b is set to 1; and when the receiving terminal receives the invalid messages, the invalid messages are discarded, and b is maintained to be unchanged. According to the data communication method disclosed by the invention, the shock of the old and new data generated by the receiving terminal can be avoided.

The invention provides an edge node scheduling method and system based on a sinking distributed network. The method comprises the following steps: determining a scheduling strategy of an edge node based on a preset load balancing algorithm; receiving a service request from the terminal equipment; identifying a proper service node based on the data type of the service request; distributing the service node to process the service request; and adjusting the scheduling strategy based on the real-time monitored data feedback. Through the scheme of the embodiment of the invention, the problem of data consistency caused by insufficient data synchronization mechanism under the condition of high concurrent requests can be solved. And the problem of communication delay increase caused by lack of an adaptive routing protocol under the condition of dynamically changing network topology is solved. And the problem of computing resource waste caused by an unreasonable task allocation strategy under the condition of resource-limited edge nodes is solved. And under the condition of data intensive application, the problem of data processing bottleneck caused by an imperfect data caching mechanism is solved.

An application consistent data protection method provides application-assist and replication-technology neutral mirroring that ensures that a remote data copy is application-consistent. The method comprises a coordination protocol to coordinate application hosts across heterogeneous hosts and heterogeneous storage devices. The method utilizes a disk layout and data record format that enables use of an underlying replication ability of a storage device, minimizing development cost and utilizing customer investment. The method comprises on-demand consistency point initiation to minimize performance impact and maximize system resource usage. The method can be applied to both synchronous and asynchronous mirroring and can be incorporated into any virtualization device.

The invention relates to a DID identity-based block chain zero-knowledge proof anonymous certificate verification method and system. The method comprises the steps of obtaining DID distributed digital certificate identity information of a certificate to-be-verified provider in a Hash chain; obtaining DID distributed digital verification identity information written by a certificate verification party based on the block chain; then, on the basis of a cross-system anonymous certificate verification library pre-stored in a block chain, carrying out certificate verification comparison on the acquired DID distributed digital certificate identity information and the DID distributed digital verification identity information, and generating a certificate verification comparison result; finally, according to the voucher verification comparison result, generating a voucher verification comparison result verification data code, and sending the voucher verification comparison result verification data code to the voucher to-be-verified provider and the voucher verification party. According to the method, the problem of data consistency of a distributed system in the prior art is solved, the personal identification information is protected, and tampering is prevented.

The invention discloses a request coordination method and device based on a Zookeeper, a computer device and a storage medium. The request coordination method based on the Zookeeper comprises the following steps: receiving a write request of a client; mapping all the service nodes in the Zookeeper cluster to a node ring; calculating the distance between every two adjacent nodes on the node ring through the agent node, and obtaining a leader node according to the distance; and querying the routing table through the agent node, and submitting the write request to the leader node for processing.According to the embodiment of the invention, the requirement on the number of servers in the existing Leader election of the ZooKeeper cluster is made up, and the transverse expansion capability andfault tolerance of the ZooKeper cluster are improved. And the proxy node is introduced to inquire the routing table to quickly route the client request, so that the problem of low efficiency caused bya main writing mode of the existing client or the problem of data consistency caused by writing in any mode are avoided.

The invention discloses an airborne helicopter vibration monitoring system. The system comprises a data acquisition device and a sensor assembly, the sensor assembly is arranged on a motion part of ahelicopter and used for measuring vibration signals of the motion part, the data acquisition device is connected with the sensor assembly and used for performing filtering and analog-to-digital conversion on analog vibration signals obtained by measurement and obtaining digital vibration signals, the data acquisition device is provided with a data memory, and the data memory is used for storing the digital vibration signals for airborne in-situ real-time analysis or analysis through transfer to a ground station. According to the system, problems of long time consumption of fault diagnosis andmaintenance of the helicopter, long preparation time of data measurement, less measuring points, incomplete data, and inconsistent historical data and test data due to the influence of sensor installation are mainly solved, and the accuracy, the integrity and the timeliness of vibration data measurement are improved.

The invention discloses a production and consumption method based on a kafka cluster, and relates to the technical field of information processing. The method comprises the following steps: S1, setting a message submission rule; S2, setting an automatic message retry rule; S3, setting the number of copies of the theme topic, and setting the number of copies of the theme topic to be greater than orequal to 3; S4, setting the number of message write-in copies, and ensuring that the number of copies of the topic is greater than the number of message write-in copies; S5, submitting the offset Offset after ensuring that the message consumption is finished; S6, setting threads of a plurality of servers. The method is characterized in that the partition number of multiple data topics is counted,the following formula is adopted for calculation: P / n = concurrence, P is the data of the total partition number, n is the number of servers, and concurrence is the number of threads; the method hasthe advantages that data fluctuation caused by instability of a single server is completely eradicated, and the problems of data consistency and single-point faults are solved.

The invention relates to the field of information construction, in particular to a big data platform-based data processing domain architecture method, which comprises the following steps of establishing a service bus for communication between a service provider and a service caller through a public communication bus consisting of various point-to-point connections; establishing a message-orientedmiddleware for communication between different application systems; and establishing a unified data access service, providing a unified data access entry of the underlying heterogeneous databases, andabstracting the plurality of underlying physical databases / stored tables into one or more logical databases according to the requirements of the business. According to the present invention, the dataprocessing domain realizes the service integration architecture between systems through the service bus and the message middleware, the cross-department business collaboration and the logic data sharing are realized, the flexible multi-data-source access is provided for business monitoring applications, and the unified data monitoring is realized, and the problem that the data consistency and timeliness cannot be guaranteed due to the redundant copying and multi-copy storage of the service data, is solved.

The invention discloses a method for unidirectional data synchronization between multiple data sources and relates to the technical field of data storage. Through carrying out mapping management on data between master and slave data sources, configuration management on unidirectional data synchronization between the master and slave data sources and distributed scheduling management on data transmission tasks, making transmission nodes carry out parallel transmission on the data and changing and collecting the data between the master and slave data sources, data synchronization is realized, and the problems of consistency and timeliness of the data between the master and slave data sources of the existing distributed data storage are solved. The method has the advantages of strong fault tolerance, simplicity in operation and data change timing consistency.

The present invention relates to the database technology and aims at providing a method for realizing high availability of a database based on a docker environment. The method for realizing high availability of the database based on the docker environment comprises the following steps: creating docker containers at a server; configuring database applications in the docker containers; mounting thedata storage directory of the database in the docker container to the same directory of the server and testing the same; deploying multiple docker containers on the server; forming a LAN by multiple docker containers, configuring a virtual IP and setting to be keeplived for master-slave switching to provide services for the outside world. The database application data storage directory in each docker container in the invention is mounted on a directory of a server, so the invention solves the problem of data consistency completely with low cost and high efficiency.

The invention provides a Hadoop-based electric power cloud platform design scheme. Through the HDFS and HBase, the efficiency of data storage and index is increased; MapReduce is employed for offline analysis of data and efficient processing of data. Rest-standard Web Service facilitates uploading of user data and brings convenience for the development of a third party. The scheme solves the problems of low efficiency and poor performance in a conventional data processing process, solves the problem of low efficiency in solving the problem in data consistency in the data processing process under the conventional single machine condition, guarantees the stable operation of clusters and has a high handling capacity; data interfaces of higher standards are used, and thus the cost for repeated development is prevented.

The invention relates to online games, in particular to a method for preventing user from cheating by means of logic random numbers. By setting a logic number instruction set, the problem about data consistency between clients in the prior art is solved, and meanwhile cheating risks caused by the data consistency problem are eliminated.

The invention belongs to the technical field of information retrieval and database structures thereof, and discloses a distributed database for big data and a constructing method thereof. A file storage layer is a distributed file system HDFS specifically and used for saving HBase data in the system and data needed by Hadoop. A database main body layer is divided into an HBase database core layerand a Redis high-speed buffering layer. An assisting tool layer is divided into an Sqoop data import export tool and a Tephra affair assisting processing framework. When the HBase and the Redis are selected to be combined and used, the saving of a large amount of data can be achieved while high concurrence and high timeliness of the system can be taken into account. For the ensuring of the consistency of data in the database, three types of replications of snapshot replication, affair replication and combining replication are mainly adopted.

The invention discloses a data communication method of a redundant CAN bus communication system. The method comprises the following steps: a sending terminal sends PDO messages containing a scrolling count value a on two CAN buses; when the sending terminal sends the PDO messages with the same message ID, each time a frame of the PDO message is sent, the scrolling count value a is increased by 1, the initial value of a is 0, the upper limit value of a is N, and when a reaches N, the count is restarted from 1; an expectation counter is arranged at a receiving terminal, and the count value b of the expectation counter indicates the scrolling count value of the PDO message that is expected to be received; when receiving a frame of the PDO message sent by the sending terminal each time, the receiving terminal firstly judges whether the message is valid; if the message is valid and a is equal to 0, b is set to 1; if the message is valid and b is less than N, b is updated to b=a+1, and if b is equal to N, b is set to 1; and when the receiving terminal receives the invalid messages, the invalid messages are discarded, and b is maintained to be unchanged. According to the data communication method disclosed by the invention, the shock of the old and new data generated by the receiving terminal can be avoided.

The invention relates to a multi-purpose vehicle remote detecting and monitoring device, which belongs to the field of vehicle remote detecting and monitoring. The device comprises a main control unit, a mobile communication unit, an audio signal unit, a satellite positioning unit, a vehicle detection unit, an image acquisition unit, a power management unit, a keyboard / touch screen, and a liquid crystal display. All the units and components except the main control unit, the mobile communication unit and the power management unit can be combined freely, can be configured flexibly for different applications, and are easy to expand and upgrade. The device can be used as a vehicular unit of multiple detecting and monitoring systems, can provide a variety of monitoring and detecting services for customers, multiple monitoring centers and service centers, and can send an alarm to multiple public alarm centers. The device integrates the systems effectively and makes the systems work together. Thus, the problem that the systems isolated from one another fight for resources, have repetitive functions and data and are inconsistent in data is solved, and investment is saved.

The invention discloses an efficient maintenance-free automatic partition method for big data of a PostgreSQL, belonging to the field of processing technologies for the big data of a database. The method comprises the following steps of creating an entry table and converting a partition value to a fixed cycle value over time in an abstract manner; creating fixed partitioned logic according to the fixed cycle value; creating a partition inheritance table, which is distributed according to a partitioned logic code and a field value of the entry table; stripping an active partition from the partitioned logic and automatically creating the active partition over time; utilizing inheritance properties to transfer data of a fixed partition to the active partition regularly and deleting the data in the fixed partition after transfer is completed; carrying out split design according to the data size, predefining correspondence rule of layering and the data size, and automatically carrying out split on the next layer when the table data size of the active partition exceeds an upper threshold; and creating an asynchronous inheritance table, which is transferred according to asynchronous active movement data of the partition inheritance table.

The embodiment of the invention discloses a home decoration household object information processing method and device. The method comprises steps of a server determining a target house object and theassociated description file information, and a description file being used for describing a three-dimensional space scene of a house and a home decoration household object model and / or a layout mode used in the house; determining the information of at least one target user joining the target house object; and providing the description file information to a client of the target user so that the client of the target user renders a three-dimensional house model of the target house object according to the description file. The method is advantaged in that mutual communication between a plurality of users for the same house model can be facilitated.

The invention discloses an erasure code overwrite method for distributed storage CEPH. First, the client node sends a write request to the main OSD in the storage node of Ceph, and the main OSD automatically selects the optimal coding scheme and then calculates the data block to be read. , and according to the client id and object id, read the data block from the cache and return it to the main OSD; then the main OSD, after receiving all the required read data blocks, updates the data block and check block, and sends them to the corresponding OSD that needs to be updated ;Then the data block node and the check block node receive the write request, allocate a new storage location near the original data block to store the new update, and record the metadata of this write request to the log PGLOG, and send ACK to the main OSD after the data and log are placed on the disk ;Finally, after the main OSD receives the ACKs from all updated nodes, it records the metadata of this update to memory, and replies ACK to the client to complete the write request. The invention solves the problem that the distributed storage system CEPH does not support erasure code overwriting.

The invention relates to an automatic synchronization method of multistate data in an integrated substation monitoring system. The method is technically characterized by including: firstly, allowing for source data file synchronization among multiple computer nodes by means of creating a file server; secondly, allowing a model database to automatically sync to an operational database through a data incremental mechanism; and thirdly, syncing the operational database to the model database by means of table change record real-time loading. The method is reasonable in design, data are kept constantly consistent in the source data files, the operational database and the model database among the computer nodes of the dual-mode integrated system, field engineering efficiency is greatly increased for intelligent substation automation engineering, and maintenance operations are simpler.

The invention provides a distributed transaction processing method and device based on a service-free architecture. The method comprises the following steps: receiving an event processing request sent by a platform end, wherein the event processing request is generated by the platform end based on a trigger event request sent by a user end; responding to the event processing request, and sending a query state request to a platform end to query a main transaction execution state; receiving first feedback information sent by the platform end according to the query state request, wherein the first feedback information comprises main transaction identification information and a main transaction execution state; and when the execution state of the main transaction in the first feedback information is a successful state, executing the sub-transaction, wherein the sub-transaction is subordinate to the main transaction. According to the method disclosed by the embodiment of the invention, the subordinate differentiation is carried out on the transactions in the event according to the logic, and the orderly processing of the data in the event is ensured through a sequential execution transmission method, so that the method is low in implementation cost, and the problem of data consistency can be effectively solved.

The invention discloses a full-quadrilateral grid generation method based on a predefined mode, and particularly relates to the technical field of grid generation, and the method comprises the specific steps: cleaning a geometric model, setting a predefined mode of grid generation according to the cleaned geometric model, and defining a grid generation rule, the method comprises the following steps: carrying out grid division according to a geometric model and a predefined mode, generating a full-quadrilateral grid based on an overlay network technology, carrying out cooperative scheduling on generation of the full-quadrilateral grid by utilizing a mode based on a distributed architecture platform, optimizing the full-quadrilateral grid by utilizing a post-processing technology, and carrying out quality inspection on the generated full-quadrilateral grid. According to the method, the generation efficiency of the full-quadrilateral grid is evaluated by combining the result of quality inspection of the full-quadrilateral grid and the calculation precision in the grid generation process, and a grid quality control strategy is provided according to the evaluation result, so that the contradiction between data consistency and processing speed when a large-scale complex geometric model is processed is effectively solved.

The invention discloses a height-based block chain peer-to-peer network data synchronization method, which comprises the following steps of: calculating an account book data set height which needs to be formally recorded in an account book, wherein an account book recorder broadcasts the account book data set height and an account book data set to an adjacent account book recorder through message broadcasting; the close account book recorder receives the broadcasted message and stores the broadcasted message locally; and each account book recorder sends a node height query request to the surrounding accounting nodes at regular time, compares the height of a request return node with the height of a local node, and starts a difference compensation mechanism to perform data synchronization if the height of the request return node is greater than the height of the local node. According to the invention, on the premise that the block chain network system allows free access of any node, whether the node data is in the latest calculation baseline in the distributed peer-to-peer network system is rapidly and accurately judged; and meanwhile, a synchronization standard and a synchronization range are defined for data replication among different nodes in the peer-to-peer network.

The present invention provides a client system, information processing method, reading and writing method and device. After receiving the target operation request sent by the service system for operating the client information, according to the operation flow identifier carried in the target operation request, the In each operation record of the activity table, query whether the operation flow ID is unique. If the operation flow ID is unique, in the tool table, according to the target operation request, update the corresponding index field used to index the basic table, and in the activity table Logging of target action requests. Since the activity table is used to record all operations performed by the business system on customer information, and each operation has a unique operation flow identifier, it avoids repeated operations and confusion of customer data, and not only solves data consistency in the case of multiple concurrency problem, while improving system performance and capacity.

The invention relates to online games, in particular to a method for preventing users from cheating by using logical random numbers. The present invention solves the problem of data consistency among clients in the prior art by setting a logical digital instruction set, and at the same time, the risk of cheating brought about by it is solved.

The invention relates to a learning state monitoring method, system and device based on artificial intelligence and a medium. The method comprises the following steps: collecting signals such as physiological and behavior images of a target object through a multi-source heterogeneous sensor, and performing normalization processing on aligned features to generate a standardized feature vector; calculating a comprehensive cognitive state score of the feature vector by adopting a dynamic weighted fusion algorithm, and judging and outputting a soft label according to a preset threshold value; applying constraint random disturbance based on statistical distribution characteristics of the feature vectors to generate synthetic data, and associating the synthetic data with the soft labels to construct a soft label data set; by taking the feature vector of the data set as input and the soft label as a supervision signal, iteratively calculating loss through a preset loss formula, updating model network parameters to convergence, and obtaining an optimized neural network model; during real-time monitoring, processed sensor signals are input into the model, and quantitative learning state scores are output through end-to-end reasoning. The method can break through the limitation that traditional monitoring is high in subjectivity and insufficient in real-time performance.

This application discloses a cache implementation method for interface calls, which effectively combines centralized cache and stand-alone cache, uses the interface version number information stored in the stand-alone Ehcache cache, and monitors the timeliness of interface information in the stand-alone memory cache , and when the interface is called, the interface call return result is preferentially obtained from the local stand-alone cache. In this way, the local stand-alone cache can be fully utilized to obtain the return result of the interface call when the interface update frequency is low. In the case of high interface frequency The centralized cache can be used to obtain the return result of the interface call, which can not only solve the data consistency problem of the stand-alone cache, but also make full use of the stand-alone cache, effectively reduce the pressure of the centralized cache, reduce network transmission overhead, and avoid waste of system resources.