40results about How to "Reduce storage redundancy" patented technology

The invention provides a mass file storage method and device for a distributed type system. The method comprises the steps of encoding 2n data files to be stored to generate m global verifying block files; dividing the 2n data files into k groups, encoding each group of data files to generate corresponding local verifying block files; storing the 2n data files, the m global verifying block files and the k local verifying block files in 2n+m+k severs in the distributed type system according to a mode that only one file is stored in one server. According to the scheme, encoding treatment is conducted on original data, the global verifying block files and the local verifying block files are calculated, then, original data files and the verifying block files simply need to be stored in the distributed type system instead of storing multiple copies of the original data files, and thus the usage rate of storage equipment is obviously increased on the premise of guaranteeing that the storage reliability is not lowered.

The invention provides a data management method and device. The data management method can perform trajectory storage and querying by using a trajectory pattern extracted from lots of historical trajectories. The data management method includes: matching original trajectory points to a road network through a map matching method, and acquiring a trajectory set after map matching; determining a minimum support and a minimum road segment number corresponding to different road types according to training data; establishing a trajectory tree according to the trajectory set, and establishing a trajectory sub-tree with each node of the trajectory tree as a staring point, wherein the trajectory tree and the trajectory sub-trees include at least one node, and each node is an intersection of the road network; determining a trajectory pattern meeting the minimum support and the minimum road segment number, passing through each node according to the trajectory sub-trees; and performing redundancy elimination treatment on the trajectory pattern of each node, and generating a new trajectory pattern and storing the new trajectory pattern. The data management method and device can reduce trajectory storage redundancy, and can accelerate the trajectory querying speed.

The invention discloses a distributed storage transformer station inspection robot remote centralized monitoring system and method. The system includes a plurality of in-station servers and a plurality of remote servers, the in-station servers are deployed in the corresponding substations and receive the data of an in-station network video server and a substation inspection robot respectively, the substation inspection robot transmits the video data to the in-station network video server, the in-station network video server receives all the video data in the substation, the in-station servers upload the data to the corresponding remote servers, and the in-station network video server uploads the data to the plurality of remote servers, and the remote servers receive the data uploaded by the in-station servers and the network video server in the substation corresponding to the remote servers, and upload the data to the corresponding remote centralized control clients. The system and method overcome the problem that the unified storage mode is large in data bulk, the retrieval speed is slow and the resources are consumed.

The invention discloses a data fusion processing method for the dynamic time granularity of multiple traffic detection sources, and belongs to the technical field of urban traffic data analysis. The method comprises the following steps: detecting the data acquisition time interval to extract a time base; loading space information for detection data, and generalizing the data structure of traffic data; evaluating the data correlation degree, equipment data accuracy and environment influence degree of each detection source to obtain the credibility coefficient of the detection source; obtaining the time granularity application requirement based on dynamic changing and updating of location check-in data of a mobile terminal in a detection area; and carrying out traffic parameter fusion of the multiple detection sources according to the application requirement and the credibility of the detection sources. According to the invention, urban traffic data processing based on the traffic data acquired by a basic sensor and the location check-in data of the mobile terminal is in line with the development trend of big data, and the rate of dynamic data fusion according to the change of time granularity is effectively improved. The method has the advantages of quick operation getting and storage redundancy reduction.

The invention discloses a dimension data storing method. The method comprises the steps of acquiring new dimension data produced as a terminal runs; determining the new dimension data meet the storage condition according to the preset dimension strategy, wherein the dimension strategy is the strategy for determining whether the dimension data meet the storage condition; if so, adding the new dimension data to a dimension data sequence to store. According to the method, the data meeting the storage conditions can be stored only, so that the storage quantity of the time sequence data can be decreased, and the storage redundancy can be reduced.

The invention provides a user priority-oriented base station collaborative caching method in a dense scene. The method mainly solves the problems that the hit rate of user request content in a base station cache is low and high-priority users are unfairly processed due to the fact that user requests are not differentially served in the prior art. According to the implementation scheme, the methodcomprises the following steps: firstly, establishing a deep reinforcement learning model of base station collaborative caching according to request information of all users and information in a base station buffer; performing offline training and learning on the model to obtain a learned deep reinforcement learning model; and finally, carrying out online base station collaborative cache decision at the macro base station by using the learned deep reinforcement learning model. According to the method, the hit rate of the request content of the user in the base station buffer is increased, differentiated services can be provided for the users with different priorities, the internet surfing requirements of the different users can be met, greater benefits can be brought to operators, and the method can be used for accessing resources by the users in a wireless network.

The invention discloses a call data processing method and device for service call, electronic equipment and a storage medium. The invention relates to the technical field of information, in particularto service calling and belongs to the technical field of frameworks for searching. The call data processing method for service call comprises the following steps: receiving a request context for a current node from a father node, wherein the request context comprises a request identifier ID and a calling ID of the father node for calling the node; sending a request context for the child node to the child node, and the request context for the child node comprises the request ID and a child calling ID of the child node called by the node, wherein the child-calling ID is generated according to the calling ID and a calling address of a child-node called by the node; and storing the request ID, the calling ID and the calling address.

The invention provides a WLAN Web caching system. The system comprises a cache controller and two or more than two Access Point (AP). The AP is used for receiving the requirement of the WLAN user for internet information to obtain a required object and send the object to the user; the cache controller is used for obtaining the requirement from the AP, obtains the required object or information about the required object position according to the global cache abstract and sends the information to the AP. The invention further provides a method based on the system. By means of the technical scheme, centralized control few in storage redundancy can be achieved, calculation and storage resources of the AP in the WLAN are fully used, the system obtains good extendibility, and effects of the system on the gateway stability are reduced.

The invention relates to a fast drawing method of a multi-level war-game map based on a blocking structure. The fast drawing method comprises the steps of: establishing a hexagonal grid template block; calculating all vertex positions in the hexagonal grid template block and storing; calculating the number of splicing blocks needed in directions X and Y according to a resolution ratio of a hexagonal grid needing to draw; drawing each splicing block one by one. According to the fast drawing method of the multi-level war-game map based on the blocking structure, the reusability characteristics of the hexagonal grid on geometric structures and material attributes are discovered, the redundant calculation is reduced, the calculation speed is improved so that the speed of drawing a large-scale hexagonal grid is real-time.

The invention discloses a medical data management system based on a block chain. The system is used for solving the problems that an existing medical data management system does not screen medical data, and though data are found, the data quality is poor, the medical data are not reasonably stored, and storage redundancy of storage nodes of a block chain is not reduced. The system comprises a medical data acquisition module, a data encryption module, a node distribution module, a server, a node acquisition module and a block chain node module. According to the method, medical data is screenedthrough node storage values, so that the data with relatively high quality in the medical data is selected and stored; by acquiring and analyzing information of a block chain storage node to obtain acoincidence value of the block chain storage node, the block chain storage node is reasonably selected for storage through the coincidence value; node allocation data is deleted and compressed for storage through the management value, so that the storage redundancy of block chain storage nodes is reduced.

The invention discloses a single-pixel photon counting spread spectrum compression depth imaging method, which comprises the following steps: S1, sending, by a pseudo-random code generator, based on a programmable logic device, a pseudo-random code to drive a vertical surface laser to emit a light beam; s2, generating a random matrix, and loading the generated random matrix to a digital light projection chip through an electric signal; s3, enabling the light beam emitted by the vertical surface laser to reach the target and receiving, by the receiving system, the returned light beam; s4, acquiring a photon arrival time point value through a single-photon detector and a photon time arrival recorder within a certain integral time; s5, obtaining a measurement vector through an optimal correlation detection method; s6, reconstructing a depth image of the target through a sparse programming inversion method. The problem of range ambiguity of current single-pixel imaging is solved, the receiving signal-to-noise ratio of single-pixel imaging is improved and the modulation frequency is reduced by utilizing an optimal correlation detection method, so that the measurement matrix dimension is reduced, the data storage redundancy is reduced, and the imaging efficiency is improved.

The invention discloses a low-redundancy block chain data storage and retrieval method and system. The method comprises the steps: reconstructing a traditional distributed account book, removing an account book data part, adding a query index part, and constructing a low-redundancy block data structure; realizing an uplink consensus mechanism between block chain nodes based on a Raft protocol; and after the leader node links the account book block, storing the data to the local, selecting an account book data backup node from the block chain network based on the Hash function, sending the backup data to the backup node for backup storage, and sending query index data to all other nodes for updating the query index. By reconstructing a block data structure, eliminating redundant account book data and newly adding a query index structure, a Raft protocol and Hash-based low-redundancy account book data storage and retrieval method is provided, and finally block chain low-redundancy data storage and traceability are realized.

The invention discloses a large file transmission method and apparatus. The method comprises the following steps: step 1, a server stores all fragment files of a target file, and sorting information and size information of the fragment files in the target file, and generates synthesis information of the target file according to the sorting information, the size information and storage addresses ofthe fragment files in a process of receiving the fragment files or after all fragment files of the target file are stored; and step 2, after receiving a downloading request of the target file from aclient, the server provides data contents of the fragment files for the client according to the sequence of the fragment files in the target file according to the synthesis information of the target file. By adoption of the large file transmission method and apparatus disclosed by the invention, a file synthesis step consuming the processing amount is omitted, the processing efficiency of the server is improved, and meanwhile storage redundancy of the server is reduced.

The invention discloses a distributed storage method and a transmission decoding method, and relates to the field of distributed storage. The distributed storage method comprises the following steps:partitioning original data to obtain a first preset number of data blocks, then encoding the data blocks according to a generation matrix to generate a second preset number of data packets, performingdata interception on the data packets by utilizing an interception scheme to obtain intercepted data packets, and storing the intercepted data packets into the corresponding distributed nodes. According to the embodiment of the invention, higher coding efficiency can be ensured by coding according to the generation matrix, and the storage redundancy of the nodes can be reduced when the data packets are intercepted and stored through the interception scheme, so that the storage redundancy of the whole distributed system is reduced, the storage space is saved, and the storage efficiency is improved.

The invention provides a mail data storage method and device. The method comprises the following steps: firstly calculating the segment body recognition of each atomic segment in a to-be-stored mail;then, replacing the atomic segment body in the to-be-stored mail with the segment body identifier to obtain compressed mail data, and storing the mail data; and finally, detecting whether the atomic segment body in the mail to be stored is stored in the electronic equipment or not, and storing the atomic segment body which is not stored in the electronic equipment into the electronic equipment according to a detection result. Compared with the prior art, the to-be-stored mail is stored integrally; compared with the prior art, the storage granularity of the mail bodies stored in the atomic segment bodies is smaller, and the same atomic segment bodies in the mail bodies of different mails can be stored only once in the mail data storage process, so that the storage redundancy of mail data storage can be reduced, and storage resources are saved.

The invention discloses a multi-tenant shared data processing method and system, and the method comprises the steps: receiving target data corresponding to a target data source configuration id sent by a tenant, generating a target data identifier of the target data and a target unit identifier of each target data segmentation unit according to the target data source configuration id and the attribute of the target data; if it is judged that there is no target data in the database according to the target data identifier and each target unit identifier, storing the target unit identifier in a shared data table, storing the target data identifier in a shared data storage table, performing a preset association operation, and storing the target data; when a query request of the tenant for the target data is received, the target data is obtained according to the tenant name of the tenant, the tenant data association table, the shared data storage table and the shared data table, and the target data is returned to the tenant, so that the multi-tenant system isolation is ensured, and meanwhile, the user experience is improved. The processing efficiency of multi-tenant shared data is improved, and the storage redundancy is reduced.

The present invention proposes a user priority-oriented base station cooperative caching method in a dense scene, which mainly solves the low hit rate of user request content in the base station cache in the prior art and the high priority caused by user requests being served without differentiation The problem of users being treated unfairly. The implementation plan is: first establish a deep reinforcement learning model for base station cooperative caching according to the request information of all users and the information in the base station buffer; then conduct offline training and learning on the model to obtain a learned deep reinforcement learning model; finally use The learned deep reinforcement learning model performs online base station cooperative caching decision at the macro base station. The invention not only increases the hit rate of the user's request content in the base station buffer, but also provides differentiated services to users with different priorities, which can not only meet the Internet access requirements of different users, but also bring more benefits to operators. Great benefits can be used for user access to resources in wireless networks.

The invention provides a communication control method for smart home. The method comprises the following steps: when Ethernet data are transmitted to a smart home device, an industrial Ethernet unit of the smart home device receives an Ethernet data packet, encodes and converts an analog signal of the Ethernet into a digital signal that can be processed by the smart home device. The communicationcontrol method for smart home provided by the invention is transparent to high-level protocols such as an application layer and is not vulnerable to network attacks, thus greatly improving the security, the parallel processing speed is high, the internal hardware can be defined, and the flexibility is high; and the manageability of large systems is guaranteed. The smart home data are processed incombination with the mobile terminal location data, and cycle demands are divided online, thereby having the advantages of fast acquisition operation and reduced storage redundancy.

The invention provides a terminal control method for the Internet of Things. The method comprises the following steps: receiving an industrial Ethernet data packet, extracting a source address, a destination address, a protocol type, a source port and a destination port parameter in the data packet, comparing the same with a pre-stored permission list, if all the data are in the permission list, indicating that the packet is legal, judging, by a microprocessor of a control unit, the received data, and if a network data packet containing configuration information is received, updating the permission list; reading information in a FLASH memory, and uploading the information to a main control network terminal. The terminal control method for the Internet of Things provided by the invention istransparent to high-level protocols such as an application layer and is not vulnerable to network attacks, thereby greatly improving the security, moreover, the processing speed is high, and the internal hardware can be defined and is high in flexibility; and the manageability of large systems is ensured. The smart home data are processed in combination with the mobile terminal location data, cycle demands are divided online, and the terminal control method has the advantages of fast acquisition operation and reduced storage redundancy.

The present invention discloses a method for storing dimension data, comprising: acquiring dimension data newly generated by terminal operation; determining whether the newly generated dimension data satisfies storage conditions according to a pre-configured dimension strategy, and the dimension strategy is judging Whether the dimension data satisfies the storage condition; when the storage condition is satisfied, the newly generated dimension data is added to the dimension data sequence for storage. The method for storing dimensional data provided by the embodiment of the present invention only stores data that meets the storage conditions, thereby reducing the storage capacity of time series data and reducing storage redundancy.

The invention discloses a document processing method taking a lexical chunk as a basic unit. The method comprises the following steps: establishing a document item and a catalog outline of the document item, wherein the catalog outline is used for recording catalog information and catalog structure; adding a plurality of lexical chunks under the catalog outline according to the catalog structure of the catalog outline and editing the lexical chunks, wherein the lexical chunks all have attribute marks and are stored in a same lexical chunk bank and the attribute marks include a value mark, a content mark, a semantic mark, a position mark and a citing state mark; storing the document item which takes the lexical chunk as the basic unit. The document processing method disclosed by the embodiment of the invention can be adopted for reducing storage redundancy and is convenient for online editing of the same document by a plurality of persons.

The invention discloses a document processing method taking a lexical chunk as a basic unit. The method comprises the following steps: establishing a document item and a catalog outline of the document item, wherein the catalog outline is used for recording catalog information and catalog structure; adding a plurality of lexical chunks under the catalog outline according to the catalog structure of the catalog outline and editing the lexical chunks, wherein the lexical chunks all have attribute marks and are stored in a same lexical chunk bank and the attribute marks include a value mark, a content mark, a semantic mark, a position mark and a citing state mark; storing the document item which takes the lexical chunk as the basic unit. The document processing method disclosed by the embodiment of the invention can be adopted for reducing storage redundancy and is convenient for online editing of the same document by a plurality of persons.

The invention relates to the field of data visualization, and discloses a method for processing large-data-volume primitives in power transmission line engineering measurement software, which comprises the following steps of: performing primitive preprocessing on a primitive to be used for drawing before drawing; setting a temporary storage module for storing the primitives in the memory; and performing unified management on different types of primitives. The method has the beneficial effects that unified management of the primitives can be realized; all the primitives are integral digital objects, so that the storage redundancy is reduced; the quantity of the primitives displayed on the graphical interface is reduced while the calculation amount of the primitives is reduced, and the software operation efficiency is improved; and a temporary storage module is established in the memory, so that the problem of slow software operation caused by more time required by frequent data access of a graphical interface is solved.

The invention discloses a distributed storage transformer station inspection robot remote centralized monitoring system and method. The system includes a plurality of in-station servers and a plurality of remote servers, the in-station servers are deployed in the corresponding substations and receive the data of an in-station network video server and a substation inspection robot respectively, the substation inspection robot transmits the video data to the in-station network video server, the in-station network video server receives all the video data in the substation, the in-station servers upload the data to the corresponding remote servers, and the in-station network video server uploads the data to the plurality of remote servers, and the remote servers receive the data uploaded by the in-station servers and the network video server in the substation corresponding to the remote servers, and upload the data to the corresponding remote centralized control clients. The system and method overcome the problem that the unified storage mode is large in data bulk, the retrieval speed is slow and the resources are consumed.

In the mail data storage method and device provided by the present application, in the method, first, calculate the segment body identification of each atomic segment in the mail to be stored; then, use the segment body identification to replace the atomic segment body in the mail to be stored, and obtain the compression mail data, and store the mail data; finally, detect whether the atomic segment body in the mail to be stored has been stored in the electronic device, and save the atomic segment body not stored in the electronic device into the electronic device according to the detection result. Compared with the existing technology that stores the mail as a whole to be stored, the storage granularity of storing the mail body as an atomic segment body is smaller, and the same atomic segment in the mail body of different mails can be stored in the process of mail data storage. The body is only stored once, which can reduce the storage redundancy of mail data storage and save storage resources.

The invention provides a data management method and device. The data management method can perform trajectory storage and querying by using a trajectory pattern extracted from lots of historical trajectories. The data management method includes: matching original trajectory points to a road network through a map matching method, and acquiring a trajectory set after map matching; determining a minimum support and a minimum road segment number corresponding to different road types according to training data; establishing a trajectory tree according to the trajectory set, and establishing a trajectory sub-tree with each node of the trajectory tree as a staring point, wherein the trajectory tree and the trajectory sub-trees include at least one node, and each node is an intersection of the road network; determining a trajectory pattern meeting the minimum support and the minimum road segment number, passing through each node according to the trajectory sub-trees; and performing redundancy elimination treatment on the trajectory pattern of each node, and generating a new trajectory pattern and storing the new trajectory pattern. The data management method and device can reduce trajectory storage redundancy, and can accelerate the trajectory querying speed.

The invention discloses a block chain-based medical data management system, which is used to solve the problem that the existing medical data management system does not screen the medical data, which leads to the phenomenon that the data is found, but the data quality is found to be very poor and the medical data is not checked. Carry out reasonable storage and reduce the problem of block chain storage node storage redundancy; including medical data collection module, data encryption module, node distribution module, server, node collection module and block chain node module; the present invention uses node storage value to medical treatment The data is screened to select high-quality medical data for storage; the matching value of the blockchain storage node is obtained through information collection and analysis of the blockchain storage node, and the blockchain storage node is reasonably selected through the matching value Storage; through the management value, delete and compress the data assigned by the node, thereby reducing the storage redundancy of the blockchain storage node.

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for implementing low-latency differential access controls in a distributed prediction system. One of the methods includes obtaining, by a root server from an authorization server, one or more permitted action types for a requester. A plurality of predicted actions that each co-occur in at least one document with a search parameter are obtained. Any actions having an action type that is not one of the one or more permitted action types for the requester is filtered from the plurality of predicted actions. One or more predicted actions having one of the permitted action types is provided to the requester.