39results about How to "Reduce duplicate data" patented technology

The embodiment of the invention discloses a data operation method, a data operation system, a client and a data server. The method comprises: transmitting a file writing request to the data server, wherein the writing request comprises marks of subdata blocks forming a file; receiving the corresponding relation between the subdata block marks which are returned by the data server and storage servers according to the writing request; and writing the subdata blocks into the corresponding storage servers according to the corresponding relation. The embodiment of the invention can judge whether the subdata blocks are written according to the fact whether the subdata block marks are stored, so that no repeated data can be stored in the system and the storage space of the system is improved.

The invention discloses a data caching method applied to storage equipment, a control device of the storage equipment and the storage equipment. The storage equipment comprises a first cache (212) anda second cache (213). When the storage device monitors that a first data block is cached in the first cache (212) (S301), a first data block to be deleted is cached in the first cache (212) (S601), or the caching time of the first data block in the first cache (212) exceeds a threshold value (S801), obtaining feature information of the first data block, and then determining whether the first datablock is stored in the second cache (213) according to the feature information of the first data block; and if it is determined that the first data block is stored in the second cache (213) (S303, S603, S803), adjusting the level of elimination priority of the first data block in the second cache (213) (S304, S604, S804). By coordinating the data in the first cache (212) and the second cache (213) in the storage device, the response speed of the IO request is improved.

Example embodiments provide methods for handling the transition of a mobile device from a first network to a second network, the second network operating according to a different communications protocol from the first network. One example embodiment includes terminating forwarding of the data packets from the first network to the mobile device; rebuilding headers of unforwarded data packets at the first network; and sending the rebuilt data packets from the first network to the second network. Another example embodiment includes resetting a header compression state at the second network; receiving unforwarded data packets from the first network at the second network, the unforwarded data packets being data packets the first network had not yet forwarded to the mobile device; and sending the unforwarded data packets from the second network to the mobile device.

The invention discloses a high-throughput sequencing database construction technology capable of efficiently capturing the three-dimensional conformation of chromosomes of a frozen biological sample.The invention provides a sample pre-processing method suitable for Hi-C high-throughput sequencing library building. The sample pre-processing method includes the steps of freezing a biological sampleto be tested first, then increasing the temperature in a gradient mode, and then cross-linking and fixing. The FS-Hi-C technology is not only suitable for fresh samples, but also for frozen samples.The results show that the three-dimensional structure of chromatin of a frozen replacement sample and a fresh sample are highly similar, and the quality of a Hi-C library is improved. Compared with atraditional Hi-C pretreatment method, FS-Hi-C is highly consistent in chromatin interaction, A / B compartment and TAD and the like, the quality of the library constructed by the FS-Hi-C method is better, the storage capacity is increased, effective interaction data is more, and the repeated data generated by PCR amplification is reduced. The technology reduces the requirements for sample timeliness. The high-throughput sequencing database construction technology provides an improved method for the application of Hi-C in biology.

Data duplication may be reduced in cloud storage. First snapshots of one or more remote volumes may be received via a network. Responsive to and / or based on the first snapshots, unique clusters and duplicate clusters may be identified among the valid clusters of the remote volumes. The unique clusters and single instances of the duplicate clusters may be stored in a backup file, such that the backup file is devoid of duplicate clusters. Second snapshots of the one or more remote volumes may be received via the network. Responsive to the second snapshots, the clusters in the backup file that are no longer valid may be utilized to store the valid clusters in the one or more remote volumes not yet stored in the backup file.

The invention relates to a method and a device for converting an SWF into a Canvas cartoon. The method comprises following steps of analyzing an SWF file, traversing the SWF file so as to obtain an element which comprises film editing and graphs, and defining and storing the element to an element pool; compressing the graphs and deriving compressed graph data; compressing the film editing and deriving frame operation instructions of the film editing; and calling and restoring the compressed graph data and the frame operation instructions of the film editing via an application function of a script runtime library to be a Canvas cartoon. In this way, size of the data is reduced; the compressed graph data and the frame operation instructions of the film editing are directly called via the application function of the script runtime library without conditional judgment, so computing time is reduced; and due to the small size of the data, loading time is saved and playing fluency is improved.

The invention discloses a method for uploading monitoring data, which includes: when the application program starts, report and save the device information of the device where the application program is located to the background server once; judge whether the variable data of the current device changes; if so, generate a The new association code is stored in association with the changed volatile data; during the period when the volatile data has not changed, all event monitoring data to be reported during the period is associated with the latest association code; when the data is reported, the The relevant information in the saved device information, the variable data and event monitoring data stored in association with the same association code are assembled and compressed according to the preset format, and the monitoring data package is obtained and uploaded to the background server. The invention also discloses a monitoring data uploading device, equipment, system and readable storage medium. While ensuring the integrity of monitoring data, the present invention reduces repeated uploading of redundant data, thereby saving traffic for users.

A machine and method of reducing duplicate transmission data employs one more more digests to track field / value pairs that have previously been distributed. Each digest contains a record table and a segment table. The record table includes anonymous identifier records, each of which contain an anonymous identifier and one or more indexes into the segment table. The segment table comprises an array of every existing data field / value pair. Before distribution of update data, each record is matched to an anonymous identifier record in the record table. The segment values in the prospective distribution record are compared to the digest's anonymous identifier record, used to determine which data has already been distributed, and thus will be suppressed in the distribution.

The invention discloses a management device and a method for providing file download addresses, wherein the method includes that resource locating information is generated according to a storage path of a file in a data source node, contents of the file generate a content summary of the file through specific data transformation, a download address is generated at least according to the resource locating information of the file and the content summary of the file, and the download at least comprises the resource locating information of the file and the content summary of the file.

The present invention discloses a download management device, method and data download system, wherein the download management device includes: a buffer configured to cache each file obtained from a data source node and the content abstract of each file, the content of the file The abstract is the data generated by specific data conversion on the content of the file; the parser is configured to obtain the file download request from the client device, and parse out the content abstract of the requested file according to the download address of the file download request; the finder, configured to look in the cache based on the content summary of the file, and if found, transmit the requested file to the client device; The data source node obtains the requested file, transmits it to the client device, and provides the requested file to the cache for caching.