35results about How to "To achieve deduplication" patented technology

The invention discloses an image management method. The image management method comprises the steps of obtaining multiple images created in a predetermined time period and identifying repeated images in the images; according to a preset low-quality image category, judging whether the repeated images are low-quality images or not; when the repeated images are the low-quality images, determining quality values of the repeated images; and according to the quality values of the repeated images, determining to-be-deleted repeated images. The invention furthermore discloses an apparatus corresponding to the method. Image management is facilitated.

The invention provides monitoring video file generation and playing methods and devices and terminal equipment. The monitoring video file generation method comprises the steps of: acquiring a real-time video frame shot by a monitoring camera; inquiring a prior video frame consistent with the real-time video frame in a de-duplicated video frame set; if the prior video frame consistent with the real-time video frame is not inquired, storing the real-time video frame into the de-duplicated video frame set, and recording a mapping relationship between playing time and the real-time video frame ina playing index; if the prior video frame consistent with the real-time video frame is inquired, abandoning the real-time video frame, and recording a mapping relationship between the playing time andthe prior video frame in the playing index; and according to the de-duplicated video frame set and the playing index, generating a monitoring video file. According to the invention, a size of the monitoring video file can be reduced, and duration of a storable monitoring video is prolonged.

The present application provides a data transmission method and device, and a readable storage medium. In this data transmission method, on the one hand, the proxy server detects the corresponding interface function for the request data of the business system, and performs deduplication processing on the request data of the interface with the same function, and then transmits it; or for the functions that need to be excluded On the other hand, the response data of the business system is detected for sensitive information, and the response data containing sensitive information is desensitized and then transmitted. Realize information desensitization of business systems. Therefore, the data transmission method can realize functional desensitization of the business system and improve the security of data transmission in the business system.

The invention discloses an outsourced data deduplication cloud storage method supporting privacy and integrity protection. First of all, the deduplication of data files on the client side and the deduplication of security authentication tags are realized, which greatly reduces the communication overhead and the storage burden of the cloud server. Secondly, the use of extractor technology makes the ciphertext of the outsourced stored data not depend on the encryptor and encryption algorithm, but on the data itself, so that the deduplication of ciphertext data can be realized, and the deduplication process and integrity audit process are guaranteed. Data Privacy. Finally, RS erasure coding technology is used to improve the fault tolerance of deduplication cloud storage, and it also supports cloud service providers to spontaneously and regularly entrust third-party auditors to conduct batch public cloud audits of data stored in cloud servers to ensure data integrity. At the same time, it also supports data owners to initiate public cloud audits on the integrity of files anytime and anywhere, and can always protect the privacy of data during the audit and deduplication process. The method provided by the invention is effective in deduplication and efficient in integrity cloud auditing.

The embodiment of the present invention discloses a data deduplication method, device, electronic equipment, and computer-readable storage medium. The method includes: obtaining a data container to be processed; The data container whose data similarity meets the preset condition is used as the target data container; the data container to be processed is compared with the target data container, and duplicate data is confirmed and deleted in the post-processing process. This technical solution can realize deduplication of massive data on a global scale, and achieve the purpose of saving storage space without reducing user IO performance.

The invention discloses a cloud data duplication elimination and integrity auditing method based on convergence encryption. According to the method, through adoption of a convergence key encapsulation / de-encapsulation algorithm based on blind signatures, convergence keys can be securely stored and moreover convergence key duplication elimination can be realized; and through utilization of a BLS signature algorithm based on the convergence keys, auditing public keys are stored by a trusted third party TTP, the TTP carries out proxy auditing, and duplication elimination of auditing signatures and the auditing public keys is realized. The method comprises the specific steps of carrying out system initialization; carrying out key initialization; carrying out file initialization; carrying out authentication evidence initialization; carrying out key encapsulation; carrying out data storage; carrying out duplication challenge; carrying out duplication response; carrying out duplication authentication; carrying out request auditing; carrying out proxy auditing; carrying out auditing response; carrying out auditing authentication; and carrying out file downloading. According to the method,a utilization rate of a cloud storage space is improved, the duplication elimination of auditing signatures and the auditing public keys is realized, and the storage and computing cost of a client arereduced.