Unlock instant, AI-driven research and patent intelligence for your innovation.

Committee data deduplication method and device and server

A technology of data and communication committees, applied in the field of transportation, can solve problems such as insufficient flexibility and accuracy, poor scalability and versatility, and achieve the effects of improving flexibility and accuracy, high versatility, and increasing speed

Pending Publication Date: 2021-02-02
WUHAN CITMS TECH CO LTD
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The embodiment of the present application provides a method and device for deduplication of handover commissioned data, which is used to solve the technical problems of insufficient flexibility and accuracy, poor scalability and versatility in the current data deduplication method

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Committee data deduplication method and device and server
  • Committee data deduplication method and device and server
  • Committee data deduplication method and device and server

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] The technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Apparently, the described embodiments are only some of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts belong to the scope of protection of this application.

[0055] In the embodiments of this application, "for example", "example" and "such as" are used to mean "used as an example, illustration or illustration". Any embodiments described in this application as "for example," "example" and "such as" are not necessarily to be construed as preferred or advantageous over other embodiments. The following description is given to enable any person skilled in the art to make and use the invention. In the following description, details are se...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a committee data deduplication method and device and a server. The method comprises the steps: determining target data of a certain data type and metadata of the target data through a selection interface, updating the selection interface to generate a configuration interface, selecting a deduplication index field and a deduplication time field from the metadata through the configuration interface, setting filtering duration corresponding to the deduplication time field, and finally, based on the data cached in a redis database, according to the index time period of the deduplication index field of the received committee data, the time data segment of the deduplication time field and the filtering duration, performing deduplication processing on the committee data. Therefore, the configuration interface for deduplication can be dynamically generated through the initial selection interface, the deduplication index field and the deduplication time field are dynamically selected through the configuration interface, the flexibility and accuracy of deduplication processing are improved, meanwhile, the redis database is adopted, the speed of deduplication processingis increased, and high system expansibility is achieved. The method has high universality.

Description

technical field [0001] The present application relates to the field of transportation, and in particular to a method, device and server for deduplicating data of a traffic committee. Background technique [0002] With the vigorous development of the Internet, big data technology has been widely used in various fields. In many big data application scenarios, it is necessary to continuously access a large amount of data from the outside in a short period of time. There are a lot of duplicate data in these data, such as , in densely populated shopping malls and stations, if a person stays near a wifi electronic fence for a period of time, similar data will be collected multiple times. The collector will repeatedly upload the passing record of the vehicle in a short period of time, causing the big data platform to store a lot of duplicate data. If these duplicate data are stored without processing, on the one hand, the throughput and storage capacity of the system will be waste...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/215G06F16/22G06F16/23G06F16/2455
CPCG06F16/2272G06F16/215G06F16/23G06F16/24552Y02D10/00
Inventor 何正威
Owner WUHAN CITMS TECH CO LTD