Unlock instant, AI-driven research and patent intelligence for your innovation.

Processing method and processing system for data transmission

A data transmission and processing method technology, applied in the field of data processing, can solve problems such as reduced efficiency, sacrificing data processing efficiency, and inability to store links, so as to achieve the effect of ensuring reliability and security

Inactive Publication Date: 2021-11-05
北京隆普智能科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The current data storage method is mainly to store massive data exclusively by setting up a large database. Although this data storage method can meet the high storage capacity requirements of massive data through a large database, querying and writing from a large database 1. The efficiency of data is greatly reduced, sacrificing the efficiency of data processing
Moreover, in the process of data transmission and storage, various uncertain factors will also be encountered, resulting in the inability of the storage link to store data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Processing method and processing system for data transmission
  • Processing method and processing system for data transmission
  • Processing method and processing system for data transmission

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0024] Such as figure 1 As shown, it is a data storage optimization method provided by this application, which specifically includes the following steps:

[0025] Step S110: Receive data.

[0026] Specifically, after receiving the data, it also includes searching the data and judging whether the data is valid data. Existing tools can be used for data retrieval. For example, the HBase platform can be used for effective data retrieval. HBase is a distributed database that can read and write large-scale data in real time. In the process of reading data, data aggregation and retrieval can be performed. and continuous retrieval of data.

[0027] Among them, the aggregated retrieval of data refers to the unified retrieval of the data received within a specified time period, and the continuous retrieval refers to the real-time retrieval of the data after receiving a piece of data.

[0028] Specifically, data generally has nominal attributes, binary attributes, ordinal attributes, ...

Embodiment 2

[0076] Such as figure 2 As shown, the present application provides a data transmission processing system, which specifically includes: a receiving unit 210, a construction unit 220, a first storage unit 230, a path determination unit 240, an abnormality detection unit 250, a selection unit 260 and a second storage unit 270 .

[0077] The receiving unit 210 is used for receiving data.

[0078] The constructing unit 220 is connected to the receiving unit 210 for constructing a data storage transmission path.

[0079] The first storage unit 230 is connected to the construction unit 220 for storing data in the data storage transmission path.

[0080] The path determination unit 240 is connected to the first storage unit 230 and configured to determine an effective storage path of the data according to the storage of the data.

[0081] The anomaly detection unit 250 is connected to the path determination unit 240 and is used to detect the anomaly of the effective path.

[0082...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data transmission processing method and a data transmission processing system. The data transmission processing method specifically comprises the following steps: receiving data; constructing a data storage and transmission path; storing the data into a data storage transmission path; determining an effective storage path of the data according to the storage of the data; performing anomaly detection on the effective path; and if the abnormal detection is qualified, storing the received data in an effective storage path. According to the method and the device, after the data are received, the transmission and storage path of the data can be effectively and efficiently planned, and the path is continuously optimized, so that the reliability and the safety of the data transmission process are ensured.

Description

technical field [0001] The present application relates to the field of data processing, and in particular, to a data transmission processing method and processing system. Background technique [0002] With the explosive growth of data, how to effectively query and write massive data in distributed storage systems has become the focus of research in the field of data storage. The current data storage method is mainly to store massive data exclusively by setting up a large database. Although this data storage method can meet the high storage requirements of massive data through a large database, querying and writing from a large database A data efficiency is greatly reduced, sacrificing data processing efficiency. Moreover, in the process of data transmission and storage, various uncertain factors will also be encountered, which will cause the storage link to fail to store data. [0003] Therefore, how to achieve data transmission and storage while taking into account the da...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F3/06
CPCG06F3/0614G06F3/062G06F3/064G06F3/0629G06F3/067
Inventor 徐小君
Owner 北京隆普智能科技有限公司