Unlock instant, AI-driven research and patent intelligence for your innovation.

Data transmission method and device, electronic equipment and storage medium

A data transmission method and a technology for transmitting files, which are applied in the fields of data transmission methods, devices, electronic equipment, and storage media, can solve problems such as high operating pressure, and achieve the effects of reducing operating pressure, reducing the number of generated, and reducing the number

Pending Publication Date: 2022-02-01
NETEASE (HANGZHOU) NETWORK CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The embodiment of the present application provides a data transmission method, device, electronic equipment and storage medium, which can improve the problem of high operating pressure of the distributed file system in the prior art

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data transmission method and device, electronic equipment and storage medium
  • Data transmission method and device, electronic equipment and storage medium
  • Data transmission method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0049] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the protection scope of the present application.

[0050] Embodiments of the present application provide a data transmission method, apparatus, electronic device, and storage medium.

[0051] Wherein, the data transmission device may be integrated in an electronic device, and the electronic device may be a terminal, a server, or the like. The terminal may be a mobile phone, a tablet computer, an intelligent Bluetooth device, a notebook computer, or a personal computer (Personal Computer, PC) and other device...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a data transmission method and device, electronic equipment and a storage medium. The data transmission method comprises the steps of obtaining a plurality of log types corresponding to log data generated by a target application program; aggregating the log types according to a preset algorithm, obtaining at least one type set, wherein each type set at least comprises one log type; generating a target number of to-be-transmitted files according to the number of the type sets and a preset parallel value; and transmitting the target number of to-be-transmitted files to the distributed file system, so that the distributed file system receives the target number of to-be-transmitted files at the same moment, and stores the target number of to-be-transmitted files as the target number of to-be-split files. Compared with the log types, the number of the type sets is greatly reduced, so that the generation number of the to-be-transmitted files is also greatly reduced, the number of the to-be-transmitted files received by the distributed file system at the same moment is greatly reduced, and the operation pressure of the distributed file system is reduced.

Description

technical field [0001] The present application relates to the field of computers, and in particular, to a data transmission method, apparatus, electronic device and storage medium. Background technique [0002] When the game software is running, a large number of operation logs will be generated. Operation logs of game software usually include thousands or even tens of thousands of different log types. Each log type has its own corresponding structure and style. In order to facilitate the user's query and use, the operation logs of different log types are usually stored in their corresponding data warehouse tables. [0003] In the prior art, in order to speed up the processing speed of the operation log, the degree of parallelism of the processing is usually set, and according to the degree of parallelism, each log type is processed in parallel. When a large number of operation logs are processed in parallel, it is often necessary to write a huge number of log files to the...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/13G06F16/18G06F16/182G06F16/35
CPCG06F16/182G06F16/1815G06F16/137G06F16/353
Inventor 於圣楠吴剑飞刘柏范长杰
Owner NETEASE (HANGZHOU) NETWORK CO LTD