Supercharge Your Innovation With Domain-Expert AI Agents!

Concurrent processing method, device and system for format data files

A technology of format data and processing method, applied in the field of communication, can solve the problem of low serial processing speed, and achieve the effect of improving speed, ensuring integrity, and ensuring reliability

Active Publication Date: 2022-02-08
HUNDSUN TECH
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although the integrity of format records can be guaranteed in this scheme, the speed of serial processing is low

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Concurrent processing method, device and system for format data files
  • Concurrent processing method, device and system for format data files
  • Concurrent processing method, device and system for format data files

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0061] The following will clearly and completely describe the technical solutions in the embodiments of the application with reference to the drawings in the embodiments of the application. Apparently, the described embodiments are only some of the embodiments of the application, not all of them. Based on the embodiments in this application, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

[0062] According to an embodiment of the present application, a concurrent processing system for format data files is provided. see figure 1 ,include:

[0063] The file storage device 100 is used to store format record files;

[0064] The server 200 is configured to receive a fragmentation request for the format record file, perform logical fragmentation processing on the format record file to obtain multiple file fragmentation meta-information, and distribute the multiple file fr...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

This application provides a concurrent processing method, device, and system for format data files. The client obtains the file fragmentation meta information sent by the server; slice content, so that the content of the read file slice is guaranteed to read one more delimiter length content at the beginning of the file slice, and at least one more cache window content is read at the end of the file slice; in the read file Parse the content of the file fragment one by one in the fragment content and delete the first format record. When the total length of the parsed content of the file fragment is equal to the length of the file fragment and the parsing of the last format record of the file fragment has not encountered a delimiter, continue parsing The parsing operation is stopped until the delimiter is parsed, and the multiple format records after the parsing operation are determined as the format record set of the file fragment. The application can concurrently read the format data files and ensure the integrity of the format records, and ensure the reliability when the speed is increased.

Description

technical field [0001] The present application relates to the field of communication technology, and in particular to a concurrent processing method, device and system for formatted data files. Background technique [0002] Format data files are usually used for data interaction between heterogeneous platforms. Format data files are composed of multiple format records and are a type of file specially used to store format records. Records of different formats in the format data file are separated by a predefined delimiter (such as a newline character [\n]). [0003] With the gradual development of communication technology, the data volume of the format data file is also gradually increasing (for example, gradually increasing to hundreds of G data volume or even up to T data volume). In order to facilitate the transmission of format data files between heterogeneous platforms, the format data files are usually fragmented. [0004] A current fragment processing solution is tha...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F16/18G06F16/14G06F16/16G06F16/172
CPCG06F16/1858G06F16/14G06F16/162G06F16/172
Inventor 徐进张昆卢威
Owner HUNDSUN TECH
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com