Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A data file encoding format conversion method and system

A coding format and data file technology, which is applied in the field of data file coding format conversion, can solve the problems that data cannot be imported, cannot be used, and the difficulty of data conversion is increased, so as to achieve fast and error-free access, improve reliability, and avoid data security. the effect of the threat

Active Publication Date: 2021-01-15
北京东方金信科技股份有限公司
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] However, data in different formats cannot be imported into the database without conversion, and cannot be used subsequently
In the existing big data fusion development system, there is no realization of this function. If the user imports data with wrong format, it will lead to invalid data in the database.
At the same time, data format conversion also faces the following problems: first, data security, that is, how to ensure that existing data can be completely stored in a new file during the conversion process, the conversion process is more complicated, and there may be many emergencies that threaten the data Security; secondly, the conversion speed, the data files of the long-running system are huge, and the time required for the conversion is also relatively long; finally, the data imported by the user into the database is usually a text with a large amount of data, which also increases the data conversion. Difficulty

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data file encoding format conversion method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0017] The present invention will be described in detail below in conjunction with the accompanying drawings and embodiments.

[0018]The invention provides a data file encoding format conversion system, which includes: a file acquisition module, a thread management module, an analysis module, a transcoding module and a file output module. Wherein, the file acquisition module is used to obtain the input file uploaded by the user, and sends to the thread management module after recording the upload time of each input file and the corresponding user name; the thread management module is used to create a thread task for the conversion task of each input file, and Take out multiple thread tasks in parallel according to the upload time and send them to the corresponding parsing module; the parsing module is used to read the input file uploaded by the user using the original encoding format, and obtain the corresponding file to be converted; the transcoding module is used to Use the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a data file coding format conversion method and system, and the system comprises a file obtaining module which is used for obtaining an input file uploaded by a user, and recording the uploading time of each input file and a corresponding user name; a thread management module which is used for creating thread tasks for the conversion tasks of the input files, taking out aplurality of thread tasks in parallel according to uploading time and sending the thread tasks to the corresponding analysis modules; an analysis module which is used for reading an input file uploaded by a user by adopting an original encoding format to obtain a to-be-converted file corresponding to the input file; a transcoding module which is used for transcoding the to-be-converted file by adopting a coding format which can be recognized by a big data fusion development system to obtain a new input file; and a file output module which is used for outputting the transcoded new input file toa big data fusion development system for subsequent processing. The method can be widely applied to the field of data transcoding.

Description

technical field [0001] The invention relates to a data file encoding format conversion method and system, belonging to the field of data processing. Background technique [0002] Big data fusion development system is a comprehensive software with functions of data access, data cleaning, data control and automatic analysis. In the process of landing a big data platform, data access is an indispensable key link. In the face of various sources and types of data, data access is needed to integrate these scattered data into a unified big data platform. From the perspective of data types, data access mainly includes structured data (database) access, log data access, IoT data access, and file access. [0003] However, data in different formats cannot be imported into the database without conversion, and cannot be used subsequently. In the existing big data fusion development system, there is no implementation of this function. If the user imports data with wrong format, it will...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F40/151
Inventor 陈涛
Owner 北京东方金信科技股份有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com