A data processing method and a data processing device

A technology for data processing and data, which is applied in the field of data processing methods and data processing devices, and can solve problems such as insufficient memory

Active Publication Date: 2019-01-08
北京九狐时代智能科技有限公司
View PDF9 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the purpose of the embodiment of the present application is to provide a data processing method and device, which can use limited memory to solve the problem of insufficient memory in the case of large-scale data double data tasks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A data processing method and a data processing device
  • A data processing method and a data processing device
  • A data processing method and a data processing device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only It is a part of the embodiments of this application, not all of them. The clusters of the embodiments of the application generally described and illustrated in the figures herein may be arranged and designed in a variety of different configurations. Accordingly, the following detailed description of the embodiments of the application provided in the accompanying drawings is not intended to limit the scope of the claimed application, but merely represents selected embodiments of the application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without m...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method and a data processing device, the method comprising: grouping data to be processed to generate a plurality of data sets; for each data group, reading all the data to be processed in the data group into the memory, and executing the dual data tasks in the data group based on all the data in the data group, and releasing the memory occupied by the datagroup after the dual data tasks in the data group are completed; and reading data of the two data groups into memory for each two data groups, executing dual data tasks between the two data groups based on the data in the two data groups, and releasing the memory occupied by the data after all the dual data tasks between the two data groups are completed. By increasing the I / O times and reducingthe amount of data read into the memory at one time, the application algorithm avoids the system or software crash caused by insufficient memory or too much task, and ensures the completeness of the task under the premise that the efficiency is basically unchanged.

Description

technical field [0001] The present application relates to the technical field of computer applications, and in particular, to a data processing method and a data processing device. Background technique [0002] When a computer processes data, it first reads the data to be processed into the memory, and then processes the data read into the memory according to a preset processing method. [0003] In some scenarios, the computer needs to read a large amount of data into the memory, and perform double data tasks on the data read into the memory according to the preset processing method. Double data task means that for each data, other data other than the data will be processed sequentially with the data according to the preset processing method. For example, when generating a 3D image based on a 2D image, the computer needs to read a large number of 2D images into the memory, and then for each of the 2D images, sequentially compare other images except the 2D image with the 2D ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5016
Inventor 王涛
Owner 北京九狐时代智能科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products