Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for efficiently traversing set with large data volume, terminal and storage medium

A data volume and big data technology, which is applied in the field of efficiently traversing large data volume collections, can solve the problems of complex applications and difficult to use, and achieve the effect of simple processing steps, wide application prospects, and improved traversal performance

Inactive Publication Date: 2019-12-10
SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, its applicable scenarios are massive data, semi-structured and unstructured data, and the application is complex, which is difficult to use in conventional applications

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for efficiently traversing set with large data volume, terminal and storage medium
  • Method and system for efficiently traversing set with large data volume, terminal and storage medium
  • Method and system for efficiently traversing set with large data volume, terminal and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] In order to enable those skilled in the art to better understand the technical solutions in the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described The embodiments are only some of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0044] Key terms appearing in the present invention are explained below.

[0045] Thread: A thread is the smallest unit that an operating system can perform operation scheduling. It is included in the process and is the actual operating unit in the process. A thread refers to a single sequential flow of control in a process. Multiple ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a method and system for efficiently traversing a large data volume set, a terminal and a storage medium. The method comprises the steps of obtaining the number of CPU cores of acurrent server; averagely splitting the big data set into subsets with the same quantity according to the quantity of the CPU cores; creating a unique corresponding sub-thread for each subset, and controlling the sub-thread to execute a processing task of the corresponding subset; and collecting calculation results of all the sub-threads, combining all the calculation results, and outputting thecombined calculation results to the main thread. The big data set can be rapidly processed, the processing steps are simple, computing resources can be fully utilized, and the method is suitable for conventional application programs.

Description

technical field [0001] The invention belongs to the technical field of data processing, and in particular relates to a method, a system, a terminal and a storage medium for efficiently traversing a larger data set. Background technique [0002] At present, in the implementation of software programs, we often encounter scenarios that need to process a large amount of data. Traditional implementation methods such as ArrayList in Java language use for loops to traverse in a single-threaded manner, which cannot take advantage of the concurrent execution of multi-core CPUs. , resulting in low efficiency of the entire task execution. [0003] Big data technology (such as Hadoop) uses a divide-and-conquer scheme similar to this case, splitting a large task into multiple small tasks, and finally merging the calculation results to complete the entire task. However, its applicable scenarios are massive data, semi-structured and unstructured data, and the application is complex, which...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F9/50G06F9/48G06F16/24
CPCG06F9/4881G06F9/5027G06F16/24G06F2209/5018
Inventor 冯立晓
Owner SUZHOU LANGCHAO INTELLIGENT TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com