Server service request parallel processing method based on thread number limit and system thereof

A business request and parallel processing technology, applied in the direction of digital transmission system, transmission system, data exchange network, etc., can solve the problems of increasing the waiting time of short processing time and long business request, reducing the efficiency of server business request processing execution, and server system task collapse, etc. , to achieve the effect of improving the reasonable performance of system resource allocation, improving user service efficiency, and improving processing execution efficiency

Active Publication Date: 2014-01-15
NEW SINGULARITY INT TECHN DEV
View PDF4 Cites 48 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, due to the limitation of the processing performance and system resources of the server system, the total number of threads that the server can use to perform parallel processing of business requests is limited, and the business requests received by the server are highly random, so the server adopts this simple method. In the multi-threaded concurrent processing mode, it is likely that such a situation often occurs: in a certain period of time, the top queues in the single request queue are all business requests with a long processing time, so that almost all of the servers that can be used to perform parallel processing of business requests Threads are called to execute these business requests with a long processing time
The occurrence of this situation will mainly bring about two adverse effects: ①. If the business request with a short processing time can be processed first, and then the business request with a long processing time can be processed, not only will the service request with a short processing time The corresponding users can quickly obtain the request processing results. For the users corresponding to the long-processing business requests, the waiting time for obtaining the request processing results has not greatly exceeded expectations, so that different users can obtain better business services. Experience; however, since all the threads of the server that can be used to perform parallel processing of business requests are "monopoly occupied" by business requests with a long processing time, business requests with a short processing time must also be queued up to wait for a thread to complete the business request processing It can only be processed after it is released. Although it does not affect the user experience of business services correspond

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Server service request parallel processing method based on thread number limit and system thereof
  • Server service request parallel processing method based on thread number limit and system thereof
  • Server service request parallel processing method based on thread number limit and system thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0042] This embodiment takes a pair of document search servers that provide document data search services as an example, and uses the server service request parallel processing method based on the limitation of the number of threads of the present invention to execute the relevant service request processing of the document search server, so as to illustrate the method of the present invention Specific applications and beneficial effects.

[0043] The total number of threads that the literature search server can use to execute parallel processing of business requests is 3,000, and can simultaneously process 3,000 business requests received by the literature search server in parallel; if the literature search server receives and queues business requests at the same time If the number of requests exceeds 3000, the part exceeding 3000 needs to wait for one of the 3000 threads executing parallel processing of business requests to complete processing and be released, and then call th...

Embodiment 2

[0072] Correspondingly, the present invention also provides a parallel processing system for server business requests based on the limitation of the number of threads. The system can be integrated in the server, or can be used as an independent device outside the server; still use the document search server described in Embodiment 1 As an example, the document search server is combined with the system for parallel processing of business requests of the present invention, so that the document search server can implement the method for parallel processing of business requests described in the first embodiment by itself.

[0073] The structure of the business request parallel processing system is as follows: Figure 5 As shown, it mainly includes a classification processing module 10, a queuing processing module 20 and a thread calling module 30, and there are several thread calling modules 30; category, and respectively set the parallel processing thread upper limit quantity cor...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present invention provides a server service request parallel processing method based on thread number limiting and a system thereof. According to the server service request parallel processing method and the system, a control solution for classifying service requests according to different processing time lengths, and the upper limit of the number of the threads which are called by the server for parallelly processing each kind of service requests, thereby preventing monopoly occupation of server thread by the service request with long processing time length, ensuring partial threads in the server is used for parallelly processing the service request with short processing time length, so that distribution balance for the threads for processing the service request of the server is improved, thereby improving service request processing executing efficiency and user service efficiency of the integral body of the server. Simultaneously the possibility of long-time monopoly occupation for server system resource caused by parallel processing for a large amount of service requests with complicated operation and long processing time length by the server is reduced, thereby improving system resource distribution performance of the server.

Description

technical field [0001] The present invention relates to the field of computer communication network technology and server technology, in particular to a method and system for parallel processing of server service requests based on thread number limitation. Background technique [0002] A server refers to a high-performance computer that provides external business services to a management resource in a computer communication network. There are many types of servers, such as data servers, file servers, web servers, streaming media servers, search servers, etc., they listen to business requests from computer clients or mobile communication clients in the computer communication network, and respond to and process the business requests , and then provide various business services for computer clients or mobile communication clients, enriching network applications. Servers in computer communication networks are faced with a huge number of business requests that need to be process...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/24H04L29/08
Inventor 王忻
Owner NEW SINGULARITY INT TECHN DEV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products