253 results about "Coroutine" patented technology

The invention provides a task scheduling method of a large language model, a data processing system and electronic equipment. The method comprises the following steps: on a first processor, obtaining a request from a ready queue to form a first running instance and a second running instance; generating a first coroutine corresponding to the first operation instance and a second coroutine corresponding to the second operation instance, wherein the first coroutine and the second coroutine are both used for executing calculation tasks and transmission tasks of Q sub-stages; running a first coroutine to submit the 1i-th calculation task to a first workflow of a second processor and submit the 1i-th transmission task to a second workflow of the second processor, and setting the 1i-th transmission task to be executed after the 1i-th calculation task is executed; and operating the second coroutine to submit the 2i-th calculation task to the first workflow and submit the 2i-th transmission task to the second workflow, and setting the execution condition of the 2i-th transmission task to be executed after the 2i-th calculation task is executed. According to the embodiment of the invention, the reasoning efficiency of a large model can be improved.

The invention relates to a data collection and retrieval distributed system and method and computer equipment. Comprising a front-end application used for collecting initial data through a multi-coroutine concurrent execution database; the ES cluster is used for performing index recovery according to the operation conditions of different cluster nodes and retrieving the target data through an inverted index; the back-end application performs service registration and discovery based on the micro-service framework, and provides information calling associated with the initial data or the target data for the front-end application; and the message middleware is used for dynamically adjusting the process of data collection and data retrieval. According to the method and the device, quick retrieval can be realized, and data consistency under a distributed condition can be ensured.

The invention discloses a coroutine-based micro-service gateway dynamic scheduling method, which comprises the following steps that: 1, a coroutine pool is created to process a network request, and a gateway receives the network request and adds the network request into a request queue; 2, identifying a request type, distributing a preset static priority for the network request, and adjusting the dynamic priority in combination with features on the basis of the static priority and the configured initial dynamic priority; and 3, collecting data in coroutine operation in real time, and reducing coroutine processing delay by calculating an overtime threshold, adopting an overtime differentiation strategy, a low-priority discarding strategy and updating a data state according to a data operation condition. The invention further discloses a dynamic scheduling micro-service gateway system based on the coroutine. The method can significantly improve the gateway performance, reduce the system delay, intelligently manage the request queue under a high load condition, ensure the normal operation of key services, and can be widely applied to the field of computer data.

The invention discloses a coroutine scheduling method, device, system and equipment, a storage medium and a product, and relates to the technical field of task scheduling, a multi-priority queue group is used for storing a first coroutine task to be executed in a corresponding scheduling domain, and a storage module is used for storing a second coroutine task periodically executed in a corresponding scheduling domain; the execution cycle of the first coroutine task is smaller than that of the second coroutine task. And when the expired second coroutine task exists in the storage module, mounting the expired second coroutine task to the multi-priority queue group. The situation that the first coroutine task with the low priority cannot be executed due to the fact that the second coroutine task does not reach the execution time is effectively avoided. And the coroutine tasks are obtained and executed from the multi-priority queue group according to the priority sequence, so that the tasks with high priorities are ensured to preferentially obtain execution resources. According to the running state and the load state of each scheduling domain, task migration of each scheduling domain is carried out, and the resource utilization rate is optimized.

The embodiment of the invention discloses a batch writing method and equipment for a PostgreSQL database, relates to the technical field of cross-database migration, and is used for solving the problems of poor compatibility and low reliability of an existing mode. The method comprises the steps of performing cross-database dialect semantic mapping on a heterogeneous data source based on a cross-database semantic mapping engine to obtain a global concurrent import control parameter set of a target database, and extracting the heterogeneous data source based on analysis configuration of the global concurrent import control parameter set to obtain a standard record object; performing flow control on a task channel of the target database based on a self-adaptive backpressure strategy so as to assemble the standard record objects into data batches and distribute the data batches to a working coroutine of the target database; the batch writing protocol is called through the working coroutine, the batch direct writing request is initiated to the target database for batch writing, and the writing abnormity is processed based on the preset fault-tolerant mechanism to obtain the writing result, so that the data writing risk is effectively reduced while the compatibility is ensured, and the reliability of cross-database batch writing is improved.

A flow control method of a distributed storage system, and a distributed storage system. The distributed storage system comprises a plurality of storage nodes and a plurality of clients. The method comprises: a client acquires a processing index related to a coroutine task in a local IO thread; the client acquires a delay index of an IO request sent to a storage node; and the client adjusts a control threshold of flow between the client and the storage node on the basis of the acquired processing index and delay index. The processing index related to the coroutine task in the IO thread and the delay index of the IO request that are collected by the client are used to evaluate the busyness of a cluster in a distributed manner, and how to the flow control threshold of the client is autonomously decided. According to the self-adaptive method, a response can be made to request accumulation in a more timely manner, thereby improving the overall resource utilization rate of the cluster.

The present disclosure provides a runtime virtualization method and apparatus. A specific implementation of the method includes: constructing a dynamic runtime library based on the native runtime library of an application, where the dynamic runtime library simulates threads implemented in the native runtime library in a coroutine manner; loading the dynamic runtime library when starting the application to generate a runtime virtualization environment and a coroutine scheduling thread running in the runtime virtualization environment, where the coroutine scheduling thread is used to schedule coroutines, and the runtime virtualization environment is an environment after replacing the native runtime library with a generated runtime environment; receiving a task request of the application in the runtime virtualization environment; and scheduling coroutines using the coroutine scheduling thread based on the task request and the dynamic runtime library so that the coroutines complete the tasks corresponding to the task request. This implementation improves the concurrency performance of the application, reduces resource consumption and resource scheduling pressure without making any modifications or recompiling to the application in the target operating system.

The invention relates to the technical field of network communication, and discloses a storage and calculation separated storage system and a method for improving the network transmission efficiency of the system. The lightweight TCP / IP protocol stack, the RDMA technology, the coroutine scheduling mechanism and the hardware acceleration module are integrated in the Ethernet-SSD, and the performance bottleneck of a traditional storage architecture in a high-concurrency and large-throughput data access scene is effectively solved. By optimizing each link of the storage system, the Ethernet-SSD realizes maximum utilization of task scheduling and resource management while providing efficient data transmission, so that the stability and the high efficiency of the system in a high-load and high-concurrency environment are ensured. An efficient and reliable storage solution is provided for the fields of distributed storage, cloud computing, high-performance computing and the like, and the method has a wide application prospect.

The invention relates to the technical field of computer application, in particular to a coroutine-driven multi-strategy APP behavior collection event reporting system. Comprising a management center, and the management center is in communication connection with a system configuration module, an event coroutine module, an event uploading module and a collection retransmission module. The method comprises the following steps: collecting equipment information data and user identity information, initializing the collected equipment information data and the user identity information, obtaining configuration data, and establishing a start burying point through the configuration data; establishing a communication link according to the starting burying point; analyzing the obtained use behavior of the APP user to obtain an APP behavior collection sub-event; processing the APP behavior collection sub-event through a coroutine unit to obtain a sub-event data packet, uploading the sub-event data packet, and generating a data uploading completion signal and a data uploading failure signal; and retransmitting the sub-event data packet through the data uploading completion signal and the data uploading failure signal. The data loss rate can be reduced.

The invention discloses a software performance test system, method and device in a high-concurrency scene, and relates to the field of software testing, the system comprises a scene intelligent construction module used for generating a concurrency scene through a behavior tree modeling and time sequence prediction algorithm according to service demand parameters and historical traffic data; the distributed test environment scheduling module is used for constructing a distributed test environment by adopting a container arrangement technology; the virtual user load generation module is used for simulating concurrent user requests by adopting a coroutine pool technology; the real-time performance data acquisition module is used for acquiring multi-source performance data of the tested software in real time; the intelligent performance analysis module is used for calculating a core performance index according to the multi-source performance data and carrying out anomaly detection and trend prediction; and the performance bottleneck positioning module is used for mining a dependency relationship among the core performance indexes and generating a bottleneck positioning report and an optimization suggestion document. According to the method, the accuracy, the efficiency and the stability of software performance testing in a high-concurrency scene are improved.

The invention discloses a memory management method and device based on a coroutine, and relates to the technical field of memory management. A specific embodiment of the method comprises the following steps: starting at least one coroutine scheduling thread; configuring at least one memory allocation area for each coroutine scheduling thread; and starting the coroutine, and when the coroutine is submitted to one coroutine scheduling thread in the at least one coroutine scheduling thread, binding the coroutine with one memory allocation area corresponding to the coroutine scheduling thread submitted by the coroutine according to a preset load balancing algorithm. According to the embodiment, the memory occupancy rate is reduced while the concurrency performance of the system is effectively improved.

The invention discloses a cross-language task processing method and related equipment, and the method comprises the steps: obtaining a to-be-executed coroutine task of a task scheduling framework of a bottom layer; the coroutine task comprises an asynchronous function, and the task scheduling framework and the asynchronous function are compiled by adopting different programming languages; constructing a wakeup device of an asynchronous function according to a task handle of the coroutine task; and according to the wake-up device, calling a polling method of an asynchronous function to poll the coroutine task and processing a return result of the polling method. According to the embodiment of the invention, the Rust asynchronous primitive can be matched with the underlying task scheduling framework of other languages, so that various services of different languages can share the same task scheduling framework, and unified management of thread resources is realized.

The invention provides a method and a device for supporting elastic scalability of computing power resources of an intelligent computing center, and the method comprises the following steps: S1, after a DiskANN service receives a task request, inserting the task request into a work queue corresponding to the type of the task request, configuring a plurality of work queues for the DiskANN service, different work queues correspond to different types of task requests; s2, the DiskANN service elastically adjusts the number of threads or the number of coroutines configured for the work queue according to the number of the task requests in the work queue; and S3, the DiskANN service obtains the task request from the work queue and processes the task request based on a thread or a coroutine configured for the work queue. The utilization rate of computing power resources of the intelligent computing center can be effectively improved.

The invention provides an asynchronous graph calculation method and system based on a coroutine, electronic equipment and a storage medium, and relates to the technical field of graph calculation. The asynchronous graph calculation method comprises the following steps: determining an activation vertex based on an activation vertex bitmap; the activation vertexes are distributed to different parallel tasks, so that each parallel task calls a first preset function based on the current activation vertex to generate a target message, and the target message is stored in a corresponding local message queue; aggregating the target messages in the local message queue based on the plurality of first target coroutines to obtain a target message set; and calling a second preset function based on the plurality of second target coroutines to carry out message processing on the target message set so as to complete asynchronous graph calculation. The resource utilization rate of the whole graph computing system can be effectively improved.

The invention provides an event processing method and device, electronic equipment, a computer readable storage medium and a computer program product, is applied to threads of responsive programs, and relates to the technical field of event response, data processing, thread scheduling and the like. A specific embodiment of the method comprises the steps of configuring a corresponding coroutine for an event in response to detection of occurrence of the event; in response to detecting that the event data of the event is in a readable state, a coroutine is scheduled to process the event data. Therefore, not only can the response capability to the event be improved, but also the scheduling and processing efficiency of processing the event data of the event can be improved.

The invention discloses a method for rewriting binary software and electronic equipment for rewriting the binary software, according to a deformation number and original code rewriting information, a part of instructions of an original binary code are selected to be replaced with a jump instruction sequence, the jump instruction sequence jumps into an additional code unit, and the additional code unit is rewritten according to the additional code unit. And after completing the same logic function of the replaced instruction, the additional code unit skips to the back of the replaced instruction and continues to execute the instruction. The additional code unit can also run additional calculation, plug-in coroutines and the like. The method is suitable for being used as random scrambling of cryptographic operation to resist energy analysis attacks. And the method is also suitable for code obfuscation, tamper-proof monitoring, piracy prevention and the like of binary software.

The invention provides a database thread pool control method and device. A specific embodiment of the method comprises the steps of loading a dynamic runtime library capable of replacing a thread with a coroutine in an operating system of a database, and generating at least one coroutine scheduling thread; receiving a connection request sent by the client to the database; detecting whether the request of the database for creating the new thread is a request for processing the connection request; and in response to detecting that the request for creating the new thread of the database is a request for processing the connection request, creating a coroutine corresponding to the connection request, and scheduling the coroutine through at least one coroutine scheduling thread to complete an access task corresponding to the connection request. According to the implementation mode, the coroutine scheduling thread serves as a working thread of a database thread pool, the problem of task starvation of a traditional multi-thread scheduling model and the problem of related task response speed jitter are avoided through a coroutine swap-in and swap-out mechanism, the concurrency performance of a database is improved, and meanwhile resource consumption of concurrency scheduling is reduced.

The embodiment of the invention provides an initialization checking method and device of a server and electronic equipment, and relates to the technical field of cloud computing, and the initialization checking method of the server comprises the following steps: obtaining an initialization list of each piece of equipment in each server, analyzing the initialization list, and extracting initial index information of each piece of equipment; coroutines with the same number as the servers are started, network delay testing is carried out on server networks of all the servers in a concurrent mode, and addresses of all the servers capable of communicating are collected; recording the address of the non-communication server to a log; based on the addresses of the communication servers, coroutines with the number equal to that of the communication servers are started, actual index information of each communication server is obtained through a redfish interface, and accuracy verification is carried out on the initial index information belonging to the same communication server and the actual index information after data cleaning; and storing the verification result and the actual index information after data cleaning to a result file.

The invention provides a coroutine implementation method and device for GPU programming, and relates to the technical field of computer graphics and programming languages, and the method comprises the steps: obtaining a coroutine program code written by a user based on a GPU programming language; wherein the coroutine program code comprises at least one hanging node, and the hanging node is used for defining a hanging behavior and a recovery behavior of a coroutine; segmenting a calculation task corresponding to a coroutine according to a suspended node of the coroutine program code to obtain a plurality of sub-routines and a plurality of coroutine frames; wherein the coroutine frame is used for transmitting information among the plurality of subroutines; and based on the plurality of coroutine frames, respectively distributing the plurality of segmented sub-routines to a plurality of threads of the GPU for parallel execution. According to the method provided by the invention, the sub-routines are automatically processed and divided, the coroutine frame for storing the intermediate data is determined, and a large number of coroutines can be efficiently executed in parallel.

The invention belongs to the technical field of task scheduling of a storage system, and discloses a user-mode-oriented storage task self-adaptive scheduling method and system, and a more efficient task processing framework is realized by replacing an original kernel thread-based storage task scheduling scheme with a user-mode coroutine scheduling mechanism. The multi-level priority queues are directly managed in task scheduling, and CPU core binding configuration is carried out, so that the switching delay of a user mode / kernel mode is reduced, and the task execution controllability is improved. A dual-threshold self-adaptive scheduling strategy switching technology is introduced, and a greedy scheduler and a reinforcement learning scheduler are combined, so that the problem of adaptability of a static scheduling strategy in a dynamic load environment is relieved, performance loss caused by scheduling strategy solidification is avoided, and the self-adaptive capability and service quality guarantee of a system under a complex load are improved. Compared with an existing task scheduling method based on a kernel thread, the task scheduling method has the advantages that the overall performance and the resource utilization rate of a storage system can be remarkably improved while the task execution efficiency and the SLA requirement are guaranteed.

The invention relates to the technical field of data transmission, and provides a data acquisition method and system for distributed equipment and a storage medium. The data acquisition method comprises the steps that the data acquisition method is triggered through a timer, equipment information of business equipment is inquired from a database through a main service program, and the equipment information is stored in the database; traversing the equipment information through the main service program, grouping the business equipment through the machine frame, creating a coroutine by taking the machine frame as a unit, traversing the equipment information in the machine frame through the main service program in the coroutine, and initiating an acquisition request to a corresponding equipment agent program according to the equipment type of the business equipment; the acquisition request is received through the device agent program, a programmed acquisition process is started, and a programmed acquisition result is obtained, and the programmed acquisition result comprises the index data of the business device. According to the application, the data can be acquired in a programmed and accurate manner, the integrity of data acquisition is ensured, and manual participation in command execution and programmed acquisition is not needed, so that the labor cost is saved.

The invention provides an online fragment restructuring method and related equipment, and relates to the technical field of computers.The method comprises the steps that an online fragment restructuring request is received, a target fragment is determined, a migration task is created in the target fragment, and a first coroutine and a second coroutine are created in the target fragment according to the incremental copying process in the migration task, the first coroutine and the second coroutine are executed asynchronously and concurrently, a binary log event in the source fragment is obtained in the first coroutine and written into a relay log of the target fragment, and data in the relay log is written into the target fragment through the second coroutine. The problem of shutdown migration is solved, shutdown processing is not needed, usability and efficiency are improved, dependence on manual operation is reduced, and the scene application range is widened.

The invention relates to a high-concurrency request processing method for reducing Linux kernel resource loss. The high-concurrency request processing method comprises the following steps: receiving a user request and extracting a routing key; the requests are distributed to one fragment in the fixed N fragments through a fragment event executor, each fragment is bound with a single thread and a bounded queue, and the same routing key requests are executed in the same fragment in a strongly sequenced mode according to the enqueue sequence; calling a coprogram state machine to push a business process in the fragment execution thread, and returning a state result of migrating to a next state, keeping a current state or terminating the process through a state processing function; dynamically triggering self-adaptive back pressure based on queue depth or waiting time delay, and adjusting a request submission strategy according to a queue filling rate and exponentially weighted moving average waiting time delay; and submitting the long blocking task to an asynchronous task subsystem, and performing isolated execution through an independent bounded queue and a small concurrent thread pool. The same-key sequence is guaranteed through fragmentation single-thread execution, and thread switching and lock contention are remarkably reduced.

The present disclosure provides a database thread pool control method and apparatus. A specific implementation of the method includes: loading a dynamic runtime library capable of replacing threads with coroutines in the operating system of the database to generate at least one coroutine scheduling thread; receiving a connection request sent by a client to the database; detecting whether a request for the database to create a new thread is a request for processing the connection request; in response to detecting that the request for the database to create a new thread is a request for processing the connection request, creating a coroutine corresponding to the connection request, and scheduling the coroutine through at least one coroutine scheduling thread to complete the access task corresponding to the connection request. In this implementation, the coroutine scheduling thread serves as the working thread of the database thread pool, and the task "starvation" problem of the traditional multithreaded scheduling model and its related task response speed jitter problem are avoided by using the coroutine swap-in and swap-out mechanism. While improving the database concurrency performance, the resource consumption of concurrent scheduling is reduced.

Embodiments of the present application provide a kind of alarm rate detection method, device, equipment and storage medium, the method can create and target test equipment same and one-to-one corresponding coroutine, then call each coroutine continuously through the way of mutual exclusion, constantly from the ordered acquisition of preset rule set in measured rule package, then measured rule package is sent to target test equipment to carry out the test of rule package, each coroutine can be realized uninterrupted continuous testing, and after completing the test of all measured rule package, the alarm result of each measured rule package is determined and alarm rate is determined, without waiting target test equipment to spit alarm after each time sending rule package, so that the test efficiency of rule package can be improved.

The invention discloses a shared resource access method and device, equipment, a medium and a product, and relates to the technical field of efficient concurrency control and resource management in a computer system.The shared resource access method and device adopt a mixed structure combining a lock-free annular queue and a double-end queue, queue data are analyzed through a load prediction unit, and the load trend is predicted; the queue capacity and the migration threshold value are dynamically adjusted; the lock-free annular queue is preferentially used in daily life to improve the access efficiency, and when the queue is close to the capacity upper limit or triggers the migration threshold, migration and capacity expansion of waiting coroutines are automatically realized through the double-end queue, so that the processing performance under high concurrency is ensured, and the dynamic capacity requirement is met; finally, the technical problems that the performance and the capacity of a single queue are difficult to consider in a high-concurrency scene and the single queue cannot adapt to a dynamic load are solved, and efficient scheduling of shared resources in a coroutine environment is realized.

The invention provides a coroutine task scheduling optimization method based on OpenHarmony, belongs to the technical field of industrial robot operation, and aims to solve the problem that an industrial robot is insufficient in real-time performance, concurrency and flexibility in a complex task scene, and the method comprises the following steps: S1, coroutine data structure design; s2, optimizing coroutine memory management; s3, multi-architecture processor adaptation is carried out; s4, optimizing a coroutine task scheduling mechanism; s5, carrying out coroutine multi-core scheduling optimization; the invention designs and realizes an industrial robot operating system library of a lightweight coroutine in order to realize coroutine task scheduling optimization. According to the coroutine library, the lightweight coroutine library which is lower in memory occupation, higher in task real-time performance and higher in CPU utilization rate is designed and realized aiming at the condition that resources are limited in a robot scene, and meanwhile, the coroutine library is introduced into a domestic robot operating system for real-time scheduling adaptation for the first time.

The application discloses a kind of Python function dynamic management method, system and storage medium, the method first receives the function call service request of containing target service identification and target function identification, then based on double hashing register fast positioning target service instance, extract target function object therefrom and analyze its execution attribute to determine the matched asynchronous execution strategy, finally according to the strategy function call is encapsulated as coroutine task or thread / process task to be executed in one step scheduling and return result.

The invention provides a task processing method which can reduce the number of coroutines of a processing core and reduce the coroutine scheduling duration so as to improve the task processing efficiency. The method comprises the steps that after a main coroutine and a standby coroutine are created in a processing core, the main coroutine is used for polling a task queue of the processing core. The invention further provides a storage device, a computer readable storage medium and a computer program product capable of implementing the method.

The application provides a processing method, device, storage medium and system for serial machine communication, and belongs to the technical field of communication. The monitoring method comprises the following steps: storing element information corresponding to a plurality of ports by using a first queue pool; adding elements corresponding to one or more TCP ports in the plurality of TCP ports into a to-be-processed linked list, adding element information corresponding to one or more TCP ports with a cache mark into a preparation linked list, and receiving output information of the TCP ports in the preparation linked list; when the one or more TCP ports are connected, predicting I / O operations generated in a next process, and marking the process by using an asynchronous keyword. The application configures the to-be-processed linked list, the preparation linked list, the cache mark and the asynchronous keyword based on the coroutine technology, realizes processing of asynchronous communication of the serial machine, and does not have a time slice of context switching of the CPU, so that the CPU resource overhead is reduced.