Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

30 results about "Runtime library" patented technology

In computer programming, a runtime library (RTL) is a set of low-level routines used by a compiler to invoke some of the behaviors of a runtime environment, by inserting calls to the runtime library into compiled executable binary. The runtime environment implements the execution model, built-in functions, and other fundamental behaviors of a programming language. During execution (run time) of that computer program, execution of those calls to the runtime library cause communication between the executable binary and the runtime environment. A runtime library often includes built-in functions for memory management or exception handling. Therefore, a runtime library is always specific to the platform and compiler.

Method and system for realizing CUDA call tracking based on eBPF

InactiveCN120723587AHardware monitoringCall tracingSoftware engineering
The invention provides a method and system for achieving CUDA call tracking based on an eBPF, and relates to the field of GPU call tracking of the eBPF. The method comprises the following steps: dynamically mounting an eBPF program at an API function entry and an API function exit of a user mode CUDA runtime library through an uprobe technology of the eBPF; the eBPF program captures metadata of the CUDA API calling event in a kernel mode and packages the metadata into a predefined structural body; asynchronously transmitting the structural body data to a user mode through an annular buffer area; and calling a standard function library by a user mode program to load an eBPF program, reading data in the annular buffer area in real time, and completing analysis and visual display of a CUDA calling event. According to the method, the calling parameter, the return value and the nanosecond timestamp are effectively captured, and the observability and the debugging efficiency of the GPU application program are improved.
Owner:JINAN INSPUR DATA TECH CO LTD

Heterogeneous GPU resource management scheduling method

The invention provides a heterogeneous GPU resource management scheduling method, and relates to the technical field of GPU resource allocation, heterogeneous equipment management and unified abstract modeling are carried out, GPU resources of different architectures are registered to a container arrangement platform, and a unified abstract layer is constructed to shield bottom layer hardware differences; gPU cluster optimization management based on a multi-dimensional real-time monitoring and intelligent scheduling strategy is carried out, GPU operation indexes are collected, priorities are dynamically calibrated for tasks, and task performance portraits are constructed; scheduling decision making is carried out through multi-strategy cooperation, and optimal GPU resources are distributed for tasks; carrying out fine-grained resource allocation, carrying out space or time segmentation on the GPU, and dynamically adjusting resource allocation according to a load state; aPI conversion of cross-architecture tasks is realized through a unified runtime library, and task execution data is collected to feed back an optimization scheduling model; automatic detection, isolation and task migration of GPU faults are carried out, and unified monitoring and alarm are provided.
Owner:TAIJI COMPUTER CORPORATION LIMITED

Task scheduling method and device, storage medium and electronic equipment

The invention provides a task scheduling method and device, a storage medium and electronic device.The method is applied to a runtime library of a host and comprises the steps that in response to a received calculation task, a kernel driver is called to obtain performance data of at least two core particles, and a scheduling score corresponding to each core particle is determined according to the performance data; scheduling the calculation task to the corresponding core particle for execution based on the scheduling score; the scheduling score is determined on the basis of the performance data of the core particles, task scheduling is executed, accurate adaptation of the calculation task and the core particles is achieved, and the task execution efficiency and the resource utilization rate under the multi-core-particle architecture are effectively improved.
Owner:SHANGHAI QINGWEI INTELLIGENT TECH CO LTD

Java application lightweight deployment system and method based on dependency stability grading

The invention discloses a Java application lightweight deployment system and method based on dependency stability grading, and relates to the technical field of software deployment, and the method comprises the following steps: collecting dependency metadata, and generating a dependency list description file; packaging the Java application service code and the internal runtime library into a service code file, forming a service code ciphertext file, and generating a lightweight application deployment package; constructing a basic container mirror image, pulling the basic container mirror image and a lightweight application deployment package, decrypting a service code ciphertext file, downloading missing dependency and verifying a dependency fingerprint, and starting a SpringBoot application; and collecting dependency operation data, generating and issuing an incremental updating plan, executing the incremental updating plan, and updating the dependency stability score and the dependency stability level. And the stability of the deployment carrier and the operation reliability of the Java application are improved.
Owner:TIANJIN COSCO SHIPPING DIGITAL INTELLIGENT SOURCE TECHNOLOGY CO LTD

Cross-platform model deployment framework, electronic equipment and storage medium

The invention discloses a cross-platform model deployment framework, electronic equipment and a storage medium, and the framework is applied to the electronic equipment and specifically comprises a framework interface abstraction layer and a plurality of runtime libraries connected with the framework interface abstraction layer. The framework interface abstraction layer is used for being connected with an application framework layer and providing a uniform abstraction interface for the application framework layer; the runtime library is used for providing running support for the framework interface abstraction layer. Compared with a traditional model deployment scheme, the scheme provided by the invention can accelerate the deployment speed of the model, ensures the uniformity of evaluation standards of the model on different platforms, and improves the reasoning performance. If the running environment is inferred to be updated, deployment updating of the model on a new platform can be rapidly completed according to the framework, and manpower and material resources needed by deployment can be greatly saved.
Owner:Z-ONE TECH CO LTD

Graphics processor memory access feature data collection method and apparatus

This invention provides a method and apparatus for acquiring memory access characteristic data of a graphics processing unit (GPU), relating to the field of computer technology. The method includes: intercepting call parameters of application programming interfaces (APIs) in the GPU runtime library; constructing a memory region tree structure based on the call parameters; inserting a preset function into the execution instruction stream of the GPU kernel to acquire instruction-level execution data; and generating GPU memory access characteristic data based on the memory region tree structure and the instruction-level execution data. The GPU memory access characteristic data acquisition method and apparatus provided by this invention correlate macroscopic memory and communication semantics with microscopic instruction-level execution data to generate global, fine-grained memory access characteristic data, improving the comprehensiveness and accuracy of acquiring GPU memory access characteristic data in cloud-edge-device architectures.
Owner:BEIJING INST OF TECH

A method and device for detecting a PE virus, an electronic device, and a storage medium

ActiveCN115017505BPlatform integrity maintainanceTerm memoryRuntime library
The application discloses a PE virus detection method, comprising the following steps: determining target resources required by a PE file during runtime; wherein the target resources comprise a CPU, a memory management module and a runtime library; virtually executing the PE file by simulating the target resources, and recording characteristic information generated by the PE file during the virtual execution; and judging whether the PE file is a virus file according to the characteristic information. The application can reduce resource consumption of PE virus detection. The application also discloses a PE virus detection device, a storage medium and an electronic device, which have the above beneficial effects.
Owner:SANGFOR TECH INC

Systems and methods for running applications associated with browser-based user interfaces within multi-developer computing platforms

PendingUS20250383890A1Link editingVersion controlSoftware engineeringRuntime library
Systems and methods for developing one or more applications associated with a browser-based user interface within a multi-developer computing platform employ one or more processors that receive a request to build one or more applications configured to run in a browser-based user interface on a client; determine whether the one or more applications are associated with a core library and one or more runtime libraries; and in response to determining that the one or more applications are associated with the core library and the one or more runtime libraries: determine one or more version numbers associated with the one or more runtime libraries; and in response to the determined one or more version numbers being within a predetermined range associated with the core library, dynamically link the one or more runtime libraries and the one or more applications.
Owner:PALANTIR TECHNOLOGIES INC

Bone animation rendering method and device, electronic equipment and storage medium

The invention discloses a skeletal animation rendering method and device, electronic equipment and a storage medium, and relates to the technical field of graphic processing. The method is applied to the electronic equipment, an operating system is installed in the electronic equipment, and the method comprises the steps that an application page of an application program is displayed, a runtime library with skeletal animations is imported into the application program, the runtime library is called through GLSkeletal View of the operating system to create Skeletal Drawable, the Skeletal Drawable is called through the GLSkeletal View to set animation parameters, an animation instance object is obtained, and the animation instance object is displayed on the application page. And calling the SkeleteronDrawable and the runtime library through the GLSkeleteronView, carrying out animation drawing according to the animation instance object to render a skeleton animation picture, and playing the skeleton animation page in the application page. According to the method and the device, the runtime library of the skeletal animation is imported into the application program, and the GLSkeleteronView of the operating system is called to realize rendering playing of the skeletal animation, so that a game engine does not need to be additionally introduced, and the access cost is low.
Owner:GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD

File storage method, file access method, electronic device, and storage medium

ActiveCN116263760BAccess methodRuntime library
Embodiments of the present application provide a file storage method, a file access method, an electronic device and a storage medium, and relate to the field of information technology. The method comprises: obtaining an installation package file; decompressing a runtime library compressed file in the installation package file to obtain a runtime library file corresponding to the runtime library compressed file; recording a correspondence relationship and a first offset, and releasing one or more data blocks of the runtime library compressed file in the installation package file; wherein the correspondence relationship is used to represent the correspondence relationship between the one or more data blocks of the runtime library compressed file in the installation package file and the runtime library file, and the first offset is used to represent the offset of the one or more data blocks of the runtime library compressed file in the installation package file. The method provided by the embodiments of the present application can save the space occupied by the installation package file, thereby improving the storage efficiency.
Owner:HUAWEI DEVICE CO LTD

System and method to scale out for compute-intensive workloads

A method and apparatus for offloading compute-intensive workloads is provided. A database system compiles an execution plan to generate an offload-enabled plan by identifying a candidate offloading region in the execution plan, generating and adding an offloading branch in the offload-enabled plan, corresponding to the candidate offloading region, for execution by a compute offload runtime, wherein the compute offload runtime comprises a compute offload runtime library executing on the database system and on each node of a compute offload server, and adding the candidate offloading region as a fallback branch in the offload-enabled plan. The database system executes the offload-enabled plan by executing the offloading branch using one or more compute nodes in the database server or the compute offload server using the offload runtime or by executing the fallback branch using one or more compute nodes in the database server.
Owner:ORACLE INT CORP

Program call stack creation method and unwind stack method and apparatus

This application discloses a program call stack creation method and apparatus, and an unwind stack method and apparatus. The call stack creation method includes: obtaining a first program, where the first program includes a first function, in a process of calling a runtime library to run the first program, adding a second function and creating a call stack, where the call stack includes a first stack frame, a second stack frame, and a third stack frame that are respectively corresponding to the first function, the second function, and a third function. An unwind stack performance can be improved to a maximum extent without affecting a non-stack trace scenario.
Owner:HUAWEI TECH CO LTD

A heterogeneous GPU resource management and scheduling method

This invention proposes a heterogeneous GPU resource management and scheduling method, relating to the field of GPU resource allocation technology. It addresses heterogeneous device management and unified abstract modeling, registering GPU resources of different architectures to a container orchestration platform and constructing a unified abstraction layer to shield underlying hardware differences. The method optimizes GPU cluster management based on multi-dimensional real-time monitoring and intelligent scheduling strategies, collecting GPU performance metrics, dynamically prioritizing tasks, and constructing task performance profiles. It makes scheduling decisions through multi-strategy collaboration to allocate optimal GPU resources to tasks. Fine-grained resource allocation is performed, partitioning GPUs spatially or temporally and dynamically adjusting resource allocation based on load status. A unified runtime library enables cross-architecture task API conversion and collects task execution data to optimize the scheduling model. Finally, it performs automatic GPU fault detection, isolation, and task migration, providing unified monitoring and alerting.
Owner:TAIJI COMPUTER CORPORATION LIMITED

User interface dynamic extensible development method and system based on software platform

PendingCN120540650AVisual/graphical programmingModel driven codeSoftware engineeringAutomotive software development
The invention belongs to the technical field of vehicle software development, and particularly relates to a user interface dynamic extensible development method and system based on a software platform. The interface manager dynamically extracts type information related to a window in a software platform runtime library and inherits the type information to form a dynamically derived basic window, meanwhile, the interface manager generates software platform import codes, codes for dynamically creating a primary window are generated according to the type information in the software platform import codes, and the primary window is dynamically created according to the type information in the software platform import codes. And storing software platform import codes and codes for primary window dynamic creation into a primary derived code file.
Owner:SHANGHAI TOSUN TECH LTD

Systems and methods for running applications associated with browser-based user interfaces within multi-developer computing platforms

ActiveUS12367050B2Link editingVersion controlSoftware engineeringRuntime library
Systems and methods for developing one or more applications associated with a browser-based user interface within a multi-developer computing platform employ one or more processors that receive a request to build one or more applications configured to run in a browser-based user interface on a client; determine whether the one or more applications are associated with a core library and one or more runtime libraries; and in response to determining that the one or more applications are associated with the core library and the one or more runtime libraries: determine one or more version numbers associated with the one or more runtime libraries; and in response to the determined one or more version numbers being within a predetermined range associated with the core library, dynamically link the one or more runtime libraries and the one or more applications.
Owner:PALANTIR TECHNOLOGIES INC

Adaptation method and system, storage medium and program product

The invention relates to the technical field of CAD, in particular to an adaptation method and system, a storage medium and a program product.The adaptation method comprises the steps that a plug-in directory table is obtained, and a query value is recorded in the plug-in directory table; querying a to-be-analyzed plug-in package according to the query value; a hierarchical analysis rule is adopted to judge whether a currently queried plug-in package is allowed to be introduced into a current operation environment or not, and the method comprises the steps that S31, first analysis information of the current plug-in package is obtained, and the first analysis information comprises runtime library data; s32, judging whether the first analysis information is complete or not; if yes, entering S33; s33, obtaining second analysis information of the plug-in package, wherein the second analysis information comprises an operation environment version; s34, judging whether the second analysis information is matched with the current operation environment or not; if yes, it is considered that the plug-in package is allowed to be introduced into the current operation environment. The problems that in existing CAD, batch plug-in introduction efficiency is low, and blockage is prone to occurring are solved.
Owner:SUZHOU CAD SOFTWARE CO LTD

Procedure call stack creation method, stack backtracking method and apparatus

This application discloses a method for creating a program call stack, a method for stack backtracking, and an apparatus. The method for creating the call stack includes: obtaining a first program, which includes a first function; adding a second function and creating a call stack during the execution of the first program by calling a runtime library, wherein the call stack includes a first stack frame, a second stack frame, and a third stack frame corresponding to the first function, the second function, and the third function, respectively; there is a call relationship between the first function and the second function, and a call relationship between the second function and the third function; the third function is a function in the runtime library or in the first program; and the high-level programming language corresponding to the first function and the high-level programming language corresponding to the third function are different; and saving a tag corresponding to a first return address, which indicates the type of the first stack frame, the second stack frame, and the third stack frame. This application can maximize the performance of stack backtracking without affecting non-stack backtracking scenarios.
Owner:HUAWEI TECH CO LTD

Hybrid life cycle scheduling storage architecture for post quantum cryptography algorithm

The invention relates to a hybrid life cycle scheduling storage architecture for a post quantum cryptography algorithm. The invention relates to the technical field of integrated circuit design and post quantum cryptography hardware acceleration, and provides a hybrid life cycle scheduling storage architecture for a post quantum cryptography algorithm, which comprises an algorithm execution coordinator, an algorithm perception life cycle analyzer ALA, an address allocator SAA and an SRAM storage group, and a complete storage management system is formed by the data flow bus and the control flow signal line. According to the method, the data life cycle label is automatically generated through the hardware event pulse, software instrumentation or runtime library is thoroughly eliminated, life cycle perception with zero software overhead is achieved, and data migration energy consumption is reduced.
Owner:HARBIN ENG UNIV

System And Method To Scale Out For Compute-Intensive Workloads

A method and apparatus for offloading compute-intensive workloads is provided. A database system compiles an execution plan to generate an offload-enabled plan by identifying a candidate offloading region in the execution plan, generating and adding an offloading branch in the offload-enabled plan, corresponding to the candidate offloading region, for execution by a compute offload runtime, wherein the compute offload runtime comprises a compute offload runtime library executing on the database system and on each node of a compute offload server, and adding the candidate offloading region as a fallback branch in the offload-enabled plan. The database system executes the offload-enabled plan by executing the offloading branch using one or more compute nodes in the database server or the compute offload server using the offload runtime or by executing the fallback branch using one or more compute nodes in the database server.
Owner:ORACLE INT CORP

Front-end internationalization automatic processing method and system based on tool chain collaboration

The invention discloses a tool chain collaboration-based front-end internationalization automatic processing method and system. The method comprises the following steps: identifying and reconstructing a hard coding text in a project source code through a source code conversion process based on AST analysis, extracting internationalized text nodes and generating a resource file; in the construction process integrated with the construction system, a construction fingerprint containing a project identifier and a construction timestamp is generated, the construction fingerprint and a resource loading address base address determined according to a construction mode are injected into an application, and a local resource file is published to a cloud storage path; and through the internationalized runtime library, according to the injected construction fingerprint and the resource loading address base address, loading a resource file corresponding to a local or cloud end as required when the application is started. The system comprises a source code conversion module, a construction integration module and a runtime loading module. According to the invention, full-link automation and resource intelligent management of the internationalization process are realized, and the development efficiency and the application performance are greatly improved.
Owner:云筑信息科技(成都)有限公司

Optimization method and system for SW Go runtime library byte slicing operation and medium

The invention discloses an optimization method and system for SW Go runtime library byte slicing operation and a medium, and belongs to the technical field of compilers, the method comprises the following steps: judging the type of the current byte slicing operation based on a calling function name: executing byte counting to count the occurrence frequency of a specified byte in a byte slice when the type is Count; when the byte is IndexByte, executing byte search to return an index with a specified byte appearing for the first time in a byte slice, adopting vectorization parallel operation, processing a 32-byte data block by utilizing a 256-bit vector operation instruction of an SW architecture, and allocating a basic unit according to a mechanism of a Go compiler by taking a 8KB page as a memory; and when the byte slice with the processing length less than 32 bytes is processed, carrying out secure excess loading operation. The method solves the problems that in the prior art, a Go compiler memory management mechanism and SW short vector instruction acceleration are not utilized, and due to processing of branches with different lengths, more judgment transfer is caused, and the running duration is increased during dynamic adjustment.
Owner:WUXI ADVANCED TECH RES INST

System runtime library configuration method, system, equipment and medium in desktop application program installation process

The invention discloses a system runtime library configuration method, system and device in the desktop application program installation process and a medium, and relates to the technical field of computer application, and the method comprises the steps that in the desktop application program installation process, whether a system runtime library meeting a preset environment configuration condition is installed in an operation system or not is detected to obtain a corresponding detection result; when the detection result is that the system is not installed, or the detection result is that the first version information of the system runtime library does not meet the preset version condition, calling a corresponding system runtime library installation program from dependency library installation resources integrated by the desktop application program installation package to execute silent installation; monitoring the execution process of the library installation program when the system runs, and obtaining an installation result; and controlling the installation process of the desktop application program according to the installation result. According to the method, repeated installation can be avoided when the installation is completed and the version is met, installation or updating is triggered only when actual needs are needed, unnecessary installation operation is reduced, and background installation is achieved through silent parameters.
Owner:SHANDONG INSPUR SCI RES INST CO LTD

Design and implementation of code debugger

The invention discloses design and implementation of a code debugger, and relates to the technical field of code debuggers, which comprises the following steps of: 1, compiling a code of a user through a customized code compiler to generate a compiled intermediate code containing specific debugging information and a record statement; 2, linking the compiling intermediate code and the runtime library to generate an executable file containing specific debugging information, a record statement and a runtime function; step 3, running the executable file to obtain information of a running process; 4, reading the running process information according to the debugging information to obtain readable running process information; 5, the readable operation process information is sent to the front end; step 6, rendering a graphical interface by the front end so as to provide a simple and visual graphical interface and rich interaction functions; by using the debugger, a user can quickly understand the running principle of the whole program or quickly locate problems in codes.
Owner:王坦

Task execution method and device based on proximity relation, electronic equipment and storage medium

The invention relates to the technical field of artificial intelligence task reasoning, and discloses a task execution method and device based on a proximity relation, electronic equipment and a storage medium. Embedding the address of the to-be-called data of the new task into the data structure of the new task as a proximity mark; searching an affinity task queue consistent with the affinity mark of the new task in each thread; if a proximity task queue matched with the proximity mark of the new task is retrieved, adding the new task into the retrieved proximity task queue; and when the thread with the empty task appears, preferentially screening the task with the same affinity mark as the thread with the empty task from the affinity task queue of other threads in the runtime system, and stealing and executing the task with the same affinity mark as the thread with the empty task. According to the method, the problems of load imbalance, data local damage, high task stealing overhead and the like are solved.
Owner:CHINA ACADEMY OF INFORMATION & COMM

Fault detection method and device, equipment, storage medium and computer program product

PendingCN121029452AFault responseAnalysis toolsRuntime library
The invention relates to a fault detection method and device, equipment, a storage medium and a computer program product, and the method comprises the steps: obtaining the target queue information of a target task queue from a user state subsystem of a target application system when the target application system is in a fault state, analyzing the target queue information, obtaining a fault detection result, and transmitting the fault detection result to a server; wherein the user mode subsystem comprises address information and space information of the target task queue. According to the method, when the target application system breaks down, the upper layer runtime library does not need to modify the permission of the application system and does not need to use a complex analysis tool to obtain the bottom layer queue information, the target queue information can be directly and rapidly obtained through the user mode subsystem, and the fault detection efficiency can be improved to a certain extent.
Owner:DAWNING INT INFORMATION IND CO LTD +2

SIMD-based high-performance mathematical function runtime library optimization method and system

The invention relates to an SIMD-based high-performance mathematical function runtime library optimization method and system, and the method optimizes a high-performance mathematical function runtime library through a high-performance mathematical trigonometric function sin, a high-performance mathematical trigonometric function cos (x), a high-performance mathematical trigonometric function tan (x), and a high-performance mathematical function logf (x). On the basis of realization and optimization of sin, cos, tan and log functions of a ReWorks operating system, high-performance optimization of a mathematical trigonometric function and a basic mathematical operation library is realized, vectorization is performed on the basic mathematical function of the system by utilizing an SIMD instruction, external optimization codes can be quickly fused, code assembly line operation is improved, the problem of single-instruction multi-data calculation of the basic mathematical operation library of a ReWorks platform is solved, and the method has the advantages of being simple in structure, convenient to operate and high in practicability. And the performance is improved on an ARMV8 platform.
Owner:ZHEJIANG YANGMING TECHNOLOGY DEVELOPMENT CO LTD

Animation implementation method, device, equipment and storage medium

The present embodiment provides an animation implementation method, apparatus, device and storage medium, which belongs to artificial intelligence technology. The method includes: obtaining at least one initial animation file; receiving an animation configuration parameter set, the animation configuration parameter set including a plurality of initial animation configuration parameters; calling a pre-configured global script; obtaining at least one initial animation file corresponding to the animation configuration parameter set through the global script, and obtaining at least one target animation file; obtaining the animation picture to be presented according to the at least one target animation file and the corresponding initial animation configuration parameter; refreshing and rendering the animation picture to be presented, wherein the animation picture to be presented is rendered by calling a pre-configured rendering script. The present invention does not need to define a tag to register the runtime library to determine the animation file corresponding to the animation configuration parameter set, solves compatibility issues and improves animation presentation efficiency, and controls the synchronization of animation picture refresh and rendering, so that animation playback is smoother.
Owner:KANG JIAN INFORMATION TECH (SHENZHEN) CO LTD

An adaptation method, system, storage medium and program product

The present application relates to a kind of CAD technical field, specifically to a kind of adaptation method, system, storage medium and program product, comprising: obtaining plug-in directory table, plug-in directory table record has query value;According to query value, the plug-in package to be parsed is queried;Whether the plug-in package currently queried is allowed to be introduced into current operating environment using hierarchical analysis rule, which includes: S31 obtains the first analysis information of current plug-in package, and the first analysis information includes: runtime library data;S32 judges whether the first analysis information is complete;If yes, then enter S33;S33 obtains the second analysis information of plug-in package, and the second analysis information includes: operating environment version;S34 judges whether the second analysis information is matched with current operating environment;If yes, then consider that plug-in package is allowed to be introduced into current operating environment.The present application solves the problems such as low efficiency, easy to jam of batch plug-in introduction in existing CAD.
Owner:SUZHOU CAD SOFTWARE CO LTD

Method and system for reducing gpu and cpu interaction overhead

ActiveCN116185615Bhigh speedInteraction Overhead EliminationParallel computingTheoretical computer science
The application discloses a method and system for reducing GPU and CPU interaction overhead, and the method comprises the following steps: according to the type and parameter information of all operators in a DNN model after topological sorting, generating kernel algorithm code from the last operator one by one, and meanwhile, according to the program information of the kernel algorithm code of the next operator to be run, inserting a serial function at the end of each generated kernel algorithm code; calling an online compiler of a runtime library to compile the kernel algorithm code of the just generated operator, and loading the binary program generated by the compilation into the GPU as input data to prepare for running; according to the input data, iteratively running each operator on the GPU through a running function from the first operator until a running end event is listened to, and then ending the running and copying the output data to the CPU. The technical scheme of the application can eliminate the interaction overhead generated by the interaction between the GPU and the CPU in the execution of each operator, save the calculation resources, and improve the speed of model running.
Owner:GLENFLY TECH CO LTD