Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

682 results about "Multi processor" patented technology

Large model-oriented reasoning service system and inter-stage resource adjustment method

The invention relates to the technical field of large models, in particular to a large-model-oriented reasoning service system and an inter-stage resource adjustment method, and the system comprises a pre-filling processor and a decoding processor; a computing resource controller implementing computing resource control of the prefill processor and the decode processor based on a multi-process service, the multi-process service allowing a target number of streaming multiprocessors to be designated to a prefill process representing an entity of the prefill processor and a decode process representing an entity of the decode processor; and the unified storage manager is used for managing the storage utilization rate of the system and the storage access of the pre-filling processor and the decoding processor to the large model weight and the KV cache. Therefore, the problems of delay interference, low storage efficiency and the like between pre-filling and decoding in related technologies are solved.
Owner:TSINGHUA UNIVERSITY

Many-core cache consistency system and method, electronic equipment, storage medium and product

The invention provides a many-core cache consistency system, a many-core cache consistency method, electronic equipment, a storage medium and a product, and the system is based on a network-on-chip architecture, and a plurality of nodes, corresponding routers and distributed directories deployed in the routers are introduced. Each node comprises one or more processor cores and a distributed last-stage cache, and a memory address is divided into a plurality of address blocks and is associated with the distributed last-stage cache through a dynamic address mapping rule. The distributed directories and the distributed last-stage caches are in one-to-one correspondence and used for recording the states of cache lines, the router is responsible for receiving and responding to requests from local or remote nodes, querying the distributed directories and updating the states of the cache lines, and efficient management of cache consistency is achieved. The technical scheme belongs to the technical field of communication, effectively solves the problems of high load and communication delay of a main node in a traditional cache consistency protocol, and improves data consistency and access efficiency in a multiprocessor system and a large-scale parallel computing environment.
Owner:SHANDONG YUNHAI GUOCHUANG CLOUD COMPUTING EQUIP IND INNOVATION CENT CO LTD

Parallel programming method for diversified computing task requirements

The invention provides a parallel programming method for diversified computing task requirements, which comprises the following steps of: quantifying the memory access cost of each processor by analyzing the specification and capability of multiple cores or multiple processors in a system; according to the memory access cost of the processor and the complexity of the task, performing preliminary mapping from the task to the processor; analyzing the time constraint of the real-time task, and modifying the preliminary mapping scheme according to the time constraint; a data transmission path between the processors is optimized so as to reduce the predicted communication cost; a greedy algorithm is adopted, adjustment is carried out according to the communication cost and the processing capacity between processors, and load balancing is optimized; according to a load balancing result, optimizing a data storage position so as to improve data locality; analyzing results of load balancing and data locality optimization, and starting a predetermined fault-tolerant mechanism; the energy consumption of the processor is predicted, and the frequency of the processor is adjusted by utilizing a PID (Proportion Integration Differentiation) controller so as to control the energy consumption.
Owner:GUANGXI POWER GRID CORP

Multi-processor core communication method and device, electronic equipment and storage medium

The invention relates to the field of satellite navigation anti-interference and the technical field of computers, and discloses a multi-processor core communication method and device, electronic equipment and a storage medium, and the method comprises the steps that a second processor core writes target information into a shared memory, and obtains a first idle channel number; the second processor obtains a first interrupt signal based on an interrupt trigger register corresponding to the first idle channel number; the first processor core reads target information in a shared memory according to the first interrupt signal; the first processor core processes the target information to obtain a processing result, and writes the processing result into the shared memory to obtain a second idle channel number; the first processor core obtains a second interrupt signal based on an interrupt trigger register corresponding to the second idle channel number; and the second processor core reads the processing result in the shared memory according to the second interrupt signal, and writes the processing result into the cache region. The multi-processor core communication method is suitable for different operating systems and is high in transportability.
Owner:CHANGSHA HAIGE BEIDOU INFORMATION TECH CO LTD

Fault-tolerant multi-processor systems and methods for an aircraft

Aspects of the present disclosure generally relate to systems and methods for flight control of aircrafts driven by electric propulsion systems and in other types of vehicles. In some embodiments, a computer-implemented method for controlling an aircraft is disclosed, comprising: receiving, from a source processor, a first copy of a signal corresponding to an input device; sending a second copy of the signal to all other processors; receiving a number of second copies of the signal from all other processors, the number of second copies being equal to the number of all other processors excluding the source processor; determining a consensus signal based on the first copy and the second copies of the signal; and determining a command signal for an effector of the aircraft based on the consensus signal, and wherein no two processors are configured to receive signals from a same input device.
Owner:ARCHER AVIATION INC

Neural network large model efficient reasoning method based on multiple GPGPUs

The invention belongs to the technical field of artificial intelligence and high-performance computing, and particularly relates to a neural network large model efficient reasoning method based on multiple GPGPUs. The method aims to solve the problems of high communication overhead, non-uniform load, low resource utilization rate, high data transmission delay and the like among multiple processors. Dividing a calculation task into a plurality of sub-graphs through static analysis and mixed granularity partitioning of a model calculation graph; distributing the sub-graphs to the optimal GPGPU based on a weighted cost function in combination with heterogeneous resource perception and a dynamic mapping strategy; a global pipeline scheduling plan is constructed by using communication topology perception, and calculation and communication overlap are maximized; data are loaded in advance through a host side hierarchical caching and asynchronous prefetching mechanism, and transmission delay is hidden; multi-stream concurrent execution and event-based lightweight synchronization are adopted on each GPGPU, so that waiting overhead is reduced. According to the method, the reasoning delay can be remarkably reduced, the throughput and the hardware utilization rate are improved, and the method has good adaptivity and expandability.
Owner:BEIJING TOPMOO TECH

Mobile multiprocessor-oriented deep learning model collaborative reasoning method

The invention belongs to the technical field of mobile computing and deep learning, and particularly relates to a mobile multiprocessor-oriented deep learning model collaborative reasoning method. According to the method, the state of each processor is monitored in real time, the deep learning model is subjected to sub-graph division in combination with the model analyzer, and the central scheduler is used for dynamically optimizing the execution strategy according to the load, the temperature and the operation state of the processor. The system comprises three core components, namely a hardware monitor, a model analyzer and a scheduler, through cooperation of the components, inference tasks of a plurality of deep learning models can be efficiently managed and executed, and the execution efficiency and the energy efficiency on mobile equipment are remarkably improved. The method can adapt to various hardware heterogeneity, is particularly suitable for mobile and edge equipment with limited resources, and solves the problem of performance bottleneck of a traditional mobile inference system when facing multi-task collaborative inference. The method has the characteristics of flexible scheduling and quick response, and is suitable for various real-time application scenes.
Owner:ANHUI UNIVERSITY OF TECHNOLOGY

Reservation policies for real-time processing tasks in multi-processor systems

Approaches presented herein provide systems and methods for allocating streaming multiprocessors (SMs) to execute one or more tasks. A utilization for a given task may be determined by one or more parameters, such as a task execution time or a period. The utilization may then be used to assign a proportionate number of SMs associated with a processing unit, such as a graphics processing unit (GPU) or other type of processing unit, executing the task. The SMs may then be identified, allocated, and reserved until execution of the task is complete.
Owner:NVIDIA CORP

Instructions and logic to perform floating point and integer operations for machine learning

One embodiment provides for a graphics processing unit to accelerate machine-learning operations, the graphics processing unit comprising a multiprocessor having a single instruction, multiple thread (SIMT) architecture, the multiprocessor to execute at least one single instruction; and a first compute unit included within the multiprocessor, the at least one single instruction to cause the first compute unit to perform a two-dimensional matrix multiply and accumulate operation, wherein to perform the two-dimensional matrix multiply and accumulate operation includes to compute a 32-bit intermediate product of 16-bit operands and to compute a 32-bit sum based on the 32-bit intermediate product.
Owner:INTEL CORP

CONTROL OF THE DRIVE-IN OF A MATERIAL OVERLOADING SYSTEM

A material transfer machine comprises a material container containing material and a material transfer system capable of transferring the material from the material container to another location, wherein the material transfer system comprises a discharge pipe movable between an operating position and a storage position and an actuator driving the movement of the discharge pipe between the operating position and the storage position.The material transfer machine further comprises one or more processors, a memory, and computer-executable instructions stored in the memory which, when executed by the one or more processors, configure the one or more processors to: receive an input indicating that the unloading tube should be moved from the operating position to the storage position; identify a pivot zone that defines an area in which the unloading tube will move when moved by the actuator from the operating position to the storage position; and generate a control signal based on the determination.
Owner:DEERE & CO

Geometric Deep Learning for Setups and Staging in Clear Tray Aligners

Systems and techniques are described for training and using a generative adversarial network (GAN) to produce intermediate stages and final setups for clear tray aligners (CTAs) including receiving, by one or more computer processors, a first digital representation of a patient's teeth, using, by the one or more computer processors and to determine a prediction for one or more tooth movements, a generator that is a neural network included in a GAN and that has been trained to predict one or more tooth movements, and producing, by the one or more processors, an output state that includes at least one of a final setup and one or more intermediate stages.
Owner:SOLVENTUM INTELLECTUAL PROPERTIES CO

Thread block scheduling module, general purpose computing graphics processing unit, device and product

The invention provides a thread block scheduling module, a general-purpose computing graphic processing unit, equipment and a product, and relates to the technical field of data process.The method comprises the steps that an operation data analysis unit conducts data analysis on all first thread blocks of a computing task issued by a host, and second thread blocks sharing data with all the first thread blocks are determined; the mapping relation between the first thread block and the second thread block is written into a thread block data mapping table of the queue management unit; the resource management unit is used for recording available resources and used resources of each streaming multiprocessor and information of a thread block currently allocated to each streaming multiprocessor; and the thread block allocation unit is used for allocating the thread blocks of the first target thread block to the corresponding stream multiprocessors according to the thread block data mapping table of the first target thread block under the condition of detecting that any stream multiprocessor recorded by the resource management unit has idle available resources.
Owner:YUANQIXIN (SHANDONG) SEMICONDUCTOR TECHNOLOGY CO LTD

Adaptive scheduling for executing machine learning operations in a multiprocessor computing device

Certain aspects of the present disclosure provide techniques and apparatus for scheduling execution of machine learning model operations on a multiprocessor computing device. The method generally includes during execution of operations in a first portion of a machine learning model on a first processing unit of the computing device, measuring a temperature for each of a plurality of locations on the computing device. It is determined that a temperature measured for the first processing unit exceeds a threshold temperature. Based on one or more operating parameters for the computing device, a second processing unit of the computing device is selected to use in executing operations in a second portion of the machine learning model. Execution of operations in the second portion of the machine learning model on the second processing unit is scheduled.
Owner:QUALCOMM INC

Multi-processor management method and device based on parallel computing chip, and medium

The invention relates to the technical field of parallel computing chips, in particular to a multiprocessor management method and device based on a parallel computing chip and a medium. The method comprises the steps that a plurality of stream processors are organized according to a hierarchical arrangement mode, a hierarchical SM cluster is formed, and each stage of SM core only keeps cache consistency with a lower stage of SM core directly controlled by the SM core; data of an external storage module enters a scheduling core through an L2 cache, and the scheduling core splits the data into thread bundles and dynamically allocates the thread bundles to a target SM core; when the thread processing demand of the target SM core exceeds the current capacity, starting a lower-level SM core according to a preset hierarchy rule, and expanding the processing capacity step by step; and skipping an unprocessed thread bundle over the current SM core through a thread bundle scheduler, splitting the unprocessed thread bundle, transmitting the split unprocessed thread bundle to a lower-level SM core, and merging calculation results of the lower-level SM core step by step through a shared memory. According to the invention, extra resources allocated by the system can be reduced, and the whole system is more efficient and ordered on the basis of ensuring consistency.
Owner:SHANDONG INSPUR SCI RES INST CO LTD

High performance code parallelization compiler with loop level parallelization

PendingCN121464428ACode compilationComputer architectureLoop level parallelism
A symmetric auto-compiler system (1) and method for high performance hardware optimized auto-parallelization of program code (3) executed by a multi-core or multi-processor parallel processing system (2) having a plurality of processing units (21) that simultaneously process instructions for data in the parallel processing system (2) by executing the program code (3). The automatic compiler system (1) converts serial source code (31) of program code (3) into parallel processing machine code (32) comprising a plurality of instructions executable by a plurality of processing units (21) of the parallel processing system (2) or controlling operation of the plurality of processing units (21).
Owner:MINATIX INC

Intelligent edge computing gateway and system of asymmetric multiprocessor architecture

The invention relates to the technical field of gateways, and discloses an intelligent edge computing gateway and system of an asymmetric multiprocessor architecture, and the intelligent edge computing gateway comprises a cloud control center, a cloud control center connection layer, a variable logic matrix, an offline execution management unit, an execution port and a data source. The cloud control center and the cloud control center connection layer are in encrypted communication; and the output end of the cloud control center is in bidirectional signal connection with the input end of the cloud control center connection layer. According to the intelligent edge computing gateway and system of the asymmetric multiprocessor architecture, two processor units with different performance specifications are configured on one integrated circuit PCB to realize separated computing control of a low-level hardware control function and a high-level logic control operation function; and an edge computing processing function and a performance index which need two independent hardware to work together in the past are realized on one hardware carrier.
Owner:GUANGZHOU HEHONG INFORMATION TECHNOLOGY CO LTD

Project management method and device, equipment and storage medium

The invention discloses a project management method, device and equipment and a storage medium, relates to the technical field of cloud, in particular to a management technology of a cloud computing management and control system supporting a multi-architecture processor in a private cloud environment, and is used for reducing project management difficulty and management cost and improving management efficiency when a project is supported to be deployed in a multi-processor architecture environment. The method comprises the steps of obtaining file information associated with a target project; the file information at least comprises a public configuration file and a multi-architecture difference file; wherein the public configuration file is used for storing general configuration information among a plurality of processor architectures; the multi-architecture difference file comprises difference sub-files matched with the processor architectures in the processor architectures respectively, and each difference sub-file is used for storing project deployment information supported by one processor architecture; and based on the public configuration file and the multi-structure difference file, compiling the source code of the target project, and respectively obtaining project deployment files associated with the plurality of processor architectures.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Secure execution for multiple processor devices using trusted executing environments

Apparatuses, systems, and techniques to generate a trusted execution environment including multiple accelerators. In at least one embodiment, a parallel processing unit (PPU), such as a graphics processing unit (GPU), operates in a secure execution mode including a protect memory region. Furthermore, in an embodiment, a cryptographic key is utilized to protect data during transmission between the accelerators.
Owner:NVIDIA CORP

System for auto-parallelization of processing codes for multi-processor systems with optimized latency, and method thereof

A compiler system for optimized compiling of a computer program for execution by a parallel processing system having a plurality of processing units and corresponding method. The compiler system comprises means for translating a source programming language of the computer program into a machine code as target programming language thereby generating an optimized processing code comprising a number of instructions executable by the plurality of processing units of the parallel processing system or controlling the operation of the plurality of processing units.
Owner:MYNATIX AG

Task processing method and system, electronic equipment, storage medium and program product

The invention discloses a task processing method and system, electronic equipment, a storage medium and a program product, and relates to the technical field of computers. The method comprises the following steps: when multiple processors cooperatively execute a to-be-processed task, determining that the to-be-processed task belongs to a communication dominant task according to memory access behavior characteristics of the to-be-processed task, and synchronizing far-end data of each processor to a local far-end data cache space. Reading target read data from the far-end data cache space when the far-end read operation is carried out; when far-end write operation is carried out, target write data written into the target local cache space is written into the local far-end data cache space, and meanwhile corresponding data in the target local cache space is invalid and synchronized to the target local cache space. According to the invention, the problem of low calculation efficiency of multiprocessor cooperative processing tasks in the prior art can be solved, the communication delay of the multiprocessor cooperative processing tasks can be reduced, the efficiency of the multiprocessor cooperative processing tasks is effectively improved, and the task processing performance of the multiprocessor is improved.
Owner:INSPUR (BEIJING) ELECTRONICS INFORMATION IND CO LTD

Periodic directed acyclic graph parallel scheduling method

The invention discloses a periodic directed acyclic graph parallel scheduling method. The core is a method for parallel computing of a periodic directed acyclic graph on a multiprocessor core by using a node sorting and node scheduling algorithm of the periodic directed acyclic graph. The method comprises the following steps: firstly, initializing a periodic directed acyclic graph, setting global simulation parameters, generating an updating sequence of internal nodes according to a topological structure of the periodic directed acyclic graph, and initializing states of the internal nodes; then, calculation of a periodic directed acyclic graph is carried out, simulation time is propelled based on a global scheduler, nodes to be updated are selected according to current global simulation time, and calculation tasks corresponding to the nodes to be updated are calculated in parallel; then waiting for all the nodes to be updated to complete calculation, judging whether simulation is finished or not based on simulation setting and global simulation time, and if the simulation is not finished, repeating the simulation time advancing step; and finally, when the global simulation time meets a simulation ending condition, completing parallel calculation of the periodic directed acyclic graph. In the calculation process of the periodic directed acyclic graph, the periodic directed acyclic graph is scheduled based on the updating sequence of the nodes, the parallelism degree in the calculation process is improved, and therefore the problems that the calculation parallelism degree of the periodic directed acyclic graph is low, and the calculation speed is low are solved.
Owner:BEIHANG UNIV

Access control method and device, equipment and medium

The invention discloses an access control method and device, equipment and a medium, and relates to the technical field of integrated circuits. The method comprises the following steps: setting a corresponding number of semaphore register groups for peripherals needing access management; determining a currently accessed target peripheral and acquiring a lock request initiated for the target peripheral; recording the information of locking the semaphore by using a semaphore register group; triggering a preset release management rule according to the information to sequentially process the lock request; the preset release management rule is used for setting a first priority among the processors, recording different processes of the processors by setting a request queue, and setting a second priority; and sequentially clearing interrupts according to the sequence of the first priority and / or the second priority by utilizing a semaphore interrupt clearing register. According to the technical scheme, the problem that a traditional hardware semaphore scheme cannot process when multiple processors and multiple cores access peripheral competition at the same time can be solved.
Owner:SHANDONG YUNHAI GUOCHUANG CLOUD COMPUTING EQUIP IND INNOVATION CENT CO LTD

SCALE-BASED UNLOADING RATE CALCULATION

An agricultural system comprises: one or more weight sensors that detect the weight of the material in a first material container and generate sensor data indicating this weight; one or more processors; a memory; and computer-executable instructions stored in the memory which, when executed by the one or more processors, configure the one or more processors to: determine a weight change of the material in the first material container based on first sensor data indicating a weight of the material in the first material container at a first time point, and second sensor data indicating a weight of the material in the first material container at a second time point; determine a material overload rate indicating a rate at which a material overloading subsystem overloads material based on the determined weight change;and to determine a material fill level in a second material container based on the specified material overload rate.
Owner:DEERE & CO

Thread block scheduling method and system for universal graphics processor

The invention provides a thread block scheduling method and system for a universal graphics processor, and belongs to the technical field of computational graphics process.The method comprises the steps that a computational task from a host is received, and the computational task comprises at least one thread block; according to the workload of each thread block, all the thread blocks are distributed to at least one thread block queue, and each thread block queue corresponds to one capacity; obtaining the free resource quantity of each streaming multiprocessor in the universal graphics processor; determining a matched thread block queue according to the free resource quantity of any available streaming multiprocessor, extracting thread blocks from the matched thread block queue, and distributing the thread blocks to the available streaming multiprocessors; the available streaming multiprocessors are streaming multiprocessors of which the free resource quantity meets a preset thread block allocation standard. According to the method, a plurality of thread block queues are arranged, and the thread blocks are dynamically selected according to the real-time idle resources of the streaming multiprocessor for fine distribution, so that the overall calculation performance and the operation efficiency of the GPGPU are improved.
Owner:YUANQIXIN (SHANDONG) SEMICONDUCTOR TECHNOLOGY CO LTD

Processing system with interspersed processors DMA-FIFO

Embodiments of a multi-processor array are disclosed that may include a plurality of processors, local memories, configurable communication elements, and direct memory access (DMA) engines, and a DMA controller. Each processor may be coupled to one of the local memories, and the plurality of processors, local memories, and configurable communication elements may be coupled together in an interspersed arrangement. The DMA controller may be configured to control the operation of the plurality of DMA engines.
Owner:HYPERX HOLDINGS LLC

Server

The invention discloses a server, and relates to the technical field of servers, the server comprises at least one mainboard and at least one backboard, each mainboard comprises a central processing unit, the central processing units are mutually independently arranged, each backboard is provided with at least one hard disk, each hard disk is based on a disk sequence of the hard disks, and each hard disk is provided with at least one hard disk. According to the technical scheme, the central processing unit is connected with the nearest central processing unit, so that the central processing units can independently operate and execute the functions of data storage and data operation, the problem of load imbalance existing in the multiple central processing units in the server can be avoided, and the operation efficiency in a multi-processor mode is improved.
Owner:INSPUR SUZHOU INTELLIGENT TECH CO LTD

Multiprocessor system and flow control method of multiprocessor system

The invention relates to a multiprocessor system and a flow control method of the multiprocessor system. Based on the present application, in each segment of port serial link for realizing streaming of data communication of a multiprocessor system, a transmission sender can predict a current transmission reception margin of a transmission receiver according to a transmission reception credit maintained by a home terminal, and the current transmission reception margin of the transmission receiver can be predicted by the transmission sender according to the transmission reception credit maintained by the home terminal. The transmission sender can actively take the flow control measure of stopping data transmission when the transmission receiving credit is in the limit depletion state representing that the transmission receiver has the port blocking risk, so that the port blocking of the transmission receiver is avoided, and the flow transmission congestion is avoided. Compared with a traditional flow control mechanism taking real port blockage of a transmission receiver as a trigger condition, the method has the advantages that the transmission sender performs active flow control based on prediction, and flow control delay when flow transmission congestion occurs does not exist, so that flow transmission packet loss of data communication can be reduced, and the data communication efficiency is improved. To facilitate lossless streaming between processors for data communication.
Owner:广州壁仞智能科技有限公司 +1

Domain Name System Threat Hunting Using Domain Name Tokenization

A computer implemented method analyzes a domain name. A number of processor units identifies the domain name for analysis. The number of processor units splits the domain name into tokens. The number of processor units combines the tokens into different arrangements to form permutated domain names. The number of processor units identifies features for the permutated domain names using a set of domain name databases. The number of processor units analyze the permutated domain names with the features to determine a maliciousness of the domain name.
Owner:INTERNATIONAL BUSINESS MACHINE CORPORATION

Concurrent data transmission

For concurrent data transmission, an example method includes acquiring a processor utilization rate related to transmission of historical data packet(s) and a bandwidth utilization rate of a data link within a target time period. A time consumption for transmitting a target data packet, a splitting processing resource related to a splitting operation, and a packaging processing resource related to a packaging operation are determined. Based on the processor utilization rate, the bandwidth utilization rate, the time consumption, the splitting processing resource, and the packaging processing resource, a split number is determined for the target data packet to concurrently transmit the target data packet. In this way, a data transmission speed can be improved, time consumed for transmitting the target data packet can be reduced, and meanwhile, it can also alleviate problems such as excessive processing resource consumption and overloaded operation of the processor caused by concurrent transmission.
Owner:DELL PROD LP

GPGPU (General Purpose Graphics Processing Unit) thread block synchronization method and equipment based on thread lock and medium

The invention discloses a GPGPU thread block synchronization method and device based on a thread lock and a medium, and relates to the technical field of electric digital data processing. The method comprises the following steps: a thread block scheduling module allocates thread blocks for each stream multiprocessor and calculates a thread start ID (Identity) to maintain a corresponding thread lock table; analyzing whether a dependency relationship exists between the memory access request and a thread in the currently occupied thread block or not under the condition that the memory access requirement exists, and if yes, adding the memory access request with the dependency relationship to a lock queue; querying a thread lock state of a thread having a dependency relationship with the memory access request in a corresponding thread lock table so as to add the thread lock state to an entry state corresponding to the lock queue; and dequeuing the memory access request from the lock queue under the condition that the entry states of all the threads with the entries in the lock queue and the thread bundle having the dependency relationship are unlocked, and performing memory access according to the memory access request to realize synchronization of GPGPU thread blocks.
Owner:YUANQIXIN (SHANDONG) SEMICONDUCTOR TECHNOLOGY CO LTD