Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

133 results about "Uniform memory access" patented technology

Uniform memory access (UMA) is a shared memory architecture used in parallel computers. All the processors in the UMA model share the physical memory uniformly. In an UMA architecture, access time to a memory location is independent of which processor makes the request or which memory chip contains the transferred data. Uniform memory access computer architectures are often contrasted with non-uniform memory access (NUMA) architectures. In the UMA architecture, each processor may use a private cache. Peripherals are also shared in some fashion. The UMA model is suitable for general purpose and time sharing applications by multiple users. It can be used to speed up the execution of a single large program in time-critical applications.

Resource adjustment method and apparatus, electronic device, storage medium and training platform

Disclosed in the present application are a resource adjustment method and apparatus, an electronic device, a storage medium and a training platform, which are applied to the technical field of artificial intelligence. The method comprises: acquiring a container set of computing nodes executing a task to be trained and a container associated with same; on the basis of resource configuration information of the container set, resource occupation information of the computing nodes and user resource requirements, and in a mode that target graphics processing unit and target central processing unit cores executing said task are preferentially located in the same non-uniform memory access group, selecting target central processing unit cores needing to be bound for the container, and updating configuration information of a process group corresponding to the container, so as to complete binding of the central processing unit cores and the container. The present application can solve the problem that AI training tasks cannot be efficiently completed in the related art, and can maximally ensure the efficient completion of AI training tasks by means of resource adjustment during the execution of the AI training tasks.
Owner:INSPUR SUZHOU INTELLIGENT TECH CO LTD

Chip system and access method

The invention provides a chip system and an access method, relates to the technical field of chips, and improves the data access performance of a high-performance computing system. According to the specific scheme, the chip system comprises a snoop filter, a plurality of processor cluster nodes and a plurality of memories, the processor cluster nodes are coupled through a bus, the snoop filter is coupled with the bus, the processor cluster nodes are in one-to-one correspondence with the memories, and the snoop filter adopts a unified directory format. The snoop filter is used for obtaining an access request initiated by the processor cluster node, and the access request comprises address information. The snoop filter is further used for determining an access mode of the access request based on the address information, wherein the access mode comprises a unified memory access mode and a non-unified memory access mode. The processor cluster node is to access the memory based on the access pattern and the access request. The embodiment of the invention is used for the process of accessing the memory by the processor cluster node.
Owner:HUAWEI TECH CO LTD

Task scheduling method, task scheduling system, and computer storage medium

A task scheduling method, a task scheduling system, and a computer storage medium. The method is used for scheduling a directed acyclic graph on a non-uniform memory access architecture and comprises the following steps: selectively segmenting the directed acyclic graph according to hardware information of the non-uniform memory access architecture and characteristic information of the directed acyclic graph; performing a clustering operation on the segmented directed acyclic graph by using a target function constructed on the basis of load balancing, so as to divide the segmented directed acyclic graph into a plurality of tasks; and generating a multi-level task scheduling strategy on the basis of the allocation of the plurality of tasks on the non-uniform memory access architecture, and sending the multi-level task scheduling strategy to the non-uniform memory access architecture, so that the non-uniform memory access architecture performs distribution and execution of the plurality of tasks according to the multi-level task scheduling strategy.
Owner:NIO SMART TECHNOLOGY (SHENZHEN) CO LTD +1

Hard disk test method, device and equipment and readable storage medium

The invention relates to the technical field of storage, in particular to a hard disk testing method, device and equipment and a readable storage medium. The method comprises the steps that mapping information of a hard disk and an access node is acquired; wherein the access node is a node in a non-uniform memory access architecture; determining whether the number of hard disks distributed to the access node is balanced by using the mapping information; if not, adjusting the number of the hard disks allocated to the access node, and returning to obtain the mapping information of the hard disks and the access node again; and if yes, allocating the same number of processors to the hard disk in the access node, and then testing the hard disk based on the non-consistent memory access architecture. According to the invention, after resource balanced allocation is satisfied, hard disk testing is carried out on the non-consistent memory access architecture, so that efficient processing of read-write operation on a processor level can be ensured, detection of individual disks is prevented from being inconsistent with reality, and the accuracy of hard disk testing can be ensured.
Owner:INSPUR SUZHOU INTELLIGENT TECH CO LTD

Interrupt scheduling method, apparatus and device, and computer readable storage medium

The invention discloses an interrupt scheduling method, device and equipment and a computer readable storage medium, and is applied to the technical field of non-uniform memory access, and the method comprises the following steps: obtaining system load prediction data corresponding to a non-uniform memory access system; dynamically adjusting the interrupt scheduling strategy based on the system load prediction data to obtain a target interrupt scheduling strategy; and determining a target interrupt processing device corresponding to each interrupt based on the target interrupt scheduling strategy, and processing each interrupt based on the target interrupt processing device. Compared with a traditional method for scheduling the interrupt based on a static scheduling strategy, the method has the advantages that the target interrupt scheduling strategy is obtained by obtaining the system load prediction data and dynamically adjusting the interrupt scheduling strategy based on the system load prediction data, so that the interrupt is scheduled based on the adjusted interrupt scheduling strategy; intelligent and dynamic interrupt scheduling is realized, and the accuracy of interrupt scheduling is improved.
Owner:INSPUR SUZHOU INTELLIGENT TECH CO LTD

Application programming interface to indicate storage

Apparatuses, systems, and techniques to indicate whether one or more storages correspond to one or more non-uniform memory access (NUMA) storages. In at least one embodiment, one or more circuits are to perform an application programming interface (API) to indicate whether one or more storages indicated by one or more users of the API corresponds to one or more NUMA storages or one or more graphics processing unit (GPU) storages.
Owner:NVIDIA CORP

Bringing NUMA awareness to load balancing in overlay networks

Some embodiments provide a novel method for forwarding data messages between first and second host computers. To send, to a first machine executing on the first host computer, a flow from a second machine executing on the second host computer, the method identifies a destination network address of the flow. The method uses the identified destination network address to identify a particular tunnel endpoint group (TEPG) including a particular set of one or more tunnel endpoints (TEPs) associated with a particular non-uniform memory access (NUMA) node of a set of NUMA nodes of the first host computer. The particular NUMA node executes the first machine. The method selects, from the particular TEPG, a particular TEP as a destination TEP of the flow. The method sends the flow to the particular TEP of the particular NUMA node of the first host computer to send the flow to the first machine.
Owner:VMWARE INC

Method and apparatus of data processing, electronic device and storage medium

Embodiments of the disclosure provide a method and an apparatus of data processing, an electronic device and a storage medium. The method includes receiving first access data transmitted by at least one client, the first access data representing an instruction log of a remote direct data read instruction transmitted by the client for target data cached in a non-uniform memory access structure; obtaining a data popularity of the target data based on the first access data, the data popularity representing a frequency of the target data accessed by the remote direct data read instruction; and based on the data popularity of the target data, caching the target data to a target location in a data storage unit implemented based on the non-uniform memory access structure, or migrating the target data out of the data storage unit, wherein the target location has a data read-write speed corresponding to the data popularity.
Owner:BEIJING VOLCANO ENGINE TECH CO LTD

Dynamically processing data message flows using different NUMA nodes of a processing system

Some embodiments provide a novel method for dynamically processing data message flows using different non-uniform memory access (NUMA) nodes of a processing system. Each NUMA node includes a memory and processors that can access data other memories of other NUMA nodes. A load balancing application associated with a first NUMA node receives flows destined for an endpoint application. The flows are assigned to the first NUMA node to be forwarded to the endpoint application. The load balancing application monitors a central processing (CPU) usage of the first NUMA node to determine whether the CPU usage of the first NUMA node exceeds a particular threshold. When the CPU usage of the first NUMA node exceeds the particular threshold, the load balancing application reassigns at least a subset of the flows to the second NUMA node for processing.
Owner:VMWARE INC

Method for optimizing user mode program processing speed under NUMA architecture

The invention relates to the technical field of computers, in particular to a method for optimizing the processing speed of a user mode program under an NUMA architecture. The method comprises the steps that in response to the optimization requirement of a user for the processing speed of an original file, first mark information representing the optimization requirement is added in the original file, a target file is generated, and the original file is a user mode program file; registering an interpreter corresponding to the target file; when a starting request corresponding to a target file is received and the starting request is scheduled to the non-uniform memory access node, calling an interpreter to process the target file to obtain a file copy; loading the file copy to a cache space of the non-uniform memory access node; according to the scheme, when the target file is executed, local access can be directly performed, so that delay and performance overhead caused by cross-node access are avoided, and the reading speed and the processing efficiency of the file copy are improved; and while the function complexity is reduced, the system stability is improved, and the system is easier to maintain and manage.
Owner:CHINA ELECTRONICS CLOUD DIGITAL INTELLIGENCE TECH CO LTD

Application programming interface to cause information to be read from a location

Apparatuses, systems, and techniques to cause information to be read from one or more non-uniform memory access (NUMA) storages. In at least one embodiment, one or more circuits are to perform an application programming interface (API) to cause information to be read from one or more NUMA storages or one or more graphics processor unit (GPU) physical storages based, at least in part, on one or more indicators to be indicated by one or more users of the API.
Owner:NVIDIA CORP

Data stream processing method and device, electronic equipment and storage medium

The invention discloses a data stream processing method and device, electronic equipment and a storage medium, and relates to the technical field of distributed storage. According to the data stream processing method and device, the data stream transmission mode is pre-judged to be intra-node transmission or cross-node transmission based on a hardware topology mapping table, and read-write caches are dynamically allocated according to the pre-judged data stream transmission mode; data received by the front-end network card is directly written into a controller memory buffer area of the target equipment through point-to-point direct memory access for data streams transmitted in the nodes, and is read and forwarded from the target equipment by the rear-end network card; the sending cache and the receiving cache of the data stream transmitted across the nodes are locked to the non-uniform memory access node to which the target network card belongs, and the data are sent to the target node through the remote direct memory access register memory, so that the problem that the data stream processing is not optimized in combination with hardware topology characteristics can be solved; the technical effects of reducing data replication overhead, avoiding redundant access across hardware nodes, improving data stream transmission efficiency and realizing end-to-end zero replication transmission are achieved.
Owner:JINAN INSPUR DATA TECH CO LTD

Application programming interface to access non-uniform memory access nodes

The invention discloses an application programming interface for accessing non-uniform memory access nodes. Apparatuses, systems, and techniques for accessing one or more non-uniform memory access (NUMA) nodes are disclosed. In at least one embodiment, one or more circuitry is to execute an application programming interface (API) such that one or more NUMA nodes or one or more physical addresses assigned to one or more graphics processing units (GPUs) are accessed based at least in part on one or more indications within the API.
Owner:NVIDIA CORP

Data transmission method, system and device and storage medium

The invention discloses a data transmission method, system and device and a storage medium, is applied to a host end in a non-uniform memory access architecture, and relates to the technical field of data transmission, and the method comprises the steps that a target path mapping table from a target end is received and analyzed, and a plurality of monitoring entrances are obtained; based on the target path mapping table, establishing a plurality of connection paths corresponding to the plurality of monitoring entrances in sequence, and generating a connection pool; in response to a data read-write request generated by the host end for a target end, determining a target processor domain corresponding to the target storage unit according to the target path mapping table, and selecting a connection path associated with the target processor domain from the connection pool as a current read-write path; and monitoring and judging whether the current read-write path is available or not, and if not, reselecting. The data transmission method can be combined with NUMA architecture perception, path state monitoring and a policy-driven selection mechanism to at least solve the problems that in the prior art, path selection lacks topology perception and multiple network cards are difficult to aggregate and use.
Owner:JINAN INSPUR DATA TECH CO LTD

Techniques associated with mapping system memory physical addresses to isolation domains for uniform memory access by a system

Examples include techniques associated with mapping system memory physical addresses to isolation domains for uniform memory access (UMA) by a system. Examples include mapping separate system memory physical addresses ranges associated with memory devices communicatively coupled with at least one compute die of the system through an input / output (I / O) die of the system. The separate system memory physical addresses to be mapped to isolation domains and address decoder information is generated to indicate the mapping of the separate system memory physical address ranges to the isolation domains.
Owner:INTEL CORP

Application programming interface to access non-uniform memory access nodes

Apparatuses, systems, and techniques to access one or more non-uniform memory access (NUMA) nodes. In at least one embodiment, one or more circuits are to perform an application programming interface (API) to cause one or more NUMA nodes or one or more physical addresses allocated to one or more graphics processing units (GPUs) to be accessed based, at least in part, on one or more indications within the API.
Owner:NVIDIA CORP

Task processing method and system, electronic equipment, medium and product

The invention discloses a task processing method and system, electronic equipment, a medium and a product, and relates to the technical field of high-performance computing. When the tasks with different priorities exist at the same time, the first type of tasks, namely the tasks with high priorities, are preferentially issued to the first type of execution queue in the scheduling domain in the node, and the processor core in the node executes the tasks according to the priority sequence of the execution queue. The first type of tasks in the first type of execution queue are ensured to be issued and executed; secondly, the task acquired by the processor core in the scheduling domain is issued by the node, and there is no need to fight for the same task by multiple cores, so that the task does not need to be locked, and the task processing efficiency and the system performance are improved; and thirdly, the tasks are issued in the non-uniform memory access architecture nodes, and the processor cores in the scheduling domains corresponding to the non-uniform memory access architecture nodes are utilized to execute the tasks, so that the performance loss of memory access across the non-uniform memory access architecture nodes is avoided.
Owner:LANGCHAO ELECTRONIC INFORMATION IND CO LTD

Network performance optimization method and optimization device

The invention discloses a network performance optimization method and device, and is applied to a server system of a multi-non-uniform memory access node architecture, and the network performance optimization method comprises the steps: obtaining non-uniform memory access node information loaded by an operating system kernel and non-uniform memory access node information where a network card is located; if it is judged that the non-uniform memory access node loaded by the operating system kernel is the same as the non-uniform memory access node where the network card is located, checking the interrupt request binding condition of the network card; according to the interrupt request binding condition of the network card, if the interrupt request of the network card is not bound to the CPU core of the non-uniform memory access node where the network card is located, binding the interrupt request of the network card to the CPU core of the non-uniform memory access node where the network card is located.
Owner:LENOVO (BEIJING) LTD

Resource allocation method and device for non-uniform memory access and memory access method and device

The invention discloses a resource allocation method for non-uniform memory access and a memory access method and device, and relates to the technical field of non-uniform memory access. The resource allocation method comprises the following steps: determining a first target selected node set according to a first initial non-uniform memory access resource node of a received non-uniform memory access resource; traversing all initial non-consistent memory access resource nodes of the non-consistent memory access resources to determine all target selected node sets; determining a target selected node set meeting a target memory resource demand and a first preset condition in all target selected node sets as a target non-consistent memory access resource node set; and distributing the target non-uniform memory access resource node set to the executor with the target memory resource demand. According to the method, the target non-uniform memory access resource node set closest to the target selected node set is allocated to the executor, so that the delay of the executor at different NUMA nodes can be reduced.
Owner:启元实验室

Method and apparatus of data processing, electronic device and storage medium

Embodiments of the disclosure provide a method and an apparatus of data processing, an electronic device and a storage medium. The method includes receiving first access data transmitted by at least one client, the first access data representing an instruction log of a remote direct data read instruction transmitted by the client for target data cached in a non-uniform memory access structure; obtaining a data popularity of the target data based on the first access data, the data popularity representing a frequency of the target data accessed by the remote direct data read instruction; and based on the data popularity of the target data, caching the target data to a target location in a data storage unit implemented based on the non-uniform memory access structure, or migrating the target data out of the data storage unit, wherein the target location has a data read-write speed corresponding to the data popularity.
Owner:BEIJING VOLCANO ENGINE TECH CO LTD

Server and application aware NUMA-based load-balancing solution

Some embodiments provide a novel method for processing data message flows using several non-uniform memory access (NUMA) nodes of a processing system. Each NUMA node includes a local memory and a set of processors that can access data from local memories of other NUMA nodes. A load balancing application associated with a first NUMA node receives a data message flow destined for an endpoint application. The load balancing application determines whether the first NUMA node should perform a middlebox service operation on the data message flow that is destined to the endpoint application. Based on a determination that the first NUMA node should not process the data message flow, the load balancing application directs the data message flow to a second NUMA node for performing the middlebox service operation.
Owner:VMWARE INC

Non-uniform memory access resource allocation method based on parallel adaptive auction algorithm

The invention discloses a non-uniform memory access resource allocation method based on a parallel adaptive auction algorithm, and the method comprises the following steps: obtaining node information and task information in a non-uniform memory access architecture when an operating system is started; and regarding a resource problem of the non-uniform memory access architecture as a knapsack problem with position constraint, and performing optimization solution by adopting a parallel adaptive auction algorithm to obtain an allocation result. According to the method, the economics theory and the computer science are combined, the tasks are enabled to perform autonomous bidding on the resources under the auction mechanism, and meanwhile, the problem is effectively decomposed into independent parallel computing sub-problems, so that the bidding strategies of the tasks are mutually independent, and more effective and efficient allocation of the memory resources is realized; when resources are subjected to autonomous bidding, the DQN model is combined with advertiser strategy solution under an auction mechanism, so that the stability of the DQN model is improved, autonomous decision-making of tasks based on local information is realized, and therefore, dispersed and efficient resource allocation is realized.
Owner:HARBIN INSTITUTE OF TECHNOLOGY (SHENZHEN) (INSTITUTE OF SCIENCE AND TECHNOLOGY INNOVATION HARBIN INSTITUTE OF TECHNOLOGY SHENZHEN)

Resource load balancing method and device, electronic equipment and storage medium

The invention provides a resource load balancing method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring a non-uniform memory access (NUMA) topological structure of a virtual machine, wherein the NUMA topological structure of the virtual machine comprises the number of target nodes and required resources; screening out a plurality of tuples satisfying the NUMA topological structure of the virtual machine from the NUMA topological structure of the host machine, wherein the number of nodes of the tuples is the same as the number of the target nodes; calculating a weighted value of each tuple according to a preset weight calculation rule, wherein the weighted value is a weight set value of residual resources of each node in the tuple; all the tuples are arranged in a descending order according to the weighted values, a descending order queue is generated, the tuple at the head of the descending order queue is confirmed to be a resource node of the NUMA topological structure of the virtual machine, the virtual machine is scheduled to the resource node, and load balanced distribution on the NUMA NODE is achieved.
Owner:CHINA UNITED NETWORK COMM GRP CO LTD +2

Application programming interface for storing information

The invention discloses an application programming interface for storing information. Apparatuses, systems, and techniques for storing information within one or more non-uniform memory access (NUMA) stores are disclosed. In at least one embodiment, one or more circuitry is to execute an application programming interface (API) such that information is stored within one or more NUMA stores or one or more graphics processing unit (GPU) physical stores based at least in part on one or more indicators to be indicated by one or more users of the API.
Owner:NVIDIA CORP

Log data processing method, device and equipment for memory access node

The invention provides a log data processing method, device and equipment for a memory access node. The processing method comprises the following steps: acquiring a plurality of log threads which are started at present; dividing the plurality of log threads into N log thread groups according to the number N of non-uniform memory access nodes; obtaining a first preset number of target log file data to be operated by at least one log thread of the N consistent memory access nodes; distributing a global log sequence number for the first preset number of target log file data, wherein the global log sequence number is a log sequence number generated according to all log data in the N log thread groups; and according to a global log sequence number corresponding to the target log file data, writing a first preset quantity of target log file data to be operated by the at least one log thread into a local memory of the non-uniform memory access node. According to the embodiment of the invention, cross-node remote access can be avoided; and the memory access delay is obviously reduced.
Owner:BEIJING QUICK CUBE TECH CO LTD

Package-on-package with different types of memory

Various embodiments may include a Package on Package (PoP) having a bottom package comprising a system-on-chip (SoC) and a bottom substrate, a top package comprising a top substrate, a first memory die, and a second memory die, wherein the first and second memory dies are different in at least one of: memory type, memory density, or memory capacity, an interposer electronically connecting the top package and the bottom package, and a heat sink covering at least a portion of the top package. The SoC may include a non-uniform memory access (NUMA) mechanism configured to manage data interleaving, memory write requests, memory access requests across the first and second memory dies.
Owner:QUALCOMM INC

NUMA node virtual machine provisioning system

A Non-Uniform Memory Access (NUMA) node virtual machine provisioning system includes a connection system and a physical NUMA node coupled to a NUMA node virtual machine provisioning subsystem that modifies NUMA node information in at least one database to create a first virtual NUMA node that is provided by a first subset of NUMA node resources in the physical NUMA node, modifies connection system information in the at least one database to dedicate a first subset of connection system resources in the connection system to the first virtual NUMA node, and deploys a first virtual machine on the first virtual NUMA node such that the first virtual machine performs operations using the first subset of NUMA node resources that provide the first virtual NUMA node, and using the first subset of connection system resources dedicated to the first virtual NUMA node.
Owner:DELL PROD LP

Virtual non-uniform memory access (NUMA) locality table for NUMA systems

Various approaches for exposing a virtual Non-Uniform Memory Access (NUMA) locality table to the guest OS of a VM running on NUMA system are provided. These approaches provide different tradeoffs between the accuracy of the virtual NUMA locality table and the ability of the system's hypervisor to migrate virtual NUMA nodes, with the general goal of enabling the guest OS to make more informed task placement / memory allocation decisions.
Owner:VMWARE INC

A process scheduling method, device, storage medium and computer program product

The application discloses a process scheduling method and device, a storage medium and a computer program product, and relates to the technical field of computers. The method comprises the following steps: counting resource demand indexes of processes; wherein the resource demand indexes comprise any one or a combination of several of the following: processor peak usage, memory growth rate, and input / output burst coefficient; performing behavior mode analysis on the processes to determine behavior mode indexes of the processes; wherein the behavior mode indexes comprise lock contention time and / or non-uniform memory access penalty value; generating dynamic priorities of the processes according to the resource demand indexes and the behavior mode indexes of the processes; and scheduling based on the dynamic priorities of the processes. The application improves the real-time performance and flexibility of process scheduling.
Owner:LANGCHAO ELECTRONIC INFORMATION IND CO LTD

Migrating memory pages between non-uniform memory access (NUMA) nodes based on entries in a page modification log

Memory pages can be migrated between non-uniform memory access (NUMA) nodes based on entries in a page modification log according to some examples described herein. In one example, a physical processor can detect a request from a virtual machine to access a memory page. The physical processor can then update a page modification log to include an entry indicating the request. A hypervisor supporting the virtual machine can be configured to detect the request based on the entry in the page modification log and, in response to detecting the request, migrate the memory page from a second NUMA node to a destination NUMA node.
Owner:RED HAT INC