4258results about "Image memory management" patented technology

The invention discloses a method for automatically drawing an OpenGL (Open Graphics Library) program by using Vulkan. The method comprises the following steps of: creating a context used by the Vulkan, initializing each module, processing an OpenGL instruction related to texture and data buffering, and managing storage of texture and data buffering resources in a video memory; a shader program used by the OpenGL is preprocessed into a format acceptable to Vulkan, and an OpenGL shader program instruction is created and destroyed; processing an OpenGL (Open Graphics Library) instruction related to frame buffering to generate structural body information required by Vulkan dynamic rendering; an OpenGL instruction of the sampler is also created; processing an OpenGL (Open Graphics Library) instruction for creating a vertex input format and managing a vertex data buffer area, and maintaining vertex input information, a vertex buffer area and an index buffer area required by Vulkan; and finally, drawing or calculating, distributing and calling Vulkan on the basis of all the instructions.

Apparatuses, systems, and techniques to train neural networks. In at least one embodiment, a first neural network is trained to match accuracy of a second neural network independently of outputs of the second neural network based on, for example, a third neural network that generates weights for the first neural network.

The invention discloses a point cloud data processing method and device, a storage medium and electronic equipment. The method comprises the following steps: acquiring initial point cloud data to be sent; dividing the initial point cloud data into a group of point cloud blocks; performing graphical representation on the basis of the point cloud data in each point cloud block in the group of point cloud blocks to generate a group of graph structure data, one graph structure data in the group of graph structure data corresponding to one point cloud block in the group of point cloud blocks, and the graph structure data being used for representing features of the corresponding point cloud block; and encoding the group of graph structure data to obtain a group of data packets, and sending the group of data packets to a target terminal so as to perform decoding reconstruction at the target terminal to obtain target point cloud data. The technical problems that the processing efficiency of the point cloud data is low and the effect cannot be quickly achieved in the related technology are solved.

Systems and methods for improving cache efficiency and utilization are disclosed. In one embodiment, a graphics processor includes processing resources to perform graphics operations and a cache controller of a cache memory that is coupled to the processing resources. The cache controller is configured to set an initial aging policy using an aging field based on age of cache lines within the cache memory and to determine whether a hint or an instruction to indicate a level of aging has been received.

The invention discloses a Direct3D memory model compatible method based on adaptive placeholder resources, which comprises the following steps: establishing resource metadata, accessing a scene library, checking an instruction template and double sandboxes when a DXVK is started, describing related resources by the DXVK through the metadata after a D3D application is started, completing resource mapping and metadata dynamic updating, and allocating the resources to the corresponding sandboxes; the DXVK compiles an application shader code, identifies a resource access instruction, matches an access scene and a check template by combining a pipeline stage and binding slot query metadata, instantiates the check instruction and adds the check instruction to the front of a target instruction; according to the unbound resources, adaptive generation of corresponding occupied resources is carried out, the authority and the state are configured, the unbound resources are bound to a Vulkan descriptor set to replace VKNULLHANDLE, and adaptation of the shader interface and the pipeline state parameters is completed to create PSO (Particle Swarm Optimization); and intercepting an application rendering instruction analysis parameter to construct a command buffer area, submitting the command buffer area to a Vulkan queue to trigger a GPU (Graphic Processing Unit) to execute rendering, and finally completing complete conversion and adaptation from the D3D rendering logic to the Vulkan.

An apparatus to facilitate lossless and lossy automatic hardware compression in graphics-to-graphics network links is disclosed. The apparatus includes compressor / decompressor circuitry (CDC) integrated with physical layer (PHY) intellectual property (IP) hardware circuitry for a graphics processor unit (GPU)-to-GPU communication link communicably coupling a first GPU to one or more other GPUs, the CDC to: receive a data message from the first GPU, wherein the data message is in an uncompressed format; determine that a compression process is to be applied to the data message; apply the compression process to the data message to generate a compressed data message; and cause a GPU link IP hardware circuitry that comprises the PHY IP hardware circuitry to transmit the compressed data message over the GPU-to-GPU communication link.

Provided in the present disclosure are a data processor, a data processing method, an electronic device and a non-transitory computer-readable storage medium. The data processor comprises a tensor operation unit and N compute units, wherein the tensor operation unit is configured to execute tensor computation on input data, so as to obtain tensor computation results; and the N compute units are configured to execute at least one of a vector operation of the tensor computation results and the generation of input data, wherein first data transmission channels are provided between the tensor operation unit and at least some compute units among the N compute units, and the first data transmission channels are used for directly providing the tensor computation results to the compute units, and directly providing the input data from the compute units to the tensor operation unit. By means of the data processor, access to a global memory can be reduced, the waste of resources is reduced, the data transmission delay is shortened, the overall efficiency of operators is significantly improved, the strong computing power of a tensor operation unit itself is effectively used, and the computation efficiency of the data processor is improved.

The invention discloses an image processing data analysis platform based on a memristor storage and calculation integrated architecture, and relates to the technical field of data identification, and the platform comprises an XC7Z020 FPGA control module which is connected with an OV5640 camera image acquisition module, a memristor array calculation module and an Internet of Things module. According to the image processing data analysis platform based on the memristor storage and calculation integrated architecture, through deep fusion of the memristor storage and calculation integrated architecture and a dynamic optimization technology, the speed, energy efficiency and reliability of image processing are remarkably improved. The data handling bottleneck of the traditional von Neumann architecture is eliminated, the processing speed is improved compared with that of the traditional GPU scheme, and meanwhile, the system energy consumption is reduced. Weight distribution and fragmentation processing strategies are adjusted through real-time feature feedback, so that the recognition accuracy in a complex industrial scene is improved, the throughput is broken through, and the real-time processing requirement of a high-resolution image is met.

The embodiment of the invention provides an information mapping method for intelligent perception information in a virtual space, perception data is acquired by deploying a multi-sensor array, data features are extracted based on a multi-scale feature pyramid and an attention mechanism, and a space mapping relation is established by using self-supervised learning and geometric constraints. Local data blocks are organized by adopting a hierarchical index tree based on a union search set, an adaptive calculation flow graph is constructed to realize efficient mapping, and data transmission is optimized in combination with predictive caching and a differential updating strategy. And meanwhile, parallel processing of incremental mapping is realized through a pipeline data channel, and the data synchronization efficiency is ensured by a dynamic scheduling mechanism based on load prediction. The method effectively solves the problem of performance bottleneck when a traditional mapping scheme processes large-scale multi-source sensing data.

A hierarchical network enables access for a stacked memory system including or more memory dies that each include multiple memory tiles. The processor die includes multiple processing tiles that are stacked with the one or more memory die. The memory tiles that are vertically aligned with a processing tile are directly coupled to the processing tile and comprise the local memory block for the processing tile. The hierarchical network provides access paths for each processing tile to access the processing tile's local memory block, the local memory block coupled to a different processing tile within the same processing die, memory tiles in a different die stack, and memory tiles in a different device. The ratio of memory bandwidth (byte) to floating-point operation (B:F) may improve 50× for accessing the local memory block compared with conventional memory. Additionally, the energy consumed to transfer each bit may be reduced by 10×.

One embodiment provides a graphics processor comprising a memory interface and a graphics core cluster including a plurality of graphics cores and tensor processing circuitry. The tensor processing circuitry includes a local memory, a tensor accelerator coupled with the local memory, the tensor accelerator configured to perform a matrix multiply and accumulate operation, and a tensor data movement accelerator configured to asynchronously transfer tensor data between a global memory coupled to the memory interface and the local memory. The tensor data movement accelerator includes circuitry configured to translate the tensor data from a first tensor format to a second tensor format.

Apparatuses, systems, and techniques to cause information to be invalidated in a second cache location after information is stored in a first cache location. In at least one embodiment, one or more circuits are to perform an application programming interface (API) to cause information to be invalidated in a second cache location after information is stored in a first cache location.

Apparatuses, systems, and techniques to perform one or more operations using a tensor. In at least one embodiment, one or more circuits are to perform an application programming interface (API) to perform one or more operations using one or more tensors based on at least one or more indications of the plurality of operations by the API, one or more compiler options indicated by the API, and / or one of one or more indications of an amount of storage to be used to perform the one or more operations.

The invention discloses rendering equipment based on three-dimensional Gaussian sputtering. The hardware architecture includes a memory interface, a pre-processing engine, a cardinality ordering engine, a rasterization engine, and the like. The preprocessing engine converts the three-dimensional Gaussian point into a two-dimensional representation and generates a key value pair containing a tile identifier and depth information; the cardinal number sorting engine performs staged efficient sorting through a parallel processing mechanism and a BRAM alternate working mode; and the rasterization engine performs rendering processing by adopting a full-pipeline design and an early-stage stopping mechanism. According to the method, parallel execution of depth sequencing and rasterization is achieved, memory access and calculation redundancy are reduced through optimized data flow design, an efficient and low-power-consumption hardware acceleration solution is provided for three-dimensional Gaussian sputtering rendering, and the method is particularly suitable for application scenes such as virtual reality, games and scientific visualization requiring real-time rendering.

Apparatus and method for efficient storage of BVH nodes in blocks. For example, one embodiment of an apparatus comprises: bounding volume hierarchy (BVH) construction circuitry to construct a BVH based on primitives of a graphics scene; and block allocation hardware logic coupled to or integral to the BVH construction circuitry, the block allocation hardware logic to allocate a plurality of nodes of the BVH into a plurality of blocks for storage in a cache or memory subsystem, the block allocation hardware logic to maximize a number of blocks which include a leading parent node and one or more corresponding child nodes of the plurality of nodes.

The invention relates to a digital twin platform GPU rendering resource dynamic scheduling method and system, and the method comprises the steps: S1, collecting a rendering task feature signal of a current frame in real time, and collecting a GPU multi-dimensional resource consumption signal; s2, based on the rendering task feature signal, the historical resource consumption signal and the scene dynamic change signal, generating a GPU resource demand prediction signal and a load fluctuation trend signal of a future frame; s3, predicting a signal, a task dependency relationship signal, a user priority signal and a real-time resource bottleneck type signal according to the GPU resource demand; s4, executing the dynamic resource allocation instruction signal; and S5, generating a parameter self-optimization signal for updating the prediction and scheduling logic of a subsequent frame according to the actual resource consumption signal of the current frame and the scheduling effect evaluation signal. According to the dynamic scheduling method and system for the GPU rendering resources of the digital twin platform, the problem that the GPU resource utilization rate is low and the real-time performance is difficult to consider at the same time under the dynamic load can be solved.

Systems and methods for efficient memory management during ray tracing are described. A ray tracing system assigns a memory stack to a ray. The ray, when intersection tested against objects of a node, accesses data that is stored in the memory stack. When data is to be consumed from the memory stack by the ray, the ray tracing system uses a memory pointer associated with the ray to locate the requested data. When data is to be stored to the memory stack, the memory allocation circuitry stores data in a free memory block and uses a linked list to link the memory block with other memory blocks storing additional data for the ray.

The invention discloses a multi-thread and LOD-based point cloud rendering method, and relates to the field of video rendering, and the method comprises the steps: dividing point cloud data into n data blocks; calculating an initial position of each data block in the point cloud file, and creating n threads; extracting m pieces of LOD point cloud data with different levels of detail from the octree of each data block; calculating the proportion # imgabs0 # of the size of the current point cloud in a rendering viewport and the distance # imgabs1 # from a viewpoint to a camera, and calculating the detail level # imgabs4 # of the current to-be-rendered LOD point cloud according to a preset viewport proportion threshold value # imgabs2 # and a preset sight distance threshold value # imgabs3 #; according to # imgabs5 #, selecting point cloud data of a corresponding detail level from the m pieces of LOD point cloud data; for each interactive operation event, parallel coordinate transformation and illumination calculation are carried out on the LOD point cloud data to be rendered currently in different threads; submitting a calculation result to a renderer for rendering; aiming at low rendering efficiency in the prior art, the method and the device can efficiently render large-scale point cloud data.

The invention provides a high-resolution machine vision detection method and system for precise chromatic aberration detection and a medium, and the method comprises the steps: carrying out the calibration of a camera based on a camera calibration tool, and synchronously calibrating a light source parameter and a color parameter; setting shooting parameters based on the calibrated camera, obtaining a workpiece image in real time, preprocessing the workpiece image, mapping the preprocessed image to a standard color space from an original RGB space, and extracting color features of the preprocessed image; comparing the color feature with the color feature of the standard sample, calculating a color difference index, and comparing with the color difference index based on a set color difference threshold to obtain a detection result; by calibrating various parameters of the camera, the visual detection precision is ensured, and by performing color space mapping on the workpiece image and analyzing the difference between the color difference index of the color feature and the color difference threshold value, the color abnormal area is accurately analyzed, and the detection precision of the abnormal color is improved.

The invention discloses a multi-cluster heterogeneous computing power scheduling method oriented to an AI training reasoning task, and belongs to the technical field of computers. According to a scheduling mechanism with issuing of the AI task as a core, the state of a resource pool is monitored in real time, resources are dynamically allocated, it is ensured that the AI task is efficiently executed, the use efficiency of the whole resource pool is improved, and the load state of an AI application example is detected in real time; through an elastic telescoping function, AI application examples are automatically expanded and shrunk, stable operation of AI tasks is ensured, resources of a plurality of clusters are integrated into a unified resource pool, centralized management and cooperative scheduling of the resources are achieved, the load condition of each cluster is monitored in real time, load balancing is automatically carried out among the clusters, and the AI tasks are reasonably distributed to different clusters. And the GPU resources of the specified model are accurately allocated to the AI task according to the actual demand of the AI task, so that the situation that the AI task application runs on non-optimal resources is avoided, and the efficient running of the AI task is ensured.

Described herein is a technique to approximate photorealistic indirect illumination shown in path traced images for dynamic lighting environments using a neural network. Given a lightly ray traced image, intermediate buffers from rendering pipeline, and light and camera information, the photorealism of rendered images can be enhanced via the neural network to approximate path traced indirect illumination.

The invention discloses a memory writing method and device, a storage medium and a program product, and relates to the technical field of memory access, and the method comprises the following steps: determining a memory step length of an initial image tensor corresponding to a target image, determining a target vectorization width according to the memory step length and a memory data width of a target graphics processor, and determining a target data dimension of the target graphics processor, determining a target thread grid corresponding to the initial image tensor according to the target data dimension, performing image tensor slicing by using the target thread grid to obtain a target image tensor, and writing the target image tensor into a memory. According to the method, the memory layout (step length) of the input tensor can be dynamically analyzed, so that the optimal vectorization width is adaptively determined, the memory access efficiency is maximized, slicing is performed according to the data dimension when the target graphics processor outputs the data, the method has adaptability and high efficiency, the GPU video memory bandwidth is fully utilized, and the memory bandwidth utilization rate is improved.

Embodiments described herein provide methods and systems for open vocabulary object detection of images. given a pre-trained vision-language model and an image-caption pair, an activation map may be computed in the image that corresponds to an object of interest mentioned in the caption. The activation map is then converted into a pseudo bounding-box label for the corresponding object category. The open vocabulary detector is then directly supervised by these pseudo box-labels, which enables training object detectors with no human-provided bounding-box annotations.

When generating a sequence of render outputs using a graphics processor, the completion status of rendering tasks for different render outputs is tracked so that processing tasks for later render outputs in the sequence of outputs can be processed concurrently with processing tasks for earlier render outputs in the sequence of outputs whilst ensuring that any dependencies between the rendering tasks are enforced.

The invention discloses a lesion area self-adaptive segmentation method and system for a seminal vesicle endoscope image, particularly relates to the field of medical image processing, is used for solving the problems of geometric distortion and artifacts in the seminal vesicle endoscope image, and aims to eliminate geometric deviation caused by thick layer sampling through synchronous acquisition and attitude correction. Then, a resampling strategy is adjusted in a self-adaptive mode through key geometric features, the problems of inter-layer artifacts and resolution imbalance are effectively weakened, a lesion segmentation network is optimized through smooth regularization and geometric constraint, continuity and geometric accuracy of lesion boundaries are ensured, finally, the accurate lesion mask is dynamically overlaid to a real-time frame stream, and the real-time frame stream is obtained. A quantitative basis is provided for biopsy path planning and photodynamic dose scheduling; smooth and continuous images are completed and output in a strict time window, the perception ability of an operator to tiny pathological changes is enhanced, meanwhile, the method is suitable for various endoscope devices, motion blur and light spot artifacts are restrained, and focus details are kept clear.

The embodiment of the invention discloses a GPU video memory channel allocation method and device, equipment and a storage medium. An exemplary embodiment of the method comprises the following steps: pre-applying for a plurality of physical video memory pages from a physical video memory space; mapping video memory colors to the plurality of physical video memory pages according to a mapping table of colored partitions and video memory colors of the physical video memory pages to obtain video memory channels corresponding to the colored partitions; in response to a detected target task of performing video memory operation according to the required color and the required space, querying an unallocated colored partition of a video memory channel corresponding to the required color; and distributing a target physical video memory page to the target task from the plurality of physical video memory pages according to the demand space, and returning a virtual address space corresponding to the target physical video memory page to the target task for use.

The invention provides a fractal graph drawing method and device, a storage medium and electronic equipment, and relates to the field of computer graphics. The method comprises the following steps: the electronic equipment iterates a preset number of times by utilizing a current basic fractal graph to obtain a derivative fractal graph; judging whether the number of pixels required for displaying the derivative fractal graph is changed or not compared with the current basic fractal graph; if the derivative fractal graph will change, taking the derivative fractal graph as a new basic fractal graph, and returning to the step of obtaining the derivative fractal graph by utilizing the current basic fractal graph to carry out iteration for preset times; and if the fractal graph does not change, taking the derivative fractal graph as a target fractal graph. Thus, whether the fractal graph reaches the optimal definition or not is judged by judging whether the number of pixels before and after iteration changes, and compared with visual inspection, the definition of the fractal graph can be judged more objectively.

A pruned version of a neural network is generated by determining pruned versions of each a plurality of layers of the network. The pruned version of each layer is determined by sorting a set of channels of the layer based on respective weight values of each channel in the set. A percentage of the set of channels are pruned based on the sorting to form a thinned version of the layer. Accuracy of a thinned version of the neural network is tested, where the thinned version of the neural network includes the thinned version of the layer. The thinned version of the layer is used to generate the pruned version of the layer based on the accuracy of the thinned version of the neural network exceeding a threshold accuracy value. A pruned version of the neural network is generated to include the pruned versions of the plurality of layers.

The invention discloses a data processing system, method and device, a medium and a program product, and relates to the technical field of computers. Weight data of a target model corresponding to a model processing task and key value pair data needing to be processed are stored in logic processing equipment; and the execution end of each operation in the target model can be a host, a logic processing device or a computing device, so that the pressure of the computing device for running and storing the model can be reduced, a proper execution end can be selected for each operation in the model, and the model operation efficiency is improved. And the execution end only needs to load the weight sub-data and the key value pair sub-data required by the currently executed operation from the logic processing equipment, and the model operation efficiency is further accelerated through loading a small amount of data. Therefore, the performance of the model can be brought into full play, and the model training and reasoning efficiency is improved.