69 results about "Ray casting" patented technology

The invention provides a high-performance volume rendering method and system based on autonomous controllable GPU pre-rendering. Curvature distribution characteristics of voxel surfaces are extracted through dynamic topology analysis to construct preprocessing metadata, and a reconfigurable computing array is driven to dynamically divide a hardware topology structure of a high-density ray casting unit and a hardware topology structure of a low-power-consumption interpolation unit according to the curvature characteristics. And task allocation and cooperative execution of heterogeneous computing units are realized based on an asynchronous computing engine, and finally, a multi-scale sampling result is fused through a hardware-level optimized mixed weight algorithm in an autonomous controllable rendering pipeline, and a closed-loop feedback mechanism of a rendering result and preprocessed metadata is established. According to the method, voxel geometric features, hardware architecture reconstruction and asynchronous calculation scheduling are innovatively and deeply coupled, and a technical closed loop of data feature driven hardware resource configuration and rendering result reverse optimization preprocessing parameters is formed. According to the technical scheme provided by the invention, high-fidelity real-time volume rendering of medical images and scientific data is realized.

The invention provides a generative adversarial network-based medical image transfer function automatic generation method, which comprises the following steps of: firstly, initializing a transfer function by using a Gaussian primitive, and carrying out multi-angle sampling on a rendering lens of volume data to obtain an optimal observation view angle of the volume data; generating rendering images of different transfer functions according to the optimal view angle and the transfer function by using a ray casting technology; secondly, selecting edge and gradient features as a clustering basis, and clustering rendered images of different transfer functions by using a k-means algorithm to obtain clustering tags; then, a CGAN-TF model is constructed, and the CGAN-TF model is trained by using a transfer function and a clustering label; and finally, selecting the generated transfer function by using a transfer function exploration component, and exploring and modifying according to requirements to obtain the transfer function with good performance and a corresponding visual rendering image. The method has the capability of generating the corresponding transfer function according to the label, and the stability is high.

The invention belongs to the technical field of data acquisition, and discloses a white space jump volume rendering acceleration method and system based on an unsigned distance field, and the white space jump volume rendering acceleration method based on the unsigned distance field comprises the steps: according to the spatial distribution characteristics of volume data; a three-dimensional unsigned distance texture map is obtained through pre-calculation of a calculation shader, and the map displays the Euclidean distance from a current voxel to a nearest non-empty voxel. Ray casting is executed in the pixel shader, and a plurality of continuous blank spaces can be skipped through one query before sampling each time, so that a large number of invalid sampling times are effectively reduced. Rendering contrast experiments of various different data sets show that the rendering speed of the method is improved by 345% compared with that of a traditional ray casting volume rendering method, the rendering speed of the method is 52% higher than that of an occupancy map method, and the rendering speed of the method is 33% higher than that of a chebyshev distance map.

The invention relates to the technical field of virtual reality cultural relic construction, in particular to a cultural relic three-dimensional construction VR display system based on multi-modal data fusion. The specific implementation process comprises the steps of obtaining a laser point cloud and a two-dimensional image of the surface of a cultural relic, respectively generating a geometric point cloud and a visual sparse point cloud, and inputting the geometric point cloud and the visual sparse point cloud into a modal registration model based on geometry-luminosity combined constraint to complete pixel alignment and data fusion; performing texture mapping by using a Markov random field to generate a three-dimensional mapping model, generating a feature saliency map based on curvature calculation, and performing differential mesh simplification on flat and detail areas to output a polygonal contour; and generating a normal and a replacement map by using a ray casting algorithm, and importing the normal and the replacement map into a virtual reality engine for rendering display in combination with the polygonal contour. According to the method, a multi-mode joint optimization and differentiation grid simplification technology is utilized, dislocation and ghosting of texture mapping are effectively eliminated, and while VR rendering fluency is guaranteed, microscopic geometric details and physical material attributes of cultural relics are reserved.

The invention discloses a three-dimensional acoustic visualization rendering method and system based on sound field modeling. The method comprises the following steps: arranging a microphone array to collect a multi-channel time domain audio signal, and carrying out short-time Fourier transform to obtain frequency domain complex sound pressure data; performing inversion based on a beam forming algorithm to obtain complex sound pressure of each voxel point in a three-dimensional space, and constructing a four-dimensional acoustic voxel matrix; further utilizing a volume ray projection algorithm to map the volume element data into color and transparency, and realizing three-dimensional rendering and visual expression of the sound field; the system supports frequency screening, time evolution playback, transparency adjustment and three-dimensional visual angle control, and the visual analysis capability of the sound field is improved; and meanwhile, a structured data output interface is provided and can be linked with an AI algorithm, so that intelligent functions such as acoustic anomaly detection and tuning optimization are realized. The method has the capabilities of high-precision modeling, deep rendering expression and intelligent expansion, and is suitable for various acoustic application scenes such as intelligent sound boxes, vehicle-mounted sound boxes, conference systems and the like.

The invention discloses a dynamic octree mapping method and system based on probability semantic fusion and a storage medium, and mainly solves the problem that a traditional octree map lacks semantic information and cannot support an advanced cognitive task. According to the implementation scheme, the method comprises the following steps: acquiring an RGB image, depth information and pose data through a sensor; extracting pixel-level semantic probability distribution by using a pre-trained semantic segmentation network; geometric information in the perception data is projected to a three-dimensional space based on the pose, and a three-dimensional observation point with semantic information is formed; performing ray projection on octree nodes, respectively updating geometric occupancy states of penetrated non-end-point nodes, and synchronously updating geometric occupancy states and semantic belief distribution of end-point surface nodes by using three-dimensional observation point data; semantic information is continuously optimized through Bayesian probability fusion, and dynamic pruning and map optimization are realized based on semantic entropy. According to the method, the map storage efficiency and the calculation speed can be remarkably improved while refined and real-time updated geometric and semantic information is given. The method can be used for map construction and storage of visual SLAM positioning, and fine three-dimensional object modeling and environment information description.

The invention relates to an electric field visualization real-time monitoring system and method, belongs to the technical field of electric field visualization, and is used for solving the problems of insufficient real-time performance, large measurement interference, incomplete imaging, weak multi-user cooperation and lack of unified time reference in the prior art. The method comprises the following steps: acquiring electric field scattering data of a test body by a conformal optical fiber electric field sensor array, transmitting the electric field scattering data to an edge GPU node through a plastic optical fiber-CAN-FD link, and converting the electric field scattering data into electric field amplitude data; the edge GPU node is combined with WebGL3D texture mapping and a volume ray casting algorithm to complete volume rendering, and multi-user concurrent interaction is realized through a Web server and a browser client; and a White-Rabbit clock architecture is adopted to provide a unified time reference for the whole process. According to the method, dynamic and accurate capturing of the electric field is achieved, and the multi-user concurrent access requirement is effectively met.

The invention provides a volume data rendering acceleration method for blank space jump, which relates to the field of volume data rendering, and comprises the following steps: judging whether a volume data block to which a current light sampling point belongs has a non-empty voxel, if the volume data block is a blank volume data block, entering a Chebyshev jump stage, jumping the blank volume data block based on a Chebyshev distance map, and if not, entering a Chebyshev jump stage; and if not, entering a voxel-level jump stage. And in the voxel-level jumping stage, judging whether the voxel is non-empty, if the voxel is non-empty, executing a ray casting sampling process, and if the voxel is empty, entering the jumping stage based on the unsigned distance map to jump the blank voxel. And performing adaptive sampling step length adjustment based on the gradient amplitude, the volume data value and the viewpoint distance. And when the light is emitted out of the cube, iteration is stopped. According to the technical scheme, the problems that in the prior art, efficient skipping of empty voxels cannot be achieved, and the calculation efficiency of a ray casting algorithm is low are solved.

The invention discloses a static map generation method in an indoor dynamic environment, and the method comprises the steps: carrying out the mapping through employing an SLAM algorithm, and obtaining a point cloud map containing a dynamic object; preprocessing point clouds in the point cloud map, removing point cloud noise, and meanwhile, performing ground segmentation to obtain ground points and non-ground points; on the basis of an octree structure, updating the point cloud map with the point cloud noise removed in real time to obtain an updated map; performing superposition scanning on non-ground points by using a ray casting method, and identifying a potential dynamic region through a preset confidence threshold; performing multi-frame consistency detection on the potential dynamic area, and if the occupancy probability of the node in the potential dynamic area changes, judging the point cloud corresponding to the node as a dynamic point cloud; and removing the dynamic point cloud in the updated map to generate a static map. According to the method, superposition scanning and multi-frame consistency detection are performed on the point clouds in the indoor dynamic environment, so that the dynamic point clouds can be quickly identified, and the dynamic point clouds are rejected to generate the static map.

This invention relates to the fields of wildfire monitoring, computer vision, and digital twin technology. It proposes a method and system for real-time wildfire spread simulation using digital twins and dynamic parameter inversion. The method dynamically inverts the surface combustible moisture content through white balance adaptive correction and HSV color feature extraction; maps physical camera parameters to a virtual camera; and uses a spatial ray casting algorithm and a digital elevation model to calculate the three-dimensional geographic coordinates of the fire point; it determines the wildfire spread direction by weighting the wind field vector and the maximum upslope vector in real time; it calculates the true slope of the dynamic path by taking points forward from the fire point as the starting point and using the grid accuracy of the digital elevation model as the step size; and it inputs the dynamic parameters into the wildfire spread model for simulation to generate the fire spread boundary. This invention significantly improves the physical realism and practical accuracy of wildfire spread simulation in complex environments through virtual-real fusion and physical correction mechanisms.

The present invention discloses a GPU-accelerated adaptive sampling volume rendering method for non-uniform cuboid meshes. First, based on data bounding box rendering and GPU multi-threaded computing, a set of sampling rays for non-uniform cuboid meshes is generated. Subsequently, the intersection points of each ray with the mesh cell faces are calculated and the coordinate positions of the adaptive sampling points are determined. Then, the non-uniform cuboid mesh data is stored in the 3D texture memory of the GPU in a normalized manner, and texture hardware queries are performed using the weighted and corrected adaptive sampling point coordinates to obtain the trilinear interpolation result scalar values at the sampling points. Finally, the colors and transparencies corresponding to the sampling points are calculated according to the transfer function, and the Under operator in Alpha blending is used to achieve the correct color synthesis of all sampling points on the ray, and finally a visualization result image is formed. Experimental results show that the present invention can effectively improve the computational efficiency of Ray Casting volume rendering for non-uniform cuboid meshes and accelerate the visualization analysis and calculation process of non-uniform cuboid meshes.

An adaptive ray-casting of 3D scalar fields on a wide SIMD machine process and system is described. In one example, a process initially casts / renders rays through a 3D scalar field to acquire information associated with specific properties of this 3D scalar field. The acquired information is then stored on a 2-D image plane. Each pixel on this 2D image plane represents the result of ray casting through the 3-D scalar field. The process of non-even / non-uniform / adaptive samplings along each ray aims / intends to minimize the number of samplings to obtain / acquire the most accurate approximation of the information of interest, doing that effectively on a wide SIMD machine.

The application discloses a gesture point selection and distance measurement method in a three-dimensional point cloud perspective display mode, comprising the following steps: obtaining two-dimensional coordinates of a user gesture by using a touch screen of a smart mobile device, mapping the two-dimensional coordinates into a ray endpoint in a three-dimensional space coordinate system through normalization conversion and inverse matrix operation, converting the ray endpoint into actual three-dimensional coordinates, converting three-dimensional point cloud data from a Cartesian coordinate system into a cylindrical coordinate system, judging whether the ray intersects with a cylinder through a ray equation, screening intersection points meeting the conditions, calculating the shortest distance between the ray and the central axis of the cylinder, and determining whether a target point is selected through a distance threshold value. The application effectively avoids misoperation through minimum distance judgment and screening, improves the user's interactive experience, is suitable for various application scenarios such as augmented reality and virtual reality, optimizes the coordinate conversion and ray projection algorithm, and improves the response speed and accuracy of the system.

The invention provides a broken shaft protection method for a circuitous wheel of an aerial passenger device, and relates to the field of coal mine safety monitoring. The problems that in the prior art, space-time alignment errors of multi-source data are large, a physical field is distorted, and real-time performance is insufficient are solved. Through dynamic graph structure modeling, heterogeneous sensors such as a vibration sensor, a temperature sensor, a displacement sensor and the like are mapped into space-time association graph nodes, edge connection is constructed based on spatial proximity and time synchronism, and continuity characteristics of an equipment structure are coded. And generating a three-dimensional continuous field and dynamically visualizing the three-dimensional continuous field through a ray casting volume rendering technology. According to the scheme, high-precision and high-real-time technical support is provided for broken shaft fault early warning.

Sparse local fields for simulation include obtaining a scene that includes object voxel grids for objects. The object voxel grids include an object voxel grid with the object voxel grid including a voxel positioning property, a geometry field property, and a color field property of the voxel in the object voxel grid. The operations further include identifying an image plane of a first virtual sensor and a set of virtual sensor properties of a second virtual sensor capturing the scene. The operations also include performing, using the object voxel grids, rasterization of the scene on the image plane and ray casting through the scene using the set of virtual sensor properties to generate a first virtual sensor snapshot and a second virtual sensor snapshot. The operations also include outputting the first virtual sensor snapshot and the second virtual sensor snapshot.

A computer-implemented method is disclosed for creating three-dimensional (3D) variable resolution (VR) region geometries of a modeled object for use in a computer-implemented numerical simulation involving the modeled object. The computer-implemented method includes, inter alia, generating two-dimensional (2D) orthographic views of a 3D modeled object, and identifying edges of each of the 2D orthographic views with a computer-based ray casting method. The computer-based ray casting method includes, for each respective one of the 2D orthographic views, casting virtual rays from different directions toward the 2D orthographic view within a plane of the 2D orthograph view, and detecting an intersection point for each of the virtual rays with an edge of the 2D orthographic view.

The present invention provides a real-time sonar point cloud visualization interaction method for dynamic data management, which relates to the field of visualization technology. The purpose of the present invention is to improve the efficiency and effect of real-time visualization interaction of massive point cloud data simultaneously. During the data organization and management process, bricks are designed for physical partitioning, and spatial fields are dynamically allocated to solve the memory consumption problem generated by conventional spatial fields. Virtual panoramic regions are defined using bricks to manage the scanning regions of each continuously incoming frame of sonar data. Memory is dynamically allocated for the collected point cloud data in units of bricks, and the memory of bricks not involved is empty. Combining the characteristics of multi-level brick partitioning organization, the ray casting algorithm is improved for real-time rendering, and the rendering resolution of the algorithm is fixed. Through the calculation of empty voxel jumping and distance-based spatial interpolation for the data points within the bricks, in terms of interaction operations, after panning and zooming the viewing field, the three-dimensional points to be rendered under the new viewing field are determined by calculating the bricks within the viewing field region.

Systems and techniques are provided for processing image data corresponding to a scene. A method may include generating a planar distance map including planar distance values for each pixel of at least one image corresponding to a scene. Plane segmentation is performed based on the plane distance map, a normal map corresponding to the at least one image, and position encoding information of the plane distance map. Triangular mesh segments are initialized based on sampling points from each of a plurality of planar segments from planar segmentation. A ray-triangular intersection is determined based on performing ray casting on a reconstructed planar grid comprising a plurality of triangular grid segments, each triangular grid segment corresponding to a different image. A planar reconstruction and segmentation machine learning network is optimized for a scene based on training the planar reconstruction and segmentation machine learning network using one or more loss functions.

The invention provides a ray casting volume rendering method for an InterfaceGrid grid model, and relates to the field of ray casting volume rendering, and the method comprises the steps: converting the InterfaceGrid grid model from display storage to an implicit storage structure of InterfaceGrid Block, transmitting the implicit storage structure to a GPU, and carrying out the segmented storage; according to the implicit storage texture set, performing coordinate transformation on the vertex coordinates of the texture by using a vertex shader to obtain transformed vertex coordinates; transmitting the transformed vertex coordinates to a fragment shader, and obtaining implicit storage information corresponding to the current fragment through a texture sampling technology in combination with an implicit storage texture set; according to the implicit storage information corresponding to the current segment, drawing an InterfaceGrid grid model body, and searching to obtain the attribute of the InterfaceGrid grid model at the current sampling point; updating the color and transparency of the sampling points, and synthesizing by using an illumination model to obtain an accumulated volume rendering color; and outputting the result to a screen, and completing the body visualization of the InterfaceGrid model. The method is used for solving the problem that a traditional three-dimensional geologic model is insufficient in expression ability.

Lithography mask generation processes utilizing a forward process that decomposes a resist pattern into segments and rasterizes the segments into a mask pattern using ray casting, and a backward process that determines lithography gradients for edge movements that incorporate mask rule constraints and propagates the lithography gradients into gradients and velocities for the segments.

The application provides a single-frame three-dimensional point cloud data visualization method based on multi-level distance interpolation, and relates to the technical field of visualization.The application improves the operation speed without losing original data information by performing multi-level distance interpolation on discrete three-dimensional space points, and realizes the balance between the calculation accuracy and the speed.In addition, according to the characteristics of the terrain three-dimensional space data field, the application changes the gradient calculation method in the traditional ray casting algorithm, improves the original ray casting algorithm, proposes the multi-level distance interpolation ray casting algorithm, calculates the gradient in advance, speeds up the rendering process, and further shortens the operation time.The original data is subjected to the first distance interpolation to generate a new three-dimensional space data field, and the generated three-dimensional space data field is subjected to gradient calculation and secondary interpolation operation, so that the high accuracy is retained while the operation speed is improved, and real-time high-precision drawing is realized.

A client device and a controller allow a user to control AR content by selecting real-world locations or objects. The client receives position data indicating a position and orientation of the controller, the position data defining an axis of the controller. The client device performs ray casting to determine a location in a 3D map of a real-world that intersects the axis. The client device receives a selection indication (e.g., a user pressing a button on the controller). The client device selects, subsequent to the selection indication, the location in the 3D map that intersects the axis as a waypoint. The client device defines a route for a virtual object based on the waypoint.

The invention provides an aerospace composite material damage visual feature extraction method. Firstly, integrated high-resolution nondestructive testing equipment is used for collecting multiple types of original data including ultrasonic waves, infrared thermal images, X-ray images and the like, and damage information is captured in multiple dimensions. And de-noising is carried out through a filtering algorithm based on Daubechies wavelet four-layer decomposition, and data is normalized, so that a foundation is built for subsequent processing. A CNN and LSTM hybrid network is used for preliminarily screening features, and an early stop method and a Dropout technology are used for preventing overfitting. And fusing the multi-modal preliminary damage features by means of a fusion algorithm based on a kernel method. Based on a genetic algorithm, features are optimized from multiple dimensions of damage identification degree, independence and redundancy. And finally, performing three-dimensional reconstruction by using a ray casting algorithm, and presenting the damage by different colors, transparencies and shapes in combination with an interaction function according to the spatial information of the key features, the damage type and strength, thereby realizing visual visualization and providing a reliable basis for the damage analysis and evaluation of the aerospace composite material.

The invention discloses a volume rendering method and system for non-uniform ocean scalar field data, and belongs to the field of GIS (Geographic Information System). Aiming at the characteristic that ocean scalar field data such as sea temperature is not uniformly distributed in depth, a step sampling method for self-adaptive step length of a ray casting algorithm is realized by constructing depth interval textures, and a nonlinear color mapping enhancement method is adopted according to statistical characteristics of data distribution to enhance spatial distribution characteristics, so that the accuracy of the data distribution is improved. The problems of low rendering efficiency and poor visualization effect caused by data redundancy or information loss in a traditional method are solved. According to the method, the rendering speed and the image quality of the non-uniform scalar field data in the three-dimensional virtual earth environment can be effectively improved, and the method has important technical value and practical significance in application in the fields of marine scientific research, environment monitoring and the like.

An apparatus includes a memory for storing image data; and processing circuitry in communication with the memory. The processing circuitry is configured to obtain a plurality of camera images and generate camera features from the plurality of camera images. According to such an example, processing circuitry may be configured to project the camera features from the plurality of camera images into a birds-eye-view (BEV) image space to generate BEV features. In certain examples, processing circuitry is configured to determine a plurality of zero-value locations of the BEV features within the BEV image space and diffuse non-zero BEV features in the BEV image space into the plurality of zero-value locations within the BEV image space to generate increased density BEV features. In at least one example, processing circuitry is configured to output a BEV image having the increased density BEV features.

A decoding method, comprising: receiving a compressed bitstream related to a video presentation; decoding data related to one or more three-dimensional blocks of a video frame from the received bitstream; for each block of the video frame, determining information about surface parameters; generating a bounding box of the three-dimensional block according to the surface parameters; for each pixel of the three-dimensional block, calculating a ray direction from a viewpoint to the coordinates of the pixel; determining at least two points according to the intersection of the ray and the generated bounding box; performing ray casting on the points between the determined at least two points until a condition for completing ray casting is satisfied; reconstructing three-dimensional data from a geometric image and a texture image according to information about one or more surface parameters of the block; reconstructing the video presentation for rendering according to the reconstructed three-dimensional data.

The invention relates to a volume rendering method and device for a three-dimensional image, electronic equipment and a storage medium, and the method comprises the steps: carrying out the sampling in an imaging plane corresponding to a plurality of organ scanning images according to a ray casting algorithm, and obtaining a sampled target pixel point; the target pixel points are subjected to ray casting analysis, a region of interest and a region of non-interest in an imaging plane are determined, and the region of interest comprises a target organ to be concerned; carrying out ray casting calculation after sampling a target pixel point in the region of interest according to a first step length; a target pixel point in the non-interested area is sampled according to a second step length and then ray casting calculation is carried out, and the second step length is larger than the first step length; and generating a three-dimensional image corresponding to the organ scanning image according to the ray casting calculation results of the region of interest and the non-region of interest. According to the method, the image quality is ensured, and the calculation efficiency is improved.

This invention provides a spatiotemporal data volume rendering method for Unreal Engine, belonging to the field of spatiotemporal data volume rendering technology. This invention acquires NetCDF format ocean spatiotemporal data and generates two-dimensional volumetric textures. It establishes a memory partitioning management system to divide GPU memory into upper and lower memory grids, employs a two-layer game theory algorithm to achieve differentiated resource allocation, creates volumetric rendering material objects in Unreal Engine, and establishes a volumetric shading framework based on ray stepping. It dynamically adjusts the sampling step size through an adaptive ray stepping algorithm to achieve efficient volumetric texture sampling based on the memory grid, performs ray casting calculations to generate three-dimensional visualization effects, and establishes dynamic interactive control in the spatiotemporal dimension to achieve synchronous display of multi-source ocean data. This invention solves the technical problem of low rendering efficiency caused by unreasonable allocation of memory resources during the three-dimensional visualization rendering of ocean spatiotemporal data.

This invention belongs to the field of image processing technology. It provides a method, apparatus, and system for rendering digital content in an image, comprising: acquiring all transparent objects in the rendering scene, classifying and labeling them and assigning unique IDs; dividing the scene into equal spatial blocks using an octree algorithm; equipping each spatial block with a unique set of classification labels; constructing a static transparent object depth value table; establishing a dynamic depth value prediction model by combining dynamic object motion parameters, animation keyframes, or interaction history; filtering effective spatial blocks through axis-aligned bounding boxes and view frustum intersection tests; generating an initial rendering sorting table by combining the maximum depth value of static objects and the depth stability weight of dynamic objects; filtering overlapping transparent object combinations based on oriented bounding boxes and the separating axis theorem; verifying spatial relationships using ray casting; and correcting the sorting order using a weighted scoring method.

This invention discloses a dual-resolution ESDF map construction method for autonomous driving, belonging to the field of environmental perception and 3D map construction technology for autonomous vehicles. This method divides the 3D space into a near-field high-resolution region and a far-field low-resolution region, maintaining occupied grids and ESDF distance information at different voxel resolutions. Ray projection is used to probabilistically update free space and occupied voxels for depth maps or point clouds. When a new occupied voxel is detected, it is used as a distance source to trigger local wavefront propagation for incremental ESDF updates. When an occupied voxel disappears, the affected voxel is quickly located by influencing the index structure and recalculating the failure, significantly reducing the overhead of full map recalculation. Simultaneously, distance and occupancy are synchronized in inter-layer boundary regions. Compared with existing single-resolution ESDF methods, this invention significantly reduces memory usage and improves real-time update performance for large scenes while maintaining near-field distance accuracy.