52 results about "Ray casting" patented technology

The invention relates to the technical field of virtual reality cultural relic construction, in particular to a cultural relic three-dimensional construction VR display system based on multi-modal data fusion. The specific implementation process comprises the steps of obtaining a laser point cloud and a two-dimensional image of the surface of a cultural relic, respectively generating a geometric point cloud and a visual sparse point cloud, and inputting the geometric point cloud and the visual sparse point cloud into a modal registration model based on geometry-luminosity combined constraint to complete pixel alignment and data fusion; performing texture mapping by using a Markov random field to generate a three-dimensional mapping model, generating a feature saliency map based on curvature calculation, and performing differential mesh simplification on flat and detail areas to output a polygonal contour; and generating a normal and a replacement map by using a ray casting algorithm, and importing the normal and the replacement map into a virtual reality engine for rendering display in combination with the polygonal contour. According to the method, a multi-mode joint optimization and differentiation grid simplification technology is utilized, dislocation and ghosting of texture mapping are effectively eliminated, and while VR rendering fluency is guaranteed, microscopic geometric details and physical material attributes of cultural relics are reserved.

The invention discloses a three-dimensional acoustic visualization rendering method and system based on sound field modeling. The method comprises the following steps: arranging a microphone array to collect a multi-channel time domain audio signal, and carrying out short-time Fourier transform to obtain frequency domain complex sound pressure data; performing inversion based on a beam forming algorithm to obtain complex sound pressure of each voxel point in a three-dimensional space, and constructing a four-dimensional acoustic voxel matrix; further utilizing a volume ray projection algorithm to map the volume element data into color and transparency, and realizing three-dimensional rendering and visual expression of the sound field; the system supports frequency screening, time evolution playback, transparency adjustment and three-dimensional visual angle control, and the visual analysis capability of the sound field is improved; and meanwhile, a structured data output interface is provided and can be linked with an AI algorithm, so that intelligent functions such as acoustic anomaly detection and tuning optimization are realized. The method has the capabilities of high-precision modeling, deep rendering expression and intelligent expansion, and is suitable for various acoustic application scenes such as intelligent sound boxes, vehicle-mounted sound boxes, conference systems and the like.

The invention discloses a dynamic octree mapping method and system based on probability semantic fusion and a storage medium, and mainly solves the problem that a traditional octree map lacks semantic information and cannot support an advanced cognitive task. According to the implementation scheme, the method comprises the following steps: acquiring an RGB image, depth information and pose data through a sensor; extracting pixel-level semantic probability distribution by using a pre-trained semantic segmentation network; geometric information in the perception data is projected to a three-dimensional space based on the pose, and a three-dimensional observation point with semantic information is formed; performing ray projection on octree nodes, respectively updating geometric occupancy states of penetrated non-end-point nodes, and synchronously updating geometric occupancy states and semantic belief distribution of end-point surface nodes by using three-dimensional observation point data; semantic information is continuously optimized through Bayesian probability fusion, and dynamic pruning and map optimization are realized based on semantic entropy. According to the method, the map storage efficiency and the calculation speed can be remarkably improved while refined and real-time updated geometric and semantic information is given. The method can be used for map construction and storage of visual SLAM positioning, and fine three-dimensional object modeling and environment information description.

The invention relates to an electric field visualization real-time monitoring system and method, belongs to the technical field of electric field visualization, and is used for solving the problems of insufficient real-time performance, large measurement interference, incomplete imaging, weak multi-user cooperation and lack of unified time reference in the prior art. The method comprises the following steps: acquiring electric field scattering data of a test body by a conformal optical fiber electric field sensor array, transmitting the electric field scattering data to an edge GPU node through a plastic optical fiber-CAN-FD link, and converting the electric field scattering data into electric field amplitude data; the edge GPU node is combined with WebGL3D texture mapping and a volume ray casting algorithm to complete volume rendering, and multi-user concurrent interaction is realized through a Web server and a browser client; and a White-Rabbit clock architecture is adopted to provide a unified time reference for the whole process. According to the method, dynamic and accurate capturing of the electric field is achieved, and the multi-user concurrent access requirement is effectively met.

The invention provides a volume data rendering acceleration method for blank space jump, which relates to the field of volume data rendering, and comprises the following steps: judging whether a volume data block to which a current light sampling point belongs has a non-empty voxel, if the volume data block is a blank volume data block, entering a Chebyshev jump stage, jumping the blank volume data block based on a Chebyshev distance map, and if not, entering a Chebyshev jump stage; and if not, entering a voxel-level jump stage. And in the voxel-level jumping stage, judging whether the voxel is non-empty, if the voxel is non-empty, executing a ray casting sampling process, and if the voxel is empty, entering the jumping stage based on the unsigned distance map to jump the blank voxel. And performing adaptive sampling step length adjustment based on the gradient amplitude, the volume data value and the viewpoint distance. And when the light is emitted out of the cube, iteration is stopped. According to the technical scheme, the problems that in the prior art, efficient skipping of empty voxels cannot be achieved, and the calculation efficiency of a ray casting algorithm is low are solved.

This invention relates to the fields of wildfire monitoring, computer vision, and digital twin technology. It proposes a method and system for real-time wildfire spread simulation using digital twins and dynamic parameter inversion. The method dynamically inverts the surface combustible moisture content through white balance adaptive correction and HSV color feature extraction; maps physical camera parameters to a virtual camera; and uses a spatial ray casting algorithm and a digital elevation model to calculate the three-dimensional geographic coordinates of the fire point; it determines the wildfire spread direction by weighting the wind field vector and the maximum upslope vector in real time; it calculates the true slope of the dynamic path by taking points forward from the fire point as the starting point and using the grid accuracy of the digital elevation model as the step size; and it inputs the dynamic parameters into the wildfire spread model for simulation to generate the fire spread boundary. This invention significantly improves the physical realism and practical accuracy of wildfire spread simulation in complex environments through virtual-real fusion and physical correction mechanisms.

The application discloses a gesture point selection and distance measurement method in a three-dimensional point cloud perspective display mode, comprising the following steps: obtaining two-dimensional coordinates of a user gesture by using a touch screen of a smart mobile device, mapping the two-dimensional coordinates into a ray endpoint in a three-dimensional space coordinate system through normalization conversion and inverse matrix operation, converting the ray endpoint into actual three-dimensional coordinates, converting three-dimensional point cloud data from a Cartesian coordinate system into a cylindrical coordinate system, judging whether the ray intersects with a cylinder through a ray equation, screening intersection points meeting the conditions, calculating the shortest distance between the ray and the central axis of the cylinder, and determining whether a target point is selected through a distance threshold value. The application effectively avoids misoperation through minimum distance judgment and screening, improves the user's interactive experience, is suitable for various application scenarios such as augmented reality and virtual reality, optimizes the coordinate conversion and ray projection algorithm, and improves the response speed and accuracy of the system.

The invention provides a broken shaft protection method for a circuitous wheel of an aerial passenger device, and relates to the field of coal mine safety monitoring. The problems that in the prior art, space-time alignment errors of multi-source data are large, a physical field is distorted, and real-time performance is insufficient are solved. Through dynamic graph structure modeling, heterogeneous sensors such as a vibration sensor, a temperature sensor, a displacement sensor and the like are mapped into space-time association graph nodes, edge connection is constructed based on spatial proximity and time synchronism, and continuity characteristics of an equipment structure are coded. And generating a three-dimensional continuous field and dynamically visualizing the three-dimensional continuous field through a ray casting volume rendering technology. According to the scheme, high-precision and high-real-time technical support is provided for broken shaft fault early warning.

Sparse local fields for simulation include obtaining a scene that includes object voxel grids for objects. The object voxel grids include an object voxel grid with the object voxel grid including a voxel positioning property, a geometry field property, and a color field property of the voxel in the object voxel grid. The operations further include identifying an image plane of a first virtual sensor and a set of virtual sensor properties of a second virtual sensor capturing the scene. The operations also include performing, using the object voxel grids, rasterization of the scene on the image plane and ray casting through the scene using the set of virtual sensor properties to generate a first virtual sensor snapshot and a second virtual sensor snapshot. The operations also include outputting the first virtual sensor snapshot and the second virtual sensor snapshot.

Systems and techniques are provided for processing image data corresponding to a scene. A method may include generating a planar distance map including planar distance values for each pixel of at least one image corresponding to a scene. Plane segmentation is performed based on the plane distance map, a normal map corresponding to the at least one image, and position encoding information of the plane distance map. Triangular mesh segments are initialized based on sampling points from each of a plurality of planar segments from planar segmentation. A ray-triangular intersection is determined based on performing ray casting on a reconstructed planar grid comprising a plurality of triangular grid segments, each triangular grid segment corresponding to a different image. A planar reconstruction and segmentation machine learning network is optimized for a scene based on training the planar reconstruction and segmentation machine learning network using one or more loss functions.

Lithography mask generation processes utilizing a forward process that decomposes a resist pattern into segments and rasterizes the segments into a mask pattern using ray casting, and a backward process that determines lithography gradients for edge movements that incorporate mask rule constraints and propagates the lithography gradients into gradients and velocities for the segments.

The application provides a single-frame three-dimensional point cloud data visualization method based on multi-level distance interpolation, and relates to the technical field of visualization.The application improves the operation speed without losing original data information by performing multi-level distance interpolation on discrete three-dimensional space points, and realizes the balance between the calculation accuracy and the speed.In addition, according to the characteristics of the terrain three-dimensional space data field, the application changes the gradient calculation method in the traditional ray casting algorithm, improves the original ray casting algorithm, proposes the multi-level distance interpolation ray casting algorithm, calculates the gradient in advance, speeds up the rendering process, and further shortens the operation time.The original data is subjected to the first distance interpolation to generate a new three-dimensional space data field, and the generated three-dimensional space data field is subjected to gradient calculation and secondary interpolation operation, so that the high accuracy is retained while the operation speed is improved, and real-time high-precision drawing is realized.

A client device and a controller allow a user to control AR content by selecting real-world locations or objects. The client receives position data indicating a position and orientation of the controller, the position data defining an axis of the controller. The client device performs ray casting to determine a location in a 3D map of a real-world that intersects the axis. The client device receives a selection indication (e.g., a user pressing a button on the controller). The client device selects, subsequent to the selection indication, the location in the 3D map that intersects the axis as a waypoint. The client device defines a route for a virtual object based on the waypoint.

The invention discloses a volume rendering method and system for non-uniform ocean scalar field data, and belongs to the field of GIS (Geographic Information System). Aiming at the characteristic that ocean scalar field data such as sea temperature is not uniformly distributed in depth, a step sampling method for self-adaptive step length of a ray casting algorithm is realized by constructing depth interval textures, and a nonlinear color mapping enhancement method is adopted according to statistical characteristics of data distribution to enhance spatial distribution characteristics, so that the accuracy of the data distribution is improved. The problems of low rendering efficiency and poor visualization effect caused by data redundancy or information loss in a traditional method are solved. According to the method, the rendering speed and the image quality of the non-uniform scalar field data in the three-dimensional virtual earth environment can be effectively improved, and the method has important technical value and practical significance in application in the fields of marine scientific research, environment monitoring and the like.

An apparatus includes a memory for storing image data; and processing circuitry in communication with the memory. The processing circuitry is configured to obtain a plurality of camera images and generate camera features from the plurality of camera images. According to such an example, processing circuitry may be configured to project the camera features from the plurality of camera images into a birds-eye-view (BEV) image space to generate BEV features. In certain examples, processing circuitry is configured to determine a plurality of zero-value locations of the BEV features within the BEV image space and diffuse non-zero BEV features in the BEV image space into the plurality of zero-value locations within the BEV image space to generate increased density BEV features. In at least one example, processing circuitry is configured to output a BEV image having the increased density BEV features.

The invention relates to a volume rendering method and device for a three-dimensional image, electronic equipment and a storage medium, and the method comprises the steps: carrying out the sampling in an imaging plane corresponding to a plurality of organ scanning images according to a ray casting algorithm, and obtaining a sampled target pixel point; the target pixel points are subjected to ray casting analysis, a region of interest and a region of non-interest in an imaging plane are determined, and the region of interest comprises a target organ to be concerned; carrying out ray casting calculation after sampling a target pixel point in the region of interest according to a first step length; a target pixel point in the non-interested area is sampled according to a second step length and then ray casting calculation is carried out, and the second step length is larger than the first step length; and generating a three-dimensional image corresponding to the organ scanning image according to the ray casting calculation results of the region of interest and the non-region of interest. According to the method, the image quality is ensured, and the calculation efficiency is improved.

This invention provides a spatiotemporal data volume rendering method for Unreal Engine, belonging to the field of spatiotemporal data volume rendering technology. This invention acquires NetCDF format ocean spatiotemporal data and generates two-dimensional volumetric textures. It establishes a memory partitioning management system to divide GPU memory into upper and lower memory grids, employs a two-layer game theory algorithm to achieve differentiated resource allocation, creates volumetric rendering material objects in Unreal Engine, and establishes a volumetric shading framework based on ray stepping. It dynamically adjusts the sampling step size through an adaptive ray stepping algorithm to achieve efficient volumetric texture sampling based on the memory grid, performs ray casting calculations to generate three-dimensional visualization effects, and establishes dynamic interactive control in the spatiotemporal dimension to achieve synchronous display of multi-source ocean data. This invention solves the technical problem of low rendering efficiency caused by unreasonable allocation of memory resources during the three-dimensional visualization rendering of ocean spatiotemporal data.

This invention belongs to the field of image processing technology. It provides a method, apparatus, and system for rendering digital content in an image, comprising: acquiring all transparent objects in the rendering scene, classifying and labeling them and assigning unique IDs; dividing the scene into equal spatial blocks using an octree algorithm; equipping each spatial block with a unique set of classification labels; constructing a static transparent object depth value table; establishing a dynamic depth value prediction model by combining dynamic object motion parameters, animation keyframes, or interaction history; filtering effective spatial blocks through axis-aligned bounding boxes and view frustum intersection tests; generating an initial rendering sorting table by combining the maximum depth value of static objects and the depth stability weight of dynamic objects; filtering overlapping transparent object combinations based on oriented bounding boxes and the separating axis theorem; verifying spatial relationships using ray casting; and correcting the sorting order using a weighted scoring method.

This invention discloses a dual-resolution ESDF map construction method for autonomous driving, belonging to the field of environmental perception and 3D map construction technology for autonomous vehicles. This method divides the 3D space into a near-field high-resolution region and a far-field low-resolution region, maintaining occupied grids and ESDF distance information at different voxel resolutions. Ray projection is used to probabilistically update free space and occupied voxels for depth maps or point clouds. When a new occupied voxel is detected, it is used as a distance source to trigger local wavefront propagation for incremental ESDF updates. When an occupied voxel disappears, the affected voxel is quickly located by influencing the index structure and recalculating the failure, significantly reducing the overhead of full map recalculation. Simultaneously, distance and occupancy are synchronized in inter-layer boundary regions. Compared with existing single-resolution ESDF methods, this invention significantly reduces memory usage and improves real-time update performance for large scenes while maintaining near-field distance accuracy.

The invention discloses a DRR image generation method based on multi-scale progressive generation and multi-view adaptive optimization. The method comprises the following steps: generating a DRR image by using a ray casting method, and dividing the DRR image into a training set, a verification set and a test set after normalization processing; a multi-scale progressive DRR image generation module is constructed, the image resolution is gradually improved through a double-generator structure, and the generation quality is optimized in combination with perception loss and discriminator loss; constructing a multi-view-angle adaptive DRR image optimization module, and realizing adaptive extraction and fusion of cross-view-angle features by means of a multi-view-angle feature extractor and an adaptive feature fusion device; and evaluating the quality of an image generated by the model by adopting a peak signal-to-noise ratio and a structural similarity index. According to the method, rapid and high-quality DRR image generation of which only six pose parameters are input is realized, and the method has important application value in the field of medical images.

A client device and a controller allow a user to control AR content by selecting real-world locations or objects. The client receives position data indicating a position and orientation of the controller, the position data defining an axis of the controller. The client device performs ray casting to determine a location in a 3D map of a real world that intersects the axis. The client device receives a selection indication (e.g., a user pressing a button on the controller). The client device selects, subsequent to the selection indication, the location in the 3D map that intersects the axis as a waypoint. The client device defines a route for a virtual object based on the waypoint.

The invention belongs to the technical field of intelligent medical assistance, and discloses an AR-based soft tissue tumor resection auxiliary planning method. By introducing a hybrid deep learning model based on SAMMMed and DeepSnake, high-precision tumor segmentation and boundary optimization are realized, and the problem of discontinuous soft tissue image boundaries is solved; a point cloud registration system combining rigid and non-rigid algorithms is constructed, and dynamic alignment and real-time updating of a preoperative model and intra-operative scanning data are achieved; a visualization method based on volume rendering ray casting is adopted, a high-fidelity three-dimensional visualization effect is generated, and a doctor is helped to obtain clear spatial cognition in an operation; an optical navigation system and an augmented reality head display equipment coordinate system are uniformly fused, so that accurate correspondence of virtual-real superposition is realized, and the stability and accuracy of model display in an operation are ensured; a voice recognition and gesture interaction mechanism is introduced, non-contact operation is achieved, the sterile requirement of an operating room is met, and the operation naturalness and convenience are improved.

The invention provides a three-dimensional radar rendering method and device, equipment and a storage medium, and the method comprises the steps: obtaining original meteorological radar echo data, carrying out the data processing of the original meteorological radar echo data through a multi-thread technology, and obtaining the processed data; performing data interpolation based on the processed data, and constructing a three-dimensional voxel data model; voxel rendering is carried out based on the three-dimensional voxel data model, voxel data in the three-dimensional voxel data model is organized and managed by utilizing a spatial octree data structure, and a rendered model is obtained by adopting an early termination strategy based on a ray casting algorithm; integrating and matching the rendered model with a geographic information engine to obtain an integrated model; and performing interactive operation with the integrated model through input equipment. In the voxel rendering process, the spatial octree data structure is utilized to organize and manage the voxel data, and an early termination strategy based on a ray casting algorithm is adopted, so that the problem of large-scale data rendering lag is effectively relieved.

The invention relates to the technical field of computers, in particular to a three-dimensional model processing method and device and a storage medium, and the three-dimensional model processing method comprises the steps: obtaining a target three-dimensional model displayed in a display page according to scanning data corresponding to a to-be-trimmed three-dimensional entity model; determining a target area corresponding to a lasso operation in the target three-dimensional model according to the lasso operation interactively triggered by a user in the display page; converting local coordinates corresponding to the key points in the target three-dimensional model into screen pixel coordinates; and performing ray processing on the screen pixel coordinates corresponding to the key points in the target three-dimensional model and the surface patch indexes corresponding to the surface patches where the key points in the target three-dimensional model are located in the target area to obtain a lasso selection result of the target three-dimensional model. According to the method and the device, lasso can be carried out on the target area selected based on user interaction, so that the target three-dimensional model is cut based on the obtained lasso selection result, and finishing of the target three-dimensional model is completed.

The invention provides a puncture path planning method and system based on ray projection and collision detection, and the method comprises the steps: obtaining a 3D voxel data model of a to-be-punctured object, and carrying out the focus and organ segmentation of the 3D voxel data model according to a pre-trained organ segmentation model; generating uniformly distributed direction vectors from the center of a target focus in the segmented 3D voxel data model to a surrounding space by adopting a Fibonacci spherical sampling algorithm to obtain an initial path set; and performing collision detection on each path in the initial path set, calculating the length of each path passing the collision detection, and determining a candidate puncture path set according to an ascending sequence of the lengths of the paths in combination with a preset candidate threshold value. The technical problems of low reliability and low efficiency of puncture path planning in the prior art are effectively solved.

Aspects of the present disclosure are for an interaction mode system that provides multiple interaction modes in an artificial reality environment with automatic, context-specific transitions between interaction modes. An interaction mode can specify how the interaction mode system determines direction indications and movement within an artificial reality environment and interactions for making selections or performing other actions. In some implementations, the interaction mode system can control at least four interaction modes including a no-hands, 3DoF mode, a no-hands, 6DoF mode, a gaze and gesture mode, and a ray casting mode. The interaction mode system can employ a mapping of interaction mode context factors (e.g., which components are enabled, mode settings, lighting or other environment conditions, current body positions, etc.) to interaction modes to control transitioning between particular interaction modes. The interaction mode system can also provide affordances for signaling a current interaction mode and interaction mode transitions.

The present invention relates to a ray tracing device and method in combination with directed distance field ray casting, wherein the device comprises: a buffer; a construction setting circuit; and a ray casting circuit. The buffer stores a mesh directed distance field. The construction setting circuit establishes multiple bottom-level acceleration structures (BLAS) for multiple geometric bodies based on multiple sets of transformation data and attributes, adds information pointing to the mesh directed distance field in at least one of the BLAS, and stores the multiple BLAS in the buffer. The ray casting circuit traces rays in multiple steps according to a directed distance function under the mesh directed distance field for the BLAS that hits it, so as to approximate the intersection between the ray and the corresponding mesh surface. The present invention can improve the performance of ray tracing by adding information pointing to the mesh directed distance field in at least one BLAS and setting up the ray casting circuit as described above.

Aspects of the present disclosure are for an interaction mode system that provides multiple interaction modes in an artificial reality environment with automatic, context-specific transitions between interaction modes. An interaction mode can specify how the interaction mode system determines direction indications and movement within an artificial reality environment and interactions for making selections or performing other actions. In some implementations, the interaction mode system can control at least four interaction modes including a no-hands, 3DoF mode, a no-hands, 6DoF mode, a gaze and gesture mode, and a ray casting mode. The interaction mode system can employ a mapping of interaction mode context factors (e.g., which components are enabled, mode settings, lighting or other environment conditions, current body positions, etc.) to interaction modes to control transitioning between particular interaction modes. The interaction mode system can also provide affordances for signaling a current interaction mode and interaction mode transitions.

The application is suitable for the field of image processing technology, and provides a registration method and device for a two-dimensional image and a three-dimensional model. The method first extracts a two-dimensional image contour of a preset projection image, wherein the preset projection image is formed by projecting a target surface of a three-dimensional model of a target object to a preset plane, the target surface of the three-dimensional model is a surface of the three-dimensional model facing a preset direction, and the preset plane is perpendicular to the preset direction. Then, ray casting is performed on the two-dimensional image contour to extract a three-dimensional feature line of the three-dimensional model. Finally, based on the three-dimensional feature line, the two-dimensional image containing the target object and the three-dimensional model are registered. Thus, by the method of the two-dimensional image contour and the ray casting, the three-dimensional feature line on the three-dimensional model of the target object is automatically extracted and used for subsequent registration. Compared with the manual drawing method, the accuracy of the three-dimensional feature line extraction can be significantly improved, and thus the accurate registration of the two-dimensional image and the three-dimensional model is realized.

This application provides a cardiac electrophysiology simulation interaction method, control device, storage medium, and VR system, belonging to the field of VR technology. The method includes: acquiring cardiac electrophysiology simulation result data in VTK format; parsing the temporal volume data in the cardiac electrophysiology simulation result data to obtain cardiac voxel data and related metadata; rendering the cardiac voxel data and related metadata in a loop according to an initial frame rate and using a ray casting algorithm to achieve simulation in a VR visual environment; monitoring trigger events and adjusting the rendering data according to an interactive control mechanism. This application achieves seamless integration of VTK format cardiac volume data with the Unity engine, ensuring high-performance rendering of high-precision 3D data in a virtual reality environment; this application also provides a temporal volume data rendering architecture, achieving smooth playback of large-scale cardiac electrophysiology simulation data through streaming loading and frame caching mechanisms.