39 results about "Ray casting" patented technology

The invention relates to the technical field of virtual reality cultural relic construction, in particular to a cultural relic three-dimensional construction VR display system based on multi-modal data fusion. The specific implementation process comprises the steps of obtaining a laser point cloud and a two-dimensional image of the surface of a cultural relic, respectively generating a geometric point cloud and a visual sparse point cloud, and inputting the geometric point cloud and the visual sparse point cloud into a modal registration model based on geometry-luminosity combined constraint to complete pixel alignment and data fusion; performing texture mapping by using a Markov random field to generate a three-dimensional mapping model, generating a feature saliency map based on curvature calculation, and performing differential mesh simplification on flat and detail areas to output a polygonal contour; and generating a normal and a replacement map by using a ray casting algorithm, and importing the normal and the replacement map into a virtual reality engine for rendering display in combination with the polygonal contour. According to the method, a multi-mode joint optimization and differentiation grid simplification technology is utilized, dislocation and ghosting of texture mapping are effectively eliminated, and while VR rendering fluency is guaranteed, microscopic geometric details and physical material attributes of cultural relics are reserved.

The invention discloses a three-dimensional acoustic visualization rendering method and system based on sound field modeling. The method comprises the following steps: arranging a microphone array to collect a multi-channel time domain audio signal, and carrying out short-time Fourier transform to obtain frequency domain complex sound pressure data; performing inversion based on a beam forming algorithm to obtain complex sound pressure of each voxel point in a three-dimensional space, and constructing a four-dimensional acoustic voxel matrix; further utilizing a volume ray projection algorithm to map the volume element data into color and transparency, and realizing three-dimensional rendering and visual expression of the sound field; the system supports frequency screening, time evolution playback, transparency adjustment and three-dimensional visual angle control, and the visual analysis capability of the sound field is improved; and meanwhile, a structured data output interface is provided and can be linked with an AI algorithm, so that intelligent functions such as acoustic anomaly detection and tuning optimization are realized. The method has the capabilities of high-precision modeling, deep rendering expression and intelligent expansion, and is suitable for various acoustic application scenes such as intelligent sound boxes, vehicle-mounted sound boxes, conference systems and the like.

The invention discloses a dynamic octree mapping method and system based on probability semantic fusion and a storage medium, and mainly solves the problem that a traditional octree map lacks semantic information and cannot support an advanced cognitive task. According to the implementation scheme, the method comprises the following steps: acquiring an RGB image, depth information and pose data through a sensor; extracting pixel-level semantic probability distribution by using a pre-trained semantic segmentation network; geometric information in the perception data is projected to a three-dimensional space based on the pose, and a three-dimensional observation point with semantic information is formed; performing ray projection on octree nodes, respectively updating geometric occupancy states of penetrated non-end-point nodes, and synchronously updating geometric occupancy states and semantic belief distribution of end-point surface nodes by using three-dimensional observation point data; semantic information is continuously optimized through Bayesian probability fusion, and dynamic pruning and map optimization are realized based on semantic entropy. According to the method, the map storage efficiency and the calculation speed can be remarkably improved while refined and real-time updated geometric and semantic information is given. The method can be used for map construction and storage of visual SLAM positioning, and fine three-dimensional object modeling and environment information description.

The invention relates to an electric field visualization real-time monitoring system and method, belongs to the technical field of electric field visualization, and is used for solving the problems of insufficient real-time performance, large measurement interference, incomplete imaging, weak multi-user cooperation and lack of unified time reference in the prior art. The method comprises the following steps: acquiring electric field scattering data of a test body by a conformal optical fiber electric field sensor array, transmitting the electric field scattering data to an edge GPU node through a plastic optical fiber-CAN-FD link, and converting the electric field scattering data into electric field amplitude data; the edge GPU node is combined with WebGL3D texture mapping and a volume ray casting algorithm to complete volume rendering, and multi-user concurrent interaction is realized through a Web server and a browser client; and a White-Rabbit clock architecture is adopted to provide a unified time reference for the whole process. According to the method, dynamic and accurate capturing of the electric field is achieved, and the multi-user concurrent access requirement is effectively met.

This invention relates to the fields of wildfire monitoring, computer vision, and digital twin technology. It proposes a method and system for real-time wildfire spread simulation using digital twins and dynamic parameter inversion. The method dynamically inverts the surface combustible moisture content through white balance adaptive correction and HSV color feature extraction; maps physical camera parameters to a virtual camera; and uses a spatial ray casting algorithm and a digital elevation model to calculate the three-dimensional geographic coordinates of the fire point; it determines the wildfire spread direction by weighting the wind field vector and the maximum upslope vector in real time; it calculates the true slope of the dynamic path by taking points forward from the fire point as the starting point and using the grid accuracy of the digital elevation model as the step size; and it inputs the dynamic parameters into the wildfire spread model for simulation to generate the fire spread boundary. This invention significantly improves the physical realism and practical accuracy of wildfire spread simulation in complex environments through virtual-real fusion and physical correction mechanisms.

The invention provides a broken shaft protection method for a circuitous wheel of an aerial passenger device, and relates to the field of coal mine safety monitoring. The problems that in the prior art, space-time alignment errors of multi-source data are large, a physical field is distorted, and real-time performance is insufficient are solved. Through dynamic graph structure modeling, heterogeneous sensors such as a vibration sensor, a temperature sensor, a displacement sensor and the like are mapped into space-time association graph nodes, edge connection is constructed based on spatial proximity and time synchronism, and continuity characteristics of an equipment structure are coded. And generating a three-dimensional continuous field and dynamically visualizing the three-dimensional continuous field through a ray casting volume rendering technology. According to the scheme, high-precision and high-real-time technical support is provided for broken shaft fault early warning.

Sparse local fields for simulation include obtaining a scene that includes object voxel grids for objects. The object voxel grids include an object voxel grid with the object voxel grid including a voxel positioning property, a geometry field property, and a color field property of the voxel in the object voxel grid. The operations further include identifying an image plane of a first virtual sensor and a set of virtual sensor properties of a second virtual sensor capturing the scene. The operations also include performing, using the object voxel grids, rasterization of the scene on the image plane and ray casting through the scene using the set of virtual sensor properties to generate a first virtual sensor snapshot and a second virtual sensor snapshot. The operations also include outputting the first virtual sensor snapshot and the second virtual sensor snapshot.

Systems and techniques are provided for processing image data corresponding to a scene. A method may include generating a planar distance map including planar distance values for each pixel of at least one image corresponding to a scene. Plane segmentation is performed based on the plane distance map, a normal map corresponding to the at least one image, and position encoding information of the plane distance map. Triangular mesh segments are initialized based on sampling points from each of a plurality of planar segments from planar segmentation. A ray-triangular intersection is determined based on performing ray casting on a reconstructed planar grid comprising a plurality of triangular grid segments, each triangular grid segment corresponding to a different image. A planar reconstruction and segmentation machine learning network is optimized for a scene based on training the planar reconstruction and segmentation machine learning network using one or more loss functions.

Lithography mask generation processes utilizing a forward process that decomposes a resist pattern into segments and rasterizes the segments into a mask pattern using ray casting, and a backward process that determines lithography gradients for edge movements that incorporate mask rule constraints and propagates the lithography gradients into gradients and velocities for the segments.

The application provides a single-frame three-dimensional point cloud data visualization method based on multi-level distance interpolation, and relates to the technical field of visualization.The application improves the operation speed without losing original data information by performing multi-level distance interpolation on discrete three-dimensional space points, and realizes the balance between the calculation accuracy and the speed.In addition, according to the characteristics of the terrain three-dimensional space data field, the application changes the gradient calculation method in the traditional ray casting algorithm, improves the original ray casting algorithm, proposes the multi-level distance interpolation ray casting algorithm, calculates the gradient in advance, speeds up the rendering process, and further shortens the operation time.The original data is subjected to the first distance interpolation to generate a new three-dimensional space data field, and the generated three-dimensional space data field is subjected to gradient calculation and secondary interpolation operation, so that the high accuracy is retained while the operation speed is improved, and real-time high-precision drawing is realized.

A client device and a controller allow a user to control AR content by selecting real-world locations or objects. The client receives position data indicating a position and orientation of the controller, the position data defining an axis of the controller. The client device performs ray casting to determine a location in a 3D map of a real-world that intersects the axis. The client device receives a selection indication (e.g., a user pressing a button on the controller). The client device selects, subsequent to the selection indication, the location in the 3D map that intersects the axis as a waypoint. The client device defines a route for a virtual object based on the waypoint.

The invention discloses a volume rendering method and system for non-uniform ocean scalar field data, and belongs to the field of GIS (Geographic Information System). Aiming at the characteristic that ocean scalar field data such as sea temperature is not uniformly distributed in depth, a step sampling method for self-adaptive step length of a ray casting algorithm is realized by constructing depth interval textures, and a nonlinear color mapping enhancement method is adopted according to statistical characteristics of data distribution to enhance spatial distribution characteristics, so that the accuracy of the data distribution is improved. The problems of low rendering efficiency and poor visualization effect caused by data redundancy or information loss in a traditional method are solved. According to the method, the rendering speed and the image quality of the non-uniform scalar field data in the three-dimensional virtual earth environment can be effectively improved, and the method has important technical value and practical significance in application in the fields of marine scientific research, environment monitoring and the like.

An apparatus includes a memory for storing image data; and processing circuitry in communication with the memory. The processing circuitry is configured to obtain a plurality of camera images and generate camera features from the plurality of camera images. According to such an example, processing circuitry may be configured to project the camera features from the plurality of camera images into a birds-eye-view (BEV) image space to generate BEV features. In certain examples, processing circuitry is configured to determine a plurality of zero-value locations of the BEV features within the BEV image space and diffuse non-zero BEV features in the BEV image space into the plurality of zero-value locations within the BEV image space to generate increased density BEV features. In at least one example, processing circuitry is configured to output a BEV image having the increased density BEV features.

This invention belongs to the field of image processing technology. It provides a method, apparatus, and system for rendering digital content in an image, comprising: acquiring all transparent objects in the rendering scene, classifying and labeling them and assigning unique IDs; dividing the scene into equal spatial blocks using an octree algorithm; equipping each spatial block with a unique set of classification labels; constructing a static transparent object depth value table; establishing a dynamic depth value prediction model by combining dynamic object motion parameters, animation keyframes, or interaction history; filtering effective spatial blocks through axis-aligned bounding boxes and view frustum intersection tests; generating an initial rendering sorting table by combining the maximum depth value of static objects and the depth stability weight of dynamic objects; filtering overlapping transparent object combinations based on oriented bounding boxes and the separating axis theorem; verifying spatial relationships using ray casting; and correcting the sorting order using a weighted scoring method.

This invention discloses a dual-resolution ESDF map construction method for autonomous driving, belonging to the field of environmental perception and 3D map construction technology for autonomous vehicles. This method divides the 3D space into a near-field high-resolution region and a far-field low-resolution region, maintaining occupied grids and ESDF distance information at different voxel resolutions. Ray projection is used to probabilistically update free space and occupied voxels for depth maps or point clouds. When a new occupied voxel is detected, it is used as a distance source to trigger local wavefront propagation for incremental ESDF updates. When an occupied voxel disappears, the affected voxel is quickly located by influencing the index structure and recalculating the failure, significantly reducing the overhead of full map recalculation. Simultaneously, distance and occupancy are synchronized in inter-layer boundary regions. Compared with existing single-resolution ESDF methods, this invention significantly reduces memory usage and improves real-time update performance for large scenes while maintaining near-field distance accuracy.

A client device and a controller allow a user to control AR content by selecting real-world locations or objects. The client receives position data indicating a position and orientation of the controller, the position data defining an axis of the controller. The client device performs ray casting to determine a location in a 3D map of a real world that intersects the axis. The client device receives a selection indication (e.g., a user pressing a button on the controller). The client device selects, subsequent to the selection indication, the location in the 3D map that intersects the axis as a waypoint. The client device defines a route for a virtual object based on the waypoint.

The invention belongs to the technical field of intelligent medical assistance, and discloses an AR-based soft tissue tumor resection auxiliary planning method. By introducing a hybrid deep learning model based on SAMMMed and DeepSnake, high-precision tumor segmentation and boundary optimization are realized, and the problem of discontinuous soft tissue image boundaries is solved; a point cloud registration system combining rigid and non-rigid algorithms is constructed, and dynamic alignment and real-time updating of a preoperative model and intra-operative scanning data are achieved; a visualization method based on volume rendering ray casting is adopted, a high-fidelity three-dimensional visualization effect is generated, and a doctor is helped to obtain clear spatial cognition in an operation; an optical navigation system and an augmented reality head display equipment coordinate system are uniformly fused, so that accurate correspondence of virtual-real superposition is realized, and the stability and accuracy of model display in an operation are ensured; a voice recognition and gesture interaction mechanism is introduced, non-contact operation is achieved, the sterile requirement of an operating room is met, and the operation naturalness and convenience are improved.

The invention provides a three-dimensional radar rendering method and device, equipment and a storage medium, and the method comprises the steps: obtaining original meteorological radar echo data, carrying out the data processing of the original meteorological radar echo data through a multi-thread technology, and obtaining the processed data; performing data interpolation based on the processed data, and constructing a three-dimensional voxel data model; voxel rendering is carried out based on the three-dimensional voxel data model, voxel data in the three-dimensional voxel data model is organized and managed by utilizing a spatial octree data structure, and a rendered model is obtained by adopting an early termination strategy based on a ray casting algorithm; integrating and matching the rendered model with a geographic information engine to obtain an integrated model; and performing interactive operation with the integrated model through input equipment. In the voxel rendering process, the spatial octree data structure is utilized to organize and manage the voxel data, and an early termination strategy based on a ray casting algorithm is adopted, so that the problem of large-scale data rendering lag is effectively relieved.

The invention provides a puncture path planning method and system based on ray projection and collision detection, and the method comprises the steps: obtaining a 3D voxel data model of a to-be-punctured object, and carrying out the focus and organ segmentation of the 3D voxel data model according to a pre-trained organ segmentation model; generating uniformly distributed direction vectors from the center of a target focus in the segmented 3D voxel data model to a surrounding space by adopting a Fibonacci spherical sampling algorithm to obtain an initial path set; and performing collision detection on each path in the initial path set, calculating the length of each path passing the collision detection, and determining a candidate puncture path set according to an ascending sequence of the lengths of the paths in combination with a preset candidate threshold value. The technical problems of low reliability and low efficiency of puncture path planning in the prior art are effectively solved.

Aspects of the present disclosure are for an interaction mode system that provides multiple interaction modes in an artificial reality environment with automatic, context-specific transitions between interaction modes. An interaction mode can specify how the interaction mode system determines direction indications and movement within an artificial reality environment and interactions for making selections or performing other actions. In some implementations, the interaction mode system can control at least four interaction modes including a no-hands, 3DoF mode, a no-hands, 6DoF mode, a gaze and gesture mode, and a ray casting mode. The interaction mode system can employ a mapping of interaction mode context factors (e.g., which components are enabled, mode settings, lighting or other environment conditions, current body positions, etc.) to interaction modes to control transitioning between particular interaction modes. The interaction mode system can also provide affordances for signaling a current interaction mode and interaction mode transitions.

Aspects of the present disclosure are for an interaction mode system that provides multiple interaction modes in an artificial reality environment with automatic, context-specific transitions between interaction modes. An interaction mode can specify how the interaction mode system determines direction indications and movement within an artificial reality environment and interactions for making selections or performing other actions. In some implementations, the interaction mode system can control at least four interaction modes including a no-hands, 3DoF mode, a no-hands, 6DoF mode, a gaze and gesture mode, and a ray casting mode. The interaction mode system can employ a mapping of interaction mode context factors (e.g., which components are enabled, mode settings, lighting or other environment conditions, current body positions, etc.) to interaction modes to control transitioning between particular interaction modes. The interaction mode system can also provide affordances for signaling a current interaction mode and interaction mode transitions.

The application is suitable for the field of image processing technology, and provides a registration method and device for a two-dimensional image and a three-dimensional model. The method first extracts a two-dimensional image contour of a preset projection image, wherein the preset projection image is formed by projecting a target surface of a three-dimensional model of a target object to a preset plane, the target surface of the three-dimensional model is a surface of the three-dimensional model facing a preset direction, and the preset plane is perpendicular to the preset direction. Then, ray casting is performed on the two-dimensional image contour to extract a three-dimensional feature line of the three-dimensional model. Finally, based on the three-dimensional feature line, the two-dimensional image containing the target object and the three-dimensional model are registered. Thus, by the method of the two-dimensional image contour and the ray casting, the three-dimensional feature line on the three-dimensional model of the target object is automatically extracted and used for subsequent registration. Compared with the manual drawing method, the accuracy of the three-dimensional feature line extraction can be significantly improved, and thus the accurate registration of the two-dimensional image and the three-dimensional model is realized.

This application provides a cardiac electrophysiology simulation interaction method, control device, storage medium, and VR system, belonging to the field of VR technology. The method includes: acquiring cardiac electrophysiology simulation result data in VTK format; parsing the temporal volume data in the cardiac electrophysiology simulation result data to obtain cardiac voxel data and related metadata; rendering the cardiac voxel data and related metadata in a loop according to an initial frame rate and using a ray casting algorithm to achieve simulation in a VR visual environment; monitoring trigger events and adjusting the rendering data according to an interactive control mechanism. This application achieves seamless integration of VTK format cardiac volume data with the Unity engine, ensuring high-performance rendering of high-precision 3D data in a virtual reality environment; this application also provides a temporal volume data rendering architecture, achieving smooth playback of large-scale cardiac electrophysiology simulation data through streaming loading and frame caching mechanisms.

The invention discloses an aneurysm wall enhanced local quantitative analysis method and system based on ray projection, and the method comprises the steps: collecting an MRI sequence of a patient, calculating the contrast corresponding to each voxel, and determining an optimal contrast threshold; constructing a preliminary aneurysm sac model and a preliminary enhanced area model, establishing a spatial position corresponding relation between the two models, and performing spatial alignment; calculating the local geometric wall thickness G corresponding to each triangular patch; determining each sampling point and acquiring the contrast ratio of each sampling point; calculating the reinforcement wall thickness E and the average reinforcement strength M corresponding to each surface patch; and integrating the enhanced wall thickness E and the average enhanced strength M corresponding to each patch into a patch-level data set, mapping the patch-level data set into color attributes of the surface of the three-dimensional model, and obtaining and outputting a three-dimensional color heat map. According to the method, local quantification of enhanced wall thickness and strength is realized by establishing a surface patch level analysis framework, and the core technical problem of enhanced quantitative analysis of the intracranial aneurysm wall is solved.

This invention belongs to the field of endoscopy technology, specifically an endoscopy image blind spot detection and 3D reconstruction system, including an endoscopy imaging module, a posture perception module, a blind spot dynamic detection module, a reliable completion module, and a 3D surface reconstruction module. It constructs a visible volume model through ray projection to identify blind spots, integrates prior knowledge of cavity anatomy with Poisson surface interpolation for reliable completion, and combines a topological rationality discriminator and photometric consistency feedback to achieve dual verification, ultimately generating a complete and geometrically consistent 3D model.

The present disclosure provides a system and method for image processing. The method may include obtaining an initial rendered image of a subject generated based on three-dimensional (3D) imaging data; obtaining one or more characteristic parameters corresponding to the 3D imaging data determined by performing a ray casting operation on the 3D imaging data; and generating a target rendered image of the subject by inputting the initial rendered image and the one or more characteristic parameters into a trained image processing model.

The invention relates to the technical field of intelligent manufacturing, in particular to an LLM multi-agent-based processing technology intelligent planning and simulation verification system, which adopts a layered architecture design and comprises a core coordination layer, a professional execution layer and an infrastructure layer, and the layers collaboratively realize intelligent planning and simulation verification of a processing technology; and the core coordination layer is a central LLM intelligent agent. A layered framework is adopted, a central LLM intelligent body is used as a core coordination layer, professional execution layer intelligent bodies such as manufacturability analysis and processing feature recognition and an infrastructure layer are matched, LLM space geometric analysis shortages are solved through a ray method, manufacturing professional knowledge is complemented by relying on a structured process knowledge base, NX platform simulation verification and an artificial feedback closed loop are combined, and therefore the manufacturing efficiency is improved. Automatic and precise generation from the CAD model to the process scheme is achieved, the planning period is shortened, the machining risk and expert dependence are reduced, and the machining requirements of complex parts in multiple fields are met.

Embodiments of the present disclosure disclose an occupancy probability grid map updating method, device, equipment and medium, the method comprising: obtaining hit points and boundary miss points associated with single-frame point cloud data; using a ray casting algorithm to associate and count ray casting data of the hit points and boundary miss points with a counting grid submap to obtain a statistical result; and updating an occupancy probability grid submap to be updated according to the statistical result, wherein a coordinate system of the counting grid submap coincides with a coordinate system of the occupancy probability grid submap, the statistical result comprises types of each grid in the counting grid submap and a number of hit events or miss events of each grid, and the types of the grid include hit grids and miss grids. The present disclosure improves the updating accuracy of the occupancy probability grid map.

This disclosure provides a method for gesture manipulation on a display. The method includes: obtaining, through a camera, a hand image of a hand of a user; performing, by a processor, a hand tracking of the hand based on the hand image; performing, by the processor, a ray casting based on the hand tracking; obtaining, by the processor, a casting point on a screen of the display based on the ray casting; rendering, by the processor, a rendered point on the screen of the display based on the casting point and a projection matrix; and updating, by the processor, the projection matrix based on the casting point and the rendered point.

An agricultural produce assessment system has a memory configured to store one or more AI models; and a processor coupled to the memory. The processor is configured to: receive one or more images captured by a mobile device; segment at least one produce object in the one or more images using the one or more AI models; determine a 3D position of the at least one produce object by ray casting from an image position of the at least one produce object to a 3D mesh, wherein the 3D mesh is generated by the mobile device based on relative position data of the mobile device with reference to the at least one produce object; and generate an assessment output by tracking the at least one produce object in the one or more images based on the determined 3D position.