Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

93 results about "Ray casting" patented technology

Ray casting is the use of ray–surface intersection tests to solve a variety of problems in 3D computer graphics and computational geometry. The term was first used in computer graphics in a 1982 paper by Scott Roth to describe a method for rendering constructive solid geometry models.

Planar mesh reconstruction using images from multiple camera poses

Systems and techniques are provided for processing image data corresponding to a scene. A process can include generating a planar distance map including a planar distance value for each pixel of at least one image corresponding to the scene. Planar segmentation is performed based on the planar distance map, a normal map corresponding to the at least one image, and positional encoding information of the planar distance map. A triangular mesh fragment is initialized based on sampling points from each planar segment of a plurality of planar segments from the planar segmentation. Ray-triangle intersections are determined based on performing ray casting for a reconstructed planar mesh including a plurality of triangular mesh fragments each corresponding to a different image. A planar reconstruction and segmentation machine learning network is optimized for the scene, based on training the planar reconstruction and segmentation machine learning network using one or more loss functions.
Owner:QUALCOMM INC

Voice-Enabled Virtual Object Disambiguation and Controls in Artificial Reality

Aspects of the present disclosure are directed to applying voice controls to a target virtual object in an artificial reality environment. User controls in an artificial reality environment can take many forms. Some user controls, such as ray casting or gaze tracking, can incorporate selection mechanics to select the artificial reality environment element (e.g., virtual object) that the user is targeting for interaction. Other forms of user controls, such as voice controls, may not include such selection mechanics. Implementations disambiguate user voice input to select a target virtual object and control the target virtual object based on the voice input. For example, a disambiguation and control layer can select the virtual object the user intends to target with voice input, format input for the target virtual object using the voice input, and control the target virtual object via execution of one or more applications that manage the virtual object.
Owner:META PLATFORMS INC

High-performance volume rendering method and system based on autonomous controllable GPU pre-rendering

The invention provides a high-performance volume rendering method and system based on autonomous controllable GPU pre-rendering. Curvature distribution characteristics of voxel surfaces are extracted through dynamic topology analysis to construct preprocessing metadata, and a reconfigurable computing array is driven to dynamically divide a hardware topology structure of a high-density ray casting unit and a hardware topology structure of a low-power-consumption interpolation unit according to the curvature characteristics. And task allocation and cooperative execution of heterogeneous computing units are realized based on an asynchronous computing engine, and finally, a multi-scale sampling result is fused through a hardware-level optimized mixed weight algorithm in an autonomous controllable rendering pipeline, and a closed-loop feedback mechanism of a rendering result and preprocessed metadata is established. According to the method, voxel geometric features, hardware architecture reconstruction and asynchronous calculation scheduling are innovatively and deeply coupled, and a technical closed loop of data feature driven hardware resource configuration and rendering result reverse optimization preprocessing parameters is formed. According to the technical scheme provided by the invention, high-fidelity real-time volume rendering of medical images and scientific data is realized.
Owner:THE PLA NAVY SUBMARINE INST

Non-uniform cuboid grid adaptive sampling volume drawing method based on GPU acceleration

ActiveCN119047261AAvoid repeated sampling multiple timesControl the amount of sampling calculationsDesign optimisation/simulationProcessor architectures/configurationData packAlgorithm
The invention discloses a non-uniform cuboid grid adaptive sampling volume drawing method based on GPU acceleration, which comprises the following steps: firstly, generating a sampling ray set of a non-uniform cuboid grid based on data bounding box rendering and GPU multi-thread calculation, then calculating an intersection point of each ray and a grid unit surface, and determining an adaptive sampling point coordinate position; and then storing the non-uniform cuboid grid data in a three-dimensional texture memory of a GPU in a normalization mode, performing texture hardware query by using the weighted and corrected adaptive sampling point coordinates to obtain a trilinear interpolation result scalar value at the sampling point, and finally, calculating the color and transparency corresponding to the sampling point according to a transfer function to obtain the three-dimensional texture data of the GPU. And correct color synthesis of all sampling points on the rays is realized by using an Underer operator in Alpha fusion, and finally a visual result image is formed. Experimental results show that the Ray Casting volume rendering calculation efficiency of the non-uniform cuboid grid can be effectively improved, and the visual analysis calculation process of the non-uniform cuboid grid is accelerated.
Owner:XIAN YUSHENSUAN SECURITY TECHNOLOGY CO LTD

Method for automatically generating medical image transfer function based on generative adversarial network

The invention provides a generative adversarial network-based medical image transfer function automatic generation method, which comprises the following steps of: firstly, initializing a transfer function by using a Gaussian primitive, and carrying out multi-angle sampling on a rendering lens of volume data to obtain an optimal observation view angle of the volume data; generating rendering images of different transfer functions according to the optimal view angle and the transfer function by using a ray casting technology; secondly, selecting edge and gradient features as a clustering basis, and clustering rendered images of different transfer functions by using a k-means algorithm to obtain clustering tags; then, a CGAN-TF model is constructed, and the CGAN-TF model is trained by using a transfer function and a clustering label; and finally, selecting the generated transfer function by using a transfer function exploration component, and exploring and modifying according to requirements to obtain the transfer function with good performance and a corresponding visual rendering image. The method has the capability of generating the corresponding transfer function according to the label, and the stability is high.
Owner:ZHENGZHOU UNIVERSITY OF LIGHT INDUSTRY

Blank space jump volume rendering acceleration method and system based on unsigned distance field

The invention belongs to the technical field of data acquisition, and discloses a white space jump volume rendering acceleration method and system based on an unsigned distance field, and the white space jump volume rendering acceleration method based on the unsigned distance field comprises the steps: according to the spatial distribution characteristics of volume data; a three-dimensional unsigned distance texture map is obtained through pre-calculation of a calculation shader, and the map displays the Euclidean distance from a current voxel to a nearest non-empty voxel. Ray casting is executed in the pixel shader, and a plurality of continuous blank spaces can be skipped through one query before sampling each time, so that a large number of invalid sampling times are effectively reduced. Rendering contrast experiments of various different data sets show that the rendering speed of the method is improved by 345% compared with that of a traditional ray casting volume rendering method, the rendering speed of the method is 52% higher than that of an occupancy map method, and the rendering speed of the method is 33% higher than that of a chebyshev distance map.
Owner:CHENGDU UNIV OF INFORMATION TECH

Multi-modal data fusion-based cultural relic three-dimensional construction VR display system

The invention relates to the technical field of virtual reality cultural relic construction, in particular to a cultural relic three-dimensional construction VR display system based on multi-modal data fusion. The specific implementation process comprises the steps of obtaining a laser point cloud and a two-dimensional image of the surface of a cultural relic, respectively generating a geometric point cloud and a visual sparse point cloud, and inputting the geometric point cloud and the visual sparse point cloud into a modal registration model based on geometry-luminosity combined constraint to complete pixel alignment and data fusion; performing texture mapping by using a Markov random field to generate a three-dimensional mapping model, generating a feature saliency map based on curvature calculation, and performing differential mesh simplification on flat and detail areas to output a polygonal contour; and generating a normal and a replacement map by using a ray casting algorithm, and importing the normal and the replacement map into a virtual reality engine for rendering display in combination with the polygonal contour. According to the method, a multi-mode joint optimization and differentiation grid simplification technology is utilized, dislocation and ghosting of texture mapping are effectively eliminated, and while VR rendering fluency is guaranteed, microscopic geometric details and physical material attributes of cultural relics are reserved.
Owner:INST OF CULTURAL & HISTORICAL RELICS & ARCHAEOLOGY HENAN

Three-dimensional acoustic visualization rendering method and system based on sound field modeling

The invention discloses a three-dimensional acoustic visualization rendering method and system based on sound field modeling. The method comprises the following steps: arranging a microphone array to collect a multi-channel time domain audio signal, and carrying out short-time Fourier transform to obtain frequency domain complex sound pressure data; performing inversion based on a beam forming algorithm to obtain complex sound pressure of each voxel point in a three-dimensional space, and constructing a four-dimensional acoustic voxel matrix; further utilizing a volume ray projection algorithm to map the volume element data into color and transparency, and realizing three-dimensional rendering and visual expression of the sound field; the system supports frequency screening, time evolution playback, transparency adjustment and three-dimensional visual angle control, and the visual analysis capability of the sound field is improved; and meanwhile, a structured data output interface is provided and can be linked with an AI algorithm, so that intelligent functions such as acoustic anomaly detection and tuning optimization are realized. The method has the capabilities of high-precision modeling, deep rendering expression and intelligent expansion, and is suitable for various acoustic application scenes such as intelligent sound boxes, vehicle-mounted sound boxes, conference systems and the like.
Owner:NANJING JIQIDAO INTELLIGENT TECH CO LTD

Octree mapping method and system based on semantic information and storage medium

The invention discloses a dynamic octree mapping method and system based on probability semantic fusion and a storage medium, and mainly solves the problem that a traditional octree map lacks semantic information and cannot support an advanced cognitive task. According to the implementation scheme, the method comprises the following steps: acquiring an RGB image, depth information and pose data through a sensor; extracting pixel-level semantic probability distribution by using a pre-trained semantic segmentation network; geometric information in the perception data is projected to a three-dimensional space based on the pose, and a three-dimensional observation point with semantic information is formed; performing ray projection on octree nodes, respectively updating geometric occupancy states of penetrated non-end-point nodes, and synchronously updating geometric occupancy states and semantic belief distribution of end-point surface nodes by using three-dimensional observation point data; semantic information is continuously optimized through Bayesian probability fusion, and dynamic pruning and map optimization are realized based on semantic entropy. According to the method, the map storage efficiency and the calculation speed can be remarkably improved while refined and real-time updated geometric and semantic information is given. The method can be used for map construction and storage of visual SLAM positioning, and fine three-dimensional object modeling and environment information description.
Owner:XIDIAN UNIV

Visual real-time monitoring system and method for electric field

The invention relates to an electric field visualization real-time monitoring system and method, belongs to the technical field of electric field visualization, and is used for solving the problems of insufficient real-time performance, large measurement interference, incomplete imaging, weak multi-user cooperation and lack of unified time reference in the prior art. The method comprises the following steps: acquiring electric field scattering data of a test body by a conformal optical fiber electric field sensor array, transmitting the electric field scattering data to an edge GPU node through a plastic optical fiber-CAN-FD link, and converting the electric field scattering data into electric field amplitude data; the edge GPU node is combined with WebGL3D texture mapping and a volume ray casting algorithm to complete volume rendering, and multi-user concurrent interaction is realized through a Web server and a browser client; and a White-Rabbit clock architecture is adopted to provide a unified time reference for the whole process. According to the method, dynamic and accurate capturing of the electric field is achieved, and the multi-user concurrent access requirement is effectively met.
Owner:NAVAL AVIATION UNIV

Systems and methods for generating synthetic sensor data via machine learning

The present disclosure provides systems and methods that combine physics-based systems with machine learning to generate synthetic LiDAR data that accurately mimics a real-world LiDAR sensor system. In particular, aspects of the present disclosure combine physics-based rendering with machine-learned models such as deep neural networks to simulate both the geometry and intensity of the LiDAR sensor. As one example, a physics-based ray casting approach can be used on a three-dimensional map of an environment to generate an initial three-dimensional point cloud that mimics LiDAR data. According to an aspect of the present disclosure, a machine-learned model can predict one or more dropout probabilities for one or more of the points in the initial three-dimensional point cloud, thereby generating an adjusted three-dimensional point cloud which more realistically simulates real-world LiDAR data.
Owner:AURORA OPERATIONS INC

Volume data rendering acceleration method for blank space jump

The invention provides a volume data rendering acceleration method for blank space jump, which relates to the field of volume data rendering, and comprises the following steps: judging whether a volume data block to which a current light sampling point belongs has a non-empty voxel, if the volume data block is a blank volume data block, entering a Chebyshev jump stage, jumping the blank volume data block based on a Chebyshev distance map, and if not, entering a Chebyshev jump stage; and if not, entering a voxel-level jump stage. And in the voxel-level jumping stage, judging whether the voxel is non-empty, if the voxel is non-empty, executing a ray casting sampling process, and if the voxel is empty, entering the jumping stage based on the unsigned distance map to jump the blank voxel. And performing adaptive sampling step length adjustment based on the gradient amplitude, the volume data value and the viewpoint distance. And when the light is emitted out of the cube, iteration is stopped. According to the technical scheme, the problems that in the prior art, efficient skipping of empty voxels cannot be achieved, and the calculation efficiency of a ray casting algorithm is low are solved.
Owner:CHINA UNIV OF PETROLEUM (EAST CHINA)

Static map generation method in indoor dynamic environment

The invention discloses a static map generation method in an indoor dynamic environment, and the method comprises the steps: carrying out the mapping through employing an SLAM algorithm, and obtaining a point cloud map containing a dynamic object; preprocessing point clouds in the point cloud map, removing point cloud noise, and meanwhile, performing ground segmentation to obtain ground points and non-ground points; on the basis of an octree structure, updating the point cloud map with the point cloud noise removed in real time to obtain an updated map; performing superposition scanning on non-ground points by using a ray casting method, and identifying a potential dynamic region through a preset confidence threshold; performing multi-frame consistency detection on the potential dynamic area, and if the occupancy probability of the node in the potential dynamic area changes, judging the point cloud corresponding to the node as a dynamic point cloud; and removing the dynamic point cloud in the updated map to generate a static map. According to the method, superposition scanning and multi-frame consistency detection are performed on the point clouds in the indoor dynamic environment, so that the dynamic point clouds can be quickly identified, and the dynamic point clouds are rejected to generate the static map.
Owner:CHENGDU UNIV OF INFORMATION TECH

Mesh generation method and apparatus, computer-readable storage medium and electronic apparatus

A mesh generation method and apparatus, a computer-readable storage medium, and an electronic apparatus. The mesh generation method comprises: acquiring attribute information of a target mesh to be fitted to the surface of a three-dimensional scene (S202); on the basis of a mesh rendering attribute in the attribute information, determining casting parameters corresponding to a target vertex on the target mesh (S204); performing ray casting on the surface of the three-dimensional scene on the basis of the casting parameters, and determining a fitting position of the target vertex with respect to the surface of the three-dimensional scene (S206); and, on the basis of the fitting position of the target vertex and a mesh structural attribute in the attribute information, generating the target mesh (S208). The present disclosure achieves the technical effect of dynamically generating fitted meshes on the basis of an arbitrary three-dimensional scene, thus solving the technical problem of relatively large limitations of dynamic rendering of three-dimensional scenes.
Owner:NETEASE (HANGZHOU) NETWORK CO LTD

Occlusion rendering method with ray casting and live depth

To provide a more immersive user experience method and augmented reality / mixed reality system capable of achieving an increased rate of update for occlusion data by using depth sensor data that has been augmented with lower level reconstruction data.SOLUTION: In an AR system using a world reconstruction system, when a perception module operates in real-time dynamic environments, changes in the physical world are reflected quickly in the occlusion data. Occlusion rendering using live depth data augmented with lower-level 3D reconstruction data, such as a ray casting point cloud, greatly reduces the latency for visual occlusion processing. Generating occlusion data in this way may provide faster operation of an XR system using less computing resources and enable the system to be packaged in a battery-operated wearable device.SELECTED DRAWING: Figure 6
Owner:MAGIC LEAP INC

Real-time deduction method and system for forest fire spread based on digital twin and dynamic parameter inversion

This invention relates to the fields of wildfire monitoring, computer vision, and digital twin technology. It proposes a method and system for real-time wildfire spread simulation using digital twins and dynamic parameter inversion. The method dynamically inverts the surface combustible moisture content through white balance adaptive correction and HSV color feature extraction; maps physical camera parameters to a virtual camera; and uses a spatial ray casting algorithm and a digital elevation model to calculate the three-dimensional geographic coordinates of the fire point; it determines the wildfire spread direction by weighting the wind field vector and the maximum upslope vector in real time; it calculates the true slope of the dynamic path by taking points forward from the fire point as the starting point and using the grid accuracy of the digital elevation model as the step size; and it inputs the dynamic parameters into the wildfire spread model for simulation to generate the fire spread boundary. This invention significantly improves the physical realism and practical accuracy of wildfire spread simulation in complex environments through virtual-real fusion and physical correction mechanisms.
Owner:山西省能源互联网研究院

GPU-Accelerated Adaptive Sampling Volume Rendering Method for Non-Uniform Cuboid Meshes

The present invention discloses a GPU-accelerated adaptive sampling volume rendering method for non-uniform cuboid meshes. First, based on data bounding box rendering and GPU multi-threaded computing, a set of sampling rays for non-uniform cuboid meshes is generated. Subsequently, the intersection points of each ray with the mesh cell faces are calculated and the coordinate positions of the adaptive sampling points are determined. Then, the non-uniform cuboid mesh data is stored in the 3D texture memory of the GPU in a normalized manner, and texture hardware queries are performed using the weighted and corrected adaptive sampling point coordinates to obtain the trilinear interpolation result scalar values at the sampling points. Finally, the colors and transparencies corresponding to the sampling points are calculated according to the transfer function, and the Under operator in Alpha blending is used to achieve the correct color synthesis of all sampling points on the ray, and finally a visualization result image is formed. Experimental results show that the present invention can effectively improve the computational efficiency of Ray Casting volume rendering for non-uniform cuboid meshes and accelerate the visualization analysis and calculation process of non-uniform cuboid meshes.
Owner:XIAN YUSHENSUAN SECURITY TECHNOLOGY CO LTD

Methods and systems for adaptive ray-casting of 3D scalar fields on wide SIMD machine

An adaptive ray-casting of 3D scalar fields on a wide SIMD machine process and system is described. In one example, a process initially casts / renders rays through a 3D scalar field to acquire information associated with specific properties of this 3D scalar field. The acquired information is then stored on a 2-D image plane. Each pixel on this 2D image plane represents the result of ray casting through the 3-D scalar field. The process of non-even / non-uniform / adaptive samplings along each ray aims / intends to minimize the number of samplings to obtain / acquire the most accurate approximation of the information of interest, doing that effectively on a wide SIMD machine.
Owner:FOVIA INC

Real-time 3D model and real scene fusion system based on smartphone camera

The present invention discloses a real-time 3D model and real scene fusion system based on a smartphone camera, and relates to the field of augmented reality technology. The system includes: a camera configured to obtain a real scene image; a real scene image modeling unit configured to model the real scene image into a high-dimensional data structure, and each object in the real scene image is represented as a high-dimensional feature vector; a light processing unit configured to perform reverse light projection for each pixel in the real scene image to determine the light path of the pixel, and interpolate the light path in a high-dimensional space to obtain the sampling point position; a fusion unit configured to calculate the energy distribution of each sampling point according to the sampling point position obtained by interpolation, and display the fused color value obtained by reverse projection in a 3D model to achieve fusion of the 3D model and the real scene. The present invention achieves high-quality, real-time and accurate fusion of 3D models and real scenes.
Owner:JINAN YITE NETWORK INFORMATION CO LTD

Gesture point selection and distance measurement method in three-dimensional point cloud perspective display mode

The application discloses a gesture point selection and distance measurement method in a three-dimensional point cloud perspective display mode, comprising the following steps: obtaining two-dimensional coordinates of a user gesture by using a touch screen of a smart mobile device, mapping the two-dimensional coordinates into a ray endpoint in a three-dimensional space coordinate system through normalization conversion and inverse matrix operation, converting the ray endpoint into actual three-dimensional coordinates, converting three-dimensional point cloud data from a Cartesian coordinate system into a cylindrical coordinate system, judging whether the ray intersects with a cylinder through a ray equation, screening intersection points meeting the conditions, calculating the shortest distance between the ray and the central axis of the cylinder, and determining whether a target point is selected through a distance threshold value. The application effectively avoids misoperation through minimum distance judgment and screening, improves the user's interactive experience, is suitable for various application scenarios such as augmented reality and virtual reality, optimizes the coordinate conversion and ray projection algorithm, and improves the response speed and accuracy of the system.
Owner:NANJING SIWEI VECTOR TECH CO LTD

Three-dimensional volume data visualization method, device and equipment based on ray casting, medium and program product

The invention relates to a three-dimensional volume data visualization method and device based on ray casting, computer equipment, a computer readable storage medium and a computer program product. The method comprises the steps of obtaining to-be-processed volume data; projecting a plurality of light rays to the volume data to be processed according to a preset light ray starting point and a field angle; sampling the volume data to be processed in the advancing direction of each light, and sequentially obtaining sampling values corresponding to a plurality of sampling points; wherein the sampling step length between the noise sampling point and the next sampling point is greater than the sampling step length between the non-noise sampling point and the next sampling point; the noise sampling points are sampling points belonging to a noise area of the to-be-processed volume data, and the non-noise sampling points are sampling points belonging to a non-noise area of the to-be-processed volume data; obtaining a synthetic output value corresponding to the light according to the sampling value of each light at each sampling point; and obtaining a rendered image corresponding to the to-be-processed volume data according to the synthetic output value corresponding to each light. By adopting the method, the rendering efficiency can be improved.
Owner:CHINA TELECOM CLOUD TECH CO LTD

Axle breakage protection method and system for circuitous wheel of aerial passenger device

The invention provides a broken shaft protection method for a circuitous wheel of an aerial passenger device, and relates to the field of coal mine safety monitoring. The problems that in the prior art, space-time alignment errors of multi-source data are large, a physical field is distorted, and real-time performance is insufficient are solved. Through dynamic graph structure modeling, heterogeneous sensors such as a vibration sensor, a temperature sensor, a displacement sensor and the like are mapped into space-time association graph nodes, edge connection is constructed based on spatial proximity and time synchronism, and continuity characteristics of an equipment structure are coded. And generating a three-dimensional continuous field and dynamically visualizing the three-dimensional continuous field through a ray casting volume rendering technology. According to the scheme, high-precision and high-real-time technical support is provided for broken shaft fault early warning.
Owner:NO 1 MINE PINGDINGSHAN TIANAN COAL

Sparse local fields for simulation

Sparse local fields for simulation include obtaining a scene that includes object voxel grids for objects. The object voxel grids include an object voxel grid with the object voxel grid including a voxel positioning property, a geometry field property, and a color field property of the voxel in the object voxel grid. The operations further include identifying an image plane of a first virtual sensor and a set of virtual sensor properties of a second virtual sensor capturing the scene. The operations also include performing, using the object voxel grids, rasterization of the scene on the image plane and ray casting through the scene using the set of virtual sensor properties to generate a first virtual sensor snapshot and a second virtual sensor snapshot. The operations also include outputting the first virtual sensor snapshot and the second virtual sensor snapshot.
Owner:WAABI CANADA INC

Automatic creation of three-dimensional (3D) variable resolution region geometries

A computer-implemented method is disclosed for creating three-dimensional (3D) variable resolution (VR) region geometries of a modeled object for use in a computer-implemented numerical simulation involving the modeled object. The computer-implemented method includes, inter alia, generating two-dimensional (2D) orthographic views of a 3D modeled object, and identifying edges of each of the 2D orthographic views with a computer-based ray casting method. The computer-based ray casting method includes, for each respective one of the 2D orthographic views, casting virtual rays from different directions toward the 2D orthographic view within a plane of the 2D orthograph view, and detecting an intersection point for each of the virtual rays with an edge of the 2D orthographic view.
Owner:DASSAULT SYSTEMS AMERICAS CORP

A Real-time Sonar Point Cloud Visualization and Interaction Method for Dynamic Data Management

The present invention provides a real-time sonar point cloud visualization interaction method for dynamic data management, which relates to the field of visualization technology. The purpose of the present invention is to improve the efficiency and effect of real-time visualization interaction of massive point cloud data simultaneously. During the data organization and management process, bricks are designed for physical partitioning, and spatial fields are dynamically allocated to solve the memory consumption problem generated by conventional spatial fields. Virtual panoramic regions are defined using bricks to manage the scanning regions of each continuously incoming frame of sonar data. Memory is dynamically allocated for the collected point cloud data in units of bricks, and the memory of bricks not involved is empty. Combining the characteristics of multi-level brick partitioning organization, the ray casting algorithm is improved for real-time rendering, and the rendering resolution of the algorithm is fixed. Through the calculation of empty voxel jumping and distance-based spatial interpolation for the data points within the bricks, in terms of interaction operations, after panning and zooming the viewing field, the three-dimensional points to be rendered under the new viewing field are determined by calculating the bricks within the viewing field region.
Owner:NORTHEASTERN UNIV CHINA

Planar mesh reconstruction using images from multiple camera poses

Systems and techniques are provided for processing image data corresponding to a scene. A method may include generating a planar distance map including planar distance values for each pixel of at least one image corresponding to a scene. Plane segmentation is performed based on the plane distance map, a normal map corresponding to the at least one image, and position encoding information of the plane distance map. Triangular mesh segments are initialized based on sampling points from each of a plurality of planar segments from planar segmentation. A ray-triangular intersection is determined based on performing ray casting on a reconstructed planar grid comprising a plurality of triangular grid segments, each triangular grid segment corresponding to a different image. A planar reconstruction and segmentation machine learning network is optimized for a scene based on training the planar reconstruction and segmentation machine learning network using one or more loss functions.
Owner:QUALCOMM INC

Object inverse Gaussian rendering method based on global-local surface collaborative perception

The embodiment of the invention provides an object Gaussian inverse rendering method based on global-local surface collaborative perception. Relates to the field of graph inverse rendering. The method comprises the following steps: performing ray casting and sampling to obtain sampling points; calculating a neural radiation distance value and a color value of a sampling point by using a geometric network and a color network, and obtaining a global geometric representation; initializing a Gaussian point cloud position according to the neural radiation distance value; selecting a local control point from the initialized Gaussian point cloud, determining a local sampling point by taking the local control point as a center, and constructing a local distance function; calculating a local distance value and a global neural radiation distance value of the local sampling point by using a local distance function and a neural radiation distance function according to the local sampling point; according to global geometric representation, geometric details are reconstructed by taking the two distance values as constraints; and adding an attribute value to the Gaussian point cloud to carry out material and illumination modeling, and obtaining a material attribute and an illumination condition. Therefore, object surface roughness is relieved, and the detail capturing capability is improved.
Owner:HARBIN INST OF TECH AT WEIHAI

Declarative multi-touch gesture and pointer semantics methods, systems, devices and media

This invention discloses a declarative multi-touch gesture and pointer semantics method, system, device, and medium, relating to the fields of game engines and human-computer interaction technology. The method includes: acquiring frame-by-frame input data of the original touch points; recognizing the current gesture based on gesture binding data and screen coordinates; triggering engine events for each entity affected by the gesture, with each engine event carrying world geometry; configuring the processing logic of the engine events and reading the world geometry and global pointer signals through the engine's existing event binding and numerical reference mechanisms; and executing actions on the entities affected by the engine events according to the processing logic. This invention enables multi-touch gesture recognition and pointer interaction in a declarative engine without executing new code at runtime. Developers only need to configure the processing logic with declarative data, eliminating the need to write input scripts or raycasting code. Furthermore, gesture binding and event processing are fully validated during loading, allowing errors to be detected before runtime.
Owner:BEIJING WAZIDA TECH CO LTD

Ray casting volume rendering method for InterfaceGrid grid model

The invention provides a ray casting volume rendering method for an InterfaceGrid grid model, and relates to the field of ray casting volume rendering, and the method comprises the steps: converting the InterfaceGrid grid model from display storage to an implicit storage structure of InterfaceGrid Block, transmitting the implicit storage structure to a GPU, and carrying out the segmented storage; according to the implicit storage texture set, performing coordinate transformation on the vertex coordinates of the texture by using a vertex shader to obtain transformed vertex coordinates; transmitting the transformed vertex coordinates to a fragment shader, and obtaining implicit storage information corresponding to the current fragment through a texture sampling technology in combination with an implicit storage texture set; according to the implicit storage information corresponding to the current segment, drawing an InterfaceGrid grid model body, and searching to obtain the attribute of the InterfaceGrid grid model at the current sampling point; updating the color and transparency of the sampling points, and synthesizing by using an illumination model to obtain an accumulated volume rendering color; and outputting the result to a screen, and completing the body visualization of the InterfaceGrid model. The method is used for solving the problem that a traditional three-dimensional geologic model is insufficient in expression ability.
Owner:CHINA UNIV OF MINING & TECH (BEIJING)

Differentiable edge-based optical proximity correction

Lithography mask generation processes utilizing a forward process that decomposes a resist pattern into segments and rasterizes the segments into a mask pattern using ray casting, and a backward process that determines lithography gradients for edge movements that incorporate mask rule constraints and propagates the lithography gradients into gradients and velocities for the segments.
Owner:NVIDIA CORP