64 results about "World space" patented technology

The invention provides a texture mapping method, a texture mapping device, a computer storage medium and electronic equipment, and relates to the technical field of computer graphic processing. The method comprises the following steps: acquiring a world space coordinate and a world space normal of a vertex of a target model; performing texture projection on the world space coordinates on a plurality of world coordinate axes to obtain target texture coordinates of the vertexes of the target model on the world coordinate axes; determining a texture weight value based on the included angles between the world space normal and the plurality of world coordinate axes; and carrying out texture sampling according to the target texture coordinate to obtain an initial map sampling result, and carrying out mixed sampling on the initial map sampling result and the texture weight value on the corresponding world coordinate axis to carry out texture mapping on the to-be-processed model based on the target map sampling result. The method can get rid of dependence on a model topological structure and UV expansion of a three-dimensional model, and realizes a more real, natural, accurate and flexible texture fitting effect without deformation stretching.

In various examples, a machine learning model—such as a deep neural network (DNN)—may be trained to use image data and / or other sensor data as inputs to generate two-dimensional or three-dimensional trajectory points in world space, a vehicle orientation, and / or a vehicle state. For example, sensor data that represents orientation, steering information, and / or speed of a vehicle may be collected and used to automatically generate a trajectory for use as ground truth data for training the DNN. Once deployed, the trajectory points, the vehicle orientation, and / or the vehicle state may be used by a control component (e.g., a vehicle controller) for controlling the vehicle through a physical environment. For example, the control component may use these outputs of the DNN to determine a control profile (e.g., steering, decelerating, and / or accelerating) specific to the vehicle for controlling the vehicle through the physical environment.

Provided are an augmented reality device for providing an augmented reality service matched to a real-world space, and an operating method thereof. The augmented reality device may recognize a plurality of objects in a real-world space from an image obtained through a camera, recognize a relative position relationship including positions and directions between the plurality of recognized objects, and display, at a preset position, a virtual object representing information related to the plurality of recognized objects, based on information about a prestored relative position relationship.

The application relates to a dynamic grid coordinate generation method, system, computer equipment and storage medium, and the technical scheme points are as follows: receiving window space coordinates of multiple vertices, inversely transforming the window space coordinates of the vertices into corresponding world space coordinates; generating a primitive using the window space coordinates of all the vertices; performing primitive assembly and primitive rasterization on the primitive to determine target pixel points; performing interpolation calculation on the primitive after the primitive rasterization according to the world space coordinates of the vertices to obtain the world space coordinates of the target pixel points; determining a scaling ratio of the world space coordinates of the vertices and the corresponding window space coordinates according to the inverse transformation, and determining a scale according to the scaling ratio; determining to-be-colored pixel points according to the scale, a preset grid line width and the world space coordinates of the target pixel points, coloring the to-be-colored pixel points to obtain a grid; and the application has the effect of dynamically adjusting the grid scale and better display effect.

This invention discloses a method, system, and electronic device for automatically switching safe zones. The method mainly includes six steps: map information acquisition, device location acquisition, device location determination, distance calculation, safe zone selection, and safe zone display. It can acquire environmental information to create a map, each map can include multiple safe boundaries, enabling switching between different safe boundaries. It also stores and updates each map piece of information, allowing for the reuse of safe boundary information within the map. The advantages of this invention lie in the reuse of safe boundaries within the same real-world space, eliminating the need for frequent setup. A single map can contain multiple safe boundaries, achieving seamless switching between different maps and safe boundaries, thus improving the user experience.

The present disclosure relates to a high light rendering method, device, medium and electronic equipment, the method comprising: obtaining a high light image to be rendered, a high light shape to be rendered being drawn in the high light image; determining a light source vector in a target coordinate space corresponding to the hair model according to a light source direction in a world space; for each pixel point to be rendered in the hair model, determining a line of sight vector corresponding to the pixel point in the target coordinate space according to a line of sight direction in the world space; for each pixel point, determining a texture offset in a vertical direction corresponding to a horizontal direction of the pixel point in the high light image according to the light source vector and the line of sight vector corresponding to the pixel point; and sampling from the high light image according to the texture offset corresponding to each pixel point to render the pixel point, to obtain a rendered high light rendering image. Thus, the rendering of anisotropic high light can be realized while ensuring the rendering of a high light shape.

A system for registering one or more cameras and / or creating an accurate three-dimensional (3D) model of a world space environment including back projecting at least one image from at least one of a plurality of camera views to the 3D model based on a set of existing camera parameters. The back projected image is added as a texture for the 3D model. This texture is automatically compared to one or more images from other camera views using a color space comparison of images to determine a set of differences or errors. The camera parameters and the 3D model are automatically adjusted to minimized the differences or errors. Over time, the parameters and the 3D model converge on a state that can be used to track moving objects, insert virtual graphics and / or perform other functions.

The invention discloses a rendering method and device of a virtual model, electronic equipment and a storage medium, and the method comprises the steps: converting each model vertex of the virtual model from a world space to a model space, and carrying out the texture map sampling of a basic texture map based on the coordinates of the virtual model in the model space; according to the method, a binding relation between the basic texture map and the model structure of the virtual model is established, it is ensured that the texture effect corresponding to the basic texture map does not deviate along with movement or selection of the virtual model, and the stability and consistency of the texture effect presented on the virtual model are ensured; by binding the basic texture map with the virtual model, the texture effect corresponding to the basic texture map presented on the virtual model can have a stereoscopic impression, so that the texture effect corresponding to the basic texture map has a penetration sense of a three-dimensional space, the rendering effect of the virtual model is effectively improved, and the game experience of players is improved.

In an augmented reality (AR) experience, virtual content may be rendered at a particular position within a 3D spatial map and overlaid onto a view of the real-world space. There may be scenarios in which the user wants to limit a 3D model to being rendered within a particular subspace of the space defined by the 3D spatial map. Computer-implemented methods are disclosed that include receiving input defining a subspace of a 3D spatial map of a real-world space. A set of 3D models may then be filtered to identify a subset of the 3D models that fit within the subspace defined by the input. AR content including a render of a particular 3D model from the subset and overlaid onto a view of the real-world space in a position within the subspace may be output for display.

We provide information processing devices that allow the first user to experience the real-world space they inhabit within a digital twin space. [Solution] An information processing device 2 used by a second user communicating with a terminal 1 used by a first user, comprising: a location information acquisition unit 21 that acquires location information 11a transmitted by terminal 1, including the current time of terminal 1, the latitude and longitude of terminal 1 at the current time, and the altitude; a space generation unit 22 that generates a digital twin space of a point that reproduces the surrounding environment of the real space of the point at the current time's latitude, longitude, and altitude; and a display processing unit 23 that displays the digital twin space generated by the space generation unit 22 on a display unit.

The invention discloses an object stroking method and device, electronic equipment and a computer readable storage medium, and the method comprises the steps: carrying out the basic material rendering processing of an object model of a target object, and obtaining a first rendering model; based on the shooting direction of the virtual camera, removing vertexes which do not face the virtual camera in the object model to obtain a model after removal; based on the vertex offset information, controlling each vertex of the model after elimination to offset along a vertex normal in the world space to obtain an offset coordinate; based on a preset stroking special effect texture map and the offset coordinates of the vertexes of the model after elimination, the model after elimination is rendered, a second rendering model is obtained, an edge area in the second rendering model presents a stroking effect, and a non-edge area has transparency; and fusing the first rendering model and the second rendering model to obtain a fused model with an object stroking effect, so that the presentation effect of the object stroking special effect of the virtual object can be improved.

This application relates to the field of game technology, specifically to a rendering method, device, electronic device, and storage medium for a virtual sight. The method includes: in response to an activation operation of the virtual sight, calculating a world space view vector and converting it into a tangent space view vector; in response to a view movement operation following a target virtual object, performing calculations within a target shader based on the tangent space view vector to generate a crosshair layer and a mask layer; in response to aiming at the target virtual object, sampling a spherical normal map on the sight rendering model, and calculating a reflection vector based on the tangent space view vector to generate a reflection layer; and in the target shader, performing pixel blending processing on the three layers, and displaying the virtual sight's image based on the blending result. This approach, while making the optical effects more realistic, reduces redundant drawing and interaction, lowers runtime overhead, and improves image stability and aiming immersion by completing integrated rendering within the same shader.

The invention discloses a digital human image rendering method, device and equipment, and the method comprises the steps: obtaining a current driving posture of a human body, and calculating a current parameterized model; calculating a first world space position, a first world space rotation and a first world space zoom respectively corresponding to each three-dimensional Gaussian in the current parameterized model according to the obtained reference normal offset coefficient, the reference local space rotation and the reference local space zoom respectively corresponding to each three-dimensional Gaussian; obtaining a first view angle vector from the first view point to each three-dimensional Gaussian; predicting a first opacity and a first spherical harmonic parameter respectively corresponding to each three-dimensional Gaussian according to each first world space position, each first world space rotation, each first world space zoom and the first view vector by using a target prediction model obtained based on multi-layer perceptron neural network training; and rendering the human body image. According to the invention, the applicability of the model to the real-time rendering terminal is improved, and real-time image rendering is realized.

Aspects of the present disclosure relate to providing assisted scene capture for an artificial reality (XR) environment. Some embodiments may obtain an XR space model corresponding to a real-world space, including walls, ceilings, and floors, using an XR system. Some embodiments may then scan the real-world space and display a grid overlying a view of the real-world space corresponding to the scanned area. Some embodiments may perform post-processing on the displayed mesh, which may include: A) folding a change in the mesh corresponding to a wall, ceiling, or floor onto the XR spatial model; the method comprises the steps of: A) selecting an XR spatial model, B) cutting a mesh to the XR spatial model for an open doorway, window or the like, C) simplifying the mesh corresponding to a wall, ceiling or floor, D) determining that the mesh is intact, or any combination thereof, by identifying that a threshold percentage of the XR spatial model is covered by the mesh.

The application provides a blasting effect rendering method and device, electronic equipment and storage medium. The blasting effect rendering method comprises the following steps: forming a first model with a normal line inward in a world space of a game engine, and configuring a material of the first model as semi-transparent and closing a depth test; acquiring a second model located inside the first model; acquiring three position components of a vertex position of a vertex on the second model on three direction axes of a model space of the first model, forming a first vector corresponding to the vertex with the three position components; screening two position components from the three position components of the first vector as texture sampling coordinates corresponding to the vertex based on a normal direction of the vertex on the second model; acquiring a blasting map, and mapping the blasting map on the second model according to the normal direction of the vertex and the corresponding texture sampling coordinates, so as to obtain a blasting effect. The blasting effect rendering method provided in the application embodiment can reduce the rendering consumption of the blasting effect.

In various examples, live perception from sensors of a vehicle can be utilized to detect and classify intersection contest areas in a vehicle’s environment in real-time or near real-time. For example, a deep neural network (DNN) can be trained to compute outputs (e.g., signed distance functions) that can correspond to boundary locations that demarcate intersection contest areas. The signed distance functions can be decoded and / or post-processed to determine instance segmentation masks that represent locations and classifications of intersection zones or areas. Locations of intersection zones or areas can be generated in image space and converted to world space coordinates to assist an autonomous or semi-autonomous vehicle in navigating an intersection according to road rules, traffic priority considerations, etc.

The invention belongs to the technical field of nuclear power, and particularly relates to a nuclear power plant containment vessel defect detecting and positioning method based on an aircraft. According to the method provided by the invention, the flight path of the unmanned aerial vehicle is planned in the three-dimensional model space, containment appearance defect shooting at a fixed distance is realized, the transformation relation between the image space and the world space is established, and positioning and marking of the defect in the world space are realized based on the coordinates of the camera in the world space during shooting. Based on a secondary modeling method, accurate positioning of an image detection result in a three-dimensional space is realized, and a neural network technology is adopted to carry out qualitative evaluation on concrete appearance defects. And level-to-level management of the surface defects of the containment is realized.

The invention provides a node updating method and device in a three-dimensional game, electronic equipment and a storage medium, and relates to the technical field of computers. By configuring a first identifier for representing whether updating is delayed or not and a second identifier for representing whether updating is needed or not for each node, when local spatial data of the node changes or world spatial data of a father node is updated, only the node and a child node which need to be updated immediately are updated; nodes and child nodes which do not need to be updated immediately are only marked as needing to be updated, calculation is not executed immediately, and actual world space data updating is triggered when world space data really need to be obtained; when the child nodes are added, the initialization updating behaviors of the child nodes are determined according to the updating state of the father node. Therefore, according to the method, actual updating is executed only when necessary, on-demand triggering of node updating is achieved, frequent and invalid cascade updating is avoided, and the node updating efficiency and the game frame rate are effectively improved.

Disclosed is a method and system to combine virtual reality techniques with a consumer's real-world space to identify ways to reduce energy consumption and reduce their attendant carbon footprint through an immersive energy assessment. An object is identified that is related to the consumption of energy in the consumer's real-world space, the system is able to present energy information that is specific to that object. This is in contrast to generic information such as an energy star rating. The specific energy information in one example is derived from data from many sources, including smart electric meters, smart appliances, smart home equipment, Internet of thing equipment, smart thermostats, smart speakers, and in-line watt meters.

The application provides a method and device for generating a fog effect simulation image. The method comprises: performing preliminary rendering on an original image by a fog effect parameter to generate an initial fog effect image, wherein the fog effect parameter comprises an altitude influence parameter; obtaining pixel altitude information of a pixel in a GPS space and camera altitude information of a camera in the GPS space by using a Unity world space coordinate to GPS space method according to texture mapping coordinates of the pixel in the initial fog effect image and preset coordinates of the camera in the world space; calculating an altitude factor according to the altitude influence parameter, the pixel altitude information and the camera altitude information, wherein the altitude factor can affect the fog effect intensity according to the altitude; calculating the altitude factor and a preset depth factor to obtain a mixed color; and rendering the initial fog effect image by using the mixed color to generate the fog effect simulation image. The application improves the authenticity and accuracy of the fog effect simulation image.

The invention discloses a model rendering method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring relative orientation configuration information of a target virtual light source of a target object model; acquiring a first visual angle vector of the virtual camera in the world space of the game scene; determining a second view angle vector of the virtual camera in a model space of the target object model based on the first view angle vector; based on the relative azimuth configuration information, performing azimuth adjustment on the second visual angle vector to obtain a first illumination vector of the target virtual light source in the model space; determining a second illumination vector of the target virtual light source in the world space based on the first illumination vector; and based on the second illumination vector, performing rendering processing on the target object model, so that the target object model has a special contour light effect. Therefore, the relative orientation configuration information of the virtual light source can be provided for the object model, so that a visual effect implementation way can be added in a contour light implementation mechanism, and a game player can conveniently customize the contour light.

The invention relates to the technical field of real-time rendering in computer graphics, and discloses a high-quality water surface rendering method, which comprises the following steps of: dividing a water surface into grids in a world space, and carrying out randomized disturbance on a rolling phase of a normal diagram by utilizing Hash of grid vertexes to obtain a high-quality water surface; a plurality of normal lines obtained after disturbance are interpolated in grids, a space repetition mode and a time repetition mode are eliminated at the same time from the source, the rendering effect that texture of a large-area water surface is rich and changeable in space and natural and random in time fluctuation is finally achieved, complex resources do not need to be manufactured or parameters do not need to be manually adjusted, and the efficiency is high. The visual reality sense and the development efficiency are greatly improved, and finally the problems of regular texture repetition and periodic dynamic circulation generated when the water surface is rendered through a traditional tiling method map are solved.

The invention provides a stylized stroke rendering method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring vertex information of a model; reconstructing a camera vector of the world space based on the vertex information; generating a first layer of texture coordinates based on a first dot product result of the reconstructed camera vector and a world space vertex normal; generating a second layer of texture coordinates based on a second dot product result of the world space vertex normal and the light direction; according to the first-layer texture coordinates and the second-layer texture coordinates, corresponding brush chartlets are sampled, and first-layer stroking information and second-layer stroking information are obtained; and carrying out fusion processing on the first layer of stroking information and the second layer of stroking information to generate a stroking rendering effect of the model. Through the method provided by the invention, the thickness and depth dynamic change of the model stroking is realized, and the artistic expressive force of the model is enhanced.

A method including receiving an image as a portion of a real-world space, placing an anchor on the image, determining a position of the anchor, determine a depth associated with the position of the anchor, applying an image editing algorithm based on the depth to the captured image, and rendering the edited image.

This disclosure relates to an image processing method, apparatus, and electronic device, belonging to the field of computer information processing technology. The image processing method includes: acquiring a two-dimensional image to be processed; converting the pixel coordinates of the two-dimensional image into world coordinates in real-world space through camera calibration; segmenting the two-dimensional image based on key points calibrated in the two-dimensional image to obtain a target two-dimensional image; marking a second target block corresponding to a first target block in the target two-dimensional image in a virtual three-dimensional model space, the virtual three-dimensional model space being simulated based on real-world space; and mapping at least one target point in the first target block to the virtual three-dimensional model space containing the second target block based on the pixel coordinates and world coordinates of at least one vertex of the first target block. This disclosure achieves reasonable coordinate mapping and high-fidelity reproduction of the real-world two-dimensional image in a virtual three-dimensional model space.

Examples in the present disclosure relate to systems and methods for reducing noise in object tracking data. Images of an object are obtained via one or more cameras. The images are processed to obtain first pose data indicative of a pose of the object over time. The first pose data is represented in a camera space. The first pose data is transformed to second pose data represented in a world space. The second pose data is filtered using a smoothing filter to generate filtered pose data. The filtering includes, for each pose data item in a time series of the second pose data, using a rotation transformation between the world space and camera space to apply one or more camera space-specific filter parameters to the pose data item that is represented in the world space. The pose of the object is dynamically tracked based on the filtered pose data.

Systems and techniques are provided for determining bounding volumes for hierarchical structures used for ray tracing. For example, a process can include obtaining an acceleration data structure that includes one or more primitives of a scene object. A graph cut can be applied to the acceleration data structure. A set of nodes of the acceleration data structure can be determined based on the graph cut, where the determined set of nodes are positioned to be adjacent to the graph cut. A world space bounding volume can be generated for the scene object using the determined set of nodes based on the graph cut.

Examples in the present disclosure relate to systems and methods for reducing noise in object tracking data. Images of an object are obtained via one or more cameras. The images are processed to obtain first pose data indicative of a pose of the object over time. The first pose data is represented in a camera space. The first pose data is transformed to second pose data represented in a world space. The second pose data is filtered using a smoothing filter to generate filtered pose data. The filtering includes, for each pose data item in a time series of the second pose data, using a rotation transformation between the world space and camera space to apply one or more camera space-specific filter parameters to the pose data item that is represented in the world space. The pose of the object is dynamically tracked based on the filtered pose data.

Techniques include calibrating the user-facing sensors using a calibration target in world space. A calibration target in this case includes an LED panel that is mounted on a linear rail, and a jig for mounting a head-mounted display (HMD) having user-facing sensors such that the user-facing sensors face the LED panel. On the HMD, there are at least two user-facing cameras; an eye-tracking (ET) camera and a face-tracking (FT) camera. There are also a plurality of LEDs associated with an ET camera. In some implementations, the LEDs surround the ET camera. The cameras are calibrated simultaneously—that is, the camera intrinsics and extrinsics relative to a base, i.e., the LED panel in a base position, are determined in a single step after data has been collected. In another, separate step, the ET camera LEDs are calibrated—that is, their positions relative to the ET camera are determined.

The invention provides a method and device for binding an input device to a three-dimensional space point in a three-dimensional scene, and the method comprises the steps: obtaining a two-dimensional coordinate value of the current position of the input device on a screen, and determining a corresponding world space coordinate point P1 and a corresponding normalized coordinate point NDCP; in response to a dragging operation of the input equipment, obtaining a new two-dimensional coordinate value of the current position of the input equipment on the screen, and converting the new two-dimensional coordinate value into a new normalized coordinate; constructing a space coordinate point P2 of the virtual camera according to the depth information of the normalized coordinate point NDCP and the new normalized coordinate; the position parameters of the virtual camera are calculated and updated, and the world space coordinate point P1 can be projected to the current position of the input device on the screen under the visual angle of the virtual camera after the position parameters are updated. Therefore, when the three-dimensional map is operated, the input device can be accurately bound with the three-dimensional object, deviation caused by movement is avoided, and the use experience of a user is improved.