109 results about "World space" patented technology

The invention provides a texture mapping method, a texture mapping device, a computer storage medium and electronic equipment, and relates to the technical field of computer graphic processing. The method comprises the following steps: acquiring a world space coordinate and a world space normal of a vertex of a target model; performing texture projection on the world space coordinates on a plurality of world coordinate axes to obtain target texture coordinates of the vertexes of the target model on the world coordinate axes; determining a texture weight value based on the included angles between the world space normal and the plurality of world coordinate axes; and carrying out texture sampling according to the target texture coordinate to obtain an initial map sampling result, and carrying out mixed sampling on the initial map sampling result and the texture weight value on the corresponding world coordinate axis to carry out texture mapping on the to-be-processed model based on the target map sampling result. The method can get rid of dependence on a model topological structure and UV expansion of a three-dimensional model, and realizes a more real, natural, accurate and flexible texture fitting effect without deformation stretching.

The invention discloses automatic boundary creation and relocation. Aspects of the present disclosure relate to instant boundary creation for virtual reality (VR) experiences. An artificial reality (XR) system may scan and collect visual feature data of a user's real-world environment in the background while rendering an augmented reality (AR) environment or a mixed reality (MR) environment. When the XR system detects an intent to enter a VR mode (e.g., by launching a VR application), the XR system may generate a recommendation to a boundary of a real-world space, which may include a type of interaction mode (e.g., a movable mode or a stationary mode). Based on the user's response to the recommendation, the XR system may prompt the user to further scan the real-world space and / or manually adjust the boundaries while continuing to scan and collect visual feature data in the background. Alternatively or additionally, some embodiments may automatically relocate the real-world space based on the generated boundaries.

In various examples, a machine learning model—such as a deep neural network (DNN)—may be trained to use image data and / or other sensor data as inputs to generate two-dimensional or three-dimensional trajectory points in world space, a vehicle orientation, and / or a vehicle state. For example, sensor data that represents orientation, steering information, and / or speed of a vehicle may be collected and used to automatically generate a trajectory for use as ground truth data for training the DNN. Once deployed, the trajectory points, the vehicle orientation, and / or the vehicle state may be used by a control component (e.g., a vehicle controller) for controlling the vehicle through a physical environment. For example, the control component may use these outputs of the DNN to determine a control profile (e.g., steering, decelerating, and / or accelerating) specific to the vehicle for controlling the vehicle through the physical environment.

The invention discloses a vehicle tracking and re-identification system in an expressway scene, and the method comprises the steps: building a homography matrix to construct the mapping of a camera space coordinate and a real space coordinate, and then carrying out the pre-screening of a confidence coefficient + Laplacian variance pre-screening module; a set of end-to-end assembly line is formed by combining a hierarchical matching and self-adaptive histogram filtering matching module, a motion constraint and Kalman filtering module and Desection-Tracking-ReID Pipeline, so that the re-recognition accuracy and the track connectivity are improved. According to the method, systematic optimization is carried out for special challenges of a highway closed monitoring scene, the accuracy of vehicle re-identification and the connectivity and smoothness of the track are remarkably improved, and reliable technical support is provided for intelligent traffic monitoring.

Provided are an augmented reality device for providing an augmented reality service matched to a real-world space, and an operating method thereof. The augmented reality device may recognize a plurality of objects in a real-world space from an image obtained through a camera, recognize a relative position relationship including positions and directions between the plurality of recognized objects, and display, at a preset position, a virtual object representing information related to the plurality of recognized objects, based on information about a prestored relative position relationship.

Provided are an augmented reality device for providing an augmented reality service for controlling an object in a real world space, and an operating method for the same. The method may include recognizing a first plane comprising a wall and a second plane comprising a floor from a spatial image based on a photograph of the real world space; generating a three-dimensional (3D) model of the real world space by extending the wall and extending the floor along the respective planes and performing 3D in-painting on an area of the extended wall and the extended floor that is hidden by an obstructive object; segmenting an object selected by a user input from the spatial image based on two-dimensional (2D) segmentation; and segmenting the object on the spatial image from the real world space based on a 3D model or 3D position information of the object using 3D segmentation.

Aspects of the present disclosure relate to more accurate and quicker localization of an artificial reality (XR) system in a real-world space (e.g., a room). If a user enters a room and localization fails, the system can locate a corner that was designated in a previous localization. The corner could have been manually selected by the user or could have been automatically recommended by the XR system. In some implementations, the user or system can identify two adjacent corners in the room for further accuracy. Through later selection of the corner(s) for localization, the XR system can identify the saved room using depth sensors, with identification of corners being more reliable and detectable than other methods identifying walls.

In various examples, image space coordinates of an image from a video may be labeled, projected to determine 3D vehicle space coordinates, then transformed to 3D world space coordinates using known 3D world space coordinates and relative positioning between the coordinate spaces. For example, 3D vehicle space coordinates may be temporally correlated with known 3D world space coordinates measured while capturing the video. The known 3D world space coordinates and known relative positioning between the coordinate spaces may be used to offset or otherwise define a transform for the 3D vehicle space coordinates to world space. Resultant 3D world space coordinates may be used for one or more labeled frames to generate ground truth data. For example, 3D world space coordinates for left and right lane lines from multiple frames may be used to define lane lines for any given frame.

The application relates to a dynamic grid coordinate generation method, system, computer equipment and storage medium, and the technical scheme points are as follows: receiving window space coordinates of multiple vertices, inversely transforming the window space coordinates of the vertices into corresponding world space coordinates; generating a primitive using the window space coordinates of all the vertices; performing primitive assembly and primitive rasterization on the primitive to determine target pixel points; performing interpolation calculation on the primitive after the primitive rasterization according to the world space coordinates of the vertices to obtain the world space coordinates of the target pixel points; determining a scaling ratio of the world space coordinates of the vertices and the corresponding window space coordinates according to the inverse transformation, and determining a scale according to the scaling ratio; determining to-be-colored pixel points according to the scale, a preset grid line width and the world space coordinates of the target pixel points, coloring the to-be-colored pixel points to obtain a grid; and the application has the effect of dynamically adjusting the grid scale and better display effect.

This invention discloses a method, system, and electronic device for automatically switching safe zones. The method mainly includes six steps: map information acquisition, device location acquisition, device location determination, distance calculation, safe zone selection, and safe zone display. It can acquire environmental information to create a map, each map can include multiple safe boundaries, enabling switching between different safe boundaries. It also stores and updates each map piece of information, allowing for the reuse of safe boundary information within the map. The advantages of this invention lie in the reuse of safe boundaries within the same real-world space, eliminating the need for frequent setup. A single map can contain multiple safe boundaries, achieving seamless switching between different maps and safe boundaries, thus improving the user experience.

The present disclosure relates to a high light rendering method, device, medium and electronic equipment, the method comprising: obtaining a high light image to be rendered, a high light shape to be rendered being drawn in the high light image; determining a light source vector in a target coordinate space corresponding to the hair model according to a light source direction in a world space; for each pixel point to be rendered in the hair model, determining a line of sight vector corresponding to the pixel point in the target coordinate space according to a line of sight direction in the world space; for each pixel point, determining a texture offset in a vertical direction corresponding to a horizontal direction of the pixel point in the high light image according to the light source vector and the line of sight vector corresponding to the pixel point; and sampling from the high light image according to the texture offset corresponding to each pixel point to render the pixel point, to obtain a rendered high light rendering image. Thus, the rendering of anisotropic high light can be realized while ensuring the rendering of a high light shape.

A system for registering one or more cameras and / or creating an accurate three-dimensional (3D) model of a world space environment including back projecting at least one image from at least one of a plurality of camera views to the 3D model based on a set of existing camera parameters. The back projected image is added as a texture for the 3D model. This texture is automatically compared to one or more images from other camera views using a color space comparison of images to determine a set of differences or errors. The camera parameters and the 3D model are automatically adjusted to minimized the differences or errors. Over time, the parameters and the 3D model converge on a state that can be used to track moving objects, insert virtual graphics and / or perform other functions.

The invention discloses a rendering method and device of a virtual model, electronic equipment and a storage medium, and the method comprises the steps: converting each model vertex of the virtual model from a world space to a model space, and carrying out the texture map sampling of a basic texture map based on the coordinates of the virtual model in the model space; according to the method, a binding relation between the basic texture map and the model structure of the virtual model is established, it is ensured that the texture effect corresponding to the basic texture map does not deviate along with movement or selection of the virtual model, and the stability and consistency of the texture effect presented on the virtual model are ensured; by binding the basic texture map with the virtual model, the texture effect corresponding to the basic texture map presented on the virtual model can have a stereoscopic impression, so that the texture effect corresponding to the basic texture map has a penetration sense of a three-dimensional space, the rendering effect of the virtual model is effectively improved, and the game experience of players is improved.

In an augmented reality (AR) experience, virtual content may be rendered at a particular position within a 3D spatial map and overlaid onto a view of the real-world space. There may be scenarios in which the user wants to limit a 3D model to being rendered within a particular subspace of the space defined by the 3D spatial map. Computer-implemented methods are disclosed that include receiving input defining a subspace of a 3D spatial map of a real-world space. A set of 3D models may then be filtered to identify a subset of the 3D models that fit within the subspace defined by the input. AR content including a render of a particular 3D model from the subset and overlaid onto a view of the real-world space in a position within the subspace may be output for display.

We provide information processing devices that allow the first user to experience the real-world space they inhabit within a digital twin space. [Solution] An information processing device 2 used by a second user communicating with a terminal 1 used by a first user, comprising: a location information acquisition unit 21 that acquires location information 11a transmitted by terminal 1, including the current time of terminal 1, the latitude and longitude of terminal 1 at the current time, and the altitude; a space generation unit 22 that generates a digital twin space of a point that reproduces the surrounding environment of the real space of the point at the current time's latitude, longitude, and altitude; and a display processing unit 23 that displays the digital twin space generated by the space generation unit 22 on a display unit.

Methods and systems for normalizing views of real world space and virtual environment of an interactive application as viewed through a pair of augmented reality glasses include receiving content of the interactive application for rendering on a display screen of the pair of augmented reality glasses. The content is streaming content provided in response to inputs provided by the user and includes virtual objects. The virtual objects are dynamically scaled to match a scale of the real world objects to a scale of the virtual objects. The content of the interactive application dynamically scaled is projected as an overlay over the real world objects of the real world space viewed through the pair of augmented reality glasses. The content that is dynamically scaled enables a normalized view between the real world space and the virtual environment.

The invention discloses an object stroking method and device, electronic equipment and a computer readable storage medium, and the method comprises the steps: carrying out the basic material rendering processing of an object model of a target object, and obtaining a first rendering model; based on the shooting direction of the virtual camera, removing vertexes which do not face the virtual camera in the object model to obtain a model after removal; based on the vertex offset information, controlling each vertex of the model after elimination to offset along a vertex normal in the world space to obtain an offset coordinate; based on a preset stroking special effect texture map and the offset coordinates of the vertexes of the model after elimination, the model after elimination is rendered, a second rendering model is obtained, an edge area in the second rendering model presents a stroking effect, and a non-edge area has transparency; and fusing the first rendering model and the second rendering model to obtain a fused model with an object stroking effect, so that the presentation effect of the object stroking special effect of the virtual object can be improved.

This application relates to the field of game technology, specifically to a rendering method, device, electronic device, and storage medium for a virtual sight. The method includes: in response to an activation operation of the virtual sight, calculating a world space view vector and converting it into a tangent space view vector; in response to a view movement operation following a target virtual object, performing calculations within a target shader based on the tangent space view vector to generate a crosshair layer and a mask layer; in response to aiming at the target virtual object, sampling a spherical normal map on the sight rendering model, and calculating a reflection vector based on the tangent space view vector to generate a reflection layer; and in the target shader, performing pixel blending processing on the three layers, and displaying the virtual sight's image based on the blending result. This approach, while making the optical effects more realistic, reduces redundant drawing and interaction, lowers runtime overhead, and improves image stability and aiming immersion by completing integrated rendering within the same shader.

The invention discloses a digital human image rendering method, device and equipment, and the method comprises the steps: obtaining a current driving posture of a human body, and calculating a current parameterized model; calculating a first world space position, a first world space rotation and a first world space zoom respectively corresponding to each three-dimensional Gaussian in the current parameterized model according to the obtained reference normal offset coefficient, the reference local space rotation and the reference local space zoom respectively corresponding to each three-dimensional Gaussian; obtaining a first view angle vector from the first view point to each three-dimensional Gaussian; predicting a first opacity and a first spherical harmonic parameter respectively corresponding to each three-dimensional Gaussian according to each first world space position, each first world space rotation, each first world space zoom and the first view vector by using a target prediction model obtained based on multi-layer perceptron neural network training; and rendering the human body image. According to the invention, the applicability of the model to the real-time rendering terminal is improved, and real-time image rendering is realized.

Aspects described herein provide resource processing techniques. The technique may include: obtaining spatial change information of a virtual character; obtaining static resource data of a hair resource of the virtual character in a second game scenario; obtaining dynamic resource data of the hair resource in the second game scenario based on the static resource data and the spatial change information; and performing physical simulation on the hair resource based on the dynamic resource data. In the aspects described herein, a world space coordinate system can be introduced into TressFx, to help the hair resource follow movement of the virtual character, to implement real movement performance.

Aspects of the present disclosure relate to providing assisted scene capture for an artificial reality (XR) environment. Some embodiments may obtain an XR space model corresponding to a real-world space, including walls, ceilings, and floors, using an XR system. Some embodiments may then scan the real-world space and display a grid overlying a view of the real-world space corresponding to the scanned area. Some embodiments may perform post-processing on the displayed mesh, which may include: A) folding a change in the mesh corresponding to a wall, ceiling, or floor onto the XR spatial model; the method comprises the steps of: A) selecting an XR spatial model, B) cutting a mesh to the XR spatial model for an open doorway, window or the like, C) simplifying the mesh corresponding to a wall, ceiling or floor, D) determining that the mesh is intact, or any combination thereof, by identifying that a threshold percentage of the XR spatial model is covered by the mesh.

The application provides a blasting effect rendering method and device, electronic equipment and storage medium. The blasting effect rendering method comprises the following steps: forming a first model with a normal line inward in a world space of a game engine, and configuring a material of the first model as semi-transparent and closing a depth test; acquiring a second model located inside the first model; acquiring three position components of a vertex position of a vertex on the second model on three direction axes of a model space of the first model, forming a first vector corresponding to the vertex with the three position components; screening two position components from the three position components of the first vector as texture sampling coordinates corresponding to the vertex based on a normal direction of the vertex on the second model; acquiring a blasting map, and mapping the blasting map on the second model according to the normal direction of the vertex and the corresponding texture sampling coordinates, so as to obtain a blasting effect. The blasting effect rendering method provided in the application embodiment can reduce the rendering consumption of the blasting effect.

An apparatus and method for tracking user orientation in a real-world space, wherein the user consumes, via an audio output device, data representing a spatial audio scene comprising one or more audio sources which are rendered at respective spatial positions with respect to a reference orientation in the real-world space. Responsive to a tracked change in user orientation from the reference orientation to a new orientation, the respective spatial positions of the audio sources are then modified so as to counter the change in user orientation from the reference orientation to the new orientation. This is followed by tracking a spatial position of the user in the real-world space with respect to a travel route, wherein the travel route comprises one or more portions which will cause one or more respective changes in user orientation from the reference orientation when the user travels along the portions. This is followed by updating the reference orientation based on the tracked spatial position of the user indicating that the user is travelling along one of said one or more portions, wherein the one or more audio sources are thereafter rendered at the respective spatial positions with respect to the updated reference orientation.

In various examples, live perception from sensors of a vehicle can be utilized to detect and classify intersection contest areas in a vehicle’s environment in real-time or near real-time. For example, a deep neural network (DNN) can be trained to compute outputs (e.g., signed distance functions) that can correspond to boundary locations that demarcate intersection contest areas. The signed distance functions can be decoded and / or post-processed to determine instance segmentation masks that represent locations and classifications of intersection zones or areas. Locations of intersection zones or areas can be generated in image space and converted to world space coordinates to assist an autonomous or semi-autonomous vehicle in navigating an intersection according to road rules, traffic priority considerations, etc.

The invention belongs to the technical field of nuclear power, and particularly relates to a nuclear power plant containment vessel defect detecting and positioning method based on an aircraft. According to the method provided by the invention, the flight path of the unmanned aerial vehicle is planned in the three-dimensional model space, containment appearance defect shooting at a fixed distance is realized, the transformation relation between the image space and the world space is established, and positioning and marking of the defect in the world space are realized based on the coordinates of the camera in the world space during shooting. Based on a secondary modeling method, accurate positioning of an image detection result in a three-dimensional space is realized, and a neural network technology is adopted to carry out qualitative evaluation on concrete appearance defects. And level-to-level management of the surface defects of the containment is realized.

A guest measurement system includes a controller configured to receive image data indicative of guest characteristics. The controller includes a processor configured to identify one or more anatomical features of the guest and the reference marker in the image data and scale distances between the identified anatomical features in the image data from a virtual space of the image data to a real-world space using the reference marker in the image data. Based on the scaled distances, the system can generate a guest height calculation.

The invention provides a visual servo method, servo device, equipment and system based on template pushing operation, and the method comprises the steps: obtaining a first code block used for positioning a template machine, and determining the position coordinates of the template machine in a world space according to the first code block; determining position coordinates of a virtual target code block when the to-be-operated template is pushed into a template machine clamping groove by utilizing a preset transformation matrix; a second code block used for positioning the to-be-operated template is obtained, and a plate pushing mechanism is indicated to press and push the to-be-operated template according to the position coordinates of the second code block; according to the position error between the real-time position coordinate of the second code block and the position coordinate of the virtual target code block, the pushing direction and the pushing distance of the template to be operated are adjusted; and in response to the fact that the position error is within the preset position error range, it is judged that the to-be-operated template is pushed to the target position of the template machine. According to the template pushing method provided by the invention, rapid positioning, high-precision alignment and stable template pushing can be realized.

A system and method for self-validating augmented reality inspection of a component are provided, including receiving an image of the component in a real world environment, determining a virtual camera pose relative to a CAD model of the component in a CAD environment that is substantially identical to the camera pose relative to the component in the world space, generating a CAD image at the virtual camera pose, removing background from the CAD image, generating a composite image by superimposing the masked CAD image on the image of the component in the real world environment, providing the composite image to a trained latching model to thereby make a latching determination of whether the CAD image is latched to the captured image of the component in the real world environment, where the latching model is trained on a dataset including ground truth composite image examples of latched and unlatched components.

A system for registering one or more cameras and / or creating an accurate three-dimensional (3D) model of a world space environment including back projecting at least one image from at least one of a plurality of camera views to the 3D model based on a set of existing camera parameters. The back projected image is added as a texture for the 3D model. This texture is automatically compared to one or more images from other camera views using a color space comparison of images to determine a set of differences or errors. The camera parameters and the 3D model are automatically adjusted to minimized the differences or errors. Over time, the parameters and the 3D model converge on a state that can be used to track moving objects, insert virtual graphics and / or perform other functions.

To improve user experience when interacting with AR content within an AR environment, the AR content may be overlaid over a proxy object in a real-world space. Differences in dimension between the proxy object and the virtual model may be such that the object is larger than the virtual model, which may result in portions of the object appearing to protrude from behind the virtual model, decreasing user enjoyment. In some embodiments, an AR system for the overlay of AR content on a proxy object and concealment of the proxy object may be implemented. The system may overlay a virtual model to a proxy object, and then conceal any remaining visible portions of the proxy object from the visual field of a device displaying the AR environment. The system may overlay the virtual model so that any remaining visible portion of the proxy object is a single continuous region.