492results about "Image rendering" patented technology

Some embodiments of a method may include: obtaining Avatar JSON Interchange File (AJIF) data; decoding the AJIF data to generate avatar data; obtaining animation parameters from the avatar data; obtaining user movement data corresponding to a movement of a user; generating updated avatar data based on the user movement data; and sending the updated avatar data to a client device. For some embodiments, a method may include: generating Avatar JSON Interchange File (AJIF) data corresponding to an avatar; sending, to an application server, the AJIF data; obtaining user movement data corresponding to a movement of a user; sending, to the application server, the user movement data corresponding to the movement of the user; receiving, from the application server, scene update data, wherein the scene update data includes updated avatar data corresponding to the movement of the user; and rendering a scene update based on the scene update data.

The invention provides a large-scale scene multi-level-of-detail cloud rendering processing method and device based on 3DGS, and relates to the technical field of three-dimensional modeling, and the method comprises the steps: dividing a target modeling scene into a plurality of sub-blocks; performing particle redundancy reconstruction and overlapping region marking on boundary regions between adjacent sub-blocks of each sub-block to obtain processed sub-blocks; performing multi-detail level division on each processing sub-block to generate a particle level set; determining a current visual area according to the user motion data, and scheduling a target hierarchy of a particle hierarchy set in the current visual area; the rendering tasks of all the processing sub-blocks of the target hierarchy are distributed to a plurality of rendering nodes to execute real-time rendering operation; and performing video stream coding on pictures rendered by each rendering node, decoding and displaying received video stream data, and performing particle level updating and re-rendering operation according to an interaction instruction. According to the invention, high-quality detail rendering can be realized for a model of a large scene.

A computer-implemented method for processing electronic images for subject-specific two-dimensional modeling of a subject's vasculature, comprising: receiving one or more subject-specific three-dimensional models of the subject's vasculature, wherein the subject-specific three-dimensional model includes a representation of the vascular tree structure; determining a two-dimensional viewing plane; determining a projection of the representation of the vascular tree structure of the one or more subject-specific three-dimensional model onto the two-dimensional viewing plane; generating one or more subject-specific three-dimensional models around the representation of the vascular tree structure; and generating a two-dimensional image depicting the one or more generated models.

Disclosed is a head-mounted display system comprising a head-mounted display unit producing a computer-generated output for a user. The head-mounted display unit includes at least one sensor. The at least one sensor may be configured to measure a parameter associated with digital eye strain for the user. The at least one sensor may be configured to communicate a measured parameter to a processor, wherein the processor is configured to effect change on the computer-generated output based on the measured parameter.

The invention relates to the technical field of electric power system digitization, in particular to an automatic efficient modeling method and system for an electricity utilization inspection scene. The automatic efficient modeling method for the electricity utilization inspection scene comprises the four steps of multi-source data collection, dynamic semantic modeling, intelligent modeling decision making and augmented reality rendering, the electricity utilization inspection scene modeling system comprises a data collection module, an intelligent modeling engine, an augmented reality terminal and edge computing equipment, and data interaction is achieved among the modules through a gRPC protocol. According to the method, an L4-level multi-physical field model is generated through unmanned aerial vehicle cluster collaborative collection and multi-source data millisecond-level fusion in combination with a dynamic semantic network and reinforcement learning resource allocation; edge calculation and dynamic LOD rendering are adopted to realize equipment internal perspective and multi-user collaborative labeling, quality closed-loop verification is matched, the bottlenecks of low modeling efficiency, multi-physical field data missing, high interaction delay and the like in the prior art are overcome, and the overall efficiency is improved by 80%.

Systems and methods for rendering of a virtual content object in an augmented reality environment based on a physical marker are discussed herein. Virtual content objects may be rendered by a display device in an augmented reality environment based on the field of view seen through the display device and a position of a marker (and one or more linkage points associated with the marker) in the real world. When rendered in the augmented reality environment, the virtual content objects may be visualized from any angle, from the exterior or interior of the object, and manipulated in response to user input. Virtual content objects and / or user visualizations of virtual content objects may be shared with other users (local and / or remote), enabling multiple users to potentially build, modify, and / or interact with a virtual content object simultaneously and / or cooperatively.

An image processing apparatus includes a processor and a memory storing a program which causes the image processing apparatus to execute detecting a direction of a line of sight of a user viewing the display, detecting a first distance that is a distance relating to a depth to a position of a line of sight of the user, based on the detected direction of the line of sight, detecting a second distance that is a distance relating to a depth to a subject that exists in a direction of the user's line of sight, and changing, based on the first distance and the second distance, at least one of an area in which processing for changing image quality of the image is performed and an image quality in the processing for changing the image quality of the image.

The invention relates to the technical field of image processing, and discloses a three-dimensional reconstruction method, device and equipment of a moving object and a readable storage medium, and the three-dimensional reconstruction method of the moving object comprises the steps: obtaining a plurality of fringe images of a measured moving object at continuous moments, selecting one frame as a reference frame, and obtaining a plurality of fringe images of the measured moving object at continuous moments; constructing an image set together with adjacent image frames; inputting the image set into a deep learning network for pixel-level motion tracking to obtain motion position information; based on the motion information and the intensity information, constructing a phase calculation equation set to obtain a relative phase value; performing phase unwrapping processing on the relative phase value to obtain absolute phase information; and performing phase height mapping by combining system calibration parameters to obtain dynamic three-dimensional shape data. According to the method, phase distortion caused by motion interference is remarkably eliminated, the three-dimensional reconstruction precision and real-time performance in a dynamic scene are improved, and a reliable guarantee is provided for industrial detection and high-speed target measurement.

In various examples, systems and methods are disclosed relating to transforming sensor measurements according to configurable atmospheric conditions. One or more circuits can identify a point cloud comprising a plurality of points and a parameter of a weather condition to simulate and modify an intensity of at least one of the plurality of points according to the parameter of the weather condition. The one or more circuits can update, based at least on a subset of the plurality of points and the parameter of the weather condition, the point cloud to include one or more additional points.

The invention discloses an image rendering method, system and device and a medium. The method comprises the steps of obtaining an original oil painting image of an oil painting; determining a normal map corresponding to the original oil painting image; and performing real-time illumination rendering based on the original oil painting image and the normal map to obtain a target oil painting image. The problem that in the prior art, color and texture between the shot and displayed oil painting image and the original painting are different, so that the appreciation experience of a user is poor is solved.

The invention discloses a component defect detection method and device, electronic equipment and a storage medium. The method comprises the following steps: constructing a three-dimensional model of a component; collecting laser ultrasonic data of the three-dimensional model, and collecting a thermal imaging image and a polarized light image of the assembly; based on the laser ultrasonic data, the thermal imaging image and the polarized light image, predicting to obtain a first defect category and a first defect position corresponding to a defect area of the assembly; based on the defect category and the defect position of the defect area, reconstructing three-dimensional defect data of the component; and on the basis of the three-dimensional defect data, predicting to obtain an expansion direction and an expansion range of the defect area.

An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.

Disclosed are methods and systems for creating an avatar (102) of a real-world athlete (104) using artificial intelligence. A corresponding method may comprise providing (802) an avatar (102) corresponding to a real-world athlete (104), receiving (806) athlete feedback (300) from the real-world athlete (104) in response to a behavior of the avatar (102), and adjusting (808) the avatar (102) based on the received athlete feedback (300).

The present disclosure generally relates to displaying visual effects such as virtual avatars. An electronic device having a camera and a display apparatus displays a virtual avatar that changes appearance in response to changes in a face in a field of view of the camera. In response to detecting changes in one or more physical features of the face in the field of view of the camera, the electronic device modifies one or more features of the virtual avatar.

The invention discloses a transformer substation civil engineering surveying and mapping data processing method and system based on multi-source data, and the method comprises the steps: obtaining three-dimensional point cloud data of a transformer substation, importing beam column coordinates and equipment basic parameters in a BIM design model, and building an initial space reference coordinate system; performing coarse registration of the actually measured point cloud and the BIM model by adopting an iterative nearest point algorithm, and correcting a registration error by introducing a ground control point coordinate; constructing a three-dimensional difference analysis layer, automatically marking a deviation region, exceeding a preset deviation value, between the actually measured point cloud and the BIM model, and generating alarm data including coordinate positions and the deviation value; performing deformation trend verification on the deviation area based on monitoring data of the optical fiber sensor, and triggering model reconstruction when the change rate of continuous three times of sampling data is greater than 1mm / h; and outputting a three-dimensional visualization report integrating the BIM model, the actual measurement point cloud and the deviation area. The problem that early deformation of a civil engineering structure cannot be captured according to civil engineering surveying and mapping data of a transformer substation in the prior art is solved.

This application relates to a physical special effect rendering method performed by a computer device. The method includes: obtaining physical special effect data of physical special effect particles emitted by a particle emission plug-in in a previous frame; obtaining a first target instance obtained by instantiating a scene management class; invoking, through the first target instance, a scene manager of a particle simulation tool to calculate motion state information of the physical special effect particles in a current frame based on the physical special effect data in the previous frame; and updating the physical special effect data in the previous frame based on the motion state information of the current frame to render a physical special effect in the current frame.

The invention discloses a real-time dynamic light and shadow rendering optimization method based on an unreal engine, and relates to the field of light and shadow rendering, and the method comprises the steps: firstly distributing shadow importance scores for all grid objects in a scene based on a camera view cone and AI context data, and carrying out the priority ranking of potential shadow projectors; and then, performance budget evaluation is carried out in combination with the current frame rate and the GPU load, and intelligent shadow projector selection and LOD application are carried out on the sorted shadow projection object list according to the performance budget evaluation. And finally, the optimized shadows to be rendered are sent to a light visual angle rendering and VSM page filling process in batches, and a movable light source optimization virtual schlieren is generated. According to the method, the unnecessary calculation overhead is remarkably reduced, so that the rendering efficiency and the frame rate stability are greatly improved while the high-quality dynamic light and shadow effect is ensured, and the core problem that the traditional performance and quality are difficult to balance is effectively solved.

The invention provides a method and system for real-time rendering of hydrodynamic data, and the method comprises the steps: obtaining hydrodynamic result data, carrying out the standardized processing of the hydrodynamic result data according to a target format, and obtaining a standardized result; reading vertex coordinate data and triangular grid index data of the standardized result, traversing a vertex coordinate data set based on values of the triangular grid index data, and further constructing a grid; the hydrodynamic result data of the current time period are packaged and transmitted to the water body grid models, and then grid vertex coordinate data of the water body grid models of the two different time periods are stored into a plurality of UV channels; creating a shader, reading vertex coordinate data in the UV channel and forming three-dimensional vector coordinate data; and constructing the texture of the water body to obtain a rendering result. According to the method, through a mode of reading the hydrodynamic data of multiple time periods in real time and rendering the data, the time for scientific calculation is shortened, and real-time rendering is supported.

Embodiments of the present disclosure relate to continuous and / or binocular time warping methods to account for head movement of the user without having to re-render a displayed image. Continuous time warping allows for transformation of an image from a first perspective to a second perspective of the viewer without having to re-render the image from the second perspective. Binocular time warp refers to the late-frame time warp used in connection with a display device including a left display unit for the left eye and a right display unit for the right eye where the late-frame time warp is performed separately for the left display unit and the right display unit. Warped images are sent to the left and the right display units where photons are generated and emitted toward respective eyes of the viewer, thereby displaying an image on the left and the right display units at the same time.

The invention relates to a BIM (Building Information Modeling) instantiation rendering method and system based on Cesium, and the method comprises the steps: loading a BIM and analyzing model data, and generating a geometry for instantiation; performing instantiation processing on the geometry, setting an instantiation number and geometry attributes, and generating instantiated geometry data; executing an editing operation based on the instantiated geometry data; after each editing operation, performing difference comparison on the instance attributes before and after editing, and determining a target instance of which the attribute is changed; updating the corresponding rendering data and executing local rendering refreshing based on the target instance with the changed attribute; and after rendering is completed, executing model output operation, wherein the output operation comprises the steps of storing a current model state or exporting a new glTF or glb file. The method has the effect of improving the flexibility of model editing.

A method of forming a volumetric effect on a game map of a video game is provided. In the method, a variable density volume of the game map is determined based on a mesh of the game map and a bounding box. The variable density volume includes the volumetric effect. The variable density volume is sliced into a plurality of texture layers. Each of the plurality of texture layers includes information associated with at least one of the volumetric effect or the mesh. An interaction between a virtual object on the game map and the volumetric effect is determined based on movement of the virtual object. The volumetric effect is rendered based on a cut out of the virtual object in the variable density volume and the determined interaction.

A system is disclosed, including a processor and a memory. The memory stores instructions that, when executed by the processor, configure the system to perform operations. Surface plane information is obtained, defining a surface plane passing through a surface location and oriented according to a surface normal. An edge is detected in an image. Virtual content is presented, having a virtual position based on an orientation of the edge and the surface plane information.

A rendering method is applied to a terminal device, and the method includes: obtaining texture information of a light probe in a to-be-rendered virtual scene; performing illumination calculation on the virtual scene based on the texture information of the light probe, to obtain a first irradiance map, where a resolution of the first irradiance map is less than a resolution required by a rendering result of the virtual scene; and performing upsampling on the first irradiance map, to obtain a second irradiance map, where a resolution of the second irradiance map and the resolution required by the rendering result of the virtual scene are the same, and the second irradiance map is used to perform indirect light rendering of the virtual scene.

A display device may detect an ambient sound from audio data captured by a plurality of microphones on a display device. A display device may determine, based on the audio data, a location of a sound source of the ambient sound. A display device may generate contextual information about the ambient sound based on an audio segment of the audio data that includes the ambient sound. A display device may display the contextual information based on the location of the sound source.

The disclosed technology is generally directed to a method for simulating light pollution by a satellite system including at least one satellite. In one example of the technology, the method may include receiving orientation and solar panel parameters associated with the satellite, a position of the Earth with respect to the Sun, importing a database including multiple point of interests (POIs) on the Earth, and determining a surface roughness parameter of the satellite using a Gaussian distribution model. Based on the orientation and solar panel parameters, the position of the Earth, and the surface roughness parameter: simulating the light pollution by the satellite to iteratively determine the light pollution at the POIs. The method may include storing the light pollution determined at the POIs in a buffer and dynamically rendering a user interface to display a visualization representing the light pollution by the satellite at the POIs.

The present disclosure relates to systems, methods, and non-transitory computer-readable media that modify two-dimensional images via scene-based editing using three-dimensional representations of the two-dimensional images. For instance, in one or more embodiments, the disclosed systems utilize three-dimensional representations of two-dimensional images to generate and modify shadows in the two-dimensional images according to various shadow maps. Additionally, the disclosed systems utilize three-dimensional representations of two-dimensional images to modify humans in the two-dimensional images. The disclosed systems also utilize three-dimensional representations of two-dimensional images to provide scene scale estimation via scale fields of the two-dimensional images. In some embodiments, the disclosed systems utilizes three-dimensional representations of two-dimensional images to generate and visualize 3D planar surfaces for modifying objects in two-dimensional images. The disclosed systems further use three-dimensional representations of two-dimensional images to customize focal points for the two-dimensional images.

Systems and methods for providing context-based content display are provided. The system may include a device having a display that provides content in a viewing area of the display. The device may include a camera device configured to track a scene of a real-world environment acquired in a field of view of the camera device. The device may determine a region of interest in the scene. The device may perform object recognition on a scene tracked by the camera device. The device may determine an environmental interaction based on the object recognition and the region of interest. The device may adaptively change the location of the content provided by the display based on the environmental interaction.

A computer system detects a hand at a first position in a first configuration while displaying a view of a three-dimensional environment. In response, the computer system displays a first visual indication at a first display location in the three-dimensional environment. The computer system detects a movement of the hand while displaying the first visual indication. In response, the computer system displays the first indication at a second display location if the movement maintains the configuration of the hand and moves the hand as a whole to a second position; or the computer system ceases to display the first visual indication and displays a second visual indication if the movement changes the configuration of the hand to a second configuration at the first position.

The invention discloses a texture mapping transformation method and device and a rendering method and device, and the method comprises the steps: determining a fragment coordinate corresponding to a to-be-processed pixel point based on a screen space coordinate corresponding to the to-be-processed pixel point; determining a directed distance field according to the image information corresponding to the to-be-processed pixel point; determining a signed distance value corresponding to each to-be-processed pixel point based on the directed distance field and the fragment coordinate corresponding to each to-be-processed pixel point; determining a texture mapping area according to the signed distance value corresponding to each pixel point to be processed; and texture mapping is carried out on the fragment coordinates of the corresponding pixel points in the texture mapping area to obtain texture coordinates, so that the texture mapping method suitable for various texture mapping transformation requirements is constructed, the texture mapping transformation method is executed through a shader program, the shader program can be directly called during rendering, and the rendering efficiency is improved. On the premise of not increasing the hardware cost, the dynamic rendering efficiency and effect are improved.

Systems and methods synchronize content of a virtual environment with a state of a physical environment. In aspects, a method includes obtaining sensor data from a network of remote sensors measuring a physical state of a location at a time; generating context specific parameter data based on the sensor data; obtaining context data from a remote virtual reality (VR) system, wherein the context data reflects a current state of virtual content in a virtual environment displayed by the remote VR system; selecting virtual content to be displayed in the virtual environment by the remote VR system based on the context specific parameter data, the context data, and rules; and sending the virtual content to the remote VR system to be displayed to a user, wherein the virtual content reflects a state of the physical location at the time.