675results about "Image rendering" patented technology

Some embodiments of a method may include: obtaining Avatar JSON Interchange File (AJIF) data; decoding the AJIF data to generate avatar data; obtaining animation parameters from the avatar data; obtaining user movement data corresponding to a movement of a user; generating updated avatar data based on the user movement data; and sending the updated avatar data to a client device. For some embodiments, a method may include: generating Avatar JSON Interchange File (AJIF) data corresponding to an avatar; sending, to an application server, the AJIF data; obtaining user movement data corresponding to a movement of a user; sending, to the application server, the user movement data corresponding to the movement of the user; receiving, from the application server, scene update data, wherein the scene update data includes updated avatar data corresponding to the movement of the user; and rendering a scene update based on the scene update data.

The invention provides a large-scale scene multi-level-of-detail cloud rendering processing method and device based on 3DGS, and relates to the technical field of three-dimensional modeling, and the method comprises the steps: dividing a target modeling scene into a plurality of sub-blocks; performing particle redundancy reconstruction and overlapping region marking on boundary regions between adjacent sub-blocks of each sub-block to obtain processed sub-blocks; performing multi-detail level division on each processing sub-block to generate a particle level set; determining a current visual area according to the user motion data, and scheduling a target hierarchy of a particle hierarchy set in the current visual area; the rendering tasks of all the processing sub-blocks of the target hierarchy are distributed to a plurality of rendering nodes to execute real-time rendering operation; and performing video stream coding on pictures rendered by each rendering node, decoding and displaying received video stream data, and performing particle level updating and re-rendering operation according to an interaction instruction. According to the invention, high-quality detail rendering can be realized for a model of a large scene.

A method for auxiliarily planning a fracture reduction path based on an augmented reality technology includes: obtaining fracture image data for a fracture area of a patient, the fracture image data including computer tomography (CT) data and X-ray data; reconstructing a three-dimensional model of a fracture part based on the fracture image data; matching and calibrating the three-dimensional model of the fracture part based on the fracture area of the patient in an actual scene; inputting a calibrated three-dimensional model of the fracture part and a corresponding fracture type and fracture surgery requirement into a fracture reduction path planning model to determine at least one corresponding optimized fracture reduction path, where the fracture reduction path planning model includes a cascaded reinforcement learning (RL) module and a multi-physics field simulation optimization module; and rendering each fracture reduction path, and determining a target fracture reduction path according to a detected interactive instruction.

A computer-implemented method for processing electronic images for subject-specific two-dimensional modeling of a subject's vasculature, comprising: receiving one or more subject-specific three-dimensional models of the subject's vasculature, wherein the subject-specific three-dimensional model includes a representation of the vascular tree structure; determining a two-dimensional viewing plane; determining a projection of the representation of the vascular tree structure of the one or more subject-specific three-dimensional model onto the two-dimensional viewing plane; generating one or more subject-specific three-dimensional models around the representation of the vascular tree structure; and generating a two-dimensional image depicting the one or more generated models.

A computer-implemented method for subject-specific two-dimensional modeling of a subject's vasculature may comprise: receiving a subject-specific three-dimensional model of the subject's vasculature, wherein the subject-specific three-dimensional model includes one or more centerlines; determining a two-dimensional viewing plane; determining a projection of the one or more centerlines of the subject-specific three-dimensional model onto the two-dimensional viewing plane; generating one or more models around the one or more centerlines; and generating a two-dimensional image depicting the one or more models.

Various implementations relate to methods, systems and computer readable media to provide cross-device communication with adaptive avatar interaction. According to one aspect, a computer-implemented method includes receiving communication inputs from a first device, determining facial landmarks and head orientation of the first user, and generating an animated 3D avatar based on the inputs. A virtual camera position is adjusted according to the head orientation. The computer-implemented method further receives additional communication inputs from a second device with enhanced features, modifies the avatar accordingly, and provides the enhanced animation to the second device. Various implementations allow for different viewing modes, including picture-in-picture (PIP), side-by-side, and cinematic views, to adapt the experience across multiple devices such as virtual reality (VR) headsets, augmented reality (AR) devices, mobile phones, and desktop computers.

Disclosed is a head-mounted display system comprising a head-mounted display unit producing a computer-generated output for a user. The head-mounted display unit includes at least one sensor. The at least one sensor may be configured to measure a parameter associated with digital eye strain for the user. The at least one sensor may be configured to communicate a measured parameter to a processor, wherein the processor is configured to effect change on the computer-generated output based on the measured parameter.

A method performed by an electronic device, the electronic device, and a storage medium are provided. The method includes obtaining a frame image of a video from a camera and inertia data of an inertial measurement unit (IMU) corresponding to the frame image and obtaining a camera position and pose of the camera, a sparse map, and a high-density map corresponding to the frame image, based on the frame image and the inertia data of the IMU.

An XR system is disclosed having a night mode to optimize performance in low light conditions. The system estimates a user's dark adaptation level based on captured image data and selects a rendering configuration aligned with the user's vision. For example, spatial resolution, temporal resolution, color mode, and brightness are adjusted based on whether the adaptation level is scotopic, mesopic, or photopic. With eye tracking, foveated rendering is used for cones and periphery rendering for rods. Without eye tracking, modes with different wavelengths and colorization are employed. The night mode aims to maximize information visible on the display, conserve power by only showing what eyes can perceive, and preserve night vision by avoiding over-stimulating rods.

The invention relates to the technical field of electric power system digitization, in particular to an automatic efficient modeling method and system for an electricity utilization inspection scene. The automatic efficient modeling method for the electricity utilization inspection scene comprises the four steps of multi-source data collection, dynamic semantic modeling, intelligent modeling decision making and augmented reality rendering, the electricity utilization inspection scene modeling system comprises a data collection module, an intelligent modeling engine, an augmented reality terminal and edge computing equipment, and data interaction is achieved among the modules through a gRPC protocol. According to the method, an L4-level multi-physical field model is generated through unmanned aerial vehicle cluster collaborative collection and multi-source data millisecond-level fusion in combination with a dynamic semantic network and reinforcement learning resource allocation; edge calculation and dynamic LOD rendering are adopted to realize equipment internal perspective and multi-user collaborative labeling, quality closed-loop verification is matched, the bottlenecks of low modeling efficiency, multi-physical field data missing, high interaction delay and the like in the prior art are overcome, and the overall efficiency is improved by 80%.

Systems and methods for rendering of a virtual content object in an augmented reality environment based on a physical marker are discussed herein. Virtual content objects may be rendered by a display device in an augmented reality environment based on the field of view seen through the display device and a position of a marker (and one or more linkage points associated with the marker) in the real world. When rendered in the augmented reality environment, the virtual content objects may be visualized from any angle, from the exterior or interior of the object, and manipulated in response to user input. Virtual content objects and / or user visualizations of virtual content objects may be shared with other users (local and / or remote), enabling multiple users to potentially build, modify, and / or interact with a virtual content object simultaneously and / or cooperatively.

An image processing apparatus includes a processor and a memory storing a program which causes the image processing apparatus to execute detecting a direction of a line of sight of a user viewing the display, detecting a first distance that is a distance relating to a depth to a position of a line of sight of the user, based on the detected direction of the line of sight, detecting a second distance that is a distance relating to a depth to a subject that exists in a direction of the user's line of sight, and changing, based on the first distance and the second distance, at least one of an area in which processing for changing image quality of the image is performed and an image quality in the processing for changing the image quality of the image.

The invention relates to the technical field of image processing, and discloses a three-dimensional reconstruction method, device and equipment of a moving object and a readable storage medium, and the three-dimensional reconstruction method of the moving object comprises the steps: obtaining a plurality of fringe images of a measured moving object at continuous moments, selecting one frame as a reference frame, and obtaining a plurality of fringe images of the measured moving object at continuous moments; constructing an image set together with adjacent image frames; inputting the image set into a deep learning network for pixel-level motion tracking to obtain motion position information; based on the motion information and the intensity information, constructing a phase calculation equation set to obtain a relative phase value; performing phase unwrapping processing on the relative phase value to obtain absolute phase information; and performing phase height mapping by combining system calibration parameters to obtain dynamic three-dimensional shape data. According to the method, phase distortion caused by motion interference is remarkably eliminated, the three-dimensional reconstruction precision and real-time performance in a dynamic scene are improved, and a reliable guarantee is provided for industrial detection and high-speed target measurement.

An extended reality scene description is provided comprising relationships between real and virtual objects and interactive triggering and processing of the extended reality scene; An extended reality system can read the scene description and run a corresponding extended reality application. The scene description comprises a scene graph structuring descriptions of the real and virtual objects which may be linked to media content items. It also comprises of behavior metadata items describing how a user can interact with the scene objects at runtime. Method and devices are disclosed to manage the behaviors comprising triggers and actions and to manage the on-going behaviors when a second scene description is received.

In various examples, systems and methods are disclosed relating to transforming sensor measurements according to configurable atmospheric conditions. One or more circuits can identify a point cloud comprising a plurality of points and a parameter of a weather condition to simulate and modify an intensity of at least one of the plurality of points according to the parameter of the weather condition. The one or more circuits can update, based at least on a subset of the plurality of points and the parameter of the weather condition, the point cloud to include one or more additional points.

The invention discloses an image rendering method, system and device and a medium. The method comprises the steps of obtaining an original oil painting image of an oil painting; determining a normal map corresponding to the original oil painting image; and performing real-time illumination rendering based on the original oil painting image and the normal map to obtain a target oil painting image. The problem that in the prior art, color and texture between the shot and displayed oil painting image and the original painting are different, so that the appreciation experience of a user is poor is solved.

To present an improved method and a computer system with an interface for presenting, to a user, a computer-generated experience which makes interaction with a computer system more efficient and more intuitive for a user.SOLUTION: While a view of a three-dimensional environment is displayed, a computer system detects movement of a user's thumb over the user's index finger by using a camera. In accordance with determination that the movement is a swipe operation of the thumb on the index finger in a first direction, the computer system executes a first operation. In accordance with determination that the movement is a tapping operation of the thumb on the index finger at a first position of the index finger, the computer system carries out a second operation different from the first operation.SELECTED DRAWING: Figure 7B

Techniques are disclosed relating to intersection tests for ray tracing in graphics processors. In some embodiments, traversal circuitry is configured to traverse an acceleration data structure that includes hierarchically-arranged bounding volumes for at least a portion of a graphics scene, including to perform a depth-first search of the acceleration data structure for a ray. The traversal may also include, for a set of child nodes of a first node in the acceleration data structure, selecting a next node for the depth-first search according to an ordering of intersected bounding regions for the set of child nodes. The ordering may begin with a bounding volume that is closer to a mid-point of a ray being tested than one or more front bounding volumes and one or more back bounding volumes.

The invention discloses a component defect detection method and device, electronic equipment and a storage medium. The method comprises the following steps: constructing a three-dimensional model of a component; collecting laser ultrasonic data of the three-dimensional model, and collecting a thermal imaging image and a polarized light image of the assembly; based on the laser ultrasonic data, the thermal imaging image and the polarized light image, predicting to obtain a first defect category and a first defect position corresponding to a defect area of the assembly; based on the defect category and the defect position of the defect area, reconstructing three-dimensional defect data of the component; and on the basis of the three-dimensional defect data, predicting to obtain an expansion direction and an expansion range of the defect area.

An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.

Disclosed are methods and systems for creating an avatar (102) of a real-world athlete (104) using artificial intelligence. A corresponding method may comprise providing (802) an avatar (102) corresponding to a real-world athlete (104), receiving (806) athlete feedback (300) from the real-world athlete (104) in response to a behavior of the avatar (102), and adjusting (808) the avatar (102) based on the received athlete feedback (300).

The present disclosure generally relates to displaying visual effects such as virtual avatars. An electronic device having a camera and a display apparatus displays a virtual avatar that changes appearance in response to changes in a face in a field of view of the camera. In response to detecting changes in one or more physical features of the face in the field of view of the camera, the electronic device modifies one or more features of the virtual avatar.

The invention discloses a transformer substation civil engineering surveying and mapping data processing method and system based on multi-source data, and the method comprises the steps: obtaining three-dimensional point cloud data of a transformer substation, importing beam column coordinates and equipment basic parameters in a BIM design model, and building an initial space reference coordinate system; performing coarse registration of the actually measured point cloud and the BIM model by adopting an iterative nearest point algorithm, and correcting a registration error by introducing a ground control point coordinate; constructing a three-dimensional difference analysis layer, automatically marking a deviation region, exceeding a preset deviation value, between the actually measured point cloud and the BIM model, and generating alarm data including coordinate positions and the deviation value; performing deformation trend verification on the deviation area based on monitoring data of the optical fiber sensor, and triggering model reconstruction when the change rate of continuous three times of sampling data is greater than 1mm / h; and outputting a three-dimensional visualization report integrating the BIM model, the actual measurement point cloud and the deviation area. The problem that early deformation of a civil engineering structure cannot be captured according to civil engineering surveying and mapping data of a transformer substation in the prior art is solved.

This application relates to a physical special effect rendering method performed by a computer device. The method includes: obtaining physical special effect data of physical special effect particles emitted by a particle emission plug-in in a previous frame; obtaining a first target instance obtained by instantiating a scene management class; invoking, through the first target instance, a scene manager of a particle simulation tool to calculate motion state information of the physical special effect particles in a current frame based on the physical special effect data in the previous frame; and updating the physical special effect data in the previous frame based on the motion state information of the current frame to render a physical special effect in the current frame.

The invention discloses a real-time dynamic light and shadow rendering optimization method based on an unreal engine, and relates to the field of light and shadow rendering, and the method comprises the steps: firstly distributing shadow importance scores for all grid objects in a scene based on a camera view cone and AI context data, and carrying out the priority ranking of potential shadow projectors; and then, performance budget evaluation is carried out in combination with the current frame rate and the GPU load, and intelligent shadow projector selection and LOD application are carried out on the sorted shadow projection object list according to the performance budget evaluation. And finally, the optimized shadows to be rendered are sent to a light visual angle rendering and VSM page filling process in batches, and a movable light source optimization virtual schlieren is generated. According to the method, the unnecessary calculation overhead is remarkably reduced, so that the rendering efficiency and the frame rate stability are greatly improved while the high-quality dynamic light and shadow effect is ensured, and the core problem that the traditional performance and quality are difficult to balance is effectively solved.

The present disclosure is directed to systems and techniques for providing immersive and interactive three-dimensional (3D) mapping data and visualizations thereof for emergency response incidents. In one example, the systems and techniques can obtain location information associated with an incident and obtain one or more portions of three-dimensional (3D) mapping data based on the location information associated with the incident. A 3D scene associated with the incident can be generated, wherein the 3D scene is generated based on the one or more portions of 3D mapping data. A first 3D view of the 3D scene can be generated, wherein the first 3D view includes one or more incident location indicators representing the location information of the incident relative to the 3D scene.

A method of detecting a Mura of a virtual image in a near-eye display (NED) and a Demura method are provided, and a method of detecting a Mura of a virtual image in a near-eye display (NED) is provided. The method for detecting Mura comprises: acquiring the virtual image presented in the near-eye display (110, 410, NED); extracting a Mura feature of the virtual image according to a Mura type (320); and evaluating the Mura degree of the virtual image based on the Mura type. The Demura method comprises: acquiring a Mura feature of a first virtual image presented in the near-eye display (110, 410, NED) (320); calculating a compensation factor based on the Mura feature (320); and adjusting a gray value of the near-eye display (110, 410, NED) based on the compensation factor to obtain a second virtual image.

The invention provides a method and system for real-time rendering of hydrodynamic data, and the method comprises the steps: obtaining hydrodynamic result data, carrying out the standardized processing of the hydrodynamic result data according to a target format, and obtaining a standardized result; reading vertex coordinate data and triangular grid index data of the standardized result, traversing a vertex coordinate data set based on values of the triangular grid index data, and further constructing a grid; the hydrodynamic result data of the current time period are packaged and transmitted to the water body grid models, and then grid vertex coordinate data of the water body grid models of the two different time periods are stored into a plurality of UV channels; creating a shader, reading vertex coordinate data in the UV channel and forming three-dimensional vector coordinate data; and constructing the texture of the water body to obtain a rendering result. According to the method, through a mode of reading the hydrodynamic data of multiple time periods in real time and rendering the data, the time for scientific calculation is shortened, and real-time rendering is supported.

Embodiments of the present disclosure relate to continuous and / or binocular time warping methods to account for head movement of the user without having to re-render a displayed image. Continuous time warping allows for transformation of an image from a first perspective to a second perspective of the viewer without having to re-render the image from the second perspective. Binocular time warp refers to the late-frame time warp used in connection with a display device including a left display unit for the left eye and a right display unit for the right eye where the late-frame time warp is performed separately for the left display unit and the right display unit. Warped images are sent to the left and the right display units where photons are generated and emitted toward respective eyes of the viewer, thereby displaying an image on the left and the right display units at the same time.