864results about "Image rendering" patented technology

Some embodiments of a method may include: obtaining Avatar JSON Interchange File (AJIF) data; decoding the AJIF data to generate avatar data; obtaining animation parameters from the avatar data; obtaining user movement data corresponding to a movement of a user; generating updated avatar data based on the user movement data; and sending the updated avatar data to a client device. For some embodiments, a method may include: generating Avatar JSON Interchange File (AJIF) data corresponding to an avatar; sending, to an application server, the AJIF data; obtaining user movement data corresponding to a movement of a user; sending, to the application server, the user movement data corresponding to the movement of the user; receiving, from the application server, scene update data, wherein the scene update data includes updated avatar data corresponding to the movement of the user; and rendering a scene update based on the scene update data.

The invention provides a large-scale scene multi-level-of-detail cloud rendering processing method and device based on 3DGS, and relates to the technical field of three-dimensional modeling, and the method comprises the steps: dividing a target modeling scene into a plurality of sub-blocks; performing particle redundancy reconstruction and overlapping region marking on boundary regions between adjacent sub-blocks of each sub-block to obtain processed sub-blocks; performing multi-detail level division on each processing sub-block to generate a particle level set; determining a current visual area according to the user motion data, and scheduling a target hierarchy of a particle hierarchy set in the current visual area; the rendering tasks of all the processing sub-blocks of the target hierarchy are distributed to a plurality of rendering nodes to execute real-time rendering operation; and performing video stream coding on pictures rendered by each rendering node, decoding and displaying received video stream data, and performing particle level updating and re-rendering operation according to an interaction instruction. According to the invention, high-quality detail rendering can be realized for a model of a large scene.

A method for auxiliarily planning a fracture reduction path based on an augmented reality technology includes: obtaining fracture image data for a fracture area of a patient, the fracture image data including computer tomography (CT) data and X-ray data; reconstructing a three-dimensional model of a fracture part based on the fracture image data; matching and calibrating the three-dimensional model of the fracture part based on the fracture area of the patient in an actual scene; inputting a calibrated three-dimensional model of the fracture part and a corresponding fracture type and fracture surgery requirement into a fracture reduction path planning model to determine at least one corresponding optimized fracture reduction path, where the fracture reduction path planning model includes a cascaded reinforcement learning (RL) module and a multi-physics field simulation optimization module; and rendering each fracture reduction path, and determining a target fracture reduction path according to a detected interactive instruction.

A computer-implemented method for processing electronic images for subject-specific two-dimensional modeling of a subject's vasculature, comprising: receiving one or more subject-specific three-dimensional models of the subject's vasculature, wherein the subject-specific three-dimensional model includes a representation of the vascular tree structure; determining a two-dimensional viewing plane; determining a projection of the representation of the vascular tree structure of the one or more subject-specific three-dimensional model onto the two-dimensional viewing plane; generating one or more subject-specific three-dimensional models around the representation of the vascular tree structure; and generating a two-dimensional image depicting the one or more generated models.

A computer-implemented method for subject-specific two-dimensional modeling of a subject's vasculature may comprise: receiving a subject-specific three-dimensional model of the subject's vasculature, wherein the subject-specific three-dimensional model includes one or more centerlines; determining a two-dimensional viewing plane; determining a projection of the one or more centerlines of the subject-specific three-dimensional model onto the two-dimensional viewing plane; generating one or more models around the one or more centerlines; and generating a two-dimensional image depicting the one or more models.

A method for three-dimensional (3D) imaging of an underground goaf includes: obtaining a video image and point cloud data of an underground goaf; determining a posture transformation matrix, and aligning the video image and the point cloud data; identifying a material texture based on the video image to obtain material texture information; dividing the point cloud data into triangular meshes to form an initial 3D model of the underground goaf; mapping the material texture information onto the 3D model to form a target 3D model with a material texture attribute; calculating a bidirectional reflectance distribution function (BRDF) of the target 3D model based on the material texture attribute; simulating global illumination, and constructing a rendering equation; and making a setting to emit ray from a viewpoint, and performing ray tracing based on the rendering equation to obtain a high-brightness real scene image of the underground goaf.

Various implementations relate to methods, systems and computer readable media to provide cross-device communication with adaptive avatar interaction. According to one aspect, a computer-implemented method includes receiving communication inputs from a first device, determining facial landmarks and head orientation of the first user, and generating an animated 3D avatar based on the inputs. A virtual camera position is adjusted according to the head orientation. The computer-implemented method further receives additional communication inputs from a second device with enhanced features, modifies the avatar accordingly, and provides the enhanced animation to the second device. Various implementations allow for different viewing modes, including picture-in-picture (PIP), side-by-side, and cinematic views, to adapt the experience across multiple devices such as virtual reality (VR) headsets, augmented reality (AR) devices, mobile phones, and desktop computers.

Disclosed is a head-mounted display system comprising a head-mounted display unit producing a computer-generated output for a user. The head-mounted display unit includes at least one sensor. The at least one sensor may be configured to measure a parameter associated with digital eye strain for the user. The at least one sensor may be configured to communicate a measured parameter to a processor, wherein the processor is configured to effect change on the computer-generated output based on the measured parameter.

A method performed by an electronic device, the electronic device, and a storage medium are provided. The method includes obtaining a frame image of a video from a camera and inertia data of an inertial measurement unit (IMU) corresponding to the frame image and obtaining a camera position and pose of the camera, a sparse map, and a high-density map corresponding to the frame image, based on the frame image and the inertia data of the IMU.

An XR system is disclosed having a night mode to optimize performance in low light conditions. The system estimates a user's dark adaptation level based on captured image data and selects a rendering configuration aligned with the user's vision. For example, spatial resolution, temporal resolution, color mode, and brightness are adjusted based on whether the adaptation level is scotopic, mesopic, or photopic. With eye tracking, foveated rendering is used for cones and periphery rendering for rods. Without eye tracking, modes with different wavelengths and colorization are employed. The night mode aims to maximize information visible on the display, conserve power by only showing what eyes can perceive, and preserve night vision by avoiding over-stimulating rods.

Approaches presented herein provide for the optimization of tasks performed for an operation such as the rendering of an image. A Frame Interceptor (FI) can generate a resource dependency graph (RDG) by intercepting API calls during the rendering process and determining dependencies. FI can analyze the RDG to identify potential optimizations, such as may correspond to reordering or parallel execution of certain tasks. FI can automatically test optimizations to determine whether sufficient improvement is obtained. This testing can be performed in real time by replacing the originally intercepted API calls with the newly ordered API calls generated by FI. FI can then issue a report that indicates information such as the changes made, the time taken to render the image, and potentially the fact that the images were determined to be identical.

The invention relates to the technical field of electric power system digitization, in particular to an automatic efficient modeling method and system for an electricity utilization inspection scene. The automatic efficient modeling method for the electricity utilization inspection scene comprises the four steps of multi-source data collection, dynamic semantic modeling, intelligent modeling decision making and augmented reality rendering, the electricity utilization inspection scene modeling system comprises a data collection module, an intelligent modeling engine, an augmented reality terminal and edge computing equipment, and data interaction is achieved among the modules through a gRPC protocol. According to the method, an L4-level multi-physical field model is generated through unmanned aerial vehicle cluster collaborative collection and multi-source data millisecond-level fusion in combination with a dynamic semantic network and reinforcement learning resource allocation; edge calculation and dynamic LOD rendering are adopted to realize equipment internal perspective and multi-user collaborative labeling, quality closed-loop verification is matched, the bottlenecks of low modeling efficiency, multi-physical field data missing, high interaction delay and the like in the prior art are overcome, and the overall efficiency is improved by 80%.

In accordance with the described techniques, a portrait relighting system receives user input defining one or more markings drawn on a portrait image. Using one or more machine learning models, the portrait relighting system generates an albedo representation of the portrait image by removing lighting effects from the portrait image. Further, the portrait relighting system generates a shading map of the portrait image using the one or more machine learning models by designating the one or more markings as a lighting condition, and applying the lighting condition to a geometric representation of the portrait image. The one or more machine learning models are further employed to generate a relit portrait image based on the albedo representation and the shading map.

Systems and methods for rendering of a virtual content object in an augmented reality environment based on a physical marker are discussed herein. Virtual content objects may be rendered by a display device in an augmented reality environment based on the field of view seen through the display device and a position of a marker (and one or more linkage points associated with the marker) in the real world. When rendered in the augmented reality environment, the virtual content objects may be visualized from any angle, from the exterior or interior of the object, and manipulated in response to user input. Virtual content objects and / or user visualizations of virtual content objects may be shared with other users (local and / or remote), enabling multiple users to potentially build, modify, and / or interact with a virtual content object simultaneously and / or cooperatively.

Disclosed herein are various embodiments related generally to computer vision, graphics, image scanning, shadow casters, shadow caster scanners, and image processing as well as associated mechanical, electrical and electronic hardware, computer software and systems, and wired and wireless network communications to form at least three-dimensional models or images of objects and environments.

An image processing apparatus includes a processor and a memory storing a program which causes the image processing apparatus to execute detecting a direction of a line of sight of a user viewing the display, detecting a first distance that is a distance relating to a depth to a position of a line of sight of the user, based on the detected direction of the line of sight, detecting a second distance that is a distance relating to a depth to a subject that exists in a direction of the user's line of sight, and changing, based on the first distance and the second distance, at least one of an area in which processing for changing image quality of the image is performed and an image quality in the processing for changing the image quality of the image.

The invention relates to the technical field of image processing, and discloses a three-dimensional reconstruction method, device and equipment of a moving object and a readable storage medium, and the three-dimensional reconstruction method of the moving object comprises the steps: obtaining a plurality of fringe images of a measured moving object at continuous moments, selecting one frame as a reference frame, and obtaining a plurality of fringe images of the measured moving object at continuous moments; constructing an image set together with adjacent image frames; inputting the image set into a deep learning network for pixel-level motion tracking to obtain motion position information; based on the motion information and the intensity information, constructing a phase calculation equation set to obtain a relative phase value; performing phase unwrapping processing on the relative phase value to obtain absolute phase information; and performing phase height mapping by combining system calibration parameters to obtain dynamic three-dimensional shape data. According to the method, phase distortion caused by motion interference is remarkably eliminated, the three-dimensional reconstruction precision and real-time performance in a dynamic scene are improved, and a reliable guarantee is provided for industrial detection and high-speed target measurement.

An extended reality scene description is provided comprising relationships between real and virtual objects and interactive triggering and processing of the extended reality scene; An extended reality system can read the scene description and run a corresponding extended reality application. The scene description comprises a scene graph structuring descriptions of the real and virtual objects which may be linked to media content items. It also comprises of behavior metadata items describing how a user can interact with the scene objects at runtime. Method and devices are disclosed to manage the behaviors comprising triggers and actions and to manage the on-going behaviors when a second scene description is received.

In various examples, systems and methods are disclosed relating to transforming sensor measurements according to configurable atmospheric conditions. One or more circuits can identify a point cloud comprising a plurality of points and a parameter of a weather condition to simulate and modify an intensity of at least one of the plurality of points according to the parameter of the weather condition. The one or more circuits can update, based at least on a subset of the plurality of points and the parameter of the weather condition, the point cloud to include one or more additional points.

The invention provides a fracture reduction path auxiliary planning method and system based on an augmented reality technology, and relates to the technical field of intelligent medical systems. The method comprises the following steps: acquiring fracture image data for a fracture area of a patient, wherein the fracture image data comprises CT data and X-ray data; reconstructing a fracture part three-dimensional model based on the fracture part image data; matching and calibrating the three-dimensional model of the fracture part and the fracture area of the patient in the actual scene; the calibrated three-dimensional model of the fracture part and the corresponding fracture type and fracture operation requirements are input into a fracture reduction path planning model to determine at least one corresponding optimized fracture reduction path, and the fracture reduction path planning model comprises a reinforcement learning module and a multi-physics field simulation optimization module which are cascaded; and rendering each fracture reduction path, and determining a target fracture reduction path according to the detected interaction instruction. Therefore, the augmented reality technology is applied to the fracture reduction scene, and the success rate of the operation and the postoperative rehabilitation effect of the patient can be improved.

The invention discloses an image rendering method, system and device and a medium. The method comprises the steps of obtaining an original oil painting image of an oil painting; determining a normal map corresponding to the original oil painting image; and performing real-time illumination rendering based on the original oil painting image and the normal map to obtain a target oil painting image. The problem that in the prior art, color and texture between the shot and displayed oil painting image and the original painting are different, so that the appreciation experience of a user is poor is solved.

Determining a fit of a real-world electronic gaming machine (EGM) using a virtual representation of an EGM includes obtaining the virtual representation, obtaining sensor data for a real-world environment in which the virtual representation is to be presented, and detecting one or more surfaces in the real-world environment based on the sensor data. A determination is made that the virtual representation of the electronic gaming machine fits within the real-world environment in accordance with the real-world dimensions and the detected one or more surfaces. The virtual representation is presented in a mixed reality environment such that the virtual representation is blended into a view of a real-world environment along the one or more surfaces.

To present an improved method and a computer system with an interface for presenting, to a user, a computer-generated experience which makes interaction with a computer system more efficient and more intuitive for a user.SOLUTION: While a view of a three-dimensional environment is displayed, a computer system detects movement of a user's thumb over the user's index finger by using a camera. In accordance with determination that the movement is a swipe operation of the thumb on the index finger in a first direction, the computer system executes a first operation. In accordance with determination that the movement is a tapping operation of the thumb on the index finger at a first position of the index finger, the computer system carries out a second operation different from the first operation.SELECTED DRAWING: Figure 7B

Techniques are disclosed relating to intersection tests for ray tracing in graphics processors. In some embodiments, traversal circuitry is configured to traverse an acceleration data structure that includes hierarchically-arranged bounding volumes for at least a portion of a graphics scene, including to perform a depth-first search of the acceleration data structure for a ray. The traversal may also include, for a set of child nodes of a first node in the acceleration data structure, selecting a next node for the depth-first search according to an ordering of intersected bounding regions for the set of child nodes. The ordering may begin with a bounding volume that is closer to a mid-point of a ray being tested than one or more front bounding volumes and one or more back bounding volumes.

The invention discloses a component defect detection method and device, electronic equipment and a storage medium. The method comprises the following steps: constructing a three-dimensional model of a component; collecting laser ultrasonic data of the three-dimensional model, and collecting a thermal imaging image and a polarized light image of the assembly; based on the laser ultrasonic data, the thermal imaging image and the polarized light image, predicting to obtain a first defect category and a first defect position corresponding to a defect area of the assembly; based on the defect category and the defect position of the defect area, reconstructing three-dimensional defect data of the component; and on the basis of the three-dimensional defect data, predicting to obtain an expansion direction and an expansion range of the defect area.

While displaying a three-dimensional scene including at least a first virtual object displayed with a first value corresponding to a first portion and a second value corresponding to a second portion of the first virtual object at a first location and a first physical surface at a second location, a computer system generates a first visual effect at the second location of the three-dimensional scene, including modifying a visual appearance of a first portion of the first physical surface in the three-dimensional scene in accordance with the first value for the first display property that corresponds to the first portion of the first virtual object; and modifying a visual appearance of a second portion of the first physical surface in the three-dimensional scene in accordance with the second value for the first display property that corresponds to the second portion of the first virtual object.

An augmented reality display system comprises a passable world model data comprises a set of map points corresponding to one or more objects of the real world. The augmented reality system also comprises a processor to communicate with one or more individual augmented reality display systems to pass a portion of the passable world model data to the one or more individual augmented reality display systems, wherein the piece of the passable world model data is passed based at least in part on respective locations corresponding to the one or more individual augmented reality display systems.

While displaying a three-dimensional scene including physical elements and virtual elements, a computer system detects a sequence of user inputs for increasing a level of immersion of the three-dimensional scene. In response, the computer system increases the quantity of virtual elements displayed in the scene, including displaying an animated transition to replace a portion of a first region occupied by a first set of physical elements with virtual elements in response to a first input, and displaying another animated transition that replaces a portion of a second region occupied by a subset of the remaining physical elements with virtual elements in response to a second input following the first input, wherein virtual elements occupy increasing portions of the scene after each of the first input and the second input.

Disclosed are methods and systems for creating an avatar (102) of a real-world athlete (104) using artificial intelligence. A corresponding method may comprise providing (802) an avatar (102) corresponding to a real-world athlete (104), receiving (806) athlete feedback (300) from the real-world athlete (104) in response to a behavior of the avatar (102), and adjusting (808) the avatar (102) based on the received athlete feedback (300).

The present disclosure generally relates to displaying visual effects such as virtual avatars. An electronic device having a camera and a display apparatus displays a virtual avatar that changes appearance in response to changes in a face in a field of view of the camera. In response to detecting changes in one or more physical features of the face in the field of view of the camera, the electronic device modifies one or more features of the virtual avatar.