25results about "Image rendering" patented technology

A method and an apparatus for processing a 3D scene are presented. Techniques are disclosed for determining light source locations, including tracking a current viewpoint of a camera capturing object(s) in a 3D scene and determining a reference viewpoint relative to the current viewpoint of the camera. According to aspects, a light source location is determined by obtaining a registered map of real cast shadows of the object(s) from an input image captured by the camera, registered with respect to the reference viewpoint. Then, for candidates of light sources, obtaining respective maps of virtual shadows of the object(s) created with respect to the reference viewpoint, and determining the location of the light source based on the candidates of light sources with respective maps of virtual shadows that match the registered map of real cast shadows.

A computing system receives a first image of a three-dimensional object in a human body. The first image of the three-dimensional object includes a structure located in the three-dimensional object. The computing system receives an indication of a location of the structure in the first image. The computing system defines a main axis of the structure based on the indication of the location of the structure and an orientation of the structure. the computing system determines a two-dimensional plane along the main axis of the structure. The computing system generates a second image of the three-dimensional object and the structure along the two-dimensional plane.

An embodiment herein provides a robotic device 100 that enables real-time autonomous navigation in a dynamic environment by determining a navigable space. The robotic device includes at least one image capturing device 102 to capture at least one image or video within a current Field of View (FOV) of the dynamic environment, and a processor 106 that is configured to obtain the point cloud, identify at least one obstacle in the dynamic environment, generate a local map that represents an occupied region and a free region, construct a virtual wall representing an imaginary boundary positioned at a pre-determined distance, project a plurality of rays from an origin of the at least one image capturing device toward the virtual wall at varying angles, determine at least one visible region of the virtual wall, update the local map and enable the robotic device to navigate to a target location.

Methods and systems for executing a Gaussian online splatting model for simultaneously localizing and mapping a surrounding 3D space are disclosed. The model is configured to receive an image-based data sample representing a first field of view of the 3D space and, using a Gaussian 3D map of the model, to render a new image-based data sample representing a new field of view distinct from the first, as well as to render the corresponding speech features. By incorporating a hierarchical encoder and a contrastive speech-image pre-training model (CLIP model) into the architecture of the Gaussian online splatting model, the overall architecture is configured to operate in near real-time.

Provided is a system for automatically generating 3D roads in a virtual environment based on precise road map data, the system including: a map data pre-processing unit configured to perform a pre-processing operation with respect to data of each layer constituting a precise road map; a roadway generation unit configured to generate a roadway by extracting roadway perimeter data based on driving path links; a shoulder generation unit configured to generate a mesh between a curb of a sidewalk which connects a border of the sidewalk and a border of the roadway, and the roadway; a sidewalk and bike road generation unit configured to generate a sidewalk and a bike road; and a road surface marking generation unit configured to generate a mesh for displaying lanes, crosswalks, and road surfaces on a road.

A firearm system includes a firearm and a computer. Electronics in the firearm determine data that includes a pathway between different points of aim of the firearm as the firearm moves. The computer receives this data and builds an image of the pathway between the different points of aim of the firearm.

The present disclosure provides computer-aided diagnosis systems and methods for detecting bone fracture. The method may include obtaining one or more medical images related to one or more bones. The method may also include obtaining a fracture detection model generated based on a machine learning model. The method may also include detecting, for at least one of the one or more medical images, one or more bone fracture regions of the one or more bones in the medical image using the fracture detection model.

A method for generating realistic synthetic images has the following steps: a) Providing a physical object (3) and a digital model (10) of the object (S2); b) Taking (S1) a photograph of the object (3) using a photographic system (1, 2); c)- Generating (S3) a synthetic image of the object (3) based on parameters of the digital model (10) and the photographic system (1, 2); d) Assess (S4) the similarity of the synthetic image to the photograph; and, if the similarity is below a given threshold, e) Modifying (S6) values ​​of parameters of at least the digital model (10), and f) Regenerating (S3) a synthetic image to find an optimized set of parameter values ​​such that the similarity of a synthetic image generated on the basis of the optimized set to the photograph is at or above the specified threshold.

Methods and systems are disclosed for performing operations for transferring garments from one real-world object to another in real time. The operations comprise receiving a first video that includes a depiction of a first person wearing a first upper-body garment in a first pose and obtaining a second video that includes a depiction of a second person wearing a second upper-body garment in a second pose. A pose of the second person depicted in the second video is modified to match the first pose of the first person depicted in the first video. The operations comprise generating an upper-body segmentation of the second upper-body garment which the second person is wearing in the second video in the modified pose and replacing the first upper-body garment worn by the first person in the first video with the second upper-body garment based on the upper-body segmentation.

A computer-implemented method for visualizing the appearance of at least two materials comprises obtaining a first set of appearance attributes, the appearance attributes in the first set being associated with a first material, the first set of appearance attributes comprising measured appearance attributes; obtaining a second set of appearance attributes, the appearance attributes in the second set being associated with a second material; and obtaining a geometric model of at least one virtual object, the geometric model defining a three-dimensional macroscopic surface geometry of the virtual object. The invention is characterized in that a third set of appearance attributes is synthesized from the first set of appearance attributes and the second set of appearance attributes, and a scene comprising the at least one virtual object is visualized using a display device, using the third set of appearance attributes, using the comparison set of appearance attributes and the geometric model, using the third set of appearance attributes to visualize a first portion of the at least one virtual object, and using the comparison set of appearance attributes to visualize a second portion of the at least one virtual object to allow a direct visual comparison of the first set of appearance attributes as modified by the second set of appearance attributes and the comparison set of appearance attributes.

The application discloses a real-time dynamic light rendering optimization method based on Unreal Engine, and relates to the field of light rendering. Firstly, based on a camera view cone and AI context data, shadow importance scores are assigned to each mesh object in a scene, and potential shadow casters are prioritized. Then, performance budget evaluation is performed in combination with the current frame rate and GPU load, and intelligent shadow projector selection and LOD application are performed on the sorted shadow caster list accordingly. Finally, these optimized rendering shadow batches are sent to the light perspective rendering and VSM page filling processes to generate movable light source optimized virtual shadow. This method significantly reduces unnecessary computational overhead, thereby greatly improving rendering efficiency and frame rate stability while ensuring high-quality dynamic light effects, effectively solving the core problem of balancing traditional performance and quality.

A system may comprise a processor and a memory having computer readable instructions stored thereon. The computer readable instructions, when executed by the processor, may cause the system to receive three-dimensional primary image data from an imaging system with a field of view and generate a surface representation for a tissue surface in the field of view. The instructions may also cause the system to identify an area in the field of view with a fiducial marker, associate the fiducial marker with the surface representation, and move the surface representation and the fiducial marker in response to motion of the tissue surface in the field of view.

A tiling unit assigning primitives to tiles in a graphics processing system which has rendering space subdivided into a plurality of tiles. Each tile can comprise one or more polygonal region. Mesh logic of the tiling unit can determine that a plurality of primitives form a mesh and can determine whether the mesh entirely covers a region. If the mesh entirely covers the region then a depth threshold for the region can be updated so that subsequent primitives which lie behind the depth threshold are culled (i.e. not included in the display list for a tile). This helps to reduce the number of primitive IDs included in a display list for a tile which reduces the amount of memory used by the display list and reduces the number of primitives which a hidden surface removal (HSR) module needs to fetch to perform HSR on the tile.

A system and method for generating models from digital images in an interactive environment comprising a memory and a processor in communication with the memory. The processor captures or derives metadata for one or more digital images. The processor derives transforms from the metadata to align the digital images with one or more three-dimensional (“3D”) models of objects / structures represented in the digital image. The processor generates an interactive environment which allows a user to view a contextual model of each of the objects / structures in two dimensional (“2D”) and 3D views.

In association with a virtual area, a first network connection is established with a first network node present in the virtual area and a second network connection is established with a second network node present in the virtual area. Based on stream routing instructions, a stream router is created between the first network node and the second network node. The stream router includes a directed graph of processing elements operable to receive network data, process the received network data, and output the processed network data. On the first network connection, an input data stream derived from output data generated by the first network node is received in association with the virtual area. The input data stream is processed through the stream router to produce an output data stream. On the second network connection, the output data stream is sent to the second network node.

Systems, apparatus, and methods for rendering content based on display assembly pose are disclosed. In an example, motion capture data of a display of a plurality of displays is received, the display moving from a first physical pose to a second physical pose. The motion capture data is processed to determine the coordinates of the second physical pose. A transformation of the second physical pose of the display to a virtual pose of the display is generated. A virtual model of the plurality of displays is updated, the virtual model comprising the virtual pose of the display. The content is rendered on the updated virtual model.

An XR system is disclosed that has a night mode to optimize performance in low light conditions. The system estimates the user's level of dark adaptation based on captured image data and selects a rendering configuration that is consistent with the user's vision. For example, the spatial resolution, temporal resolution, color mode, and luminance are adjusted based on whether the adaptation level is scotopic, mesopic, or photopic. In the case of eye tracking, the fovea is rendered for cone cells and the periphery is rendered for rod cells. In the case of no eye tracking, a pattern with different wavelengths and coloration is employed. The night mode aims to maximize the information visible on the display, save power by only displaying what the eye can perceive, and preserve night vision capability by avoiding overstimulation of rod cells.

Frontend and backend systems and processes. Technical foundations on which an Augmented Reality (AR) platform, such as an AR Social Media Platform. Systems and methods are used to construct and manage an AR Cloud backend and frontend environment facilitation: persistent 3-Dimensional and 2-Dimensional geo-located content that can be created, viewed, changed, and interacted with by users in the same or different sessions; ephemeral content; local creation and posting of content; remote creation and posting of content; remote visualization, altering, and placing content on a 3D map; filtering and management of content in the camera view based on a visibility layer / similar theme and content priority based on preferences, categorization, and ownership; automated creation and posting; lighting of content and digital environments; linking of point clouds with real-world geo-coordinates for accurate map construction; and the security of property and content rights and ownership via smart contracts on a blockchain.

The present disclosure relates to a virtual reality simulator and a computer-readable recording medium. In an eye-sight VR simulation, a sense of incongruity experienced by a user is suppressed. The VR simulator projects or displays a virtual space image on a screen disposed at a position remote from the user in an actual space and not integrally moved with the user. In more detail, the VR simulator acquires information of an actual user position as a position of the head of the user in the actual space. The VR simulator acquires a virtual user position as a position within the virtual space corresponding to the actual user position. Furthermore, the VR simulator acquires a virtual space image by capturing the virtual space with a camera disposed at the virtual user position within the virtual space in accordance with virtual space structure information representing a structure of the virtual space. At this time, the VR simulator performs a sense of perspective adjustment process in which a focal length of the camera is adjusted in such a manner as to eliminate a sense of perspective corresponding to a distance between the actual user position and the screen.

A rendering method, including: based on information about a plurality of lights included in a rendered scene corresponding to a view associated with a camera, classifying the plurality of lights according to a plurality of light types; generating an input texture corresponding to each light type from among the plurality of light types; generating a shadow mask configured to reduce shadow noise included in a shadow corresponding to each light type by applying the input texture to a neural network model; and reducing the shadow noise from the rendered scene using the shadow mask.