19 results about "Perspective camera" patented technology

A computer-implemented method includes converting by a pose tokenizer, based on a learned codebook, pose parameters of a body into a sequence of discrete pose tokens; randomly masking a portion of the sequence of discrete pose tokens; predicting the randomly masked sequence of discrete pose tokens based on multi-scale features extracted from a monocular image by an image conditioned masked transformer; optimizing the sequence of discrete pose tokens by aligning a re-projected three-dimensional (3D) pose with an estimated two-dimensional (2D) pose; directly regressing, from the multi-scale features, a shape parameter of the body and a weak perspective camera parameter; and generating a 3D mesh reconstruction of the body based on the shape parameter and the weak perspective camera parameter.

The disclosed systems and techniques facilitate efficient detection and classification of traffic signs in driving environments. The disclosed techniques include, obtaining, using a sensing system of a vehicle a first set of perspective camera images of an environment and a second set of radar images of the environment. The techniques further include generating, using a first neural network, one or more camera features characterizing the first set of images, generating, using a second neural network, one or more radar features characterizing the second set of images, and processing the one or more camera features and the one or more radar features to obtain an identification of one or more traffic signs in the environment.

The present application relates to a kind of video perspective camera automatic focusing method and system for XR head-mounted display, belong to image processing technical field, solve the existing video perspective camera focusing speed slow, and the depth information of monocular image and focusing parameter cannot be effectively mapped problem.Method includes: the current image and its corresponding depth map of the video perspective camera of XR head-mounted display are collected;According to the fixation point coordinates of user in current image, the local region with fixation point coordinates as center is extracted from depth map as fixation area depth map;Fixation area depth map and fixation point coordinates are input into trained focusing parameter prediction model, and the target focusing parameter of video perspective camera is obtained;According to target focusing parameter, video perspective camera is adjusted, and single focusing is completed.Accurate mapping from image to focusing parameter is realized, and focusing speed is improved.

The invention relates to the technical field of video fusion, and discloses a video fusion method and system based on a shadow map and a program product, and the method comprises the following steps: creating a virtual perspective camera in a three-dimensional scene, and generating the shadow map according to a visual cone of the virtual perspective camera; pixels in the three-dimensional scene are converted from a visual space coordinate system of a physical world camera to a virtual perspective camera coordinate system, NDC coordinates of the pixels are obtained, the NDC coordinates are aligned with texture coordinates of the shadow map, and sampling texture coordinates are obtained; judging whether the pixels in the visual range of the virtual perspective camera are in the visual area of the shadow map or not, and obtaining the color of the current pixel of the three-dimensional scene; and obtaining the color of the current pixel of the fused three-dimensional scene. According to the invention, the problems of shielding area processing errors and the like in the prior art are solved.

The invention discloses a production line display method and device based on a three-dimensional rendering technology and electronic equipment, and relates to the technical field of intelligent manufacturing, and the method comprises the steps: creating L target models corresponding to a production line, the L target models being three-dimensional models corresponding to production equipment and equipment connection assemblies in the production line, the data volume of each target model is smaller than a preset data volume threshold; creating a scene container, a perspective camera and a renderer corresponding to the production line, and loading the L target models to the scene container through the renderer to obtain an initial display scene of the production line; based on the layout information of the production line, the equipment operation data and the light information, updating the initial display scene to obtain a target display scene of the production line; and dynamically displaying the target display scene of the production line through the perspective camera. The technical problems of low visualization degree and low production line management efficiency in simulation display of the industrial production line based on the prior art are solved.

The application provides a sparse-to-dense visual positioning method and system based on feature Gaussian splash, and the method comprises the following steps: initializing a color-decoupled feature Gaussian field based on a training image set, optimizing the color-decoupled feature Gaussian field based on a query feature map set in combination with feature rendering and feature alignment loss cyclic optimization, and outputting a compact feature Gaussian scene model; screening a Gaussian landmark set in the compact feature Gaussian scene model by using a matching-oriented sampling strategy; training a scene-specific detector; extracting sparse local features of a query landmark heat map corresponding to a query image and performing sparse feature matching with the Gaussian landmark set to obtain an initial pose of a query perspective camera; based on 3D Gaussian splash, rendering a dense feature map and a depth map of the query perspective in the compact feature Gaussian scene model by using the initial pose of the query perspective camera, performing cluster-based proxy matching-based sparse-to-dense accelerated pose optimization, and obtaining accurate positioning of the query perspective camera.

The invention relates to the technical field of medical image processing, in particular to a neonatal feeding behavior image recognition and oral movement evaluation system which comprises a data acquisition module, a feature extraction module, a differential geometric modeling module, a trajectory analysis module, a collaborative movement analysis module, an anomaly detection module, a result display module and an application service module. According to the system, a high-speed camera, a three-dimensional face tracking camera and an optical perspective camera work cooperatively, multi-view image data of newborn face and oral cavity movement are synchronously collected through a data collection analyzer, and a differential geometry theory is innovatively applied to oral cavity movement analysis. Facial feature point groups are regarded as Riemannian manifolds embedded in a three-dimensional Euclidean space, oral movement characteristics are accurately described through curvature feature calculation, shape operator construction and differential invariant extraction, a coupling model of lip manifolds and mandibular manifolds is systematically constructed, synchronism measurement and topological features between the manifolds are analyzed, and the oral movement characteristics are accurately described. And accurate detection of feeding abnormity is realized.

The invention discloses a visual training animation production method and device, equipment and a medium, and relates to the technical field of visual training, and the visual training animation production method comprises the following steps: obtaining a plurality of display elements, and mapping the display elements to a virtual three-dimensional space provided with a perspective camera; the display elements are replaceable elements; the display elements are to-be-displayed elements stored in an associated medium of the display device and / or elements displayed in a reference area of the display device; determining a moving direction vector corresponding to the display element, and moving the display element in the virtual three-dimensional space according to a preset element moving sequence on the basis of a preset moving rule and the moving direction vector corresponding to the display element, the display elements are projected and rendered to the reference area by using the perspective camera every preset frame rendering time interval so as to complete animation production; the preset movement rule is that the display element moves between the farthest plane and the nearest plane. The convenience and universality of visual training can be improved.

Estimating temporally consistent 3D human body shape, pose, and motion from a monocular video is a challenging task due to occlusions, poor lightning conditions, complex articulated body poses, depth ambiguity, and limited availability of annotated data. Embodiments of present disclosure provide a method for temporally consistent motion estimation from monocular video. A monocular video of person(s) is captured by a weak perspective camera and spatial features of body of the persons are extracted from each frame of the video. Then, initial estimates of body shape, body pose, and features of the weak perspective camera are obtained. The spatial features and initial estimates are then aggregated to obtain spatio-temporal features by a combination of self-similarity matrices between the spatial features, pose and the camera and self-attention maps of the camera features and the spatial features. The spatio-temporal aggregated features are then used to predict shape and pose parameters of the person(s).

A method includes determining that an inter-pupillary distance (IPD) between display lenses of a video see-through (VST) extended reality (XR) device has been adjusted with respect to a default IPD. The method also includes obtaining an image captured using a see-through camera of the VST XR device. The see-through camera is configured to capture images of a three-dimensional (3D) scene. The method further includes transforming the image to match a viewpoint of a corresponding one of the display lenses according to a change in IPD with respect to the default IPD in order to generate a transformed image. The method also includes correcting distortions in the transformed image based on one or more lens distortion coefficients corresponding to the change in IPD in order to generate a corrected image. In addition, the method includes initiating presentation of the corrected image on a display panel of the VST XR device.

A method includes identifying a passthrough transformation associated with a VST XR device. The VST XR device includes see-through cameras that are (i) offset from forward axes extending from expected locations of a user's eyes and / or (ii) rotated such that optical axes of the see-through cameras are angled relative to the forward axes. The method also includes obtaining images captured using the see-through cameras, applying the passthrough transformation to the images to generate transformed images, and displaying the transformed images on one or more display panels of the VST XR device. The passthrough transformation is based on (i) a first transformation between see-through camera viewpoints and viewpoint-matched virtual camera viewpoints and (ii) a second transformation that aligns principal points of the see-through cameras and principal points of the one or more display panels.

A method includes: determining a first set of vertex adjustment values ​​for a distorted mesh at an extended reality (XR) device, and receiving image frame data of a scene captured at a first time in a first head pose using a perspective camera of the XR device. The method further includes: applying the first set of vertex adjustment values ​​for the distorted mesh to the image frame data to obtain intermediate image data, and predicting a second head pose at a second time after the first time. The method further includes: generating a second set of vertex adjustment values ​​for the distorted mesh based on the predicted second head pose, applying the second set of vertex adjustment values ​​for the distorted mesh to the intermediate image data to generate a rendered virtual frame, and displaying the rendered virtual frame by the XR device at a second time.

A method includes generating a virtual view image and a virtual depth map based on an image captured using a see-through camera and a corresponding depth map. The virtual view image and the virtual depth map include holes for which image data or depth data cannot be determined. The method also includes searching one or more previous images to locate a region in at least one previous image that includes missing pixels in the holes. The method further includes at least partially filling the holes in the virtual view image and the virtual depth map with image data and depth data associated with the located region to generate a filled virtual view image and a filled virtual depth map. In addition, the method includes generating a virtual view to present on a display panel of a VST AR device using the filled virtual view image and the filled virtual depth map.

The application discloses a kind of complementary dynamic visual angle camera coordination methods based on polar coordinate transformation, including steps: S1, target detection network, camera positioning network and cross-view target association network training;S2, top view and side view are applied to target detection network to obtain two view target positions;S3, human detection module is generated according to two view target positions Calculation generates two-view heat map;S4, according to the position of the camera positioning network identified by the photographer to the origin of the side view photographer Polar coordinate transformation is carried out on the view heat map;S5, according to the heat map after polar coordinate transformation Application search network of viewing direction determines side view angle;S6, based on the target position identified in step S3 and the side view angle determined in step S5, calculate target similarity matrix and input cross-view target association network to obtain matching matrix output, end, the application is measured with tracking algorithm Similarity of cross-view target, effectively ensure the accuracy of measurement result and the performance of cross-view association.

In one embodiment, a method includes capturing, by a calibration camera, a calibration pattern displayed on a display of a video see-through AR system, where the calibration camera is located at an eye position for viewing content on the video see-through AR system. The method further includes determining, based on the captured calibration pattern, one or more system parameters of the video see-through AR system that represent combined distortion caused by a display lens of the video see-through AR system and caused by a camera lens of the see-through camera; determining, based on the one or more system parameters and on one or more camera parameters that represent distortion caused by the see-through camera, one or more display-lens parameters that represent distortion caused by the display lens; and storing the one or more system parameters and the one more display-lens parameters as a calibration for the system.

Embodiments of the present application provide a kind of three-dimensional target detection method, system, equipment and medium of timing fusion, method includes: the view angle of multiple encoding features based on perspective camera is converted to the view angle of first encoding feature in the multiple encoding features, obtains corresponding multiple target encoding features;The multiple target encoding features and the first encoding feature are superimposed, and the camera feature of the first encoding feature corresponding time is obtained;By the camera feature of multiple view angle cameras is converted in feature space, corresponding multiple space features are obtained;The multiple space features are input into three-dimensional detection head and are processed, and three-dimensional target detection result is obtained.It aims at improving the depth perception accuracy of three-dimensional target, and then improve the accuracy of three-dimensional target detection.

This invention relates to the field of medical image processing technology, and in particular to a system for image recognition and oral motor assessment of neonatal feeding behavior. The system includes a data acquisition module, a feature extraction module, a differential geometry modeling module, a trajectory analysis module, a cooperative motion analysis module, an anomaly detection module, a result display module, and an application service module. The system employs a high-speed camera, a 3D facial tracking camera, and an optical perspective camera working collaboratively. It simultaneously acquires multi-view image data of neonatal facial and oral motor movements through a data acquisition and analysis instrument. Innovatively, it applies differential geometry theory to oral motor analysis, treating facial feature point groups as Riemannian manifolds embedded in 3D Euclidean space. Through curvature feature calculation, shape operator construction, and differential invariant extraction, it accurately characterizes oral motor properties. The system constructs a coupled model of the lip manifold and the mandibular manifold, analyzing the synchronicity measurement and topological features between the manifolds to achieve accurate detection of feeding abnormalities.

A video perspective (VST) augmented reality (XR) apparatus includes a perspective camera configured to capture image frames of a three-dimensional (3D) scene; a display panel; and at least one processing device. The at least one processing device is configured to obtain an image frame, identify a depth-based transformation in the 3D space, transform the image frame into a transformed image frame based on the depth-based transformation, and initiate presentation of the transformed image frame on the display panel. The depth-based transformation provides viewpoint matching between the head pose of the VST XR device when an image frame is captured and the head pose of the VST XR device when a transformed image frame is presented, parallax correction between the head pose of the VST XR device when an image frame is captured and the head pose of the VST XR device when a transformed image frame is presented, and compensation for a change between the head pose of the VST XR device when the image frame is captured and the head pose of the VST XR device when the transformed image frame is presented.

The application relates to a method and a terminal for realizing a pseudo 3D scene based on Unity3D by using a 2D surface sheet, which comprises the following steps: S1, in a 3D scene in which a 2D surface sheet model is pre-prepared and placed, a default perspective camera is replaced by an orthogonal camera, and the camera position and the observation angle of the orthogonal camera are set; S2, an area grid for a character role to walk in is received based on the 3D scene, the area grid is placed into the 3D scene according to user operation, and the area grid is baked by using a Navmesh automatic pathfinding plug-in, wherein the area grid comprises a first area grid of a plane and a second area grid with a height difference; and S3, a NavmeshAgent component is added to the character role, and the movement and turning of each direction of the character role are controlled by acquiring the position of the area grid clicked by the user and the coordinate offset and rotation offset of the character role. The application realizes the picture effect of the movement of the character role in the 3D scene by using the 2D surface sheet model, so that the package size is reduced, and the rendering calculation amount and the game performance consumption are reduced.