6289 results about "Projector" patented technology

The invention relates to a method and a system for inhibiting strong mutual reflection based on polarization complementary logic coding. The method comprises the following steps: acquiring calibration parameters of a camera and a projector; generating a polarization phase shift stripe based on the calibration parameter, designing a high-frequency complementary logic code word, and embedding the high-frequency complementary logic code word into a polarization channel through polarization modulation to obtain a composite stripe pattern; the method comprises the following steps: calculating to obtain a linear polarization degree image through an acquired multi-angle polarization image, extracting a high-reflection region from the linear polarization degree image by adopting an adaptive threshold segmentation method, and carrying out binarization processing on the linear polarization degree image to obtain a binarized linear polarization degree mask; and on the basis of a decoding range of a binary linear polarization degree mask constraint high-reflection region, decoding the composite stripe pattern to obtain absolute phase level information, and performing noise suppression on the absolute phase level information by adopting a self-adaptive threshold algorithm. The method can effectively solve the influence of mutual reflection and high dynamic range of the surfaces of the measured object, and improves the precision and stability of three-dimensional reconstruction.

The invention relates to a non-standard special-shaped part high-precision measurement and verification method based on three-dimensional vision, and belongs to the field of three-dimensional reconstruction and computer vision. Point cloud data of a non-standard special-shaped part are obtained through multi-angle scanning by means of multi-camera-projector collaborative layout in combination with a structured light coding technology and a phase shift code technology; the method comprises the following steps of: acquiring point cloud data, ensuring comprehensiveness and accuracy of the data, realizing high-precision alignment of the point cloud data through matching an underivative optimization algorithm with image feature points, and performing fusion, denoising and registration processing on the acquired point cloud data to ensure that point clouds acquired from a plurality of angles can be effectively fused so as to reconstruct a high-precision three-dimensional model. In the measurement and verification stage, the deviation between the point cloud data and the CAD model is measured through a standard coordinate system, multi-stage registration and a high-precision algorithm, rapid detection and size verification of the geometric deviation of the industrial workpiece are achieved, and reliable technical support is provided for quality control.

A video output device includes a projector module configured to output a content image along a radiation direction, a first rotating device configured to rotate at least a portion of the projector module about a first axis that is parallel to the radiation direction, a second rotating device configured to rotate the projector module about a second axis intersecting the first axis, a substrate electrically connected to the second rotating device, and a connector electrically connected to the substrate through a first wire, electrically connected to the second rotating device through a second wire. While the projector module rotates about the second axis, the connector is configured to prevent the first wire and the second wire from being twisted.

The invention provides a construction and training method and device for an eye fundus image multi-task model, and belongs to the field of image processing, and the method comprises the steps: S1, collecting and sorting a public eye fundus image data set, constructing an image text pair according to a real label, and carrying out the two-stage training of a multi-modal large language model, the multi-mode large language model comprises a visual encoder, a visual projector and a large language model; s2, inputting the image data # imgabs0 # into a visual encoder in the trained multi-modal large language model to obtain an enhanced visual feature # imgabs1 #, and extracting a visual feature # imgabs3 # from the # imgabs2 # through a visual projector; and S3, embedding the text input # imgabs4 # to obtain a text feature # imgabs5 #, splicing the text feature # imgabs5 # with the visual feature # imgabs6 #, and inputting the spliced text feature # imgabs5 # and the visual feature # imgabs6 # into a large language model to generate a prediction text A. According to the method, a wide range of fundus image data is collected for training, multilevel lesion features in the fundus image are fully utilized, and the performance of the model for executing a fundus disease auxiliary diagnosis task can be effectively improved.

The invention belongs to the field of three-dimensional measurement, and discloses a three-dimensional reconstruction method based on structured light image enhancement, which comprises the following steps of: generating a stripe coding pattern: generating four sine stripe patterns with different phase shift amounts by using MATLAB programming, and projecting the sine stripe patterns to the surface of an object to be measured; calibrating a camera; calibrating a projector; the method comprises the following steps: capturing four phase shift stripe images projected on the surface of an object by using a camera, and preprocessing the stripe images collected by the camera through a GF-CL image enhancement algorithm; acquiring a wrapped phase: extracting wrapped phase distribution through a four-step phase calculation formula; generating a Gray code; carrying out binarization conversion; unwrapping the phase by using a complementary Gray code; and performing three-dimensional reconstruction. According to the invention, the contrast is improved by using an image enhancement algorithm, and noise is effectively removed. In addition, three-dimensional reconstruction is carried out by combining a four-step phase shift method and a complementary Gray code, so that the error of edge hopping in the traditional Gray code reconstruction is eliminated, and no hopping and interruption are ensured when a real phase is obtained.

An electronic device includes: a projector; a camera; one or more processors; and memory storing instructions that, when executed by the one or more processors, cause the electronic device to: control the projector to display a projected image on a screen, wherein the screen includes surfaces; control the camera to obtain a captured image including the surfaces and the projected image; identify, based on the captured image, shapes of the surfaces and areas of the projected image projected onto the surfaces; and correct the projected image, based on the shapes of the surfaces and the areas of the projected image, by transforming the projected image into one from among a three-dimensional image and a flat image.

Disclosed herein is an ultrasound imaging system including an ultrasound probe and a blood vessel visualization device. The ultrasound probe includes an ultrasound generation device and is configured to detect one or more blood vessels. The blood vessel visualization device is configured to project a depiction of the blood vessel topography within a target area. The blood vessel visualization device can include one or more near-infrared / infrared emitters configured to generate infrared / near-infrared waves within the target area, one or more near-infrared / infrared sensors configured to detect the difference in reflective properties of tissue and blood vessels within the target area, and one or more visual light projectors configured to project a blood vessel visualization depiction of the blood vessel topography onto the target area.

A system for three-dimensional spatial perception underwater that includes a primary submersible vehicle. Frontward facing projectors are used to scan beams of light across a selected field of underwater view. Further, event cameras with pixels triggered by events are used to detect corresponding spots of the scanned beams that are reflected from underwater objects or surfaces. Circuitry is configured to determine positions of the objects based on the pixels that are triggered. Additionally, pilot submersible vehicles the projectors and event cameras are tethered to the primary submersible vehicle to provide extend detection of spots corresponding to reflections from underwater objects or surfaces.

The invention provides a robot control method and device, equipment and a storage medium, and relates to the technical field of robot control. The method comprises the steps of obtaining robot data of a robot executing a task, and determining a learning data set according to the data; building a first robot action prediction model based on the initial visual language model; obtaining a second robot action prediction model according to the data set and the first robot action prediction model; a robot time sequence, image data and a language instruction are taken and input into a second robot action prediction model, the time sequence data are input into a second language model through a preset time sequence model and a multi-layer projector, the image data are input into the second language model through a visual encoder and the projector, and the language instruction is input into the second language model through the first language model; the second language model outputs continuous actions to be executed; and completing the task according to continuous action control. And the time sequence model captures time sequence characteristics, so that the second robot action prediction model outputs continuous actions to be executed, and the operation smoothness and continuity are effectively guaranteed.

The invention belongs to the technical field of stereoscopic vision, and discloses a depth estimation method based on adaptive structured light. The method comprises the following steps: acquiring a camera visual angle RGB image in a scene that a projector is turned off, acquiring a camera visual angle coarse disparity map through a semi-global matching algorithm, generating a projector visual angle RGB image and a projector visual angle coarse disparity map through projection transformation, and inputting the images into an adaptive structured light generation module to generate an adaptive structured light projection pattern; the adaptive structured light projection pattern generates a camera visual angle structured light image through a physical perception differentiable imaging module; the parallax attention depth estimation module receives the camera visual angle RGB image and the camera visual angle structured light image and outputs a depth estimation result; and taking the depth error as a loss function, jointly training and optimizing the adaptive structured light generation module and the parallax attention depth estimation module, and performing depth estimation after optimization. The optimal structured light mode is dynamically generated according to the real-time information of the scene, and the problem that traditional fixed-mode structured light cannot adapt to scene changes is solved.

The invention relates to the technical field of detection, in particular to a complex shell detection method and system based on structured light scanning. The method comprises the following steps: calculating a wrapped phase value and a phase modulation amplitude of each pixel point under each frequency, calculating discrete probability distribution containing candidate stripe series and a corresponding probability for each pixel point based on a multi-frequency wrapped phase difference, generating an initial pixel confidence map, and constructing an energy function; the penalty weight of the smooth item is determined according to the phase modulation amplitude and the wrapped phase gradient local variance, obtaining an initial fringe order distribution diagram, updating discrete probability distribution by using an initial pixel confidence map, re-minimizing an energy function to obtain a corrected fringe order distribution diagram, and reconstructing a final three-dimensional shape. And iteratively optimizing a projector principal point and a radial distortion coefficient in system calibration parameters. According to the scheme, the geometric details of the surface can be reserved, and the processing effect and the measurement precision of the complex curved surface and the high-curvature area are improved.

The invention discloses a fringe projection three-dimensional shape measurement method based on frequency domain and time domain joint coding, and the method comprises the following steps: firstly, embedding a multi-frequency three-step phase shift fringe pattern in the vertical direction based on multi-scale region division, introducing four-step phase shift and complementary Gray code joint coding in the horizontal direction, generating a coding pattern set, and carrying out the projection; after an image is collected, frequency domain transformation and time domain decoding are carried out respectively, and a vertical dominant frequency position, a horizontal period number and a wrapped phase are obtained; then, combining a main frequency position in the vertical direction with a period number and a wrapped phase in the horizontal direction, and extracting a space coordinate of a direct illumination component based on frequency position invariance; and finally, establishing a pixel homonymy point mapping relation between the projector and the camera, and realizing high-precision three-dimensional reconstruction. Compared with a traditional frequency shift method, the method has the advantages that projection patterns are greatly reduced, reconstruction precision and anti-interference performance are improved, and the method is suitable for dynamic three-dimensional measurement under complex illumination conditions such as specular reflection, semitransparent shielding and subsurface scattering.

The invention relates to the technical field of projectors, in particular to an intelligent picture geometric distortion control method based on machine vision and an image projector, and the method comprises the steps: obtaining image data of a to-be-corrected projection picture, and carrying out the feature analysis of the image data, so as to obtain a distortion feature value; matching a correction optimization model corresponding to the distortion characteristic value, so as to call a correction parameter from a preset correction parameter library through the correction optimization model; simulating a correction process corresponding to the projection picture to be corrected according to the correction parameter; the correction parameters are adjusted according to the correction process, and the projection picture to be corrected is corrected according to the adjusted correction parameters, the corresponding correction optimization model is matched based on the characteristic values, the adaptive correction parameters can be dynamically called from the preset parameter library, the limitation of a traditional fixed algorithm is changed, and the correction efficiency is improved. The correction strategy is highly coupled with the actual distortion scene, and the correction efficiency and pertinence are remarkably improved.

The invention discloses a projection single attitude calibration method, system and device and a medium, and relates to the technical field of computer vision and projection interaction.The method comprises the steps that a plurality of calibration patterns are generated and projected to a calibration plane, gray level images are collected, corner point detection and sub-pixel refinement processing are carried out, and a projection single attitude calibration result is obtained. The method comprises the following steps: acquiring an angular point corresponding relation between a projector image and a camera image, carrying out iterative solution on a projection matrix of a projector and a projection matrix of a camera, separating an internal parameter matrix and an external parameter matrix, calculating a basic matrix and an essential matrix, and decomposing to obtain a rotation matrix and a translation vector of the camera relative to the projector; camera imaging distortion is estimated, a distortion correction coefficient is obtained, and distortion correction is carried out; and counting a re-projection error generated in the correction process, and adjusting parameters of the projector and the camera until the error meets a preset precision requirement. Projector parameter calculation is completed through projection single posture calibration, posture adjustment is not needed in the calibration process, the automation degree is improved, and meanwhile manual intervention is reduced.

1. Name of the Design Product: Projector. 2. Use of the Design Product: For projecting images, videos, etc. 3. Design Feature of the Design Product: Lies in the shape. 4. Picture or Photograph that Best Illustrates the Design Feature: Perspective View 1.

The invention provides a visual token removal method for video understanding model reasoning acceleration, which is based on a visual attention contraction phenomenon, dynamically evaluates the importance of visual tokens and screens and removes redundant tokens by analyzing the distribution and change of attention weights of the visual tokens in a reasoning pre-filling stage. Therefore, calculation overhead is reduced and reasoning efficiency is improved. The method comprises the following steps: carrying out frame sampling and region division on video input to obtain image blocks with space-time structures; the method comprises the following steps: extracting visual features by using a visual encoder and a projector and generating a visual token; splicing the visual token with the system token and the text token to form multi-modal input; tracking the attention change trend of the text to the vision to evaluate the importance of the visual token; the recognition of unimportant visual tokens is accelerated through a grouping and aggregation mode, and the unimportant visual tokens are gradually removed in reasoning. While the output quality is maintained, the method significantly reduces the reasoning time and memory occupation.

The invention provides a structured light calibration method and system under three coordinates, and relates to the technical field of structured light imaging, and the method comprises the steps: 1, collecting calibration plate images of a plurality of angles, extracting sub-pixel angular point data, constructing a camera parameter description mode including radial and tangential distortion, and based on a pinhole imaging principle, carrying out the calibration of a plurality of angles; solving an internal parameter matrix and a distortion coefficient of the camera by establishing a linear equation set so as to obtain calibrated camera parameters; 2, projecting a composite coding pattern to the calibration plate based on the calibrated camera parameters, synchronously acquiring related images, decoding phase and coding data, establishing a corresponding relation between projector pixels and three-dimensional space points of the calibration plate by using the calibrated camera parameters, and solving an internal and external parameter matrix of the projector to obtain initial projector parameters; according to the invention, through multi-view image acquisition, composite coding projection and three-dimensional target matching, structured light collaborative calibration of camera and projector parameters is realized.

The invention discloses a projector projection brightness adaptive control method and system based on deep learning, and relates to the technical field of projector control, and the method comprises the steps: S1, constructing a deep learning model; s2, ambient light perception and data acquisition; s3, implementing a local brightness adjustment algorithm; s4, real-time brightness adjustment and feedback are carried out; and S5, performing user interaction and personalized setting. According to the projector projection brightness adaptive control method and system based on deep learning, a hybrid architecture combining multi-task learning and a convolutional neural network is designed, and the hybrid architecture is used for learning a complex relationship between ambient light and projection picture brightness and an optimal strategy for brightness adjustment of each region in a picture; and the adjustment strategy is applied to the projection picture, the brightness level of each area is adjusted in real time, and then the local brightness adjustment strategy is adjusted in combination with feedback information of the brightness adjustment effect, so that the optimal projection brightness adaptive control effect of the projector is achieved.

The present disclosure relates to systems and methods for generating a digital representation of a three-dimensional (3D) object. In particular, the disclosure relates to a dental scanning system for acquiring images of the object and for generating the digital representation of the object. One embodiment relates to a dental scanning system for scanning a dental object, comprising an intraoral 3D scanning device comprising at least one projector unit configured to project a light pattern along a projector optical axis, the light pattern comprising a plurality of pattern features; one or more cameras having at least partly overlapping fields of view along different camera optical axes (and along the projector optical axis), each of the cameras comprising an image sensor, wherein the system further comprises one or more processors configured to generate a digital three-dimensional representation of the dental object based on triangulation.

1. The name of the product of this design: mobile phone rear camera and screen device. 2. Purpose of the product with this design: to push multimedia content such as pictures, videos and music on the mobile phone to display screens, televisions, projectors and other devices for playback. 3. The design key point of this appearance design product lies in the shape. 4. The picture or photo that best illustrates the design points: Stereoscopic diagram 1.

The invention discloses a non-contact multi-modal decoupling emotion recognition method and device in a dialogue scene. The method comprises the following steps: acquiring original data of multiple modals in the dialogue scene; encoding the original data into original features by using a mode-dedicated encoder; projecting the original features by using a shared feature projector to obtain projection features, and performing weighted fusion to obtain shared features; extracting exclusive features from the original features by using a modal-specific expert network, and carrying out weighted fusion on the exclusive features to obtain private features; fusing the shared features and the private features through a cross attention fusion module to obtain multi-modal fusion features; and classifying the multi-modal fusion features by using a first classifier to obtain an emotion recognition result. According to the method, the key problems of high modal feature heterogeneity, inconsistent modal information, unbalanced modal, missing and the like in the field of multi-modal emotion recognition are solved, and the performance and robustness of emotion recognition in a dialogue scene are improved.

1. Name of the Design Product: Projector. 2. Use of the Design Product: For projectors. 3. Design Key Points of the Design Product: Lies in the shape. 4. Picture or Photo that Best Illustrates the Design Key Points: Perspective View 1.

The invention belongs to the technical field of medical images, and relates to a surgical navigation-oriented multi-dimensional medical image adaptive registration method, which comprises the following steps: acquiring a 3D CT image, performing feature extraction, and performing voxel-by-voxel addition on the 3D CT image and an original 3D CT image to obtain a 3D image to be projected; obtaining current pose estimation and target pose estimation; inputting the 3D image, the current pose estimation and the current pose estimation into a ProST projector to obtain a current projection image and a target projection image; inputting the current projection image and the target projection image into a double-path encoder-decoder, and capturing a global corresponding relation between features by adopting a cross-modal attention module to generate final features; fusing the final features, and inputting the fused final features into a total differential regression iteration model to obtain a registered medical image; the regression module provided by the invention provides a more robust initial pose for the optimization framework, and the probability that the network falls into local minimum during gradient descent optimization is greatly reduced.

A kaleidoscopic laser beam projector (KLBP) system that employs a single moving structure to project patterns of sweeping laser beams with diverse sweep directions and emission apertures. The system comprises a collimated light source, a spinning mirror deflector (“spindle / flutter mirror”) at the center, and a stationary kaleidoscopic mirror containing multiple facet mirrors arranged in a concave fashion around the spindle mirror. As the spindle mirror rotates, it directs laser beams in a radially whirling movement toward the facet mirrors, which then subdivide these beams into multiple short strokes and redirect them outward in different directions. Various embodiments include configurations with diffractive optical elements (DOEs) for beam splitting, different kaleidoscopic mirror geometries (hexagonal, octagonal, etc.), and innovative flutter mirror mechanisms that create controlled angular variations during rotation. The system enables a “4×1” configuration that replaces traditional “4×4” systems requiring eight motors and multiple moving structures. The KLBP system offers significant advantages including mechanical simplicity, reduced size and weight, improved energy efficiency, enhanced reliability, cost-effectiveness, and modular configurability. The diverse beam incidence angles enable superior illumination of complex three-dimensional objects for applications in machine vision systems, precision metrology, gap and flushness inspection, and robot-assisted assembly of complex structures.

A head-mounted display device includes a first camera provided on a front surface, a projector provided on the front surface and configured to project a pattern image onto an imaging range of the first camera, and a second camera provided on a side surface. The head-mounted display device acquires first information on a state of the head-mounted display device by detecting features of a real space from an image captured by the first camera, acquires second information on the state by detecting features of the real space from an image captured by the second camera, and generates an image of a virtual object, based on the first and second information, wherein the second information is acquired by detecting the features of the real space from an image in which the pattern image does not appear.

An intraoral scanning system comprises an elongate handheld wand with a probe at a distal end, a structured light projector configured to project a uniform structured light pattern onto an object, a plurality of cameras configured to capture points of the uniform structured light pattern projected onto the object by the structured light projector, and one or more processors. The one or more processors are configured to determine a correspondence between projected points in the uniform structured light pattern generated by the structured light projector and captured points of the uniform structured light pattern captured by the plurality of cameras viewing the uniform structured light pattern projected onto the object, and to use triangulation and the determined correspondence to determine three-dimensional points in space associated with the captured points of the uniform structured light pattern captured by the plurality of cameras.

Multimodal large language models (MLLMs) have excellent reasoning capabilities and are used for autonomous driving applications. For real-world applications, understanding and navigating in three-dimensional (3D) space is necessary, particularly for autonomous vehicles (AVs) to make informed decisions, anticipate future states, and interact safely with the environment. An MLLM agent system includes a 3D projector model and an adapted LLM that extends understanding and reasoning capability from 2D to 3D. Another component of the MLLM agent system is development of a benchmark visual question-answering (VQA) training dataset for training the MLLM agent. The VQA tasks include scene description, traffic regulation, 3D grounding, counterfactual reasoning, decision making, and planning.

According to examples, a system for detection, analysis and correction of disparities in display systems utilizing one or more disparity sensing port is described. The system may include a processor and a memory storing instructions. In addition, the system may include a first lens including a first waveguide for displaying a first image and a second lens including a second waveguide for displaying a second image. Furthermore, the system may include a first projector associated with the first lens to propagate first display light associated with the first image, a second projector associated with the second lens to propagate second display light associated with the second image and a disparity sensing port to receive the first display light and the second display light to determine a disparity associated with the first image and the second image.

The invention relates to the technical field of intelligent dimming, in particular to an intelligent projector light source power dynamic adjustment method, which comprises the following steps of: acquiring an image through an image sensor, constructing a pyramid, dividing grids, aggregating HSV-V values by adopting a sliding window, outputting a brightness variation rate, and comparing a dynamic threshold value to generate an adjustment priority; and calculating a compensation coefficient in combination with an environment illumination interpolation to generate a correction weight parameter, extracting a main peak region span fusion output brightness structure stability, performing weighted fusion after normalization to obtain a driving current proportion, performing scaling to generate an adjustment parameter, and sending and executing the adjustment parameter. According to the method, the light source power is regulated and controlled through multi-dimensional data fusion, brightness variation is extracted through an image pyramid and a sliding window, a dynamic threshold value is used for screening an adjusting area, linear interpolation is used for fusing environment illumination, a histogram is used for detecting a main brightness interval, abnormal fluctuation is restrained, driving current is normalized and balanced, the response speed is increased, and the energy efficiency is optimized; and the picture stability and the visual comfort are enhanced.

1. Name of the product of this design: Remote control (universal for projectors). 2. Purpose of the product of this design: This design is used to control the various functions of the projector. 3. Key points of the design of this product: Shape. 4. The picture or photo that best illustrates the key points of the design: Stereoscopic picture.