4150 results about "Projector" patented technology

A system for three-dimensional spatial perception underwater that includes a primary submersible vehicle. Frontward facing projectors are used to scan beams of light across a selected field of underwater view. Further, event cameras with pixels triggered by events are used to detect corresponding spots of the scanned beams that are reflected from underwater objects or surfaces. Circuitry is configured to determine positions of the objects based on the pixels that are triggered. Additionally, pilot submersible vehicles the projectors and event cameras are tethered to the primary submersible vehicle to provide extend detection of spots corresponding to reflections from underwater objects or surfaces.

The invention provides a robot control method and device, equipment and a storage medium, and relates to the technical field of robot control. The method comprises the steps of obtaining robot data of a robot executing a task, and determining a learning data set according to the data; building a first robot action prediction model based on the initial visual language model; obtaining a second robot action prediction model according to the data set and the first robot action prediction model; a robot time sequence, image data and a language instruction are taken and input into a second robot action prediction model, the time sequence data are input into a second language model through a preset time sequence model and a multi-layer projector, the image data are input into the second language model through a visual encoder and the projector, and the language instruction is input into the second language model through the first language model; the second language model outputs continuous actions to be executed; and completing the task according to continuous action control. And the time sequence model captures time sequence characteristics, so that the second robot action prediction model outputs continuous actions to be executed, and the operation smoothness and continuity are effectively guaranteed.

The invention relates to the technical field of detection, in particular to a complex shell detection method and system based on structured light scanning. The method comprises the following steps: calculating a wrapped phase value and a phase modulation amplitude of each pixel point under each frequency, calculating discrete probability distribution containing candidate stripe series and a corresponding probability for each pixel point based on a multi-frequency wrapped phase difference, generating an initial pixel confidence map, and constructing an energy function; the penalty weight of the smooth item is determined according to the phase modulation amplitude and the wrapped phase gradient local variance, obtaining an initial fringe order distribution diagram, updating discrete probability distribution by using an initial pixel confidence map, re-minimizing an energy function to obtain a corrected fringe order distribution diagram, and reconstructing a final three-dimensional shape. And iteratively optimizing a projector principal point and a radial distortion coefficient in system calibration parameters. According to the scheme, the geometric details of the surface can be reserved, and the processing effect and the measurement precision of the complex curved surface and the high-curvature area are improved.

The invention discloses a fringe projection three-dimensional shape measurement method based on frequency domain and time domain joint coding, and the method comprises the following steps: firstly, embedding a multi-frequency three-step phase shift fringe pattern in the vertical direction based on multi-scale region division, introducing four-step phase shift and complementary Gray code joint coding in the horizontal direction, generating a coding pattern set, and carrying out the projection; after an image is collected, frequency domain transformation and time domain decoding are carried out respectively, and a vertical dominant frequency position, a horizontal period number and a wrapped phase are obtained; then, combining a main frequency position in the vertical direction with a period number and a wrapped phase in the horizontal direction, and extracting a space coordinate of a direct illumination component based on frequency position invariance; and finally, establishing a pixel homonymy point mapping relation between the projector and the camera, and realizing high-precision three-dimensional reconstruction. Compared with a traditional frequency shift method, the method has the advantages that projection patterns are greatly reduced, reconstruction precision and anti-interference performance are improved, and the method is suitable for dynamic three-dimensional measurement under complex illumination conditions such as specular reflection, semitransparent shielding and subsurface scattering.

The invention relates to the technical field of projectors, in particular to an intelligent picture geometric distortion control method based on machine vision and an image projector, and the method comprises the steps: obtaining image data of a to-be-corrected projection picture, and carrying out the feature analysis of the image data, so as to obtain a distortion feature value; matching a correction optimization model corresponding to the distortion characteristic value, so as to call a correction parameter from a preset correction parameter library through the correction optimization model; simulating a correction process corresponding to the projection picture to be corrected according to the correction parameter; the correction parameters are adjusted according to the correction process, and the projection picture to be corrected is corrected according to the adjusted correction parameters, the corresponding correction optimization model is matched based on the characteristic values, the adaptive correction parameters can be dynamically called from the preset parameter library, the limitation of a traditional fixed algorithm is changed, and the correction efficiency is improved. The correction strategy is highly coupled with the actual distortion scene, and the correction efficiency and pertinence are remarkably improved.

The invention discloses a non-contact multi-modal decoupling emotion recognition method and device in a dialogue scene. The method comprises the following steps: acquiring original data of multiple modals in the dialogue scene; encoding the original data into original features by using a mode-dedicated encoder; projecting the original features by using a shared feature projector to obtain projection features, and performing weighted fusion to obtain shared features; extracting exclusive features from the original features by using a modal-specific expert network, and carrying out weighted fusion on the exclusive features to obtain private features; fusing the shared features and the private features through a cross attention fusion module to obtain multi-modal fusion features; and classifying the multi-modal fusion features by using a first classifier to obtain an emotion recognition result. According to the method, the key problems of high modal feature heterogeneity, inconsistent modal information, unbalanced modal, missing and the like in the field of multi-modal emotion recognition are solved, and the performance and robustness of emotion recognition in a dialogue scene are improved.

A kaleidoscopic laser beam projector (KLBP) system that employs a single moving structure to project patterns of sweeping laser beams with diverse sweep directions and emission apertures. The system comprises a collimated light source, a spinning mirror deflector (“spindle / flutter mirror”) at the center, and a stationary kaleidoscopic mirror containing multiple facet mirrors arranged in a concave fashion around the spindle mirror. As the spindle mirror rotates, it directs laser beams in a radially whirling movement toward the facet mirrors, which then subdivide these beams into multiple short strokes and redirect them outward in different directions. Various embodiments include configurations with diffractive optical elements (DOEs) for beam splitting, different kaleidoscopic mirror geometries (hexagonal, octagonal, etc.), and innovative flutter mirror mechanisms that create controlled angular variations during rotation. The system enables a “4×1” configuration that replaces traditional “4×4” systems requiring eight motors and multiple moving structures. The KLBP system offers significant advantages including mechanical simplicity, reduced size and weight, improved energy efficiency, enhanced reliability, cost-effectiveness, and modular configurability. The diverse beam incidence angles enable superior illumination of complex three-dimensional objects for applications in machine vision systems, precision metrology, gap and flushness inspection, and robot-assisted assembly of complex structures.

Multimodal large language models (MLLMs) have excellent reasoning capabilities and are used for autonomous driving applications. For real-world applications, understanding and navigating in three-dimensional (3D) space is necessary, particularly for autonomous vehicles (AVs) to make informed decisions, anticipate future states, and interact safely with the environment. An MLLM agent system includes a 3D projector model and an adapted LLM that extends understanding and reasoning capability from 2D to 3D. Another component of the MLLM agent system is development of a benchmark visual question-answering (VQA) training dataset for training the MLLM agent. The VQA tasks include scene description, traffic regulation, 3D grounding, counterfactual reasoning, decision making, and planning.

The invention discloses a space-time speckle projection three-dimensional imaging method based on multi-frame optical flow alignment. Firstly, a projector based on DLP is used for projecting a space-time speckle pattern to a measured scene, and a binocular camera synchronously collects a three-dimensional space-time speckle image. The calibration parameters of the binocular camera are used to carry out stereo correction on an acquired original speckle image, and a parallax image is generated frame by frame in combination with a coarse-to-fine single-frame speckle matching strategy. And estimating a two-dimensional inter-frame displacement field between continuous disparity maps by using an optical flow method by taking an intermediate frame disparity map as a reference, compensating motion artifacts in a space-time speckle image, and ensuring strict space-time registration of a dynamic target. And based on the speckle image after motion correction, a speckle matching strategy is expanded to a time-space domain, and high-precision multi-frame three-dimensional measurement of a complex dynamic scene is realized. The method is suitable for performing rapid and high-precision three-dimensional modeling on a moving target in an unstructured environment, and can perform accurate three-dimensional measurement on a high-speed dynamic target undergoing any translation or rotation motion.

The invention relates to the technical field of optical measurement, in particular to a complex reflective object surface reconstruction method and system based on multi-system point cloud fusion, and the method comprises the steps: carrying out the joint calibration of the spatial relation among a camera, a projector and an LCD screen; projecting to a target object based on a projection grating phase method and a phase deflection operation path, and collecting structured light patterns of the two through a camera; phase solving is carried out on the structured light pattern collected by the camera, and a three-dimensional reconstruction result is obtained in combination with the joint calibration information; and world coordinate system matching and point cloud fusion are carried out on the three-dimensional reconstruction result based on the joint calibration information, and the three-dimensional morphology of the target object is generated. According to the method, the problems that in diffuse reflection reconstruction, patterns projected by a projector cannot be comprehensively collected due to exposure and height and gradient ambiguity cannot be solved by a monocular phase deflection technology in high reflection can be solved complementarily, high reflection and diffuse reflection objects can be solved, a complete reconstructed object can be obtained, and the reconstruction precision is improved.

The invention discloses a Mecanum wheel omnidirectional robot anti-interference control method and system, and relates to the technical field of robot anti-interference control, and the method comprises the steps: collecting multi-source original data, and carrying out the preprocessing; multi-source data fusion is carried out, a current operation condition is identified based on a fusion result, and an augmented state is generated; calculating a baseline control instruction; inputting to the reinforcement learning agent, and outputting a corresponding compensation instruction; adding the baseline control instruction and the compensation instruction to obtain a candidate control instruction; inputting to the security constraint projector, and correcting to obtain a final control instruction; issuing to a motor driver of the Mecanum wheel for execution; and actual state data of the executed robot is collected as execution feedback data, and the execution feedback data and a new target instruction are used for generating standardized observation data at the next moment. According to the invention, cross-working-condition high-precision, fast-recovery, low-energy-consumption and compliant-constraint omnidirectional chassis anti-interference control is realized, and the tail robustness and the system safety and reliability are improved.

1. The name of the product under this design: Projector (C26B050A). 2. Purpose of this design product: used to project images, videos or play audio. 3. The key point of the design of this product lies in its shape. 4. The picture or photo that best illustrates the design points: Stereoscopic drawing 1.

A projector includes a first light source, a light modulator that modulates visible light output from the first light source to form a projection image, a first relay optical system that forms the projection image at a first position, an enlarging optical system, an invisible image generator that forms an invisible image made of invisible light, and a light combiner that is disposed in the optical path between the enlarging optical system and the light modulator and combines the visible light and the invisible light with each other into combined light. The invisible image is formed at a second position conjugate with the position where the projection image is formed. The enlarging optical system forms an image at the first position and projects the combined light to display the projection image and the invisible image on a single projection surface.

The invention discloses a circular RNA drug sensitivity correlation identification method based on integrated multi-instance learning. The circular RNA drug sensitivity correlation identification method comprises the following steps: collecting experimental verification circular RNA and drug sensitivity correlation data; establishing a feature representation model based on a heterogeneous network and vertexes; embedding a heterogeneous graph node into the model, and extracting deep feature representation of the node; designing a meta-path instance embedding projector, and generating a plurality of meta-path instances; a circular RNA and drug sensitivity association predictor is constructed and completed; constructing an integrated heterogeneous graph network deep learning model; and outputting the meta-path instance of the circular RNA and drug pair and the attention coefficient, and carrying out interpretable analysis. According to the method, integrated learning and a deep learning model are combined, so that the reliability of the model is improved; according to the invention, interpretable analysis is carried out by utilizing the meta-path and the attention coefficient, the potential action mechanism of the circular RNA associated with the drug sensitivity can be explained, and the guidance of medical research is facilitated.

The invention discloses a single-frame three-dimensional imaging method based on multi-frequency RGB (red, green and blue) stripe compression. According to the method, three groups of structured light stripe patterns with relatively prime frequencies and different directions are respectively embedded into RGB channels by utilizing channel characteristics of a color camera, the patterns are switched at a high speed by a projector, dynamic superposition is completed within single-frame exposure time of the camera, space compression acquisition of time domain information is realized, and a color superposition image fused with multiple pieces of time slice information is obtained. According to the invention, a multi-stage deep neural network architecture is designed to realize separation of fringe images of a color superposition image at different moments, phase information is accurately extracted from the decomposed fringe images, and finally unambiguous high-speed three-dimensional imaging in dynamic scenes at different moments is realized. According to the method, the time resolution of three-dimensional imaging can be remarkably improved without improving the frame rate of the camera, meanwhile, the space precision and the system stability are considered, and good universality and expandability are achieved.

The invention belongs to the technical field of computer vision and optical measurement, and discloses a three-dimensional reconstruction method and device based on multi-frequency fringe synchronous optimization and a medium, and the method comprises the following steps: based on a monocular structured light system, projecting a plurality of groups of sine fringe images with different frequencies to the surface of an object to be measured through a projector, and carrying out the stepping of a plurality of phases, acquiring a corresponding image sequence by using a camera; using a structured light phase shift method to obtain a relative phase value of a pixel point; obtaining an initial absolute phase value and modulation intensity based on a structured light phase shift method and a multi-frequency heterodyne method; and carrying out joint optimization on the absolute phase and modulation intensity parameters of the multi-frequency fringes through a Gaussian-Newton iteration method. According to the method, the anti-noise capability and the reconstruction precision are improved, a parameter adjustment and threshold recovery mechanism is introduced in the optimization process, the convergence stability and abnormal value elimination are ensured, and the method is suitable for high-precision structured light application scenes such as industrial vision measurement and complex surface detection.

The present disclosure relates to systems and methods for generating a digital representation of a three-dimensional (3D) object. In particular, the disclosure relates to a dental scanning system for acquiring images of the object and for generating the digital representation of the object. One embodiment relates to a dental scanning system for scanning a dental object, comprising an intraoral 3D scanning device comprising at least one projector unit configured to project a light pattern along a projector optical axis, the light pattern comprising a plurality of pattern features; one or more cameras having at least partly overlapping fields of view along different camera optical axes (and along the projector optical axis), each of the cameras comprising an image sensor, wherein the system further comprises one or more processors configured to generate a digital three-dimensional representation of the dental object based on triangulation.

The invention relates to a light curtain. The wiring workability under the condition that an operation indicating lamp is arranged on a light curtain of an optical synchronization system is improved. The light curtain includes a synchronization unit (optical axis for timing synchronization) for synchronizing the light projection timing of the light projector and the light reception timing of the light receiver by optical communication. A safety signal generated on the basis of whether or not an optical axis formed between the light projector and the light receiver is in a light-shielding state is output to the outside. The light curtain comprises a first operation indicating lamp arranged in the light projector; the second operation indicating lamp is arranged in the light receiver; an optical element (optical axis) provided in each of the light projector and the light receiver and configured to display the first operation indicator light and the second operation indicator light in conjunction with each other; and a control circuit configured to display the first operation indicating lamp and the second operation indicating lamp in linkage by using at least one group of optical elements.

The invention relates to the technical field of projection, and discloses a method, a device and equipment for measuring a projection ratio and an off-axis ratio, and a medium. The method comprises the following steps: acquiring a projection test image obtained by sampling a projection area and a reference area by an image sampling device of the projector; performing area feature extraction processing on the projection test image to obtain image size information and central point pixel information of a projection area and image size information of a reference area; determining the projection ratio of the projector based on the image size information of the projection area, the projection distance information of the projector and the image size information and the actual size information of the reference area; and determining the off-axis ratio of the projector based on the central point pixel information of the projection area, the optical axis pixel information of the projector and the image size information and the actual size information of the reference area. According to the embodiment of the invention, the cost of measuring the projection ratio and the off-axis ratio can be reduced.

1. The name of the product under this design: Projector (YG320B). 2. Purpose of this design product: for playing images, images or videos. 3. The key point of the design of this product lies in its shape. 4. The picture or photo that best illustrates the design points: Stereoscopic drawing 1.

1. The name of the design product: projector. 2. The use of the design product: projecting text, patterns and video images. 3. The design points of the design product: in shape. 4. The picture or photo that best shows the design points: perspective view 1.

The invention discloses a semantic segmentation method based on phase contour constraint, and belongs to the technical field of computer vision. The method comprises the following steps of: acquiring a two-dimensional texture image and a deformed stripe image of a scene to be detected in the same view field by using a calibrated camera-projector system; resolving the deformed fringe image through a multi-step phase shift and Gray code technology to obtain absolute phase distribution, and calculating a gradient field; according to a preset sudden change condition, extracting a physical edge contour reflecting the depth change of the object from the gradient field; and mapping the physical edge contour into the two-dimensional texture image based on a pixel coordinate corresponding relation to accurately define a semantic object region, endowing a corresponding category label, and finally generating a semantic label mask image. According to the method, the uncertainty of the visual texture edge is corrected by utilizing the physical phase information, the problem of edge extraction in a complex illumination scene is effectively solved, automatic generation of semantic segmentation data is realized, and the training precision and robustness of a semantic segmentation model are improved.

The invention discloses an automobile wire harness detection device based on artificial intelligence and machine vision, and relates to the technical field of visual inspection, and the device comprises a film covering module which enables an automobile wire harness to be immersed in a control groove of magnetic fluid to form a nano film; the marking module projects interference fringes to the nano-film through a laser interference projector, and marks timestamps and capture numbers of fringe images; the image module is used for applying magnetic field pulses in the timestamps of the adjacent stripe images to generate a turbulent flow image sequence; the quantization module is used for respectively carrying out interference fringe phase analysis on the turbulence images in the turbulence image sequence to generate a curvature quantization matrix; the defect module is used for analyzing the curvature quantization matrix through a pre-trained convolutional neural network and identifying a defect type and a coordinate position; and the result module is used for superposing the defect type and the coordinate position to the stripe image to generate a defect distribution thermodynamic diagram. According to the invention, high-precision intelligent defect identification of wire harness detection is realized through cooperation of the nano-film and the convolutional neural network.

An intraoral scanner includes a probe housing disposed at a distal end of an elongate wand. The probe housing forms an interior volume. The intraoral scanner further includes a lightguide projector that includes a light source configured to generate light. The light source is disposed in the interior volume. The lightguide structure is configured to receive the light from the light source. The light is to propagate through the lightguide structure via internal reflections. The lightguide projector is configured to cause the light to exit the lightguide structure to illuminate a mouth of a patient.

1. Name of the product subject to this design: Projector. 2. Purpose of this design: For use in projectors. 3. The key design features of this product are the combination of shape and pattern. 4. The image or photograph that best illustrates the design's key points: 3D rendering 1.

The invention provides a structured light projector calibration method and system and a medium, and the method comprises the steps: projecting a multi-frequency stripe pattern to a target region based on an MEMS micromirror array module, obtaining a distorted image sequence, and carrying out the phase decoding, and obtaining a phase diagram corresponding to each frequency; resolving the phase diagram based on a phase shift method and an optical path triangulation principle to obtain a preliminary three-dimensional point coordinate; constructing a neural network model and a calibration sample set, obtaining a real three-dimensional coordinate by using a standard calibration plate or a known curved surface, and calculating the deviation between the initial three-dimensional point coordinate and the real three-dimensional coordinate to obtain a training sample set; and training the neural network model according to a training sample set based on an Euclidean distance loss function, outputting a three-dimensional offset compensation amount according to the neural network model, correcting the initial three-dimensional point coordinates, and realizing an end-to-end error self-compensation mechanism through the neural network model, so that deviation compensation is effectively performed on the three-dimensional point coordinates, and the accuracy of the three-dimensional point coordinates is improved. And the three-dimensional reconstruction precision is improved.

An electronic device may include a waveguide that directs light to an eye box. The waveguide may include a diffractive grating structure. A projector may generate image light coupled into the waveguide by a first input coupler. A light source may generate supplemental light coupled into the waveguide by a second input coupler. The diffractive grating structure may couple the image light out of the waveguide within a central region of the field of view (FOV) of an eye box and may couple the supplemental light out of the waveguide at a location within a peripheral region of the FOV. The location may be outside of the central region by at least 10 degrees. A gaze tracking sensor may estimate a user's gaze direction at the eye box. A processor may wake or power down the projector responsive to the gaze direction overlapping the location for a predetermined time period.

A light generation device (LGD) includes an attachment configured to couple the LDG to a surface of an interior of a vehicle, a sensor configured to capture motion data of the LGD, a plurality of light projectors configured to generate a plurality of light patterns within the interior, a memory, and a processor operatively coupled to the sensor and the memory. The processor is configured to cause the plurality of light patterns to be generated within the interior via the plurality of light projectors, and send the motion data to a head mounted display (HMD) that determines a pose associated with the HMD after receiving the motion data based on at least one of the motion data or image data (1) that is captured by the HMD and (2) that includes a representation of at least some patterns from the plurality of light patterns.

An optoelectronic apparatus includes an array of emitters configured to emit beams of optical radiation. Refractive optics focus the emitted beams with a first optical power. An optical metasurface splits the focused beams to form a pattern of spots and applies a vergence to the spots with a second optical power so as to project the pattern of spots toward a target.

The invention discloses a low-cost three-dimensional live-action measurement and holographic reconstruction method and system for fringe projection, and the method comprises the steps: sequentially capturing at least three first object modulation images and five second object modulation images, which are obtained after sine and Gray code fringe patterns are modulated by the surface depth of an object to be measured, through a projector and a first camera; reconstructing three-dimensional shape information by using a multi-step phase shift method and a complementary Gray code phase unwrapping method to obtain a depth map of the surface of the object to be measured; according to the holographic reconstruction method, the obtained depth map is used, a projector and a first camera are used for obtaining an intensity map of the surface of an object to be measured when no projection fringe pattern exists, the intensity map is divided into a plurality of slice images in the depth direction of the depth map, sub-holograms are obtained according to an iterative Fresnel algorithm and a fast Fourier transform algorithm, and the sub-holograms are reconstructed. And after superposition and phase extraction, a phase hologram is obtained. According to the invention, the depth map can be simply, conveniently, efficiently and losslessly obtained with low cost and high precision, and popularization and application of the digital holographic technology are facilitated.