54 results about "Information projection" patented technology

The invention discloses a dynamic fusion method, a dynamic fusion system and dynamic fusion equipment for multi-modal perception data of an intelligent body. The dynamic fusion method comprises the following steps: S1, acquiring image data in real time in a movement process of the intelligent body; s2, judging the point cloud filling density of the image data by using a multi-modal large model, and filling 3D point cloud of a camera picture by using a map algorithm in a data acquisition process; s3, generating a laser radar feature map through projection conversion of the point cloud data; s4, carrying out initialization alignment on the feature data of the multi-modal large model; s5, constructing a group of multi-scale multi-channel differentiable mutual information fine optimization methods to process the feature data; s6, executing online monitoring and fusion self-correction operation of the multi-modal large model; and S7, projecting camera information to the laser 3D point cloud, and continuously constructing a fused RGB-3D scene in the movement process of the body-equipped intelligent body. According to the invention, accurate, robust and automatic calibration and fusion of external parameters between the laser radar and the camera can be realized.

The invention discloses an agent training data set construction method and system combined with cross-modal learning, and relates to the technical field of agent training, and the method comprises the steps: obtaining multi-modal intelligence data from a multi-source database, extracting feature information, and projecting the feature information to a preset semantic space to obtain cross-modal alignment features; constructing an agent function call syntax tree based on cross-modal alignment features, analyzing the syntax tree into an instruction sequence, constructing an analysis reasoning chain, and generating a sample label and an interaction track; constructing a task dependency graph by using the sample labels and the interaction tracks, decomposing the task dependency graph into a plurality of parallel decision branches, and dynamically adjusting a processing strategy to form a training data set; mapping the training data set to an agent target space, optimizing and analyzing an inference chain through a training feedback channel, and outputting a standardized sample library; and finally inputting to-be-analyzed data into the trained agent, and generating an intelligence analysis report according to the analysis reasoning chain.

The invention relates to the field of intelligent driving, and discloses a map updating method and device, a vehicle and a storage medium, and the method comprises the steps: obtaining inertial measurement data, vehicle-mounted wheel speed and camera data on the vehicle; calculating according to the inertial measurement data and the vehicle-mounted wheel speed, and determining the vehicle pose; semantic segmentation is carried out on the camera data, a semantic image is determined, and the semantic image comprises ground semantic information; projecting ground semantic information on a road to a three-dimensional space on a world coordinate system based on a vehicle pose, and determining point cloud information of a target lane line; and the point cloud information of the target lane line is matched with the point cloud data on the high-precision map, the map is updated according to a matching result, and the point cloud data on the high-precision map is determined by the priori map. According to the method, the limitation of traditional high-precision map static updating is broken through, real-time dynamic correction of map data is realized through multi-sensor space-time synchronization and three-dimensional reconstruction, the cost is reduced, and the coverage use scene is expanded.

The invention discloses a video generation method and system based on a scene adaptive track and mirror moving control, and belongs to the technical field of computer vision. The method comprises the following steps: firstly, aligning a scene point cloud and a parameterized human motion sequence to a unified coordinate system, generating a ground adaptive three-dimensional track according to a two-dimensional track input by a user and scene geometry, and redirecting the motion; projecting the three-dimensional information into a two-dimensional condition graph based on camera parameters; and finally, in a conditional diffusion model generation process, selectively fusing scene geometric condition information after noise addition into the current denoising latent variable by utilizing a visibility mask generated by the depth map, so as to realize view angle self-adaptive mirror operation control. According to the method, the problems of conflict between character motion and scene, inflexible track control and inconsistent background under camera motion are solved, and a controllable video which is physically consistent and visually real can be generated.

A work information projection system estimates a position in a workplace. The work information projections system includes a camera (13), a stereo camera (14), and a controller. The camera (13) is arranged facing in a first direction and acquires first environment information which is information about an object arranged in and around the first direction. The stereo camera (14) is arranged facing in a second direction and acquires second environment information which is information about an object arranged in and around the second direction. The controller estimates a position in a first coordinate system based on the first environment information when it determines that the second environment information becomes unacquirable.

The application relates to a rapid matching positioning optical projection system and method, wherein the optical projection system comprises a projector, a camera, an information editing module, a rapid positioning module and a projection operation module; the information editing module is used for compiling virtual process information required by each working procedure according to an assembly process flow, and generating a guide information set file; the rapid positioning module is used for determining two-dimensional coordinates of a preset target ball mark reference point in a camera image after movement according to projected workpiece images before and after movement of the optical projection system, and corresponding points of the target ball mark reference point in a projector image, and determining pose information of the projected workpiece relative to a projector space coordinate system in combination with measurement data of three-dimensional coordinates of the target ball obtained by a measuring device; the projection operation module is used for generating a working procedure guide image through a three-dimensional space projection algorithm according to the guide information set file and the pose information; and the projector is used for projecting the working procedure guide image on a surface of the projected workpiece.

This application provides a joint emotion recognition method and system based on action unit-driven attention, relating to the fields of computer vision and affective computing. The method includes: inputting a feature map into an action unit (AU)-driven attention branch, processing it through a sigmoid activation function to obtain an activation vector, and inputting this vector into a learnable mapping layer; projecting the AU information back into the spatial geometric space to generate a single-channel spatial attention map, which is then multiplied element-wise with the feature map to obtain a weighted feature map; determining continuous values ​​for discrete emotion category probabilities, valence, and arousal; constructing a total loss function; and training the model using the acquired AffectNet and Aff-wild2 datasets to determine the target model for emotion recognition. This application achieves end-to-end joint optimization of AU detection and emotion recognition, significantly enhancing the interpretability and generalization ability of the model while improving emotion recognition accuracy, enabling it to better adapt to the emotion recognition needs in complex scenarios.

The application provides a kind of complex environment under image enhancement and passage cost chart generation method and system, applied to image processing technical field, the method obtains original environment image and standardization processing, based on local gray variance self-adapting determination cutting limit threshold, combined with brightness protection weight generation enhanced image;Extract boundary mutation, surface roughness, local contrast and shadow risk and other multi-response characteristics, determine candidate high-cost area and generate boundary uncertain response;Fusion generates pixel-level passage cost chart above-mentioned response, and combined with camera calibration parameter and posture information projection to ground coordinate system, output spatial passage cost chart and passage area result.The application can reduce the influence of complex illumination, shadow and texture change on passage area extraction, improve the continuity and stability of passage risk representation.

Provided is an information projection method in which a projection device mounted on a vehicle displays information, wherein if it is determined that the vehicle is in an automatic driving state during automatic driving, the project unit displays information related to automatic driving on the basis of a display condition during the automatic driving.

The invention relates to the technical field of intelligent riding glasses, and discloses an information screen projection method and device for intelligent riding glasses, and the method comprises the steps: collecting a riding environment feature data set in a riding process, and generating a riding vibration compensation parameter set and an ambient light adaptation parameter set according to the riding environment feature data set; performing optical waveguide coupling on the intelligent riding glasses to obtain a dynamic diffraction angle adjustment parameter set; according to the dynamic diffraction angle adjustment parameter set, performing adaptive modulation on an electric control liquid crystal layer and a nano surface grating in the optical waveguide to obtain an optical waveguide coupling efficiency optimization result; the backlight power and display image parameters are cooperatively adjusted based on the optical waveguide coupling efficiency optimization result, and an intelligent screen projection display result is output, the problem that display lags when the ambient light rapidly changes is effectively solved, real-time adjustment of the optical characteristics of the optical waveguide is achieved, and consistency and stability of screen projection display quality are ensured.

This application provides an intelligent control method and device for a multi-functional projection device, belonging to the field of projection control. The method includes: acquiring personnel flow information, personnel distribution information, and personnel trajectory information of a target area; dividing the personnel flow information into multiple target personnel flow information based on the personnel flow information; each target personnel flow information corresponds one-to-one with a target sub-area; each target sub-area is an area within the target area that is at a different distance from the target multi-functional projection device; dividing the personnel trajectory information into multiple target personnel trajectory information based on the personnel flow information; each target personnel trajectory information corresponds one-to-one with a target sub-area; determining a target projection control strategy based on the multiple target personnel flow information, multiple target personnel trajectory information, and personnel distribution information; and controlling the target multi-functional projection device to perform projection display based on the target projection control strategy. This application can improve the adaptability of information projection by the projection device.

This invention discloses a visual recognition-based method and system for detecting OCA bonding defects, belonging to the field of defect detection. The method includes: acquiring the original grayscale image of the OCA bonding area; automatically filtering a candidate set of normal regions based on local texture flatness, and estimating the global background joint grayscale distribution based on the candidate set of normal regions; extracting the empirical joint grayscale distribution of the local neighborhood window for each pixel position in the original grayscale image; calculating the minimum information projection distribution of the empirical joint grayscale distribution onto the global background joint grayscale distribution under exponential family constraints, and calculating the cross-entropy between the global background joint grayscale distribution and the minimum information projection distribution to obtain a cross-entropy map; performing threshold segmentation on the cross-entropy map and outputting a defect location mask. This application solves the technical problem that existing OCA bonding defect detection technologies are unable to distinguish between grayscale changes caused by normal process fluctuations and real defects, resulting in insufficient detection efficiency and production line adaptability.

Systems and methods for tracking a non-self-reporting vessel ("dark vessel") with an unknown identity are provided. A method includes: providing a system configured to receive and store a plurality of ship detections; comparing a timestamp T2 of a new ship detection having a geolocation of P2 to a timestamp T1 of a first ship detection having a geolocation of P1 and determining that the T2 is later than T1; using kinematical information of the first ship detection, projecting the first ship detection to a projected second geolocation at T2; determining that the projected second geolocation is within a threshold proximity of P2; forming a vessel track having a geolocation of P1 at T1 and a geolocation of P2 at T2; and storing the vessel track in the system as a dark vessel track.

Projection device for projecting images or information, comprising at least one light source (10) for emitting at least one light beam (11) having an ellipticity in the beam cross-section, a microscanner (20) for variably deflecting the at least one light beam (11) for projecting images or information into an observation field, at least one lens arrangement (30) arranged in the beam path of the at least one light beam (11) between the light source (10) and the microscanner (20) for collimating the at least one light beam (11), and at least one anamorphic prism (40) arranged in the beam path of the at least one light beam (11) between the light source (10) and the microscanner (20) downstream of the lens arrangement (30) for minimizing the ellipticity of the at least one light beam (11).

The invention relates to a projection lamp and method for an underground coal mine, and belongs to the technical field of intelligent illumination and information projection for the underground coal mine. The technical problems that traditional underground lighting equipment can only provide environment floodlight and cannot dynamically project graphical information, and a universal projector is poor in adaptability, low in safety and prone to causing image blurring in the underground high-dust, humid and vibration environment are solved. According to the technical scheme, the projection lamp is provided, the projection lamp is provided with an anti-explosion shell, an optical projection module, an image generation and control module, an environment sensing module and a power supply and communication module, image parameters are dynamically optimized through environment sensing data, and clear projection is achieved. The technical effects are that the underground information transmission mode is innovated, the environmental adaptability and intrinsic safety are improved, the intelligent integration capability is enhanced, and the long-term operation and maintenance cost is reduced.

A hand piece for dermal therapy is provided that includes a projector configured to project digital information onto the skin of the patient. A clinician may thus monitor the digital information to confirm that the proper therapy parameters are being used or to adjust the dermal therapy based upon the therapy parameters including in the digital information. In addition, the hand piece includes a camera so that image processing may be used to identify features such as a lesion within a treatment area on the skin of the patient. Based on this image processing, the projector may then selectively illuminate the lesion.

A work information projection system for estimating a position in a work site. The work information projection system includes a camera (13), a stereo camera (14), and a control device. The camera (13) is disposed toward a first direction, and acquires first environment information that is information of an object disposed in the first direction and around. The stereo camera (14) is disposed toward a second direction, and acquires second environment information that is information of an object disposed in the second direction and around. In a case where it is determined that the second environment information cannot be acquired, the control device estimates a position in a first coordinate system based on the first environment information.

The invention relates to the field of machine vision, and discloses a printing and dyeing defect detection method and system, and the method comprises the steps: carrying out the image collection of the surface of a printed and dyed object through a multi-angle imaging device disposed on a production line, and obtaining an original image set containing multiple visual angles; performing alignment processing on the original image set to obtain a registration image set under a unified coordinate system; a three-dimensional point cloud model is generated according to the registration image set, and geometric structure features of the surface of the printed and dyed object are obtained; projecting color information in the registration image set to the three-dimensional point cloud model to obtain a three-dimensional color distribution model; pixel points in the three-dimensional color distribution model are grouped to obtain boundary features of a color difference area; and according to the boundary features of the color difference region, analyzing the coordinate range of the color difference region in the three-dimensional color distribution model, and determining the spatial position coordinates of the defect. According to the technical scheme, color information projection distortion caused by geometric fluctuation is avoided, and the identification accuracy of the color difference area is improved.

The invention discloses a black-start overcurrent suppression method and device, electronic equipment and a storage medium, and relates to the field of artificial intelligence or other related technical fields, and the method comprises the steps: collecting electric power data of an optical storage grid-connected system, carrying out the preprocessing of the electric power data, and extracting an electric power feature vector; the electric power feature vector is input into a virtual impedance coefficient optimization model, a target virtual impedance coefficient is output, and the virtual impedance coefficient optimization model integrates an attractor trend strategy, a coupling interference strategy and an information projection strategy for dynamic optimization; and the power data and the target virtual impedance coefficient are substituted into a virtual impedance calculation formula, a virtual impedance value is calculated, a reference signal of an inverter control loop is adjusted based on the virtual impedance value, and overcurrent caused by black start is suppressed. According to the invention, the technical problem that the overcurrent suppression stability is low when the overcurrent is suppressed based on a fixed virtual impedance control strategy in the prior art is solved.

The invention provides a model resource processing method and device, a computer program product and electronic equipment. The model resource processing method comprises the following steps: determining a geometric grid corresponding to a target neural field model based on the target neural field model and original images under a plurality of observation view angles; performing UV expansion on a geometric grid corresponding to the target neural field model to obtain a UV layout of the geometric grid, and performing reverse solution based on the UV layout of the geometric grid to obtain a PBR material map of the geometric grid; semantic instance segmentation information of each original image is determined through semantic instance segmentation, and the semantic instance segmentation information of each original image is projected to a surface corresponding to the geometric grid to obtain a semantic instance label corresponding to the geometric grid; and packaging the geometric grid, the PBR material map of the geometric grid and the semantic instance label corresponding to the geometric grid into a standardized PBR asset package based on a preset packaging format so as to improve the reusability of model resources.

The present invention provides a zonal metering system for controlling the difference between gas purchase and sales, which relates to the technical field of data processing. The system includes: a conversion module for projecting key information into corresponding key data points, each key data point representing a specific location in the gas supply network and including its longitude and latitude coordinates; a mapping module for mapping each key data point onto the plane of a decagon by calculating the relative position relationship between the coordinates of each key data point and the coordinates of each vertex of the decagon; a zoning module for dividing the gas supply network into multiple metering zones according to the distance of each key data point from the center of the decagon structure and the geometric characteristics of the decagon; and a data processing module for calculating the total input gas volume and the difference between the purchase and sales of the output gas volume in each metering zone in real time. The present invention can more accurately reflect the actual situation of the gas supply network and the difference between purchase and sales.

The application relates to a laser radar and camera external parameter online calibration method and device based on a deep neural network and a storage medium, wherein the method comprises the following steps: building a laser radar and camera joint calibration platform; calibrating camera internal parameters; synchronously time stamping; acquiring a gray image and a point cloud and completing pretreatment; initializing external parameters; converting the point cloud to a camera coordinate system; based on a random mask mode, respectively covering the point cloud and the gray image according to a preconfigured covering ratio; projecting the covered point cloud to an image plane to obtain depth information projection and reflectivity information projection; constructing an external parameter online calibration network, which is composed of an input branch, a prediction branch, a fusion branch and a result output module, and realizing external parameter calibration by fusing the features of the depth information projection, a depth map, the reflectivity information projection and a covered gray image; training the external parameter online calibration network; and completing external parameter online calibration. Compared with the prior art, the application has the advantages of good calibration effect, wide application range and the like.

Projection device for projecting images or information, comprising at least one light source (10) for emitting at least one light beam (11) having an ellipticity in the beam cross-section, a microscanner (20) for variably deflecting the at least one light beam (11) for projecting images or information into an observation field, at least one lens arrangement (30) arranged in the beam path of the at least one light beam (11) between the light source (10) and the microscanner (20) for collimating the at least one light beam (11), and at least one anamorphic prism (40) arranged in the beam path of the at least one light beam (11) between the light source (10) and the microscanner (20) downstream of the lens arrangement (30) for minimizing the ellipticity of the at least one light beam (11).

A projection system (3) is provided with a projection device (31) that projects information (I) onto or near to a production facility (2) that includes a conveying device (21) for conveying a vehicle body (V), wherein the information (I) includes facility information (IA) relating to the production facility (2).

The application discloses a kind of multi-feature regularization rendering methods and systems for sparse view angle.It is easy to appear appearance overfitting, detail loss, geometric drift and floating artifact and other problems for traditional three-dimensional Gaussian splashing (3DGS) new view synthesis under sparse view angle input, the joint optimization mechanism of pixel reconstruction constraint, multi-source feature consistency regularization, depth information projection consistency, scale-insensitive depth geometry regularization is used to realize stable learning and high-quality new view rendering of three-dimensional scene representation.The application does not need large-scale pre-training and additional artificial labeling, is compatible with 3DGS, training cost is controllable and inference keeps real-time rendering ability, significantly improves the quality and stability of new view synthesis under sparse view angle input, and can be widely applied to few-shot three-dimensional reconstruction, real-time new view synthesis and high-quality scene visualization and other fields.

A work information projection system (1) includes a projector (12), a camera (14), and a controller. The projector (12) projects an auxiliary image (101) onto a workplace. The camera (14) captures the workplace. During a work, the controller controls the projector (12) based on a position of the projector (12) to project the auxiliary image onto the workplace. During a calibration process of calibrating relative information, the camera (14) captures a calibration image projected by the projector (12) onto a calibration jig (32) through a reflector (15). The controller performs the calibration process of calibrating the relative information based on the calibration image captured by the camera (14).

The application discloses a vehicle information projection method, device, equipment and medium. The method comprises the following steps: acquiring road condition satellite information and traffic satellite information on a target navigation route of a vehicle, and a real-time driving position of the vehicle; acquiring a pre-display distance input by a user and an information collection radius; calculating a data collection area and a data pre-collection area of the vehicle, querying the road condition satellite information and the traffic satellite information corresponding to the data collection area of the vehicle, and determining vehicle environment information of the vehicle; querying the road condition satellite information and the traffic satellite information corresponding to the data pre-collection area located at the pre-display distance, and determining vehicle pre-display information of the vehicle; screening objects in the vehicle environment information and the vehicle pre-display information, obtaining object space positions and object sizes of to-be-displayed objects, generating to-be-projected image information, and projecting the to-be-projected image information through a holographic projection vehicle lamp. The technical scheme of the embodiment of the application can improve the accuracy and efficiency of vehicle information projection.

Projection device for projecting images and information, comprising at least two projectors (1 i ), each of which is used to scan at least one light beam (2 i ) are designed over a defined field angle, for multi-field projection from at least two light beams (2 i ), a waveguide (3) arranged so that the at least two light beams (2 i ) can be coupled into the waveguide (3), and at least as many coupling-out elements (31 i ), such as projectors (1 i ), wherein each coupling element (31 i ) by at least one projector (1 i ) and has a first and at least one second partial area, at least two pupil multipliers (4 i ) that is located between the projectors (1 i) and the waveguide (3) and are designed as amplitude splitter surfaces or as diffractive structures so that each light beam (2 i ) into a first partial light beam (2 i1 ) and at least a second partial light beam (2 i2 ), with the pupil multipliers (4 i ) are arranged so that each first partial light beam (2 i1 ) in the first partial area and every second partial light beam (2 i2 ) or further partial light beams (2 ii ) into the second or a further sub-area of each of the coupling elements (31 i ) to distract.

The application provides a robot explainable intelligent computing method and system, which comprises the following steps: S1, collecting action behavior data and tactile representation data of a target object operation task of a robot in a working state; S2, extracting feature information of semantic description of the action behavior data and the tactile representation data, projecting feature information with strong correlation into a shared semantic subspace, and establishing a feature information vector matrix corresponding to the data and the task; S3, combining a symbolic planner with a specific tactile model based on a GEP algorithm, so as to achieve the goal of combining a long-term task structure of the robot with an operation strategy learned from tactile signals; and S4, based on a Bayesian trust model, cognitively fusing and calculating the robot action behavior data and the tactile representation data by using a probability method, so as to predict the next action of the robot. The problems of lack of explainability and transparency of a machine learning model are effectively solved.

The present invention discloses a method, system, and device for the dynamic fusion of multimodal perception data of an embodied intelligent body, including: S1. The embodied intelligent body collects image data in real time during motion; S2. Uses a multimodal large model to determine the point cloud filling density of the image data, and uses a mapping algorithm to fill the 3D point cloud of the camera image during data collection; S3. Generates a lidar feature map through point cloud data projection conversion; S4. Initializes and aligns the feature data of the multimodal large model; S5. Constructs a set of multi-scale, multi-channel, differentiable mutual information fine optimization methods to process the feature data; S6. Performs online monitoring and fusion self-correction operations of the multimodal large model; S7. Projects camera information onto the laser 3D point cloud, and continuously constructs a fused RGB-3D scene during the motion of the embodied intelligent body. The present invention can achieve accurate, robust, automatic calibration and fusion of external parameters between the lidar and the camera.