20368 results about "Image manipulation" patented technology

This disclosure provides systems, methods, and devices that support image processing. In a first aspect, a method for multi-sensor fusion includes receiving first information indicative of a first set of BEV features of image data captured by an image sensor; receiving second information indicative of a second set of BEV features of non-image sensor data captured by a non-image sensor; and determining fused data that combines the image data and the non-image sensor data based on the first information, the second information, and third information indicative of differences between BEV features of training data and the first set of BEV features and the second set of BEV features. The BEV features of the training data include a third set of BEV features associated with the image sensor and a fourth set of BEV features associated with the non-image sensor. Other aspects and features are also claimed and described.

A modeling method for three-dimensional real-time measurement reconstruction, comprising: on the basis of a three-dimensional camera, a laser radar, and an infrared sensor device, generating a multi-source original data set; performing data preprocessing; performing feature extraction and data fusion; performing three-dimensional space construction; by means of a deep machine learning algorithm, performing real-time dynamic adjustment and optimization on a model; and, by adopting an advanced image processing algorithm, generating a high-precision three-dimensional model.

The invention discloses a data center intelligent operation and maintenance method and system based on an industrial internet of things, belongs to the field of image processing calculation, and aims to solve the problems of privacy protection deficiency, serious manual dependence and weak energy efficiency and safety. Full-link dynamic optimization is realized through an edge calculation layer and an adaptive clustering network, edge nodes are integrated with a wavelet transform noise filtering technology, dynamic denoising is performed on multi-band sensor signals of temperature, vibration, current and the like, heterogeneous device time sequence data are aligned in combination with a dynamic time warping algorithm, sampling frequency differences of multiple devices are eliminated, and the multi-band sensor signals are obtained. A weight formula is put forward, a cluster head is dynamically elected based on node residual energy, data similarity and a load coefficient, a transmission path of a high-delay area is optimized in combination with a multi-hop routing protocol, the packet loss rate and the signal strength are evaluated in real time, redundant coding is started for a high-packet-loss link or the high-packet-loss link is switched to a low-power-consumption mode. And synchronizing the dynamic topology state with the digital twin platform through an open platform communication unified architecture protocol.

The invention discloses a glass lens surface scratch detection method and system, relates to the technical field of precision optical detection, and aims to solve the problems of scratch false detection, leak detection and poor algorithm adaptability caused by interference fringes, noise coupling and poor form adaptability in a high-reflection / complex coating process scene in the prior art. According to the scheme, an orthogonal polarization state composite light field is generated based on a multi-angle polarization light source array and a near-infrared compensation light source, and candidate regions are extracted through dynamic threshold segmentation and a direction gradient tensor matrix; gaussian pyramid multi-scale feature fusion and refraction angle consistency verification are utilized to eliminate artifact interference; constructing a direction constraint convolution kernel group to decompose scratches and background textures, and dynamically allocating computing resources in combination with a cascade network; feeding back closed-loop calibration light source wavelength and convolution kernel parameters in real time through coating parameters; according to the method, the precision and robustness of high-reflectivity surface scratch detection are remarkably improved, and meanwhile, the requirements for high-resolution image processing and real-time performance in a high-speed production line are balanced.

Embodiments of the invention provide a task processing method, a task platform, a computing device and a computer readable storage medium. The image processing method comprises the steps of obtaining a task description text of a target task; extracting task elements of the target task from the task description text by using a large language model, determining a plurality of target agents and target skills of the target agents from the candidate agent set based on the task elements, and generating a structured execution protocol corresponding to the target skills of the target agents; based on the structured execution protocols corresponding to the target skills of the multiple target agents, performing dependency analysis on the target skills of the multiple target agents to obtain a skill combination; and scheduling a skill tool corresponding to the skill combination to execute the target task to obtain a task result. The accuracy and the expandability of calling and processing the target task by skills and tools in an open scene are realized.

The invention provides an infrared and visible light image fusion method based on multi-scale feature interaction enhancement, belongs to the field of image processing, and aims to improve the image fusion quality in a complex environment. The method comprises the following steps: firstly, performing feature extraction on infrared and visible light images through a double-flow multi-scale encoder to generate multi-level features of different scales; and then, cross-modal information interaction is carried out by adopting a feature interaction enhancement module, fusion features are optimized through a space and channel attention mechanism, and clear expression of key areas such as target heat radiation and image edges is ensured. In the decoding stage, multi-scale jump connection and layer-by-layer up-sampling are utilized to reconstruct a high-resolution fusion image. And finally, training the fusion network through a content-gradient joint loss function to realize balance between detail reservation and global information. The method is suitable for tasks such as monitoring and target identification in a complex scene, and can effectively improve the image fusion effect especially under the conditions of low illumination, smoke shielding and the like.

An example assistant system can use a multimodal multitask medical machine-learned model to perform image processing to answer natural language queries. A device can process speech data or other natural language inputs to obtain a query. The query can be processed alongside image data that provides context for the query. The example system can receive a query associated with a particular task domain; generate, based on the query, a query input that comprises query instruction data from a first modality and query context data from a second modality; generate a combined input comprising the query input and an exemplar input, wherein the exemplar input comprises exemplar instruction data from the first modality and an exemplar context placeholder in lieu of exemplar context data from the second modality; process the combined input with a multimodal machine-learned model to generate output data; and output a query response based on the output data.

A multi-modal articulation system translates human gestures into control commands for digital and automation devices. The system integrates a camera module, which captures facial and hand movements, with an image processing unit that extracts facial features, such as eyebrow movement, lip curvature, eyelid motion, and eye trajectory. These extracted features are analyzed in real time by an articulation recognition module that compares them against a database to recognize specific gestures. The system tracks and processes air-drawn hand gestures using a gesture trajectory tracking unit, which converts the motions into digital representations and classifies them using deep learning algorithms. The recognized gestures are converted into machine-readable control signals and executed on various connected devices via a relay control unit. The system incorporates adaptive algorithms to improve accuracy, account for environmental conditions, and stabilize hand tremors, providing a gesture-based control interface for applications ranging from smart home systems to multimedia devices.

The invention relates to the technical field of image processing, and discloses a video monitoring personnel behavior identification method and system. The method comprises the following steps: performing action node and joint angle extraction processing on a positioning area to obtain human body action skeleton sequence data; constructing an action connection graph and a time sequence association edge, and carrying out behavior pattern learning processing to obtain space-time behavior characteristics; performing action semantic mapping processing on the spatio-temporal behavior features and the human body behavior feature vectors, and performing behavior time sequence chain construction processing to obtain behavior semantic description features; and performing behavior pattern matching and anomaly measurement processing on the behavior semantic description features, performing feature discrimination processing to obtain a behavior type identifier and an anomaly degree index, performing behavior persistence analysis processing, and performing behavior risk level evaluation processing to obtain a behavior recognition result and early warning information. According to the invention, based on multi-modal feature fusion and spatio-temporal behavior modeling, accurate identification of personnel behaviors and dynamic assessment of risk levels are realized.

The invention relates to the technical field of image processing, and discloses a display method and system for a vehicle-mounted LED display screen. The method comprises the following steps: acquiring ambient light intensity data, performing fusion processing to obtain a characteristic value, and predicting ambient light change; identifying a driving scene according to the road condition data, and analyzing the priority by combining the ambient light change data; arranging a display area in combination with the eye movement data, and determining display parameters; analyzing the multi-modal interaction data, determining an interaction strategy, and verifying to generate response data; adjusting display content according to the ambient light features, and outputting a display effect in combination with response data; and energy consumption is estimated by integrating various data, and control parameters are generated to adjust an LED driving circuit. Through intelligent analysis and processing of multi-dimensional data such as ambient light intensity, driving scene and eye movement tracking, dynamic optimization and energy-saving control of display content are realized, and the problem that display effect and energy efficiency are difficult to consider in the prior art is overcome.

The invention relates to the technical field of image processing, and discloses a detection method, system and equipment for intelligent welding of pipe pile splicing and a medium. The method comprises the steps that noise reduction is conducted on a target weld seam image through a filtering algorithm, registration and splicing are conducted on the image through feature matching, and a weld seam unfolding image is obtained; segmenting the weld joint expanded image by using a deep learning network, and extracting a weld joint center line and surface features to obtain weld joint feature data; defect detection and recognition are conducted on the weld joint feature data, hierarchical calculation is conducted through a rule set, and weld joint quality data are obtained; parameter mapping is conducted according to the weld joint quality data, a welding parameter instruction is generated, welding process variables are adjusted, and target welding parameters are obtained; and the welding seam quality data and the target welding parameters are stored, and a quality report is generated through data analysis. The detection accuracy of intelligent welding for pipe pile splicing is improved.

The invention discloses an aluminum profile surface defect automatic detection method and system based on image recognition, and relates to the technical field of image processing and intelligent detection.The method comprises the steps that three-dimensional geometric data of the section of an aluminum profile are obtained through a three-dimensional scanning device, candidate observation angles and geometric feature parameters needed by coverage calculation are extracted, and the three-dimensional geometric data of the section of the aluminum profile are obtained; if the section shape contains a groove or a curved surface structure, marking a space coordinate range corresponding to the area of the shadow region to obtain a section geometric feature vector and a shadow region coordinate set; according to the aluminum profile surface defect automatic detection method and system based on image recognition, all-dimensional dead-corner-free detection of the surface of the aluminum profile is achieved, the method and system can adapt to the production takt of complex section shapes and changes, the accuracy and comprehensiveness of defect detection are improved, and effective technical support is provided for aluminum profile quality control.

The invention relates to an image processing technology, and discloses an efficient panoramic image splicing method and system based on multi-view fusion, and the method comprises the steps: collecting a plurality of images from different views; performing multi-scale feature extraction on each image, generating a feature descriptor for each extracted feature point, and matching a corresponding feature point pair; performing multi-view geometric constraint screening on the feature point pairs; according to the screened feature point pairs, estimating a homography matrix between adjacent images, and carrying out global optimization on the homography matrix; aligning all the images into the same coordinate system; determining an overlapping region between adjacent images; and according to the pixel information in the overlapping areas, fusing the overlapping areas by adopting a self-adaptive weighted fusion algorithm so as to splice the plurality of images into a panoramic image. The invention further discloses a control device and a computer readable storage medium. The invention aims to improve the efficiency and accuracy of generating the multi-view fused panoramic image.

Embodiments of the disclosure relate to unsupervised learning with synthetic data and attention masks. According to example embodiments of the disclosure, a plurality of sample images are generated by providing a plurality of text prompts into a trained generative model, respectively. For a sample image of the plurality of sample images, at least one attention map is obtained from a generative model, the at least one attention map being determined by the generative model for generating the sample image, an attention map indicating visual elements of an object within the sample image. Training of a target model is performed according to unsupervised learning at least based on the plurality of sample images and attention maps for the plurality of sample images, the target model being configured to perform an image processing task.

The invention discloses a land degradation condition evaluation method and system, and relates to the technical field of image processing, and the method comprises the steps: collecting a land image through multi-source remote sensing, and classifying land organisms through multi-level extraction of remote sensing spatial features; constructing a space-time coupled dynamic particle evolution model based on the land organism distribution map, and performing dynamic particle evolution prediction on land organisms; establishing a non-biological value quantitative model, performing weight distribution according to historical data and a machine learning algorithm, and dynamically calculating a multi-dimensional value index system; and evaluating the land degradation condition according to the land abiotic value historical value and the dynamic particle evolution prediction of the land organisms. According to the method, adaptive feature extraction is carried out through the combination of deformable convolution and transfer learning, the classification precision under a complex terrain is improved, land degradation is evaluated by constructing a particle evolution model to quantify the space-time response of a biocenosis and constructing a multi-dimensional non-biological value index system at the same time, and the credibility of a block chain is enhanced.

The invention provides a remote sensing image super-resolution method based on a diffusion model and a multi-modal large language model, and relates to the technical field of image processing. According to the method, a pre-trained stable diffusion model is adopted, the model is trained on a large-scale data set, the stable and detailed super-resolution effect can be achieved, and the convergence speed is higher. According to the method, a multi-mode large language model is used for enhancing the semantic comprehension ability of the model, and detailed content description and texture description are provided. The invention also introduces an additional classifier which provides global information and a simple signal about the LR. The prior information is adaptively integrated into a diffusion model through a cross attention module. And finally, through combination of the strong generation capability of the stable diffusion model and the semantic understanding capability of the MLLM, the method provided by the invention is excellent in the aspect of remote sensing image reconstruction, and excellent performance is realized in the aspect of quality of a plurality of images on different data sets.

The invention relates to an active lane changing obstacle avoidance control method based on pavement friction coefficient prediction. Comprising the steps of 1, obtaining a road adhesion coefficient based on vehicle vision; 2, obtaining a road adhesion coefficient based on vehicle dynamics; 3, fusing the road adhesion coefficient based on the vehicle vision and the road adhesion coefficient based on the vehicle dynamics through a weighted average method to obtain a road adhesion coefficient; 4, sensing the environment; 5, determining a lane changing obstacle avoidance decision based on a safe distance model; and 6, controlling and executing a lane changing obstacle avoidance decision. According to the method, sensor data and environment information collected during vehicle driving are analyzed, the road surface visual adhesion coefficient is estimated by using an image processing technology, and the road surface visual adhesion coefficient is combined with a dynamic road surface adhesion coefficient measured by a vehicle sensor, so that a more accurate comprehensive road surface adhesion coefficient is synthesized; the comprehensive road adhesion coefficient is combined with a vehicle dynamics model and a driver intention to predict a possible advancing track of the vehicle in a period of time in the future.

A computer-implemented method includes receiving an image of an article of interest to be evaluated relative to one or more features of interest, identifying a reference feature of a known size in the received image, identifying two or more extremities of the reference feature in the received image and a number of pixels between the two or more extremities of the reference feature, calculating a pixel size for the selected image based on the reference feature size and the number of pixels between the two or more extremities of the reference feature, annotating the received image to include one or more tolerance lines for the one or more features of interest, and determining whether the one or more features of interest in the image comply with the one or more tolerance lines. A computer program product and computer system corresponding to the method are also disclosed.

The invention relates to a lightweight parking detection method based on a multi-scale attention mechanism, and belongs to the technical field of image processing and target detection. The method comprises the following steps: acquiring a parking space data set, and preprocessing the data set; according to the method, a lightweight YOLOv8 network structure is constructed, and a Backbone layer at least comprises a plurality of MobileNetV3 modules and a plurality of C2fScConv modules; an EMA attention mechanism is introduced between a C2f module and a Deect module of the Neck layer; establishing a loss function WIoU v3 for the lightweight YOLOv8 network structure; and training the network to obtain a lightweight parking detection model, and detecting the parking space state in real time through the lightweight parking detection model. According to the invention, while the target detection precision and robustness are improved, the operation cost and operation time of model training and detection are reduced, and lightweight and accurate parking space state detection are realized.

The invention provides an AI-based automatic identity card image cutting and OCR recognition method and system, and relates to the technical field of image processing, and the method comprises the steps: collecting a multi-angle depth image and a visible light image, reconstructing a three-dimensional model of a certificate through a three-dimensional point cloud registration network, and achieving the perspective correction of an image through the combination of attention posture estimation and projection matrix optimization; a double-flow memory neural network is adopted to carry out information area positioning, a feature extraction backbone network constructs a multi-scale feature pyramid, and a dynamic memory updating network carries out feature matching and dictionary updating based on a time sequence attention module and comparative learning; and performing character recognition on the segmented information sub-images through a multi-branch feature enhancement network, improving the recognition precision in combination with a self-attention enhancement unit and a context reasoning unit, and dynamically optimizing network parameters by using a reinforcement learning controller until a preset recognition credibility threshold value is reached.

The invention relates to the technical field of image processing, and discloses an AR technology-based precise positioning method and system for minimally invasive surgery of hepatobiliary surgery. The method comprises the steps that blood vessel network data are extracted through a medical image sequence, a three-dimensional structure diagram is generated, operation target points are marked, and a coordinate system is established; collecting dynamic data for mapping matching, and establishing a real-time tracking model; constructing an augmented reality scene and implanting a navigation path; acquiring an instrument position calculation track, and comparing with a navigation map to generate an instruction; constructing a projection interface to display the key area; recording the whole process and evaluating the operation quality. By establishing the real-time tissue deformation tracking model, a multi-source data fusion accurate positioning mechanism and an intelligent operation quality evaluation system, the accuracy and reliability of operation navigation are effectively improved.

The invention relates to a multi-source remote sensing image classification method based on a key band retrieval attention mechanism, and belongs to the technical field of remote sensing image processing. The method comprises the steps of firstly performing preprocessing and data set division on multi-source remote sensing data, then constructing a key band retrieval attention network, performing training and evaluation on a model by utilizing a training set and a verification set after division, and finally performing visual analysis on a model result by utilizing a test set. According to the method, the features of the hyperspectral image and the laser radar / synthetic aperture radar image are effectively extracted and fused, redundant information interference is effectively reduced, the retention rate of hyperspectral key information is improved, the complementary expression ability among multi-source data is enhanced, and the remote sensing image classification precision and calculation efficiency are remarkably improved. The method is suitable for application scenes of multi-source remote sensing data fusion and classification, can meet efficient intelligent processing requirements of complex earth surface information, and provides an accurate and efficient remote sensing image classification solution.

The invention provides an aviation video stream target identification processing method and system, relates to the technical field of image processing, artificial intelligence and aviation monitoring, and aims to realize the target identification processing of an aviation video stream through preprocessing modal data such as video, infrared and radar and combining an adaptive weighted fusion technology, a multi-stage visual feature extraction and a global convolution optimization technology. The system can extract target features from multi-level and multi-modal data; and a historical motion track and future motion prediction are further combined, the system dynamically corrects the target position, and finally the consistency of multi-modal data is ensured through cross validation. According to the method, the recognition precision and robustness of the system to weak and small targets are enhanced, missing detection and false detection are reduced, the adaptability is high, the requirement for computing resources is low, and the method is suitable for target recognition and tracking tasks in a complex dynamic environment.

The invention belongs to the technical field of image processing, and particularly discloses an SAR image ship target detection method based on multi-attention fusion. The method and the device are used for solving the problem of how to accurately detect a ship target in an SAR image in a complex environment. Comprising the following steps: (1) constructing a data set; (2) constructing an SAR image ship target detection network model based on multi-attention fusion, comprising a network main branch, a multi-level feature enhancement module composed of a global feature enhancement branch and a local feature enhancement branch, a multi-attention fusion module composed of channel attention and space attention, and a mixed loss function composed of shape segmentation loss and boundary weighted cross entropy loss. And (3) training the SAR image ship target detection network model, and carrying out ship target detection on the SAR image. According to the invention, the optimal balance between accuracy and efficiency can be achieved, and ship targets of different scales in a complex environment can be effectively detected.

The invention discloses a CAD drawing segmentation parameter adjustment method and system combined with region recognition, and relates to the technical field of image processing, and the method comprises the steps: obtaining a target CAD drawing file, carrying out the region feature extraction, generating a region feature vector set, carrying out the region type recognition, and determining a plurality of pieces of region information; constructing a segmentation rule base, matching the segmentation rule base according to the information of the plurality of regions, and dynamically adjusting the boundary information according to a matching result to obtain a segmentation parameter set; based on the segmentation parameter set, performing adaptive segmentation processing on the target CAD drawing file to generate a structured drawing segmentation result; and based on the structured drawing segmentation result, carrying out topological relation verification, and generating a segmentation optimization result. According to the method, the technical problem of poor segmentation effect caused by inaccurate region identification and fixed segmentation parameters in the CAD drawing segmentation process in the prior art is solved, and the technical effects of improving the accuracy and adaptability of CAD drawing segmentation and optimizing the segmentation quality and the structural effect are achieved.

The invention relates to an image processing and data processing technology, in particular to an intelligent coagulant dosing control method and system based on image recognition and multi-parameter modeling, the floc state is accurately quantified through image recognition and deep learning modeling, and a dosing prediction model with self-adaptive capacity is established in combination with raw water feed-forward information. And accurate control of coagulant addition is realized. The method comprises the following steps: collecting a floc image, carrying out image processing and floc feature extraction, and constructing a floc image description vector; time sequence input structure data fusing the floc image and the water quality data is constructed, and floc image sampling at each moment is defined as a time frame; performing enhancement and reconstruction processing on the training data of the dosing amount prediction model by adopting a data enhancement and sample equalization strategy to obtain continuously distributed synthetic samples; and constructing a hierarchical feature fusion enhanced dosing amount prediction model, fusing the previous water quality parameters, the current water quality parameters and the floc image joint feature vectors, and optimizing the dosing amount prediction precision layer by layer.

The invention relates to a multi-source remote sensing image classification method based on spectrum adaptive feature fusion, and belongs to the field of remote sensing image processing and analysis. Aiming at the problems of poor feature extraction flexibility, poor feature fusion strategy, low calculation efficiency and the like of the existing multi-source remote sensing image classification method, the method comprises the following steps: firstly, preprocessing and dividing a multi-source remote sensing data set, then constructing a spectrum adaptive feature fusion neural network model, and then carrying out model training and quantitative evaluation; and finally, carrying out model visualization result analysis. The features of a hyperspectral image and a laser radar / synthetic aperture radar image are effectively extracted and fused, classification of multi-source remote sensing data is achieved, the method is suitable for a multi-source data fusion and classification scene, the remote sensing data processing requirement of complex earth surface information can be met, the advantages in the aspect of improving classification precision and processing efficiency are remarkable, and the method is suitable for popularization and application. And a more efficient and accurate solution is provided for multi-source remote sensing image classification.

The invention relates to the technical field of medical image processing, in particular to a medical image automatic analysis system and method, and the system comprises a time sequence dynamic monitoring module, a lesion area weighted fusion module, a boundary energy optimization module, a multi-channel filtering processing module, and a time sequence feature construction module. According to the method, time sequence tracking analysis of medical images is realized through time sequence dynamic monitoring, change salient region screening and precise lesion evolution trend positioning, lesion data at different moments are integrated by means of weighted fusion processing, the accuracy of time sequence analysis is improved, data fluctuation errors are reduced, lesion boundaries are optimized in combination with gradient analysis and gray scale comparison, and the accuracy of medical image analysis is improved. Noise interference is eliminated, lesion contours are clearer, different frequency features of images are screened through multichannel filtering, lesion differentiation information is highlighted, irrelevant interference is reduced, feature expression is enhanced, a complete lesion time sequence analysis framework is constructed, and a comprehensive image analysis basis is provided for precise medical treatment.

The invention discloses a real-time single-stage remote sensing image correction target detection method based on YOLOV8, and relates to the technical field of remote sensing image processing. According to the method, a deformable convolution dynamic prediction local geometric distortion parameter is embedded based on a YOLOv8 backbone network, an adaptive deformation field is generated, pixel-level real-time correction is realized, shallow details and high-level semantic features are fused through a bidirectional path aggregation network, and channel attention and a space gating mechanism are combined, so that the real-time correction of the image is realized. The small target detection capability is enhanced, background noise is suppressed, angle prediction is divided into discrete classification and continuous residual error regression tasks through a decoupling type rotation detection head, angle periodic errors are eliminated in combination with a direction sensitive loss function, and the rotation frame positioning precision is improved. And constructing a dynamic multi-task collaborative loss function, introducing gradient distribution consistency constraint to jointly optimize correction and detection tasks, and realizing feature semantic alignment and model self-enhancement through end-to-end closed-loop training. And the rotating target detection precision and the complex scene robustness are obviously improved.

The invention provides a multi-image forgery detection method and system based on a cross-modal vision large language model, and relates to the technical field of image processing and computer vision, and the method comprises the steps: constructing a data set, and carrying out the preprocessing of the data set; according to the preprocessed data, respectively extracting visual features and language features through a pre-trained visual Transform and a language model so as to obtain cross-modal features; according to the cross-modal features, the visual features and the language features are clustered, cross-modal similarity is calculated, a matching relation is established, fusion is carried out, and fused multi-modal features are obtained; and according to the fused multi-modal features, performing adversarial training through a generator and a discriminator to generate an adversarial network. According to the method, high-precision detection and effective detection of multiple image counterfeiting types such as positioning splicing, copying and pasting, AIGC generation and the like are realized.