Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

2748 results about "Optical flow" patented technology

Optical flow or optic flow is the pattern of apparent motion of objects, surfaces, and edges in a visual scene caused by the relative motion between an observer and a scene. Optical flow can also be defined as the distribution of apparent velocities of movement of brightness pattern in an image. The concept of optical flow was introduced by the American psychologist James J. Gibson in the 1940s to describe the visual stimulus provided to animals moving through the world. Gibson stressed the importance of optic flow for affordance perception, the ability to discern possibilities for action within the environment. Followers of Gibson and his ecological approach to psychology have further demonstrated the role of the optical flow stimulus for the perception of movement by the observer in the world; perception of the shape, distance and movement of objects in the world; and the control of locomotion.

Video super-resolution reconstruction method and system

The invention discloses a video super-resolution reconstruction method and system, and relates to the technical field of video restoration processing, and the method comprises the steps: collecting a to-be-reconstructed video frame sequence and a reference frame sequence; extracting a dense optical flow field between the reference frame and the target frame; performing geometric alignment on the target frame to the reference frame according to the dense optical flow field to obtain a motion consistency feature; performing feature extraction on the video frame sequence through a parameterized residual scaling module; inputting the extracted features into a bidirectional propagation module to process forward and backward image sequences respectively, extracting time sequence forward features and time sequence reverse features, and fusing the features to obtain detail features; carrying out adaptive fusion on the motion consistency features and the detail features, and sending the fused features into a reconstruction network to obtain deep visual features; pixel-level adaptive reconstruction is realized according to the deep visual features, and a super-resolution video sequence is obtained; according to the method, the feature space consistency is kept, and meanwhile, the feature matching precision in a complex motion scene is remarkably improved.
Owner:BEIJING UNIV OF TECH

Panoramic photographing and machine vision deformation monitoring integrated Beidou monitoring machine system

The invention discloses an integrated Beidou monitoring machine system integrating panoramic photographing and machine vision deformation monitoring, and relates to the technical field of safety monitoring. The system comprises a hardware structure unit and a software function unit, the hardware structure unit comprises a Beidou positioning module, an inertial navigation compensation module, a panoramic vision acquisition module, a machine vision processing module, a multi-mode communication transmission module and a power management module; the software function unit comprises a multi-source data fusion engine, a panoramic three-dimensional modeling sub-module, an intelligent early warning decision module and a cloud collaborative resolving interface. According to the invention, through real-time fusion of Beidou positioning data and panoramic vision imaging, an improved dense optical flow method is adopted to track local crack propagation, and global displacement monitoring of Beidou is combined, so that cross-scale synchronous sensing from macroscopic displacement to microscopic deformation is realized, and the comprehensive monitoring precision is improved.
Owner:HUASI (GUANGZHOU) MEASUREMENT & CONTROL TECH CO LTD

Container surface damage detection method and device based on machine vision

The invention relates to the technical field of intelligent detection, in particular to a container surface damage detection method and device based on machine vision, and the device consists of a multi-modal data acquisition module, a dynamic compensation processing module, a multi-modal data fusion module and a damage classification and positioning module. The multi-modal data acquisition module generates a high-density three-dimensional point cloud through double-laser line scanning, and acquires a multispectral image, an infrared thermogram and a real-time motion state. The dynamic compensation processing module integrates an optical flow method and acceleration data to realize sub-pixel-level motion compensation, and combines adaptive exposure control to optimize the imaging quality under complex illumination. The multi-modal data fusion module strengthens defect feature expression through space-time alignment and a double-branch collaborative attention mechanism, and model parameters are reduced through lightweight network design. And the damage classification and positioning module adopts an improved deep network to realize defect classification and complete millimeter-level three-dimensional positioning. The automatic detection requirement of a port is met, and the problems of poor container detection precision, poor adaptability and the like are solved.
Owner:HAINAN UNIV

Image segmentation and dynamic target identification method based on artificial intelligence

The invention relates to the technical field of artificial intelligence, in particular to an artificial intelligence-based image segmentation and dynamic target recognition method, which comprises the following steps of: accurately positioning a candidate region through multi-modal space-time fusion and dynamic confidence coefficient screening; strengthening spatial-temporal feature expression in a layering manner through a multi-level feature decoupler, and generating a multi-dimensional feature enhanced spatial-temporal candidate region; through a deformable segmentation network, a deformation convolution kernel and edge motion matching loss are combined, joint optimization of a geometric boundary and motion continuity is realized, and the segmentation robustness of a flexible target is improved; through optical flow back propagation dynamic correction and confidence coefficient propagation, high-precision segmentation masks with consistent time and space are output; and through a target trajectory re-identification and completion mechanism driven by a graph attention network, and in combination with optical flow deformation prediction, stable tracking in a shielding scene is realized.
Owner:CHANGSHA INSTITUTE OF TECHNOLOGY

Operating room intelligent monitoring method and system based on monitoring video recognition

The invention discloses an operating room intelligent monitoring method and system based on monitoring video recognition, and relates to the technical field of medical safety supervision, and the method comprises the steps: collecting a video through an operating room camera array, and constructing an operation region panoramic sequence through a residual neural network and an optical flow field; a double-branch target detection network is adopted to extract the position of a medical worker, the body position of a patient and the characteristics of surgical instruments, and a surgical scene model is constructed; performing trajectory tracking based on skeleton key point extraction and Kalman filtering, and constructing a dynamic graph of the operation process; generating an operation process state report by using the time sequence diagram convolutional network and a multi-head attention mechanism; and comparing the operation specification library through a knowledge distillation algorithm, and carrying out grading recording on abnormal events. According to the invention, efficient abnormal event tracking and recording functions are realized, technical support is provided for operation quality control and safety management, and the overall performance of operating room intelligent monitoring is improved.
Owner:XIANGNAN UNIV

Personnel positioning method and system based on 3D Gaussian splash model and video fusion

The invention discloses a personnel positioning method and system based on a 3D Gaussian splash model and video fusion. The method comprises the following steps: firstly, acquiring input data of at least two visual angles through a multi-visual angle video stream acquisition module, and constructing an initial three-dimensional Gaussian model by utilizing a sparse point cloud initialization module; a time sequence dynamic tracking module is combined with an optical flow algorithm to realize cross-frame parameter updating of a Gaussian ellipsoid, and a time sequence consistency optimization module is adopted to suppress parameter drift; identifying a constructor bounding box by using a target detection module, and establishing a corresponding relation between pixels and three-dimensional coordinates through a three-dimensional-two-dimensional space matching module; three-dimensional coordinates are calculated through a multi-view fusion positioning module, and the positioning precision is improved through a multi-sensor fusion optimization module in combination with IMU data. A 3D Gaussian splash model is combined with multi-view geometry and time sequence optimization, high-precision personnel dynamic positioning without marking in a construction scene is realized, and the problems of tracking drift and shielding in a complex environment in a traditional method are effectively solved.
Owner:JIANYUAN FUTURE CITY INVESTMENT DEV CO LTD

Method and system for measuring slope deformation of hard mountainous area based on image data

The invention relates to the technical field of image data measurement and analysis, in particular to a method and a system for measuring slope deformation in a dangerous mountainous area based on image data. The method comprises the following steps: acquiring high-resolution image acquisition data and GNSS auxiliary data of the slope of the hard mountain area; correcting the high-resolution image acquisition data to obtain corrected slope image acquisition data; performing local feature extraction and matching of each time phase image on the corrected slope image acquisition data to obtain slope preliminary matching point set data; and performing mismatching elimination on the slope preliminary matching point set data to obtain transformation matrix data between the slope images. According to the method, high-resolution image acquisition and GNSS data are combined, through correction, registration, three-dimensional reconstruction and optical flow analysis, slope deformation of the hard mountainous area is accurately obtained and analyzed, and efficient deformation monitoring and visualization results are achieved.
Owner:四川高速公路建设开发集团有限公司 +1

Self-localization and motion perception method and system based on deep learning

The invention relates to a self-localization and motion perception method based on deep learning, and the method comprises the following steps: multi-modal perception: collecting RGB frames and event streams through employing a DAVIS346 event camera, obtaining texture and depth information through employing an RGB-D camera, and supplementing 3D structure data through a laser radar; hybrid optical flow driven motion perception: adopting a double-branch architecture of an improved RAFT network and an event optical flow private network; multi-modal 3D detection and trajectory management: fusing multi-modal data based on VoxelNeXt-Lite to generate a 3D detection frame, filtering false detection by combining point cloud density clustering and an event density threshold, then constructing a space-time diagram associated trajectory through a Spatio-Temporal Graph Transformer, and optimizing pedestrian trajectory prediction continuity by using an LSTM (Long Short Term Memory) model perceived by a gait cycle; multi-view semantic graph matching: constructing a 3D semantic voxel map containing vertical features, calculating scene similarity in combination with top view NetVLAD features and deformable graph matching, and dynamically adjusting semantic weight by using a situation encoder and knowledge graph reasoning; and carrying out multi-sensor fusion and robust positioning.
Owner:JINGCHU UNIV OF TECH

Unmanned aerial vehicle obstacle avoidance control method and system based on computer vision

The invention relates to the technical field of unmanned aerial vehicle autonomous control, and discloses an unmanned aerial vehicle obstacle avoidance control method and system based on computer vision, and the method comprises the steps: collecting the multi-view image data of a flight environment in real time through a multi-view camera, and carrying out the preprocessing; using an improved YOLOv7 network to identify obstacles in the preprocessed image, and extracting position, size and motion information of the obstacles; generating a three-dimensional environment map and a plurality of candidate obstacle avoidance paths in combination with the flight parameters of the unmanned aerial vehicle and the extracted obstacle information; an optimal path is screened based on a dynamic safety evaluation model, and the attitude and power output of the unmanned aerial vehicle are adjusted in real time to complete obstacle avoidance; an obstacle avoidance effect is verified by using an optical flow method and depth information, and path planning is dynamically corrected. According to the method, the dynamic safety evaluation model is introduced, multi-dimensional factors are comprehensively considered, the safety of each path is dynamically determined, and it is ensured that the flight path of the unmanned aerial vehicle can be timely and accurately modified and optimized in a dynamic complex environment.
Owner:NORTHWESTERN POLYTECHNICAL UNIV +1

Video stream dynamic fragment encryption and block chain evidence storage method

The invention discloses a video stream dynamic fragmentation encryption and block chain evidence storage method, and relates to the technical field of video content security, and the method comprises the steps: calculating a color histogram difference value and an optical flow vector change rate between adjacent frames of an input video, marking the difference value as a scene switching point when the difference value exceeds a preset threshold value, and storing the scene switching point; the method comprises the following steps: preliminarily dividing a video into a plurality of scene segments according to scene switching points, performing content complexity evaluation on the scene segments, calculating gray level co-occurrence matrix characteristics of each frame of image through texture density analysis, calculating edge complexity to extract the number and distribution of Canny edges, and performing motion vector statistics to analyze the size and direction of inter-frame object displacement. The change rate between adjacent pixels in the color space is measured according to the color change gradient; the video stream dynamic fragment encryption and block chain evidence storage method is suitable for video contents of different types and complexities, and has relatively high detection accuracy and robustness.
Owner:HANGZHOU MEICHANG IOT TECH CO LTD

Industrial surface defect detection method based on multi-scale feature fusion

The invention discloses an industrial surface defect detection method based on multi-scale feature fusion, and the method comprises the steps: collecting the multi-source data of a detected surface in real time through a multi-modal sensor array, and forming a structured data set through time-space synchronization and denoising; constructing an adaptive geometric correction model to realize spatial transformation and scale normalization of multi-scale features, and cooperatively realizing cross-modal alignment and preliminary fusion through texture and physical attribute branches of a double-flow decoding network; dynamically reweighting the fusion features based on a defect physical model, strengthening physical mechanism defect characterization and suppressing interference; combining optical flow compensation and three-dimensional convolution to extract spatio-temporal evolution characteristics, and forming dynamic defect characterization; and finally outputting defect type and severity evaluation through the classification model in combination with the process parameter library. Therefore, the adaptability of the method to a complex industrial environment is enhanced, and the detection stability can be maintained under different materials, illumination conditions and dynamic interference.
Owner:XIAN AERONAUTICAL UNIV +1

Highway tunnel monitoring method, system, equipment and medium

The invention discloses an expressway tunnel monitoring method, system and device and a medium, and relates to the technical field of tunnel monitoring. Tunnel environment data are collected in real time through a multi-source heterogeneous sensor array, and the data at least comprise video images, millimeter wave radar point cloud, laser radar three-dimensional coordinates, temperature and humidity and CO concentration parameters. According to the system, an improved YOLOv7 algorithm is used for carrying out target real-time detection, an optical flow method is combined to predict the motion trail of a target object, a tunnel dynamic characteristic spectrum is constructed, real-time monitoring of the tunnel environment is achieved, by deploying a risk level assessment engine, the system can extract space-time correlation characteristics, and the risk level assessment efficiency is improved. A comprehensive risk index is generated in combination with a fuzzy logic decision tree, and when the risk index exceeds a dynamic threshold value, the system triggers a grading early warning mechanism, links tunnel emergency equipment, synchronously generates an emergency plan and pushes the emergency plan to an operation and maintenance terminal to guarantee tunnel operation safety.
Owner:山西交通控股集团有限公司

Intelligent event identification method and system based on high-speed camera

The invention provides an intelligent event identification method and system based on a high-speed camera, and the method comprises the steps: setting the collection parameters of the high-speed camera, and triggering the camera to collect a target scene video stream. And hardware acceleration decoding processing is carried out on the collected original video data stream, real-time environment illumination information of the environment illumination sensor is obtained, and dynamic brightness equalization processing is executed. And performing motion adaptive denoising processing on the video sequence. Geometric distortion correction is carried out on the image sequence through camera calibration parameters, sub-pixel-level displacement vectors and dense optical flow field data of a moving object are extracted, and multi-scale morphological features are extracted. And the features are fused to generate motion feature data, the data are processed through a spatio-temporal joint event classification model, an event identification result is output, the result is bound with a high-precision timestamp, and event identification information is output to an industrial control system display device in real time. According to the invention, the accuracy and real-time performance of event identification can be improved.
Owner:广州思林杰科技股份有限公司

Real-time video stream behavior identification and early warning system

The invention relates to the technical field of video behavior recognition, and discloses a behavior recognition and early warning system for a real-time video stream. The system comprises a spatio-temporal feature modeling module, a behavior fragment extraction module, an anomaly propagation modeling module, a risk area positioning module and an early warning strategy generation module. The spatial-temporal feature modeling module builds a dynamic model based on historical data, captures a skeleton key point three-dimensional coordinate sequence, a motion optical flow vector field and a micro-expression intensity spectrum, and outputs a theoretical behavior mode vector; the behavior fragment extraction module generates a multi-modal difference feature tensor through cross-modal difference analysis; the exception propagation modeling module generates an exception propagation path risk probability distribution cloud picture in combination with spatial constraint and trajectory information; the risk area positioning module identifies a high-risk area and marks a boundary; and the early warning strategy generation module dynamically configures monitoring parameters, starts high-frame-rate micro-expression capture for a high-risk area, and performs a track disturbance test on an adjacent area.
Owner:GAOZI TECHNOLOGY (SHENZHEN) CO LTD

Pipe gallery pipeline key connection point leakage monitoring system and method based on AI vision

The invention relates to the field of computer vision and industrial safety monitoring, and discloses a pipe gallery pipeline key connection point leakage monitoring system and method based on AI vision, and the system comprises a data collection module, an intelligent analysis module, a 3D modeling module, a space-time verification module and an alarm prediction module. Real-time detection and three-dimensional accurate positioning of a leakage area are realized in combination with neural network optimization driven by physical simulation parameters; further through optical flow tracking and fluid mechanics verification, false alarm events of non-physical rules are screened out; and based on Bayesian decision and diffusion equation prediction, generating a leakage risk heat map and triggering graded alarm. The method solves the technical problems of low leakage detection precision, high false alarm rate and inaccurate positioning in a complex pipe gallery scene, has the advantages of high environmental adaptability, high anti-interference capability and prospective risk pre-judgment, and is suitable for intelligent safety monitoring of underground pipe galleries and petrochemical engineering pipelines.
Owner:天津东方泰瑞科技有限公司 +2

Dynamic scene three-dimensional reconstruction method and device based on hydrogen energy unmanned aerial vehicle survey

The invention discloses a dynamic scene three-dimensional reconstruction method and device based on hydrogen energy unmanned aerial vehicle survey, and the method comprises the steps: obtaining dense time sequence multi-view image data of a target region through a hydrogen energy unmanned aerial vehicle platform, and carrying out the preprocessing of radiation correction and geometric correction; carrying out optical flow analysis and deformation rate clustering on the preprocessed image, identifying a pseudo-static anchor point and constructing a dynamic reference field; introducing a dynamic reference field as a soft constraint in a binding adjustment process, and optimizing a camera pose to generate a three-dimensional point cloud with consistent time and space; and finally, mapping the point cloud to a space-time voxel grid, constructing a surface evolution model by using a graph neural network or an anisotropic diffusion algorithm, and calculating a surface deformation vector to realize continuous and high-precision three-dimensional reconstruction of the disaster scene surface deformation process.
Owner:BEIJING YUANSHEN ENERGY SAVING TECH +1

Panoramic image real-time splicing algorithm and system based on multi-sensor fusion

The invention discloses a panoramic image real-time splicing algorithm and system based on multi-sensor fusion, and particularly relates to the technical field of panoramic image real-time splicing, and the algorithm comprises the following steps: constructing a structured fusion sequence based on multi-source images, postures and position information, optimizing a matching effect through high-density feature extraction and repeated texture recognition, and obtaining a multi-source image fusion sequence; a dynamic foreground and a static background are distinguished by using sparse optical flow so as to improve the visual angle estimation precision, pose fusion optimization is realized in combination with a multi-mode residual error, and the continuity and stability of a spliced image are improved through edge smoothing, brightness tuning and color correction; according to the method, the structured fusion sequence is constructed through multi-source data alignment, so that the data synchronization and splicing stability is improved; identifying repeated regions based on texture direction features, and optimizing feature matching accuracy; and through edge smoothing, brightness harmonizing and color consistency processing, the visual coherence and output quality of the panoramic image are enhanced.
Owner:SHENZHEN WEIQUNSHI TECH CO LTD

Target tracking method and system based on AI vision

The invention belongs to the technical field of image recognition, and provides a target tracking method and system based on AI vision, and the method comprises the following steps: collecting original video frames; environment adaptive image enhancement; performing multi-target detection and multi-modal feature extraction; estimating local optical flow motion; performing multi-target trajectory association; carrying out shielding processing and re-identification; outputting a track and analyzing a result; according to the method, a physical-deep learning cascade defogging model is set, light / dense fog processing paths are dynamically switched through a dark channel mean value, atmospheric scattering physical prior and U-Net residual error correction are fused, an environment self-adaptive sensing architecture is provided, the failure bottleneck of a traditional single model under sudden change fog concentration is broken through, and the real-time performance of the system is improved. According to the method, an apparent-motion-geometry ternary coupling trajectory cognition system is constructed, a dynamic cost matrix and a feature cache pool are designed, the ID switching problem caused by similar target aggregation and long-time shielding is solved, and the accuracy of target tracking in the shielding environment is improved.
Owner:BEIJING SIMPLE NETWORK SECURITY TECH CO LTD

Hydraulic engineering concrete crack intelligent identification and quantitative analysis method and system based on machine vision

The invention relates to a hydraulic engineering concrete crack intelligent identification and quantitative analysis method and system based on machine vision. The method comprises the following steps: firstly, acquiring an original image sequence of the surface of a hydraulic engineering concrete structure, classifying according to illumination intensity, shooting angle and shooting distance, extracting crack edge features through a convolutional neural network, and fusing to obtain a crack feature set; correcting illumination through adaptive histogram equalization, correcting angles and distances through geometric transformation, and combining edge detection and scale invariant feature transformation to obtain standardized geometric parameters including crack length, maximum width and the like; if the parameter exceeds the engineering safety standard threshold value, tracking a crack track through an optical flow method to calculate increment, and inputting a neural network to output a damage trend; and finally, generating a three-color risk distribution diagram by using a finite element based on the trend, extracting high-risk data to calculate a real-time evaluation value, and dynamically adjusting the monitoring frequency to generate an optimization strategy. By adopting the method, the reliability and economy of engineering safety monitoring can be remarkably improved.
Owner:高磊

Unmanned aerial vehicle real-time road condition monitoring method and system and medium

The invention provides an unmanned aerial vehicle real-time road condition monitoring method and system and a medium, the method relates to the field of image data processing, and the system comprises an unmanned aerial vehicle which comprises an image acquisition device and a sensor group and is used for acquiring aerial videos and flight parameters of the unmanned aerial vehicle in real time; the streaming media server is used for receiving and storing the aerial video transmitted by the unmanned aerial vehicle; analyzing the video stream into a frame-by-frame image sequence with aligned timestamps; performing target detection on each frame of image, and identifying a target vehicle by using a pre-trained deep learning model; carrying out target tracking on the target vehicle in the continuous frames based on an intersection-to-union ratio matching and trajectory prediction algorithm, and constructing a target motion trajectory; and calculating the displacement distance of the target vehicle in the image based on an optical flow method, feature point matching and a deep learning algorithm, and estimating the actual running speed of the vehicle in combination with the flight parameters of the unmanned aerial vehicle. According to the system, computer vision and sensor technologies are combined, and accurate speed measurement is realized through target detection, tracking and speed estimation.
Owner:SHANDONG TIANHE XIANGTONG INTELLIGENT TECHNOLOGY CO LTD

Unmanned aerial vehicle shooting system control method based on adaptive optimization

The invention relates to the technical field of unmanned aerial vehicle control, in particular to an unmanned aerial vehicle shooting system control method based on adaptive optimization. A multi-modal semantic map fusing task description, equipment types, geographic positions, historical data, illumination and weather information and image optical flow features is constructed, and an equipment space distribution probability, a shooting difficulty level and key route nodes are obtained by adopting graph neural network reasoning. On the basis, a control strategy candidate set is generated, and optimal shooting parameter configuration is screened out in combination with a Bayesian optimization algorithm. The unmanned aerial vehicle collects multi-source information in real time in the flight process, dynamic fusion is conducted through an attention mechanism, the combined control module is driven to synchronously adjust the attitude of a holder and camera parameters, and accurate imaging control in a complex scene is achieved. And when the recognition confidence is low, triggering a supplementary shooting control mechanism based on the semantic map, and performing local fine tuning to improve the image quality. And the system also continuously updates the control strategy through transfer learning, so that the adaptability to a new task environment is enhanced.
Owner:STATE GRID JIANGXI ELECTRIC POWER CO LTD

Liver focus three-dimensional modeling method

The invention provides a liver focus three-dimensional modeling method, and belongs to the technical field of image processing based on computer vision. Firstly, a multi-view spatial registration method based on optical flow optimization is designed, pixel-level displacement information of different view images is estimated by calculating an optical flow field, accurate image alignment is achieved, and spatial consistency of three-dimensional reconstruction is improved. And secondly, a three-dimensional reconstruction strategy based on two-dimensional focus segmentation is proposed, the two-dimensional focus segmentation is completed by adopting a lightweight U-Net variant, and a segmentation result is mapped to a three-dimensional space through a voxel probability projection method, so that 3D focus reconstruction is realized, and the calculation cost is reduced. And finally, extracting high-frequency features of the three-dimensional model by adopting a local edge enhancement method based on a Laplacian operator, and strengthening a focus boundary and a key anatomical structure through interpolation optimization, so that the three-dimensional model is more accurate and clearer. Compared with a traditional method, the method has the advantages that the mode of purely depending on image superposition is avoided, and the accuracy of three-dimensional modeling is improved.
Owner:QINGDAO MUHUA DATA TECHNOLOGY CO LTD

Multi-scene self-adaptive visual acquisition system and method

InactiveCN120434509AFrequency spectrumOptical flow
The invention discloses a multi-scene adaptive visual acquisition system and method, and belongs to the technical field of image recognition, and the system comprises an environment sensing module which is used for collecting carrier vibration spectrum, multi-band illumination intensity and target depth information in real time; the dynamic zoom imaging module drives the focal length adjustment rate of the lens to be dynamically associated with the frequency of the high-frequency component output by the vibration sensor; and the cooperative control module executes vibration compensation, spectrum fusion and target positioning, dynamically calculates based on an illumination intensity ratio and color temperature, and dynamically configures a target positioning threshold according to a target pixel area. According to the invention, the dynamic correlation vibration frequency and the focal length adjustment rate are utilized, and mechanical anti-shake pre-focusing and electronic anti-shake optical flow methods are matched to realize accurate compensation of low-frequency continuous vibration and high-frequency impact vibration, so that the imaging stability is remarkably improved in a dynamic environment, and the phenomena of image blurring and edge blurring are effectively reduced.
Owner:INNER MONGOLIA VOCATIONAL OF CHEM ENG

Visual inertia mileage pose positioning method based on cross attention and dynamic weight

The invention relates to the technical field of machine vision, and provides a visual inertial mileage pose positioning method based on cross attention and dynamic weight, which performs positioning prediction of visual inertial mileage pose information by means of a visual inertial mileage pose prediction model. In the visual inertial mileage pose prediction model, a cross-modal feature association between a visual optical flow feature and an inertial variable feature is established by using a cross attention mechanism, so that the attention of a space region highly related to inertial variable information in the visual optical flow feature is enhanced; meanwhile, by means of a dynamic weight fusion mechanism, dynamic balance between different modal features is achieved through a learnable weight distribution strategy, the problem of falling into a local optimal solution is helped to be avoided, and the accuracy of visual inertial mileage pose information positioning prediction and the stability and reliability for different scenes are remarkably improved.
Owner:CHONGQING UNIV

Chip bonding wire three-dimensional measurement method and system based on inner cavity reflection camera system

The invention provides a chip bonding wire three-dimensional measurement method and system based on an inner cavity reflection camera system, and relates to the technical field of three-dimensional measurement. The method comprises the following steps: performing one-time exposure imaging on a chip bonding wire to be detected through an inner cavity reflection camera system to obtain at least three mutually independent visual angle images in the same frame; performing brightness normalization compensation and geometric calibration on the visual angle image to obtain a visual angle data set with uniform brightness and correlation; pairing the view angle data sets in pairs, extracting parallax information by using a feature matching algorithm based on optical flow, and fusing multiple pairs of parallax to generate a lead three-dimensional point cloud; performing noise filtering and curved surface reconstruction on the three-dimensional point cloud to obtain a continuous three-dimensional grid model of a lead; and performing texture mapping on the three-dimensional grid model by adopting any visual angle in the visual angle image or the combination of the visual angles, and outputting a lead three-dimensional reconstruction result with textures. According to the invention, high-precision, large-depth-of-field and rapid three-dimensional measurement of the chip bonding wire is realized.
Owner:SHANXI NIER OPTICAL TECHNOLOGY CO LTD

Flow field measurement method based on event camera

The invention discloses a flow field measurement method based on an event camera, and the method comprises the steps: generating a PIV data set, each time sequence sample sequence comprising a plurality of frames of continuous particle images, a corresponding velocity vector field, and particle event data at all moments; establishing a flow field data acquisition device based on an event camera and a high-speed camera, acquiring real event data and real image data which are synchronous in time so as to adjust parameters of an event simulator, and verifying and updating particle event data in the PIV data set according to the adjusted event simulator so as to obtain a flow field data acquisition result; obtaining the updated PIV data set as a training data set; building an event camera optical flow method model, and training by adopting the training data set; and on the basis of the trained event camera optical flow method model, event sequences in two adjacent time periods are used as inputs to calculate a velocity vector field corresponding to a middle moment. According to the invention, the flow field velocity field at the required moment can be obtained based on the event data within a period of time.
Owner:ZHEJIANG UNIV

Panoramic video frame insertion method based on potential diffusion model

The invention discloses a panoramic video frame insertion method based on a potential diffusion model. The method comprises the following steps: compressing an input image to a potential space by using a panoramic perception vector quantization variational auto-encoder to obtain potential features; constructing initial noise, and fusing the motion features extracted by the panoramic optical flow adapter to obtain condition information; performing iterative denoising operation on the potential features of the intermediate frame to obtain final potential features of the intermediate frame; and restoring the final potential features of the intermediate frame into a frame insertion image of a pixel space through a condition decoder. According to the panoramic video frame interpolation method provided by the invention, the potential diffusion model and the panoramic characteristic enhancement technology are combined, so that the perception quality of a frame interpolation result can be remarkably improved, details and complex textures of a pole region can be better reserved, and a high-quality time interpolation solution is provided for immersive panoramic video application.
Owner:HANGZHOU DIANZI UNIV

Intelligent fire safety early warning system for expressway tunnel

The invention relates to the technical field of highway tunnel safety monitoring, and discloses a highway tunnel intelligent fire safety early warning system, which comprises a data acquisition and preprocessing module used for acquiring video monitoring data, environment sensor data and vehicle positioning data in a tunnel in real time; the dynamic risk assessment module is used for constructing a risk field model based on vehicle trajectory and smoke diffusion space-time coupling; the emergency resource elastic adaptation module is used for automatically adjusting the induction screen and the fire fighting equipment according to the risk intensity; according to the method, the limitation of traditional threshold alarm is avoided, fire early warning nodes are greatly advanced through multi-source data dynamic fusion, long-term stability of a monitoring benchmark is guaranteed by utilizing an optical flow compensation and pollution self-repairing mechanism, and the self-adaptive migration of a calculation task is realized by utilizing the optical flow compensation and pollution self-repairing mechanism. And the initiative and reliability of tunnel safety prevention and control are obviously improved.
Owner:Jiangxi Jiaotong Maintenance Technology Group Co., Ltd.

Visual navigation method and system based on improved optical flow method

The invention provides a visual navigation method and system based on an improved optical flow method, and relates to the technical field of computer vision and inertial navigation. A collaborative optimization framework of an inertial navigation system and visual feature navigation is constructed, carrier motion state parameters are obtained through dead reckoning of an inertial measurement unit, variance parameters of pose variation are calculated, and the layering depth of a pyramid LK optical flow method is dynamically adjusted based on the variance parameters. When the inertial navigation output variance exceeds a preset threshold value, the number of layers of an image pyramid is increased to cope with large-range motion, and otherwise, calculation levels are reduced to improve real-time performance. A dual-period optical flow / feature matching tracking mechanism is designed, improved sub-pixel-level optical flow tracking is adopted in a short period, the calculation complexity is reduced while the positioning precision is guaranteed, feature matching is switched to in a long period, accumulative errors are eliminated, and a period parameter N is determined by inertial navigation precision. According to the method, the calculation complexity can be reduced, and a better effect can be achieved on a low-calculation-performance platform.
Owner:THE 54TH RESEARCH INSTITUTE OF CHINA ELECTRONICS TECHNOLOGY GROUP CORPORATION

Monitoring video enhancement method for farm

The invention belongs to the technical field of video processing, and particularly relates to a monitoring video enhancement method for a farm, which aims to solve the technical problem of low quality of an enhanced video in the prior art, and comprises the following steps: S1, processing each frame of image in a monitoring video sequence frame by frame; s2, distinguishing a target animal area from a background area, and identifying and generating an artifact mask; s3, aiming at the background area, carrying out key smoothing processing on the artifact position to inhibit the artifact; s4, for the image of the target animal area, performing adaptive nonlinear enhancement on the brightness component, and performing color correction on the chrominance component; s5, performing pixel-level fusion on the enhanced target animal area and the background area; and S6, spreading the information of the previous frame to the current frame by using the forward optical flow field, and carrying out weighted fusion on the information of the previous frame and the current frame. According to the method, the target bred animals, the background areas and the artifacts are accurately distinguished, so that refined and differentiated processing of pictures is realized.
Owner:EGG NO 1 FOOD CO LTD