7135 results about "Image sequence" patented technology

The invention belongs to the technical field of visual special effects, and discloses an AI visual special effect dynamic generation system fusing multi-modal perception. Through cooperative work of six core modules of multi-modal input processing, importance analysis, parameter configuration, parameterized rendering, parameter optimization and rendering and output, deep fusion of special effects and contents is realized. An image sequence, audio data and scene parameters can be processed at the same time, a multi-modal feature data set is constructed, a scene key visual area is scientifically recognized, a visual importance distribution map is generated, and the special effect parameter configuration and rendering process is guided. An improved neural radiation field technology and a physical constraint model are adopted to ensure the consistency and reality of the special effect at different visual angles; and a multi-dimensional quality evaluation and parameter automatic optimization mechanism is introduced, so that the visual expressive force and the artistic value of the special effect are guaranteed. The creation threshold is remarkably reduced, the cooperative expression ability of the special effect and the content is improved, and the special effect becomes a powerful tool for enhancing the narration and enhancing the emotion.

The invention provides a reconstruction method of a three-dimensional reconstruction model based on two-dimensional Gaussian splashing, which comprises the following steps: S1, carrying out sparse reconstruction on an input image sequence through a multi-view stereoscopic vision algorithm to generate an initial sparse three-dimensional point cloud and a corresponding camera pose parameter; s2, inputting an improved two-dimensional Gaussian radiation field by using the sparse three-dimensional point cloud and the camera pose as information; s3, dynamically screening a visible anchor point subset based on the current view angle parameter, and generating a rendered image through a differentiable rendering pipeline; s4, calculating a loss function of the rendering image of the training track and the input image to optimize a reconstruction scene; and S5, starting a special visualization tool, and inputting a rendering result. According to the method, by introducing a trimmable anchor point parameterization framework and a multi-scale feature fusion mechanism, light-weight and high-precision three-dimensional scene modeling is achieved, and the problems that traditional 2D Gaussian sputtering is insufficient in multi-view geometric consistency, storage overhead and weak texture region reconstruction and an existing 2D Gaussian splashing method is insufficient in self-adaptive mechanism are solved.

The invention relates to the field of defect detection, in particular to a PCB defect detection method and system based on image recognition. The method comprises the following steps: collecting a multidirectional PCB detection image, carrying out pixel-level registration correction and adaptive pixel stability compensation, and constructing a space-time stability compensation image sequence; performing reverse pyramid structure division on the space-time stability compensation image sequence, performing normalized similarity probability calculation, and constructing an initial region classification result; based on an initial region classification result, depth image visual analysis is carried out, pseudo defect comprehensive elimination optimization is carried out, and a pseudo defect purification high-confidence image is constructed; pCB connection defect identification is carried out on the pseudo defect purification high-confidence image, global defect point distribution marking is carried out, and a defect point space distribution diagram is constructed. According to the invention, high-credibility, high-precision and high-closed-loop PCB defect detection is realized.

The invention relates to the technical field of unmanned vehicle control, and discloses a smart city environmental sanitation unmanned vehicle path planning and real-time monitoring method. The method comprises the following steps: firstly, acquiring a multi-source environment sensing data set such as laser radar point cloud data, a camera image sequence and real-time traffic flow information; local road network features are extracted based on laser radar point cloud data, a dynamic target motion prediction map is generated according to a camera image sequence, and real-time traffic flow information is processed to generate a regional traffic efficiency evolution curve. And inputting the data into a path optimization model to generate an initial path sequence, dividing cleaning task priorities, fusing related data and generating a final path planning scheme through a reinforcement learning algorithm. In addition, operation state data of the unmanned vehicle are collected in real time, and a path correction instruction set is generated through an anomaly detection model to update the strategy network. According to the method, the rationality and the operation efficiency of the path planning of the environmental sanitation unmanned vehicle can be improved, real-time monitoring is realized, and the operation safety and the management intelligence level are enhanced.

The invention relates to the technical field of welding defect identification, and discloses a welding defect identification method and system based on a molten pool image. According to the method, a multispectral high-speed camera is used for collecting a molten pool dynamic image sequence in the welding process, after multi-scale morphological filtering preprocessing is conducted, a fusion feature vector is extracted through a depth separable convolutional network, and then the fusion feature vector is input into a defect classification model adopting a heterogeneous graph neural network architecture to obtain a defect probability distribution matrix. Then, constructing a dynamic sparse optimization model to position defects, generating a defect space coordinate set, and finally, outputting welding defect types and position information through hierarchical verification framework processing. According to the method, the problems of welding image noise interference, complex defect characteristics and the like are effectively solved, the accuracy and reliability of welding defect identification are improved, and powerful technical support is provided for welding quality control.

The invention discloses a video super-resolution reconstruction method and system, and relates to the technical field of video restoration processing, and the method comprises the steps: collecting a to-be-reconstructed video frame sequence and a reference frame sequence; extracting a dense optical flow field between the reference frame and the target frame; performing geometric alignment on the target frame to the reference frame according to the dense optical flow field to obtain a motion consistency feature; performing feature extraction on the video frame sequence through a parameterized residual scaling module; inputting the extracted features into a bidirectional propagation module to process forward and backward image sequences respectively, extracting time sequence forward features and time sequence reverse features, and fusing the features to obtain detail features; carrying out adaptive fusion on the motion consistency features and the detail features, and sending the fused features into a reconstruction network to obtain deep visual features; pixel-level adaptive reconstruction is realized according to the deep visual features, and a super-resolution video sequence is obtained; according to the method, the feature space consistency is kept, and meanwhile, the feature matching precision in a complex motion scene is remarkably improved.

The invention provides an unmanned aerial vehicle multi-dimensional information fusion method and system based on acousto-optic-electric composite detection. According to the method, acoustic frequency band signals, visible light image sequences and electromagnetic field intensity change data are collected, acoustic characteristic flow, optical characteristic flow and electrical characteristic flow are generated, and based on the time deviation between a low-frequency vibration mode and transient electromagnetic pulses, multi-channel dynamic calibration is carried out on an image distortion area in the optical characteristic flow. The method comprises the following steps: acquiring an acoustic feature flow, an optical feature flow and an electrical feature flow, correcting space-time coordinate parameters of the acoustic feature flow, the optical feature flow and the electrical feature flow, generating a calibration feature flow, carrying out anti-interference fusion processing on the calibration feature flow, extracting multi-dimensional coupling features, inputting the multi-dimensional coupling features into an unmanned aerial vehicle flight path planning model, and generating a three-dimensional space situation model; according to the invention, the physical space-time consistency alignment and noise suppression of the multi-modal data are realized, and the obstacle positioning precision and the dynamic trajectory prediction real-time performance are significantly improved.

The invention relates to the technical field of rail traffic safety detection, in particular to a railway freight train key part online monitoring system based on an unmanned aerial vehicle, which comprises an unmanned aerial vehicle control module, a multi-modal data acquisition module, an edge calculation module, a central processing module and a feedback execution module. A dynamic three-dimensional grid flight path is generated by fusing a train Beidou positioning signal and a millimeter wave radar sensing result, a system is provided with an infrared thermal imager, a laser radar and a high-speed polarization camera, bearing temperature, train body point cloud and a train coupler image sequence are obtained, and temperature rise area identification, structural deformation extraction and coupling state modeling are completed on the edge side. The central processing module outputs a multi-dimensional safety assessment result, and the feedback module generates a compensation control instruction and a graded early warning signal based on the risk fusion index. The method has the advantages of being high in autonomy degree, high in recognition precision and high in response speed, and is suitable for full-time structural intelligent inspection and early warning of the freight train in a high-speed operation environment.

The invention discloses a railway track damage detection method, and belongs to the technical field of railway track detection. According to the method, an image acquisition module and an ultrasonic detection module are installed at the bottom of a track detection vehicle, the detection vehicle is controlled to run, and track top face and side face image sequences and ultrasonic reflection signals are acquired; preprocessing the image, and respectively inputting the image into a deep convolutional neural network model and a support vector machine classifier to obtain a crack identification result and a wear level; processing an ultrasonic reflection signal, and judging a layering defect; and finally fusing the data, marking a damage position and generating a structured detection report. According to the method, the problems of incomplete detection, low precision and the like in the existing railway track damage detection are solved, efficient detection of track surface cracks, side abrasion and internal layering defects is realized through collaborative acquisition of the multi-modal sensor, intelligent algorithm processing and data fusion, and the comprehensiveness and reliability of detection are improved.

The invention provides a rehabilitation training action evaluation method and device based on multi-view vision. According to the method, a multi-view camera is adopted to synchronously collect a rehabilitation training image sequence, two-dimensional coordinates of key points of a human body are extracted by improving an HRNet deep learning model, three-dimensional reconstruction is performed in combination with a Gaussian process, motion feature data are extracted, and rehabilitation training quality is evaluated. Accurate motion capture without wearing mark points by the patient is realized, the training constraint feeling of the patient is effectively reduced, the rehabilitation evaluation accuracy is improved, and a personalized rehabilitation scheme can be generated.

Image series transformation for optimal compressibility is performed with neural upsampling and error resilience. A novel correlation network composed of convolutional layers for feature extraction that extract multi-dimensional features from the image and a channel-wise transformer with attention to capture complex inter-channel dependencies. An angle optimizer enhances compressibility of an image and an error resilience subsystem improves robustness against transmission errors and data loss. The error resilience subsystem applies forward error correction coding, data partitioning based on importance, and embeds error concealment hints. This hybrid approach addresses both local and global features, mitigates compression artifacts, improves image quality, and enhances data integrity during transmission. The correlation network incorporates error correction and concealment techniques during decoding. The model's outputs enable effective image reconstruction, achieving advanced compression while preserving information for accurate analysis.

The embodiment of the invention discloses an outer wall thermal insulation defect diagnosis method and system based on artificial intelligence, and the method comprises the steps: firstly obtaining an infrared thermal imaging and visible light image sequence of a target building outer wall, the former comprising continuous temperature distribution data, and the latter comprising textural feature data in time-space alignment with the latter; performing dynamic temperature gradient analysis on the infrared thermal imaging image sequence to generate a three-dimensional heat conduction abnormal map, extracting surface deformation characteristics from the visible light image sequence to generate a structure deformation distribution map, and performing multi-modal characteristic fusion on the two to obtain a joint defect characteristic matrix; performing defect type classification and region positioning on the matrix based on a pre-trained deep residual neural network model, outputting a defect type identifier and a corresponding region boundary coordinate, and finally generating a diagnosis report containing a repair priority score and a material matching suggestion according to the defect type identifier and the corresponding region boundary coordinate, and sending the diagnosis report to a user terminal for visual display. And efficient and accurate external wall thermal insulation defect diagnosis is realized.

The invention discloses an adaptive teaching real-time feedback method based on multi-modal fusion, and the method comprises the following steps: synchronously collecting text modal information, voice modal information and image modal information generated by students in a teaching process, forming multi-modal original data information, and extracting historical student interaction behavior data; preprocessing the multi-modal original data information, and respectively generating corresponding text, voice and image sequence features; a visual feature encoder and a sequence feature encoder are adopted to encode each modal sequence feature to obtain a high-dimensional feature; inputting the modal high-dimensional features into a cross-modal fusion network for deep fusion; parameters of the feedback model are optimized through a model-independent element learning feedback regulation and control algorithm, and a personalized feedback strategy is generated; generating comprehensive feature representation according to the fusion features, and outputting personalized teaching feedback; and the interaction information is updated based on the feedback behavior data to realize closed-loop optimization.

The invention provides a human body posture detection method and equipment based on machine vision, which are applied to posture recognition in physical fitness detection, and are used for generating a dynamic human body region set of a target user by acquiring a multi-frame continuous image sequence of a physical fitness training scene and performing human body region positioning processing on the multi-frame continuous image sequence. Performing posture feature extraction processing on the dynamic human body region set to obtain a space-time posture feature set of the target user, performing posture state recognition processing on the space-time posture feature set based on a preset physical fitness evaluation model to generate a posture state recognition result of the target user, and generating physical fitness evaluation parameters according to the posture state recognition result, and the physical fitness evaluation parameters are fed back to the physical fitness training guidance system. According to the method, the identification capability of fine posture change in the fitness action of the complex body can be improved, the synchronous evaluation of the action specification degree and the physiological load state is realized, and the limitation of the traditional single-dimensional action evaluation is broken through.

The invention discloses an end-to-end monocular visual odometer method fusing space-time semantic information. According to the method, continuous image sequence frames are collected through a color monocular camera, and a multi-information fusion end-to-end deep learning framework is constructed; a heterogeneous training domain is adopted to set various data set course sharing parameter fusion training, continuous image sequences are input, and the end-to-end deep learning framework is dynamically coupled with hidden state feature vectors output historically, so that a feature mapping relation of time sequence perception is formed; and interpretable feature decoupling of the static background elements and the dynamic entity objects in the scene is realized. After iterative feature fusion, the system outputs sparse depth and camera motion poses which conform to scene geometric constraints, so that a camera trajectory estimation model with high robustness and strong generalization ability in a complex environment is constructed. According to the method, the positioning precision and stability of the monocular vision odometer are remarkably improved.

A method for early diagnosis of Parkinson's disease based on multimodal deep learning is provided. Audio-visual data of a to-be-diagnosed subject while performing a speech task is acquired. The audio-visual data are preprocessed to extract a plurality of audio segments and a plurality of video segments. A face image sequence is extracted from each of the plurality of video segments. A Mel-spectrogram of each of the plurality of audio segments is calculated. The face image sequence and the Mel-spectrogram are input into a multimodal deep learning model to output a classification result for Parkinson's disease early diagnosis of the to-be-diagnosed subject. A system for early diagnosis of Parkinson's disease based on multimodal deep learning is also provided.

The invention provides a square power battery shell visual defect rapid detection method and system, and relates to the technical field of image processing, and the method comprises the steps: obtaining a high-resolution multi-view image sequence, outputting standardized image data, carrying out front visual scratch detection, outputting scratch defect positions and features, and outputting defect candidate regions containing confidence scores; and recognizing bubble defects, summarizing recognition results of the defect candidate areas, and generating a labeling image. The method solves the problems that in the prior art, due to the fact that multi-view image information is not fully fused, traditional scratch detection depends on a single edge feature, and a main defect recognition model is insufficient in recognition capacity for tiny defects such as bubbles, defect detection accuracy is low, missing detection and false detection phenomena are serious, and detection efficiency is high. According to the method, the problems that the defect is difficult to comprehensively and accurately locate and classify in the prior art are solved, the multi-view information fusion capability and the identification accuracy and detection efficiency of multi-class defects are improved, and high-precision, comprehensive and real-time quality monitoring of defect detection results is realized.

The invention provides an artificial intelligence-based ultrasonic image data classification method and system, and the method comprises the steps: firstly obtaining a real-time ultrasonic scanning signal sequence containing the time sequence change characteristics of a tissue elastic parameter and a hemodynamic parameter, carrying out the noise suppression and motion artifact compensation processing, generating a standardized ultrasonic image sequence, and marking the coordinates of an anatomical boundary; then performing multi-scale anatomical structure decomposition on the ultrasonic image to obtain a local feature map set of different organization levels, inputting the local feature map set into a cascade deep classification network, and realizing cross-frame feature fusion and dynamic weight adjustment through spatial-temporal feature alignment and a multi-granularity attention distribution module to obtain a spatial-temporal feature fusion model; and the abnormal region classification probability distribution and the spatial topological relation graph are output, finally, a multi-modal diagnosis report is generated according to the abnormal region classification probability distribution and the spatial topological relation graph, an interactive three-dimensional visual interface containing risk level labels and treatment suggestions is generated after the multi-modal diagnosis report is compared with historical cases, and ultrasonic image classification accuracy and diagnosis efficiency are improved.

The invention provides a magnetic core intelligent cutting parameter self-adaptive optimization system based on multi-mode perception, and relates to the technical field of data processing.The method comprises the steps that a multi-mode sensor module is integrated on magnetic core cutting equipment, and the module comprises a force sensor, a visual sensor and a temperature sensor; the acquisition units are respectively used for acquiring cutting force dynamic signals, cutting track image sequences and cutter temperature time sequence data in real time; magnetic core surface texture features and three-dimensional contour data are captured through a visual sensor, and an initial cutting parameter set is generated in combination with a magnetic core material type recognition result, associated parameters in a historical process database and preset process constraint conditions; and first workpiece trial cutting is executed based on the initial cutting parameter set, multi-modal data fusion collection is synchronously started, cutting force frequency domain feature vectors, a tool temperature change rate curve and cutting surface defect image features are obtained, and multi-modal data are obtained. According to the invention, multi-objective collaborative optimization of processing efficiency and energy consumption is realized.

The invention relates to the technical field of crop disease recognition, in particular to a crop early disease recognition method and system based on time sequence feature fusion, and the method comprises the steps: obtaining an RGB image and a temperature feature image of a target leaf, and collecting multispectral feature data through a spectral imaging device; based on the time sequence image sequence, generating a coordinate transformation matrix of the first frame image by using a PnP algorithm, and aligning subsequent images according to the coordinate transformation matrix; multi-modal features are extracted by using a deep neural network, and the deep neural network comprises a 3D convolutional layer and an adaptive attention mechanism and is used for extracting features of space and time dimensions; realizing cross-modal feature fusion through a graph convolutional network based on the spectral data and the multi-modal features; inputting the fused features into a classifier, and generating the disease category and the disease severity of the target leaf based on the output of the classifier; outputting the disease transmission risk and the early warning result, and capturing the tiny dynamic change in the disease development process.

The invention relates to the technical field of traditional Chinese medicinal material defect detection, in particular to a traditional Chinese medicinal material defect detection method based on vision, which comprises the following steps: regularly acquiring a time sequence image of a traditional Chinese medicinal material sample, acquiring a multi-view image, carrying out pixel alignment on the time sequence image, and carrying out structured organization on the multi-view image according to a shooting direction to associate camera parameters; and generating a registration time sequence image sequence and a multi-view image set. According to the method, the time sequence images of the traditional Chinese medicine samples are collected regularly, pixel alignment is carried out, image offset caused by environment illumination fluctuation and equipment jitter is eliminated, and time-space consistency of dynamic variable quantity calculation is ensured. Structured organization is carried out on multi-view-angle images according to shooting directions, camera parameters are associated, a geometric constraint relation between view angles is established, and the problem that three-dimensional reconstruction precision is insufficient due to view angle isolation in a traditional method is solved.

The invention provides a self-adaptive scene analysis and target generation method and system based on deep learning, and relates to the technical field of computer vision, and the method comprises the steps: extracting the depth information of a scene image sequence, constructing three-dimensional point cloud data, calculating the distance and direction matrix between objects, and generating a scene space feature vector. Meanwhile, a semantic label graph is obtained through semantic segmentation, a semantic incidence matrix is constructed, and a scene semantic vector is calculated. Inputting the two into a variational auto-encoder to obtain a target feature vector, calculating an attention score based on the target feature vector, and generating a target description vector with a weight; and finally, target contour features are generated through a probability graph reasoning network, and a final target result is generated in combination with the regional attention graph. According to the method, the accuracy and efficiency of target generation are improved.

The invention provides a photovoltaic module fault detection system, method and device based on infrared image hot spot detection, and a storage medium, and belongs to the field of photovoltaic module fault detection. The system comprises a temperature difference boundary extraction module, an image sequence registration module, a hot spot track identification module, an abnormal dynamic screening module and a fault hot spot confirmation module. Pixel difference screening is carried out by setting a temperature difference threshold value, a boundary communication structure is established, frame-level displacement calculation between time sequence images is introduced to realize coordinate alignment, hot spot center points in continuous frames are extracted to form a motion path, abnormal point screening and time node labeling are carried out in combination with path displacement characteristics, and the time sequence image is obtained. According to the method, the boundary area growth rate and temperature change double factors are fused to screen fault areas, dynamic tracking and accurate detection of abnormal hot spots are achieved, the logic relevance between abnormal behavior recognition and fault judgment is enhanced, and the integrity of photovoltaic module fault information extraction and the accuracy of hot spot recognition are guaranteed.

The invention discloses a three-dimensional Gaussian sputtering method for sparse visual angle semantic priori. The method comprises the following steps of: 1, acquiring a target scene image, constructing a real image set as a data set, and manually selecting an interested object in a target scene to perform semantic three-dimensional reconstruction to obtain an initial semantic image of a sparse view angle; a multi-view image is collected, camera external parameters and scene sparse point clouds are obtained, a plurality of views are selected and input into the SAM2 segmentation model, and a view set Is with semantic images is obtained; 2, using a pre-trained SAM2 segmentation model as an interactive image sequence segmentation model, and initializing a three-dimensional Gaussian primitive according to the scene sparse point cloud; and step 3, training parameters of semantic three-dimensional Gaussian sputtering based on the trained three-dimensional Gaussian sputtering model and the interactive image sequence segmentation model, and reconstructing a target scene. According to the method, the high-quality semantic model is efficiently reconstructed. And the reconstruction result can be easily corrected through the interactive graphical interface in the training process.

The invention relates to the technical field of mechanical arm control, in particular to an unmanned aerial vehicle mechanical arm control system for power transmission line inspection. The method comprises the following steps: the distortion correction module is used for collecting and processing a patrol video and generating a corrected image sequence, the pose estimation module is used for performing three-dimensional pose estimation on a corrected image and performing motion trail fitting, and the extension evolution module is used for performing entity reconstruction and extension evolution on a fitting trail, so as to obtain a corrected image sequence; the extension trajectory data generation module is used for generating extension trajectory data, the constraint analysis module is used for performing constraint analysis based on a trajectory model, generating a feasible trajectory and synchronizing with an inspection video to obtain a synchronous trajectory positioning point, and the control planning module is used for performing inspection route planning according to the feasible trajectory and controlling an unmanned aerial vehicle mechanical arm in real time to complete an intelligent inspection task. According to the invention, the reliability of unmanned aerial vehicle inspection is improved.

The invention relates to the technical field of quality monitoring, and discloses a diamond high-strength micro-powder quality detection method and system based on artificial intelligence. The method comprises the steps of obtaining a two-dimensional projection image sequence of diamond micro-powder particles, calculating a projection matrix based on camera calibration parameters and geometric constraints, obtaining a multi-view image data set of the particles, establishing a pixel-level corresponding relation, extracting three-dimensional space coordinates of the surfaces of the particles, and reconstructing dense point cloud data of the particles. Establishing a local coordinate system based on the dense point cloud data, determining attitude parameters of particles in a three-dimensional space, if the attitude parameters deviate from a normal range, performing attitude compensation processing to obtain standardized point cloud data, and performing three-dimensional grid model construction on the standardized point cloud data; and calculating geometrical characteristic parameters of the particles based on the three-dimensional grid model, performing defect detection on the surfaces of the particles, and generating a crystal integrity evaluation report of the particles. The quality detection accuracy of the diamond high-strength micro-powder particles is improved.

The invention discloses a voice interaction method and device based on lip language enhancement, equipment and a storage medium, and the method comprises the steps: extracting lip language features based on an image sequence of a lip region, and carrying out the feature extraction of a voice signal, and obtaining an audio feature; performing cross-modal fusion coding on the lip language features and the audio features to generate mixed features containing audio-visual information; inputting the mixed features into a large language model, understanding the intention of the interaction object and generating a corresponding semantic reply; and finally, synthesizing into voice and / or converting into characters. According to the invention, by introducing the lip features, additional visual clues are provided for speech recognition, and the robustness and accuracy of speech recognition can be significantly improved; effective fusion coding is carried out on the lip language features and the sound features, and semantic information splitting caused by simple and independent recognition is avoided; and the capability of the large model is fully utilized, so that more natural and more intelligent interaction experience is realized.

The invention relates to the technical field of image recognition, in particular to an image processing method and system for rehabilitation training action analysis. According to the method, a multi-view image sequence is collected based on a binocular camera device, skeleton key point data of a user in a training process is extracted by utilizing a three-dimensional attitude reconstruction technology, and an action three-dimensional time sequence data set is constructed. The method comprises the following steps: firstly, constructing an individual standard power generation characteristic model of a user, modeling a skeleton driving path of a main muscle group, and forming a personalized power generation reference structure; and then a standard rehabilitation action path is matched through a dynamic time warping algorithm, and the attitude deviation under the key frame is identified. And the system dynamically compares the identified non-standard motion mode with the individual model, judges whether abnormal force generation exists or not and outputs the type and the part of the muscle compensation behavior. And finally, multi-modal feedback information with highlighted graphs, voice prompts and character suggestions is generated in combination with an identification result, so that the identification precision and personalized guidance capability of rehabilitation training are remarkably improved.

The invention provides an intelligent event identification method and system based on a high-speed camera, and the method comprises the steps: setting the collection parameters of the high-speed camera, and triggering the camera to collect a target scene video stream. And hardware acceleration decoding processing is carried out on the collected original video data stream, real-time environment illumination information of the environment illumination sensor is obtained, and dynamic brightness equalization processing is executed. And performing motion adaptive denoising processing on the video sequence. Geometric distortion correction is carried out on the image sequence through camera calibration parameters, sub-pixel-level displacement vectors and dense optical flow field data of a moving object are extracted, and multi-scale morphological features are extracted. And the features are fused to generate motion feature data, the data are processed through a spatio-temporal joint event classification model, an event identification result is output, the result is bound with a high-precision timestamp, and event identification information is output to an industrial control system display device in real time. According to the invention, the accuracy and real-time performance of event identification can be improved.

The invention discloses a light guide plate defect detection method and system based on a neural network, and particularly relates to the technical field of machine vision detection, and the method comprises the following steps: aiming at the problem of image instability of a light guide plate in a dynamic transmission or rotation process, continuously collecting an image sequence and extracting time domain features; and performing interference judgment in combination with the inter-frame consistency prediction coefficient and a first threshold to realize accurate identification of the abnormal image frame. For an abnormal image frame, further correcting the recognition credibility of the abnormal image frame by adopting a confidence adjustment and fusion mode, and meanwhile, introducing a frequency domain transformation and image enhancement strategy to compensate detail loss caused by motion blur; according to the method, inter-frame consistency analysis, confidence fusion regulation and control and frequency domain fuzzy recognition and compensation mechanisms are introduced, abnormal judgment and image quality restoration of the light guide plate image in the dynamic scene are realized, the recognition accuracy and stability of the neural network model on the defect type, position and confidence are improved, and the false detection and omission ratio is effectively reduced.