1613 results about "Colour image" patented technology

The invention provides an aluminum alloy surface oxidation spot defect identification method and device based on machine vision, and relates to the field of intelligent manufacturing and industrial automation, and the method comprises the steps: obtaining an aluminum alloy surface color image, and carrying out the preprocessing of the image, so as to extract a brightness component image; self-adaptive threshold segmentation of local contrast enhancement is carried out on the brightness component image, a defect area binary mask is generated, morphological connected domains are extracted according to the mask, and three basic feature indexes of the area pixel value, the contour Fourier descriptor complexity and the area gray scale standard deviation contrast of each connected domain are calculated; and extracting and marking a connected domain boundary, verifying a boundary closed topological structure, and dynamically generating a curvature-driven self-adaptive sampling point through multi-scale B-spline curvature extreme value detection. Through optical-algorithm-process three-level collaborative innovation, the curved surface reflection false alarm rate is reduced, the pinhole detection rate is increased, and the boundary precision is + / -0.2 pixel.

The invention provides a self-adaptive nonlinear image enhancement method and system for a low-light scene of a mobile terminal, and relates to the technical field of image enhancement, and the method comprises the steps: carrying out the image preprocessing and noise reduction, and carrying out the graying and noise suppression of an input color image through a local variance self-adaptive algorithm; adaptive down-sampling is carried out, and the down-sampling proportion is dynamically adjusted according to the image resolution and the content complexity, so that the processing efficiency is improved; brightness adaptive enhancement is carried out, and the overall brightness of the image is rapidly improved by adopting an Otsu method and a lookup table; contrast nonlinear enhancement: enhancing image details and contrast in combination with a Laplace operator and local mean adjustment; and color restoration: restoring the resolution through bilinear interpolation and performing weighted fusion to realize natural color reconstruction. And finally, a high-quality image of which the brightness, the contrast ratio and the color are remarkably improved is output. According to the invention, the recognition accuracy and processing efficiency of the low-illumination image are improved.

The invention relates to the technical field of foamed silicone rubber surface detection, and discloses a foamed silicone rubber surface detection method based on image visual identification, which comprises the following steps: acquiring a color image of a foamed silicone rubber surface, carrying out graying and normalization processing, and generating a diffuse reflection effective detection area by using a polarization filter difference technology; color abnormity is detected based on an image gridding and gray statistical method, meanwhile, pore and microbubble defects are detected in combination with minimum value seed point extraction and an eight-neighborhood region growing algorithm, finally, various masks are fused, the defect area and number are counted, and a quality inspection report is generated; the method can effectively inhibit highlight interference and accurately identify uneven colors and pore microbubbles, the detection process does not need external training, calculation is efficient, and the method is suitable for rapid detection and quality control of surface defects of foamed silicone rubber.

The invention provides a depth map generation method and device based on a large model, a three-dimensional reconstruction method and device, electronic equipment and a storage medium, relates to the technical field of artificial intelligence, in particular to the technical fields of computer vision, deep learning, large models and the like, can be applied to real-time road scene depth perception, environment three-dimensional reconstruction and obstacle avoidance, and can be applied to real-time road scene depth perception. And virtual and real scene fusion and other scenes can be realized. The specific implementation scheme is as follows: performing visual coding on a monocular image to obtain a coded image; inputting the coded image and the target text into a pre-trained large language model for fusion to obtain fusion features; generating global guide features based on the fusion features, wherein the global guide features comprise joint semantic information of visual features and text features; adding noise to the color image of the monocular image to obtain a noise feature sequence; de-noising the noise feature sequence under the condition of the global guide feature, and generating an implicit feature matched with the joint semantic information; a depth map is generated based on the implicit features.

The invention discloses a multi-mode teenager idiopathic scoliosis screening method based on a back RGB-D image, and belongs to the technical field of image processing and scoliosis screening, and the method specifically comprises the steps: collecting an RGB-D image pair of a subject in an Adams anteflexion posture, carrying out the manual marking of an RGB color image, constructing and training a back key point detection model, and carrying out the detection of the back key point. And establishing a calculation rule of a maximum trunk rotation angle, a minimum trunk rotation angle and a back contour asymmetry index, and establishing an AIS classification rule based on the RGB-D data set, thereby completing AIS classification of the to-be-detected subject. According to the non-contact radiation-free AIS screening method, comprehensive utilization of back two-dimensional and three-dimensional information is achieved by means of data complementation of the RGB mode and the D mode, the problem of feature deficiency in a single mode is solved, and the method has the advantages of being fast, efficient, robust and objective.

The invention provides a commodity identification method and device, and the method comprises the steps: carrying out the multi-view collection and preprocessing, and constructing a second color image set and a depth image set; performing three-dimensional reconstruction and volume estimation based on the second color image set and the depth image set, and judging a commodity packaging form; extracting a commodity packaging semantic and price information area based on the second color image set, constructing a space-semantic joint code, and generating global packaging semantic features; based on the second color image set, a multi-view visual coding network is adopted, and a visual prediction SKU index is output; carrying out structure-semantic fusion modeling based on multi-source heterogeneous features, and outputting commodity category labels; and matching a commodity price based on the commodity category label, generating an interaction prompt sign in combination with a confidence threshold, and triggering interaction feedback. According to the invention, commodity vision, space and price activity information are fused, the identification accuracy and price verification intelligence are improved, and the method is suitable for the field of intelligent cashier and retail automation.

The invention relates to the technical field of computer vision and three-dimensional space modeling, and discloses a real-time multi-instance segmentation method and device based on a Gaussian splash radiation field model. The method comprises the following steps: based on a two-dimensional Gaussian splash radiation field model, rendering a visual angle with continuous spatial change to obtain an image sequence, and obtaining a multi-visual-angle consistent two-dimensional instance segmentation mask of the image sequence; and assigning an instance tag to each Gaussian primitive based on the two-dimensional instance segmentation mask. And for a two-dimensional Gaussian splash radiation field model with an instance label, acquiring a coarse instance segmentation mask and a color image at any view angle by using a Gaussian splash algorithm, inputting the mask and the image into a lightweight post-processing network for edge detection and region connectivity repair, and outputting a target two-dimensional instance segmentation mask with a complete structure and a label consistent with a three-dimensional scene. The method does not depend on any training or distillation process, directly acts on a Gaussian splash radiation field model, and has the advantages of high reasoning speed, high semantic consistency, support of multi-target continuous tracking and the like.

An image processing method, performed by a computer device, comprising: extracting sketch texture features at multiple scales from a sketch image; extracting image noise features at multiple scales from preset noise; determining color guide information corresponding to the sketch image; encoding, for each scale, a noise feature based on a sketch texture feature and the color guide information to obtain multi-scale image features; and performing multi-scale decoding on these image features to obtain a colored image comprising a sketch texture corresponding to the sketch image and a color based on the color guide information. A related training method and apparatus are also provided to develop models for this image processing technique.

The invention relates to the technical field of automatic spraying, and particularly discloses a spraying system based on multi-modal vision and artificial intelligence self-correction, comprising a multi-modal vision acquisition module for acquiring color image information, depth information and infrared feature information; the control module is used for generating a spraying sensing model according to the information of the multi-modal visual acquisition module; the control module carries out spraying area identification, track planning and spraying parameter decision making based on the spraying sensing model; the spraying execution module is used for spraying; and the feedback self-correction module iterates the spraying parameter decision in the control module based on a reinforcement learning algorithm according to the difference between the actual coating state information and the expected state. The control method based on multi-modal vision and artificial intelligence self-correction is applied to a spraying system based on multi-modal vision and artificial intelligence self-correction. The scheme is used for solving the problems that the spraying quality of complex workpieces is not high due to the single sensing dimension of an existing spraying system, and the production flexibility is poor due to the rigid control mode.

The invention discloses an electronic cabin assembly quality detection method based on three-dimensional vision. The method comprises the following steps: firstly, generating data for comparison during detection for a standard electronic cabin; shooting all to-be-detected objects in the to-be-detected electronic cabin to obtain a depth image and a color image of each to-be-detected object; according to the depth image and the color image of the to-be-detected object, combining with the data of the standard electronic cabin for comparison during detection; and whether screws of the electronic cabin to be detected are neglected and not installed in place, whether cable plugs are neglected and not installed in place, whether connectors and cable plugs in the wiring unit are wrongly matched, and whether the bending radius of cables is too small are detected in sequence. Through fusion of depth information, three-dimensional quantitative detection of the assembly quality is realized, and the detection precision, reliability and automation level are significantly improved.

The invention provides a real-time human body detection method and system based on a microwave radar, and is applied to the field of signal data processing. By constructing a sparse reconstruction model and combining multi-dimensional feature decomposition, the method effectively relieves the recognition difficulty caused by target signal aliasing, continuously outputs and receives radar signals, extracts distance, Doppler and angle features, constructs target distribution point clouds in a three-dimensional feature space, further utilizes angle continuity judgment and point cloud density analysis, and improves the recognition accuracy of target distribution point clouds. According to the method, the number and distribution of overlapped targets are accurately estimated, a Kalman filter is introduced for dynamic tracking for a scene in which a continuous area is not formed, continuous separation and pseudo-color image reconstruction of multiple targets are realized, and thus the resolution precision and target positioning capability of a radar in a multi-person close-range aggregation scene are remarkably improved.

The invention discloses an uncertainty mapping method and device based on selective learnable depreciation, and the method comprises the steps: S1, collecting color images and depth maps at different time points, and projecting the color images and the depth maps to a three-dimensional coordinate system; s2, predicting an evidence vector for each pixel by using an evidence generation network; s3, calculating total evidence intensity based on the evidence vector, and defining credibility and uncertainty based on the total evidence intensity; s4, constructing a noise mask to represent the observation quality, and predicting a damage coefficient by using a selective damage network; s5, the evidence intensity is adjusted in a zooming and depreciation mode; and S6, outputting a final probability, carrying out basic probability distribution of multi-frame fusion observation on the three-dimensional voxel grid, and constructing a semantic map containing uncertainty estimation. According to the method, the conflict rate and uncertainty in the semantic map fusion process can be effectively reduced, and the accuracy and credibility of the map are remarkably improved.

The invention discloses an AI-based child story video generation method and system, and relates to the technical field of artificial intelligence and multimedia crossing, and the method comprises the steps: generating a script from an original text input by a user through constructing an AI model fusing an emotion modeling capability; constructing an image generation combination model, defining a joint loss function, calculating an edge intensity graph of the contour image by using a Sobel edge detection algorithm, calculating an optical flow field of frame change by using a block matching algorithm, and performing color image dynamic frame alignment; a fine tuning WaveNet model is used to generate audio; through constructing an image generation combination model, combining a StyleGAN3-T model and an LDM model, defining a joint loss function, and using a Sobel edge detection algorithm and a block matching algorithm to calculate an edge intensity graph and an optical flow field, dynamic frame alignment of a color image is realized, and inter-frame continuity of a generated video is improved.

The invention discloses a LiDAR-IMU-camera tight coupling positioning and mapping method and device for a mobile platform, and belongs to the technical field of robot SLAM. Synchronously triggering the color camera, the laser radar and the IMU through hardware, and unifying timestamps; performing compensation and distortion removal on the laser point cloud motion by the IMU data; based on curvature, intensity and density self-adaptive downsampling, local plane fitting errors are used for distributing observation weights; the IMU pre-integration pose is used as an initial value, point-to-surface registration of the weighted point cloud and the local map is carried out, and a laser-IMU tight coupling odometer factor is obtained; the color image and the laser intensity graph are fused into a multi-mode loopback descriptor, and loopback factors are generated through global retrieval and geometric verification; and inputting an odometer, an IMU, a laser loopback factor and a visual loopback factor into an increment factor graph optimizer, jointly solving a global optimal key frame pose, and outputting a dense laser point cloud map and a color visual point cloud map. The method can be operated in real time on an embedded platform, effectively inhibits drifting, and realizes centimeter-level global consistent positioning and mapping.

The invention relates to the technical field of liquid crystal display, and provides liquid crystal display equipment based on a field order and a color image display method. An image to be displayed can be decomposed into three sub-frames based on a field sequential display technology, each sub-frame corresponds to a color field, when a liquid crystal panel is driven according to a main color gray scale value of the color field corresponding to each sub-frame, at least one backlight source corresponding to each color field is firstly driven to emit backlight of a first duration within a time period when liquid crystal molecules reach a steady state, and then the backlight source corresponding to each color field is driven to emit backlight of a second duration within a time period when the liquid crystal molecules reach the steady state. The white light of the second duration is emitted after the first duration, so that the white light is added in the backlight lightening stage of each color field, the color gamut range of the color field corresponding to each sub-frame is effectively reduced, and the color separation phenomenon is reduced. In addition, each subframe corresponds to a single color field or a mixed color field, so that the color separation phenomenon in various algorithms can be improved.

The invention discloses an indoor scene three-dimensional reconstruction method based on deep fusion and confidence modeling, and belongs to the technical field of computer vision. According to the method, composite data frames such as a color image, a depth map, an IMU (Inertial Measurement Unit) and a camera attitude are comprehensively utilized to carry out regional three-dimensional reconstruction on an indoor scene: firstly, the scene is divided into a smooth region (such as a wall, a ground, a ceiling, a glass plane, a mirror surface, a blackboard and other planes) and a complex curved surface region; aiming at the smooth area, adopting geometric prior guide plane fitting provided by a visual large model, and combining sensor attitude information to quickly reconstruct a regular plane model; for a complex curved surface area, a multi-frame point cloud fusion strategy is adopted to accumulate different view angle information, and a deep residual error refining network is utilized to recover curved surface details, so that a high-precision curved surface model is obtained. According to the method, the three-dimensional structure of the indoor scene can be efficiently reconstructed, the global framework of the smooth area is reserved, and the details of the surface of a complex object are depicted in detail.

The invention discloses a railway cargo grabbing method based on improved YOLO and depth map processing, and the method comprises the steps: collecting a color image and a depth image of a target scene through a camera, inputting the color image into an improved YOLOv8 model, and obtaining a mask image; performing registration processing on the mask image by using the depth image to obtain a plurality of alternative target areas; performing three-dimensional statistical analysis on each alternative target area, and screening all the alternative target areas to obtain an effective target area; and selecting a plurality of candidate edge points in the effective target area, performing screening according to the score of each candidate edge point, and obtaining a grabbed area according to the screened candidate edge points. According to the embodiment of the invention, accurate identification and positioning can be carried out on railway goods in a complex scene, so that the robot grabbing efficiency and success rate in a railway freight scene are improved.

The invention discloses an object three-dimensional reconstruction method, device and system based on deep learning. The reconstruction method comprises the following steps: acquiring a multi-view color image of an object through a controllable image acquisition device; reconstructing a sparse three-dimensional point cloud by using a motion recovery structure method and obtaining a camera pose; initializing parameters of the three-dimensional Gaussian sputtering model based on the sparse point cloud and performing training optimization; a target object semantic segmentation data set is constructed, and a low-rank adaptive technology is adopted to finely segment all models; generating prompts through an open vocabulary detection model at each view angle, obtaining an accurate segmentation mask, and optimizing a three-dimensional segmentation weight by adopting a joint loss function fusing color consistency loss and edge perception loss; and finally outputting the color three-dimensional point cloud of the target object. According to the method, the original image is segmented, so that the influence of the quality of the rendered image is avoided; the segmentation precision of the model in a specific scene is improved through field adaptive fine tuning; and the accuracy of the segmentation boundary is ensured by adopting a double-loss joint optimization mechanism.

The invention provides a steel plate surface defect detection method and system based on multi-source data fusion, and relates to the technical field of steel production automatic detection.The method comprises the steps that water stain pretreatment is conducted on the surface of a steel plate, the residual humidity is reduced to be below a preset low humidity threshold value, and a dry surface is obtained; based on the dry surface, collecting multi-source data through a 3D laser line scanning camera and a 2D industrial line scanning camera which are synchronously triggered, obtaining line scanning laser point cloud data, a line scanning reflectivity gray level image, a line scanning depth gray level image and an area array reflectivity color image, and establishing a space corresponding relation among the multi-source data; and forming a multi-source data set based on the spatial correspondence among the multi-source data. According to the method, a high-precision and high-robustness steel plate surface defect detection system covering the whole detection process is constructed by eliminating water stain interference, unifying a multi-source data reference, optimizing data quality, accurately identifying defects and realizing automatic feedback and data closed loop.

The invention discloses a motor fault diagnosis method and system based on color image fusion symmetric point mode, and the method comprises the steps: converting a vibration signal and an electromagnetic signal of a motor into symmetric point mode images, and generating a color signal image fusing feature information; respectively abstracting the color signal images fused with the feature information into nodes and edges in a high-dimensional semantic space so as to construct graph structure data; and performing diagnosis classification on the graph structure data of the vibration signals and the electromagnetic signals by using respective capsule graph network models, and fusing diagnosis classification results of the vibration signals and the electromagnetic signals through a voting mechanism to obtain a final diagnosis classification result. According to the method, multi-channel time domain signals are converted into image expressions with dense information and consistent geometry, and unified feature modeling is carried out on the images based on a depth map structure network with topology perception capability, so that motor fault diagnosis with high diagnosis precision and strong robustness is realized.

The invention relates to a multi-unmanned aerial vehicle cooperative positioning method and system for target tracking. The method comprises the steps of determining a first relative position parameter between an unmanned aerial vehicle and a target object under a local coordinate system based on a received color image and a depth image; based on the state parameters of the unmanned aerial vehicles, establishing a dynamic model suitable for the multi-unmanned aerial vehicle system; obtaining a position change parameter through the VIO to determine a relative displacement measurement value between the unmanned aerial vehicles; the relative distance between the unmanned aerial vehicles is measured through UWB and is filtered, and a second relative position parameter between the unmanned aerial vehicles is determined; establishing a Kalman filter based on the first relative position parameter and the second relative position parameter, and estimating the relative position between the unmanned aerial vehicles; and enabling the unmanned aerial vehicle to selectively fuse measurement data of neighbors, and cooperatively estimating the positions of the unmanned aerial vehicle and the target object by using an event-triggered DKF method. Compared with the prior art, the method can overcome the problem of positioning dependence in a complex environment, and improves the reliability of the collaborative surrounding target.

The invention provides a focusing method, device and equipment. The method comprises the following steps: determining pixel offset between a red channel image and a green channel image of a tissue slice; the red channel image and the green channel image are a red channel image and a green channel image of a tissue slice in a ghosting image captured by the color image sensor when a red light filter, a green light filter and double optical wedges in the focusing module are modulated at the same time; determining an out-of-focus distance according to the pixel offset and a preset corresponding relation; the preset corresponding relation is the corresponding relation between the pixel offset and the defocus distance; and focusing according to the out-of-focus distance. According to the method provided by the embodiment of the invention, the problem that positive and negative defocusing directions cannot be distinguished through a single-frame image in a phase shift detection automatic focusing technology based on image monochromatic double-hole modulation is solved, and the problem of time waste caused by high-speed switching of an illumination light source in an automatic focusing technology based on red-green double-LED illumination is solved; and meanwhile, the problem that a phase shift detection automatic focusing technology based on pupil segmentation images is relatively small in focusing range is solved.

The invention discloses an intelligent robot navigation system with a body based on a multi-modal large model, and the system comprises an RGB-D camera module which captures a color image and a depth image of an environment in real time, and carries out the preprocessing of the color image and the depth image, and outputs the preprocessed image; the laser radar SLAM module provides a basis for subsequent coordinate calculation and navigation path planning; the multi-modal VLM module is used for calculating the three-dimensional coordinates of the target location in the map; and the navigation control module controls the robot to move. The beneficial effects of the invention lie in that the system realizes efficient environmental perception and natural language understanding through multi-modal fusion, and can accurately identify a target location, calculate a three-dimensional coordinate and plan a safe path, thereby improving the autonomous navigation precision and reliability of the robot, and being suitable for intelligent movement control in a complex scene.

The invention relates to the technical field of computer vision, and discloses a jade defect intelligent detection method and system based on machine vision and deep learning, and the method comprises the following steps: S1, based on a high-resolution industrial camera and a laser three-dimensional scanner, adopting a multi-mode synchronous collection strategy, and rotating a jade sample through a precise motion control system, a jade surface high-resolution two-dimensional color image and high-precision three-dimensional point cloud data are respectively obtained, and a jade multi-mode original data set is generated. A high-resolution two-dimensional color image and high-precision three-dimensional point cloud data are integrated through a multi-modal synchronous acquisition strategy, and multi-dimensional feature expression under unified coordinates is constructed, so that the limitation of a single data source is effectively overcome; an image registration algorithm and a feature pyramid network are combined with a point cloud network to perform multi-modal feature fusion, complementarity of color texture and geometric morphology information is enhanced, and image quality is optimized based on adaptive histogram equalization and non-local mean filtering.

The invention belongs to the field of machine vision, and relates to a novel circle detection method in a complex environment. The method comprises the following steps: firstly, preprocessing an input color image, converting the color image into a grayscale image, then performing Gaussian blur processing, and applying a Canny edge detection algorithm to obtain an edge image; then, a findContours function of OpenCV is used for detecting a contour in the edge image, and traversal processing is carried out on the contour; secondly, circle detection is conducted on each contour through a findcircle () function, and circle fitting is conducted through a three-point circle determination method or a least square circle fitting method; performing accuracy verification on the fitted circle; and finally outputting the number and parameters of the identified circles, such as circle center coordinates and radiuses. The method is low in operand, can rapidly and accurately detect a circle in a complex environment with a weak light source and noise, does not need to occupy high computing resources, and has high detection speed and precision.

The invention discloses an SAR image orientation sensitive target detection method based on sub-aperture image saturation characteristics, and belongs to the technical field of synthetic aperture radar image target detection. The azimuth sensitive target detection is realized through the following steps: 1) sub-aperture image generation: dividing an azimuth frequency spectrum into a plurality of sub-bands, and generating a plurality of sub-aperture images through inverse Fourier transform; 2) color synthesis and feature extraction: allocating different hues to each sub-aperture image by using an HSV color space, synthesizing an RGB color image, converting the RGB color image to the HSV color space, and extracting a saturation channel in the RGB color space as an azimuth sensitivity feature map; and 3) target detection: carrying out threshold segmentation on the saturation feature map, and identifying a pixel region with a high saturation value, namely, an orientation sensitive target. According to the method, the color saturation change caused by the scattering difference of the target in different sub-apertures is utilized, effective detection of azimuth sensitive targets such as artificial buildings and vehicles is achieved, and the method has the advantages of being simple in calculation and high in robustness.

The invention relates to the technical field of image processing, and discloses a pitaya fruit pose estimation method based on point cloud three-dimensional reconstruction. The pitaya fruit pose estimation method comprises the steps that RGB color images and depth images of pitaya fruits are collected, expanded and marked; the DeepLabV3 + network model is improved and trained, and then an RGB color image is segmented; segmenting the depth image by using the semantic segmentation mask image, then matching the depth image with the RGB color image to obtain a pitaya tree point cloud, and preprocessing the pitaya tree point cloud; registering the pitaya fruit tree point cloud by using an improved point cloud registration algorithm to obtain a fruit tree three-dimensional point cloud model, and segmenting fruit local point clouds from the fruit tree three-dimensional point cloud model; establishing a pitaya fruit point cloud coordinate system by using a PCA principal component analysis method; and performing spherical fitting and ellipsoid fitting on the pitaya fruit point cloud coordinate system to obtain an ellipsoid model with unique pose parameters. According to the invention, a fruit tree three-dimensional point cloud model and accurate fruit three-dimensional space pose information can be provided for a pitaya fruit picking system.

An image processor for a medical observation device includes a color conversion function, The image processor is configured to retrieve an input pixel of a digital input color image and a location of the input pixel in the input color image, and apply the color conversion function to the input pixel to generate an output pixel in a digital output color image. The color conversion function depends on the location of the input pixel.

The invention provides a pallet pose estimation method and system, and the method comprises the steps: obtaining a color image which comprises a pallet region and at least part of pixels of which are aligned, and point cloud data, and cutting the color image to obtain a target image which only comprises the pallet region; obtaining a point cloud of an area corresponding to the target image from the point cloud data according to an alignment relationship between the color image and the point cloud data, and obtaining a to-be-fitted point cloud; performing plane fitting on the to-be-fitted point cloud to obtain a plane fitting model; angle information and center coordinates of the pallet are calculated based on the plane fitting model and a preset reference coordinate system, and the angle information and the center coordinates of the pallet are utilized to construct a pose matrix of the pallet to obtain pose information of the pallet. The pallet pose estimation method provided by the invention has higher robustness and higher accuracy.

The invention relates to the technical field of oral recognition, in particular to an oral mucosa lesion dynamic tracking system and method, and the system comprises a data collection module which is used for obtaining a two-dimensional color image of an oral mucosa; the data processing module is used for carrying out preprocessing operation on the obtained two-dimensional color image; the intelligent analysis module is used for performing feature extraction and analysis on the preprocessed two-dimensional color image by adopting a deep convolutional neural network architecture; the dynamic tracking module is used for dynamically tracking oral mucosa lesions and recording the development and change conditions of the lesions; and the user interaction module is used for displaying the dynamic tracking result of the oral mucosa lesion to a user. The deep convolutional neural network is combined with the attention mechanism and the multi-scale feature extraction technology, fine differences of oral mucosa lesions are automatically recognized, traditional manual observation errors are greatly reduced, the method is especially good at distinguishing complex textures and early-stage tiny lesions, and a reliable basis is provided for clinical diagnosis.