Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

3362 results about "Colour image" patented technology

Path marking detection and classification for autonomous and semi-autonomous systems and applications

In various examples, multimodal image data may be used to generate a set of top-down tile images, which are applied to a deep neural network generator architecture model to produce lane marking-specific heatmap images corresponding to the set of top-down tile images. The multimodal sensor data may include LIDAR-captured intensity channel data, LIDAR-captured feature height channel data, and optical color image channel data. The set of top-down tile images may be processed by the generator model to automatically detect lane boundaries and navigation boundaries to generate pixel-level heatmap images that may classify lane markings by marking characteristics such as line type and / or color. The generator model may comprise an encoder-decoder architecture, with multiscale feature extraction and / or context extraction functional layers intervening between the encoder model and the decoder model.
Owner:NVIDIA CORP

Dynamic multi-target tracking and trajectory prediction method

The invention relates to the technical field of multi-target tracking, in particular to a dynamic multi-target tracking and trajectory prediction method. Comprising the following steps: acquiring a color image and a depth image, and preprocessing; constructing a dynamic threshold double-flow neural network, extracting features from the preprocessed color image and depth image to obtain a visual feature set and a depth feature set, fusing the visual feature set and the depth feature set through an adaptive attention mechanism to obtain a fused feature set, and combining a dynamic threshold to obtain an observation information list of a target; updating the observation information list through a self-motion decoupling mechanism to obtain a real information list; establishing space association and time association between the target and the track based on the real information list to obtain a newest track set; and analyzing target characteristics, environmental constraints, social behaviors and historical trajectories, generating a prediction trajectory of each target and a corresponding multi-factor score, generating a time-varying influence graph, and performing planning and decision making by adopting a double-layer decision-making mechanism.
Owner:NANJING FANGJI TECH CO LTD

Real-time online cargo volume recognition method, system, and device, and medium

PCT designated stage expiredWO2025039766A1Image enhancementImage analysisColor imageEngineering
The present application relates to a real-time online cargo volume recognition method, system, and device, and a medium. The method comprises: collecting, by means of a camera, a depth image and a color image of a set area comprising a cargo; introducing a median filter to remove noise pixels in the depth image, and aligning the color image with the filtered depth image on the basis of internal and external parameters of the camera to obtain an aligned color image; on the basis of color, light, and grayscale differences between the cargo and a non-cargo object, using a pre-trained YOLACT model to perform instance segmentation on the aligned color image, and generating a cargo mask; and performing edge fitting, surface extraction, and background separation of the cargo by means of the aligned color image, the filtered depth image and the cargo mask, so as to determine the volume of the cargo. Thus, the present application has high stability and robustness, reliable data can be obtained regardless of the placement location and the placement direction of a cargo, and the working efficiency can be improved.
Owner:HANGZHOU LANXIN TECH CO LTD

Steel bar binding method, steel bar binding system, storage medium and electronic equipment

The invention provides a reinforcing steel bar binding method, a reinforcing steel bar binding system, a storage medium and electronic equipment, and relates to the field of industrial automation, and the method comprises the following steps: obtaining a color image and a depth image of a reinforcing steel bar scene; inputting the preprocessed color image into a key point detection model to obtain pixel information; the pixel information comprises a binding point area pixel frame and binding point pixel coordinates; extracting point cloud data of a binding point area according to the pixel information and the depth image; setting a template point cloud, and performing registration on the binding point area point cloud data by using the template point cloud to obtain a transformation matrix of the actual binding point point cloud and the template point cloud; and according to the transformation matrix, the binding posture of the reinforcing steel bar is determined, so that a mechanical arm is guided to bind the reinforcing steel bar according to the binding posture. The reinforcing steel bar binding pose can be estimated, so that the mechanical arm is guided to complete reinforcing steel bar binding operation, and automation of the reinforcing steel bar binding process is achieved.
Owner:HUNAN UNIV

Aluminum alloy surface oxidation spot defect identification method and device based on machine vision

The invention provides an aluminum alloy surface oxidation spot defect identification method and device based on machine vision, and relates to the field of intelligent manufacturing and industrial automation, and the method comprises the steps: obtaining an aluminum alloy surface color image, and carrying out the preprocessing of the image, so as to extract a brightness component image; self-adaptive threshold segmentation of local contrast enhancement is carried out on the brightness component image, a defect area binary mask is generated, morphological connected domains are extracted according to the mask, and three basic feature indexes of the area pixel value, the contour Fourier descriptor complexity and the area gray scale standard deviation contrast of each connected domain are calculated; and extracting and marking a connected domain boundary, verifying a boundary closed topological structure, and dynamically generating a curvature-driven self-adaptive sampling point through multi-scale B-spline curvature extreme value detection. Through optical-algorithm-process three-level collaborative innovation, the curved surface reflection false alarm rate is reduced, the pinhole detection rate is increased, and the boundary precision is + / -0.2 pixel.
Owner:SHAANXI LIANGDINGRUI METAL NEW MATERIAL CO LTD

Method and apparatus for acquiring grabbing pose of target object, and electronic device

A method for acquiring the grabbing pose of a target object. The method comprises: setting a detection area for a three-dimensional point cloud in a point cloud coordinate system acquired from a scenario, so as to obtain a three-dimensional detection area comprising a point cloud of a target object; converting the three-dimensional detection area into a two-dimensional detection area; performing target detection and analysis on the basis of the two-dimensional detection area and a color image acquired from the scenario, so as to obtain at least one target object and feature information of the target object that comprises spatial geometric features in an image coordinate system; converting a three-dimensional point cloud of the three-dimensional detection area in a point cloud coordinate system into a robot coordinate system, so as to obtain a three-dimensional point cloud in the robot coordinate system; acquiring feature information in the robot coordinate system on the basis of the feature information of the target object in the image coordinate system; and obtaining a grabbing point of the target object on the basis of the feature information of the target object in the robot coordinate system and the three-dimensional point cloud in the robot coordinate system, so as to obtain the grabbing pose of the target object. Further provided are an apparatus (1000) for acquiring a grabbing pose of a target object, and an electronic device.
Owner:BEIJING TRANSFER TECH CO LTD

Structural perception three-dimensional scene reconstruction method and device

The invention discloses a three-dimensional scene reconstruction method and device based on structure perception. The method comprises the following steps: constructing a sparse point cloud generation model according to a diffusion model based on a Unet architecture; inputting the information into a sparse point cloud generation model, and generating camera internal and external parameters and sparse point cloud data of the RGB image frame under the corresponding view angle; constructing a rough three-dimensional structure grid according to the sparse point cloud data; carrying out random sampling on the rough three-dimensional structure grid, and carrying out Gaussian field initialization on the Gaussian primitives according to a random sampling result to obtain an initialized Gaussian field; the loss between the current image frame and the RGB color image is calculated, parameters of Gaussian primitives of all the RGB image frames in the information are iteratively optimized in sequence according to the loss, all the optimized Gaussian primitives are combined, and a reconstructed three-dimensional scene is obtained. According to the invention, the spatial consistency and accuracy of reconstruction results are improved.
Owner:CHENGDU UNIV OF INFORMATION TECH

Self-adaptive nonlinear image enhancement method and system for low-illumination scene of mobile terminal

The invention provides a self-adaptive nonlinear image enhancement method and system for a low-light scene of a mobile terminal, and relates to the technical field of image enhancement, and the method comprises the steps: carrying out the image preprocessing and noise reduction, and carrying out the graying and noise suppression of an input color image through a local variance self-adaptive algorithm; adaptive down-sampling is carried out, and the down-sampling proportion is dynamically adjusted according to the image resolution and the content complexity, so that the processing efficiency is improved; brightness adaptive enhancement is carried out, and the overall brightness of the image is rapidly improved by adopting an Otsu method and a lookup table; contrast nonlinear enhancement: enhancing image details and contrast in combination with a Laplace operator and local mean adjustment; and color restoration: restoring the resolution through bilinear interpolation and performing weighted fusion to realize natural color reconstruction. And finally, a high-quality image of which the brightness, the contrast ratio and the color are remarkably improved is output. According to the invention, the recognition accuracy and processing efficiency of the low-illumination image are improved.
Owner:GUANGDONG POLYTECHNIC NORMAL UNIV

AI image analysis-based old people health state prediction and alarm method

The invention belongs to the technical field of image analysis, and discloses an old people health state prediction and alarm method based on AI image analysis, and the method comprises the steps: obtaining a depth image, a color image and a pressure image of an activity environment of old people, carrying out the combined analysis of the depth image and the pressure image, recognizing a terrain semantic region in a monitoring region, and carrying out the prediction of the health state of the old people; and carrying out dynamic segmentation on the gait contour of the old people. And the terrain gait coupling degree is calculated by analyzing the depth change characteristics and the motion period characteristics of the gait sub-regions, so that the abnormal gait sub-regions are screened out. And for the abnormal regions, the terrain gait coupling degree, the dynamic texture features of the color image and the pressure distribution features of the pressure image are fused, and a cross-modal health risk vector is constructed. Based on the vector, the health state of the old people is accurately predicted, and a corresponding alarm signal is generated. According to the invention, precise evaluation and timely early warning of the health state of the old people are realized, and intelligent guarantee is provided for the home safety of the old people.
Owner:BEIJING FRACTAL TECH CO LTD

Information processing device, information processing method, and program

Provided is an information processing device configured to acquire a color image at a first viewpoint and a depth image at a second viewpoint, and generate an output color image at a virtual viewpoint different from the first viewpoint on a basis of a result of separation processing of separating the depth image into a foreground depth image and a background depth image.
Owner:SONY GROUP CORP

Mechanical arm autonomous grabbing system based on visual language model and control method thereof

The invention discloses a mechanical arm autonomous grabbing system based on a visual language model and a control method of the mechanical arm autonomous grabbing system. The method comprises the steps that firstly, a mechanical arm is initialized, and a color image and a depth image of a working interval are collected; secondly, based on the color image and the natural language description, generating a target object bounding box and confidence, and judging whether a target object exists in the scene or not; and when the target object does not exist, instance segmentation and capture feasibility detection are carried out on the visible object in the current scene. And then the depth image and the object binary mask passing through grabbing feasibility detection are sent to an interaction object selection strategy and an action selection strategy to obtain an object to be interacted and a pushing action direction. And finally, center coordinates of the to-be-interacted object and center coordinates of the mechanical arm are obtained, the obstacle is moved in the pushing action direction until the target object appears and can be grabbed, and the mechanical arm grabs the target object and places the target object at a designated position. According to the method, the object specified by the human natural language can be accurately recognized and grabbed.
Owner:HANGZHOU DIANZI UNIV

Multi-source information fusion outdoor inspection scene three-dimensional color geometric model reconstruction method

The invention belongs to the technical field of robotics and computer vision, and relates to a multi-source information fusion outdoor inspection scene three-dimensional color geometric model reconstruction method, which comprises the following steps: (1) inertial measurement unit IMU internal reference calibration initialization, (2) laser radar and inertial measurement unit IMU combined external reference calibration, (3) state estimation, (4) using an i-Octree structure to store an updated map, and (5) performing multi-source information fusion. (5) carrying out loopback detection to solve the mileage drift problem; (6) carrying out data fusion of the laser radar and the color camera; and (7) carrying out 3D global positioning. The method has the advantages that the information of the laser radar and the information of the color camera are fused, the one-to-one mapping relation between each space point in the three-dimensional point cloud and a certain pixel point in the color image is established, visual information is more completely described, and the visual information is more accurately and accurately positioned by using a 3D global positioning method. And high-precision reconstruction of the three-dimensional color geometric model is realized.
Owner:DALIAN UNIV OF TECH

Three-dimensional temperature field reconstruction method based on 3D Gaussian splashing

The invention discloses a three-dimensional temperature field reconstruction method based on 3D Gaussian splashing, and the method comprises the steps: firstly carrying out the feature point extraction of an input color image, obtaining a descriptor, and carrying out the feature matching of the extracted features; and then generating a camera pose and realizing reconstruction of sparse point clouds, and finally selecting corresponding strategies to realize three-dimensional temperature field reconstruction according to different requirements. According to the method, three different strategies can be formulated according to different application requirements of three-dimensional reconstruction on storage space, reconstruction speed, reconstruction quality and the like in the actual application process so as to realize reconstruction of the three-dimensional temperature field, and a user can select corresponding strategies to realize reconstruction of the three-dimensional temperature field according to different requirements. The on-demand selection strategy can flexibly adapt to various scene requirements, and the applicability and reconstruction efficiency of the model are improved, so that calculation resources are effectively optimized, the reconstruction precision is ensured, unnecessary calculation consumption is reduced, and the reconstruction effects of the color image and the temperature image are improved at the same time.
Owner:HANGZHOU DIANZI UNIV

Perception method based on lightweight real-time instance segmentation and semantic mapping

The invention belongs to the technical field of computer vision, provides a real-time semantic perception system running on equipment, performs real-time instance segmentation and semantic mapping on a working environment, and provides a perception method based on lightweight real-time instance segmentation and semantic mapping. In the first part, firstly, a color image containing color and texture information is used for object classification and bounding box regression; cutting the original depth image into a depth image with an accurate geometric edge, and inputting the depth image into the truncation network to generate a mask of the instance; a second part: (1) calculating the attitude and size of a target object in the view of the camera through principal component analysis; (2) obtaining the category of the object in the view obtained by segmentation; (3) creating a point cloud of the depth image projection of the target object in a map; and then cross-frame tracking and fusion are carried out by using data association to realize the purpose of sensing. The method is mainly applied to automatic sensing occasions.
Owner:TIANJIN UNIV

Three-dimensional scene reconstruction method based on multi-modal regularization and temperature smoothing constraint

The invention discloses a three-dimensional scene reconstruction method based on multi-modal regularization and temperature smoothing constraint, and belongs to the technical field of computer vision. According to the method, firstly, color-temperature image pairs of the same three-dimensional scene under the same visual angle are registered, and then an enhanced image is generated in a mixing or contour line superposition mode. And performing motion construction on the enhanced image to generate a point cloud and a camera pose. And creating two independent Gaussian models, inputting point cloud data and camera poses, and respectively rendering to obtain a temperature image and a color image. A loss function is set for the Gaussian models of the temperature mode and the color mode, and a smooth item is introduced into the loss function of the temperature mode. A regularization coefficient is set, and loss functions of a temperature mode and a color mode are combined. And calculating overall loss and gradient by using a total loss function, performing back propagation, and optimizing various parameters of the model through adaptive density control. And finally, completing the reconstruction of a three-dimensional scene by using the trained model.
Owner:HANGZHOU DIANZI UNIV

Face recognition algorithm adaptive to illumination change

The invention belongs to the technical field of face recognition, and particularly relates to a face recognition algorithm adaptive to illumination variation, which uses Gaussian filtering to reduce noise caused by illumination variation, convert a color image into a grey-scale image, reduce calculation complexity, perform adaptive histogram equalization, estimate global illumination conditions in the image and improve the face recognition accuracy. Calculating the main direction and intensity of illumination in the image, predicting the current illumination condition, and enabling the image brightness to adapt to different environment illumination; identifying a face region in the image, using a deep learning method to position face related points, using an LBP to extract local features insensitive to illumination variation, and using a deep convolutional neural network to extract global features; introducing a multi-illumination data set; the Euclidean distance is used for comparing the extracted feature vectors, the similarity between the extracted feature vectors and known faces in a database is recognized, according to the similarity score, threshold judgment is adopted for AQW to obtain a final recognition decision, and the method has the effect of being capable of accurately adapting to facial features under different illumination conditions in real time.
Owner:BEIJING ZHONGSHITONG TECH CO LTD

Tunnel detection method based on color image

The invention discloses a tunnel detection method based on a color image, and relates to the technical field of tunnel detection, and the method comprises the following steps: obtaining color image data in a tunnel, and carrying out the illumination condition calibration of the image data, so as to recognize the illumination change caused by natural light, an artificial light source and a light source fault. According to the method, through illumination calibration, adaptive color correction and dynamic contrast enhancement technologies, the problems of image color distortion and detail loss under the complex illumination condition of the tunnel are solved, accurate extraction of color features and clear presentation of details of each region are ensured, and the robustness and precision of defect detection are remarkably improved. In combination with edge detection, color feature extraction, shape analysis and a machine learning algorithm, automatic application of a multi-modal identification technology is realized, misjudgment areas are automatically filtered, a defect detection report with high confidence is generated, and the defect detection report comprises crack length, leakage area and deformation classification. Accurate and comprehensive data support is provided for tunnel safety assessment and maintenance decision.
Owner:CHANGRUI DIGITAL TECH (SICHUAN) CO LTD

Inspection scene multi-view three-dimensional reconstruction method based on adaptive feature enhancement

The invention belongs to the technical field of three-dimensional reconstruction, and relates to an inspection scene multi-view three-dimensional reconstruction method based on adaptive feature enhancement, which comprises the following steps of: (1) constructing a depth map fusion framework based on laser radar and monocular camera self-calibration, obtaining an inspection scene color image and depth map data, the method comprises the following steps: (1) constructing a routing inspection scene multi-view three-dimensional reconstruction network based on adaptive feature enhancement, (3) carrying out transfer learning fine tuning on the routing inspection scene multi-view three-dimensional reconstruction network, and (4) dividing a routing inspection scene data set and configuring an experimental environment, and carrying out network model training and testing. According to the multi-view three-dimensional reconstruction network provided by the invention, the integrality index on a public data set is superior to that of other network models in a pre-training stage, and each evaluation index on an inspection scene data set is lower than values of a reference network and before fine adjustment in a transfer learning fine adjustment stage, so that the network is more suitable for inspection scene reconstruction through fine adjustment; and an ideal effect is achieved.
Owner:XINJIANG UNIVERSITY

Foamed silicone rubber surface detection method based on image visual identification

The invention relates to the technical field of foamed silicone rubber surface detection, and discloses a foamed silicone rubber surface detection method based on image visual identification, which comprises the following steps: acquiring a color image of a foamed silicone rubber surface, carrying out graying and normalization processing, and generating a diffuse reflection effective detection area by using a polarization filter difference technology; color abnormity is detected based on an image gridding and gray statistical method, meanwhile, pore and microbubble defects are detected in combination with minimum value seed point extraction and an eight-neighborhood region growing algorithm, finally, various masks are fused, the defect area and number are counted, and a quality inspection report is generated; the method can effectively inhibit highlight interference and accurately identify uneven colors and pore microbubbles, the detection process does not need external training, calculation is efficient, and the method is suitable for rapid detection and quality control of surface defects of foamed silicone rubber.
Owner:ZHEJIANG LEXUS NEW ENERGY TECH CO LTD

Depth map generation method and device based on large model, three-dimensional reconstruction method and device, electronic equipment and storage medium

The invention provides a depth map generation method and device based on a large model, a three-dimensional reconstruction method and device, electronic equipment and a storage medium, relates to the technical field of artificial intelligence, in particular to the technical fields of computer vision, deep learning, large models and the like, can be applied to real-time road scene depth perception, environment three-dimensional reconstruction and obstacle avoidance, and can be applied to real-time road scene depth perception. And virtual and real scene fusion and other scenes can be realized. The specific implementation scheme is as follows: performing visual coding on a monocular image to obtain a coded image; inputting the coded image and the target text into a pre-trained large language model for fusion to obtain fusion features; generating global guide features based on the fusion features, wherein the global guide features comprise joint semantic information of visual features and text features; adding noise to the color image of the monocular image to obtain a noise feature sequence; de-noising the noise feature sequence under the condition of the global guide feature, and generating an implicit feature matched with the joint semantic information; a depth map is generated based on the implicit features.
Owner:BEIJING BAIDU NETCOM SCI & TECH CO LTD

Thyroid intraoperative real-time navigation method and system based on multi-mode optical fusion

The invention discloses a thyroid intraoperative real-time navigation method and a thyroid intraoperative real-time navigation system based on multi-mode optical fusion. The thyroid intraoperative real-time navigation method comprises the following steps: outputting visible light through an endoscope and coupling light waves of a narrow-band multispectral light source to irradiate an operative field, exciting parathyroid glands to generate near-infrared fluorescence, and receiving reflected visible light, split light, near-infrared fluorescence and laser speckle signals through an endoscope probe. And separating the composite optical signal into four channels, and respectively generating an anatomical structure color image, a blood vessel spectroscopic image, a parathyroid gland near-infrared fluorescence image and a laser speckle image. Performing decorrelation processing on the laser speckle image to generate a blood flow dynamic pseudo-color decorrelation speckle image; an anatomical structure, a blood vessel center line, a parathyroid gland contour and blood flow dynamic feature points are extracted through a multi-modal registration technology, after affine transformation space alignment is conducted, a comprehensive imaging map containing the anatomical structure, blood vessel distribution and parathyroid gland function marking information is generated through a wavelet fusion algorithm, and intraoperative multi-dimensional real-time tissue navigation is achieved.
Owner:THE FIFTH AFFILIATED HOSPITAL OF GUANGZHOU MEDICAL UNIV

Multi-mode teenager idiopathic scoliosis screening method based on back RGB-D image

The invention discloses a multi-mode teenager idiopathic scoliosis screening method based on a back RGB-D image, and belongs to the technical field of image processing and scoliosis screening, and the method specifically comprises the steps: collecting an RGB-D image pair of a subject in an Adams anteflexion posture, carrying out the manual marking of an RGB color image, constructing and training a back key point detection model, and carrying out the detection of the back key point. And establishing a calculation rule of a maximum trunk rotation angle, a minimum trunk rotation angle and a back contour asymmetry index, and establishing an AIS classification rule based on the RGB-D data set, thereby completing AIS classification of the to-be-detected subject. According to the non-contact radiation-free AIS screening method, comprehensive utilization of back two-dimensional and three-dimensional information is achieved by means of data complementation of the RGB mode and the D mode, the problem of feature deficiency in a single mode is solved, and the method has the advantages of being fast, efficient, robust and objective.
Owner:UNIV OF ELECTRONICS SCI & TECH OF CHINA +1

Commodity identification method and device

The invention provides a commodity identification method and device, and the method comprises the steps: carrying out the multi-view collection and preprocessing, and constructing a second color image set and a depth image set; performing three-dimensional reconstruction and volume estimation based on the second color image set and the depth image set, and judging a commodity packaging form; extracting a commodity packaging semantic and price information area based on the second color image set, constructing a space-semantic joint code, and generating global packaging semantic features; based on the second color image set, a multi-view visual coding network is adopted, and a visual prediction SKU index is output; carrying out structure-semantic fusion modeling based on multi-source heterogeneous features, and outputting commodity category labels; and matching a commodity price based on the commodity category label, generating an interaction prompt sign in combination with a confidence threshold, and triggering interaction feedback. According to the invention, commodity vision, space and price activity information are fused, the identification accuracy and price verification intelligence are improved, and the method is suitable for the field of intelligent cashier and retail automation.
Owner:JILIN YUNTOU LAISENGOU DIGITAL TECH CO LTD

Real-time multi-instance segmentation method and device based on Gaussian splash radiation field model

The invention relates to the technical field of computer vision and three-dimensional space modeling, and discloses a real-time multi-instance segmentation method and device based on a Gaussian splash radiation field model. The method comprises the following steps: based on a two-dimensional Gaussian splash radiation field model, rendering a visual angle with continuous spatial change to obtain an image sequence, and obtaining a multi-visual-angle consistent two-dimensional instance segmentation mask of the image sequence; and assigning an instance tag to each Gaussian primitive based on the two-dimensional instance segmentation mask. And for a two-dimensional Gaussian splash radiation field model with an instance label, acquiring a coarse instance segmentation mask and a color image at any view angle by using a Gaussian splash algorithm, inputting the mask and the image into a lightweight post-processing network for edge detection and region connectivity repair, and outputting a target two-dimensional instance segmentation mask with a complete structure and a label consistent with a three-dimensional scene. The method does not depend on any training or distillation process, directly acts on a Gaussian splash radiation field model, and has the advantages of high reasoning speed, high semantic consistency, support of multi-target continuous tracking and the like.
Owner:EAST CHINA NORMAL UNIV

Middle and primary school multi-person interactive teaching method and system based on VR technology

The invention provides a middle and primary school multi-person interactive teaching method and system based on a VR technology, and relates to the technical field of virtual reality, and the method comprises the steps: generating a model through deep learning based on pre-obtained teaching aid model data, determining subcomponents, combining a teaching aid generation engine, and constructing a virtual teaching aid; a color image and a depth image are obtained through a structured light depth camera, two-dimensional pixel coordinates are obtained, depth information is combined, a three-dimensional skeleton curve of limb movement of a student is generated, an optical motion capture result is obtained, an inertial motion capture result is obtained through inertial drift calibration based on the three-dimensional skeleton curve, and a limb movement three-dimensional track of the student is reconstructed; generating a force feedback signal by solving a kinetic equation through a collision detection algorithm based on the three-dimensional trajectory of the limb movement of the trainee; and rendering the virtualization model into a virtual teaching scene, synchronizing the limb movement three-dimensional track and the force feedback signal in real time, and generating a multi-person collaborative interaction process of the virtual teaching aid.
Owner:ZHONGKE LEMU (JIANGSU) TECH CO LTD

Liquid crystal display device based on field sequential display and color image display method thereof

The embodiment of the invention belongs to the technology of display equipment, and provides liquid crystal display equipment based on field sequential display and a color image display method thereof.The liquid crystal display equipment comprises a liquid crystal display screen, a backlight module and a processor, the liquid crystal display screen is divided into a plurality of backlight partitions used for displaying images, and the backlight module is used for emitting backlight; the backlight is used for adjusting the backlight brightness of the display image corresponding to the four-field sequence. And the processor is used for acquiring RGBW image pixel data of the image in the backlight partition, and acquiring backlight brightness data corresponding to the RGBW color based on a preset backlight extraction algorithm according to the RGBW image pixel data. And the processor is also used for determining image compensation pixel data corresponding to the RGBW color based on a preset pixel compensation algorithm and the backlight brightness data corresponding to the RGBW color. And the liquid crystal display screen is used for displaying a color image according to the image compensation pixel data corresponding to the RGBW color. The power consumption of the display equipment is reduced, and the user experience is improved.
Owner:HISENSE VISUAL TECH CO LTD

Plant leaf scab segmentation method and system based on RGB-D cross-modal fusion

The invention belongs to the field of agricultural information perception, and relates to a plant leaf scab segmentation method and system based on RGB-D cross-modal fusion, and the method comprises the steps: collecting a color image and a depth image of a crop through a synchronous collection device; registering the color image and the depth image to obtain a registered color image and a corresponding registered depth image; constructing an initial segmentation network, and performing model training on the initial segmentation network; the initial segmentation network comprises a cross attention-based feature aggregation module and an attention-guided adaptive feature fusion module; inputting the registered color image and the registered depth image into a trained segmentation network for segmentation to obtain a segmentation result; through heterogeneous data fusion of a depth sensor and a visible light camera, a multi-dimensional feature system covering two-dimensional textures and three-dimensional deformation is constructed; in combination with a cross-modal feature complementation mechanism, the recognition robustness of weakly dominant diseases and insect pests is enhanced, and the segmentation precision in a complex illumination and branch and leaf shielding scene is significantly improved.
Owner:YUNNAN HANZHE TECHN CO LTD

Temperature field and deformation field synchronous measurement method and system

The invention relates to a temperature field and deformation field synchronous measurement system and method based on laser speckle DIC and temperature field algorithm temperature measurement. The system comprises a 3CCD color camera, a lens, a three-band filter, a monochromatic light source, a mechanical support adjusting platform, a triangular support and a computer. A test piece is actively illuminated by blue laser, and a color image containing three channel sub-images of red, green and blue on the surface of a high-temperature sample before and after deformation is acquired by a 3CCD color camera. A temperature field algorithm is used for analyzing sub-images of the R channel and the G channel after deformation to calculate a temperature field of the surface of the test piece, and a digital image correlation method is used for analyzing sub-images of the B channel before and after deformation to obtain a strain field of the surface of the test piece, so that synchronous measurement of the temperature field and the deformation field of the surface of the test piece is realized. The principle is simple, the system structure is compact, temperature field measurement is not interfered by speckles, and non-contact, high-precision and synchronous measurement of a material deformation field and a temperature field under the action of force and thermal loads can be achieved.
Owner:BEIHANG UNIV +1

Laparoscopic surgery scene three-dimensional reconstruction method and system based on three-dimensional Gaussian sputtering

ActiveCN119091060Aeasy to observeImprove the accuracy of 3D reconstructionImage enhancementImage analysisColor imageColour image
The invention provides a laparoscopic surgery scene three-dimensional reconstruction method and system based on three-dimensional Gaussian sputtering, and relates to the field of scene three-dimensional reconstruction. According to the method, whether a color image frame at the current moment is a key frame or not is judged, a dynamic or static scene optimizer is started, then a pose optimizer is started, the two optimizers are alternately and iteratively operated until the two optimizers converge, and accurate camera pose and tissue deformation information can be estimated at the same time. The designed three-dimensional reconstruction framework can establish a three-dimensional model of the whole environment under the condition that only the local in-vivo environment and tissue deformation are shot, and the defect that the visual field of the endoscope is limited is overcome. Besides, depth map information providing geometric surface information is introduced and is used for supervising center point coordinates of 3D gausses, so that the center point coordinates are bound around the surface, the three-dimensional reconstruction precision of the tissue surface is greatly improved, geometric priori is provided for all 3D gausses by adding the depth map, and 3D Gaussian density adjustment does not need to be carried out.
Owner:HEFEI UNIV OF TECH

Steel structure welding seam quality detection method

The invention discloses a steel structure welding seam quality detection method, which comprises the following steps: acquiring a color image of a steel structure welding seam area, graying the acquired color image, performing weighted average according to weights of three color components of red, green and blue to obtain a gray value of each pixel point, selecting a neighborhood, and determining the quality of a welding seam in the neighborhood; different weights are given to pixel values in each neighborhood according to the distance between the pixel values and a center pixel, a weighted average value is calculated as a local threshold value, pixel points in the image are received, the local threshold value is compared with the pixel values of the points, the positions of weld defects are positioned, image coordinates are introduced, positioning is carried out, and the weld defects are obtained. According to the method, real-time detection of the weld defects is achieved, instant feedback is provided for quality control, the local threshold value method calculates the threshold value according to the local characteristic of each pixel point, the accuracy of defect recognition is enhanced, and the method is suitable for various weld types and illumination conditions.
Owner:HUBEI TUANSTEEL SCI & TECH RES CO LTD +1