Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

281 results about "Residual Blocks" patented technology

Image data encoding / decoding method and apparatus

Disclosed are methods and apparatuses for decoding an image. A method includes receiving a bitstream obtained by encoding the image; dividing a first coding block into a plurality of second coding blocks; generating a prediction block of a second coding block based on syntax information obtained from the bitstream; and reconstructing the second coding block based on the prediction block and a residual block of the second coding block, the residual block being obtained by performing a dequantization and an inverse-transform on quantized transform coefficients from the bitstream. The first coding block has a recursive division structure. The first coding block is divided based on at least one of a quad tree division, a binary tree division or a triple tree division.
Owner:INST OF IMAGE TECH INC

Remote sensing image super-resolution reconstruction method and system based on residual hierarchical Transform

The invention provides a remote sensing image super-resolution reconstruction method and system based on residual hierarchical Transform, and relates to the technical field of digital image processing, and the method comprises the following steps: obtaining a low-resolution image; performing shallow feature extraction on the input low-resolution image through convolutional layer operation to obtain a shallow feature image; secondly, on the basis of the design concept that residual blocks are nested in residual groups, a multi-scale feature calibration mechanism, a Transform space-channel attention mechanism based on a hierarchical window and a space-gate feed-forward network are combined, and a depth feature image is obtained; and finally, performing fusion and up-sampling on the shallow feature image and the depth feature image through convolution and sub-pixel convolution operation to obtain a final remote sensing image super-resolution reconstruction result. By means of the scheme, the remote dependency relationship in the remote sensing image can be effectively modeled, the feature extraction capacity can be improved, and the problem that large-scale window self-attention calculation is high in complexity in a Transform mechanism can be solved.
Owner:PUTIAN UNIV

3D document key information deformation recovery method, system, device and medium

The invention relates to the field of image correction and recovery, in particular to a 3D document key information deformation recovery method, system and device and a medium, shallow layer features are extracted from a distorted document image, after first feature enhancement is carried out, a plurality of inverted residual blocks are used for extracting depth features, then second feature enhancement is carried out on an obtained depth feature map, and a 3D document key information deformation recovery result is obtained. Performing multi-layer expansion convolution processing on the feature map after the second feature enhancement to obtain a fusion feature; based on the fusion features, respectively outputting the intervals between the predicted reference points and the predicted coordinate positions of the control points, obtaining a position mapping relation between each control point and the corresponding reference point, and further obtaining a position corresponding relation between all pixel points and the reference points in the corrected image; and moving each pixel point to the position of the reference point corresponding to the pixel point in the corrected image to obtain the document image after deformation recovery, thereby realizing efficient deformation recovery of the 3D document key information deformation.
Owner:SHANDONG UNIV OF SCI & TECH +1

Method for predicting elastic property of fiber reinforced composite material

The invention discloses a method for predicting the elastic property of a fiber reinforced composite material, and aims to solve the problems of low precision, low efficiency and difficulty in processing multi-scale correlation of a traditional method. The method comprises the following steps: firstly, generating a representative volume unit by using a random algorithm, and constructing a high-quality training data set by combining Sobol sequence sampling and an SMOGN data enhancement technology; secondly, designing and training a deep neural network embedded with residual blocks and physical constraints, and improving the generalization ability of the model through Bayesian optimization adaptive parameter adjustment; and finally, establishing a plurality of macrostructure models, and realizing end-to-end prediction of the multi-scale elastic performance. The method realizes breakthrough in prediction precision and calculation efficiency: the time consumed by single analysis is shortened from several hours to a minute-second level, and the average prediction error is lower than 5%. The technology can be widely applied to the fields of aerospace, new energy automobiles, wind power and the like, and intelligent support is provided for design and manufacturing of high-performance composite materials.
Owner:ZHEJIANG SCI-TECH UNIV

Deep learning network structure and method for magnetic anomaly inversion

The invention relates to the technical field of magnetic exploration, in particular to a deep learning network structure and method for magnetic anomaly inversion, and solves the problems that a traditional linear inversion method is slow in calculation stable speed and relatively low in precision, and a traditional ground and aeromagnetic data inversion method is insufficient in vertical resolution and relatively low in precision. A traditional linear inversion method is always encountered with the problems of low calculation efficiency and poor stability due to the local minimum value problem, and comprises an inversion network encoder, and a residual block and down-sampling method is adopted to realize the characteristics of magnetic anomaly data to extract an encoding network unit in a two-dimensional form. According to the method, feature extraction of magnetic anomaly data is realized, a residual module is added in an encoder to fuse feature maps from different sources, a three-dimensional magnetic susceptibility structure is reconstructed from two-dimensional observation magnetic field data, and in order to solve the problem that a sample library of deep learning inversion needs enough diversity and complexity, the method has high robustness. The generalization ability of the magnetic method inversion neural network is fully improved, and the inversion precision is further improved.
Owner:CHINA UNIV OF GEOSCIENCES (BEIJING) +1

Self-distillation model compression method and device, electronic product and medium

The invention provides a self-distillation model compression method and device, an electronic product and a medium. The method comprises the steps that a teacher model needing model compression is constructed, the basic structure of the teacher model is divided into a plurality of residual blocks, and student models are constructed according to the residual blocks; through knowledge distillation of each model, enhancing result knowledge; enhancing process knowledge through attention map mapping of feature maps of the teacher model and each student model; according to the enhancement result of the effective knowledge and the enhancement result of the process knowledge, calculating a loss function of the teacher model and each student model; according to the loss function obtained through calculation, a student model with the classification effect closest to the teacher model is extracted to serve as a compression model of the teacher model. According to the self-distillation model compression method and device, the electronic product and the medium provided by the invention, a method technical support is provided for forming a simple, convenient, high-automation and user-friendly model compression and acceleration tool.
Owner:SHANGHAI ADVANCED RES INST CHINESE ACADEMY OF SCI

Multiple residual block coding mode

A video bitstream comprising coded information of a plurality of partial residual blocks of a current block in a current picture is received. Each of the plurality of partial residual blocks indicates a difference between a respective prediction block of the current block and the current block. The plurality of partial residual blocks of the current block is determined based on respective coding parameters. A residual block is determined based on the plurality of partial residual blocks. A prediction block for the current block is determined. The current block is reconstructed based on a combination of the derived residual block and the determined prediction block.
Owner:TENCENT AMERICA LLC

Image super-resolution reconstruction method

The invention relates to the technical field of image super-resolution, and provides an image super-resolution reconstruction method, and the method comprises the steps: obtaining a to-be-reconstructed low-resolution image, inputting the to-be-reconstructed low-resolution image into a trained super-resolution image reconstruction model, and obtaining a super-resolution reconstruction image corresponding to the to-be-reconstructed low-resolution image. A shallow layer feature extraction module in the super-resolution image reconstruction model is composed of a depth separable convolution sub-module and a standard convolution sub-module, and a deep layer feature extraction module is composed of a plurality of dense parallel residual blocks constructed based on an adaptive attention mechanism and a standard convolution layer which are connected in sequence. The reconstruction module is composed of a dynamic convolution layer, a moving window attention layer, a pixel reconstruction layer and a standard convolution layer, and solves the problems that an existing shallow feature extraction module cannot fully extract shallow features, the local modeling capability of a residual Swin Transform block in a deep feature extraction module is insufficient, and the reconstruction module cannot obtain features of a target area. Therefore, a high-quality super-resolution reconstructed image is obtained.
Owner:XIDIAN UNIV

EDSR image super-resolution reconstruction method based on particle swarm optimization

The invention relates to an EDSR (Enhanced Depth Super-Resolution) image super-resolution reconstruction method based on particle swarm optimization, and the method comprises the following steps of: (1) carrying out super-resolution reconstruction on an EDSR (Enhanced Depth Super-Resolution) image; the method comprises the following steps: firstly, inputting a low-resolution image data set as a training sample, defining an optimization space containing the number and stage of residual blocks, convolutional layer parameters, an attention module, an up-sampling mode and the like, initializing particle swarm optimization (PSO) parameters, and dynamically constructing a candidate network by particle position coding; a candidate network is dynamically constructed through particle position coding, and a residual block layer, a convolution layer, an attention module and an up-sampling module are sequentially configured. The candidate network is subjected to limited training, and individual and global optimal positions are updated through fitness function evaluation fusing PSNR and model complexity. And finally, a global optimal structure is selected for complete training for low-resolution image reconstruction, the detail reduction capability and the reasoning efficiency are remarkably improved, and a high-quality image is generated.
Owner:XIANGTAN UNIV

Chroma quantization parameter (QP) derivation for video coding

ActiveUS12244805B2AlgorithmVideo encoding
Techniques are described for decoding video data. A video decoder may determine chroma blocks in a chroma quantization group (QG) of the video data, determine a quantization parameter predictor that is the same for each of the chroma blocks of the chroma QG, determine an offset value that is the same for two or more of the chroma blocks of the chroma QG, determine a quantization parameter value for each of the two or more of the chroma blocks in the chroma QG based on the quantization parameter predictor and the offset value inverse quantize coefficients of one or more residual blocks for the chroma blocks based on the determined quantization parameter value, generate the one or more residual blocks based on the inverse quantized coefficients, and reconstruct the chroma blocks based on the one or more residual blocks.
Owner:QUALCOMM INC

U-net and transformer based in-loop filtering for video coding

Methods and devices for decoding video data are described. An example method includes in-loop filtering a current block of the video data using a neural network-based in-loop filter to generate an in-loop filtered current block, wherein the neural network-based in-loop filter is trained using an architecture comprising a U-Net architecture comprising one or more residual blocks and one or more transform blocks; and outputting the in-loop filtered current block.
Owner:QUALCOMM INC

An intelligent identification method for individual communication radiation sources in cross-period scenarios

The present invention discloses a method for intelligently identifying individual communication radiation sources in cross-period scenarios, relating to the technical field of radiation source individual identification. To address the problem of the degradation of individual distinguishability of radiation sources over time due to the inherent characteristics of communication signal radiation sources and the influence of complex electromagnetic environmental factors, the present invention, based on a generative adversarial network, constructs a generator using residual blocks to establish a mapping relationship between the feature distributions of data from two periods. By adding noise to the discriminator and discarding neurons with a certain probability, the model training process is stabilized and the risk of overfitting is reduced. Through adversarial training, a robust classifier with strong generalization capabilities is constructed. Through the above technical solutions, the present invention can achieve stable and effective individual identification of communication radiation sources in cross-period scenarios.
Owner:UNIV OF ELECTRONICS SCI & TECH OF CHINA

U-net and transformer based in-loop filtering for video coding

Methods and devices for decoding video data are described. An example method includes in-loop filtering a current block of the video data using a neural network-based in-loop filter to generate an in-loop filtered current block, wherein the neural network-based in-loop filter is trained using an architecture comprising a U-Net architecture comprising one or more residual blocks and one or more transform blocks; and outputting the in-loop filtered current block.
Owner:QUALCOMM INC

VIDEO ENCODING / DECODING METHOD AND APPARATUS USING CORRELATION IN YCbCr

Disclosed is video encoding / decoding method and apparatus using a correlation of YCbCr. According to an aspect of the present disclosure, the video decoding method for predictively decoding a target block includes, receiving a bitstream and generating a residual block for a chroma block, generating reconstructed information in a luma block corresponding to the chroma block and reconstructed neighboring information about the luma block, generating reconstructed neighboring information about the chroma block, determining a scaling value and an offset value based on the reconstructed neighboring information about the chroma block and the reconstructed neighboring information about the luma block, generating a prediction block for the chroma block by applying the determined scaling value and offset value to the reconstructed information in the luma block, and generating a reconstructed block for the chroma block based on the residual block for the chroma block and the prediction block for the chroma block.
Owner:SK TELECOM CO LTD

Image multi-domain style conversion method based on dense frequency domain attention residual

The invention relates to the technical field of computer vision, in particular to an image multi-domain style conversion method based on dense frequency domain attention residuals, which comprises the following steps: acquiring an image to be converted and a target style attribute tag; the to-be-converted image and the target style attribute label are input into a preset style conversion model, a target style image is output, the style conversion model is obtained through training of a training set, the training set comprises images of a plurality of styles and attribute labels, and the target style image is output. The style conversion model is constructed by fusing a dense frequency domain attention residual block and a feature extraction block of spectrum normalization on the basis of a StarGAN network. According to the method, the convolutional attention, the dense frequency domain attention residual network and the style conversion model constructed by embedding spectrum normalization are combined, so that instability in a model training process can be effectively prevented, and a more realistic image is generated.
Owner:TAIYUAN UNIVERSITY OF SCIENCE AND TECHNOLOGY

Foundation cloud picture multi-class segmentation method based on multi-scale feature extraction and screening

The invention discloses a foundation cloud picture multi-class segmentation method based on multi-scale feature extraction and screening. Comprising the following steps: 1) extracting multi-level visual features by using four stacked residual blocks as a trunk structure; 2) a multi-scale feature extraction module processes a feature map output by the backbone network through a parallel pooling layer, reduces the number of channels by using a 1 * 1 convolution kernel, and realizes global feature extraction through bilinear interpolation up-sampling; 3) further screening important features from the multi-scale features by a feature screening module, and performing feature fusion by using multi-branch depth separable convolution and a mixed attention mechanism; and 4) the decoder performs up-sampling through transposition convolution and fuses deep and shallow layer features, and finally completes pixel-level classification through a softmax function. Compared with other algorithms, when a semantic segmentation task of the foundation cloud picture is processed, the segmentation accuracy is remarkably improved, particularly, the capability of subdividing different types of cloud classes is excellent, misclassification conditions are greatly reduced, and the advantages of the method in the aspect of global feature extraction are verified.
Owner:BEIJING UNIV OF TECH

Point cloud vision fusion method and device, electronic equipment and storage medium

The invention relates to a point cloud visual fusion method and device, electronic equipment and a storage medium. The method comprises the following steps: constructing a semantic point cloud map, and obtaining a current picture; the current picture corresponds to the current pose, semantic segmentation is carried out on the current picture to obtain the category of pixels in the current picture, likelihood fields and likelihood field gradients of different categories are calculated, a residual block is constructed based on the semantic point cloud map, the likelihood fields and the likelihood field gradients, and the current pose is updated through the residual block. The updated current pose is used for updating the semantic point cloud map. According to the scheme provided by the invention, data fusion of the point cloud and the image can be realized without cross-sensor feature extraction and feature matching, and the accuracy of information in the semantic point cloud map is improved, so that the stability and precision of SLAM are improved.
Owner:ZHIDAO NETWORK TECH (BEIJING) CO LTD

Image filtering method and apparatus based on neural network, and device and storage medium

Provided in the embodiments of the present application are a filtering method and apparatus, a coding method and apparatus, a decoding method and apparatus, and an electronic device. The filtering method based on a neural network comprises: generating an input parameter for a neural network filter on the basis of an image to be subjected to filtering; inputting the input parameter into the neural network filter, wherein the neural network filter includes a residual unit used for extracting image feature information, the residual unit includes a plurality of residual blocks which are sequentially connected, each residual block includes a plurality of convolutional layers which are arranged in parallel and have convolution kernels of different sizes, and the residual unit comprises different first set convolutional layers and second set convolutional layers, which are alternately arranged; and acquiring a filtered image which is output by the neural network filter with regard to the image to be subjected to filtering. The technical solution in the embodiments of the present application can reduce the computational complexity of a neural network filter and improve the filtering effect, thereby facilitating an improvement in video coding and decoding efficiency.
Owner:TENCENT TECHNOLOGY (SHENZHEN) CO LTD

Counter-defense method based on dynamic gating mixed batch normalization

The invention discloses a confrontation and defense method based on dynamic gating mixed batch normalization. The method comprises the following steps: step 1, data acquisition and model initialization; 2, calling an adversarial attack algorithm to generate an adversarial sample; combining the adversarial sample and the clean sample to form a mixed sample; step 3-1, establishing a wide residual network model; the initial convolution layer passes through three network frameworks with the same structure, and the output of the last network framework sequentially passes through a standard batch normalization layer, a ReLU activation function, a global pooling layer and a full connection layer; each network framework comprises four residual blocks; 3-2, learning mixed batch normalization layer statistical distribution by using clean samples and adversarial samples; and 3-3, freezing parameters of the mixed batch normalization layer, and learning parameters of other network layers in the wide residual network model. According to the invention, by introducing a dual-path dynamic normalization and adaptive gating fusion mechanism, the robustness, generalization ability and calculation efficiency of the model are significantly improved.
Owner:CHENGDU UNIV

Reference picture resampling (RPR) based super-resolution guided by partition information

A method for video processing applied to a decoder includes (i) receiving an input image; (ii) processing the input image by one or more convolution layers; (iii) processing the input image by multiple residual blocks by using partition information of the input image as reference so as to obtain reference information features; (iv) generating different-scales features based on the reference information features; (v) processing the different-scales features by multiple convolutional layer sets; (vi) processing the different-scales features by reference spatial attention blocks (RSABs) so as to form a combined feature; and (vii) concatenating the combined feature with the reference information features so as to form an output image.
Owner:GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD

Method and Apparatus for Sign Coding of Transform Coefficients in Video Coding System

A method and apparatus for joint sign prediction of transform coefficients of residual blocks in a video coding system are disclosed. At the encoder side, a transform coefficient region or an index value range is determined according to coding context associated with the current block. A set of signs associated with a set of selected transform coefficients are determined for joint sign prediction are determined according to the transform coefficient region or the index value range. Joint sign prediction for the set of signs is determined by selecting a hypothesis from a group of hypotheses for the set of signs that achieves a minimum cost. The sign prediction is then used for coding the set of signs. A corresponding method and apparatus for the decoder side is also disclosed.
Owner:MEDIATEK INC

Rs-fMRI classification method based on residual block and Bayesian variational reasoning

The invention relates to an rs-fMRI classification method based on a residual block and Bayesian variational reasoning. The method comprises the following steps: firstly, acquiring rs-fMRI data and preprocessing the rs-fMRI data to obtain a time signal sequence; then, brain function connection is calculated based on the time signal sequence, and an original brain network is constructed; constructing a line graph based on the original brain network and performing line graph convolution; and finally, based on the line graph after convolution, Bayesian variation posteriori is adopted for classification, and an rs-fMRI classification result is obtained. The brain connection reconstruction model is used as a node, the importance of functional connection is highlighted, and the residual block is combined with Bayesian variational reasoning, so that accurate storage and analysis of brain network connection are facilitated, the problems of original noise and abnormal values are solved, and the accuracy and robustness of brain information extraction by the model for identification and classification are improved.
Owner:SOUTHWEST JIAOTONG UNIV

Alzheimer disease prediction method and system based on deep learning and electrocardiosignals

The invention discloses an Alzheimer disease prediction method and system based on deep learning and electrocardiosignals. Firstly, electrocardiosignals are collected and preprocessed; then, constructing a deep learning prediction model which comprises a feature extraction module and a classification prediction module; the feature extraction module comprises a plurality of residual blocks, and each residual block comprises a convolution layer, a batch normalization layer, a nonlinear activation layer and a jump connection; the classification prediction module realizes a complete mapping process from a feature space to probability prediction through a multi-layer perceptron structure and a softmax function, and obtains a prediction probability of each electrocardiosignal fragment belonging to each category; and fusing the prediction results of the plurality of electrocardiosignal segments of the same sample by adopting a soft voting mechanism to obtain a final prediction result. The system comprises a signal acquisition module, a signal preprocessing module, a deep learning prediction module and a result output module. According to the method, Alzheimer's disease prediction is realized based on the electrocardiosignals, and the method is simple and convenient in acquisition mode, non-invasive, low in cost and suitable for large-scale screening.
Owner:HEBEI UNIV OF TECH

System and methods for low-complexity deep learning networks with augmented residual features

In some example embodiments, there may be provided a method that includes receiving, at a machine learning model, an input for a task of the machine learning model, wherein the machine learning model comprises a plurality of residual blocks augmented with a plurality of augmented weight blocks that sample intermediate features from the plurality of residual blocks; applying the input to the machine learning model to perform the task, wherein the applying comprises applying the plurality of intermediate features, which are obtained from the plurality of residual blocks, to the plurality of augmented weight blocks to form a plurality of intermediate outputs; and generating an output of the machine learning model, wherein the output is generated using at least on a combination of the plurality of intermediate outputs. Related systems, methods, and articles of manufacture are also disclosed.
Owner:RGT UNIV OF CALIFORNIA

Flight delay prediction method and system, computer equipment and storage medium

The invention provides a flight delay prediction method and system, computer equipment and a storage medium, and belongs to the technical field of traffic delay prediction.The method comprises the steps that firstly, a bacterial foraging algorithm (BFA) is optimized through a genetic algorithm (GA) so as to improve the global search ability and convergence speed of the algorithm; secondly, optimizing the structure and parameters of a deep neural network DNN by using the optimized BFA algorithm, and constructing a deep neural network model based on double hidden layers; according to the model, an attention mechanism and a residual block are introduced, so that the nonlinear mapping capability and the generalization capability are improved, and model overfitting is effectively prevented. In addition, the flight data and the weather condition data are combined, so that the prediction accuracy is further improved. The performance of the model is evaluated through multiple indexes, the result shows that the method can effectively solve the problem of DNN structure and parameter selection, and the training efficiency and generalization ability of the model are remarkably improved.
Owner:CIVIL AVIATION UNIV OF CHINA

Quality control classification method and system suitable for laryngeal knot DR images

The invention relates to a quality control classification method and system suitable for laryngeal knot DR images, and the method comprises the steps: carrying out the preprocessing of each obtained historical laryngeal knot DR image, and obtaining a preprocessed image; dividing a training set, a verification set and a test set according to a preset distribution proportion based on the preprocessed historical laryngeal knot DR image set; the training set and the verification set are input into a classification network model for model training, the classification network model is composed of a plurality of cascaded residual blocks, and after output of each residual block, an attention and multi-scale aggregation module is integrated, so that an attention and multi-scale aggregation model is formed; the attention and multi-scale aggregation module is composed of a CBAM space channel attention module and an MSAA multi-scale feature aggregation module which are arranged in sequence; inputting the test set into the trained classification network model, and optimizing model parameters based on a model performance evaluation result; and acquiring a real-time laryngeal knot DR image, inputting the real-time laryngeal knot DR image into the trained and optimized classification network model, and processing the real-time laryngeal knot DR image to obtain a corresponding classification result.
Owner:WUHAN JULEI TECH CO LTD

Hadamard transform screen-resistant watermarking method based on deep learning

This invention discloses a deep learning-based Hadamard transform-based anti-screen-capture watermarking method, belonging to the field of watermarking technology. This invention combines a convolutional neural network (CNN) and residual blocks to achieve an end-to-end process of watermark embedding and extraction within the Hadamard domain. By simulating screen-capture attacks and incorporating this method between the embedding and extraction layers, the network ensures robust watermark embedding. This method can efficiently extract watermark information from photos taken by surreptitiously, protecting the copyright of digital media. The use of the transform domain for watermark embedding allows the watermark to spread over a wider area of ​​the image, significantly improving the robustness of the watermarking algorithm. Comparison with related technologies demonstrates the superiority of this invention in terms of imperceptibility and robustness.
Owner:HANGZHOU DIANZI UNIV

Adaptive edge-aware three-dimensional medical image segmentation method

This invention discloses an adaptive edge-aware 3D medical image segmentation method, with the following specific steps: S1, constructing an adaptive edge-aware network, which includes an encoder and a decoder, with a skip connection between the encoder and decoder; S2, acquiring and processing a 3D medical image; S3, inputting the preprocessed image from step S2 into the encoder of the adaptive edge-aware network through a patch partitioning layer, then into the decoder through residual blocks and adaptive weight matching blocks. The decoder output and the original input image are skip-connected through adaptive weight matching blocks, and finally, the image segmentation result is output through residual blocks and Fourier convolution. This invention exhibits stronger robustness and boundary accuracy in multi-organ 3D segmentation tasks, providing an efficient and scalable solution for medical image segmentation.
Owner:ZHEJIANG SCI-TECH UNIV

Encoding method, decoding method, bitstream, encoder, decoder, and storage medium

Disclosed in the present application are an encoding method, a decoding method, a bitstream, an encoder, a decoder, and a storage medium. The method comprises: decoding a bitstream, so as to determine the value of first syntax identifier information; when the first syntax identifier information indicates that a multi-transform combination mode is applied to the current block, determining at least two first transform coefficients of the current block; determining at least two transform cores of the current block, and performing inverse transform on the at least two first transform coefficients respectively on the basis of the at least two transform cores, so as to determine at least two first residual blocks of the current block; and determining a reconstructed block of the current block on the basis of the at least two first residual blocks. In this way, the processing efficiency can be improved, thereby improving the encoding and decoding performance.
Owner:GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD

A dynamic obstacle avoidance method for assisting the blind

This invention discloses a dynamic obstacle avoidance method for assistive visually impaired scenarios. First, a feature extraction module based on a hierarchical residual structure constructed within residual blocks is built, which expands the receptive field of deep features. Second, a spatial feature recovery module based on bilinear interpolation and transposed convolution upsampling is designed to make segmentation edges more accurate. Third, a discrete sampling strategy is used to extract obstacle category, distance, and contour information, and path planning is performed using a heuristic search algorithm considering safe distance constraints. Finally, priority rules and logical order rules for the obstacle avoidance warning system are assumed, and a decision is generated based on the planned path, effectively guiding blind users to avoid obstacles through auditory and tactile information. This invention solves the problem that single-stage instance segmentation algorithms struggle to simultaneously and accurately segment small target obstacles and background road surfaces, overcoming the difficulty of providing effective information for obstacle avoidance decisions in assistive visually impaired scenarios with instance segmentation results, enabling blind users to avoid obstacles more intelligently and autonomously.
Owner:BEIJING UNIV OF CHEM TECH