224 results about "Visual Word" patented technology

The invention discloses a remote sensing image classification method based on multi-feature fusion, which includes the following steps: A, respectively extracting visual word bag features, color histogram features and textural features of training set remote sensing images; B, respectively using the visual word bag features, the color histogram features and the textural features of the training remote sensing images to perform support vector machine training to obtain three different support vector machine classifiers; and C, respectively extracting visual word bag features, color histogram features and textural features of unknown test samples, using corresponding support vector machine classifiers obtained in the step B to perform category forecasting to obtain three groups of category forecasting results, and synthesizing the three groups of category forecasting results in a weighting synthesis method to obtain the final classification result. The remote sensing image classification method based on multi-feature fusion further adopts an improved word bag model to perform visual word bag feature extracting. Compared with the prior art, the remote sensing image classification method based on multi-feature fusion can obtain more accurate classification result.

The invention discloses a sparse dimension reduction-based spectral hash indexing method, which comprises the following steps: 1) extracting image low-level features of an original image by using an SIFT method; 2) clustering the image low-level features by using a K-means method, and using each cluster center as a sight word; 3) reducing the dimensions of the vectors the sight words by using a sparse component analysis method directly and making the vectors sparse; 4) resolving an Euclidean-to-Hamming space mapping function by using the characteristic equation and characteristic roots of a weighted Laplace-Beltrami operator so as to obtain a low-dimension Hamming space vector; and 5) for an image to be searched, the Hamming distance between the image to be searched and the original image in the low-dimensional Hamming space and using the Hamming distance as the image similarity computation result. In the invention, the sparse dimension reduction mode instead of a spectral has principle component analysis dimension reduction mode is adopted, so the interpretability of the result is improved; and the searching problem of the Euclidean space is mapped into the Hamming space, and the search efficiency is improved.

The present invention provides an improved closed-loop detection algorithm-based mobile robot vision SLAM (Simultaneous Location and Mapping) method. The method includes the following steps that: S1,Kinect is calibrated through a using the Zhang Dingyou calibration method; S2, ORB feature extraction is performed on acquired RGB images, and feature matching is performed by using the FLANN (Fast Library for Approximate Nearest network); S3, mismatches are deleted, the space coordinates of matching points are obtained, and inter-frame pose transformation (R, t) is estimated through adopting thePnP algorithm; S4, structureless iterative optimization is performed on the pose transformation solved by the PnP; and S5, the image frames are preprocessed, the images are described by using the bagof visual words, and an improved similarity score matching method is used to perform image matching so as to obtain closed-loop candidates, and correct closed-loops are selected; and S6, an image optimization method centering cluster adjustment is used to optimize poses and road signs, and more accurate camera poses and road signs are obtained through continuous iterative optimization. With the method of the invention adopted, more accurate pose estimations and better three-dimensional reconstruction effects under indoor environments can be obtained.

The invention provides a mass video semantic annotation method based on Spark. The method is mainly based on elastic distributed storage of mass video under a Hadoop big data cluster environment and adopts a Spark computation mode to conduct video annotation. The method mainly comprises the following contents: a video segmentation method based on a fractal theory and realization thereof on Spark; a video feature extraction method based on Spark and a visual word forming method based on a meta-learning strategy; a video annotation generation method based on Spark. Compared with the traditional single machine computation, parallel computation or distributed computation, the mass video semantic annotation method based on Spark can improve the computation speed by more than a hundred times and has the advantages of complete annotation content information, low error rate and the like.

An improved method and apparatus for localizing objects within an image is disclosed. In one embodiment, the method comprises accessing at least one object model representing visual word distributions of at least one training object within training images, detecting whether an image comprises at least one object based on the at least one object model, identifying at least one region of the image that corresponds with the at least one detected object and is associated with a minimal dissimilarity between the visual word distribution of the at least one detected object and a visual word distribution of the at least one region and coupling the at least one region with indicia of location of the at least one detected object.

The invention discloses an image retrieval method, an image retrieval device and an image retrieval system, wherein the image retrieval method comprises the following steps: extracting the local features of a query image, and quantizing the local features into visual words; querying a preset visual-word inverted list in an image database by using the visual words so as to obtain matched local-feature pairs and matched images; respectively carrying out space encoding on relative space positions between matched local features in the query image and the matched images so as to obtain a space code picture of the query image and space code pictures of the matched images; executing a space consistency check on the space code picture of the query image and the space code pictures of the matched images so as to obtain the number of the matched local-feature pair in conformity with the space consistency; and according to the numbers of the matched local-feature pairs (in conformity with the space consistency) of different matched images, returning to the matched images according to the similarity of the matched images. By using the method provided by the invention, the image retrieval accuracy and the retrieval efficiency can be improved, and the time consuming for retrieval can be reduced.

The invention provides a probabilistic latent semantic model object image recognition method with the fusion of a significant characteristic of a color, belonging to the field of image recognition technology. The method is characterized by: using an SIFT algorithm to extract a local significant characteristic of an image, adding a color characteristic simultaneously, generating a HSV_SIFT characteristic, introducing TF_IDF weight information to carry out characteristic reconstruction such that the local significant characteristic has discrimination more, using a latent semantic characteristicmodel to obtain an image latent semantic characteristic, and finally using a nearest neighbor KNN classifier to carry out classification. According to the method, not only is color information of theimage considered, but also the distribution of a visual word in a whole image set is fully considered, thus the local significant characteristic of an object has discrimination more, and the ability of recognition is raised.

The invention relates to a method for realizing the quick retrieval of mass videos. The method comprises the following steps: respectively extracting spatial feature vectors from all frame video images in a video stream of a video library to obtain video feature sequences; extracting key feature vectors from the spatial feature vectors; establishing a distributed storage index database according to the key feature vectors of all video files in the video library; extracting key feature vector sets of videos to be retrieved and extracting video index files of the videos to be retrieved; performing the video similarity retrieving in the distributed storage index database according to the video index files of the videos to be retrieved and outputting video retrieval results of the video files with the similarity larger than the preset value of the system. Through the adoption of the method with the structure, representative visual words are adopted to replace key frames, video information is completely represented, a large amount of redundant of video information does not exist, the video information is very compact, the retrieval speed is increased, and the method has mass data concurrent processing capacity, and is wider in application range.

A sign language recognizer is configured to detect interest points in an extracted sign language feature, wherein the interest points are localized in space and time in each image acquired from a plurality of frames of a sign language video; apply a filter to determine one or more extrema of a central region of the interest points; associate features with each interest point using a neighboring pixel function; cluster a group of extracted sign language features from the images based on a similarity between the extracted sign language features; represent each image by a histogram of visual words corresponding to the respective image to generate a code book; train a classifier to classify each extracted sign language feature using the code book; detect a posture in each frame of the sign language video using the trained classifier; and construct a sign gesture based on the detected postures.

The invention discloses an increment neural network and sub-graph code based image classification method. The increment neural network and sub-graph code based image classification method comprises the following steps of: extracting local characteristics; studying increment code books in a network; performing characteristic coding based on a sub-graph; getting image spaces together; and studying a classifier and predicting a model. The increment neural network and sub-graph code based image classification method greatly reduces time complexity of a traditional algorithm to a great extent as the code book can be studied efficiently, and the space relationship between visual words is also kept; in addition, the characteristic coding based on the sub-graph is specifically for performing characteristic coding by fully utilizing the space relationship between the visual words, so that more abundant semantic information can be extracted, and excellent classification performances are obtained finally while the computational efficiency of a classification system is increased. Therefore, the increment neural network and sub-graph code based image classification method has a relatively high use value.

The invention provides image searching method and system and a client side and a server, wherein the image searching method comprises the steps: the client side obtains a target image to be searched and first relevance information aiming at the target image, sends the first relevance information to the server, and obtains a vision word of the target image; the server searches a vision word dictionary in a vision word dictionary library inside the server based on the first relevance information, and sends the vision word dictionary to the client side; the client side obtains a target vision word based on the vision word dictionary sent by the server and sends the target vision word to the server; and the client side receives the target vision word, searches more than one result image corresponding to the target vision word and relevant expansion information and sends the result image and the relevant expansion information to the client side. The image searching method shortens the searching waiting time of a client, improves the searching performance and the efficiency and can be suitable for various fields.

Methods and systems of identification of objects in query images are disclosed. Keypoints in the query images are identified corresponding to objects to be identified. Visual words are identified in a dictionary of visual words for the identified keypoints. A set of hits is identified corresponding to reference images comprising the identified keypoints. Reference images corresponding to the identified set of hits are ranked using clustering of matches in a limited pose space. The limited pose space comprises a one-dimensional table corresponding to the rotation between the object to be identified with respect to the reference image. A first subset of M reference images that obtained a rank above a predetermined threshold is then selected. Offline, hybrid and combined offline and hybrid systems for performing the proposed methods are disclosed.

The invention discloses an extracting method for a local descriptor, an image searching method and an image matching method. The extracting method comprises the following steps of: obtaining more than one interesting point on a target image searched in advance; obtaining N sub-fan areas corresponding to each interesting point in the target image; aiming at each interesting point, establishing a pixel gradient directional histogram according to pixels in each of the N sub-fan areas, thereby obtaining N multi-dimensional original sub-local descriptors corresponding to N sub-fan areas; multiplying each of the multi-dimensional original sub-local descriptors with a preset weight, thereby obtaining N multi-dimensional weighted sub-local descriptors; searching for visual words similar to the multi-dimensional weighted sub-local descriptors in a preset quantized dictionary, thereby obtaining N visual words corresponding to each interesting point; and forming the local descriptor of the target image by all the searched visual words of the interesting points. The local descriptor obtained according to the extracting method has a better judging capability.

The invention provides a dictionary learning method. The dictionary learning method includes 1), dividing local characteristic vector of images into first segments and second segments on the basis of dimensionality; 2) establishing a first data matrix by the first segments of a plurality of local characteristic vectors, and establishing a second data matrix by the second segments of a plurality of local characteristic vectors; 3) subjecting the first data matrix to sparse non-negative matrix factorization to obtain a first dictionary sparsely coding the first segments of the local characteristic vectors; subjecting the second data matrix to sparse non-negative matrix factorization to obtain a second dictionary sparsely coding the second segments of the local characteristic vectors. The invention further provides a visual word bag characteristic extracting method for sparsely indicating the local characteristic vectors of the images segment by segment on the basis of the dictionaries and provides a corresponding retrieval system. Memory usage can be greatly reduced, wordlist training time and characteristic extraction time are shortened, and the dictionary learning method is particularly suitable for mobile terminals.

The invention discloses a method for recognizing human behavior based on a threshold matrix and a characteristics-fused visual word. The method is characterized by comprising the steps of extracting the visual word by the salience calculation method, namely, performing the salience calculation for a training video frame to obtain the location of an area of a human, detecting interesting points at the inside and outside of the area through different thresholds, and then calculating the visual word based on the obtained interesting points; molding and analyzing the obtained visual word, and constructing an action model; extracting the visual word from a testing video frame by the same salience calculation method after the construction mode is constructed; classifying the obtained visual word as input through the constructed action model; returning the action classification result as a human behavior label in the testing video, so as to finish the recognizing of the human behavior. With the adoption of the method, the accuracy of recognizing human behavior under a complex scene can be effectively ensured.

The invention relates to a remote sensing image land utilization scene classification method based on two-dimension wavelet decomposition and a visual sense bag-of-word model. The method comprises the steps that a remote sensing image land utilization scene classification training set is built; scene images in the training set are converted to grayscale images, and two-dimension decomposition is conducted on the grayscale images; regular-grid sampling and SIFT extracting are conducted on the converted grayscale images and sub-images formed after two-dimension decomposition, and universal visual word lists of the converted grayscale images and the sub-images are independently generated through clustering; visual word mapping is conducted on each image in the training set to obtain bag-of-word characteristics; the bag-of-word characteristics of each image in the training set and corresponding scene category serial numbers serve as training data for generating a classification model through an SVM algorithm; images of each scene are classified according to the classification model. The remote sensing image land utilization scene classification method well solves the problems that remote sensing image texture information is not sufficiently considered through an existing scene classification method based on a visual sense bag-of-word model, and can effectively improve scene classification precision.

The invention discloses an indoor common object identification method based on machine vision. The method comprises the following step of: (1) establishing a visual word bank of a kind of objects, and clustering the scale of the determiner bank through an mean value K; (2) preliminarily processing images, expressing an image with the words in the word bank, and approximately distinguishing a background and a foreground with similar threshold values; (3) describing the images, wherein the information contained in one image is mapped into a multi-dimensional column vector (x0,x1x2......xP-3xP-2xP-1y0y1y2......yQ-3yQ-2yQ-1) of 1*(P+Q), and the characteristics and the space relation in the images are vectorized, P is the emerging times of the word in the visual word bank, and Q is the statistics of the space relation; and (4) supporting a vector machine with a no-supervision identification classifier so as to realize the classified identification. With the adoption of the indoor common object identification method, the machine can identify the object more accurately.

The invention provides a depth feature-based image retrieval method and apparatus. The method comprises the steps of obtaining an image sample set; cutting each image in the image sample set into a plurality of image blocks with independent semanteme; extracting corresponding image features from the image blocks, and performing clustering operation on the extracted image features to determine visual words corresponding to the image features; constructing eigenvectors corresponding to the images in the image sample set according to the determined visual words, and forming an image index library through the eigenvectors; obtaining a to-be-retrieved target image, and extracting a target eigenvector corresponding to the target image; and matching the target eigenvector with the eigenvectors in the image index library, and feeding back a retrieval result of the target image according to a matching result. According to the depth feature-based image retrieval method and apparatus provided by the invention, the image retrieval precision can be improved.

The invention provides an image search method based on space symbiosis of visual words. The image search method comprises the following steps of: counting the symbiosis probability between any two visual words in a training database, and constructing a visual word symbiosis table; extracting a size constant characteristic of an input query image; randomly selecting the partial characteristic from the size constant characteristic as a central characteristic, and performing precise mapping on the central characteristic; counting neighboring characteristics in an affine constant region of the central characteristic; forecasting candidate visual words for the neighboring characteristics through a high-order probability forecaster according to the visual word symbiosis table and a precise mapping result; and comparing distances between the candidate words and the size constant characteristic, determining the optimal visual word, and performing image search. By the symbiosis of the visual words, the visual words can be produced effectively and quickly, and image search can be performed.