235results about How to "Enhanced description ability" patented technology

The invention discloses a pronunciation quality assessment and error detection method based on the fusion of multiple characteristics and multiple systems, which carries out assessment and error detection on pronunciation quality by a method utilizing multiple characteristic parameters to describe pronunciation quality and utilizing multiple inspecting systems to mutually fuse, and comprises the following steps: recognizing voice and automatically segmenting and aligning the voice; extracting the characteristic parameters used for voice quality assessment and error detection; acquiring pronunciation quality assessment and error detection model training data; training a plurality of pronunciation quality assessment and error detection systems; fusing a plurality of pronunciation quality assessment and error detection systems; and assessing pronunciation quality and detecting pronunciation errors. By utilizing the invention, multiple voice characteristics are effectively utilized, and multiple assessment and detection system are fully utilized and perform information fusion, thereby maximally exerting the advantages of various characteristics and systems, and ensuring the accuracy and reliability of pronunciation assessment and error detection.

The invention belongs to the crossing field of computer vision and intelligent robot, and discloses a new multi-feature multi-sensor method for a mobile robot to track a moving body. The method comprises the following steps: 1, coarsely positioning a body carrying a passive tag around a radio frequency identification (RFID) system by using the RFID system; 2, initially positioning the body in an image by using an adaptive template matching algorithm based on head and shoulder features; 3, accurately positioning the body in the image by using a multi-feature-based mean-shift algorithm; 4, predicting the moving state of the body by using a extended Kalman filter algorithm; 5, screening the acquired target position information by using a double-layer collaboration positioning mechanism; and 6, controlling the robot to move along with the body by using a robot following control algorithm. By the method, bodies with different poses can be tracked, the problem that the tracking is influenced when a target suddenly turns and is shielded is solved, and the robot can accurately, stably and continuously track the moving body.

The invention discloses an image retrieval method and an image retrieval device and relates to the field of image search. The method comprises the steps of extracting global characteristics of a picture and then carrying out dimension reduction; quantifying the characteristics into binary bit strings; and retrieving similar pictures from a database according to a distance of the binary bit strings. According to the image retrieval method and the image retrieval device, the description for the picture is accurate by use of the global characteristics, the data size of picture characteristics can be decreased through dimension reduction for the global characteristics, meanwhile as a dimension reduction model can allow the distance of the global characteristics, subjected to dimension reduction, of a picture to be decreased and the distance of the global characteristics subjected to dimension reduction of dissimilar pictures increases, the descriptive power is improved after the global characteristics of the picture are subjected to dimension reduction; furthermore, the picture characteristics are quantified into the the binary bit strings, the data complexity can be reduced, the data storage volume is decreased, the matching complexity during retrieval is reduced, the retrieval efficiency is improved, and the image retrieval processing power is enhanced to hundreds of millions of magnitude orders.

The invention discloses a video description method based on multi-feature fusion. The method is characterized in that (1) deep spatial-temporal features of a video are extracted by fusing traditional CNN features and SIFT flow features; (2) an S2VT sentence generation model with added average pooling features being video overall features is adopted to generate corresponding sentence description according to the deep spatial-temporal features extracted in the step (1); and (3) a word2vec word vector method is adopted to replace one-hot vector word representation to optimize the sentence generation model in the step (2). The method has the advantages that more robust spatial-temporal features can be better extracted through multi-feature fusion; meanwhile, the average pooling features are added into the sentence generation model, so that more relations are established between visual information and words; finally, the word2vec word vector method is adopted to replace one-hot vector word representation, so that more relations are established between words, and video description performance is effectively improved.

The invention discloses a night pedestrian detection method based on statistical features of infrared pedestrian brightness. According to the method, gray average information of parts of one pedestrian and a negative sample in a sample database is firstly subjected to statistical processing, a mapping interval boundary is determined by the aid of the information, and a brightness histogram feature for distinguishing vote interval division is constructed; then, a histogram feature in the gradient direction is calculated, and the two features are combined to form a final feature descriptor; secondarily, model training is performed by the aid of Adaboost in combination of a decision tree, and pedestrian determination and positioning are performed with a sliding window scanning method; finally, when a classifier obtains lower degree of confidence through classification judgment on a certain detection frame, a brightness interval template is adopted for secondary judgment, so that night pedestrian detection is realized. Pedestrians in the night environment are effectively detected, and the method has the characteristics of high detection rate and adaptability.

The invention provides a face recognition method and face recognition equipment. The method comprises the following steps of: performing down-sampling on an original face image to obtain down-sampled images with different sizes; blocking the down-sampled images and the original face image; performing characteristic extraction on each image block obtained by blocking; performing similarity matching on characteristics of each extracted image block and characteristics of the corresponding image block of a pre-registered face image to obtain the similarity of each image block; and obtaining a recognition result of the face image according to the obtained similarities of all the image blocks. According to the face recognition method and the face recognition equipment, the original face image is subjected to down-sampling to obtain the down-sampled images with different sizes for multi-size face image characteristic extraction, so that the capability of the characteristics of the face image in the description of the image face is improved; and the down-sampled images and the original face image are blocked, and the recognition result of the face image is obtained according to the obtained similarities of all the image blocks, so that the recognition accuracy of the face image is improved.

A web service modeling and the test method based on an interface semantic contract model relate to the fields of software test modeling and automatic test case generation. The web service test method comprises (1) building a service interface semantic contract model to expand descriptive capability of an existing service interface; (2) generating test input data and a test case according to description of the interface data ontology to provide input data for the test case; and (3) providing an expected output result for the test case according to regular test data. The web service modeling and the test method based on the interface semantic contract model have the advantages of being applicable to a web service test, capable of expanding the descriptive capability of the existing service interface, capable of being used for generating the test data and the test case and improving the degree of automation and intelligentization of test generation through knowledge descriptions and reasoning technologies.

The invention discloses a multilayer bitmap color feature-based image retrieval method. In the method, fast clustering is performed on an image with rich color information to obtain rational statistical distribution centers of each color cluster, and based on the rational statistical distribution centers, features capable of reflecting color differences among different distribution layers of the image are extracted to perform image retrieval. The method comprises the following steps of: first performing meshing on a color space of the queried image, counting the numbers of pixel points in each mesh and selecting the mesh with a number local maximum; then quickly generating each color cluster and the rational statistical distribution centers thereof by adopting a novel distance optimization algorithm and an equal-average nearest neighbor algorithm search (ENNS) algorithm in a K-average clustering algorithm, and on the other hand, performing space sub-block division on the queried image and calculating a Gaussian-weighted color average of sub-blocks; next comparing the color average of the image sub-blocks with the rational statistical distribution centers of the color clusters to extract the features of a K-layer bitmap; and finally performing the matched searching of the image features by combining the similarity measurements of the rational statistical distribution centers of the color clusters and the bitmap.

The invention discloses a robust learning model and an image classification system. The robust learning model comprises the steps that a training set is initialized so that an initial category tag matrix is obtained, and training samples in the training set include the samples of which the categories are known with calibration of category tags corresponding to the categories and the samples of which the categories are unknown without calibration of the category tags; the training samples are processed by a construction method based on neighboring definition and reconstruction weights, a reconstruction coefficient matrix is constructed according to similarity between the samples, and symmetrization and normalization processing is performed; soft tags without calibration samples are determined by utilizing the reconstruction coefficient matrix and the initial category tag matrix, and l2,1 normal regularization is performed on the soft tags of the training samples by adopting an iteration method so that a projection matrix and a soft tag matrix are obtained; mapping is performed on samples under test by utilizing the projection matrix so that the soft tags of the samples are obtained; and the samples under test are the samples of which the categories are unknown without calibration of the categories. Influence of mixed signals in an original space can be effectively reduced by the model so that classification accuracy can be enhanced.

The invention discloses a self-adaptive weight selected incremental characteristic background modeling method. The invention can conduct incremental real-time updating of a background model according to the movement contained in each video frame in the movement detection, and appoint a weight for every frame in the updating process to improve the expression and description abilities of the background model. The method comprises the following steps of: roughly detecting the movement area of the present frame by an un-updated background model, constructing a weight for the movement area based on the reconstruction error of the model, updating the background model by right of the incremental principal component analysis based on the weighted present frame and generating background images. With well expressing the dynamic changes of the complex scenes and being sensitive to the objects with obvious movement prospect, the inventive technique has great application value in the fields of video surveillance, etc.

The invention is suitable for the technical field of pattern recognition, and provides a human movement recognition method and device. The method comprises the steps: obtaining a depth image sequence, carrying out the conversion of the depth image sequence, and obtaining a corresponding depth movement sequence; carrying out the dividing of the depth movement sequence in the time dimension and space dimension, and obtaining a plurality of movement historical cubes and a plurality of corresponding space cube subblocks; calculating corresponding characteristic vectors corresponding to the movement historical cubes according to the space cube subblocks, and obtaining the characteristic vector of the depth movement sequence through combining the characteristic vectors corresponding to the plurality of movement historical cubes; and carrying out the model training and testing through employing an SVM (support virtual machine) according to the characteristic vector of the depth movement sequence, so as to obtain a recognition result of human movement. The method solves a problem of self-sheltering in a conventional human movement recognition method, improves the description capability for human movement, and improves the recognition accuracy of human movement.

The invention relates to a natural interactive method of a virtual learning environment based on speech emotion recognition, belonging to the field of depth learning. The method comprises the following steps: 1, collecting speech signals of students and users through kinect, resampling, adding windows by frames, and mute processing to obtain short-time single frame signals; 2, carrying out fast Fourier transform on that signal to obtain the frequency domain data, obtaining the pow spectrum thereof, and adopting a Mel filter bank to obtain a Mel spectrum diagram; 3, inputting the features of the Mel spectrum map into a convolution neural network, performing convolution operation and pooling operation, and inputting the matrix vectors of the last desample layer to the whole connecting layerto form a vector output feature; 4, compressing and inputting the output characteristic into a bi-directional long-short time memory neural network; 5, inputting the output features into a support vector machine to classify and output a classification result; 6, feeding back the classification result to the virtual learning system for virtual learning environment interaction. The invention driveslearners to adjust the learning state and enhances the practicability of the virtual learning environment.

The invention discloses a text multi-granularity similarity comparison method based on semantic aggregation fingerprints. The method comprises the following steps: training word vector representation;extracting semantic features; performing multi-feature aggregation; constructing a hierarchical index; calculating similarity. According to the method, word vector representation modeling is carriedout in combination with multi-dimensional semantic correlation; semantic information among words is fully mined; characteristics are extracted by taking sentences as units, semantic features are represented by adopting multiple weights, text library statistics and distribution information are mined by utilizing a statistical learning method, finer division of a feature space is realized, a compacttext fingerprint with high identification degree is generated on the basis of multi-feature aggregation, and the description capability and the discrimination degree of the text fingerprint are effectively improved. According to the method, text similarity comparison is carried out by adopting a top-down thought and using semantic aggregation fingerprint and local semantic features, and global-to-local multi-granularity similarity comparison of texts can be quickly and efficiently realized by constructing hierarchical indexes; the method has good expandability.

The invention provides a micro expression automatic identification method based on multiple-dimensioned sampling. The method comprises micro expression image sequence preprocessing, micro expression feature extraction and micro expression identification. For the purpose of reducing influences exerted by face natural displacement and an ineffective area on micro expression identification, a method for automatically aligning a face and effectively partitioning a face area, and thus the robustness of an identification result is improved; and for the purpose of solving the defect of an existing feature descriptor, the invention brings forward a novel micro expression feature description operator CPTOP, the CPTOP operator the same sampling point number as a LBP-TOP operator yet employs a multiple-dimensioned sampling strategy, and under the same time complexity and space complexity, better description information is obtained.

The invention discloses an automatic identification method and system for a vehicle logo. The automatic identification system for the vehicle logo comprises an offline training subsystem and an online identification subsystem. Features of the vehicle logo are extracted by adopting dense scale invariant feature transform (dense-SIFT), and abundant and stable features which are identifiable and discriminative can be extracted from a low-resolution vehicle logo picture; clustering analysis is performed on the dense-SIFT features, and a visual word bank and a K-dimension (KD) tree index are established so as to accelerate computation speed; according to the relevance between the dense-SIFT and visual words, the dense-SIFT is mapped into all visual words for representation to enhance feature descriptiveness; when a visual word histogram is established, a rectangular-ambulatory-plane spatial pyramid is proposed to increase the spatial position information of the features ,and thus, discriminating effect is promoted; and by adopting a support vector machine (SVM) training vehicle logo classifier, vehicle logo identification is realized. The automatic identification system for the vehicle logo disclosed by the invention still has high identification rate on the low-resolution picture, has high robustness on blocking, illumination, weather and shooting angle changes and the like, is short in computation time and has real-time performance.

The invention discloses a gradient binaryzation based rotation-invariant and scale-invariant scene matching method, and relates to the field of scene recognition. According to the method, on the basis of a classical binary description BRIEF algorithm in which only gray scale intensity is compared, horizontal and vertical gradient comparison is added, texture information of a sampled area is saved, and accordingly, matching error rate is reduced. Moreover, an image scale pyramid is created, image feature point detection and feature description are performed within different scales, gravity center vector directions are added during descriptor calculation, and direction and scale invariance of binary descriptors is achieved. Experiments show that binaryzation based rotation-invariant gradient sampling descriptors have high robustness, and the matching accuracy rate is 73.06% higher than that of the BRIEF algorithm in average when a scene image is rotated greatly and the scale is varied.

The invention discloses a method for detecting changes of a remarkable target of a remote sensing image. The method comprises the steps that a remarkable target area is extracted from a reference image; the reference image and an input image are sampled, and sampling points are used for approximately representing the remarkable target area; DAISY characters of the sampling points are extracted; a plurality of candidate matching points are searched in a sampling point set of the input image for the sampling points of the reference image; an optimal matching point is searched in the corresponding candidate matching point set for a sampling point set of the remarkable target area, and the distance between optimal matching point sets serves as the change feature of the corresponding remarkable target area; whether an area, corresponding to the remarkable target area, in the input image changes or not is determined. By means of the method, a large amount of redundant information is filtered, practicability of detection on the changes of the remote sensing image is improved, description capacity and robustness for view angle conversion and registering errors of the area are improved, and inter-class divisibility of the change class and the non-change class is improved. The method can be widely applied to various fields such as disaster monitoring and target reconnaissance.