318 results about "Scene segmentation" patented technology

Systems and methods for automatically matching in real-time an advertisement with a video desired to be viewed by a user are provided. A database is created that stores one or more attributes (e.g., visual metadata relating to objects, faces, scene classifications, pornography detection, scene segmentation, production quality, fingerprinting) associated with a plurality of videos. Supervised machine learning can be used to create signatures that uniquely identify particular attributes of interest, which can then be used to generate the attributes associated with the plurality of videos. When a user requests to view an on-line video having associated with it an advertisement, an advertisement can be selected for display with the video based on matching an advertiser's requirements or campaign parameters with the stored attributes associated with the requested video, with the user's information, or a combination thereof. The displayed advertisement can function as a hyperlink that allows a user to select to receive additional information about the advertisement. The performance or effectiveness of the selected advertisements can be measured and recorded.

The invention discloses a depth extraction method of merging motion information and geometric information, which comprises the following steps: (1) carrying out scene segmentation on each frame of two-dimensional video image, and separating the static background and the dynamic foreground; (2) processing a scene segmentation chart by binaryzation and filtering; (3) generating a geometric depth chart of the static background based on the geometric information; (4) calculating the motion vector of the foreground object, and converting the motion vector into the motion amplitude; (5) linearly transforming the motion amplitude of the foreground object according to the position of the foreground object, and obtaining a motion depth chart; and (6) merging the motion depth chart and the geometricdepth chart, and filtering to obtain a final depth chart. The method only calculates the motion vector of the separated dynamic foreground object, thereby eliminating the mismatching points of the background and reducing the amount of calculation. Meanwhile, the motion amplitude of the foreground object is linearly transformed according to the position of the foreground object, the motion amplitude is merged into the background depth, thereby integrally improving the quality of the depth chart.

The invention discloses a generative adversarial network-based pixel-level portrait cutout method and solves the problem that massive data sets with huge making costs are needed to train and optimizea network in the field of machine cutout. The method comprises the steps of presetting a generative network and a judgment network of an adversarial learning mode, wherein the generative network is adeep neural network with a jump connection; inputting a real image containing a portrait to the generative network for outputting a person and scene segmentation image; inputting first and second image pairs to the judgment network for outputting a judgment probability, and determining loss functions of the generative network and the judgment network; according to minimization of the values of theloss functions of the two networks, adjusting configuration parameters of the two networks to finish training of the generative network; and inputting a test image to the trained generative network for generating the person and scene segmentation image, randomizing the generated image, and finally inputting a probability matrix to a conditional random field for further optimization. According tothe method, a training image quantity is reduced in batches; and the efficiency and the segmentation precision are improved.

A system is provided for adaptively conformed imaging of work pieces having disparate configurations, which comprises a mount unit for holding at least one work piece, and an imaging unit for capturing images of the work piece held by the mount unit. At least one manipulator unit is coupled to selectively manipulate at least one of the mount and imaging units for relative displacement therebetween. A controller coupled to automatically actuate the manipulator and imaging units executes scene segmentation about the held work piece, which spatially defines at least one zone of operation in peripherally conformed manner about the work piece. The controller also executes an acquisition path mapping for the work piece, wherein a sequence of spatially offset acquisition points are mapped within the zone of operation, with each acquisition point defining a vantage point for the imaging unit to capture an image of the work piece from.

The invention discloses a deep learning based automatic checking method against a vehicle lane-pressing illegal behavior. The method comprises the following steps that a snapshot picture of a camera is obtained, cut and ordered; the license plate number of a target vehicle is obtained; a deep learning based target vehicle detection module is used to detect the target vehicle in different ordered images, and a target vehicle detection frame is obtained; scene cutting is carried out on the ordered image by means of deep learning based scene cutting module, and segmented solid line pixels are obtained; in each ordered image, a vehicle lane pressing illegal behavior determining module determines whether there is an intersection point between a solid line fitting straight line and a straight line of a lower frame of the target vehicle detection frame by calculation; and whether the target vehicle in the group of ordered images has a lane pressing illegal behavior is determined according toposition of the intersection point. Thus, the method is suitable for illegal behavior checking via the pictures shot by traffic cameras in the real scene.

The invention relates to a scene segmentation method and device, computer equipment and a storage medium, and relates to the technical field of machine learning. The method includes: inputting the image to be identified into the deep neural network; carrying out depth separable convolution on the image through the down-sampling module; obtaining a first feature map of which the size is smaller than that of the image; performing hole convolution on the first feature map through a hole space pyramid pooling module; obtaining a second feature map of different scales, performing depth separable convolution on the second feature maps of different scales through an up-sampling module to obtain a third feature map with the same size as the image, and classifying each pixel in the third feature map through a classification module to obtain a scene segmentation result of the image. According to the invention, the calculation amount of scene segmentation through the deep neural network can be reduced, and the accuracy of scene segmentation through the deep neural network can be ensured.

The invention discloses an automatic driving processing method and apparatus based on scene segmentation and a computing device. The method comprises the following steps: a current frame image in thevideo shot and/or recorded via an image collection device is obtained in real time during vehicle driving processes, the current frame image is input into a second neural network to obtain a scene segmentation result corresponding to the current frame image, the second neural network is obtained after output data of at least one intermediate layer of the pre-trained first neural network is subjected to guiding and training operation, and the first neural network is greater than the second neural network in terms of layer quantity. According to a scene segmentation result, a driving route and/or a driving instruction is determined; autonomous driving control is exerted on a vehicle is according to the determined driving route and/or driving instruction. Via use of the automatic driving processing method and apparatus based on scene segmentation and the computing device, the neural network with a small number of layers after training operation is used for achieving fast and accurate calculation so as to obtain the scene segmentation result, the scene segmentation result used for accurately determining the driving route and/or the driving instruction, and improvement of automatic driving safety can be facilitated.

A system and method are disclosed for learning a random multinomial logit (RML) classifier and applying the RML classifier for scene segmentation. The system includes an image textonization module, a feature selection module and a RML classifier. The image textonization module is configured to receive an image training set with the objects of the images being pre-labeled. The image textonization module is further configured to generate corresponding texton images from the image training set. The feature selection module is configured to randomly select one or more texture-layout features from the texton images. The RML classifier comprises multiple multinomial logistic regression models. The RML classifier is configured to learn each multinomial logistic regression model using the selected texture-layout features. The RML classifier is further configured to apply the learned regression models to an input image for scene segmentation.

The invention discloses a video semantic scene segmentation method based on a convolutional neural network, which is mainly divided into two parts, wherein one part is that a convolutional neural network is built on the basis of shot segmentation, and then semantic feature vectors of video key frames are obtained by using the built convolutional neural network; and the other part is that the Bhattacharyya distance between the semantic feature vectors of two shot key frames is calculated by using the time continuity of the front and back key frames according to the semantic feature vectors, andthe semantic similarity of the shot key frames is obtained through measuring the Bhattacharyya distance. Probability estimation values of different semantics are outputted by using the convolutionalneural network to act as a semantic feature vector of the frame. Considering a time sequence problem of scene partition in the continuous time, the shot similarity is compared by combining semantic features of the two shot key frames and the time sequence feature distance between the shots, and thus a final scene segmentation result is obtained. The method disclosed by the invention has certain universality and has a good scene segmentation effect under the condition that training sets are sufficient.

The invention discloses an image scene segmentation and layering joint solution method based on component set sampling. The method comprises the following steps of: performing over-segmentation treatment on an input image to obtain a super-pixel set of the image; training on a training dataset to obtain a discriminant model of semantic category and a discriminant model of layer category, and obtain a probability value (of each super-pixel in the input image) belonging to each semantic category and a probability vale belonging to each layer category according to the two models; structuring a candidate graph structure of the input image and calculating a node weighted value, a positive side weighted value and a negative side weighted value; and based on the a candidate graph structure, obtaining an optimal solution by reasoning via a component set sampling algorithm, wherein the optimal solution includes the exact semantic category and the exact layer category of each super-pixel of the input image. The method disclosed by the invention can be widely used for semantic information and layer information labeling of computer visual systems of military, aviation, aerospace, monitoring and manufacturing, and the like.

The invention discloses a sky detection algorithm based on context inference. The algorithm comprises establishment of a sky sample data set, a scene segmentation algorithm, extraction of super-pixel features, classifier training and establishment of a context inference model. A training classifier can be used to detect the sky area preliminarily; the CRF context inference model is established, so that the detection precision is further improved via context limitation, and a detection precision higher than a present algorithm is obtained; and a balance is made between the detection precision and the detection speed, and the practical requirements are met.

The video semantic scene segmentation and labeling method of the present invention comprises the following steps: offline training a deep convolutional neural network based on a labeled scene image set, and constructing a scene classifier; calculating a similarity between adjacent video frames in a video sequence and grouping the video frames according to the similarity; adaptively adjusting a similarity threshold to obtain video frame packet groups with uniformly distributed number of video frames; merging the frame groups including too few frames, splitting the frame groups including too many frames to readjust a video frame grouping result; selecting a representative video frame for each video frame group; using the scene classifier to identify the scene categories of the video frame groups; and performing semantic scene segmentation and labeling on the video sequence. The method provides an effective means for video retrieval and management, and improves the experience and fun forthe users to watch the videos.

The invention discloses a road scene segmentation method based on a residual network and expanded convolution. The method comprises: a convolutional neural network being constructed in a training stage, and a hidden layer of the convolutional neural network being composed of ten Respondial blocks which are arranged in sequence; inputting each original road scene image in the training set into a convolutional neural network for training to obtain 12 semantic segmentation prediction images corresponding to each original road scene image; calculating a loss function value between a set formed by12 semantic segmentation prediction images corresponding to each original road scene image and a set formed by 12 independent thermal coding images processed by a corresponding real semantic segmentation image to obtain an optimal weight vector of the convolutional neural network classification training model. In the test stage, prediction is carried out by utilizing the optimal weight vector of the convolutional neural network classification training model, and a predicted semantic segmentation image corresponding to the road scene image to be subjected to semantic segmentation is obtained. The method has the advantages of low calculation complexity, high segmentation efficiency, high segmentation precision and good robustness.

The invention discloses a deep learning based video retrieval method which mainly comprises the following parts: performing video pre-processing by using a convolutional neural network; extracting feature vectors of the video after pre-processing by using a long short-term memory; and finally learning by a similarity learning algorithm to obtain a distance calculation method, and performing similarity calculation according to the method and ranking, so as to obtain a video retrieval result. According to the method disclosed by the invention, scene segmentation and key frame selection are performed by the convolutional neural network, and high-level semantics representing video is extracted, so as to acquire a proper quantity of key frame sequences, and effectively avoid false detection andmissing inspection in shot segmentation. According to method disclosed by the invention, time-order characteristics of the video are extracted by the long short-term memory, so as to obtain a more accurate retrieval result. By similarity learning and a text based matching method, matching accuracy of a similarity measurement method can be promoted. By adopting the method disclosed by the invention, accurate retrieval on a large scale of videos can be realized.

The invention discloses a scene-segmentation-based semantic watermark embedding method for a video resource. According to the scene-segmentation-based semantic watermark embedding method, a video semantic information set, containing content semantic information, control semantic information and optional physical attribute information, is firstly generated, an original video sequence of the video resource is then subjected to segmentation, and a scene video sequence with higher texture complexity and more dramatic interframe change is selected as a target scene video sequence; when the target scene video sequence is subjected to compressed coding, the control semantic information and the physical attribute information are embedded into I frames of each group of picture (GOP), the content semantic information is embedded into non-I frames, and a compressed code stream containing semantic watermarks is then generated; and the semantic information is represented by using the manners of plain texts and mapping codes and then respectively embedded into the non-I frames and I frames of GOPs of compressed codes of the target scene video sequence, so that the embedded amount of the semantic watermarks is increased, the robustness is enhanced, and meanwhile, the remarkable reduction of the quality of the video resource cannot be caused.

The invention discloses an image scene segmentation method, a device, a computing device and a computer storage medium. The image scene segmentation method is executed on the basis of a well trained scene segmentation network. The method comprises the following steps of acquiring a to-be-segmented image; inputting the to-be-segmented image into a scene segmentation network, wherein at least one layer of a convolution layer is formed in the scene segmentation network; subjecting the first convolution block of the convolution layer to scaling treatment by means of a scale coefficient outputted by a scale regression layer to obtain a second convolution block; carrying out the convolution operation of the convolution layer by utilizing the second convolution block to obtain the output result of the convolution layer, wherein the scale regression layer is a middle convolution layer of the scene segmentation network; and outputting a scene segmentation result corresponding to the to-be-segmented image. According to the technical scheme, the self-adaptive scaling of a sensing field is realized. The scene segmentation result can be quickly obtained through the trained scene segmentation network, and the image scene segmentation accuracy and the processing efficiency are improved.

The present invention provides an advertisement data processing method and device, and an advertisement putting method and device. The advertisement data processing method comprises: performing scene segmentation of video data, obtaining at least one video paragraph data, and distributing only one video paragraph identification for each video paragraph; aiming each video paragraph data, performing scene classification of the video paragraph data and a plurality of advertisement data, and adding corresponding scene class label; distribute advertisement data having the same scene class label for the video paragraph data, and calculating the similarity score between the video paragraph data and each distributed advertisement data; distributing only one advertisement identification for each distributed advertisement, and generating the advertisement score list of the video paragraph data; and establishing a mapping relation between the video paragraph identification of the video paragraph data and the advertisement score list. The association degree between the video paragraph and each advertisement is obtained to provide guarantee for subsequently putting advertisements with high correlation degree.

The invention discloses a height information-based unmanned vehicle lane scene segmentation method. According to the method, a neural network is utilized to encode and decode a lane image, so that a thickened feature graph is obtained; pixels in the thickened feature graph are classified through a softmax classifier, so that a pixel point-based lane scene segmentation graph can be obtained; and the division of a vehicle road region and a non-road region is realized through using the correction of height information-based error processing; and therefore, noises generated in segmentation can be decreased, and problems such as the ambiguity of the boundaries of the road region and non-road region caused by the noises can be solved.

The invention discloses a de-convolutional neural network-based scene semantic segmentation method. The method comprises the following steps of: S1, extracting intensive feature expression for a scene picture by using a full-convolutional neural network; and S2, carrying out up-sampling learning and object edge optimization on the intensive feature expression obtained in the step S1 through utilizing a locally sensitive de-convolutional neural network by means of a local affinity matrix of the picture, so as to obtain a score map of the picture and then realize refined scene semantic segmentation. Through the locally sensitive de-convolutional neural network, the sensitivity, to the local edge, of the full-convolutional neural network is strengthened by utilizing local bottom layer information, so that scene segmentation with higher precision is obtained.

A method, apparatus and computer program product are provided to facilitate scene segmentation from focal stack images. The method may include receiving a set of focal stack images, calculating a focal measure for each of a plurality of pixels of the set of focal stack images, and grouping each of a plurality of pixels for which the focal measure was calculated into a plurality of super pixels. The method may also include calculating a focal measure for each of the plurality of super pixels, segmenting a respective focal stack image based on the focal measure of each of the plurality of super pixels, calculating a color probability for each of the plurality of super pixels, and segmenting each focal stack image based on color probability of each of the plurality of super pixels.