132 results about "Crowd counting" patented technology

The invention provides a multi-modal crowd counting method and system, and the method comprises the steps: obtaining an image, and extracting the image features of the image, the image comprising a visible light modal image and a thermal infrared modal image; image features of the visible light modal image and the thermal infrared modal image are subjected to attention through spatial frequency in a spatial frequency guiding module layer by layer to generate a target attention map; fusing the image features of the visible light modal image and the thermal infrared modal image of each level and the target attention map through an adaptive dynamic fusion module to obtain each multi-modal fusion feature; according to the multi-modal crowd counting method, a prediction density map is generated from each multi-modal fusion feature through a multi-scale progressive fusion module, the multi-scale progressive fusion module is composed of cavity space pyramid pooling and Swin Transform Block, and through the modules designed in the steps, the problems that multi-modal crowd counting errors are large and counting precision is low can be effectively solved.

The invention relates to the technical field of crowd counting, in particular to a crowd counting method based on a DGCC-Net model, and the method comprises the steps: obtaining a crowd counting image; a DGCC-Net model is constructed, and pre-training is carried out; extracting a multi-scale feature map from the crowd counting image by using a feature extraction network; a local attention module is used for extracting context information and detail information of a crowd region from a feature map on a high-resolution scale in the multi-scale feature map, and a high-resolution feature map is obtained; feature fusion of semantic and detail information is carried out on a feature map on a low-resolution scale and a high-resolution feature map in the multi-scale feature map by using a multi-level feature fusion network, and a density guide feature map is generated from the fused feature map through a density guide module; and predicting a crowd counting result according to the density guide feature map by using a prediction network. According to the invention, the counting precision and robustness are improved when crowd scenes with uneven density distribution are processed.

The invention discloses a crowd counting and positioning early warning method based on a multi-scale attention mechanism, and the method comprises the steps: obtaining an image of a public region, detecting the head of an individual in the image, and carrying out the frame selection and marking; performing data preprocessing on the image; performing multi-scale feature extraction on the image by using a pre-trained ResNet50 network; carrying out position coding on the extracted image features and introducing learnable scale coding; adjusting rounds and the maximum number of training iterations according to a preset learning rate, and controlling a model training process; enabling the model network to convert the input image into specific output data; the data processed by the model is used for visualization processing, and a visualization result is sent to a central monitoring system for monitoring and managing people flow in public places in real time; according to the invention, the problems of accuracy and efficiency of crowd counting and positioning in complex scene processing by the existing monitoring system are solved.

The invention belongs to the technical field of image analysis, and particularly relates to a multi-expert voting type crowd counting method based on scene understanding, which comprises the following steps of: extracting visual features from an input image and extracting text features from a text prompt by utilizing a backbone network comprising an image encoder, a text encoder and a feature enhancer; projecting the text features into an embedding space which is the same as the visual features for alignment; constructing a local subject expert used for local crowd target detection, a global context expert used for understanding the overall layout of the scene, a spatial relationship expert used for modeling the spatial relationship between crowds, and an attribute feature expert used for processing the appearance and attribute information of the target in the scene; a knowledge distillation strategy is adopted, and experts are trained in a fine-grained mode; and obtaining the output of each expert, and outputting a final counting result through a decoder. According to the method, the fine-grained crowd counting performance in a complex scene can be optimized by utilizing a voting mechanism and a knowledge distillation strategy of a multi-expert system.

The invention discloses a cross-modal feature extraction and adaptive fusion crowd counting system and method, and belongs to the technical field of computer vision. The crowd counting system comprises a visible light image acquisition module and a thermal infrared image acquisition module which are parallel; a visible light double-layer feature extraction network layer and a visible light feature preference selection interaction layer are sequentially connected behind the visible light image acquisition module, and a thermal infrared double-layer feature extraction network layer and a thermal infrared feature preference selection interaction layer are sequentially connected behind the thermal infrared image acquisition module. A common lightweight cross-modal feature interaction fusion attention module and a crowd density map estimation module are connected behind the visible light feature preference selection interaction layer and the thermal infrared feature preference selection interaction layer, and crowd counting can be realized by using a crowd density map obtained by the system. The method can effectively solve the problem that the counting performance is limited due to the fact that different hierarchical features cannot be adaptively fused according to the current scene.

The invention discloses a video crowd counting method based on a cascaded cross-domain feature interaction network. The method comprises the following steps: carrying out data enhancement processing of random cutting and horizontal flipping on a current frame and front and back frames of the current frame; and constructing a cross-domain feature interaction network composed of a spatial domain branch and a frequency domain branch. The frequency domain branch extracts frequency domain feature output of different stages through a high and low frequency signal aggregation module and a feature encoder based on adjacent frames; the spatial domain branch is based on a single-frame image, and static spatial semantic features are extracted through a feature encoder. Cascade fusion is carried out on the double-branch features on multiple scales, two-way channel cross attention is utilized to reconstruct time sequence correlation frequency domain features of a current frame, and fusion and reconstruction of the two domain features are achieved through a cross-domain feature mutual modulation module. And after the reconstructed double-branch features are processed by the fusion network, outputting a crowd density map of the current frame by a density regression head. And after training is completed, storing the optimal model for video crowd counting. According to the invention, through cross-domain feature cascade and bidirectional time sequence modeling, the accuracy and robustness of crowd counting in a video scene are effectively improved.

The invention discloses a multi-scale crowd counting method and system based on VSSM and mask reconstruction and a medium, and belongs to the field of computer vision and deep learning, and the method comprises the steps: carrying out the multi-scale transformation and segmentation operation of an input crowd image, so as to obtain an image block under each scale; analyzing each image block to obtain an information entropy graph, performing masking operation on each image block according to the information entropy graph, inputting the masked image block into a VSSM to perform feature extraction so as to obtain coding features, performing decoding reconstruction on the coding features through a Transform decoder, and finally obtaining a reconstructed feature image; fusing the reconstructed feature images of different scales by using a multi-scale fusion module to generate fused features; and generating a crowd density map based on the fusion features, and analyzing the crowd density map to obtain a crowd counting result. Counting errors caused by single-scale analysis are avoided, and the crowd counting precision in a full-scale range is remarkably improved.

The invention provides a crowd counting method and device for a dense scene, electronic equipment and a storage medium, and belongs to the field of intelligent traffic, and the method comprises the steps: inputting an obtained to-be-detected crowd image into a completely trained crowd counting network, carrying out the grouping type pyramid feature convolution of the to-be-detected crowd image, and obtaining a preliminary convolution feature, performing frequency domain conversion enhancement on the preliminary convolution features to obtain frequency domain enhanced features, performing visual information modeling on the frequency domain enhanced features to obtain visual modeling enhanced features, and performing density regression output on the visual modeling enhanced features to obtain an estimated density map; and performing peak point filtering on the estimated density map to obtain crowd counting recognition output. According to the method, the image is converted to the frequency domain through frequency domain conversion enhancement to capture the contour and features of the pedestrian, the pedestrian feature precision is improved, visual information modeling is carried out on the pedestrian features in global and medium-long distance levels through visual information enhancement, more complete feature information is obtained, and the crowd counting accuracy is effectively improved.

The invention discloses a domain adaptive crowd counting method based on multi-aspect fine-grained alignment. The method comprises the following steps: 1, weighted sampling of a source domain image and a target domain image; 2, image coding and density map generation of a source domain and a target domain; 3, crowd density alignment based on conditional domain adversarial training; 4, image style alignment based on comparative learning; 5, optimizing model parameters on the crowd counting data set; and 6, performing crowd density map prediction by using the optimized model. According to the method, crowd specific information related to the target domain can be extracted, interference of irrelevant source domain features is filtered, crowd distribution of the source domain and the target domain is aligned in a fine-grained mode from multiple aspects, and the crowd distribution of the target domain is accurately aligned through weighted sampling and two loss functions related to distribution alignment. The consistency of the number of training samples, crowd density and image styles of the source domain and the target domain is constrained respectively, so that crowd distribution between the source domain and the target domain is correctly aligned, and generalization and robustness of a cross-domain crowd counting model can be improved.

The invention discloses a weakly supervised crowd counting method based on a cross-type window self-attention mechanism. The method comprises the following steps: 1) performing feature extraction on a target picture by adopting the cross-type window self-attention mechanism; (2) a CSWinCrowd structure based on global average pooling and regression Token is introduced; the method comprises the steps of (1) designing a CSWinwd-Token scheme based on a learnable position coding module, (2) designing a CSWinCrowd-Token scheme based on a learnable position coding module, and (4) providing a crowd counting model based on CSWinTransform for crowd counting of a target picture in combination with the steps (S1) to (S3). According to the method, the dependency relationship between different positions in a sequence can be well captured, and the problem that the counting effect is poor when the crowd density change of a current Transform model is large is solved.

The invention discloses a lightweight crowd counting and positioning method, and the method comprises the steps: building a brand-new lightweight crowd counting and positioning network, designing a grouping feature pairing interaction module, carrying out the grouping of feature maps, splicing adjacent groups, learning the context relation between feature groups, generating a dynamic attention weight to enhance the expression of key features, and carrying out the recognition of the key features. Therefore, the recognition capability of the target in the complex shielding scene is improved. A multi-stage training strategy is adopted, backbones, positioning branches, segmentation branches and lightweight adapter modules are sequentially and independently trained, and stable convergence of the multi-task capability of the model is ensured; according to the method, excellent performance is achieved on the public crowd counting data set, counting and positioning precision is improved, low calculation overhead is kept, and an efficient and accurate solution is provided for crowd analysis tasks in a resource limited scene.

The invention discloses a dynamic label flipping backdoor attack method facing RGB-T crowd counting, and belongs to the technical field of neural networks. The method comprises the following steps: randomly selecting 10% of all samples as poisoning samples for pollution, and taking the rest 90% as benign samples; designing a local disturbance trigger and embedding the local disturbance trigger into RGB image information of the poisoning sample; designing a local patch trigger and embedding the local patch trigger into T image information of the poisoning sample; designing a label information modification strategy and finishing modification of poisoning sample label information; the poisoning and benign samples are mixed according to a preset proportion to serve as a training set to train any RGB-T crowd counting model, and an RGB-T crowd counting poisoning model with a backdoor function is generated; the intoxication model is used to test clean and intoxication test sets respectively to assess the attack performance thereof. According to the method, different triggers and different label modification strategies are designed according to the difference among the modes, and a new attack and defense reference is provided for security defense research of the multi-mode visual system.

Crowd density monitoring systems and methods arc disclosed, comprising a computer vision density monitoring system comprising a camera and a vision processing module adapted to count persons in a given area of in real time during an event. Information from the computer vision processing module and secondary crowd density and crowd counting sensors are displayed on a density monitoring station adapted to issue alerts in the event density or counts exceed a predetermined threshold.

The invention discloses a people number recognition statistical method based on HRNet and a 3D attention mechanism, and relates to the field of image processing, indoor image information is collected through a camera installed indoors and transmitted to a server side, and the server detects the people number and position information in an image through the following steps. A multi-scale convolution kernel double-branch structure is introduced into a Block module in an HRNet network to enhance feature extraction capability, and then a 3D attention mechanism is added, so that extracted features concentrate on useful information of a feature map, and therefore, identification and statistics of the number of people and distribution positions thereof in a specified spatial region can be realized, and the accuracy of the number of people in the specified spatial region can be improved. People flow management and control and security deployment can be effectively carried out by accurately predicting the number of people in the scene, and the method is of great significance to social public security; in addition, the crowd counting result can also be applied to the fields of building energy management and the like, actively responds to the call of energy conservation and emission reduction, and has wide application value.

A method for counting number of people in an image includes feeding an image into an object counting model to generate a first result for the image that is indicative of a number of human heads detected in one or more regions of the image. The image is fed into a regression model to generate a second result for the image that is indicative of a regression count of people detected in the one or more regions of the image. An estimate of people detected in the image is obtained based on the first result and the second result using one or more rules.

The invention relates to the technical field of crowd counting, and discloses a scale attention-based crowd counting method, which comprises the following steps of: performing feature extraction on an input image; the multi-scale-level features pass through a scale attention module and a feature fusion module, and information from all low-resolution layers is aggregated and inherited at the highest-scale-level resolution layer; on each resolution level, inputting the fusion features into a density map generation module to obtain predicted density maps under different scale levels; designing a loss function based on a multi-expert thought, and training the crowd counting model; and preprocessing a to-be-predicted crowd image, inputting the preprocessed to-be-predicted crowd image into the trained crowd counting model, and outputting a prediction density map at the highest scale level resolution layer to realize crowd number prediction. According to the method, the internal relation between different feature levels and different pedestrian head scales is explored, so that scale sensing capabilities under different feature levels are fully utilized and integrated, and accurate crowd counting is realized.

The invention relates to the technical field of crowd counting, in particular to a crowd counting method and system based on WiFi and video modal cross-level attention, and the method comprises the steps: constructing a WiFi density map at a WiFi sensing side, and converting an irregular detection record into a fixed-size image representation; on a video sensing side, marking a region of interest for video frames collected by cameras with different visual angles, and cutting the region of interest to serve as a video side image; respectively carrying out feature coding on the WiFi density map and the video side image by adopting a convolutional neural network and self-attention combined mode; gradually aligning the WiFi modal feature embedded representation and the video modal feature embedded representation through multi-layer stacked cross-modal attention to obtain a cross-modal fusion feature; and inputting the cross-modal fusion features into a lightweight multilayer perceptron, and outputting crowd count. According to the invention, through hierarchical alignment and fusion of WiFi signals and video features, accurate estimation of the number of crowds in a large-scale complex scene can be realized.

The present invention relates to a method for counting the number of people in video images based on a multi-scale attention mechanism, which solves the defect that it is difficult to ensure the accuracy of people counting under the interference of complex scenes compared with the prior art. The present invention includes the following steps: acquisition and preprocessing of crowd images; generation of real crowd density maps; construction of a multi-scale attention mechanism module; construction of a crowd counting model; training of the crowd counting model; acquisition of video images to be detected; counting of the number of people in the video images. The present invention designs a multi-scale attention module, which embeds an attention mechanism in different scale branches to reduce the influence of irrelevant background noise of the model at different scales and increase the scale diversity of the model.

The invention discloses an RGB-T counting method and device based on semantic perception complementary feature mining. The method comprises the steps that firstly, images in a training data set are preprocessed; then constructing an RGB-T counting network based on semantic perception complementary feature mining, wherein the RGB-T counting network comprises a feature extractor based on Transform, a mode feature adaptive method from coarse to fine and a semantic perception agent module; the feature extractor based on the Transform is used for extracting high-level semantic representations of two different modal images; the mode feature adaptive method from coarse to fine is used for filtering noise features and mining fine complementary features; and the semantic perception agent module is used for enhancing semantic consistency perception in network output and the feature extractor, and predicting a density map and a counting result through a density regression layer. According to the method, the RGB-T crowd counting task can be efficiently completed, and the counting result is better than that in the prior art.

The application discloses a kind of multi-modal crowd density prediction methods based on time convolution network, comprising the following steps: video information module obtains image from monitoring camera, the image obtained is carried out crowd counting by crowd counting model, obtains the crowd density of each camera every time, and is organized into time series data;The time series data of crowd density is respectively extracted into the current time hidden vector for each sub-region by time convolution network;Itinerary planning module extracts corresponding itinerary information from itinerary planning table for multi-modal prediction;The features of fusion module and video information module are fused, and the crowd density prediction value of each sub-region in the future is obtained.This application can improve the prediction accuracy of the model by fusing multi-modal information, and can give a smooth prediction result when facing low SNR data, and can also respond in time when the crowd density changes suddenly.

The invention discloses a small target cluster tracking method based on memory enhancement. The method comprises the following steps: 1) constructing a data set of non-repeated crowd counting to a video frame sequence by using aerial photography data; 2) detecting a target by a pre-trained crowd positioning network based on inverse focal length transformation; 3) inputting the video frames and the positioning coordinates into a deepened memory network to extract deepened memory features of the head; 4) constructing a loss function, and training the deepened memory network; 5) tracking the test data set, and constructing a memory item for a tracked trajectory; 6) associating the existing track with the detection target in the current frame; according to the method, a deepened memory network is designed, the network can extract target features with higher discriminability only through human head point annotation, and therefore representation of the foreground head in the head area is remarkably optimized.

An aspect of the present disclosure provides a crowd counting system. The system includes at least one processor, and at least one memory including computer program code. The at least one processor, at least one memory and the computer program code are configured to allow the system to receive an image depicting a crowd, determine if a crowd density variation exists within the image based on a predetermined threshold for crowd density variation, partition the image into a plurality of image segments based on predefined crowd density ranges in response to a positive determination of the crowd density variation, each image segment corresponding to a predefined crowd density range, determine a crowd size within each image segment using a crowd counting algorithm associated with crowd density range of the image segment, wherein each predefined crowd density range is associated with a respective crowd counting algorithm, and determine the crowd size in the image by summing the crowd size in each of the plurality of image segments.

The invention discloses a foggy day crowd counting method based on Transform coding cross attention, and the method comprises the steps: obtaining a preprocessed image, carrying out the feature extraction of the preprocessed image through employing a Transform encoder network, and obtaining the feature Fr of the image; inputting the feature Fr of the image into a local enhancement module, and updating and outputting a local enhancement feature F'r; outputting a feature sequence composed of local enhancement features F'r by the local enhancement module, merging the position token into the feature sequence, inputting the feature sequence into the decoder module, and outputting a final decoding feature Wr; and forming a final feature sequence by the final decoding features Wr output by the decoder module, performing global average pooling on the final feature sequence, and feeding the final feature sequence to a regression head to generate a predicted crowd count. Transform is used as a backbone network to better capture crowd structure dependence at different positions, so that the model is more accurate in crowd number estimation in a heavy fog scene, and errors are reduced.

The invention belongs to the technical field of crowd counting, and particularly relates to a domain-oriented adaptive crowd counting energy-driven active learning method, which comprises the following steps of: extracting multi-scale visual features from an input image, and training HRNet to obtain an optimal source domain model; source domain and target domain samples are mapped to a unified energy space through an energy function; performing data enhancement on the target domain sample, and calculating uncertainty and a predicted people number mean value under various data enhancement modes; calculating sample energy of the target domain; screening the target domain samples twice by adopting an active learning strategy, and labeling the screened samples; designing energy alignment loss; and performing fine tuning on the optimal source domain model, and obtaining a final crowd counting result by using the fine-tuned model. According to the method, data distribution of the source domain and the target domain is effectively aligned through the energy model, sample labeling is carried out in combination with an active learning strategy, and the cross-domain crowd counting performance is improved.

The application discloses a crowd counting method and device, a terminal equipment and a storage medium. The method comprises the following steps: acquiring a target picture; performing prediction on the target picture by using a pre-trained crowd counting model to obtain a density map prediction value and a head number prediction value; and performing weighted calculation on the density map prediction value and the head number prediction value to obtain a crowd quantity count value. The head number prediction value is used as an auxiliary result to be weighted with the density map prediction value, so that the accuracy of the obtained crowd quantity count value is improved, and the accuracy of crowd counting is improved.

The invention relates to the technical field of AI patrol robots, in particular to an intelligent scheduling system and scheduling method for AI patrol robots. An intelligent scheduling system of an AI patrol robot comprises a scenic spot modeling device which constructs a scenic spot two-dimensional road network based on a scenic spot route map; the people counting device is used for counting the current tourist number of each node in the two-dimensional road network in real time and generating current people flow data; according to the intelligent scheduling system provided by the invention, the initial patrol plan is generated according to the future people number distribution prediction map of the scenic spot, the dynamic matching precision and adaptability of the patrol strategy and the real-time people flow density are remarkably improved, and the inherent limitation of a fixed route patrol mode is effectively overcome.

The invention discloses a dense crowd counting method based on an improved yolov11 model. The dense crowd counting method comprises the following steps: improving a feature extraction network of a yolov11n model; replacing an original CBS and C3K2 module of the yolov11n model with an encoder module of a U-NET V2 network; the feature fusion network of the yolov11n model is improved; an AIFI module is added behind the highest layer of the feature fusion network; a detection head of the yolov11n model is improved, and a DIOU loss function is adopted to replace an original loss function; and inputting the preprocessed image tensor into the improved yolov11n model for training, and storing the trained model for dense target counting detection. According to the method, the calculation speed is ensured as much as possible, and the precision of crowd number detection when severe shielding exists between targets in a dense scene is improved.

The present application relates to the field of transportation information engineering, and more particularly to a traffic hub crowd counting method and system based on multi-scale cross-region graph convolution driving, wherein the method comprises: constructing a crowd counting sequence; constructing three time series density map identification evaluation standards of spatial consistency, time sequence continuity and scale adaptability; proposing a multi-scale cross-region graph convolution network model to train and test the traffic hub crowd counting; and performing instance verification of the traffic hub crowd counting. The proposed model is applied to a series of empirical data sets for training and testing, which proves that it can achieve better demand prediction performance than the baseline model.

The application discloses a crowd counting method in a complex scene based on a visual angle self-adaption, and the counting method comprises the following steps: a NOOMP framework is fitted to a natural world through a few-shot learning method; the NOOMP framework is trained through meta-learning to adapt a multi-head parallel network to a main body of the NOOMP framework; the multi-head parallel network is used for estimating a density map of the crowd; and the multi-head parallel network is trained in multiple different scenes, and sub-losses are summarized. The application proposes a new marking method, an absolute geometric Gaussian generation method, and the method can obtain better precision by only adding a point to each person in an image.

The present application relates to the technical field of post safety management, and specifically relates to a personnel off-duty detection method based on a Hungarian algorithm and a P2PNet, which comprises the following steps: step 1, acquiring image information, installing a camera, adjusting the irradiation direction of the camera so that it includes all posts in the monitored area, and collecting image information of on-site personnel under different conditions; step 2, data labeling and model training, labeling the original data set, and training a head center point detection model based on the P2PNet; the present application uses artificial intelligence technology to detect personnel off-duty, combines the crowd counting P2PNet algorithm and the Hungarian matching algorithm, and is deployed on the Cambrian MLU370-S4 intelligent acceleration card, thereby realizing real-time automatic detection of personnel off-duty. The method has high robustness and reliability for various scenes, and the intelligent acceleration card ensures the timeliness of the detection, reduces a large amount of labor cost, and ensures the safety of production operations.