Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

471 results about "Pedestrian detection" patented technology

Pedestrian detection is an essential and significant task in any intelligent video surveillance system, as it provides the fundamental information for semantic understanding of the video footages. It has an obvious extension to automotive applications due to the potential for improving safety systems. Many car manufacturers (e.g. Volvo, Ford, GM, Nissan) offer this as an ADAS option in 2017.

Intelligent traffic management using reinforcement learning

An intelligent traffic management device for optimizing traffic flow at one or more intersections using reinforcement learning, comprising: a central control unit housed in a weatherproof enclosure and mounted on a structural support near an intersection; a sensor interface operatively connected to a variety of multimodal sensors, including at least radar-based vehicle detectors, inductive loop sensors embedded in the road surface, infrared pedestrian detection detectors, and high-resolution optical imaging modules; a powerful embedded computing unit consisting of a multi-core processor and a GPU configured for on-device inference; a reinforcement learning engine embedded in the computing unit, comprising a deep reinforcement learning model trained to map environmental states defined by traffic-related sensor inputs to optimized action policies for traffic light control; a signal actuation module electrically connected to traffic signal controllers, with action policies outputting signal phase durations and transitions in real time; a communications module supporting wireless connectivity and configured for device-to-device communication and cloud synchronization; a policy synchronization module configured to perform federated learning-based updates of model parameters by exchanging gradient weights or distilled traffic state vectors with neighboring intelligent traffic management devices deployed in a traffic network; where the reinforcement learning engine continuously observes traffic state vectors consisting of vehicle counts, average speeds, queue lengths, and pedestrian activity, and dynamically updates the policy to maximize cumulative traffic throughput and minimize average delay.
Owner:MOHAMMED ABDUL SALAM DR

Unmanned aerial vehicle tiny target detection method based on SCCA-YOLO

The invention discloses an SCCA-YOLO-based unmanned aerial vehicle tiny target detection method, which mainly carries out innovative design around neck feature processing and backbone network optimization, improves vehicle and pedestrian detection in a complex road environment under an unmanned aerial vehicle view angle through a multi-module cooperation mechanism, designs a parallel heterogeneous convolution MCAD module, and improves the detection accuracy of a small target on the premise of ensuring the real-time performance. Local details and global semantic comprehension are considered; the method comprises the following steps: designing a space and channel attention module SCCA introducing a PSAS intelligent dimension adaptation mechanism, and combining a bottleneck structure BottleNeck of a YOLOv11 backbone network C3k2 module with the SCCA space and channel attention module to form an SCCA-BottleNeck; the MSFI and SCC modules are introduced into the NECK part, the modeling capacity of the model for scale change and hierarchy association is remarkably enhanced on the premise of keeping reasonable calculation overhead, and the method is particularly suitable for the traffic road environment of fine multi-scale processing.
Owner:HUAIYIN INSTITUTE OF TECHNOLOGY

Three-dimensional space track identification method and system based on multi-view three-dimensional reconstruction

The invention provides a three-dimensional space track identification method based on multi-view three-dimensional reconstruction, which comprises the following steps of: shooting the same scene from different angles by using a plurality of cameras, and determining a picture intersection part of the plurality of cameras as a research scene; frame extraction and pedestrian detection are carried out on the video of each camera, pedestrians and position information of the pedestrians in each frame of video are identified, a unified identity number is distributed to the same pedestrian, registration is carried out on video frame images of different cameras, the pixel position of each pedestrian in each camera is obtained, and a multi-view-angle triangulation method is adopted, and internal and external parameters of the cameras are combined, so that the pedestrian positioning accuracy is improved. Solving a three-dimensional point coordinate of each pedestrian in a camera coordinate system; the three-dimensional point coordinates are converted into coordinates in a world coordinate system, and world coordinate system coordinates of pedestrian point locations of all frames and all numbers are obtained; and according to the time information, connecting the pedestrian point locations of each frame and each number to form a track, and completing reconstruction of the pedestrian three-dimensional space track in the world coordinate system. According to the invention, manpower and calculation cost can be reduced.
Owner:TIANJIN UNIV

Low-visibility environment pedestrian detection method based on improved YOLOv8n model

The invention provides a low-visibility environment pedestrian detection method based on an improved YOLOv8n model. A double-branch fusion attention network is adopted in a backbone network of an original YOLOv8n model, and a CBFuse module and a CBLinear module are introduced for feature fusion between different branches; a feature aggregation and calibration pyramid network is introduced, multi-scale feature fusion is carried out through an up-sampling module, a down-sampling module and a feature aggregation and calibration module, and the feature aggregation and calibration module carries out feature calibration and enhancement through a local attention mechanism, a global attention mechanism and a pixel attention mechanism; an adaptive task alignment detection head is introduced to execute a dynamic convolution mechanism, a task decomposition mechanism and a dynamic feature alignment mechanism; an improved YOLOv8n model is formed based on the improvement and serves as a foggy day pedestrian detection network model; according to the method, the detection accuracy and stability of the network in processing shielded and background complex images can be enhanced, and the boundary and detail features of a fuzzy target can be extracted more accurately in low-visibility environments such as foggy days and the like.
Owner:DALIAN NATIONALITIES UNIVERSITY

Event camera pedestrian detection method based on space-time state space model

The invention relates to the technical field of artificial intelligence computer vision, in particular to an event camera pedestrian detection method based on a space-time state space model, and the method comprises the steps: collecting a pedestrian detection data set based on an event camera, obtaining original event data, carrying out the preprocessing, determining an event tensor, and obtaining an event frame sequence; modeling is carried out through combination of a state space and an event tensor, an event-driven recursive space-time state space module is defined as a core unit, and an isomorphic deep neural network architecture is constructed; training the isomorphic deep neural network architecture by adopting the training set, and verifying through the verification set; inputting the test set into the verified isomorphic deep neural network architecture for detection, and generating a pedestrian detection result; the collaborative optimization of sparse adaptation-dynamic capture-noise suppression is realized in a unified framework, the essential characteristics of the event camera triggered based on brightness change are theoretically fit, and higher robustness and generalization ability are shown in an actual complex scene.
Owner:NANJING UNIV OF POSTS & TELECOMM

Subway pedestrian anomaly detection method and system based on improved yolov8 network and clip model

The invention provides a subway pedestrian anomaly detection method and system based on an improved yov8 network and a clip model, and relates to the technical field of subway pedestrian detection, and the method comprises the steps: obtaining a video frame in a subway scene, and carrying out the preprocessing of the video frame; inputting the preprocessed frame data into an improved yolov8 neural network model to obtain an abnormal behavior target detection frame, and performing target candidate tracking on the target detection frame by using a target tracking algorithm to obtain a candidate image of a target area of a specific behavior; the method comprises the following steps: inputting a candidate image containing a target area into a clip model, inputting a set detection text into the clip model, mapping the detection text and the candidate image of the target area, performing text-image similarity matching, and optimizing a similarity matching threshold by adopting a Q-Learning reinforcement learning immune algorithm to obtain a similarity matching result; and the abnormal behavior detection accuracy is improved.
Owner:JINAN RAILWAY TRANSPORT GRP CO LTD

Road target detection model and detection method based on Voxel RCNN Complex HD

The invention discloses a Voxel RCNN Complex HD-based road target detection model and detection method, and proposes an improved three-dimensional feature extraction network and a two-dimensional feature extraction network for the problem that the Voxel R-CNN algorithm is insufficient in point cloud feature extraction. In order to solve the problem of low pedestrian detection precision, a mixed detection head with an anchor frame and a mixed detection head without an anchor frame are provided, and the detection precision of a large target and a small target is improved by using the mixed detection head based on an anchor and a mixed detection head without an anchor. The voxel candidate box self-attention pool module is provided for solving the problem that the difference between the detection precision of buses and trucks and the detection precision of trolleys in vehicle categories is large, local and global features of an object are better obtained, and therefore the size, the position and the course angle of a large target can be more accurately refined. And finally, the problem of insufficient detection accuracy of pedestrians, buses and trucks in a complex traffic scene is solved.
Owner:JIANGSU UNIV

Dense pedestrian detection method, system and device for traffic scene

The invention relates to a dense pedestrian detection method for a traffic scene, and belongs to the technical field of machine vision, and the method comprises the following steps: S1, collecting pedestrian images of the traffic scene, and constructing a training and testing data set; s2, constructing a pedestrian detection network, fusing high and low frequency attention and a bidirectional feature fusion module, and introducing a target frame matching strategy; s3, preprocessing the image, and inputting the preprocessed image into a detection network training model; and S4, deploying the trained model to a traffic monitoring system to realize pedestrian detection. The method improves the detection precision and the calculation efficiency, still has the precise detection capability in a complex background and a dense shielding environment, and can be applied to an intelligent traffic monitoring and automatic driving system.
Owner:CHONGQING UNIV OF POSTS & TELECOMM

Infrared and visible light fusion pedestrian detection method based on weight autonomous optimization

The invention belongs to the field of machine learning and target detection, and discloses an infrared and visible light fusion pedestrian detection method based on weight autonomous optimization. According to the method, feature extraction is carried out on infrared and visible light images through a convolutional neural network; and through a learnable proportionality coefficient, the extracted features are superposed back to the original image according to respective proportions. In the feature fusion stage, the fusion proportion of the infrared and visible light modes is dynamically adjusted through a learnable fusion weight coefficient. In the training stage, end-to-end optimization is carried out by using a large-scale annotation data set, so that the superposition proportion and the fusion weight alpha of each mode can be adaptively adjusted to adapt to different illumination conditions and scene changes, and the generalization ability of the model is remarkably improved. In a robot vision system for night pedestrian detection, an infrared and visible light modal fusion method based on machine learning weight optimization is adopted, and the accuracy and robustness of pedestrian detection are effectively improved.
Owner:DALIAN UNIV OF TECH

Multi-level voxel adaptive laser radar pedestrian tracking method

The invention discloses a multistage voxel adaptive laser radar pedestrian tracking method, which comprises the following steps: S1, acquiring laser radar point cloud data, and adding ground filtering and elevation filtering; s2, performing hierarchical voxel grid processing on the basis of the point cloud data after ground filtering and elevation filtering, inputting the point cloud data after hierarchical voxel grid processing into a DV-Det model to detect a point cloud pedestrian target of a current frame, and adding a Soft-NMS for post-processing optimization; s3, designing an unscented Kalman filter based on a pedestrian kinematics equation, predicting the motion state of a pedestrian target, and adding a joint probability data interconnection algorithm and an adaptive life cycle management strategy; and S4, the mass center of the pedestrian target is calculated and detected, the relative position and the movement speed of the pedestrian target are solved, and a display panel of pedestrian state information is added to a visual interface. In conclusion, the defects in the prior art are overcome, high-precision and low-delay pedestrian detection and tracking can be achieved in multiple indoor and outdoor scenes, and the method has high social use value.
Owner:JIAXING SOYA INTELLIGENT TECH CO LTD

Space-time correlation multi-camera personnel tracking method and system

The invention provides a time-space correlation multi-camera personnel tracking method and system, and the method comprises the steps: obtaining video streams of all cameras in a scene, carrying out the frame-by-frame detection of the video streams through a detection module based on a deep learning model, and obtaining pedestrian detection samples under different cameras at the current moment and corresponding appearance features. Associating the detection sample with a historical tracking trajectory to obtain a trajectory in each single camera; and carrying out inter-camera association on the trajectory in the single camera by combining a pedestrian re-identification ReID technology and homography-based spatial constraint to obtain a complete tracking trajectory of the current frame. According to the method, in the aspect of position representation of the trajectory, 2D Kalman prediction is used in an image plane, meanwhile, the 3D space position of the trajectory is predicted and tracked, and the trajectory position can be accurately drawn and output.
Owner:ECCOM NETWORK SYST CO LTD

Multi-pedestrian target detection method based on YOLOCDG network in complex scene

The invention discloses a multi-pedestrian target detection method based on a YOLOCDG network in a complex scene, and aims to solve the problems of small target missing detection, model redundancy and inaccurate positioning in multi-pedestrian detection in a scene with dense people flow and serious shielding. The method comprises the following steps: firstly, based on YOLOv8, deleting a redundant convolution fusion layer of a backbone network, adjusting the size of a detection head, and simplifying a framework to reduce small target feature dilution; secondly, designing a context attention module CoAM and embedding the CoAM into a backbone network, and enhancing feature distinction degree in a shielding scene by capturing cross-target context association of dense pedestrians; thirdly, an improved C2fG module is proposed to replace a neck C2f module, the parameter quantity is reduced, and the detection performance and the edge deployment efficiency in a complex scene are balanced; then, an SPPFDSC multi-scale fusion layer containing depth separable convolution is designed, an original SPPF layer is replaced, and fine-grained feature perception of small-size pedestrians in the distance is enhanced; and finally, optimizing a bounding box loss function by adopting WIOU v3, improving the target positioning precision in the dense people stream, and finally constructing a multi-pedestrian detection model.
Owner:HOHAI UNIV

Adaptive frequency domain adversarial training method and device for target detector

The invention belongs to the field of computer vision and artificial intelligence security, and discloses a self-adaptive frequency domain adversarial training method and device for a target detector, the target detector comprises a repair module and a pedestrian detector which are connected in series, and the input of the repair module is connected with the output of a patch detector; the self-adaptive frequency domain adversarial training method comprises the following steps: losses in joint training comprise standard target detection losses, repair consistency losses on a frequency domain based on a frequency domain image corresponding to a training image and a clean image, and repair dependence losses based on a detected average precision mean value; according to the invention, the end-to-end joint training is carried out through the restoration module and the subsequent pedestrian detector, and the optimization target of the restoration module is directly aligned with the improvement of the detection robustness, so that the confrontation disturbance is eliminated as far as possible, and meanwhile, the key semantic information of the detection task is reserved to the maximum extent. The separation of the performance of the repair module and the pedestrian detector is avoided, and the detection robustness is improved.
Owner:NORTHWESTERN POLYTECHNICAL UNIV

Elevator group control system scheduling method based on improved YOLOv10

The invention relates to an elevator group control system scheduling method based on improved YOLOv10, and belongs to the technical field of intelligent elevator control and computer vision crossing. The elevator group control system scheduling method comprises the following steps that S1, pedestrian images of indoor elevator corridor scenes are collected, and a training set and a test set are constructed; s2, the YOLOv10 network is improved; s3, training the improved YOLOv10 network by using the training set to obtain a pedestrian detection model, and testing by using the test set; s4, the trained pedestrian detection model is used for actual pedestrian detection in the elevator floor; and S5, counting the number of pedestrians on each floor according to a detection result, and dynamically adjusting an elevator scheduling strategy according to the distribution of the number of pedestrians on high and low floors. According to the method, the detection capability of the network on the shielded pedestrians is enhanced, the pedestrian detection precision is improved, and the operation efficiency of the elevator and the riding experience of passengers are remarkably improved.
Owner:CHONGQING UNIV OF POSTS & TELECOMM

Multi-pedestrian target detection method based on unmanned aerial vehicle

The invention discloses a multi-pedestrian target detection method based on an unmanned aerial vehicle, and the method comprises the steps: (1) collecting pedestrian video data of the unmanned aerial vehicle, carrying out the frame extraction preprocessing, and marking a pedestrian bounding box, a type, and a confidence coefficient; (2) constructing a YOLOv8 optimization network, wherein a neck network of the YOLOv8 optimization network is integrated with a feature enhancement module, a channel reweighting module and a spatial context sensing module; (3) designing a ternary loss function fusing intersection-to-union ratio, center distance and length-width ratio constraints, wherein the ternary loss function comprises position, category and confidence loss; (4) training the network to converge by adopting a gradient descent method; and (5) deploying the model to the unmanned aerial vehicle to realize real-time detection. According to the method, by improving the network structure and the loss function, the pedestrian detection precision in a complex scene is remarkably improved, efficient data support is provided for an intelligent traffic system, and pedestrian safety guarantee and traffic management efficiency are enhanced.
Owner:HEFEI INSTITUTE OF PHYSICAL SCIENCE CHINESE ACADEMY OF SCIENCES

Target detection method and system and storage medium

The invention provides a target detection method and system and a storage medium, and relates to the field of object detection, and the method comprises the steps: obtaining image data and laser radar scanning data corresponding to a current scene; calling a first pedestrian detection model based on an image to carry out pedestrian detection on the image data to obtain position information of a pedestrian target; calling a second pedestrian detection model based on point cloud data to carry out pedestrian detection on the laser radar scanning data to obtain pose information of a pedestrian target; and calling an external parameter matrix to match the position information and the pose information, and outputting three-dimensional position information of the pedestrian target in a space coordinate system. According to the invention, the detection and positioning of the pedestrian target can be realized without using a high-cost depth camera and a three-dimensional laser radar, and the detection precision of the pedestrian target is improved through two different modal data.
Owner:SUZHOU WANDIANZHANG NETWORK TECH CO LTD

Long-distance identity recognition method for large area

The invention discloses a long-distance identity recognition method for a large area, which belongs to the technical field of computer vision and comprises the following steps: S1, initializing a system; s2, collecting video data; s3, pedestrian detection and segmentation; s4, performing gait recognition; s5, multi-target cross-camera tracking is carried out; and S6, result output and application service. According to the invention, an effective solution is provided for large-scene video intelligent security and protection in a complex environment of a park, the accuracy and traceability of personnel identity recognition in a high-risk area are ensured, and the safety production level of the park is improved; a long-distance multi-target identity recognition scheme is provided, real-time monitoring and early warning of illegal person invasion in key protection areas are achieved, and reliable safety guarantee is provided for public places.
Owner:ANHUI TELECOMM PLANNING & DESIGNING

Pedestrian detection method based on YOLOv7

The invention discloses a pedestrian detection method based on YOLOv7, and relates to the technical field of image recognition, and the method comprises the following steps: constructing a data set D, and dividing the data set D into a training set DLLVIP-train, a test set DLLVIP-test and a verification set DLLVIP-val; preprocessing images in the data set LLVIP by adopting a Mosaic data enhancement technology, and unifying image sizes to obtain a data set LLVIP '; a network model PCAM-YOLOv7 is constructed; all the images in the data set LLVIP'are sequentially input into the network model PCAM-YOLOv7, and prediction information of a bounding box of each image is obtained; using the training set DLLVIP-train to train a network model PCAM-YOLOv7, and using the training set DLLVIP-train to train a network model; according to the method, the PAELAN module fusing the partial convolution and the Shuffle Attention mechanism, the CCBS module fusing the coordinate convolution and the SPPCSPCATT module fusing the Shuffle Attention mechanism are adopted, the shielded pedestrian target can be efficiently and accurately recognized, and the detection accuracy is remarkably improved.
Owner:NANTONG INST OF TECH

Subway platform edge behavior abnormity real-time identification and early warning method based on deep learning

The invention provides a subway platform edge behavior abnormity real-time identification and early warning method based on deep learning, and relates to the technical field of deep learning, which comprises the steps of obtaining real-time video data, performing pedestrian detection and track extraction, calculating behavior characteristic parameters and a dynamic distance threshold value, performing danger grade division on pedestrians, and performing early warning and early warning. According to the method, time sequence feature extraction is carried out on potential dangerous targets, a behavior abnormity scoring mechanism is established, timely early warning of abnormal behaviors is realized, the accuracy and real-time performance of safety monitoring of the subway platform can be effectively improved, and the occurrence rate of safety accidents can be reduced.
Owner:CHANGZHOU DONGFANG HAOYOU TECH CO LTD

Automatic driving system based on pedestrian motivation and control method

PendingCN120942366ASimulationData acquisition
The invention relates to the technical field of automatic driving, in particular to an automatic driving system based on pedestrian motivation and a control method, and the system comprises a data acquisition module, a pedestrian detection module, a pedestrian intention reasoning module and a vehicle control module. The data acquisition module is used for acquiring a video sequence and environment information of a traffic intersection when the intelligent driving vehicle drives to the intersection without the signal lamp. The pedestrian detection module detects pedestrians through video processing and a pedestrian recognition strategy and outputs pedestrian inter-frame images. The pedestrian intention reasoning module classifies pedestrian crossing motivations based on the trajectory and attitude information of pedestrians. The vehicle control module dynamically adjusts the vehicle speed according to the pedestrian motivation type and automatically brakes when necessary so as to ensure that pedestrians safely pass through the intersection. According to the system, self-adaptive comity of the intelligent driving vehicle to pedestrians at the intersection without signal lamps is realized, and the traffic safety and the adaptive capacity of intelligent driving are effectively improved.
Owner:广东助你行智能科技有限公司

Single-mirror pedestrian height change perception and adaptive state perception Re-ID tracking method

The invention provides a single-mirror pedestrian height change perception and adaptive state perception Re-ID tracking method and system. The method comprises the following steps: acquiring a video stream and extracting a video frame; pedestrian detection is carried out on each video frame, and corresponding pedestrian features are extracted according to a pedestrian detection result; judging the confidence coefficient of each detection frame, and constructing a track instance when the confidence coefficient of each detection frame is greater than a threshold value; calculating an adaptive state sensing Re-ID cost matrix and a height change weighted intersection-to-parallel ratio cost matrix to obtain a final cost matrix; performing Hungary matching on the cost matrix to search the most matched trajectory instance for each pedestrian detection object; and integrating the track state, the track updating state and the detection frame state of the current time frame, and updating the track attribute. According to the method, hidden constraints of height changes of the detection frame and the tracking frame are considered, weights of the height changes are added on the basis of area constraints, and the problem of identity switching when pedestrians are shielded can be better solved.
Owner:ECCOM NETWORK SYST CO LTD

Lightweight unmanned forklift AI visual anti-collision method based on domestic embedded platform

The invention discloses a light-weight unmanned forklift AI visual anti-collision method based on a domestic embedded platform, and the method comprises the following steps: S1, carrying out the preprocessing of an RGB image through a light-weight pedestrian detection module, carrying out the automatic pruning and compression of a deep convolutional network based on an image recognition algorithm of a light-weight convolutional neural network, and carrying out the recognition of the deep convolutional network; lightweight pedestrian detection features are extracted; s2, using a lightweight pedestrian distance estimation module to extract lightweight pedestrian distance estimation features by model compression through camera calibration, image correction, stereo matching and distance acquisition; s3, performing feature fusion, performing feature analysis in combination with a dynamic adaptive sparse transformation network, and completing multi-pedestrian detection and pedestrian distance estimation by introducing a sparse feature adaptive reconstruction mechanism; and S4, deployment is carried out on a domestic embedded platform, and software function module cutting is carried out. According to the invention, a lightweight deep learning algorithm and adaptive feature fusion are adopted, and multi-pedestrian anti-collision detection on a domestic embedded platform is realized.
Owner:HEFEI SHINNY INSTR CONTROL TECH

Multispectral pedestrian detection method applied to intelligent traffic monitoring

The invention belongs to the technical field of intelligent traffic and computer vision crossing, and particularly relates to a pedestrian detection method based on multispectral fusion. Aiming at the bottleneck problem that single-source data sensing reliability is insufficient in a complex traffic scene, the invention provides a visible light-infrared double-flow collaborative pedestrian detection framework based on a neural network. According to the method, complementary semantic information between visible light and infrared images is fully mined, a multispectral feature dynamic interaction mechanism composed of three stages of feature decoupling, interaction and reconstruction is established, and robust multispectral representation is generated through a feature fusion module based on channel attention. Compared with an existing method, the method has the advantages that target feature discrimination can be remarkably improved, higher adaptability is achieved in multi-scene, multi-scale and multi-target detection tasks, accurate positioning and recognition of pedestrian targets in the all-weather environment can be achieved, and reliable technical guarantee is provided for an intelligent traffic monitoring system.
Owner:NANKAI UNIV

Cloud-edge collaborative abnormal behavior character recognition method, device and system

The invention relates to the technical field of computers, and provides a cloud-edge collaborative abnormal behavior character recognition method, device and system, and the method comprises the steps: edge end equipment employs a trained pedestrian detection model to cut out a video sequence containing pedestrians from a received video sequence, and uploads the video sequence containing the pedestrians to a cloud server; the cloud server cuts a video sequence containing pedestrians according to a set time length to obtain video slices, the video slices and prompt words are input into a trained multi-mode large model to obtain an identification result, the prompt words are described in a video question and answer mode, option question and answer pairs in video question and answer are constructed according to related task types, and the identification result is obtained. The options in the video questions and answers are possible behavior types. The lightweight pedestrian detection is integrated on the side end equipment to reduce the transmission, reduce the processing data volume of the cloud server, solve the problem of high demand of cloud computing resources, and improve the efficiency and response speed of the system.
Owner:CHINA TOWER CO LTD

No-reference vehicle image quality evaluation method and equipment based on saliency perception

The invention discloses a no-reference vehicle image quality evaluation method and equipment based on saliency perception. A large-scale no-label vehicle image data set is utilized, and image distortion recognition models for distinguishing different types and grades are trained in a self-supervision mode; training a model for detecting the salient region in the image by using the salient region segmentation data set; a pre-trained distortion quality perception module and a pre-trained saliency region segmentation module are used to acquire a saliency feature map and a distortion feature map in an input image, and then a weight matrix is constructed and applied to realize weighted fusion between the saliency feature map and the distortion feature map so as to generate a new comprehensive feature map; and sending the generated comprehensive feature map into a multi-layer perceptron, and outputting a score reflecting the overall quality of the image after processing. The method not only improves the accuracy of image quality evaluation, but also enhances the practical application value and generalization ability of the model. The method is of great significance in key tasks such as pedestrian detection and traffic sign recognition.
Owner:ZHONGQIYAN AUTOMOBILE INSPECTION CENT (CHANGZHOU) CO LTD

Cableway platform tourist falling detection method, system and equipment based on visual identification and medium

The invention relates to the technical field of cableway platform intelligent management, in particular to a cableway platform tourist falling detection method, system and device based on visual identification and a medium, and the method comprises the steps: collecting a video stream of a platform region, carrying out the pedestrian detection, obtaining the position of a bounding box of a tourist, and storing the position of the bounding box; a unique track ID and continuous track data are generated for each tourist by using a multi-target tracking algorithm; for each tourist, extracting a human body posture key point coordinate in each frame of the video stream and calculating a posture feature, and when the posture feature meets a preset posture collapse judgment rule, judging that the posture collapse is suspected; carrying out time sequence fusion on the continuous tracks of each tourist, and carrying out real falling event judgment based on the judgment condition of suspected posture collapse; and matching a preset platform area according to the position of the real falling event, outputting a risk level and triggering a corresponding control instruction. According to the invention, the falling behavior can be accurately and stably identified, and the safety protection capability of the cableway platform is improved.
Owner:SHANDONG LANGCHAO SMART CULTURAL TOURISM IND DEV CO LTD

Method and device for detecting and tracking dense pedestrians

The invention discloses a detection and tracking method and device for dense pedestrians, relates to the technical field of computer vision, and can solve the problem of low tracking accuracy during real-time detection and tracking in a scene with extremely dense pedestrians in the prior art. According to the specific technical scheme, firstly, a dense pedestrian detection data set and a tracking data set are obtained; an alpha-EIoU loss, a GAM attention mechanism and a Swin Transform module are used for improving a YOLOv5s algorithm, and a detection model is obtained; training and optimizing the detection model to obtain a target detection model; a ShuffleNetV2 module is introduced to improve a DeepSORT algorithm, and then training is performed to obtain a target tracking model; and detecting and tracking the pedestrian target video according to the target detection model and the target tracking model to obtain an experimental result of detection and tracking. The method is used for detecting and tracking dense pedestrians.
Owner:SHANGHAI INST OF TECH

Lightweight pedestrian detection algorithm based on improved YOLOv7-tiny

The invention relates to a lightweight pedestrian detection algorithm based on improved YOLOv7-tiny, and the algorithm comprises the steps: replacing an ELAN module with an ELCG module on the basis of an original YOLOv7-tiny network to carry out the feature extraction of an input image, and carrying out the feature enhancement in a feature fusion sub-network through employing an ECA attention mechanism; comprising the following steps: obtaining a pedestrian detection picture, and shortening the picture processing time and constructing a data set D1 by using a data enhancement and adaptive size scaling method; an improved YOLOv7-tiny model is constructed; the data set D1 is input into the improved YOLOv7-tiny model to be trained; and pedestrian detection is carried out on the trained improved YOLOv7-tiny model, loss function calculation is carried out on a detection result and a sample label, and parameters in the model are optimized through a gradient descent algorithm and a back propagation algorithm. According to the lightweight pedestrian detection algorithm based on the improved YOLOv7-tiny, an ECA attention mechanism is introduced, and the network structure is improved, so that the detection precision of pedestrians in a complex environment is improved, and the accuracy of capturing and identifying features in pedestrian detection is improved.
Owner:HUBEI UNIV OF ECONOMICS

Pre-warning system equipment for pedestrian crossing zebra crossing

The invention belongs to the technical field of traffic safety pre-warning, and provides a pedestrian zebra crossing pre-warning system device which comprises a mounting stand column, a monitoring assembly and a pre-warning assembly, a connecting base is arranged at the top of the front side of the mounting stand column, the monitoring assembly is arranged on the connecting base, and the monitoring assembly comprises an AI camera, a laser radar and a far infrared sensor. The early warning assembly comprises an electronic warning board, a laser transmitter and a laser spotlight; by comprehensively using various sensors such as the AI camera, the infrared sensor and the laser radar, pedestrians can be monitored and recognized from different angles and different modes, the accuracy of pedestrian recognition is improved, and the method is particularly suitable for pedestrian detection under complex weather and illumination conditions and has a wide application prospect. Through the synergistic effect of the laser spotlight, the laser curtain wall, the electronic warning board and the warning sound, early warning is performed on drivers and pedestrians from multiple aspects of visual sense and auditory sense, the early warning effect is enhanced, and the safety of the pedestrians crossing the road is improved.
Owner:ZHUZHOU ZHONGMEI ELECTRONIC TECH CO LTD

Vehicle trunk automatic opening method and device and computer program product

The invention discloses a vehicle trunk automatic opening method and device and a computer program product, and the method comprises the steps: firstly, after the device fingerprint verification of a target vehicle is passed, obtaining N paths of surrounding video streams through a whole vehicle panoramic camera composed of N vehicle-mounted cameras; and then pedestrian detection and cross-shot pedestrian tracking processing are carried out on each frame of image in the N paths of video streams to obtain a pedestrian detection result and a pedestrian tracking result. Generating a BEV pedestrian trajectory according to a pedestrian tracking result; a target pedestrian BEV track is screened out from the target pedestrian BEV track; and after the identity verification of the target pedestrian is passed, obtaining a state diagram of the target pedestrian according to a pedestrian detection result, inputting the BEV track of the target pedestrian, the state diagram of the target pedestrian and the scene text information of the landmark building within the preset range around the target vehicle into a VLM in combination with prompt, and when the VLM judges that the target pedestrian has the intention of opening the trunk, opening the trunk. And the trunk is automatically opened, so that the safety of the target vehicle and the vehicle use experience of the target pedestrian are improved.
Owner:IFLYTEK CO LTD