A detection device and method for dragging of cargo dropped from a vehicle

Vehicle point cloud data is obtained through line laser devices and cameras above the road, combined with license plate number and driving speed information, and the limitations and cost of cargo drop monitoring are solved, achieving high-precision detection and low-cost deployment, suitable for large-scale Scale promotion.

CN118328860BActive Publication Date: 2025-01-07SHENZHEN EAI TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202410757779.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-06-13
Publication Date
2025-01-07
Estimated Expiration
2044-06-13

AI Technical Summary

Technical Problem

In the prior art, cargo drop monitoring devices have greater detection limitations or high cost of on-board devices, making it difficult to achieve large-scale promotion.

Method used

Using a linear laser device and camera fixed above the road, point cloud data is obtained by scanning vertically downward, the height, width and length of the vehicle are calculated, and the license plate number and driving speed information are combined to determine whether there is any cargo falling, and through the backstage The server controls the alarm reminder device to display the alarm message.

Benefits of technology

It realizes high-precision cargo drop detection and dimensional analysis, provides reliable early warning data, is low in deployment cost, and does not require road surface modification or installation of on-board devices, which is convenient for large-scale promotion.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118328860B_ABST
    Figure CN118328860B_ABST
Patent Text Reader

Abstract

The present invention belongs to the technical field of road accident monitoring, and specifically relates to a detection device and method for dropped and dragged cargo on a vehicle. The device includes a line laser device and a camera fixed above the road; the line laser device emits a line laser perpendicular to the road surface to obtain point cloud data; the camera faces the direction of the oncoming vehicle on the road to obtain vehicle information; the line laser scanned vertically downwards obtains the point cloud data of the moving freight vehicle in real time and calculates and analyzes its height, width and length information, which can realize the detection of dropped and dragged cargo with high detection accuracy, and can analyze the size information of dropped and dragged cargo at the same time, and further provide reliable early warning data; and this detection method does not require modification of the road surface, nor does it require a vehicle-mounted device, so the deployment cost is low and it is easy to promote on a large scale.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention belongs to the technical field of road accident monitoring, and in particular relates to a detection device and method for the dragging of cargo dropped from a vehicle. Background Art

[0002] Freight vehicles are prone to cargo falling and being dragged while moving. The location of the dragged cargo is often in the driver's rear blind spot, which is difficult for the driver to discover in time. This may affect the vehicles behind and cause traffic accidents, or affect road traffic, posing a major traffic safety hazard.

[0003] In the prior art, some schemes monitor the running status of freight vehicles by adding weighing devices on the road, but the weighing devices can only be installed on a small number of road sections, with large detection limitations and low accuracy. Some schemes monitor cargo falling by installing a vehicle-mounted detection device to detect the status of cargo in the vehicle, such as the Chinese invention application with publication number CN116381722A, which discloses a method, device, equipment and medium for detecting cargo falling during transportation, and installs a vehicle-mounted multi-line laser radar in the vehicle to collect point cloud information of cargo to monitor cargo changes during transportation. The Chinese utility model with authorization number CN203793211U discloses a cargo safety monitoring and alarm system during freight transportation, which acquires cargo images through a camera device that collects cargo images through a vehicle-mounted terminal to realize monitoring and early warning of cargo falling. These technical solutions require freight vehicles to install vehicle-mounted cargo monitoring devices by themselves, which have high practical costs and are difficult to promote on a large scale. Summary of the invention

[0004] The technical problem to be solved by the present invention is to overcome the defects of the prior art that the cargo falling monitoring road device has large detection limitations or the vehicle-mounted device has high cost, thereby providing a detection device and method for vehicle dropped cargo dragging.

[0005] A method for detecting the dragging of dropped cargo on a vehicle comprises the following steps:

[0006] Step S1: The camera photographs the vehicle, obtains the vehicle license plate number, and obtains the actual vehicle length from the backend server according to the license plate number;

[0007] Step S2: The camera takes a picture of the vehicle and obtains the vehicle's speed;

[0008] Step S3: The line laser device scans vertically downward to obtain multiple frames of point cloud data, and calculates the measurement height and measurement width of each frame of point cloud data;

[0009] Step S4: Analyze the point cloud data and calculate the measured length. When the measured length is greater than the actual vehicle length, determine that the vehicle is dragging dropped cargo, and calculate the size of the dropped cargo.

[0010] Furthermore, the method further includes step S5: when it is determined that the vehicle has dropped cargo being dragged, the background server controls the warning reminder device to display a warning message.

[0011] Furthermore, in step S2, the method for obtaining the vehicle speed is: obtaining two adjacent frames of the image taken by the camera, and the vehicle speed is v=x*F1, wherein x is the relative distance between the vehicles in the two adjacent frames, and f1 is the frame rate of the camera.

[0012] Furthermore, in step S3, the method for obtaining the point cloud data is:

[0013] Step S3.1: calibrate the road surface height to 0, and calibrate the conversion ratio between the point cloud data and the actual width and height;

[0014] Step S3.2: According to a preset frame rate, the line laser device emits a line laser vertically downward and receives echoes to obtain multi-frame point cloud data;

[0015] Step S3.3: Calculate the measured height and measured width of each frame of point cloud data according to the conversion ratio.

[0016] Furthermore, in step S4, the measurement length is L= i*v / F0, wherein i is the total number of point cloud frames scanned by the line laser to the vehicle, v is the vehicle speed, and F0 is the scanning frame rate of the line laser device.

[0017] A detection device for the dragging of dropped cargo on a vehicle, and its detection method is as described above; it includes a line laser device and a camera fixed above a road, and the line laser device and the camera are respectively connected to a background server; the line laser device emits a line laser perpendicular to the road surface for obtaining point cloud data; the camera faces the direction of oncoming vehicles on the road for obtaining vehicle information; the background server is used to determine whether there is cargo dropped on the vehicle based on the road point cloud data and the vehicle information.

[0018] Furthermore, it also includes a warning reminder device; the warning reminder device is fixed above the road and faces the direction of oncoming vehicles on the road; the warning reminder device is connected to the background server, includes a display screen and a warning light, and is used to display warning reminder information.

[0019] Furthermore, the detection width of the line laser device and the camera is a single lane.

[0020] Beneficial effects: The present invention discloses a detection device and method for dropped and dragged cargo on a vehicle, the device comprising a line laser device and a camera fixed above a road; the line laser device emits a line laser perpendicular to the road surface to obtain point cloud data; the camera faces the direction of oncoming vehicles on the road to obtain vehicle information; the line laser scans vertically downward to obtain point cloud data of the moving freight vehicle in real time and calculates and analyzes its height, width and length information, thereby realizing the detection of dropped and dragged cargo with high detection accuracy, and at the same time being able to analyze the size information of the dropped and dragged cargo, further providing reliable early warning data; and the detection method does not require modification of the road surface, nor does it require a vehicle-mounted device, so the deployment cost is low, and it is convenient for large-scale promotion. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0022] Figure 1 The figure is a schematic block diagram of the method steps of the present invention. DETAILED DESCRIPTION

[0023] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are described in detail below in conjunction with the accompanying drawings. In the following description, many specific details are set forth to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar improvements without violating the connotation of the present application, so the present application is not limited by the specific embodiments disclosed below.

[0024] In the description of the present application, it should be understood that the terms "center", "longitudinal", "lateral", "length", "width", "thickness", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside", "outside", "clockwise", "counterclockwise", "axial", "radial", "circumferential" and the like indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.

[0025] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0026] In this application, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0027] In the present application, unless otherwise clearly specified and limited, a first feature being “above” or “below” a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being “above”, “above”, and “above” a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being “below”, “below”, and “below” a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0028] It should be noted that when an element is referred to as being "fixed to" or "disposed on" another element, it may be directly on the other element or there may be a central element. When an element is considered to be "connected to" another element, it may be directly connected to the other element or there may be a central element at the same time. The terms "vertical", "horizontal", "upper", "lower", "left", "right" and similar expressions used herein are for illustrative purposes only and are not intended to be the only implementation method.

[0029] Embodiment 1:

[0030] This embodiment discloses a method for detecting the dragging of dropped cargo on a vehicle, comprising the following steps:

[0031] Step S1: The camera photographs the vehicle, obtains the vehicle's license plate number, and obtains the actual vehicle length from the background server based on the license plate number; as a further improvement of this embodiment, the actual vehicle length L0, actual vehicle width W0 and actual vehicle height H0 are obtained from the background server based on the license plate number.

[0032] Step S2: The camera takes a picture of the vehicle and obtains the vehicle's speed;

[0033] Specifically, in step S2, the method for obtaining the vehicle speed is: obtaining two adjacent frames of the image taken by the camera, and the vehicle speed is v=x*F1, where x is the relative distance between the vehicles in the two adjacent frames, and f1 is the frame rate of the camera.

[0034] Step S3: The line laser device scans vertically downward to obtain multiple frames of point cloud data, and calculates the measured height and measured width of each frame of point cloud data;

[0035] Step S4: Analyze the point cloud data and calculate the measured length. When the measured length is greater than the actual vehicle length, determine that the vehicle is dragging dropped cargo, and calculate the size of the dropped cargo.

[0036] In step S4, the measured length is L= i*v / F0, where i is the total number of point cloud frames scanned by the line laser to the vehicle, v is the vehicle speed, and F0 is the scanning frame rate of the line laser device. When the point cloud frame height changes from 0 to greater than 0, it is identified as the first point cloud frame of the vehicle; when the point cloud frame height changes from greater than 0 to 0, it is identified as the last point cloud frame of the vehicle.

[0037] Specifically, in some embodiments of the present invention, when the towed cargo is connected to the vehicle, the measured length is calculated as L= i*v / F0; when the towed cargo is separated from the vehicle, the measured length is defined as L= (i+i')*v / F0, where i' frames are the number of frames where the cargo is dropped. Specifically, when the point cloud frame height changes from greater than 0 to 0, and changes to greater than 0 again within a preset number of frames, the towed cargo is considered to be separated from the vehicle, and the latter point cloud frame greater than 0 is defined as dropped cargo.

[0038] As a further improvement of this embodiment, in order to avoid misjudging the rear vehicle as the dropped cargo of the front vehicle due to the rear vehicle following too close, a limit length L' is set here, and the limit length L' is adjusted according to the vehicle speed limit of different road sections, the braking experience distance of the vehicle, and the shortest vehicle length; in addition, considering that radar measurement has a certain measurement accuracy, a measurement accuracy p is set here;

[0039] When the detected measured length L≥L', it can be considered that the rear vehicle is too close to the front vehicle and there is a risk of rear-end collision. The judgment information can be used to warn the front vehicle of the rear situation through the warning system to facilitate the driver to make driving adjustments;

[0040] When the detected measured length L<L' and L>L0+p, it is determined that the vehicle is at risk of cargo falling and dragging, and a warning system can be used to warn;

[0041] When the detected measured length L<L' and L0-p≤L≤L0+p, the vehicle is in a normal driving state.

[0042] Step S5: When it is determined that the vehicle has dropped cargo being dragged, the background server controls the warning device to display a warning message.

[0043] Specifically, in step S3, the method for obtaining the point cloud data is:

[0044] Step S3.1: calibrate the road surface height to 0, and calibrate the conversion ratio between the point cloud data and the actual width and height;

[0045] Specifically, a square calibration object with a length, width and height of a*a*a is taken, and the material can be plastic or foam. It is placed directly below the line laser scan, and the line laser scan is turned on to obtain one frame of the point cloud image. The width and height information in the point cloud image are w0 and h0 respectively.

[0046] The conversion ratio in width direction is a / w0; the conversion ratio in height direction is a / h0;

[0047] Step S3.2: According to the preset frame rate, the line laser device emits a line laser vertically downward and receives an echo to obtain multiple frames of point cloud data; each frame of point cloud data includes a sliced ​​point cloud frame height and a point cloud frame width.

[0048] Step S3.3: Calculate the measured height and measured width of each frame of point cloud data according to the conversion ratio.

[0049] The measurement height Hi=hi*a / h0, the measurement width Wi=wi*a / w0, hi is the point cloud frame height, wi is the point cloud frame width.

[0050] Embodiment 2:

[0051] This embodiment provides a detection device for cargo dragging dropped from a vehicle, and the detection method thereof is as described in the first embodiment; it comprises a line laser device and a camera fixed above a road, the line laser device and the camera are respectively connected to a backend server; the line laser device emits a line laser perpendicular to the road surface to obtain point cloud data; the camera faces the direction of the oncoming vehicle on the road to obtain vehicle information; the backend server is used to determine whether cargo has been dropped from the vehicle based on the road point cloud data and the vehicle information. In this embodiment, the arrangement of the line laser is perpendicular to the road direction.

[0052] As a further improvement of this embodiment, a warning device is also included; the warning device is fixed above the road and faces the direction of the oncoming vehicle on the road; the warning device is connected to the background server and includes a display screen and a warning light for displaying warning information. Specifically, the warning device consists of a display screen and a warning light, which are installed facing the direction of the vehicle. When the monitoring and identification system detects an abnormal state of the vehicle, the vehicle information is transmitted to the warning display screen, and the warning light flashes to remind the driver. The driver can stop in the emergency lane to check for hidden dangers based on the warning information.

[0053] The detection width of the line laser device and the camera is a single lane. In this embodiment, the line laser device and the camera are respectively set on each lane, set at fixed intervals on straight sections, and additionally set on curves, intersections, ramps and accident-prone sections.

[0054] The present invention discloses a detection device and method for dropped and dragged cargo on a vehicle. The device comprises a line laser device and a camera fixed above a road; the line laser device emits a line laser perpendicular to the road surface to obtain point cloud data; the camera faces the direction of oncoming vehicles on the road to obtain vehicle information; the line laser scans vertically downward to obtain point cloud data of the moving freight vehicle in real time and calculates and analyzes its height, width and length information, thereby realizing the detection of dropped and dragged cargo with high detection accuracy, and at the same time being able to analyze the size information of the dropped and dragged cargo, and further providing reliable early warning data; and the detection method does not require modification of the road surface, nor does it require a vehicle-mounted device, so the deployment cost is low and it is convenient for large-scale promotion.

[0055] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0056] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be construed as limiting the scope of the patent application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent application shall be subject to the attached claims.

Claims

1. A method for detecting the dragging of dropped cargo on a vehicle, characterized in that: The detection device used in the detection method includes a line laser device and a camera fixed above the road, the line laser device and the camera are respectively connected to a backend server; the line laser device emits a line laser perpendicular to the road surface to obtain point cloud data; the camera faces the direction of the oncoming vehicle on the road to obtain vehicle information; The backend server determines whether there is cargo dropped from the vehicle according to the point cloud data and the vehicle information; further comprising a warning device; the warning device is fixed above the road and faces the direction of the oncoming vehicle on the road; the warning device is connected to the backend server, comprises a display screen and a warning light, and displays warning information; The detection method includes the following steps: Step S1: The camera photographs the vehicle, obtains the vehicle license plate number, and obtains the actual vehicle length from the backend server according to the license plate number; Step S2: The camera takes a picture of the vehicle and obtains the vehicle's speed; In step S2, the method for obtaining the vehicle speed is: obtaining two adjacent frames of the image captured by the camera, and the vehicle speed is v=x*F1, where x is the relative distance between the vehicles in the two adjacent frames, and f1 is the frame rate of the camera; Step S3: The line laser device scans vertically downward to obtain multiple frames of point cloud data, and calculates the measurement height and measurement width of each frame of point cloud data; In step S3, the method for obtaining the point cloud data is: Step S3.1: calibrate the road surface height to 0, and calibrate the conversion ratio between the point cloud data and the actual width and height; Step S3.2: According to a preset frame rate, the line laser device emits a line laser vertically downward and receives echoes to obtain multi-frame point cloud data; Step S3.3: Calculate the measured height and measured width of each frame of point cloud data according to the conversion ratio; Step S4: Analyze the point cloud data, calculate the measured length, and when there is dropped cargo being dragged by the vehicle, calculate the size of the dropped cargo; In step S4, when the point cloud frame height changes from greater than 0 to 0, and changes to greater than 0 again within a preset number of frames, it is considered that the towed cargo is separated from the vehicle, and the point cloud frame greater than 0 in the latter section is defined as dropped cargo; when the towed cargo is connected to the vehicle, the measured length is calculated as L= i*v / F0; when the towed cargo is separated from the vehicle, the measured length is calculated as L= (i+i')*v / F0; When the measured length L≥L', it is determined that the following vehicle is too close to the vehicle; When the measured length L<L' and L>L0+p, it is determined that the vehicle has cargo dropped and dragged; When the measured length L<L' and L0-p≤L≤L0+p, the vehicle is judged to be in normal driving state; Wherein, i'frame is the frame number of dropped cargo, i is the total point cloud frame number of the line laser scanning to the vehicle, L is the measurement length, L' is the preset limit length, v is the vehicle speed, F0 is the scanning frame rate of the line laser device, and p is the measurement accuracy; Step S5: When it is determined that the vehicle has dropped cargo or is dragging, the background server controls the warning device to display a warning message; when it is determined that the rear vehicle is too close to the vehicle, the warning device is used to warn the front vehicle of the situation behind.

2. A method for detecting the dragging of dropped cargo on a vehicle according to claim 1, characterized in that: The detection width of the line laser device and the camera is a single lane.

Citation Information

Patent Citations

  • Method, device and equipment for detecting fallen goods in transportation process and medium

    CN116381722A

  • Cargo security monitoring and warning system in cargo transportation process

    CN203793211U

  • Vehicle over-limit detection system and method

    CN107945530A

  • A detecting system for the over loaded vehicles for the service of the road traffic safety

    KR1020170062702A

  • KR20220014118A