Sludge weighing method and device, electronic equipment and computer readable medium

Through the automated sludge weighing method, information collection, volume recognition and density calculation are used to solve the problems of high cost and resource waste in the floor scale equipment in the prior art, efficient sludge weight measurement is achieved, and resource consumption is reduced.

CN118941616AActive Publication Date: 2024-11-12BEIJING ZHONGHAIJIYUAN DIGITAL TECH DEV CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
CN202411419292.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-12
Publication Date
2024-11-12
Estimated Expiration
2044-10-12

AI Technical Summary

Technical Problem

The existing sludge weighing methods rely on floor scales, resulting in high site area requirements, high cost, prone to failure, and require professional management, resulting in waste of fuel, manpower and time resources.

Method used

The automated sludge weighing method is adopted to collect vehicle information, license plate and model identification, volume identification, sampling robotic arm collects sludge samples, measuring device measures volume and weight, and calculates the weight of the whole vehicle sludge based on density.

Benefits of technology

It reduces the demand for floor scale equipment, reduces site and equipment costs, improves the operating efficiency of transport vehicles, and reduces waste of fuel, manpower and time.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118941616A_ABST
    Figure CN118941616A_ABST
Patent Text Reader

Abstract

The embodiment of the invention discloses a sludge weighing method and device, electronic equipment and a computer readable medium. A specific embodiment of the method comprises the following steps: in response to detection that a sludge transport vehicle enters an automatic weighing range, controlling an information acquisition device to acquire vehicle information of the sludge transport vehicle; carrying out license plate and model identification on the sludge transport vehicle to generate vehicle model information; carrying out volume identification on sludge loaded by the sludge transport vehicle to generate loaded sludge volume data; controlling the sampling mechanical arm to collect a sludge sample from the loaded sludge, and controlling the measuring device to measure the sludge sample so as to generate a sludge sample volume value and a sludge sample weight value; determining a sludge sample density value corresponding to the sludge sample volume value and the sludge sample weight value; and determining sludge weight data of the whole vehicle according to the loaded sludge volume data and the sludge sample density value. According to the embodiment, waste of resources such as fuel, manpower and time is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the field of computer technology, and in particular to a sludge weighing method, device, electronic device, and computer-readable medium. Background Art

[0002] When transporting and treating the sludge generated by the sewage treatment plant, the sludge loaded on the transport vehicle needs to be weighed first. At present, the method usually adopted for weighing the sludge is to weigh the vehicle loaded with sludge on a scale, and then subtract the weight of the empty vehicle to get the weight of the sludge.

[0003] However, when the above method is used to weigh sludge, the following technical problems often occur: Weighbridges have high requirements for site area, which requires enough space for trucks to turn around. Weighbridges are also expensive to build, prone to malfunction, and require professional management and maintenance. These factors together result in high resources and costs required for weighbridges. At the same time, transferring transport vehicles loaded with sludge to dedicated weighbridge stations may result in a waste of resources such as fuel, manpower, and time.

[0004] The above information disclosed in this Background section is only for enhancement of understanding of the background of the inventive concept and therefore it may contain information that does not form the prior art that is already known in this country to a person of ordinary skill in the art. Summary of the invention

[0005] The content of this disclosure is used to introduce concepts in a brief form, which will be described in detail in the detailed implementation section below. The content of this disclosure is not intended to identify the key features or essential features of the technical solution claimed for protection, nor is it intended to limit the scope of the technical solution claimed for protection.

[0006] Some embodiments of the present disclosure propose a sludge weighing method, an apparatus, an electronic device, and a computer-readable medium to solve one or more of the technical problems mentioned in the above background technology section.

[0007] In a first aspect, some embodiments of the present disclosure provide a sludge weighing method, the method comprising: in response to detecting that a sludge transport vehicle enters an automatic weighing range, the control calculation module controls an information acquisition device to collect vehicle information of the sludge transport vehicle, wherein the vehicle information includes license plate number picture information and compartment picture information; the control calculation module performs license plate and model recognition on the sludge transport vehicle according to the vehicle information to generate vehicle model information, wherein the vehicle model information includes license plate number, vehicle model information, vehicle load information and compartment size information; the control calculation module performs license plate and model recognition on the sludge transport vehicle according to the vehicle information to generate vehicle model information, wherein the vehicle model information includes license plate number, vehicle model information, vehicle load information and compartment size information; The control and calculation module controls the sampling mechanical arm to collect sludge samples from the loaded sludge, and controls the measuring device to measure the sludge samples to generate sludge sample volume values ​​and sludge sample weight values; the control and calculation module determines the sludge sample density values ​​corresponding to the sludge sample volume values ​​and the sludge sample weight values; the control and calculation module determines the whole vehicle sludge weight data carried by the sludge transport vehicle according to the loaded sludge volume data and the sludge sample density values.

[0008] In a second aspect, some embodiments of the present disclosure provide a sludge weighing device, the device comprising: a first control unit, configured to respond to detecting that a sludge transport vehicle enters an automatic weighing range, the control calculation module controls the information acquisition device to collect vehicle information of the sludge transport vehicle, wherein the vehicle information includes license plate number picture information and compartment picture information; a license plate and model recognition unit, configured to perform license plate and model recognition on the sludge transport vehicle according to the vehicle information by the control calculation module to generate vehicle model information, wherein the vehicle model information includes license plate number, vehicle model information, vehicle load information and compartment size information; a volume recognition unit, configured to perform volume recognition on the control calculation module according to the vehicle information The first determining unit is configured as the control calculation module to determine the sludge sample density value corresponding to the sludge sample volume value and the sludge sample weight value; the second determining unit is configured as the control calculation module to determine the whole vehicle sludge weight data carried by the sludge transport vehicle according to the loaded sludge volume data and the sludge sample density value.

[0009] In a third aspect, some embodiments of the present disclosure provide an electronic device comprising: one or more processors; a storage device on which one or more programs are stored, and when the one or more programs are executed by the one or more processors, the one or more processors implement the method described in any implementation manner of the above-mentioned first aspect.

[0010] In a fourth aspect, some embodiments of the present disclosure provide a computer-readable medium having a computer program stored thereon, wherein when the program is executed by a processor, the method described in any implementation manner of the above-mentioned first aspect is implemented.

[0011] The above-mentioned various embodiments of the present disclosure have the following beneficial effects: through the sludge weighing method of some embodiments of the present disclosure, the waste of resources such as fuel, manpower and time can be reduced. Specifically, the reason for the waste of resources such as fuel, manpower and time in the process of sludge weighing is that the scale has high requirements for the site area, and the site needs to be large enough for the truck to turn around, and the scale has high cost, is prone to failure, and requires professional management and maintenance. These factors together lead to high resources and costs required for the scale. At the same time, transferring the transport vehicle loaded with sludge to a special scale station may cause the consumption of resources such as fuel, manpower and time. Based on this, the sludge weighing method of some embodiments of the present disclosure, first, in response to detecting that the sludge transport vehicle enters the automatic weighing range, the control calculation module controls the information collection device to collect the vehicle information of the sludge transport vehicle. Among them, the above-mentioned vehicle information includes license plate number picture information and carriage picture information. Automatically collecting the vehicle information of the sludge transport vehicle through the information collection device can reduce labor costs. Then, the control calculation module performs license plate and model recognition on the sludge transport vehicle according to the above-mentioned vehicle information to generate vehicle model information. Among them, the vehicle model information includes the license plate number, vehicle model information, vehicle load information and vehicle compartment size information. Thus, the resource consumption generated by manually recording the license plate number and querying the vehicle model information can be reduced. Afterwards, the control calculation module performs volume recognition on the sludge loaded on the sludge transport vehicle according to the vehicle information and the vehicle model information to generate the loaded sludge volume data. By replacing the weighing of the scale with volume recognition, the demand for the scale equipment can be reduced, and the site and equipment costs can be reduced. Secondly, the control calculation module controls the sampling mechanical arm to collect sludge samples from the loaded sludge, and controls the measuring device to measure the sludge samples to generate the sludge sample volume value and the sludge sample weight value. Then, the control calculation module determines the sludge sample density value corresponding to the sludge sample volume value and the sludge sample weight value. Finally, the control calculation module determines the vehicle sludge weight data of the sludge transport vehicle according to the loaded sludge volume data and the sludge sample density value. The weight of sludge loaded on the sludge transport vehicle is determined by volume and density, which avoids the transfer of the transport vehicle, improves the operating efficiency of the transport vehicle, and reduces the waste of resources such as fuel, manpower and time. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the accompanying drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that components and elements are not necessarily drawn to scale.

[0013] Figure 1is a schematic diagram of an application scenario of the sludge weighing method of some embodiments of the present disclosure; Figure 2 is a flow chart of some embodiments of the sludge weighing method according to the present disclosure; Figure 3 is a schematic structural diagram of some embodiments of the sludge weighing device according to the present disclosure; Figure 4 It is a schematic diagram of the structure of an electronic device suitable for implementing some embodiments of the present disclosure. DETAILED DESCRIPTION

[0014] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0015] It should also be noted that, for ease of description, only the parts related to the invention are shown in the drawings. In the absence of conflict, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0016] It should be noted that the concepts such as "first" and "second" mentioned in the present disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0017] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0018] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0019] The present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with embodiments.

[0020] Figure 1 The present invention is a schematic diagram of an application scenario of the sludge weighing method of some embodiments of the present invention. The sludge weighing method is applied to a sludge weighing device, wherein the sludge weighing device includes: an information collection device, a sampling mechanical arm, a measuring device, a control and calculation module, a transmission module, a power supply component, and a support and protection component.

[0021] exist Figure 1In the application scenario, first of all, the control calculation module 101 can be hardware or software. When the control calculation module is hardware, it can be implemented as a distributed cluster composed of multiple servers or terminal devices, or it can be implemented as a single server or a single terminal device. When the control calculation module is embodied as software, it can be installed in the hardware devices listed above. It can be implemented as multiple software or software modules for providing distributed services, or it can be implemented as a single software or software module. No specific limitation is made here. Here, the control calculation module can be used to coordinate and control other modules, or it can process data from each module. Among them, the transmission module 102 is a module for transmitting information, which can transmit data by wire or wirelessly. The measuring device 103 can be placed separately or mounted at the end of the sampling robot arm to weigh the sludge sample. Secondly, the information collection device 104 can include a camera, a projector, a binocular camera, a laser radar, and a pulse transmitting antenna. Here, the information collection device 104 is used to collect vehicle information of the sludge transport vehicle. The sampling mechanical arm 105 can be composed of multiple joints and a sampling shovel at the end, and is used to take sludge samples from the sludge transport vehicle. The power supply component 106 can power the entire sludge weighing device through the mains, or it can be equipped with a solar power supply device to use a dual power supply method to power the entire device. The support and protection component 107 includes various support and protection sub-components, which are mainly made of materials such as stainless steel, steel structure and polyvinyl chloride plastic, to provide fixation, support and protection for various parts of the sludge weighing device.

[0022] Further references Figure 2 , shows a process 200 of some embodiments of the sludge weighing method according to the present disclosure. The sludge weighing method comprises the following steps: Step 201, in response to detecting that a sludge transport vehicle enters an automatic weighing range, the control calculation module controls the information collection device to collect vehicle information of the sludge transport vehicle.

[0023] In some embodiments, the execution subject (e.g., the control and calculation module) may control the information collection device to collect vehicle information of the sludge transport vehicle in response to detecting that the sludge transport vehicle enters the automatic weighing range. In this case, an infrared sensor may be configured to detect whether there is a sludge transport vehicle within the preset automatic weighing range. Afterwards, if it is detected that the sludge transport vehicle enters the automatic weighing range, the control and calculation module is used to control the information collection device to collect vehicle information of the sludge transport vehicle. In this case, the automatic weighing range may be the area directly below the information collection device.

[0024] Step 202: The control calculation module identifies the license plate and model of the sludge transport vehicle according to the vehicle information to generate vehicle model information.

[0025] In some embodiments, the execution subject can identify the license plate and model of the sludge transport vehicle based on the vehicle information to generate vehicle model information. First, the license plate image information is identified by a preset license plate recognition algorithm to obtain the license plate data. Afterwards, the license plate data is retrieved to find the model information of the transport vehicle from the transport vehicle database to obtain the vehicle model information. Here, the transport vehicle database is a preset database that records the vehicle model information of the sludge transport vehicle. The vehicle model information includes the license plate number, vehicle model information, vehicle load information and vehicle compartment size information.

[0026] As an example, the license plate number recognition algorithm includes but is not limited to at least one of the following: License-Plate-Recognition (license plate recognition algorithm), a license plate recognition algorithm based on OCR (Optical Character Recognition), etc.

[0027] Step 203 : the control calculation module identifies the volume of the sludge loaded on the sludge transport vehicle according to the vehicle information and the vehicle model information, so as to generate the loaded sludge volume data.

[0028] In some embodiments, the execution entity may identify the volume of sludge loaded on the sludge transport vehicle according to the vehicle information and vehicle model information to generate loaded sludge volume data.

[0029] In some optional implementations of some embodiments, the execution subject identifies the volume of sludge loaded on the sludge transport vehicle according to the vehicle information and the vehicle model information to generate the loaded sludge volume data, which may include the following steps: The first step is to perform sparse depth feature extraction on the cabin image information in the above vehicle information to obtain sparse depth features. Among them, the above cabin image information is first preprocessed, and the preprocessed cabin image information can be obtained by adjusting the image size, denoising and enhancing the contrast. After that, the sparse depth feature extraction can be performed on the preprocessed cabin image information through a preset depth feature extraction algorithm to obtain sparse depth features. Among them, the sparse depth feature is a sparse form of the depth feature. Secondly, the depth feature characterizes the distance between the real scene corresponding to each pixel point in the above cabin image information and the above shooting camera.

[0030] As an example, the above-mentioned deep feature extraction algorithm includes but is not limited to at least one of the following: Scale Invariant Feature Transform (SIFT), Speeded-Up Robust Features (SURF), etc.

[0031] The second step is to extract residual features from the above-mentioned car image information to obtain residual depth features. Among them, the above-mentioned car image information is feature extracted through a preset improved residual network to obtain residual depth features. Here, the fully connected layer and pooling layer at the end of the residual network layer (Residual Network, ResNet) are deleted in the above-mentioned improved residual network. Secondly, the residual depth feature is the depth feature extracted by the residual network.

[0032] In practice, the skip links in the residual network can effectively avoid the problems of gradient diffusion and precision degradation that occur in deep convolutional neural networks, and can prevent key information such as the three-dimensional structure and edge information in the car image information from disappearing during deep network propagation, thereby avoiding the degradation of deep prediction quality. At the same time, improving the residual network can achieve a balance between the accuracy and speed of feature extraction.

[0033] The third step is to perform a sparse convolution operation on the above sparse depth features to obtain convolution depth features. The sparse convolution operation can be performed on the above sparse depth features through a sparse convolution network (Sparse Convolution Net) to obtain convolution depth features. The convolution depth features are depth features extracted by the sparse convolution network.

[0034] The fourth step is to splice the residual depth feature and the convolutional depth feature in the channel dimension to obtain a fused depth feature. First, the residual depth feature and the convolutional depth feature are dimensionally aligned to obtain standard residual depth features and standard convolutional depth features of the same resolution. Then, the standard residual depth feature and the standard convolutional depth feature are spliced ​​in the channel dimension to obtain a fused depth feature. Here, the dimensional alignment refers to aligning the length of the feature vector. The feature vector length can be increased to the specified length by padding with zeros, or the feature vector length can be reduced to the specified length by pooling.

[0035] The fifth step is to extract the attention features from the above fused depth features to obtain the attention depth features. First, the channel attention features can be extracted from the above fused depth features through the channel attention module (CAM) to obtain the channel attention depth features. Then, the spatial attention features can be extracted from the above channel attention depth features through the spatial attention module (SAM) to obtain the multi-dimensional attention depth features. After that, the multi-dimensional attention depth features can be input into the global average pooling layer (GAP) to obtain the global pooling depth features. Secondly, the global pooling depth features are input into the fully connected layer and the activation function to obtain the attention weight matrix. Finally, the element-by-element product between the attention weight matrix and the multi-dimensional attention depth features is determined as the attention depth features. Here, the channel attention depth features represent the attention depth features on the channel dimension. At the same time, the multi-dimensional attention depth features represent the channel attention depth features on the spatial dimension. Secondly, the attention depth features are the fused depth features weighted by the attention mechanism, which can enhance the important information of the fused depth features.

[0036] The sixth step is to upsample and decode the above-mentioned attention depth features to obtain a set of loading sludge surface depth information. Among them, the above-mentioned attention depth features can be upsampled and decoded through a preset upsampling decoding module to obtain a set of loading sludge surface depth information. Here, the upsampling decoding module can include two upsampling modules, namely an upsampling convolution layer and an upsampling layer based on bicubic interpolation. Among them, the convolution kernel of the above-mentioned convolution layer can be 3×3 in size. Secondly, the above-mentioned loading sludge surface depth information set includes the distance value from the real scene point corresponding to each pixel point in the above-mentioned carriage picture information to the camera.

[0037] In the seventh step, the above-mentioned sludge surface depth information set is numerically integrated according to the above-mentioned vehicle model information to obtain the sludge volume data. The sludge volume data can be obtained by numerically integrating the above-mentioned sludge surface depth information set according to the compartment size information in the above-mentioned vehicle model information through a preset numerical integration method.

[0038] In practice, the coordinates of the space coordinate points corresponding to each point on the plane of the loaded sludge in the carriage can be determined based on the loaded sludge surface depth information in the loaded sludge surface depth information set and the carriage size information in the vehicle model information. Then, the volume of the loaded sludge in the carriage can be determined based on the coordinates of the above-mentioned space coordinate points by numerical integration.

[0039] As an example, the numerical integration method includes but is not limited to at least one of the following: trapezoidal method, Simpson's method, Gaussian integration method, etc.

[0040] Optionally, the execution subject may identify the volume of sludge loaded on the sludge transport vehicle according to the vehicle information and the vehicle model information to generate the loaded sludge volume data, and may further include the following steps: The first step is to control the projector to project the structured light information onto the upper part of the compartment of the sludge transport vehicle, and control the camera to collect a set of pictures containing structured light. The projector and camera are components of the information collection device, which can be set at Figure 1 The information collection device 104 is used. First, the projector can be controlled to project the structured light information onto the upper part of the compartment of the sludge transport vehicle. At the same time, based on a preset number of times, the camera is controlled to collect pictures of the sludge transport vehicle including structured light projection to obtain a picture set containing structured light. Here, the structured light information includes line scanning structured light and area array structured light. Secondly, the structured light information can include stripe patterns of different frequencies. Correspondingly, the picture set containing structured light includes structured light pictures of different frequencies corresponding to stripe patterns of different frequencies.

[0041] In practice, collecting multiple structured light images can improve data redundancy and enhance the robustness of 3D reconstruction. Secondly, structured light information is usually implemented using digital projection technology. The digital light source built into the projector generates structured light information according to a preset coding algorithm. Since the efficiency of 3D reconstruction using random structured light is low. In order to improve the real-time and accuracy of 3D reconstruction of loaded sludge, mathematically encoded structured light information can be used, such as time-coded structured light information and spatially encoded structured light information.

[0042] The second step is to perform image preprocessing on each structured light picture in the above structured light picture set to obtain a preprocessed structured light picture set. First, each structured light picture in the above structured light picture set can be denoised by a preset denoising algorithm to obtain a denoised structured light picture set. Secondly, each denoised structured light picture in the above denoised structured light picture set can be contrast enhanced by a preset contrast enhancement algorithm to obtain a preprocessed structured light picture set.

[0043] As an example, the denoising algorithm includes but is not limited to at least one of the following: median filtering, Gaussian low-pass filtering, and a denoising method based on deep learning, etc. The contrast enhancement algorithm includes but is not limited to at least one of the following: adaptive histogram equalization, contrast stretching, nonlinear mapping, etc.

[0044] The third step is to perform three-dimensional reconstruction on the pre-processed structured light picture set according to the camera and projector parameter matrix, the camera photometric parameter matrix and the vehicle model information to obtain a three-dimensional model of the sludge in the carriage. Among them, first, the phase main value of the corresponding pixel points in each pre-processed structured light picture of different frequencies in the pre-processed structured light picture set can be calculated by the phase shift method to obtain a phase main value set. Here, the phase shift method includes a three-step phase shift method and a four-step phase shift method. Among them, each phase main value in the phase main value set corresponds to a pre-processed structured light picture of different frequencies. Then, each phase main value in the phase main value set can be phase-unwrapped by a phase unwrapping algorithm to obtain an absolute phase value set. Here, the phase unwrapping algorithm includes time phase unwrapping and space phase unwrapping. After that, the depth of each absolute phase value in the absolute phase value set is estimated according to the camera and projector parameter matrix and the camera photometric parameter matrix through a preset depth information solution algorithm to obtain a carriage loaded sludge depth information set. Among them, the carriage loaded sludge depth information is the depth distance value from each point on the surface of the loaded sludge to the camera. Here, the depth information solving algorithm includes a depth information solving method based on Phase Measurement Profilometry (PMP). Finally, the three-dimensional coordinate values ​​of each point on the loading sludge surface corresponding to the depth distance value from each point on the loading sludge surface to the camera in the above-mentioned carriage loading sludge depth information set can be determined, and the carriage height and carriage width in the carriage size information included in the vehicle model information can be combined to generate a three-dimensional model of the sludge in the carriage.

[0045] In practice, the above-mentioned pre-processed structured light picture set can also be reconstructed in three dimensions by a stereo matching algorithm according to the camera and projector parameter matrix, the camera photometric parameter matrix and the above-mentioned vehicle model information to obtain a three-dimensional model of the sludge in the vehicle compartment. Among them, the above-mentioned camera is a binocular camera. Secondly, the above-mentioned pre-processed structured light picture set includes a left pre-processed structured light picture subset and a right pre-processed structured light picture subset.

[0046] The fourth step is to perform volume segmentation on the above-mentioned three-dimensional model of the sludge in the carriage to generate the loaded sludge volume data. Among them, the irregular three-dimensional model of the sludge in the carriage can be segmented into regular tetrahedrons by the volume segmentation method. Secondly, the volume sum of the above-mentioned tetrahedrons is determined as the loaded sludge volume data.

[0047] Specifically, before controlling the projector to project the structured light information onto the upper part of the compartment of the sludge transport vehicle, and controlling the camera to collect a set of pictures containing structured light, the method further includes: Sub-step one, geometrically calibrate the above-mentioned camera and projector to obtain the camera and projector parameter matrix. First, use the above-mentioned projector to project a calibration object of preset shape and size. Secondly, use the camera to shoot the projected calibration object to obtain a calibration object picture. Finally, calibrate the above-mentioned calibration object picture through a preset geometric calibration method to obtain the camera and projector parameter matrix. Among them, the above-mentioned calibration object may include a checkerboard picture, a dot array picture, etc. Secondly, the camera and projector parameter matrix includes a camera intrinsic parameter matrix, a projector intrinsic parameter matrix, and a camera and projector extrinsic parameter matrix.

[0048] As an example, the geometric calibration method includes but is not limited to at least one of the following: Zhang Zhengyou calibration method, Tsai two-step method, etc.

[0049] Sub-step 2: photometrically calibrate the camera and projector. First, calibration images under different exposure times and lighting conditions can be taken to obtain a calibration image set. Then, the camera photometric parameter matrix can be determined based on the calibration image set using a preset photometric calibration method. Here, the photometric parameters may include exposure time, an inverse function of a sensor response function, optical vignetting correction parameters, etc.

[0050] As an example, the photometric calibration method includes but is not limited to at least one of the following: DSO (Direct Sparse Odometry) photometric calibration method, direct method, etc.

[0051] In practice, when using cameras as key components of information collection equipment to collect information on sludge loaded on the above-mentioned sludge transport vehicles, the following technical problems will be encountered: The imaging effect of the camera is easily affected by lighting. It is difficult to collect clear sludge vehicle image information or structured light images at night, on rainy days and other conditions with poor lighting, which affects the robustness and accuracy of volume recognition of loaded sludge, making it difficult for the camera-based volume recognition solution to generate effective loaded sludge volume data, thereby reducing the robustness and accuracy of the sludge weighing method and device for sludge weighing. Combined with the advantage of LiDAR that it is not easily affected by lighting, the following solution can be decided.

[0052] Optionally, the execution subject may identify the volume of sludge loaded on the sludge transport vehicle according to the vehicle information and the vehicle model information to generate the loaded sludge volume data, and may further include the following steps: The first step is to control the laser radar to collect point cloud information of the sludge loading vehicle to obtain the point cloud information of the sludge vehicle. The laser radar is a component of the information collection device and can be set Figure 1The information collection device 104 is used. Here, the laser radar can be a normal temperature scanning imaging radar. Secondly, the corresponding point cloud information of each point on the surface of the sludge transport vehicle and the sludge in the vehicle compartment can be obtained through the laser radar, that is, the sludge vehicle point cloud information.

[0053] In the second step, according to the above-mentioned vehicle model information, the above-mentioned sludge vehicle point cloud information is point cloud preprocessed to obtain the pre-processed loaded sludge point cloud information. Among them, the above-mentioned sludge vehicle point cloud information can be point cloud preprocessed by a point cloud preprocessing algorithm to obtain the pre-processed sludge vehicle point cloud information. Afterwards, according to the carriage length information, the point cloud information representing the head of the above-mentioned sludge transport vehicle in the pre-processed sludge vehicle point cloud information can be deleted to obtain the point cloud information representing the carriage and the loaded sludge. Then, according to the carriage height information and the distance between the laser radar and the upper surface of the carriage, the distance between the laser radar and the bottom of the carriage can be determined to obtain the lower surface of the loaded sludge. Among them, the above-mentioned carriage length information and carriage height information are obtained from the carriage size information contained in the above-mentioned vehicle model information. Secondly, the distance between the laser radar and the upper surface of the carriage can be determined by the point cloud information with the highest corresponding height in the above-mentioned point cloud information representing the carriage and the loaded sludge. Here, the lower surface of the loaded sludge is a plane in three-dimensional space. After that, the point cloud information with the highest corresponding height in the above point cloud information representing the carriage and the loaded sludge can be deleted to obtain the loaded sludge point cloud information. Finally, the above loaded sludge point cloud information can be vertically mapped to the lower surface of the loaded sludge to obtain the sludge lower surface point cloud information. And, the above loaded sludge point cloud information is supplemented with the lower surface point cloud information to obtain the pre-processed loaded sludge point cloud information.

[0054] As an example, the point cloud preprocessing algorithm includes but is not limited to at least one of the following: a point cloud sliding minimum multiplication sampling method, a radius filter-based filtering algorithm, an outlier filtering algorithm, and the like.

[0055] The third step is to divide the pre-processed loading sludge point cloud information into volume column grids based on a preset grid to obtain a loading sludge point cloud volume column set. The pre-processed loading sludge point cloud information can be volume columnized based on a preset grid to obtain a loading sludge point cloud volume column set. The point cloud volume columnization is a special form of point cloud voxelization, which is the process of converting three-dimensional point cloud data into a columnar structure. Here, the loading sludge point cloud volume column usually has a fixed bottom surface and height, forming a three-dimensional columnar area. Here, the bottom surface is a preset grid, which can be a square grid.

[0056] The fourth step is to determine the body column volume value of each loaded sludge point cloud body column in the above-mentioned loaded sludge point cloud body column set, and generate body column loaded sludge volume data according to each body column volume value. Among them, firstly, the distance value between the point cloud of the highest point and the point cloud of the lowest point in each loaded sludge point cloud body column in the above-mentioned loaded sludge point cloud body column set can be determined to obtain the body column height value of each loaded sludge point cloud body column. Afterwards, the product of the area of ​​the preset grid and the above-mentioned height value of each body column is determined as the body column volume value of each loaded sludge point cloud body column. Finally, the sum of the above-mentioned volume values ​​of each body column is determined as the body column loaded sludge volume data. Among them, the above-mentioned body column loaded sludge volume data represents the loaded sludge volume obtained based on the body column.

[0057] The fifth step is to perform three-dimensional reconstruction on the pre-treated loading sludge point cloud information to obtain a three-dimensional model of the loading sludge. The pre-treated loading sludge point cloud information can be reconstructed in three dimensions by a preset point cloud three-dimensional reconstruction algorithm to obtain a three-dimensional model of the loading sludge.

[0058] As an example, the point cloud 3D reconstruction algorithm includes but is not limited to at least one of the following: sparse view Figure 3 dimensional reconstruction algorithm (SparseFusion), Poisson reconstruction algorithm, etc.

[0059] The sixth step is to perform volume recognition on the three-dimensional model of the loaded sludge to generate three-dimensional reconstructed loaded sludge volume data. The three-dimensional model of the loaded sludge can be volume recognized by the numerical integration and volume segmentation method introduced in step 203 to generate three-dimensional reconstructed loaded sludge volume data. No further details are given here. The three-dimensional reconstructed loaded sludge volume data represents the loaded sludge volume obtained based on the three-dimensional reconstruction.

[0060] The seventh step is to determine the loading sludge volume data according to the body column loading sludge volume data and the three-dimensionally reconstructed loading sludge volume data. If the difference between the body column loading sludge volume data and the three-dimensionally reconstructed loading sludge volume data is greater than a preset threshold, the volume recognition step is repeated. Secondly, if the difference between the body column loading sludge volume data and the three-dimensionally reconstructed loading sludge volume data is less than or equal to a preset threshold, the average value between the body column loading sludge volume data and the three-dimensionally reconstructed loading sludge volume data is determined as the loading sludge volume data. Here, the preset threshold may be 0.5 cubic meters.

[0061] The above-mentioned first step to the seventh step and their related contents, as an inventive point of an embodiment of the present disclosure, solve the above-mentioned technical problem "It is difficult to generate effective volume data of loaded sludge based on the volume recognition solution of the camera under poor lighting conditions, thereby reducing the robustness and accuracy of the sludge weighing method and device for sludge weighing." The factors that lead to the above-mentioned technical problems are often as follows: the imaging effect of the camera is easily affected by lighting, and it is difficult to collect clear sludge vehicle image information or structured light images under poor lighting conditions such as at night and on rainy days, which affects the robustness and accuracy of volume recognition of loaded sludge. If the above-mentioned factors are solved, the robustness and accuracy of volume recognition of loaded sludge can be improved, thereby improving the robustness and accuracy of sludge weighing method and device for sludge weighing. In order to achieve this effect, laser radar can be used to perform volume recognition of sludge loaded on sludge transport vehicles. First, by collecting point cloud data through laser radar, it is not easily affected by lighting, which can improve the robustness of volume recognition of sludge. Then, by preprocessing the point cloud, cleaning and optimizing the original point cloud data, noise and outliers can be eliminated, and the accuracy and reliability of subsequent volume recognition can be improved. After that, the volume of the loaded sludge is determined by the body column-based scheme and the 3D reconstruction-based scheme respectively to avoid the inaccurate volume data caused by a single scheme. Thus, the accuracy of volume recognition of loaded sludge can be improved.

[0062] Step 204 : the control and calculation module controls the sampling mechanical arm to collect sludge samples from the loaded sludge, and controls the measuring device to measure the sludge samples to generate sludge sample volume values ​​and sludge sample weight values.

[0063] In some embodiments, the execution entity may control the sampling robot arm to collect sludge samples from the loaded sludge, and control the measuring device to measure the sludge samples to generate sludge sample volume values ​​and sludge sample weight values.

[0064] In some optional implementations of some embodiments, the execution subject controls the sampling mechanical arm to collect the sludge sample from the loaded sludge, and controls the measuring device to measure the sludge sample to generate the sludge sample volume value and the sludge sample weight value, which may include the following steps: The first step is to determine the preset position coordinates of the preset sampling points corresponding to the upper surface of the sludge loading to obtain a preset position coordinate set. The preset sampling points are evenly distributed in the carriage. Secondly, the coordinates of the preset sampling points can be determined by the external parameter matrix of the sampling mechanical arm and the above-mentioned information collection device to obtain a preset position coordinate set. Here, the external parameter matrix of the sampling mechanical arm and the above-mentioned information collection device can be obtained by hand-eye calibration.

[0065] The second step is to control the sampling mechanical arm to collect sludge samples from each preset position coordinate in the preset position coordinate set to obtain a sludge sample set. The sampling shovel at the end of the sampling mechanical arm can be controlled to collect sludge samples from each preset position coordinate in the preset position coordinate set to obtain a sludge sample set.

[0066] The third step is to control the sampling robot arm to divide the sludge samples in the sludge sample set to obtain a standard volume sludge sample set. The volume value of each standard volume sludge sample in the standard volume sludge sample set is a preset standard volume value. Here, the standard volume sludge sample set can be obtained by pouring each sludge sample into a container with a volume of the preset standard volume value. Secondly, one sludge sample corresponds to one standard volume sludge sample.

[0067] The fourth step is to control the sampling mechanical arm to transport each of the standard volume sludge samples to the measuring device to generate a standard sludge sample weight value set. The measuring device is used to weigh each of the standard volume sludge samples to generate a standard sludge sample weight value set.

[0068] In the fifth step, the preset standard volume value is determined as the sludge sample volume value, and the average value of each standard sludge sample weight value in the standard sludge sample weight value set is determined as the sludge sample weight value. The above-mentioned standard sludge sample weight values ​​can be transmitted to the control calculation module through the transmission module. After that, the average value of each standard sludge sample weight value is determined through the control calculation module. Finally, the above average value is determined as the sludge sample weight value.

[0069] Step 6: In response to the measurement device completing the measurement, the sampling mechanical arm is controlled to transport each standard volume sludge sample in the standard volume sludge sample set to the sludge transport vehicle. The sign that the measurement device completes the measurement may be that the control calculation module receives the standard sludge sample weight value set from the measuring device. Afterwards, if the measuring device completes the measurement, the sampling mechanical arm is controlled to transport each standard volume sludge sample in the standard volume sludge sample set to the sludge transport vehicle.

[0070] Optionally, the execution body controls the sampling mechanical arm to collect sludge samples from the loaded sludge, and controls the measuring device to measure the sludge samples to generate sludge sample volume values ​​and sludge sample weight values, and may further include the following steps: The first step is to determine the preset position coordinates of the preset sampling points corresponding to the upper surface of the sludge loading to obtain a preset position coordinate set. The preset position coordinate set can be obtained by the preset position coordinate determination method in step 204. No further details will be given here.

[0071] In the second step, for each preset position coordinate in the preset position coordinate set, perform the following steps: Sub-step 1: Control the sampling robot arm to collect sludge samples from the above-mentioned preset position coordinates to obtain sludge samples, and perform sample segmentation on the above-mentioned sludge samples to obtain standard volume sludge samples. The sampling robot arm can be controlled to collect sludge samples from the above-mentioned preset position coordinates to obtain sludge samples. Then, control the sampling shovel to perform sample segmentation on the above-mentioned sludge samples to obtain standard volume sludge samples. Here, one sludge sample corresponds to one standard volume sludge sample.

[0072] Sub-step 2: controlling the measuring device to weigh the standard volume sludge sample to obtain the weight value of a single sludge sample. The measuring device is mounted at the end of the sampling mechanical arm.

[0073] Sub-step three, in response to the measurement device completing the measurement, controlling the sampling mechanical arm to put the standard volume sludge sample back into the sludge transport vehicle. The sign that the measurement device completes the measurement is that the control calculation module receives a single sludge sample weight value from the measurement device.

[0074] The third step is to determine the preset standard volume value as the sludge sample volume value, and determine the average value of the single sludge sample weight values ​​as the sludge sample weight value. The average value of the single sludge sample weight values ​​is determined as the sludge sample weight value by controlling the calculation module.

[0075] Step 205 : The control calculation module determines the sludge sample density value corresponding to the sludge sample volume value and the sludge sample weight value.

[0076] In some embodiments, the execution subject may determine a sludge sample density value corresponding to the sludge sample volume value and the sludge sample weight value, wherein the quotient of the sludge sample weight value and the sludge sample volume value may be determined as the sludge sample density value.

[0077] Step 206 : The control calculation module determines the weight data of the entire sludge carried by the sludge transport vehicle according to the loaded sludge volume data and the sludge sample density value.

[0078] In some embodiments, the execution subject may determine the weight data of the whole vehicle of sludge carried by the sludge transport vehicle according to the loaded sludge volume data and the sludge sample density value, wherein the weight data of the whole vehicle of sludge may be determined as the product of the loaded sludge volume data and the sludge sample density value.

[0079] Optionally, after the above step 206, the following steps are further included: In the first step, the vehicle model information, the loaded sludge volume data, the sludge sample density value and the whole vehicle sludge weight data are determined as sludge transportation information.

[0080] In the second step, the control calculation module controls the transmission module to send the above sludge transportation information to the local terminal or remote platform for display.

[0081] The above-mentioned various embodiments of the present disclosure have the following beneficial effects: through the sludge weighing method of some embodiments of the present disclosure, the waste of resources such as fuel, manpower and time can be reduced. Specifically, the reason for the waste of resources such as fuel, manpower and time in the process of sludge weighing is that the scale has high requirements for the site area, and the site needs to be large enough for the truck to turn around, and the scale has high cost, is prone to failure, and requires professional management and maintenance. These factors together lead to high resources and costs required for the scale. At the same time, transferring the transport vehicle loaded with sludge to a special scale station may cause the consumption of resources such as fuel, manpower and time. Based on this, the sludge weighing method of some embodiments of the present disclosure, first, in response to detecting that the sludge transport vehicle enters the automatic weighing range, the control calculation module controls the information collection device to collect the vehicle information of the sludge transport vehicle. Among them, the above-mentioned vehicle information includes license plate number picture information and carriage picture information. Automatically collecting the vehicle information of the sludge transport vehicle through the information collection device can reduce labor costs. Then, the control calculation module performs license plate and model recognition on the sludge transport vehicle according to the above-mentioned vehicle information to generate vehicle model information. Among them, the vehicle model information includes the license plate number, vehicle model information, vehicle load information and vehicle compartment size information. Thus, the resource consumption generated by manually recording the license plate number and querying the vehicle model information can be reduced. Afterwards, the control calculation module performs volume recognition on the sludge loaded on the sludge transport vehicle according to the vehicle information and the vehicle model information to generate the loaded sludge volume data. By replacing the weighing of the scale with volume recognition, the demand for the scale equipment can be reduced, and the site and equipment costs can be reduced. Secondly, the control calculation module controls the sampling mechanical arm to collect sludge samples from the loaded sludge, and controls the measuring device to measure the sludge samples to generate the sludge sample volume value and the sludge sample weight value. Then, the control calculation module determines the sludge sample density value corresponding to the sludge sample volume value and the sludge sample weight value. Finally, the control calculation module determines the vehicle sludge weight data of the sludge transport vehicle according to the loaded sludge volume data and the sludge sample density value. The weight of sludge loaded on the sludge transport vehicle is determined by volume and density, which avoids the transfer of the transport vehicle, improves the operating efficiency of the transport vehicle, and reduces the waste of resources such as fuel, manpower and time.

[0082] Further references Figure 3As an implementation of the methods shown in the above figures, the present disclosure provides some embodiments of a sludge weighing device, which are similar to Figure 2 Corresponding to the method embodiments shown, the device can be specifically applied to various electronic devices.

[0083] like Figure 3 As shown, the sludge weighing device 300 of some embodiments includes: a first control unit 301, a license plate and model recognition unit 302, a volume recognition unit 303, a second control unit 304, a first determination unit 305, and a second determination unit 306. The first control unit 301 is configured to, in response to detecting that the sludge transport vehicle enters the automatic weighing range, control the information collection device to collect vehicle information of the sludge transport vehicle, wherein the vehicle information includes license plate image information and compartment image information; the license plate and model recognition unit 302 is configured to control the control calculation module to perform license plate and model recognition on the sludge transport vehicle according to the vehicle information to generate vehicle model information, wherein the vehicle model information includes license plate number, vehicle model information, vehicle load information and compartment size information; the volume recognition unit 303 is configured to control the control calculation module to perform license plate and model recognition on the sludge transport vehicle according to the vehicle information to generate vehicle model information, wherein the vehicle model information includes license plate number, vehicle model information, vehicle load information and compartment size information. The volume of the sludge loaded on the above-mentioned sludge transport vehicle is identified to generate loaded sludge volume data; the second control unit 304 is configured as the above-mentioned control calculation module to control the sampling mechanical arm to collect sludge samples from the loaded sludge, and control the measuring device to measure the above-mentioned sludge samples to generate sludge sample volume values ​​and sludge sample weight values; the first determination unit 305 is configured as the above-mentioned control calculation module to determine the sludge sample density value corresponding to the above-mentioned sludge sample volume value and the above-mentioned sludge sample weight value; the second determination unit 306 is configured as the above-mentioned control calculation module to determine the whole vehicle sludge weight data loaded on the above-mentioned sludge transport vehicle according to the above-mentioned loaded sludge volume data and the above-mentioned sludge sample density value.

[0084] It is understood that the units described in the device 300 are similar to those described in the reference Figure 2 Therefore, the operations, features and beneficial effects described above for the method are also applicable to the device 300 and the units contained therein, and will not be described in detail here.

[0085] Reference below Figure 4 , which shows an electronic device (such as Figure 1 The structural diagram of the computing device 101) 400 is shown. Figure 4 The electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0086] like Figure 4 As shown, the electronic device 400 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 401, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 402 or a program loaded from a storage device 408 into a random access memory (RAM) 403. In the RAM 403, various programs and data required for the operation of the electronic device 400 are also stored. The processing device 401, the ROM 402, and the RAM 403 are connected to each other via a bus 404. An input / output (I / O) interface 405 is also connected to the bus 404.

[0087] Typically, the following devices may be connected to the I / O interface 405: an input device 406 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 407 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 408 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 409. The communication device 409 may allow the electronic device 400 to communicate with other devices wirelessly or by wire to exchange data. Although Figure 4 The electronic device 400 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead. Figure 4 Each block shown in the figure may represent one device, or may represent multiple devices as required.

[0088] In particular, according to some embodiments of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In some such embodiments, the computer program can be downloaded and installed from the network through the communication device 409, or installed from the storage device 408, or installed from the ROM 402. When the computer program is executed by the processing device 401, the above-mentioned functions defined in the method of some embodiments of the present disclosure are executed.

[0089] It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by or in combination with an instruction execution system, device or device. In some embodiments of the present disclosure, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer readable signal media may also be any computer readable medium other than computer readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer readable medium may be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0090] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or future developed network.

[0091] The computer-readable medium may be included in the electronic device; or it may exist independently without being installed in the electronic device. The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: in response to detecting that the sludge transport vehicle enters the automatic weighing range, the control calculation module controls the information acquisition device to collect the vehicle information of the sludge transport vehicle, wherein the vehicle information includes license plate number picture information and compartment picture information; the control calculation module performs license plate and model recognition on the sludge transport vehicle according to the vehicle information to generate vehicle model information, wherein the vehicle model information includes license plate number, vehicle model information, vehicle load information and compartment size information; the control The calculation module identifies the volume of the sludge loaded on the sludge transport vehicle according to the vehicle information and the vehicle model information to generate loaded sludge volume data; the control calculation module controls the sampling mechanical arm to collect sludge samples from the loaded sludge, and controls the measuring device to measure the sludge samples to generate sludge sample volume values ​​and sludge sample weight values; the control calculation module determines the sludge sample density values ​​corresponding to the sludge sample volume values ​​and the sludge sample weight values; the control calculation module determines the whole vehicle sludge weight data carried by the sludge transport vehicle according to the loaded sludge volume data and the sludge sample density values.

[0092] Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0093] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0094] The units described in some embodiments of the present disclosure may be implemented by software or hardware. The units described may also be set in a processor, for example, it may be described as: a processor includes a first control unit, a license plate and model recognition unit, a volume recognition unit, a second control unit, a first determination unit, and a second determination unit. The names of these units do not constitute limitations on the units themselves in some cases. For example, the first control unit may also be described as a "unit that controls the information collection device to collect information."

[0095] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0096] The above descriptions are only some preferred embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above inventive concept. For example, the above features are replaced with (but not limited to) technical features with similar functions disclosed in the embodiments of the present disclosure.

Claims

1. A sludge weighing method, applied to a sludge weighing device, wherein: The sludge weighing device comprises: an information collection device, a sampling mechanical arm, a measuring device, a control calculation module, a transmission module, a power supply component and a support protection component, including: In response to detecting that the sludge transport vehicle enters the automatic weighing range, the control calculation module controls the information collection device to collect vehicle information of the sludge transport vehicle, wherein the vehicle information includes license plate number image information and carriage image information; The control calculation module performs license plate and model recognition on the sludge transport vehicle according to the vehicle information to generate vehicle model information, wherein the vehicle model information includes license plate number, vehicle model information, vehicle load information and vehicle compartment size information; The control calculation module identifies the volume of the sludge loaded on the sludge transport vehicle according to the vehicle information and the vehicle model information to generate loaded sludge volume data; The control and calculation module controls the sampling mechanical arm to collect sludge samples from the loaded sludge, and controls the measuring device to measure the sludge samples to generate sludge sample volume values ​​and sludge sample weight values; The control calculation module determines the sludge sample density value corresponding to the sludge sample volume value and the sludge sample weight value; The control calculation module determines the weight data of the entire vehicle of sludge carried by the sludge transport vehicle according to the loaded sludge volume data and the sludge sample density value.

2. The method according to claim 1, wherein: The method further comprises: The control calculation module determines the vehicle model information, the loaded sludge volume data, the sludge sample density value and the vehicle sludge weight data as sludge transportation information; The control calculation module controls the transmission module to send the sludge transportation information to a local terminal or a remote platform for display.

3. The method according to claim 1, wherein: The control calculation module identifies the volume of the sludge loaded on the sludge transport vehicle according to the vehicle information and the vehicle model information to generate loaded sludge volume data, including: Performing sparse depth feature extraction on the carriage image information in the vehicle information to obtain sparse depth features; Performing residual feature extraction on the carriage image information to obtain residual depth features; Performing a sparse convolution operation on the sparse depth feature to obtain a convolution depth feature; Concatenating the residual depth feature and the convolutional depth feature in terms of channel dimension to obtain a fused depth feature; Performing attention feature extraction on the fused depth feature to obtain an attention depth feature; Upsampling and decoding the attention depth feature to obtain a sludge loading surface depth information set, wherein the sludge loading surface depth information set includes a distance value from a real scene point corresponding to each pixel point in the carriage image information to a camera; According to the vehicle model information, the loaded sludge surface depth information set is numerically integrated to obtain loaded sludge volume data.

4. The method according to claim 1, wherein: The information collection device includes a projector and a camera; and The control calculation module identifies the volume of the sludge loaded on the sludge transport vehicle according to the vehicle information and the vehicle model information to generate loaded sludge volume data, and further includes: Controlling the projector to project the structured light information onto the upper part of the compartment of the sludge transport vehicle, and controlling the camera to collect a set of pictures containing the structured light; Performing image preprocessing on each structured light picture in the structured light picture set to obtain a preprocessed structured light picture set; According to the camera and projector parameter matrix, the camera photometric parameter matrix and the vehicle model information, the pre-processed structured light image set is three-dimensionally reconstructed to obtain a three-dimensional model of the sludge in the vehicle compartment; The three-dimensional model of the sludge in the carriage is volume segmented to generate loaded sludge volume data.

5. The method according to claim 1, wherein: The control calculation module controls the sampling mechanical arm to collect sludge samples from the loaded sludge, including: Determine the preset position coordinates of the upper surface of the sludge loading device corresponding to the preset sampling points to obtain a preset position coordinate set; Controlling the sampling mechanical arm to collect sludge samples from each preset position coordinate in the preset position coordinate set to obtain a sludge sample set; The sampling mechanical arm is controlled to perform sample segmentation on each sludge sample in the sludge sample set to obtain a standard volume sludge sample set, wherein the volume value of each standard volume sludge sample in the standard volume sludge sample set is a preset standard volume value.

6. The method according to claim 5, wherein: The control and measurement device measures the sludge sample to generate a sludge sample volume value and a sludge sample weight value, including: Controlling the sampling mechanical arm to transport each standard volume sludge sample to the measuring device to generate a standard sludge sample weight value set; Determining the preset standard volume value as the sludge sample volume value, and determining the average value of each standard sludge sample weight value in the standard sludge sample weight value set as the sludge sample weight value; In response to the measurement device completing the measurement, the sampling mechanical arm is controlled to transport each standard volume sludge sample in the standard volume sludge sample set to the sludge transport vehicle.

7. A sludge weighing device, comprising: A first control unit is configured to control the calculation module to control the information collection device to collect vehicle information of the sludge transport vehicle in response to detecting that the sludge transport vehicle enters the automatic weighing range, wherein the vehicle information includes license plate number image information and carriage image information; a license plate and model recognition unit, configured so that the control calculation module performs license plate and model recognition on the sludge transport vehicle according to the vehicle information to generate vehicle model information, wherein the vehicle model information includes a license plate number, vehicle model information, vehicle load information and vehicle compartment size information; a volume recognition unit configured so that the control calculation module can perform volume recognition on the sludge loaded on the sludge transport vehicle according to the vehicle information and the vehicle model information to generate loaded sludge volume data; A second control unit is configured so that the control calculation module controls the sampling mechanical arm to collect sludge samples from the loaded sludge, and controls the measuring device to measure the sludge sample to generate a sludge sample volume value and a sludge sample weight value; A first determining unit is configured to determine, by the control calculation module, a sludge sample density value corresponding to the sludge sample volume value and the sludge sample weight value; The second determining unit is configured so that the control calculation module determines the weight data of the entire vehicle of sludge carried by the sludge transport vehicle according to the loaded sludge volume data and the sludge sample density value.

8. An electronic device, comprising: one or more processors; a storage device having one or more programs stored thereon; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 6.

9. A computer readable medium having a computer program stored thereon, wherein: When the program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

Citation Information

Patent Citations

  • Real-time shielding residue soil volume measurement method based on optical grating projection binocular-imaging technology

    CN106839977A

  • Muck truck earthwork loading judgment method and system based on point cloud data

    CN112184707A

  • Method, device and equipment for measuring unloading time of mine truck and storage medium

    CN115856923A

  • Method and system for calculating stacking volume after point cloud registration for black coal loading vehicle

    CN116843742A

  • Acquisition method and device for carrying-out weight of dry sludge

    CN117455976A