Method and device for monitoring garbage can collecting state of sanitation vehicle, medium and terminal
By acquiring the operation signals and in-place status of the trash cans and combining them with video analysis, the accuracy and cost issues of counting the number of trash cans collected are solved, and efficient and accurate updates of the number of trash cans and abnormality identification are achieved.
Patent Information
- Application Number
- CN202510512311.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-04-22
- Publication Date
- 2025-09-09
AI Technical Summary
The existing method of counting the number of garbage bins collected cannot take into account both accuracy and cost. Manual recording is inefficient and has high labor costs. In addition, there are abnormal situations such as failure to hang the bins and garbage bins falling off, which leads to low statistical accuracy.
By obtaining the operation signal and in-place status of the trash can, the operation stage of the trash can in the garbage dumping process is determined, and the effectiveness of the garbage dumping is judged based on the in-place status. The number of garbage bins collected is updated, and the effectiveness of the dumping is further confirmed using video analysis.
The accuracy of trash bin counting is improved, costs are saved, and the ability to identify abnormal situations is improved through video analysis, ensuring the accuracy and efficiency of trash bin counting.
Smart Images

Figure CN120607044A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present invention relate to the field of environmental protection technology, and in particular to a method and device, medium, and terminal for monitoring the collection status of a garbage bin of a sanitation vehicle. Background Art
[0002] With the rapid development of the economy, the number of cities and their populations have increased significantly. As the scale and scope of cities continue to expand, the amount of urban domestic waste is also increasing. The collection of waste by sanitation vehicles is a key stage in waste disposal.
[0003] During the operation of sanitation vehicles, measuring the number of trash cans collected is a key parameter for evaluating the vehicle's workflow. Currently, at the site of garbage dumping operations, counting personnel manually record and tally the total number of effective dumping operations (essentially equivalent to the total number of trash cans used for effective dumping). Some methods use trash can weighing to measure the effective collection and weight of trash cans collected during a single operation. However, due to abnormalities in the actual garbage collection process, such as failed hanging bins and trash cans falling off, the accuracy of the collected trash can count is low. Manual recording is inefficient and labor-intensive. In summary, existing methods of counting the number of trash cans collected fail to strike a balance between accuracy and cost. Summary of the Invention
[0004] The technical problem solved by the embodiments of the present invention is that the existing method of counting the number of garbage bins cannot take into account both accuracy and cost.
[0005] To solve the above technical problems, an embodiment of the present invention provides a method for monitoring the collection status of a garbage bin of a sanitation vehicle, comprising: obtaining an operation signal for the garbage bin and the in-place status of the garbage bin during the garbage dumping process, wherein the operation signal is at least used to determine the operation stage of the garbage bin during the garbage dumping process, the operation stage at least includes a rising stage, a dumping stage and a descending stage, and the in-place status of the garbage bin is used to characterize whether the garbage bin is on a garbage bin carrying device; based on the in-place status of the garbage bin in each operation stage, a first result is obtained, the first result at least including the dumping effectiveness of this garbage dumping; at least based on the first result, the number of collection bins of the garbage bin is updated.
[0006] Optionally, the updating of the number of collection bins in the trash can at least based on the first result includes: if the dumping validity in the first result indicates that the garbage dumping is a valid dumping, updating the number of collection bins in the trash can to increase the original number of collection bins by 1.
[0007] Optionally, the updating of the number of collection bins of the trash can is based at least on the first result, including: if the dumping validity in the first result indicates that the current garbage dumping is invalid or the validity is pending, obtaining the first dumping video of the current garbage dumping; identifying and analyzing the first dumping video to obtain a second result, the second result at least including the dumping validity of the current garbage dumping; and updating the number of collection bins of the trash can at least based on the first result and the second result.
[0008] Optionally, the updating of the number of collection bins in the trash can is based at least on the first result and the second result, including: if the dumping validity in the first result and the second result is the same and both are invalid dumping, updating the number of collection bins in the trash can is to maintain the original number of collection bins.
[0009] Optionally, the garbage bin collection status monitoring method also includes: if the dumping validity in the first result is different from the dumping validity in the second result, marking the working status of this garbage dumping as abnormal, and the information of the working status abnormality marking is at least included in the video information of the first dumping video.
[0010] Optionally, the method for monitoring the trash can collection status further includes: outputting a first video showing an abnormal working status.
[0011] Optionally, the updating of the number of collection bins of the trash can is based at least on the first result and the second result, including: if the dumping validity in the first result is different from the dumping validity in the second result, obtaining a second dumping video of this garbage dumping, the first dumping video and the second dumping video are respectively captured by two different image acquisition devices, and the installation positions of the two image acquisition devices are different; identifying and analyzing the second dumping video to obtain a third result, the third result at least includes the dumping validity of this garbage dumping; if the dumping validity in the third result is the same as the dumping validity of the first result or one of the second results, updating the number of collection bins of the trash can based on the third result.
[0012] Optionally, the identification and analysis of the first dumping video includes: performing target detection on each frame image in the first dumping video to obtain detection information of the target object, where the target object is a specified part of the trash can; tracking the target object, and determining the operation stage of the trash can based on changes in the detection information of the target object during the target tracking process; counting the number of trash cans in each operation stage to obtain the second result.
[0013] Optionally, the counting of the trash cans in each operation stage and obtaining the second result include: counting the first number of the trash cans appearing in the ascending stage; counting the second number of the trash cans appearing in the descending stage; if the first number of the trash cans is greater than the second number of the trash cans, it is determined that the trash can falls off in the descending stage, and the second number of the trash cans is updated to be the same as the first number of the trash cans, and the second result is obtained, and the effectiveness of this garbage dumping in the second result is effective dumping; if the first number of the trash cans is less than the second number of the trash cans, the second result is obtained, and the effectiveness of this garbage dumping in the second result is effective dumping; if the first number of the trash cans is equal to the second number of the trash cans, and both indicate that no trash can appears, the effectiveness of this garbage dumping in the second result is invalid dumping.
[0014] Optionally, counting the first number of collecting bins in the rising stage of the trash can includes: after determining that the trash can is in the rising stage, counting the first number of collecting bins in the rising stage; if the trash can is determined to be in the rising stage multiple times, exiting the counting of the trash can in the rising stage.
[0015] Optionally, the detection information of the target object includes at least: the category of the target object, the area of the target object, the center position of the target object and the size of the target object. The target object is tracked and the operation stage of the trash can is determined according to the change of the detection information of the target object during the target tracking process, including: during the target tracking process, obtaining the center position change information of the target object and the size change information of the target object according to the detection information of the target object; obtaining the corresponding operation stage determination rule according to the category of the target object; and determining the operation stage of the trash can based on the obtained operation stage determination rule, the center position change information of the target object and the size change information of the target object.
[0016] Optionally, the operation stage determination rule includes an ascending stage determination rule and a descending stage determination rule, and the operation stage of the trash can is determined based on the acquired operation stage determination rule, the center position change information of the target object, and the size change information of the target object, including: the ascending stage determination rule includes: the center position continues to rise and the size of the target object continues to increase. If the center position change information of the target object meets the requirements that the center position continues to rise and the size change information of the target object meets the requirements that the size of the target object continues to increase, then it is determined that the trash can is in the ascending stage; the descending stage determination rule includes: the center position continues to descend and the size of the target object continues to decrease. If the center position change information of the target object meets the requirements that the center position continues to descend and the size change information of the target object meets the requirements that the size of the target object continues to decrease, then it is determined that the trash can is in the descending stage.
[0017] Optionally, the trash can collection status monitoring method further includes: before determining the operation stage of the trash can based on the acquired operation stage judgment rules, the center position change information of the target object and the size change information of the target object, determining whether the target object is within the valid area according to the area of the target object.
[0018] Optionally, target detection is performed on each frame image in the first dumping video to obtain detection information of the target object, including: determining the confidence of each category of target objects in the target detection based on the type of garbage in the trash can and / or the current time; and performing target detection on each frame image based on the confidence of each category of target objects to obtain detection information of the target object.
[0019] Optionally, the first dumping video starts to be collected when a lifting signal is detected and the trash can in-place status indicates that the trash can is on the trash can carrying device; and / or, the first dumping video ends to be collected after a lowering signal is detected and the trash can in-place status indicates that the trash can has left the trash can carrying device.
[0020] Optionally, the method for monitoring the collection status of a trash can further includes: obtaining the operation time of the operation signal for the trash can, and using the operation time as video information of the first dumping video.
[0021] Optionally, the video information of the first dumping video also includes: location information and / or working status information, and the working status information is used to indicate whether each operation node in the entire garbage dumping process is normal.
[0022] Optionally, the first result is obtained based on the in-place status of the trash can in each operation stage, including: when the in-place status of the trash can in the ascending stage suddenly changes from being on the trash can carrying device to not being on the trash can carrying device, the dumping validity of this garbage dumping is determined to be invalid dumping, and the first result is obtained; when the in-place status of the trash can in the ascending stage and the dumping stage are both on the trash can carrying device, and the in-place status in the descending stage is not being on the trash can carrying device, the dumping validity of this garbage dumping is determined to be valid dumping, and the first result is obtained; when the trash can in the ascending stage and the dumping stage is not on the trash can carrying device and the descent stage are all on the trash can carrying device, the dumping validity of this garbage dumping is determined to be valid dumping, and the first result is obtained; when the trash can is not on the trash can carrying device in the ascending stage, the dumping stage and the descent stage, the dumping validity of this garbage dumping is determined to be invalid dumping, and the first result is obtained; when the trash can is on the trash can carrying device in the ascending stage and its in-place state in the dumping stage suddenly changes from being on the trash can carrying device to not being on the trash can carrying device, the dumping validity of this garbage dumping is determined to be valid pending, and the first result is obtained.
[0023] Optionally, the operation signal includes at least a bin-raising signal for controlling the raising of the trash can, and when the bin-raising signal is detected, the presence detection of the trash can is activated.
[0024] Optionally, before obtaining the operation signal for the trash can, the method includes: locating the position of the sanitation vehicle; and starting the collection of the operation signal for the trash can after locating that the sanitation vehicle has entered the working range.
[0025] The present application also provides a garbage bin collection status monitoring device for a sanitation vehicle, comprising: an acquisition unit, configured to acquire an operation signal for the garbage bin and its in-place status during the garbage dumping process, wherein the operation signal is at least used to determine the operation stage of the garbage bin during the garbage dumping process, the operation stage at least including a rising stage, a dumping stage and a descending stage, and the garbage bin in-place status is used to characterize whether the garbage bin is on a garbage bin carrying device; a determination unit, configured to obtain a first result based on the in-place status of the garbage bin in each operation stage, the first result at least including the dumping effectiveness of this garbage dumping; a counting unit, configured to update the number of garbage bins collected based at least on the first result.
[0026] The present application also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of any of the above-mentioned methods for monitoring the status of a garbage bin collection of a sanitation vehicle are executed.
[0027] The present application also provides a terminal including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor runs the computer program, the steps of any of the above-mentioned methods for monitoring the garbage bin collection status of a sanitation vehicle are executed.
[0028] The present application also provides a computer program product, including a computer program / instruction, which is executed by a processor to perform the steps of any of the above-mentioned methods for monitoring the collection status of a garbage bin of a sanitation vehicle.
[0029] Compared with the prior art, the technical solution of the embodiment of the present invention has the following beneficial effects:
[0030] During the garbage dumping process, an operation signal for the garbage bin and the in-place status of the garbage bin during the garbage dumping process are obtained. The operation signal can at least determine the operation stage of the garbage bin during the garbage dumping process, and the operation stage at least includes the rising stage, the dumping stage, and the descending stage. Since the in-place status of the garbage bin can indicate whether the garbage bin is on the garbage bin carrying device, a first result can be obtained based on the in-place status of the garbage bin in each operation stage. The first result includes at least the dumping effectiveness of the garbage dumping. Determining the dumping effectiveness of the garbage dumping by the in-place status of the garbage bin in each operation stage can more realistically reflect the actual situation of the garbage bin on the garbage carrying device during the garbage dumping process and whether the actual dumping situation is normal. Therefore, updating the number of garbage bins collected based on the first result can improve the accuracy of the garbage bin number statistics. In addition, compared with manual recording methods, it saves costs. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] Figure 1 This is a flow chart of a method for monitoring the status of a garbage bin collection bin of a sanitation vehicle according to an embodiment of the present invention;
[0032] Figure 2 is a flowchart of a specific implementation scheme of step 13;
[0033] Figure 3 is a flowchart of a specific implementation scheme of step 132;
[0034] Figure 4 The figure is a structural diagram of a garbage bin collection status monitoring device for a sanitation vehicle according to an embodiment of the present invention. DETAILED DESCRIPTION
[0035] As mentioned above, manual recording is inefficient and labor-intensive. Weighing trash cans, on the other hand, allows for the effective collection of trash cans and the measurement of collected weights during a single operation. However, due to anomalies during actual collection, such as failed hanging bins or trash cans falling off, the accuracy of collected trash can counts is low. Therefore, existing methods for counting collected trash cans fail to achieve a balanced balance between accuracy and cost.
[0036] To address the above-mentioned issues, in an embodiment of the present invention, during the garbage dumping process, an operation signal for the garbage bin and the in-place status of the garbage bin during the garbage dumping process are obtained. The operation signal can at least determine the operation stage of the garbage bin during the garbage dumping process, and the operation stage can at least include the rising stage, the dumping stage, and the descending stage. Since the in-place status of the garbage bin can indicate whether the garbage bin is on the garbage bin carrying device, a first result can be obtained based on the in-place status of the garbage bin in each operation stage. The first result includes at least the dumping effectiveness of the garbage dumping. Determining the dumping effectiveness of the garbage dumping by the in-place status of the garbage bin in each operation stage can more realistically reflect the actual situation of the garbage bin on the garbage carrying device during the garbage dumping process and whether the actual dumping situation is normal. Therefore, updating the number of garbage bins collected based on the first result can improve the accuracy of the garbage bin collection statistics and save costs compared to manual recording methods.
[0037] In order to make the above-mentioned objects, features and beneficial effects of the embodiments of the present invention more obvious and easy to understand, specific embodiments of the present invention are described in detail below with reference to the accompanying drawings.
[0038] This application provides a method for monitoring the collection status of trash cans on a sanitation vehicle. This method can be used to count the number of trash cans collected by the sanitation vehicle during operation, thereby automatically counting the number of collected trash cans. The method can be executed by a terminal installed on the sanitation vehicle, a cloud platform, a cloud service, or a local device, and can be configured based on the specific application scenario.
[0039] In specific implementations, sanitation vehicles include wet garbage trucks, dry garbage trucks, food waste trucks, compressed garbage trucks, recyclable material transport trucks, etc. The sanitation vehicle is provided with a trash can dumping device (also known as a trash can lifting device), and the trash can dumping device includes a trash can carrying device. When dumping garbage, the trash can is mounted on the trash can carrying device, and the trash can carrying device drives the trash can to rise, flip, and lower, etc., so that the garbage in the trash can is dumped into the compartment of the sanitation vehicle. The compartment is usually equipped with a garbage dumping inlet, and the trash can carrying device is usually set at a corresponding position of the garbage can dumping inlet, such as below the garbage can dumping inlet or other suitable positions. In practice, the setting position of the trash can dumping device varies depending on the type of sanitation vehicle, and the specific setting position of the trash can dumping device is not limited here.
[0040] See also Figure 1 , a flowchart of a method for monitoring the state of a garbage bin collection bin of a sanitation vehicle according to an embodiment of the present invention is given, see Figure 1 The method for monitoring the status of a garbage bin collection includes the following steps:
[0041] Step 11: Obtain an operation signal for the trash can and the in-place status of the trash can during the garbage dumping process, wherein the operation signal is at least used to determine the operation stage of the trash can during the garbage dumping process, and the operation stage at least includes an ascending stage, a dumping stage, and a descending stage, and the in-place status of the trash can is used to characterize whether the trash can is on the trash can carrying device.
[0042] Step 12: obtaining a first result based on the status of the trash can in each operation stage, wherein the first result at least includes the effectiveness of the current trash dumping.
[0043] Step 13: Update the number of collection bins in the trash bin based at least on the first result.
[0044] As can be seen from the above, during the garbage dumping process, the operation signal for the garbage bin and the in-place status of the garbage bin during the garbage dumping process are obtained, and the operation signal can at least determine the operation stage of the garbage bin during the garbage dumping process, and the operation stage at least includes the rising stage, the dumping stage and the descending stage. Since the in-place status of the garbage bin can characterize whether the garbage bin is on the garbage bin carrying device, a first result can be obtained based on the in-place status of the garbage bin in each operation stage. The first result includes at least the dumping effectiveness of this garbage dumping. Determining the dumping effectiveness of the garbage dumping by the in-place status of the garbage bin in each operation stage can more realistically reflect the actual situation of the garbage bin on the garbage carrying device during the garbage dumping process and whether the actual dumping situation is normal, so that updating the number of garbage bins based on the first result can improve the accuracy of the garbage bin number statistics.
[0045] In a specific implementation, during the trash can emptying process, the trash can carrier can be controlled in response to an operation signal, thereby controlling the trash can on the carrier to empty. For example, the trash can carrier can be controlled to rise in response to an operation signal, thereby driving the trash can upward. After the trash can reaches a certain height, the trash can can be turned over in response to an operation signal. During the turning process, the bottom of the trash can can be higher than the opening of the trash can, and the trash in the trash can can be dumped out through one or more flips. After the trash is completely emptied, the trash can carrier can be controlled to descend in response to an operation signal, thereby driving the trash can downward.
[0046] The operation signal may include a lifting signal, a flipping signal, a lowering signal, etc. Among them, the lifting signal is used to control the trash can to rise. The flipping signal is used to control the trash can to flip. The lowering signal is used to control the trash can to lower.
[0047] The operational phases of a trash can during the dumping process include at least the raising phase, the dumping phase, and the lowering phase. The operational phase of a trash can can be determined in a variety of ways. For example, the phase between the raising signal and the flipping signal is the raising phase, the phase between the flipping signal and the lowering signal is the flipping phase, and the phase after the lowering signal is the lowering phase.
[0048] Furthermore, when acquiring the operation signal, the triggering time of the operation signal is acquired. Based on the triggering time of the operation signal, an operation time period corresponding to the operation phase can be determined, where the operation time period includes a start time and an end time.
[0049] Furthermore, the operational phases of the trash can during the garbage dumping process may also include the phase of pushing or moving the trash can into the effective area and the phase of mounting the trash can on the trash can carrier. The phase of pushing or moving the trash can into the effective area precedes the phase of mounting the trash can on the trash can carrier and precedes the ascending phase. After the descending phase, the operational phase may also include the phase of pushing the trash can out of the effective area.
[0050] It should be noted that in some cases, in a single garbage dumping operation, one or more of the above stages may actually be repeated, one or more of the above stages may not be experienced, or in addition to several of the above-listed stages, other stages may also be experienced.
[0051] In a typical application scenario, the operation signal includes at least a lift signal for controlling the trash can to rise. When the lift signal is detected, the presence detection function for the trash can is activated. After the presence detection function is activated, the presence status of the trash can can be collected, thereby saving resources.
[0052] In some embodiments, the presence of the trash can may be detected in a variety of ways.
[0053] For example, a pressure sensor is installed on a trash can carrier, and the pressure detected by the pressure sensor is used to determine whether the trash can is on the trash can carrier. When the value detected by the pressure sensor is greater than or equal to a set pressure threshold, the trash can is determined to be on the trash can carrier. Correspondingly, when the value detected by the pressure sensor is less than the set pressure threshold, it is determined that the trash can is not on the trash can carrier, that is, the trash can has fallen off the trash can carrier. The set pressure threshold is less than the weight of the empty trash can. The pressure sensor can be set on the trash can carrier and located at the bottom of the trash can. The pressure sensor can also be set on the rack in the trash can carrier for hanging the trash can.
[0054] For example, a distance sensor is installed on the trash can carrier to determine whether the trash can is on the trash can carrier by detecting the distance between the distance sensor and the trash can. When the detected distance is less than or equal to a set distance threshold, the trash can is determined to be on the trash can carrier. Correspondingly, when the detected distance is greater than the set distance threshold, the trash can is determined to be off the trash can carrier, i.e., it has fallen off the trash can carrier.
[0055] For another example, a trigger switch is provided on the hanger of the trash can carrying device. When the trash can is hung on the hanger, the signal fed back by the trigger switch can be used to determine whether the trash can is on the trash can carrying device.
[0056] Before step 11, the position of the sanitation vehicle may be located. When the sanitation vehicle is located to enter the working range, the collection of the operation signal for the garbage bin is started.
[0057] In a specific implementation, a positioning device may be installed on the sanitation vehicle. The positioning device may be a Global Positioning System (GPS) or a Beidou Navigation Satellite System (BDS, also known as COMPASS).
[0058] The operating range can be, for example, a pre-set garbage station or designated collection point. Each sanitation vehicle's corresponding operating range can be pre-configured and bound. For example, the vehicle's license plate can be bound to the corresponding operating range. This can further improve control accuracy, avoid false triggering of operation signals for garbage bins, prevent the collection of easily accessible information, improve the effectiveness of collected operation signals, and reduce energy consumption.
[0059] In practice, the working area range of the sanitation vehicle can be adjusted and updated to meet the work deployment needs of the sanitation vehicle.
[0060] In some embodiments, before starting to collect the operation signal for the trash can, the device for collecting the operation signal for the trash can may be in a dormant state, thereby saving energy consumption.
[0061] In some embodiments, the sanitation vehicle may be provided with operation buttons, such as an ascending operation button, a flipping operation button, and a descending operation button. When the operator triggers the ascending operation button, the trash can carrying device drives the trash can mounted thereon to ascend. When the operator triggers the flipping operation button, the trash can carrying device drives the trash can mounted thereon to flip over for garbage dumping. When the operator triggers the descending operation button, the trash can carrying device drives the trash can mounted thereon to descend. It is understandable that the operation signal is not limited to being triggered by the operation buttons provided on the sanitation vehicle. For sanitation vehicles with automatic dumping, the corresponding program can be pre-configured, and the operation signals corresponding to different stages can be configured in the program to detect the current operation stage of the trash can and generate the required operation signals based on the current operation stage.
[0062] In typical scenarios, the trash can carrier of some sanitation vehicles is usually stowed. The operator can press and hold the lowering signal to lower the carrier, preparing for the operator to place the trash can. When the operator presses and hold the lowering signal, the device collecting the trash can's operation signals enters the operating state. Once the device is in the operating state, it begins collecting operation signals.
[0063] In step 12, the effectiveness of the current garbage dumping is determined based on the status of the garbage bin in each operation phase, thereby obtaining a first result. The effectiveness of the current garbage dumping varies depending on the status of the garbage bin in each operation phase, as described in detail below.
[0064] In some embodiments, when the trash can suddenly changes from being on the trash can carrier to not being on the trash can carrier during the ascending stage, the dumping validity of this trash dumping is determined to be invalid, and the first result is obtained. At this time, the trash can falls off during the ascending stage.
[0065] Furthermore, for the scenario where the trash can falls off during the rising stage, the working status of this garbage dumping will be marked as abnormal.
[0066] In some embodiments, when the trash can is on the trash can carrier during both the ascending and dumping phases, and is not on the trash can carrier during the descending phase, the dumping validity of the current dumping is determined to be valid, and the first result is obtained. In this case, the trash can falls off during the descent phase.
[0067] Furthermore, for the scenario where the trash can falls off during the descent phase, the garbage dumping will be marked as abnormal in working status.
[0068] In some embodiments, when the trash can is in the position state of being on the trash can carrier during the ascending phase, the dumping phase, and the descending phase, the dumping validity of the current trash dumping is determined to be valid dumping, and the first result is obtained. In this case, it is a valid trash can hanging scenario.
[0069] Furthermore, for the scenario where the barrel is hung effectively, the garbage dumping will be marked as being in normal working condition.
[0070] In some embodiments, when the trash can is not on the trash can carrier during the ascending phase, the dumping phase, and the descending phase, the dumping validity of the current trash dumping is determined to be invalid, and the first result is obtained. In this case, the trash can is in an empty (no trash can) state.
[0071] Furthermore, for the empty (no bucket) scenario, the garbage dumping will be marked as normal working status.
[0072] In some embodiments, when the trash can's in-position state during the rising phase is on the trash can carrier, and its in-position state during the dumping phase suddenly changes from on the trash can carrier to not on the trash can carrier, the dumping validity of this trash dumping is determined to be valid pending, and the first result is obtained. In this case, the trash can falls off during the flipping phase. The in-position state during the dumping phase suddenly changes from on the trash can carrier to not on the trash can carrier, that is, the trash can falls off during the flipping process. At this time, the dumping status of the trash in the trash can is unknown. The trash may have been dumped completely, only a portion of the trash may have been dumped, or no trash may have been dumped at all. For cases where the dumping validity is valid pending, the amount of trash dumped can be further determined by other means.
[0073] Furthermore, for the scenario where the trash can falls off during the flipping stage, the garbage dumping will be marked as abnormal working status.
[0074] In some specific implementations of step 13, if the dumping validity in the first result indicates that the garbage dumping is valid, the number of the garbage bins is updated to increase by 1 based on the original number of the garbage bins.
[0075] In some other specific implementations of step 13, see Figure 2 , step 13 may specifically include the following steps:
[0076] Step 131: If the dumping validity in the first result indicates that the current garbage dumping is invalid or pending, a first dumping video of the current garbage dumping is obtained.
[0077] Step 132: perform identification analysis on the first dumping video to obtain a second result, which at least includes the dumping effectiveness of this garbage dumping.
[0078] Step 133: Update the number of collection bins in the trash bin based on at least the first result and the second result.
[0079] In a specific implementation of step 133, if the dumping validity in the first result and the second result are the same and both are invalid dumping, the number of bins in the trash can is updated to maintain the original number of bins. That is, when the dumping is invalid, the number of bins in the trash can remains the original number of bins.
[0080] In some embodiments, if the dumping validity in the first result is different from the dumping validity in the second result, the working status of this garbage dumping is marked as abnormal, that is, the working status label is marked as abnormal, and the information of the working status abnormality marking is at least included in the video information of the first dumping video.
[0081] Because the method of judging the effectiveness of garbage dumping based on the status of the garbage bin in each operational stage requires less computing power and energy consumption, and has higher accuracy, compared to relying on video recognition and analysis throughout the process, when the dumping effectiveness in the first result indicates that the garbage dumping was invalid or pending, a first dumping video of the garbage dumping is obtained, and the garbage dumping effectiveness is further judged based on the dumping effectiveness in the first result obtained based on the status of the garbage bin in each operational stage and the dumping effectiveness in the second result obtained based on the first dumping video. This can improve the accuracy of the garbage dumping effectiveness judgment while saving computing power and energy consumption.
[0082] Furthermore, the first video showing an abnormal working state can be output. For example, the first video showing an abnormal working state can be output to a designated location for manual review by back-end personnel. This allows back-end personnel to quickly locate the dumping video corresponding to the trash can that showed an abnormal working state during the dumping process, eliminating the need to screen each video one by one from a large amount of videos, thereby improving review efficiency.
[0083] In another specific implementation of step 133, if the dumping validity in the first result is different from the dumping validity in the second result, a second dumping video of this garbage dumping is obtained, and the first dumping video and the second dumping video are respectively captured by two different image acquisition devices, and the installation positions of the two image acquisition devices are different; the second dumping video is identified and analyzed to obtain a third result, and the third result at least includes the dumping validity of this garbage dumping; if the dumping validity in the third result is the same as the dumping validity of the first result or one of the second results, the number of collection bins of the garbage bin is updated based on the third result.
[0084] In some embodiments, the image capture device may be a camera. Two different image capture devices are installed at different locations on the sanitation vehicle to capture video of the trash can being emptied from different angles. At least one image capture device can capture the entire process of the trash can being emptied. The other image capture device can capture the entire process of the trash can being emptied, or can capture at least the final image of the dumping process.
[0085] When the sanitation vehicle can simultaneously empty two or more trash cans, the two image capture devices must be installed in positions that allow them to simultaneously capture the emptying videos of all the trash cans. It is understood that corresponding image capture devices can also be configured for trash cans placed in different positions to capture the emptying videos.
[0086] In some non-limiting embodiments, when two image capture devices are installed in positions sufficient to simultaneously capture videos of all trash cans being dumped, one image capture device can be configured as a primary image capture device and the other as a secondary image capture device. The video captured by the primary image capture device serves as the first dumping video, and the video captured by the secondary image capture device serves as the second dumping video.
[0087] When the main image acquisition device fails, the auxiliary image acquisition device is switched to the main image acquisition device.
[0088] In some embodiments, the first dumping video begins to be collected when a lifting signal is detected and the trash can in-place status indicates that the trash can is on the trash can carrying device. The first dumping video ends its collection after a lowering signal is detected and the trash can in-place status indicates that the trash can has left the trash can carrying device. In this way, the first dumping video that can be collected can contain key information in the garbage dumping process (information on the rising stage and / or the falling stage), meeting the needs of counting the number of trash cans in garbage dumping without recording too much redundant information, reducing the size of the first dumping video, and reducing the computing power required for recognition and analysis, thereby improving recognition and analysis efficiency.
[0089] In some embodiments, after dumping, the worker drags the trash can off the trash can support device (such as a rack). The trash can's in-place state indicates that the trash can has been detached from the trash can support device, completing the first dumping video acquisition process. A complete first dumping video and its video information are generated, and other information is recorded, such as one or more of the following: the work location, the number of bins per trip, the time information, and the work status. The work location, the number of bins per trip, the time information, and the work status can be stored separately or included with the video information of the first dumping video. The data storage and transmission module transmits and stores the first dumping video, its video information, and other information, completing a single garbage dumping cycle.
[0090] In some embodiments, the operation time of the operation signal for the trash can is obtained, and the operation time is used as the video information of the first dumping video. The video information can be displayed in the form of a timeline, and the operation signal is marked at the corresponding time position on the timeline. When the first dumping video is played, the timeline can be displayed. For example, the raising signal of the trash can is marked at time point A on the timeline, the flipping signal is marked at time point B, and the lowering signal is marked at time point C. This makes it easier for backstage personnel to quickly locate the various dumping stages of the trash can dumping process.
[0091] The video information of the first dumping video also includes: location information and / or working status information, wherein the working status information is used to indicate whether each operation node in the entire garbage dumping process is normal. When an abnormality occurs in the dumping process, it can be determined that the working status information is abnormal.
[0092] Reference Figure 3 In the specific implementation of step 132, step 132 specifically includes the following steps:
[0093] Step 1321 , performing target detection on each frame image in the first dumping video to obtain detection information of a target object, where the target object is a designated part of the trash can.
[0094] In a specific implementation, a YOLO model can be used to detect targets in each frame of the first dumping video. After training, the YOLO model outputs the image in the ONNX format. It is understandable that other image processing models can also be used for target detection, and examples are not given here one by one.
[0095] In some embodiments, the target object detection information includes at least the target object's category, area, center, and dimensions. The target object's center can be represented by center coordinates, and the target object's dimensions can include its width and height. The target object can be a trash can's opening, body, lid, or wheels. The target object category can include the opening, body, lid, or wheels.
[0096] Based on the type of garbage in the garbage bin and / or the current time, the confidence of each category of target objects in target detection is determined; based on the confidence of each category of target objects, target detection is performed on each frame image to obtain detection information of the target object.
[0097] For example, the type corresponding to the target object with the highest confidence is used as the category of the target object.
[0098] The quality of the first dumping video may be affected by various factors, such as weather and garbage type. For example, videos collected during the day are generally of better quality, while videos collected at night or in inclement weather (fog, haze, etc.) are of relatively poor quality. For the same type of target object, different confidence levels can be configured for daytime, nighttime, and inclement weather. The daytime confidence level can be higher than the confidence levels corresponding to nighttime and inclement weather to improve the accuracy of target object recognition. Relatively low confidence levels are configured for nighttime and inclement weather to facilitate target object recognition and reduce the probability of non-recognition. Furthermore, for sanitation vehicles transporting wet garbage, the target object confidence level can be lowered to facilitate recognition and reduce the probability of non-recognition.
[0099] In some non-limiting embodiments, before performing target detection on each frame of the first dumping video, data preprocessing may be performed on each frame of the first dumping video. The data preprocessing may include operations such as noise removal, contrast adjustment, brightness adjustment, and image normalization.
[0100] For example, the image initialization module is configured with one or more data preprocessing operations, such as noise removal, contrast adjustment, brightness adjustment, and image normalization. Each frame of the first dumped video is passed through the image initialization module for data preprocessing, resulting in a processed, normalized image. This data preprocessing can reduce the impact of noise, contrast, brightness, and other factors on image recognition and analysis results, thereby improving the accuracy of image recognition and analysis.
[0101] Step 1322 : Track the target object and determine the operation stage of the trash can according to changes in the detection information of the target object during the target tracking process.
[0102] In a specific implementation of step 1322, during the target tracking process, the center position change information of the target object and the size change information of the target object are obtained based on the detection information of the target object; the corresponding operation stage determination rule is obtained according to the category of the target object; and based on the obtained operation stage determination rule, the center position change information of the target object and the size change information of the target object, the operation stage of the trash can is determined.
[0103] The operation phase determination rules include an ascending phase determination rule and a descending phase determination rule.
[0104] The ascending stage determination rule includes: the center position continues to rise and the size of the target object continues to increase. If the center position change information of the target object meets the requirement of the center position continues to rise and the size change information of the target object meets the requirement of the size of the target object continues to increase, then the trash can is determined to be in the ascending stage.
[0105] The descending stage determination rule includes: the center position continues to descend and the size of the target object continues to decrease. If the center position change information of the target object meets the requirement of the center position continuing to descend and the size change information of the target object meets the requirement of the size of the target object continuing to decrease, then the trash can is determined to be in the descending stage.
[0106] Step 1323: Count the number of trash bins in each operation phase and obtain the second result.
[0107] In some embodiments, the number of first collection bins of the trash can appearing in the ascending phase is counted; and the number of second collection bins of the trash can appearing in the descending phase is counted.
[0108] If the first number of buckets is greater than the second number of buckets, it is determined that a bucket dropped during the descent phase of the trash can, and the second number of buckets is updated to be the same as the first number of buckets, obtaining a second result. In the second result, the effectiveness of this garbage dumping is considered to be effective dumping. Since the bucket dropped at the extreme end of the descent, the garbage dumping has already been completed at this point, so the effectiveness of the garbage dumping is determined to be effective dumping. In this way, it is possible to avoid missing statistics on the number of buckets collected by the trash can, further improving the accuracy of the statistics on the number of buckets collected by the trash can. The second number of buckets can be updated to be the same as the first number of buckets when the trash can rises next time, or it can be updated after the second result is obtained.
[0109] If the first number of collection bins is less than the second number of collection bins, the second result is obtained, and the effectiveness of this garbage dumping in the second result is effective dumping. In the case of bad weather such as night, fog and haze, or the garbage in the garbage bin is affected by the garbage in the garbage bin, which causes the garbage bin to be successfully identified during the rising stage, but the garbage bin is identified after the garbage in the garbage bin is dumped, even if the first number of collection bins is less than the second number of collection bins, the effectiveness of this garbage dumping is considered to be effective dumping, which can avoid missing statistics on the number of garbage bins and further improve the statistical accuracy of the number of garbage bins. Furthermore, the first number of collection bins can be updated to be the same as the second number of collection bins.
[0110] If the first number of bins is equal to the second number of bins, and both indicate no trash can is present, the second result indicates that the effectiveness of this trash dump is invalid. In this case, no trash can was identified during either the ascending or descending phases, so the effectiveness of this trash dump is invalid.
[0111] When counting the number of first collection bins in the rising phase of the trash can, after determining that the trash can is in the rising phase, the number of first collection bins in the rising phase is counted. If the trash can is determined to be in the rising phase multiple times, counting of the trash can in the rising phase is terminated. If a trash can falls off the trash can carrier and is remounted on the trash can carrier for continued dumping, the above counting method can be used to avoid duplicate counting of the trash can, thereby improving the accuracy of the number of collection bins.
[0112] In some non-limiting embodiments, if the category of the target object identified during the descent phase is the body of the trash can or the mouth of the trash can, the effectiveness of this garbage dumping is determined to be effective dumping.
[0113] Before step 1322, it is determined that the target object is within the valid area based on the area of the target object. In this way, interference from other objects (such as boxes and trash cans passing by) can be avoided.
[0114] The embodiment of the present invention also provides a device for monitoring the state of a garbage bin collection bin of a sanitation vehicle, see Figure 4 The garbage bin collection status monitoring device of the sanitation vehicle includes: an acquisition unit 41, used to obtain an operation signal for the garbage bin and the in-place status during the garbage dumping process, wherein the operation signal is at least used to determine the operation stage of the garbage bin during the garbage dumping process, and the operation stage at least includes the rising stage, the dumping stage and the descending stage, and the garbage bin in-place status is used to characterize whether the garbage bin is on the garbage bin carrying device; a determination unit 42, used to obtain a first result based on the in-place status of the garbage bin in each operation stage, and the first result at least includes the dumping validity of this garbage dumping; a counting unit 43, used to update the number of garbage bins collected based on at least the first result.
[0115] In a specific implementation, the garbage bin collection status monitoring device 40 of the sanitation vehicle is used to implement the above-mentioned garbage bin collection status monitoring method of the sanitation vehicle. The garbage bin collection status monitoring device 40 of the sanitation vehicle includes units corresponding to each step in the above-mentioned garbage bin collection status monitoring method of the sanitation vehicle. Regarding the specific working principle and work flow of the garbage bin collection status monitoring device 40 of the sanitation vehicle, please refer to the description in the above-mentioned embodiment, which will not be repeated here.
[0116] The present application also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of any of the above-mentioned methods for monitoring the status of a garbage bin collection of a sanitation vehicle are executed.
[0117] The computer-readable storage medium may include a non-volatile memory or a non-transitory memory, and may also include an optical disk, a mechanical hard disk, a solid-state drive, etc.
[0118] Specifically, in the embodiments of the present invention, the processor may be a central processing unit (CPU), or other general-purpose processors, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor.
[0119] It should also be understood that the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of random access memory (RAM) are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct RAM bus random access memory (DR RAM).
[0120] The present application also provides a terminal including a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor runs the computer program, the steps of any of the above-mentioned methods for monitoring the garbage bin collection status of a sanitation vehicle are executed.
[0121] The memory is coupled to the processor, and the memory may be located inside or outside the terminal. The memory and the processor may be connected via a communication bus.
[0122] The terminal may include but is not limited to mobile phones, computers, tablet computers and other terminal devices, and may also be a server, cloud platform, etc.
[0123] The present application also provides a computer program product, including a computer program / instruction, which is executed by a processor to perform the steps of any of the above-mentioned methods for monitoring the collection status of a garbage bin of a sanitation vehicle.
[0124] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer program are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer program can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer program can be transmitted from one website, computer, server or data center to another website, computer, server or data center by wired or wireless means.
[0125] In the several embodiments provided in this application, it should be understood that the disclosed methods, devices and systems can be implemented in other ways. For example, the device embodiments described above are merely schematic; for example, the division of the units is merely a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.
[0126] In addition, the functional units in the various embodiments of the present invention may be integrated into one processing unit, or each unit may be physically included separately, or two or more units may be integrated into one unit. The above-mentioned integrated units may be implemented in the form of hardware or in the form of hardware plus software functional units. For example, for various devices and products applied to or integrated into a chip, the various modules / units contained therein may all be implemented in the form of hardware such as circuits, or at least some of the modules / units may be implemented in the form of software programs, which run on the processor integrated inside the chip, and the remaining (if any) modules / units may be implemented in the form of hardware such as circuits; for various devices and products applied to or integrated into a chip module, the various modules / units contained therein may all be implemented in the form of hardware such as circuits, and different modules / units may be located in the same component (such as a chip, circuit module, etc.) or different components of the chip module, or at least some of the modules / units may be implemented in the form of software programs. The element can be implemented in the form of a software program, which runs on the processor integrated inside the chip module, and the remaining (if any) modules / units can be implemented in the form of hardware such as circuits; for various devices and products applied to or integrated in the terminal, the various modules / units contained therein can all be implemented in the form of hardware such as circuits, and different modules / units can be located in the same component (for example, chip, circuit module, etc.) or different components in the terminal, or, at least some modules / units can be implemented in the form of a software program, which runs on the processor integrated inside the terminal, and the remaining (if any) modules / units can be implemented in the form of hardware such as circuits.
[0127] It should be understood that the term "and / or" as used herein simply describes an association between related objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, or B exists alone. Furthermore, the character " / " as used herein indicates that the related objects are in an "or" relationship.
[0128] The first, second, etc. descriptions appearing in the embodiments of this application are only for illustration and distinction of the description objects. There is no order, nor does it indicate any special limitation on the number of devices in the embodiments of this application, and cannot constitute any limitation on the embodiments of this application.
[0129] It should be noted that the serial numbers of the steps in this embodiment do not limit the execution order of the steps.
[0130] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention should be based on the scope defined by the claims.
Claims
1. A method for monitoring the status of a garbage bin of a sanitation vehicle, characterized in that: include: Obtaining an operation signal for the trash can and the in-place status of the trash can during the trash dumping process, wherein the operation signal is at least used to determine the operation stage of the trash can during the trash dumping process, the operation stage including at least a rising stage, a dumping stage, and a descending stage, and the in-place status of the trash can is used to indicate whether the trash can is on the trash can carrying device; Based on the status of the trash can in each operation phase, a first result is obtained, wherein the first result at least includes the dumping effectiveness of the current trash dumping; Based at least on the first result, the number of collection bins of the trash bin is updated.
2. The method for monitoring the state of a garbage bin as claimed in claim 1, wherein: The updating of the number of collection bins of the trash bin based at least on the first result includes: If the dumping validity in the first result indicates that this garbage dumping is a valid dumping, the number of collection bins in the garbage bin is updated to increase by 1 based on the original number of collection bins.
3. The method for monitoring the state of a garbage bin as claimed in claim 1, wherein: The updating of the number of collection bins of the trash bin based at least on the first result includes: If the dumping validity in the first result indicates that the current garbage dumping is invalid or pending, obtaining a first dumping video of the current garbage dumping; Performing identification analysis on the first dumping video to obtain a second result, wherein the second result at least includes the dumping effectiveness of the garbage dumping; Based on at least the first result and the second result, the number of collection bins of the trash bin is updated.
4. The method for monitoring the state of a garbage bin as claimed in claim 3, wherein: The updating of the number of collection bins of the trash bin based at least on the first result and the second result includes: If the dumping validity in the first result and the second result is the same and both are invalid dumping, the number of collection bins in the trash can is updated to maintain the original number of collection bins.
5. The method for monitoring the state of a garbage bin as claimed in claim 3 or 4, characterized in that: Also includes: If the dumping validity in the first result is different from the dumping validity in the second result, the working status of this garbage dumping is marked as abnormal, and the information of the abnormal working status marking is at least included in the video information of the first dumping video.
6. The method for monitoring the state of a garbage bin as claimed in claim 5, wherein: Also includes: Output the first video of abnormal working status.
7. The method for monitoring the state of a garbage bin as claimed in claim 3, wherein: The updating of the number of collection bins of the trash bin based at least on the first result and the second result includes: If the dumping validity in the first result is different from the dumping validity in the second result, obtaining a second dumping video of the garbage dumping, wherein the first dumping video and the second dumping video are respectively captured by two different image acquisition devices, and the two image acquisition devices are installed at different positions; Performing identification analysis on the second dumping video to obtain a third result, wherein the third result at least includes the dumping effectiveness of the garbage dumping; If the dumping validity in the third result is the same as the dumping validity of one of the first result or the second result, the number of collection bins in the trash bin is updated based on the third result.
8. The method for monitoring the state of a garbage bin as claimed in claim 3, wherein: The identifying and analyzing the first dumping video includes: Performing target detection on each frame image in the first dumping video to obtain detection information of a target object, where the target object is a specified part of the trash can; Tracking the target object, and determining the operation stage of the trash can according to changes in detection information of the target object during the target tracking process; The number of trash bins in each operation phase is counted to obtain the second result.
9. The method for monitoring the state of a garbage bin as claimed in claim 8, wherein: The counting of the number of trash bins in each operation phase and obtaining the second result includes: Counting the number of first collection bins of the trash bin that appear in the rising phase; Counting the number of second collection bins of the trash bin that appear in the descending phase; If the first number of collecting buckets is greater than the second number of collecting buckets, it is determined that a bucket has fallen during the descent phase of the garbage bin, and the second number of collecting buckets is updated to be the same as the first number of collecting buckets, thereby obtaining a second result, in which the effectiveness of this garbage dumping is effective. If the first number of collecting bins is less than the second number of collecting bins, a second result is obtained, and the effectiveness of the garbage dumping in the second result is effective dumping; If the first number of collecting bins is equal to the second number of collecting bins, and both indicate that no trash bin appears, the validity of this trash dumping in the second result is invalid dumping.
10. The method for monitoring the state of a garbage bin as claimed in claim 8, wherein: The counting of the number of first collection bins in the rising stage of the trash bins includes: After determining that the trash can is in the ascending stage, the number of first collection bins in the ascending stage is counted. If the trash can is determined to be in the ascending stage multiple times, the counting of the trash can in the ascending stage is exited.
11. The method for monitoring the state of a garbage bin according to any one of claims 8 to 10, characterized in that: The detection information of the target object includes at least: a category of the target object, an area of the target object, a center position of the target object, and a size of the target object. Tracking the target object and determining the operation stage of the trash can according to changes in the detection information of the target object during the target tracking process include: During the target tracking process, obtaining the center position change information of the target object and the size change information of the target object according to the detection information of the target object; Acquire corresponding operation stage determination rules according to the category of the target object; The operation stage of the trash can is determined based on the acquired operation stage determination rule, the center position change information of the target object, and the size change information of the target object.
12. The method for monitoring the state of a garbage bin according to claim 11, wherein: The operation stage determination rule includes an ascending stage determination rule and a descending stage determination rule. Determining the operation stage of the trash can based on the acquired operation stage determination rule, the center position change information of the target object, and the size change information of the target object includes: The ascending stage determination rule includes: the center position continues to rise and the size of the target object continues to increase. If the center position change information of the target object meets the requirement that the center position continues to rise and the size change information of the target object meets the requirement that the size of the target object continues to increase, then it is determined that the trash can is in the ascending stage; The descending stage determination rules include: the center position continues to descend and the size of the target object continues to decrease. If the center position change information of the target object meets the requirements that the center position continues to descend and the size change information of the target object meets the requirements that the size of the target object continues to decrease, it is determined that the trash can is in the descending stage.
13. The method for monitoring the state of a garbage bin as claimed in claim 12, wherein: Also includes: Before determining the operation stage of the trash can based on the acquired operation stage determination rule, the center position change information of the target object, and the size change information of the target object, it is determined that the target object is within the valid area according to the area of the target object.
14. The method for monitoring the state of a garbage bin as claimed in claim 8, wherein: The performing target detection on each frame image in the first dumping video to obtain detection information of the target object includes: Determining the confidence level of each category of target objects in target detection based on the type of garbage in the garbage bin and / or the current time; Based on the confidence level of target objects of each category, target detection is performed on each frame image to obtain detection information of the target object.
15. The method for monitoring the state of a garbage bin as claimed in claim 3, wherein: The first dumping video starts to be collected when a lifting signal is detected and the trash can in-place state represents that the trash can is on the trash can carrying device; and / or, the first dumping video ends to be collected after a lowering signal is detected and the trash can in-place state represents that the trash can leaves the trash can carrying device.
16. The method for monitoring the state of a garbage bin according to claim 3 or 15, wherein: Also includes: An operation time of an operation signal for the trash can is obtained, and the operation time is used as video information of the first dumping video.
17. The method for monitoring the state of a garbage bin according to claim 16, wherein: The video information of the first dumping video also includes: location information and / or working status information, and the working status information is used to indicate whether each operation node in the entire garbage dumping process is normal.
18. The method for monitoring the state of a garbage bin as claimed in claim 1, wherein: The obtaining of a first result based on the in-place status of the trash can in each operation stage includes: When the in-position state of the trash can in the ascending stage suddenly changes from being on the trash can carrying device to not being on the trash can carrying device, the dumping validity of this trash dumping is determined to be invalid dumping, and the first result is obtained; When the trash can is on the trash can carrying device during both the ascending stage and the dumping stage, and is not on the trash can carrying device during the descending stage, the dumping validity of the current trash dumping is determined to be valid, and the first result is obtained; When the trash can is in the trash can carrying device during the ascending stage, the dumping stage, and the descending stage, the dumping validity of the current trash dumping is determined to be valid dumping, and the first result is obtained; When the trash can is not on the trash can carrying device during the ascending stage, the dumping stage, and the descending stage, the dumping validity of the current trash dumping is determined to be invalid dumping, and the first result is obtained; When the trash can is on the trash can carrying device during the rising stage and its on-site status during the dumping stage suddenly changes from being on the trash can carrying device to not being on the trash can carrying device, the dumping validity of this garbage dumping is determined to be valid pending, and the first result is obtained.
19. The method for monitoring the state of a garbage bin as claimed in claim 1, wherein: The operation signal at least includes a bucket-raising signal for controlling the lifting of the trash can. When the bucket-raising signal is detected, the presence detection of the trash can is activated.
20. The method for monitoring the state of a garbage bin as claimed in claim 1, wherein: Before obtaining the operation signal for the trash can, include: Positioning the sanitation vehicle; When the sanitation vehicle is located to enter the working range, the collection of the operation signal for the garbage bin is started.
21. A device for monitoring the status of a garbage bin on a sanitation vehicle, characterized in that: include: an acquisition unit, configured to acquire an operation signal for the trash can and an in-place status thereof during a trash dumping process, wherein the operation signal is at least used to determine an operation stage of the trash can during the trash dumping process, the operation stage including at least an ascending stage, a dumping stage, and a descending stage, and the in-place status of the trash can is used to indicate whether the trash can is on a trash can carrying device; a determining unit, configured to obtain a first result based on the in-place status of the trash can in each operation stage, wherein the first result at least includes the dumping effectiveness of the current trash dumping; A counting unit is used to update the number of collection bins of the trash bin based on at least the first result.
22. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by the processor, the steps of the method for monitoring the status of a garbage bin collection of a sanitation vehicle according to any one of claims 1 to 20 are executed.
23. A terminal comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, wherein: When the processor runs the computer program, the steps of the method for monitoring the garbage bin collection status of a sanitation vehicle according to any one of claims 1 to 20 are executed.
24. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instruction is executed by a processor, the steps of the method for monitoring the garbage bin collection status of a sanitation vehicle as described in any one of claims 1 to 20 are implemented.