A method and device for monitoring the discharge of a mixing plant, and a mixing plant

Abstract

The application provides a mixing station unloading monitoring method and device, and a mixing station, and applies to the field of intelligent monitoring of mixing stations. The method comprises the following steps: acquiring a first video frame of a first monitoring video of a mixing station unloading area shot by a first monitoring camera; detecting and identifying the first video frame of the first monitoring video based on a target detection algorithm to obtain a first identification result; acquiring a second video frame of a second monitoring video of the mixing station unloading area shot by a second monitoring camera or a third monitoring camera based on the first identification result, wherein the first monitoring camera, the second monitoring camera, and the third monitoring camera are arranged at different positions of the mixing station unloading area; acquiring a third video frame of the first monitoring video; and monitoring unloading of the mixing station based on the third video frame of the first monitoring video and the second video frame of the second monitoring video. The application can realize monitoring of the two-way unloading process of a mixing truck without manual participation, and improves the unloading efficiency of the mixing station.

Description

Technical Field

[0001] This application relates to the field of intelligent monitoring technology for mixing plants, specifically to a method, device, and mixing plant for monitoring material unloading. Background Technology

[0002] With the continuous development of the concrete mixing plant industry, monitoring technology for unloading at mixing plants has emerged. Traditional mixing plant unloading processes largely rely on manual operation, resulting in low efficiency, susceptibility to errors, and high safety risks. To address these issues, mixing plants have begun to incorporate monitoring technology. By installing cameras at the mixing plant and utilizing AI intelligent recognition technology, the unloading process can be monitored in real time, automatically identifying the alignment of the unloading port and receiving hopper, the unloading material level, and controlling the unloading flow rate to prevent overflow and reduce material loss.

[0003] However, current monitoring of batching plant unloading only assesses the reversing of a single mixer truck. Some batching plants, to improve unloading efficiency, use a through-type unloading port, allowing two mixer trucks to reverse back-to-back to unload, reducing the time spent switching vehicles and increasing production efficiency. Currently, in this scenario, both bidirectional reversing guidance and opposing unloading control are manually operated. Therefore, a method for monitoring batching plant unloading that can monitor both directions of mixer truck unloading is needed. Summary of the Invention

[0004] In view of this, this application provides a method, device, and mixing plant for monitoring the unloading of a mixing plant, which solves the technical problem that current monitoring methods for monitoring the unloading of mixing plants only judge the reversing of a single mixing truck and cannot monitor the bidirectional unloading of mixing trucks.

[0005] As a first aspect of this application, this application provides a method for monitoring the unloading of a mixing plant, comprising:

[0006] Acquire the first video frame of the first surveillance video of the unloading area of ​​the mixing plant captured by the first surveillance camera;

[0007] Based on a preset target detection algorithm, the first video frame of the first monitoring video is detected and identified to obtain a first identification result, the first identification result including the target mixer truck;

[0008] Based on the first identification result, a second video frame of the second monitoring video of the unloading area of ​​the mixing plant captured by the second monitoring camera or the third monitoring camera is obtained, wherein the first monitoring camera, the second monitoring camera and the third monitoring camera are respectively set at different positions in the unloading area of ​​the mixing plant.

[0009] Obtain the third video frame of the first surveillance video, wherein the third video frame is generated after the first video frame;

[0010] The unloading of the mixing plant is monitored based on the third video frame of the first monitoring video and the second video frame of the second monitoring video.

[0011] Optionally, the step of obtaining the second video frame of the second monitoring video of the mixing plant's unloading area based on the first identification result includes:

[0012] When the first identification result indicates that the receiving hopper of the target mixer truck is in the target area to be unloaded, the second video frame of the monitoring video in the corresponding direction of the target mixer truck is acquired, and the target area to be unloaded is in the unloading area of ​​the mixing plant.

[0013] Optionally, monitoring the unloading of the mixing plant based on the third video frame of the first monitoring video and the second video frame of the second monitoring video includes:

[0014] Based on a preset deep learning key point detection algorithm, the second video frame of the second monitoring video is detected and identified to obtain a second identification result;

[0015] Based on the second identification result, determine whether the receiving hopper of the target mixer truck and the discharge port of the mixing station are aligned in the first direction;

[0016] Based on the preset target detection algorithm, the third video frame of the first monitoring video is detected and identified to obtain a third identification result;

[0017] Based on the third identification result, determine whether the feed inlet of the receiving hopper of the target mixer truck and the discharge port of the mixing station are aligned in the second direction;

[0018] If it is determined that the feed inlet of the target mixer truck's receiving hopper is aligned with the discharge port of the mixing plant in a second direction, and the feed inlet of the target mixer truck is aligned with the discharge port of the mixing plant in a first direction, a discharge signal is generated. The discharge signal is used to instruct the discharge port of the mixing plant to start discharging.

[0019] Optionally, determining whether the receiving hopper of the target mixer truck and the discharge port of the mixing plant are aligned in the first direction based on the second identification result includes:

[0020] The second identification result is the first distance between the center point of the outer edge of the receiving hopper of the target mixer truck and the vertical line of the discharge port of the mixing station;

[0021] When the first distance is less than or equal to the first preset value, it is determined that the receiving hopper of the target mixer truck is aligned with the discharge port of the mixing station in the first direction.

[0022] Optionally, determining whether the feed inlet of the target mixer truck's hopper and the discharge outlet of the mixing plant are aligned in the second direction based on the third identification result includes:

[0023] The third identification result is the second distance between the vertical line of the feed inlet of the target mixer truck's receiving hopper and the vertical line of the discharge outlet of the mixing plant;

[0024] When the second distance is less than or equal to the second preset value, it is determined that the feed inlet of the receiving hopper of the target mixer truck is aligned with the discharge outlet of the mixing station in the second direction.

[0025] Optionally, generating the unloading signal includes:

[0026] The programmable signal lights are controlled to send a preset alignment signal to the driver of the target mixer truck, so that the target mixer truck can be stopped according to the preset alignment signal;

[0027] When it is determined that the target mixer truck is in a stable state, a discharge signal is generated.

[0028] Optionally, after generating the unloading signal, the following may also be included:

[0029] Obtain the fourth video frame of the second surveillance video, wherein the fourth video frame was generated after the second video frame;

[0030] Based on the fourth video frame of the second monitoring video, the material position in the receiving hopper of the target mixer truck is determined;

[0031] When the material level is higher than the preset position, a second control signal is sent to the control device corresponding to the discharge port of the mixing plant. The second control signal is used to instruct the discharge port of the mixing plant to stop discharging or adjust the discharge speed.

[0032] As a second aspect of this application, this application provides a monitoring device for unloading materials at a mixing plant, comprising:

[0033] The first video acquisition module is used to acquire the first video frame of the first monitoring video of the unloading area of ​​the mixing plant; and to acquire the third video frame of the first monitoring video, wherein the generation time of the third video frame is after the first video frame.

[0034] The algorithm recognition module detects and recognizes the first video frame of the first monitoring video to obtain a first recognition result, wherein the first recognition result includes the target mixer truck;

[0035] The second video acquisition module is used to acquire the second video frame of the second surveillance video based on the first recognition result;

[0036] The unloading monitoring module is used to monitor the unloading of the mixing plant based on the third video frame of the first monitoring video and the second video frame of the second monitoring video.

[0037] As a third aspect of this application, this application provides a mixing plant, comprising:

[0038] The mixing plant unloading monitoring device described in the second aspect above;

[0039] The surveillance cameras include a first surveillance camera, a second surveillance camera, and a third surveillance camera installed at different locations in the unloading area of ​​the mixing plant.

[0040] The first, second, and third monitoring cameras are configured to capture monitoring videos of the unloading area of ​​the mixing plant.

[0041] Optionally, the first monitoring camera is installed at the intersection of a straight line passing through the discharge port of the mixing plant and perpendicular to the reversing route of the mixer truck with the mixing plant.

[0042] The second monitoring camera is installed at the first intersection of a straight line passing through the discharge port of the mixing plant, parallel to the reversing route of the mixer truck, and the mixing plant.

[0043] The third monitoring camera is installed at the second intersection of a straight line passing through the center of the discharge port of the mixing plant and parallel to the reversing route of the mixer truck with the mixing plant, and the first, second and third monitoring cameras are all facing the discharge port of the mixing plant.

[0044] Based on the above, the batching plant unloading monitoring method provided in this application acquires the first video frame of the first monitoring video of the batching plant unloading area captured by the first monitoring camera, and detects and identifies the first video frame of the first monitoring video based on a preset target detection algorithm to obtain a first identification result. When the first identification result includes a target mixer truck, the method acquires the second video frame of the second monitoring video of the batching plant unloading area captured by the camera corresponding to the target mixer truck. The first monitoring camera, the second monitoring camera, and the third monitoring camera are respectively set at different positions in the batching plant unloading area. Then, the method continues to acquire the third video frame of the first monitoring video, which is generated after the first video frame. Finally, based on the third video frame of the first monitoring video and the second video frame of the second monitoring video, the method monitors the unloading of the batching plant using video frames of the batching plant unloading area captured by two cameras at different angles. This method can monitor the bidirectional unloading process of the mixer truck without human intervention, thereby improving the unloading efficiency of the batching plant. Attached Figure Description

[0045] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0046] Figure 1 The diagram shown is a flowchart illustrating a method for monitoring the unloading of a mixing plant according to an embodiment of this application.

[0047] Figure 2 The diagram shown is a flowchart illustrating another method for monitoring the unloading of a mixing plant provided in an embodiment of this application.

[0048] Figure 3 The diagram shown is a flowchart illustrating another method for monitoring the unloading of a mixing plant provided in an embodiment of this application.

[0049] Figure 4 The diagram shown is a flowchart illustrating another method for monitoring the unloading of a mixing plant provided in an embodiment of this application.

[0050] Figure 5 The diagram shown is a flowchart illustrating another method for monitoring the unloading of a mixing plant provided in an embodiment of this application.

[0051] Figure 6 The diagram shown is a structural block diagram of a mixing plant unloading monitoring device provided in an embodiment of this application.

[0052] Figure 7 The diagram shown is a structural block diagram of an electronic device provided in an embodiment of this application. Detailed Implementation

[0053] Unless otherwise defined, the technical or scientific terms used in the embodiments of this specification shall have the ordinary meaning understood by one of ordinary skill in the art to which this specification pertains. The terms "first," "second," and similar terms used in the embodiments of this specification do not indicate any order, quantity, or importance, but are merely used to avoid confusion of constituent elements.

[0054] Unless the context otherwise requires, throughout this specification, "a plurality of" means "at least two," and "including" is interpreted as open-ended or encompassing, that is, "including, but not limited to." In the description of this specification, terms such as "one embodiment," "some embodiments," "exemplary embodiment," "example," "specific example," or "some examples" are intended to indicate that a particular feature, structure, material, or characteristic associated with that embodiment or example is included in at least one embodiment or example of this specification. The illustrative representations of the above terms do not necessarily refer to the same embodiment or example.

[0055] The technical solutions in the embodiments of this specification will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this specification, and not all embodiments. Based on the embodiments in this specification, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this specification.

[0056] Exemplary methods

[0057] like Figure 1 As shown in the exemplary embodiment of this application, a method for monitoring the unloading of a mixing plant is provided, which may include the following steps:

[0058] S10: Obtain the first video frame of the first monitoring video of the unloading area of ​​the mixing plant captured by the first monitoring camera.

[0059] This application primarily addresses mixing plants with a through-type unloading port, where two mixer trucks can simultaneously unload back-to-back. The provided unloading monitoring method is applied to a mixing plant unloading monitoring system, which includes monitoring cameras, a control module, and a display module. The monitoring cameras capture video of the unloading area. To clearly monitor the unloading area, three monitoring cameras can be installed: a first monitoring camera, a second monitoring camera, and a third monitoring camera. The installation positions of the three cameras can be set according to actual conditions. For example, the first monitoring camera can be installed at the intersection of a straight line perpendicular to the mixer truck's reversing path and the center of the unloading port with the mixing plant itself. The second monitoring camera... The first, second, and third monitoring cameras can be installed at the first intersection point of a straight line parallel to the reversing path of the mixer truck and passing through the discharge port of the mixing plant. The third monitoring camera can be installed at the second intersection point of the same line. All three cameras face the discharge port. If the reversing path of the mixer truck is defined as forward and backward, specifically, the first monitoring camera can capture the first monitoring video of the discharge area (left-right direction of the discharge port), and the second or third monitoring camera can capture the second video frame of the second monitoring video of the discharge area (forward and backward direction of the discharge port). The control module acquires the monitoring video of the discharge area captured by the cameras and monitors the discharge of the mixing plant based on the video content. The display module displays the monitoring video of the discharge area captured by the cameras. When the control module acquires the first video frame of the first monitoring video of the discharge area captured by the first monitoring camera, it displays it in real time on the display module, which can be a display screen.

[0060] S20: Based on a preset target detection algorithm, detect and identify the first video frame of the first surveillance video to obtain the first identification result.

[0061] The control module of the mixing plant unloading monitoring system can be an embedded edge computing module, that is, the control module embeds a preset target detection algorithm. The target detection algorithm can identify various objects and their positions in an image or video. The target detection algorithm can be a traditional target detection algorithm, such as a sliding window-based method or a region-based method; or it can be a deep learning-based target detection algorithm, such as the R-CNN (Region-based Convolutional Neural Networks) series, SSD (Single Shot MultiBox Detector), YOLO (You Only Look Once) series, etc. This application does not impose any special limitations on the preset target detection algorithm, as long as it can meet the function of identifying various objects and their positions in the image. The control module calls the preset target detection algorithm through an interface, and based on the preset target detection algorithm, detects and identifies the first video frame of the first monitoring video to obtain the first identification result. When the first identification result includes the target mixing truck, the control module can perform the next control operation.

[0062] S30: Based on the first recognition result, obtain the second video frame of the second monitoring video of the mixing plant unloading area captured by the second monitoring camera or the third monitoring camera, wherein the first monitoring camera, the second monitoring camera and the third monitoring camera are respectively set at different positions in the mixing plant unloading area.

[0063] Specifically, based on the first identification result, it can be determined which concrete mixer truck is preparing to receive the material. The concrete mixer truck preparing to receive the material is the target concrete mixer truck. For example, if the first video frame of the first monitoring video includes the first and second concrete mixer trucks, and the first and second concrete mixer trucks are traveling back to back, the second or third monitoring camera can capture detailed video of the front and rear directions of the corresponding receiving hoppers of the first and second concrete mixer trucks and the unloading port of the mixing plant, based on the installation position of the second or third monitoring camera, and display it on the display device. That is, based on the first identification result, the control device acquires the second video frame of the second monitoring video of the unloading area of ​​the mixing plant captured by the second or third monitoring camera, where the second video frame is a specific video frame of the second monitoring video.

[0064] S40: Obtain the third video frame of the first monitoring video. The third video frame is generated after the first video frame.

[0065] At this time, the display device displays the second monitoring video of the unloading area of ​​the mixing plant captured by the second or third monitoring camera. In order to avoid the mixing plant unloading port from being misaligned with the mixer truck receiving hopper, which would cause concrete to spill, it is necessary to ensure that the mixing plant unloading port and the mixer truck receiving hopper are aligned. Obviously, it is difficult to accurately determine whether the mixing plant unloading port and the mixer truck receiving hopper are aligned based solely on the first or second monitoring video. Therefore, it is necessary to combine the first and second monitoring videos for judgment. In addition, in order to distinguish the different video frames of the first monitoring video, the video frame generated after the first video frame is named the third video frame.

[0066] S50: Based on the third video frame of the first monitoring video and the second video frame of the second monitoring video, monitor the unloading of the mixing plant.

[0067] The first and second monitoring videos can be displayed simultaneously on the display device. Based on the third video frame of the first monitoring video and the second video frame of the second monitoring video, the unloading process of the mixing plant can be monitored.

[0068] In some embodiments of this application, a first video frame of a first monitoring video of the unloading area of ​​the mixing plant captured by a first monitoring camera is obtained. Based on a preset target detection algorithm, the first video frame of the first monitoring video is detected and identified to obtain a first identification result, which includes the target mixing truck. Based on the first identification result, a second video frame of a second monitoring video of the unloading area of ​​the mixing plant captured by a second or third monitoring camera is obtained. The first, second, and third monitoring cameras are respectively located at different positions in the unloading area of ​​the mixing plant. A third video frame of the first monitoring video is obtained, and the third video frame is generated after the first video frame. The unloading of the mixing plant is monitored based on the third video frame of the first monitoring video and the second video frame of the second monitoring video. By monitoring the unloading of the mixing plant using video frames of the monitoring video of the unloading area captured by two cameras at different angles, the monitoring of the bidirectional unloading process of the mixing truck can be achieved without manual intervention, thus improving the unloading efficiency of the mixing plant.

[0069] In some embodiments of this application, in step S30, based on the first identification result, the second video frame of the second monitoring video of the mixing plant unloading area is obtained. Specific steps may include:

[0070] S31: When the first identification result is that the receiving hopper of the target mixer truck is in the target area to be unloaded, the second video frame of the monitoring video in the corresponding direction of the target mixer truck is acquired, and the target area to be unloaded is in the unloading area of ​​the mixing plant.

[0071] Specifically, the preset target detection algorithm identifies the first video frame of the first monitoring video of the unloading area of ​​the mixing plant captured by the first monitoring camera, and outputs the first identification result corresponding to the first video frame. During the identification process, the target area to be unloaded, the receiving hopper of the first mixer truck, and the receiving hopper of the second mixer truck in the first video frame are selected and identified by generating recognition boxes. The recognition box can be a fixed-shape bounding box, such as a rectangle, which uses the smallest circumscribed rectangle to enclose the position of the object. The recognition box can determine the target area to be unloaded, the receiving hopper of the first mixer truck, the receiving hopper of the second mixer truck, and their corresponding position information. The target area to be unloaded can be a fixed area including the unloading port of the mixing plant. When the first identification result is that the receiving hopper of the target mixer truck is in the target area to be unloaded, that is, the receiving hopper of the first mixer truck or the receiving hopper of the second mixer truck is in the target area to be unloaded, it can be determined which mixer truck is ready to receive the material. The mixer truck ready to receive the material is the target mixer truck. Then, the second video frame of the monitoring video in the direction corresponding to the target mixer truck is acquired, wherein the target area to be unloaded is in the unloading area of ​​the mixing plant. For example, when the first mixer truck's receiving hopper is in the target area to be unloaded, the second video frame of the monitoring video in the corresponding direction of the first mixer truck is acquired; when the second mixer truck's receiving hopper is in the target area to be unloaded, the second video frame of the monitoring video in the corresponding direction of the second mixer truck is acquired.

[0072] In some implementations, it can be determined whether the receiving hopper of the first or second mixer truck is in the target area to be unloaded based on the identification frames of the target area to be unloaded, the receiving hopper of the first mixer truck, and the receiving hopper of the second mixer truck. Specifically, if the left and right edges of the identification frames of the receiving hoppers of the first or second mixer truck are both within the identification frame of the target area to be unloaded, then it can be determined that the receiving hoppers of the first or second mixer truck are in the target area to be unloaded.

[0073] In some embodiments of this application, such as Figure 2 As shown, in S50, the unloading of the mixing plant is monitored based on the third video frame of the first monitoring video and the second video frame of the second monitoring video. Specific steps may include:

[0074] S51: Based on a preset deep learning key point detection algorithm, detect and identify the second video frame of the second surveillance video to obtain the second identification result.

[0075] After identifying the first video frame of the first monitoring video of the mixing plant's unloading area captured by the first monitoring camera, obtaining the first identification result, determining the target mixing truck, and acquiring the second video frame of the monitoring video in the corresponding direction of the target mixing truck, the second video frame of the second monitoring video is further detected and identified based on a preset deep learning key point detection algorithm, and a second identification result is obtained. The deep learning key point detection algorithm is used to automatically identify and locate key points of the target object in the image or video, obtaining the position coordinates of the key points. The deep learning key point detection algorithm can be a CNN combined with RNN method, the YOLO-KP method, DETR (Detection Transformer), etc. Since the target mixing truck's receiving hopper is located in the unloading target area including the mixing plant's unloading port, the second video frame of the second monitoring video can further obtain detailed information about the target mixing truck's receiving hopper and the mixing plant's unloading port.

[0076] S52: Based on the second identification result, determine whether the receiving hopper of the target mixer truck and the discharge port of the mixing station are aligned in the first direction.

[0077] The first direction can be a forward or backward direction parallel to the direction of the mixer truck's reversing route, or it can be a forward or backward direction relative to the discharge port of the mixing plant.

[0078] S53: Based on the preset target detection algorithm, detect and identify the third video frame of the first monitoring video to obtain the third identification result.

[0079] After the control module acquires the third video frame of the first monitoring video of the unloading area of ​​the mixing plant captured by the first monitoring camera, it detects and identifies the third video frame of the first monitoring video based on a preset target detection algorithm to obtain a third identification result.

[0080] S54: Based on the third identification result, determine whether the feed inlet of the target mixer truck's receiving hopper is aligned with the discharge outlet of the mixing plant in the second direction.

[0081] Since the first monitoring camera is installed to the left and right of the discharge port of the mixing plant, the second direction can also be relative to the left and right of the discharge port. Therefore, based on the third identification result, it is determined whether the feed inlet of the target mixer truck's hopper is aligned with the discharge port of the mixing plant in the second direction.

[0082] S55: If it is determined that the feed inlet of the target mixer truck's receiving hopper is aligned with the discharge port of the mixing plant in the second direction, and the feed inlet of the target mixer truck is aligned with the discharge port of the mixing plant in the first direction, a discharge signal is generated. The discharge signal is used to instruct the discharge port of the mixing plant to start discharging.

[0083] Specifically, it can be determined first whether the feed inlet of the target mixer truck's hopper is aligned with the discharge port of the mixing plant in the second direction, and then whether the feed inlet of the target mixer truck is aligned with the discharge port of the mixing plant in the first direction; alternatively, it can be determined first whether the feed inlet of the target mixer truck is aligned with the discharge port of the mixing plant in the first direction, and then whether the feed inlet of the target mixer truck's hopper is aligned with the discharge port of the mixing plant in the second direction; or it can be determined simultaneously whether the feed inlet of the target mixer truck's hopper is aligned with the discharge port of the mixing plant in the second direction, and whether the feed inlet of the target mixer truck is aligned with the discharge port of the mixing plant in the first direction. This application does not impose any specific limitations on these determinations. A discharge signal is generated when it is determined that the feed inlet of the target mixer truck's hopper is aligned with the discharge port of the mixing plant in both the first and second directions. This discharge signal is used to instruct the discharge port of the mixing plant to begin discharging.

[0084] In this embodiment, by detecting the second video frame of the second monitoring video of the mixing plant unloading area captured by the second or third monitoring camera and the third video frame of the first monitoring video of the mixing plant unloading area captured by the first monitoring camera, it is possible to accurately determine whether the feed inlet of the target mixer truck's receiving hopper is aligned with the discharge port of the mixing plant in the first and second directions. This can reduce the frequency and time of manual inspection of alignment and improve work efficiency.

[0085] In some embodiments of this application, such as Figure 3 As shown, in step S52, based on the second identification result, it is determined whether the receiving hopper of the target mixer truck and the discharge port of the mixing plant are aligned in the first direction. Specific steps may include:

[0086] S521: The second identification result is the first distance between the center point of the outer edge of the receiving hopper of the target mixer truck and the vertical line of the discharge port of the mixing plant.

[0087] Specifically, based on the preset deep learning key point detection algorithm, when detecting and recognizing the second video frame of the second monitoring video, the vertical line of the discharge port of the mixing plant is marked first, as well as the center point of the outer edge of the receiving hopper of the target mixing truck. The first distance between the center point of the outer edge of the receiving hopper of the target mixing truck and the vertical line of the discharge port of the mixing plant is calculated, and the first distance is used as the second recognition result.

[0088] The receiving hopper of a mixer truck is generally a regular shape, such as a circle, ellipse, square, or rectangle. The position of the center point of the outer edge of the receiving hopper can be obtained based on the position information of any three points on the outer edge of the receiving hopper. Optionally, based on a preset deep learning key point detection algorithm, three key points on the outer edge of the receiving hopper of the target mixer truck in the second video frame of the second monitoring video can be identified, and the coordinates of the center point of the outer edge of the receiving hopper of the target mixer truck can be determined based on these three key points.

[0089] S522: When the first distance is less than or equal to the first preset value, determine that the receiving hopper of the target mixer truck is aligned with the discharge port of the mixing plant in the first direction.

[0090] A first preset value is set in advance. When the second recognition result is obtained, that is, the first distance between the center point of the outer edge of the target mixer truck's receiving hopper and the vertical line of the mixing plant's discharge port, the relationship between the first distance and the first preset value is determined. When the first distance is less than or equal to the first preset value, it is determined that the target mixer truck's receiving hopper and the mixing plant's discharge port are aligned in the first direction. Otherwise, the target mixer truck's receiving hopper and the mixing plant's discharge port are not aligned in the first direction, and the driver needs to continue to adjust the position of the mixer truck's receiving hopper.

[0091] In some embodiments of this application, such as Figure 4 As shown, in step S54, based on the third identification result, it is determined whether the feed inlet of the target mixer truck's receiving hopper is aligned with the discharge outlet of the mixing plant in the second direction. Specific steps may include:

[0092] S541: The third identification result is the second distance between the vertical line of the feed inlet of the target mixer truck's receiving hopper and the vertical line of the discharge outlet of the mixing plant.

[0093] Specifically, based on a preset target detection algorithm, the third video frame of the first monitoring video is detected and identified. When obtaining the third identification result, the vertical line of the feed inlet of the target mixer truck's receiving hopper and the vertical line of the discharge port of the mixing plant are marked first. The second distance between the vertical line of the target mixer truck's receiving hopper and the vertical line of the discharge port of the mixing plant is calculated, and the second distance is used as the third identification result.

[0094] Optionally, based on a preset target detection algorithm, the receiving hopper of the target mixer truck is selected to generate an identification box. At a preset position from the left edge of the identification box of the receiving hopper of the target mixer truck, the center point of the feed inlet of the receiving hopper of the target mixer truck is marked, and the vertical line of the feed inlet of the receiving hopper of the target mixer truck is marked. The preset position can be a preset ratio, for example, the preset position is one-third of the distance from the left edge of the identification box of the receiving hopper of the target mixer truck. The specific position can be determined according to the positional relationship between the feed inlet and the receiving hopper of different mixer trucks.

[0095] S542: When the second distance is less than or equal to the second preset value, determine that the feed inlet of the receiving hopper of the target mixer truck is aligned with the discharge outlet of the mixing plant in the second direction.

[0096] A second preset value is set in advance. When the third identification result is obtained, that is, the second distance between the vertical line of the inlet of the target mixer truck's hopper and the vertical line of the discharge port of the mixing plant, the relationship between the second distance and the second preset value is determined. When the second distance is less than or equal to the second preset value, it is determined that the inlet of the target mixer truck's hopper and the discharge port of the mixing plant are aligned in the second direction. Otherwise, the inlet of the target mixer truck's hopper and the discharge port of the mixing plant are not aligned in the second direction, and the driver needs to continue to adjust the position of the mixer truck's hopper.

[0097] In some embodiments of this application, generating a discharge signal in step S55 may include the following steps:

[0098] S551: Controls programmable signal lights to send a preset alignment signal to the driver of the target mixer truck, so that the target mixer truck can be stopped according to the preset alignment signal.

[0099] The programmable signal light is installed at the mixing plant and is within the driver's line of sight. When it is determined that the feed inlet of the target mixing truck's hopper is aligned with the discharge outlet of the mixing plant in both the first and second directions, the programmable signal light sends a preset alignment signal to the driver of the target mixing truck. The preset alignment signal can be a preset color light flashing, such as a green light, so that the driver of the target mixing truck can adjust the target mixing truck to stop according to the preset alignment signal.

[0100] S552: When the target mixer truck is determined to be in a stable state, a discharge signal is generated.

[0101] Continue monitoring the video frames of the first monitoring video and preset the frame, such as 10 frames. The preset frame can also be adjusted according to the actual situation. When the video frame of the first monitoring video is within the preset frame and the change range of the target mixer truck position is less than the preset value, it is determined that the target mixer truck is in a stable state. At this time, a discharge signal is generated.

[0102] In some embodiments of this application, such as Figure 5 As shown, after the unloading signal is generated in S55 above, the unloading monitoring method for the mixing plant may further include the following steps:

[0103] S56: Obtain the fourth video frame of the second monitoring video. The fourth video frame was generated after the second video frame.

[0104] During the unloading process of the target mixer truck at the unloading port of the mixing plant, the unloading process can be monitored by the fourth video frame of the second monitoring video captured by the monitoring camera in the corresponding direction of the target mixer truck. The fourth video is generated after the second video frame.

[0105] S57: Based on the fourth video frame of the second monitoring video, determine the material position in the receiving hopper of the target mixer truck.

[0106] Specifically, the fourth video frame of the second monitoring video can determine the material position in the receiving hopper of the target mixer truck. In addition, based on the preset target detection algorithm, when detecting and identifying the fourth video frame of the second monitoring video, the preset position of the receiving hopper of the target mixer truck is marked. Based on the relationship between the material position in the receiving hopper of the target mixer truck and the preset position, the discharge port of the mixing plant is further controlled. The preset position can be a straight line related to the position.

[0107] S58: When the material level is higher than the preset position, an adjustment signal is sent to the control device corresponding to the discharge port of the mixing plant. The adjustment signal is used to instruct the discharge port of the mixing plant to stop discharging or adjust the discharge speed.

[0108] When the material level is lower than the preset level, or when the material level is equal to the preset level, the unloading speed of the current mixing plant discharge port is maintained. When the material level is higher than the preset level, an adjustment signal is sent to the control device corresponding to the mixing plant discharge port. The adjustment signal is used to instruct the mixing plant discharge port to stop unloading or adjust the unloading speed.

[0109] In this embodiment, the height relationship between the material level in the receiving hopper of the target mixer truck and the preset position is determined by the fourth video frame of the second monitoring video, and the unloading process is monitored throughout to avoid waste caused by overflow.

[0110] In some implementations, before the preset target detection algorithm detects and identifies the video frames of the monitoring video, the mixing plant unloading monitoring method further includes: preprocessing the video frames of the monitoring video captured by the monitoring camera. Specifically, the preprocessing includes calculating the intrinsic and extrinsic parameters of the monitoring camera, calculating the homography matrix, performing coordinate transformation on the video frames of the monitoring video, and then performing image distortion correction and inverse perspective transformation.

[0111] Exemplary device

[0112] Below, as a second aspect of this application, this is as follows: Figure 6 As shown, the application also provides a mixing plant unloading monitoring device. It includes: a first video acquisition module 601, an algorithm recognition module 602, a second video acquisition module 603, and an unloading monitoring module 604, wherein...

[0113] The first video acquisition module 601 is used to acquire the first video frame of the first monitoring video of the unloading area of ​​the mixing plant; and to acquire the third video frame of the first monitoring video, wherein the third video frame is generated after the first video frame.

[0114] The algorithm recognition module 602 is used to detect and recognize the first video frame of the first monitoring video to obtain a first recognition result, which includes the target mixer truck.

[0115] The second video acquisition module 603 is used to acquire the second video frame of the second monitoring video based on the first recognition result.

[0116] The unloading monitoring module 604 is used to monitor the unloading of the mixing plant based on the third video frame of the first monitoring video and the second video frame of the second monitoring video.

[0117] The controller switching control device provided in this application acquires the first video frame of the first monitoring video of the unloading area of ​​the mixing plant through the first video acquisition module 601. Then, the algorithm recognition module 602 detects and recognizes the first video frame of the first monitoring video to obtain a first recognition result, which includes the target mixing truck. Then, the first video acquisition module 601 continues to acquire the third video frame of the first monitoring video. The third video frame is generated after the first video frame. The second video acquisition module 603 acquires the second video frame of the second monitoring video based on the first recognition result. Finally, the unloading monitoring module 604 monitors the unloading of the mixing plant based on the third video frame of the first monitoring video and the second video frame of the second monitoring video. This application can realize the monitoring of the bidirectional unloading process of the mixing truck without human intervention, thus improving the unloading efficiency of the mixing plant.

[0118] The batching plant unloading monitoring device provided in this embodiment belongs to the same application concept as the batching plant unloading monitoring method provided in the above embodiments of this application. It can execute the batching plant unloading monitoring method provided in any of the above embodiments of this application and has the corresponding functional units and beneficial effects of the batching plant unloading monitoring method. Technical details not described in detail in this embodiment can be found in the specific processing content of the batching plant unloading monitoring method provided in the above embodiments of this application, and will not be repeated here.

[0119] Exemplary mixing plant

[0120] As a third aspect of this application, this application provides a mixing plant, comprising:

[0121] The controller switching control device and monitoring camera mentioned in the second aspect include a first monitoring camera, a second monitoring camera and a third monitoring camera set at different positions in the unloading area of ​​the mixing plant, wherein the first monitoring camera, the second monitoring camera and the third monitoring camera are configured to capture monitoring videos of the unloading area of ​​the mixing plant.

[0122] The first surveillance camera is installed at the intersection of a straight line perpendicular to the reversing path of the mixer truck and the discharge port of the mixing plant.

[0123] The second surveillance camera is installed at the first intersection of a straight line parallel to the reversing route of the mixer truck and the discharge port of the mixing plant.

[0124] The third monitoring camera is installed at the second intersection of a straight line parallel to the reversing route of the mixer truck and the discharge port of the mixing plant, and the first, second and third monitoring cameras are all facing the discharge port of the mixing plant.

[0125] Exemplary electronic devices

[0126] As a fourth aspect of this application, this application also provides an electronic device. (Reference) Figure 7 This describes an electronic device according to embodiments of the present application.

[0127] Figure 7 The figure shows a structural block diagram of an electronic device according to an embodiment of the present application.

[0128] like Figure 7 As shown, the electronic device 70 includes one or more processors 701 and memory 702.

[0129] The processor 701 may be a central processing unit (CPU) or other form of processing unit with data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 100 to perform desired functions.

[0130] The memory 702 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and / or cache memory. The non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 701 may execute the program instructions to implement the mixing plant unloading monitoring method of the various embodiments of this application described above, and / or other desired functions.

[0131] In one example, the electronic device 70 may also include an input device 703 and an output device 704, which are interconnected via a bus system and / or other forms of connection mechanism (not shown).

[0132] When the electronic device is a standalone device, the input device 703 can be a communication network connector for receiving the collected input signals from the first device and the second device.

[0133] In addition, the input device 703 may also include, for example, a keyboard, a mouse, etc.

[0134] The output device 704 can output various information to the outside, including determined distance information, direction information, etc. The output device 704 may include, for example, a display, a speaker, a printer, and a communication network and its connected remote output devices, etc.

[0135] Of course, for the sake of simplicity, Figure 7 Only some of the components of the electronic device 70 relevant to this application are shown in this illustration; components such as buses, input / output interfaces, etc., are omitted. In addition, the electronic device 70 may include any other suitable components depending on the specific application.

[0136] Exemplary computer-readable storage media

[0137] As a fifth aspect of this application, this application provides a computer-readable storage medium storing a computer program for performing the steps in the mixing plant unloading monitoring method of the various embodiments described above.

[0138] Computer-readable storage media may take the form of any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may, for example, include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0139] In addition to the methods and devices described above, embodiments of this application may also be computer program products, which include computer program information. When the computer program information is run by a processor, it causes the processor to execute the steps in the mixing plant unloading monitoring method of various embodiments of this application.

[0140] Computer program products can be written in any combination of one or more programming languages ​​to perform the operations of the embodiments of this application. The programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on the user's computing device, partially on the user's computing device, as a standalone software package, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0141] The basic principles of this application have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this application are merely examples and not limitations, and should not be considered as essential features of each embodiment of this application. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the application to the necessity of employing the aforementioned specific details for implementation.

[0142] The block diagrams of devices, apparatuses, devices, and systems involved in this application are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0143] It should also be noted that in the apparatus, equipment, and methods of this application, the components or steps can be disassembled and / or recombined. These disassemblies and / or recombinations should be considered as equivalent solutions of this application.

Claims

1. A method for monitoring the discharge of a mixing plant, applied to a through-type discharge opening mixing plant in which two mixers back-to-back discharge, characterized in that, The method comprises the following steps: obtaining a first video frame of a first monitoring video of a discharging area of a mixing station captured by a first monitoring camera; based on a preset target detection algorithm, detecting and identifying the first video frame of the first monitoring video to obtain a first identification result, the first identification result comprising a target mixer truck; based on the first identification result, obtaining a second video frame of a second monitoring video of the discharging area of the mixing station captured by a second monitoring camera or a third monitoring camera, wherein the first monitoring camera, the second monitoring camera and the third monitoring camera are respectively arranged at different positions of the discharging area of the mixing station; obtaining a third video frame of the first monitoring video, the generation time of the third video frame being after the first video frame; based on the third video frame of the first monitoring video and the second video frame of the second monitoring video, monitoring the discharging of the mixing station; based on the first identification result, obtaining a second video frame of a second monitoring video of the discharging area of the mixing station, comprising: when the first identification result is that the receiving hopper of the target mixer truck is in a target area to be unloaded in the discharging area of the mixing station, obtaining a second video frame of a monitoring video corresponding to the direction of the target mixer truck, and the target area to be unloaded is in the discharging area of the mixing station.

2. The method of claim 1, wherein, based on the third video frame of the first monitoring video and the second video frame of the second monitoring video, monitoring the discharging of the mixing station, comprising: based on a preset deep learning key point detection algorithm, detecting and identifying the second video frame of the second monitoring video to obtain a second identification result; based on the second identification result, determining whether the receiving hopper of the target mixer truck is aligned with the discharging port of the mixing station in a first direction; based on the preset target detection algorithm, detecting and identifying the third video frame of the first monitoring video to obtain a third identification result; based on the third identification result, determining whether the feeding port of the receiving hopper of the target mixer truck is aligned with the discharging port of the mixing station in a second direction; if it is determined that the feeding port of the receiving hopper of the target mixer truck is aligned with the discharging port of the mixing station in the second direction, and at the same time, the receiving hopper of the target mixer truck is aligned with the discharging port of the mixing station in the first direction, a discharging signal is generated, and the discharging signal is used to indicate that the discharging of the discharging port of the mixing station starts.

3. The method of claim 2, wherein, based on the second identification result, determining whether the receiving hopper of the target mixer truck is aligned with the discharging port of the mixing station in the first direction, comprising: the second identification result is a first distance between the center point of the outer edge of the receiving hopper of the target mixer truck and the perpendicular line of the discharging port of the mixing station; when the first distance is less than or equal to a first preset value, it is determined that the receiving hopper of the target mixer truck is aligned with the discharging port of the mixing station in the first direction.

4. The method of claim 2, wherein, based on the third identification result, determining whether the feeding port of the receiving hopper of the target mixer truck is aligned with the discharging port of the mixing station in the second direction, comprising: the third identification result is a second distance between the perpendicular line of the feeding port of the receiving hopper of the target mixer truck and the perpendicular line of the discharging port of the mixing station; When the second distance is less than or equal to a second preset value, it is determined that the feeding port of the receiving hopper of the target mixer truck is aligned with the discharging port of the mixing station in a second direction.

5. The method of claim 2, wherein, The generation of the discharging signal comprises: controlling a programmable signal lamp to send a preset alignment signal to the driver of the target mixer truck, so that the target mixer truck is parked according to the preset alignment signal; When it is determined that the target mixer truck is in a stable state, a discharging signal is generated.

6. The method of monitoring the discharge of a mixing plant according to claim 2, characterized in that, After the discharging signal is generated, further comprising: obtaining a fourth video frame of the second monitoring video, the generation time of the fourth video being after the second video frame; based on the fourth video frame of the second monitoring video, determining the material level position in the receiving hopper of the target mixer truck; When the material level position is higher than the preset position, a second control signal is sent to the control device corresponding to the discharging port of the mixing station, the second control signal being used to instruct the discharging port of the mixing station to stop discharging or adjust the discharging speed.

7. A kind of mixing station unloading monitoring device, it is applied to the through type unloading port mixing station of two mixing trucks back-to-back backing unloading, it is characterized in being, comprising: a first video acquisition module for acquiring a first video frame of a first monitoring video of a mixing station discharging area; obtaining a third video frame of the first monitoring video, the generation time of the third video frame being after the first video frame; an algorithm recognition module for detecting and recognizing the first video frame of the first monitoring video to obtain a first recognition result, the first recognition result comprising a target mixer truck; a second video acquisition module for acquiring a second video frame of a second monitoring video of a mixing station discharging area based on the first recognition result; the second video frame of the second monitoring video of the mixing station discharging area based on the first recognition result comprises: when the first recognition result is that the receiving hopper of the target mixer truck is in a target area to be discharged, a second video frame of a monitoring video of a corresponding direction of the target mixer truck is acquired, and the target area to be discharged is in the mixing station discharging area; a discharging monitoring module for monitoring the discharging of the mixing station based on the third video frame of the first monitoring video and the second video frame of the second monitoring video.

8. A mixing plant, characterized in that comprising: the mixing station discharging monitoring device of claim 7; a monitoring camera, the monitoring camera comprising a first monitoring camera, a second monitoring camera and a third monitoring camera arranged at different positions of the mixing station discharging area; wherein the first monitoring camera, the second monitoring camera and the third monitoring camera are configured to shoot monitoring videos of the mixing station discharging area.

9. The mixing station of claim 8, wherein the first monitoring camera is installed at the intersection of a straight line passing through the center of the discharging port of the mixing station perpendicular to the reversing route of the mixer truck and the mixing station; the second monitoring camera is installed at the first intersection of a straight line passing through the center of the discharging port of the mixing station parallel to the reversing route of the mixer truck and the mixing station; the third monitoring camera is installed at the second intersection of a straight line passing through the center of the discharging port of the mixing station parallel to the reversing route of the mixer truck and the mixing station, and the first monitoring camera, the second monitoring camera and the third monitoring camera all face the direction of the discharging port of the mixing station.

Images